2023-10-16T13:25:46.451 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T13:25:46.452 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} --verbose --name rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020 -- /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/orig.config.yaml 2023-10-16T13:25:46.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T13:25:46.581 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020 branch: rishabh-2023oct13 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: null first_in_suite: false job_id: '7429020' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-b2 sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-b2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes - tasks.cephfs.test_subvolume.TestSubvolume teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:17:50 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T13:25:46.582 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa; will attempt to use it 2023-10-16T13:25:46.583 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks 2023-10-16T13:25:46.583 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T13:25:46.585 INFO:teuthology.task.internal:Checking packages... 2023-10-16T13:25:46.607 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T13:25:46.607 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T13:25:46.608 INFO:teuthology.packaging:ref: None 2023-10-16T13:25:46.608 INFO:teuthology.packaging:tag: None 2023-10-16T13:25:46.608 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T13:25:46.608 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:25:46.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T13:25:46.855 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T13:25:46.856 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T13:25:46.862 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T13:25:46.863 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T13:25:46.868 INFO:teuthology.task.internal:Saving configuration 2023-10-16T13:25:46.884 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T13:25:46.890 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:25:46.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 13:20:41.857962', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:25:46.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 13:20:41.855780', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:25:46.936 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T13:25:46.942 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-16T13:25:46.943 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-16T13:25:46.943 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T13:25:47.015 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd2a128da60>, signals=[15]) 2023-10-16T13:25:47.016 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T13:25:47.022 INFO:teuthology.task.internal:Opening connections... 2023-10-16T13:25:47.022 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:25:47.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:25:47.092 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:25:47.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:25:47.160 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T13:25:47.167 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-10-16T13:25:47.189 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-10-16T13:25:47.190 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-10-16T13:25:47.250 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T13:25:47.250 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T13:25:47.250 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-10-16T13:25:47.251 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-10-16T13:25:47.251 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-10-16T13:25:47.251 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-10-16T13:25:47.251 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T13:25:47.251 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-10-16T13:25:47.252 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T13:25:47.252 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T13:25:47.252 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T13:25:47.252 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T13:25:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:25:47.253 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T13:25:47.253 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T13:25:47.253 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T13:25:47.253 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T13:25:47.254 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-10-16T13:25:47.276 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-10-16T13:25:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-10-16T13:25:47.297 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-10-16T13:25:47.357 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T13:25:47.358 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T13:25:47.358 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-10-16T13:25:47.358 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-10-16T13:25:47.358 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6" 2023-10-16T13:25:47.358 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-10-16T13:25:47.359 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T13:25:47.359 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-10-16T13:25:47.359 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T13:25:47.359 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T13:25:47.359 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T13:25:47.360 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T13:25:47.360 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:25:47.360 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T13:25:47.360 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T13:25:47.360 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T13:25:47.361 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T13:25:47.361 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-10-16T13:25:47.385 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T13:25:47.394 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T13:25:47.399 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T13:25:47.400 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-10-16T13:25:47.402 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2023-10-16T13:25:47.420 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T13:25:47.427 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T13:25:47.427 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-10-16T13:25:47.462 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2023-10-16T13:25:47.491 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T13:25:47.540 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T13:25:47.553 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T13:25:47.554 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-16T13:25:47.554 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-16T13:25:47.554 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T13:25:47.555 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T13:25:47.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:25:47.575 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-10-16T13:25:47.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:25:47.577 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-10-16T13:25:47.635 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:47.635 INFO:teuthology.task.kernel:Running kernel on smithi112: 4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:47.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2023-10-16T13:25:47.638 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:47.638 INFO:teuthology.task.kernel:Running kernel on smithi005: 4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:47.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2023-10-16T13:25:48.847 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-16T13:25:48.848 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-16T13:25:48.849 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-16T13:25:48.849 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-16T13:25:50.309 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-16T13:25:50.372 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-10-16T13:25:50.984 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-16T13:25:51.489 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-16T13:25:54.443 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-10-16T13:25:55.145 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T13:25:55.147 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 581 kB/s | 24 kB 00:00 2023-10-16T13:25:55.196 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-16T13:25:55.197 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2023-10-16T13:25:55.198 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-16T13:25:55.340 DEBUG:teuthology.orchestra.run.smithi112:> echo no | sudo yum reinstall kernel || true 2023-10-16T13:25:55.670 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-16T13:25:55.670 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-16T13:25:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T13:25:55.936 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Oct 2023 01:25:54 PM UTC. 2023-10-16T13:25:55.941 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-16T13:25:55.942 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-10-16T13:25:55.942 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-16T13:25:55.976 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T13:25:56.013 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2023-10-16T13:25:56.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum reinstall -y kernel || true 2023-10-16T13:25:56.074 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2023-10-16T13:25:56.387 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-16T13:25:56.387 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-16T13:25:56.468 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-16T13:25:56.468 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-16T13:25:56.653 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 01:25:54 PM UTC. 2023-10-16T13:25:56.694 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T13:25:56.736 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2023-10-16T13:25:56.743 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Oct 2023 01:25:55 PM UTC. 2023-10-16T13:25:56.787 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T13:25:56.789 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T13:25:56.822 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-10-16T13:25:56.867 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:56.868 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:56.868 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T13:25:56.868 DEBUG:teuthology.parallel:result is None 2023-10-16T13:25:56.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2023-10-16T13:25:57.219 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-16T13:25:57.220 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-16T13:25:57.485 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 01:25:55 PM UTC. 2023-10-16T13:25:57.527 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T13:25:57.557 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-10-16T13:25:57.604 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T13:25:57.771 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:57.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T13:25:57.772 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T13:25:57.772 DEBUG:teuthology.parallel:result is None 2023-10-16T13:25:57.772 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T13:25:57.779 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T13:25:57.780 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T13:25:57.782 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T13:25:57.800 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T13:25:57.806 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T13:25:57.813 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T13:25:57.814 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T13:25:57.839 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T13:25:57.863 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T13:25:57.870 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T13:25:57.870 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T13:25:57.897 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T13:25:57.923 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T13:25:57.934 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T13:25:57.940 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T13:25:57.960 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T13:25:57.962 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T13:25:57.969 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T13:25:57.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T13:25:57.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T13:25:58.030 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T13:25:58.039 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T13:25:58.039 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T13:25:58.046 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T13:25:58.087 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T13:25:58.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T13:25:58.197 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T13:25:58.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T13:25:58.324 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:25:58.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T13:25:58.392 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T13:25:58.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T13:25:58.486 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T13:25:58.570 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T13:25:58.612 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:25:58.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T13:25:58.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-10-16T13:25:58.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2023-10-16T13:25:58.771 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:25:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:25:59.223 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T13:25:59.231 INFO:teuthology.task.internal:Starting timer... 2023-10-16T13:25:59.232 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T13:25:59.314 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T13:25:59.323 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-16T13:25:59.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2023-10-16T13:25:59.388 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2023-10-16T13:25:59.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2023-10-16T13:25:59.462 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2023-10-16T13:25:59.464 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T13:25:59.464 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2023-10-16T13:25:59.487 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2023-10-16T13:25:59.488 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2023-10-16T13:25:59.511 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2023-10-16T13:25:59.511 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2023-10-16T13:25:59.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:25:59.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:25:59.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:25:59.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:25:59.585 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T13:25:59.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2023-10-16T13:25:59.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2023-10-16T13:25:59.656 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T13:25:59.666 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T13:25:59.672 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T13:25:59.784 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T13:25:59.800 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T13:25:59.801 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T13:34:57.450 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2023-10-16T13:34:57.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-16T13:34:57.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:34:57.523 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-10-16T13:34:57.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-16T13:34:57.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-16T13:34:57.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T13:34:57.662 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-10-16T13:34:57.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-16T13:34:57.733 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T13:34:57.744 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T13:34:57.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T13:34:57.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:34:57.748 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T13:34:57.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:34:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T13:34:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T13:34:57.805 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T13:34:57.819 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T13:34:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2023-10-16T13:34:57.878 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2023-10-16T13:34:57.882 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2023-10-16T13:34:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T13:34:57.894 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2023-10-16T13:34:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T13:34:57.908 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T13:34:57.921 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T13:34:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-10-16T13:34:57.983 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:34:57.984 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-10-16T13:34:57.984 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.984 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.984 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.985 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-10-16T13:34:57.989 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:34:57.989 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-10-16T13:34:57.989 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.989 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.989 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.990 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:34:57.991 INFO:teuthology.run_tasks:Running task install... 2023-10-16T13:34:57.999 DEBUG:teuthology.task.install:project ceph 2023-10-16T13:34:57.999 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T13:34:58.000 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T13:34:58.000 INFO:teuthology.task.install:Using flavor: default 2023-10-16T13:34:58.006 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T13:34:58.006 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T13:34:58.007 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T13:34:58.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:34:58.010 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T13:34:58.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:34:58.156 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T13:34:58.157 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T13:34:58.259 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T13:34:58.260 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T13:34:58.264 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T13:34:58.265 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:34:58.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T13:34:58.295 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T13:34:58.296 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T13:34:58.363 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T13:34:58.440 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T13:34:58.463 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T13:34:58.463 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:34:58.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T13:34:58.493 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T13:34:58.493 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T13:34:58.506 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2023-10-16T13:34:58.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2023-10-16T13:34:58.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T13:34:58.643 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T13:34:58.712 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2023-10-16T13:34:58.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2023-10-16T13:34:58.879 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-16T13:34:59.107 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-16T13:34:59.134 INFO:teuthology.orchestra.run.smithi112.stdout:44 files removed 2023-10-16T13:34:59.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T13:34:59.337 INFO:teuthology.orchestra.run.smithi005.stdout:44 files removed 2023-10-16T13:34:59.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T13:34:59.512 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-16T13:34:59.735 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-16T13:35:00.426 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 144 kB/s | 81 kB 00:00 2023-10-16T13:35:00.512 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 200 kB/s | 81 kB 00:00 2023-10-16T13:35:00.785 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-16T13:35:00.946 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2023-10-16T13:35:01.161 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-10-16T13:35:01.356 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-16T13:35:01.445 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-10-16T13:35:01.565 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-16T13:35:02.472 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-16T13:35:05.995 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 386 kB/s | 24 kB 00:00 2023-10-16T13:35:06.947 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-10-16T13:35:14.973 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 16 MB 00:13 2023-10-16T13:35:15.040 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-16T13:35:18.747 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-10-16T13:35:19.724 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-10-16T13:35:26.071 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:35:26.072 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:35:26.086 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T13:35:26.087 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T13:35:26.089 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T13:35:26.090 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:35:26.092 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:35:26.095 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T13:35:26.096 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:35:26.228 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-16T13:35:26.240 INFO:teuthology.orchestra.run.smithi112.stdout:=========================================================================================================================== 2023-10-16T13:35:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2023-10-16T13:35:26.241 INFO:teuthology.orchestra.run.smithi112.stdout:=========================================================================================================================== 2023-10-16T13:35:26.241 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2023-10-16T13:35:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T13:35:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T13:35:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T13:35:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T13:35:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T13:35:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T13:35:26.242 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T13:35:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T13:35:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T13:35:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T13:35:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T13:35:26.243 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T13:35:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T13:35:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T13:35:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T13:35:26.244 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T13:35:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T13:35:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T13:35:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T13:35:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T13:35:26.245 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T13:35:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T13:35:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T13:35:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T13:35:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T13:35:26.246 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T13:35:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T13:35:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T13:35:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T13:35:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T13:35:26.247 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T13:35:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T13:35:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T13:35:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T13:35:26.248 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T13:35:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T13:35:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T13:35:26.249 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2023-10-16T13:35:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T13:35:26.249 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:35:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:35:26.250 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2023-10-16T13:35:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T13:35:26.250 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T13:35:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T13:35:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T13:35:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T13:35:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T13:35:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T13:35:26.251 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T13:35:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T13:35:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T13:35:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T13:35:26.252 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T13:35:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T13:35:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T13:35:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T13:35:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T13:35:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T13:35:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T13:35:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T13:35:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T13:35:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T13:35:26.254 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T13:35:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T13:35:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T13:35:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T13:35:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T13:35:26.255 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T13:35:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T13:35:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T13:35:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T13:35:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T13:35:26.256 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T13:35:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T13:35:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T13:35:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T13:35:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T13:35:26.257 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T13:35:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T13:35:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T13:35:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T13:35:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T13:35:26.258 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T13:35:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T13:35:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T13:35:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T13:35:26.259 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T13:35:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T13:35:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T13:35:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T13:35:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T13:35:26.260 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T13:35:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T13:35:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T13:35:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:35:26.261 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T13:35:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T13:35:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T13:35:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T13:35:26.262 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T13:35:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T13:35:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T13:35:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T13:35:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T13:35:26.263 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T13:35:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T13:35:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T13:35:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T13:35:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T13:35:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T13:35:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T13:35:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T13:35:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T13:35:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:35:26.265 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T13:35:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T13:35:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T13:35:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T13:35:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T13:35:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T13:35:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T13:35:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T13:35:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T13:35:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T13:35:26.267 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T13:35:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T13:35:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T13:35:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T13:35:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T13:35:26.268 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T13:35:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T13:35:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T13:35:26.269 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling module streams: 2023-10-16T13:35:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql 10 2023-10-16T13:35:26.269 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:35:26.270 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-10-16T13:35:26.270 INFO:teuthology.orchestra.run.smithi112.stdout:=========================================================================================================================== 2023-10-16T13:35:26.270 INFO:teuthology.orchestra.run.smithi112.stdout:Install 128 Packages 2023-10-16T13:35:26.270 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 3 Packages 2023-10-16T13:35:26.270 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:35:26.271 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 209 M 2023-10-16T13:35:26.271 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-10-16T13:35:26.632 INFO:teuthology.orchestra.run.smithi112.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-10-16T13:35:27.033 INFO:teuthology.orchestra.run.smithi112.stdout:(2/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 9.2 MB/s | 5.4 MB 00:00 2023-10-16T13:35:27.100 INFO:teuthology.orchestra.run.smithi112.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.5 MB/s | 167 kB 00:00 2023-10-16T13:35:27.333 INFO:teuthology.orchestra.run.smithi112.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 9.9 MB/s | 2.3 MB 00:00 2023-10-16T13:35:27.542 INFO:teuthology.orchestra.run.smithi112.stdout:(5/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-16T13:35:27.684 INFO:teuthology.orchestra.run.smithi112.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 4.6 MB/s | 1.6 MB 00:00 2023-10-16T13:35:28.175 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-16T13:35:28.384 INFO:teuthology.orchestra.run.smithi112.stdout:(7/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 12 MB/s | 23 MB 00:01 2023-10-16T13:35:29.093 INFO:teuthology.orchestra.run.smithi112.stdout:(8/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x86 13 MB/s | 18 MB 00:01 2023-10-16T13:35:29.143 INFO:teuthology.orchestra.run.smithi112.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 489 kB/s | 24 kB 00:00 2023-10-16T13:35:29.351 INFO:teuthology.orchestra.run.smithi112.stdout:(10/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x8 2.6 MB/s | 4.6 MB 00:01 2023-10-16T13:35:29.502 INFO:teuthology.orchestra.run.smithi112.stdout:(11/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 12 MB/s | 14 MB 00:01 2023-10-16T13:35:29.527 INFO:teuthology.orchestra.run.smithi112.stdout:(12/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.5 MB/s | 261 kB 00:00 2023-10-16T13:35:29.552 INFO:teuthology.orchestra.run.smithi112.stdout:(13/131): libcephfs-devel-18.0.0-6730.g4ba8a190 619 kB/s | 31 kB 00:00 2023-10-16T13:35:29.603 INFO:teuthology.orchestra.run.smithi112.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 3.6 MB/s | 184 kB 00:00 2023-10-16T13:35:29.686 INFO:teuthology.orchestra.run.smithi112.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.6 MB/s | 139 kB 00:00 2023-10-16T13:35:29.728 INFO:teuthology.orchestra.run.smithi112.stdout:(16/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 4.1 MB/s | 839 kB 00:00 2023-10-16T13:35:29.771 INFO:teuthology.orchestra.run.smithi112.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 6.1 MB/s | 518 kB 00:00 2023-10-16T13:35:29.846 INFO:teuthology.orchestra.run.smithi112.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 597 kB/s | 45 kB 00:00 2023-10-16T13:35:29.921 INFO:teuthology.orchestra.run.smithi112.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.6 MB/s | 126 kB 00:00 2023-10-16T13:35:30.005 INFO:teuthology.orchestra.run.smithi112.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.3 MB/s | 197 kB 00:00 2023-10-16T13:35:30.124 INFO:teuthology.orchestra.run.smithi112.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 3.0 MB/s | 371 kB 00:00 2023-10-16T13:35:30.205 INFO:teuthology.orchestra.run.smithi112.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 4.4 MB/s | 365 kB 00:00 2023-10-16T13:35:30.281 INFO:teuthology.orchestra.run.smithi112.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.4 MB/s | 107 kB 00:00 2023-10-16T13:35:30.364 INFO:teuthology.orchestra.run.smithi112.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.1 MB/s | 94 kB 00:00 2023-10-16T13:35:30.814 INFO:teuthology.orchestra.run.smithi112.stdout:(25/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 8.0 MB/s | 3.6 MB 00:00 2023-10-16T13:35:30.898 INFO:teuthology.orchestra.run.smithi112.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-16T13:35:31.022 INFO:teuthology.orchestra.run.smithi112.stdout:(27/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 5.4 MB/s | 6.9 MB 00:01 2023-10-16T13:35:31.049 INFO:teuthology.orchestra.run.smithi112.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6730.g 153 kB/s | 23 kB 00:00 2023-10-16T13:35:31.108 INFO:teuthology.orchestra.run.smithi112.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.5 MB/s | 132 kB 00:00 2023-10-16T13:35:31.274 INFO:teuthology.orchestra.run.smithi112.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 7.8 MB/s | 1.8 MB 00:00 2023-10-16T13:35:31.358 INFO:teuthology.orchestra.run.smithi112.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.8 MB/s | 242 kB 00:00 2023-10-16T13:35:31.425 INFO:teuthology.orchestra.run.smithi112.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 713 kB/s | 47 kB 00:00 2023-10-16T13:35:31.500 INFO:teuthology.orchestra.run.smithi112.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 200 kB/s | 15 kB 00:00 2023-10-16T13:35:31.592 INFO:teuthology.orchestra.run.smithi112.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.8 MB/s | 261 kB 00:00 2023-10-16T13:35:31.684 INFO:teuthology.orchestra.run.smithi112.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.0 MB/s | 192 kB 00:00 2023-10-16T13:35:31.760 INFO:teuthology.orchestra.run.smithi112.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 241 kB/s | 18 kB 00:00 2023-10-16T13:35:32.268 INFO:teuthology.orchestra.run.smithi112.stdout:(37/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 16 MB/s | 49 MB 00:03 2023-10-16T13:35:32.410 INFO:teuthology.orchestra.run.smithi112.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-10-16T13:35:32.694 INFO:teuthology.orchestra.run.smithi112.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 138 kB/s | 59 kB 00:00 2023-10-16T13:35:32.719 INFO:teuthology.orchestra.run.smithi112.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 319 kB/s | 306 kB 00:00 2023-10-16T13:35:32.828 INFO:teuthology.orchestra.run.smithi112.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 180 kB/s | 75 kB 00:00 2023-10-16T13:35:32.845 INFO:teuthology.orchestra.run.smithi112.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 348 kB/s | 44 kB 00:00 2023-10-16T13:35:32.945 INFO:teuthology.orchestra.run.smithi112.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-10-16T13:35:33.054 INFO:teuthology.orchestra.run.smithi112.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 151 kB/s | 16 kB 00:00 2023-10-16T13:35:33.079 INFO:teuthology.orchestra.run.smithi112.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-10-16T13:35:33.104 INFO:teuthology.orchestra.run.smithi112.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 671 kB/s | 185 kB 00:00 2023-10-16T13:35:33.188 INFO:teuthology.orchestra.run.smithi112.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-10-16T13:35:33.248 INFO:teuthology.orchestra.run.smithi112.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2023-10-16T13:35:33.280 INFO:teuthology.orchestra.run.smithi112.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 463 kB/s | 81 kB 00:00 2023-10-16T13:35:33.297 INFO:teuthology.orchestra.run.smithi112.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-10-16T13:35:33.339 INFO:teuthology.orchestra.run.smithi112.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 194 kB/s | 18 kB 00:00 2023-10-16T13:35:33.398 INFO:teuthology.orchestra.run.smithi112.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 486 kB/s | 49 kB 00:00 2023-10-16T13:35:33.431 INFO:teuthology.orchestra.run.smithi112.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2023-10-16T13:35:33.515 INFO:teuthology.orchestra.run.smithi112.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 515 kB/s | 60 kB 00:00 2023-10-16T13:35:33.557 INFO:teuthology.orchestra.run.smithi112.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 4.2 MB/s | 1.2 MB 00:00 2023-10-16T13:35:33.582 INFO:teuthology.orchestra.run.smithi112.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-16T13:35:33.624 INFO:teuthology.orchestra.run.smithi112.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-16T13:35:33.658 INFO:teuthology.orchestra.run.smithi112.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-10-16T13:35:33.708 INFO:teuthology.orchestra.run.smithi112.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-16T13:35:33.742 INFO:teuthology.orchestra.run.smithi112.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 547 kB/s | 64 kB 00:00 2023-10-16T13:35:33.767 INFO:teuthology.orchestra.run.smithi112.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2023-10-16T13:35:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-16T13:35:33.851 INFO:teuthology.orchestra.run.smithi112.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-10-16T13:35:33.876 INFO:teuthology.orchestra.run.smithi112.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-10-16T13:35:33.935 INFO:teuthology.orchestra.run.smithi112.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-16T13:35:33.977 INFO:teuthology.orchestra.run.smithi112.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2023-10-16T13:35:34.019 INFO:teuthology.orchestra.run.smithi112.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-10-16T13:35:34.044 INFO:teuthology.orchestra.run.smithi112.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 785 kB/s | 85 kB 00:00 2023-10-16T13:35:34.069 INFO:teuthology.orchestra.run.smithi112.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-16T13:35:34.094 INFO:teuthology.orchestra.run.smithi112.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 195 kB/s | 23 kB 00:00 2023-10-16T13:35:34.161 INFO:teuthology.orchestra.run.smithi112.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 510 kB/s | 47 kB 00:00 2023-10-16T13:35:34.187 INFO:teuthology.orchestra.run.smithi112.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-10-16T13:35:34.212 INFO:teuthology.orchestra.run.smithi112.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-16T13:35:34.238 INFO:teuthology.orchestra.run.smithi112.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T13:35:34.263 INFO:teuthology.orchestra.run.smithi112.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 957 kB/s | 48 kB 00:00 2023-10-16T13:35:34.288 INFO:teuthology.orchestra.run.smithi112.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-16T13:35:34.313 INFO:teuthology.orchestra.run.smithi112.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-10-16T13:35:34.338 INFO:teuthology.orchestra.run.smithi112.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-10-16T13:35:34.381 INFO:teuthology.orchestra.run.smithi112.stdout:(79/131): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2023-10-16T13:35:34.406 INFO:teuthology.orchestra.run.smithi112.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-10-16T13:35:34.448 INFO:teuthology.orchestra.run.smithi112.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-10-16T13:35:34.473 INFO:teuthology.orchestra.run.smithi112.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 203 kB/s | 19 kB 00:00 2023-10-16T13:35:34.498 INFO:teuthology.orchestra.run.smithi112.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.7 MB/s | 155 kB 00:00 2023-10-16T13:35:34.515 INFO:teuthology.orchestra.run.smithi112.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 427 kB/s | 18 kB 00:00 2023-10-16T13:35:34.576 INFO:teuthology.orchestra.run.smithi112.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.3 MB/s | 559 kB 00:00 2023-10-16T13:35:34.607 INFO:teuthology.orchestra.run.smithi112.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-10-16T13:35:34.641 INFO:teuthology.orchestra.run.smithi112.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.1 MB/s | 605 kB 00:00 2023-10-16T13:35:34.666 INFO:teuthology.orchestra.run.smithi112.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-10-16T13:35:34.692 INFO:teuthology.orchestra.run.smithi112.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T13:35:34.709 INFO:teuthology.orchestra.run.smithi112.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-10-16T13:35:34.767 INFO:teuthology.orchestra.run.smithi112.stdout:(91/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 12 MB/s | 2.3 MB 00:00 2023-10-16T13:35:34.784 INFO:teuthology.orchestra.run.smithi112.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 767 kB/s | 58 kB 00:00 2023-10-16T13:35:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:(93/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 837 kB/s | 98 kB 00:00 2023-10-16T13:35:34.827 INFO:teuthology.orchestra.run.smithi112.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 657 kB/s | 39 kB 00:00 2023-10-16T13:35:34.860 INFO:teuthology.orchestra.run.smithi112.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 8.3 MB/s | 644 kB 00:00 2023-10-16T13:35:34.885 INFO:teuthology.orchestra.run.smithi112.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 138 kB 00:00 2023-10-16T13:35:34.910 INFO:teuthology.orchestra.run.smithi112.stdout:(97/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.7 MB/s | 171 kB 00:00 2023-10-16T13:35:34.936 INFO:teuthology.orchestra.run.smithi112.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-10-16T13:35:34.978 INFO:teuthology.orchestra.run.smithi112.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 807 kB/s | 54 kB 00:00 2023-10-16T13:35:35.028 INFO:teuthology.orchestra.run.smithi112.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.7 MB/s | 259 kB 00:00 2023-10-16T13:35:35.062 INFO:teuthology.orchestra.run.smithi112.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-10-16T13:35:35.087 INFO:teuthology.orchestra.run.smithi112.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-10-16T13:35:35.129 INFO:teuthology.orchestra.run.smithi112.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-16T13:35:35.171 INFO:teuthology.orchestra.run.smithi112.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-10-16T13:35:35.196 INFO:teuthology.orchestra.run.smithi112.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-16T13:35:35.230 INFO:teuthology.orchestra.run.smithi112.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-16T13:35:35.272 INFO:teuthology.orchestra.run.smithi112.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-16T13:35:35.322 INFO:teuthology.orchestra.run.smithi112.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 534 kB/s | 27 kB 00:00 2023-10-16T13:35:35.372 INFO:teuthology.orchestra.run.smithi112.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-16T13:35:35.473 INFO:teuthology.orchestra.run.smithi112.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-16T13:35:35.498 INFO:teuthology.orchestra.run.smithi112.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 351 kB/s | 44 kB 00:00 2023-10-16T13:35:35.557 INFO:teuthology.orchestra.run.smithi112.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-16T13:35:35.623 INFO:teuthology.orchestra.run.smithi112.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 25 MB/s | 3.7 MB 00:00 2023-10-16T13:35:35.648 INFO:teuthology.orchestra.run.smithi112.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2023-10-16T13:35:35.674 INFO:teuthology.orchestra.run.smithi112.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-10-16T13:35:35.691 INFO:teuthology.orchestra.run.smithi112.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2023-10-16T13:35:35.833 INFO:teuthology.orchestra.run.smithi112.stdout:(117/131): python3-scipy-1.0.0-21.module+el8.5. 14 MB/s | 14 MB 00:00 2023-10-16T13:35:35.858 INFO:teuthology.orchestra.run.smithi112.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 109 kB/s | 20 kB 00:00 2023-10-16T13:35:35.910 INFO:teuthology.orchestra.run.smithi112.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 472 kB/s | 103 kB 00:00 2023-10-16T13:35:35.950 INFO:teuthology.orchestra.run.smithi112.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-10-16T13:35:35.975 INFO:teuthology.orchestra.run.smithi112.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.0 MB/s | 198 kB 00:00 2023-10-16T13:35:36.026 INFO:teuthology.orchestra.run.smithi112.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-10-16T13:35:36.126 INFO:teuthology.orchestra.run.smithi112.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-10-16T13:35:36.160 INFO:teuthology.orchestra.run.smithi112.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-10-16T13:35:36.235 INFO:teuthology.orchestra.run.smithi112.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-16T13:35:36.277 INFO:teuthology.orchestra.run.smithi112.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-16T13:35:36.355 INFO:teuthology.orchestra.run.smithi112.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-10-16T13:35:36.444 INFO:teuthology.orchestra.run.smithi112.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-10-16T13:35:36.503 INFO:teuthology.orchestra.run.smithi112.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-16T13:35:36.720 INFO:teuthology.orchestra.run.smithi112.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 10 MB/s | 3.7 MB 00:00 2023-10-16T13:35:36.929 INFO:teuthology.orchestra.run.smithi112.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 5.8 MB/s | 3.7 MB 00:00 2023-10-16T13:35:36.931 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:35:36.931 INFO:teuthology.orchestra.run.smithi112.stdout:Total 20 MB/s | 209 MB 00:10 2023-10-16T13:35:37.754 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-10-16T13:35:37.873 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-10-16T13:35:37.874 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-10-16T13:35:38.996 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-10-16T13:35:39.000 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-10-16T13:35:40.166 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:35:40.167 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T13:35:40.181 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T13:35:40.182 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T13:35:40.183 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T13:35:40.185 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:35:40.187 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:35:40.190 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T13:35:40.191 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:35:40.334 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-16T13:35:40.348 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-16T13:35:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-10-16T13:35:40.349 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-16T13:35:40.349 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-10-16T13:35:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T13:35:40.349 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T13:35:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T13:35:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T13:35:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T13:35:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T13:35:40.350 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T13:35:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T13:35:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T13:35:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T13:35:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T13:35:40.351 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T13:35:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T13:35:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T13:35:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T13:35:40.352 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T13:35:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T13:35:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T13:35:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T13:35:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T13:35:40.353 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T13:35:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T13:35:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T13:35:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T13:35:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T13:35:40.354 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T13:35:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T13:35:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T13:35:40.355 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T13:35:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T13:35:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T13:35:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T13:35:40.356 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T13:35:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T13:35:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T13:35:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T13:35:40.357 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T13:35:40.357 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-10-16T13:35:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T13:35:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:35:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T13:35:40.358 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-10-16T13:35:40.358 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T13:35:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T13:35:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T13:35:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T13:35:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T13:35:40.359 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T13:35:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T13:35:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T13:35:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T13:35:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T13:35:40.360 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T13:35:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T13:35:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T13:35:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T13:35:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T13:35:40.361 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T13:35:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T13:35:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T13:35:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T13:35:40.362 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T13:35:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T13:35:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T13:35:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T13:35:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T13:35:40.363 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T13:35:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T13:35:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T13:35:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T13:35:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T13:35:40.364 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T13:35:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T13:35:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T13:35:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T13:35:40.365 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T13:35:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T13:35:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T13:35:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T13:35:40.366 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T13:35:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T13:35:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T13:35:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T13:35:40.367 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T13:35:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T13:35:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T13:35:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T13:35:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T13:35:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T13:35:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T13:35:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T13:35:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T13:35:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T13:35:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T13:35:40.369 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T13:35:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:35:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T13:35:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T13:35:40.370 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T13:35:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T13:35:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T13:35:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T13:35:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T13:35:40.371 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T13:35:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T13:35:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T13:35:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T13:35:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T13:35:40.372 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T13:35:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T13:35:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T13:35:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T13:35:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T13:35:40.373 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T13:35:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T13:35:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T13:35:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T13:35:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T13:35:40.374 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T13:35:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T13:35:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T13:35:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T13:35:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T13:35:40.375 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T13:35:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T13:35:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T13:35:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T13:35:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T13:35:40.376 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T13:35:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T13:35:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T13:35:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T13:35:40.377 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T13:35:40.377 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-10-16T13:35:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql 10 2023-10-16T13:35:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:35:40.378 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-16T13:35:40.378 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-16T13:35:40.378 INFO:teuthology.orchestra.run.smithi005.stdout:Install 128 Packages 2023-10-16T13:35:40.379 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 3 Packages 2023-10-16T13:35:40.379 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:35:40.380 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 209 M 2023-10-16T13:35:40.380 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-10-16T13:35:40.592 INFO:teuthology.orchestra.run.smithi005.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-10-16T13:35:40.984 INFO:teuthology.orchestra.run.smithi005.stdout:(2/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 9.3 MB/s | 5.4 MB 00:00 2023-10-16T13:35:41.068 INFO:teuthology.orchestra.run.smithi005.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.0 MB/s | 167 kB 00:00 2023-10-16T13:35:41.368 INFO:teuthology.orchestra.run.smithi005.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 7.7 MB/s | 2.3 MB 00:00 2023-10-16T13:35:41.585 INFO:teuthology.orchestra.run.smithi005.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 7.5 MB/s | 1.6 MB 00:00 2023-10-16T13:35:42.110 INFO:teuthology.orchestra.run.smithi005.stdout:(6/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 13 MB/s | 23 MB 00:01 2023-10-16T13:35:42.144 INFO:teuthology.orchestra.run.smithi005.stdout:(7/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 592 kB/s | 918 kB 00:01 2023-10-16T13:35:42.244 INFO:teuthology.orchestra.run.smithi005.stdout:(8/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 7.0 MB/s | 4.6 MB 00:00 2023-10-16T13:35:42.294 INFO:teuthology.orchestra.run.smithi005.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 488 kB/s | 24 kB 00:00 2023-10-16T13:35:43.536 INFO:teuthology.orchestra.run.smithi005.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 13 MB/s | 18 MB 00:01 2023-10-16T13:35:43.595 INFO:teuthology.orchestra.run.smithi005.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 4.4 MB/s | 261 kB 00:00 2023-10-16T13:35:43.693 INFO:teuthology.orchestra.run.smithi005.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 318 kB/s | 31 kB 00:00 2023-10-16T13:35:43.795 INFO:teuthology.orchestra.run.smithi005.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 8.0 MB/s | 839 kB 00:00 2023-10-16T13:35:43.854 INFO:teuthology.orchestra.run.smithi005.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 3.1 MB/s | 184 kB 00:00 2023-10-16T13:35:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 2.3 MB/s | 139 kB 00:00 2023-10-16T13:35:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-10-16T13:35:44.013 INFO:teuthology.orchestra.run.smithi005.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 5.1 MB/s | 518 kB 00:00 2023-10-16T13:35:44.197 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T13:35:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T13:35:44.557 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:35:44.647 INFO:teuthology.orchestra.run.smithi005.stdout:(17/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 11 MB/s | 6.9 MB 00:00 2023-10-16T13:35:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T13:35:44.713 INFO:teuthology.orchestra.run.smithi005.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 672 kB/s | 45 kB 00:00 2023-10-16T13:35:44.780 INFO:teuthology.orchestra.run.smithi005.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.8 MB/s | 126 kB 00:00 2023-10-16T13:35:44.864 INFO:teuthology.orchestra.run.smithi005.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.3 MB/s | 197 kB 00:00 2023-10-16T13:35:44.882 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:35:44.939 INFO:teuthology.orchestra.run.smithi005.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 4.8 MB/s | 371 kB 00:00 2023-10-16T13:35:45.031 INFO:teuthology.orchestra.run.smithi005.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 3.9 MB/s | 365 kB 00:00 2023-10-16T13:35:45.098 INFO:teuthology.orchestra.run.smithi005.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.6 MB/s | 107 kB 00:00 2023-10-16T13:35:45.173 INFO:teuthology.orchestra.run.smithi005.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-16T13:35:45.291 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T13:35:45.440 INFO:teuthology.orchestra.run.smithi005.stdout:(25/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 4.2 MB/s | 14 MB 00:03 2023-10-16T13:35:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:35:45.516 INFO:teuthology.orchestra.run.smithi005.stdout:(26/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 10 MB/s | 3.6 MB 00:00 2023-10-16T13:35:45.541 INFO:teuthology.orchestra.run.smithi005.stdout:(27/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.7 MB/s | 179 kB 00:00 2023-10-16T13:35:45.558 INFO:teuthology.orchestra.run.smithi005.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6730.g 554 kB/s | 23 kB 00:00 2023-10-16T13:35:45.616 INFO:teuthology.orchestra.run.smithi005.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.7 MB/s | 132 kB 00:00 2023-10-16T13:35:45.758 INFO:teuthology.orchestra.run.smithi005.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 8.8 MB/s | 1.8 MB 00:00 2023-10-16T13:35:45.834 INFO:teuthology.orchestra.run.smithi005.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 3.2 MB/s | 242 kB 00:00 2023-10-16T13:35:45.899 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T13:35:45.901 INFO:teuthology.orchestra.run.smithi005.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 709 kB/s | 47 kB 00:00 2023-10-16T13:35:46.140 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:35:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:35:46.385 INFO:teuthology.orchestra.run.smithi005.stdout:(33/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 12 MB/s | 49 MB 00:04 2023-10-16T13:35:46.410 INFO:teuthology.orchestra.run.smithi005.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6730.g4 29 kB/s | 15 kB 00:00 2023-10-16T13:35:46.452 INFO:teuthology.orchestra.run.smithi005.stdout:(35/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 3.8 MB/s | 261 kB 00:00 2023-10-16T13:35:46.477 INFO:teuthology.orchestra.run.smithi005.stdout:(36/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.8 MB/s | 192 kB 00:00 2023-10-16T13:35:46.482 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:35:46.502 INFO:teuthology.orchestra.run.smithi005.stdout:(37/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 363 kB/s | 18 kB 00:00 2023-10-16T13:35:46.600 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:35:46.602 INFO:teuthology.orchestra.run.smithi005.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 7.5 MB/s | 7.4 MB 00:00 2023-10-16T13:35:46.753 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:35:46.786 INFO:teuthology.orchestra.run.smithi005.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 207 kB/s | 59 kB 00:00 2023-10-16T13:35:46.811 INFO:teuthology.orchestra.run.smithi005.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 378 kB/s | 75 kB 00:00 2023-10-16T13:35:46.903 INFO:teuthology.orchestra.run.smithi005.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-10-16T13:35:46.924 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T13:35:46.954 INFO:teuthology.orchestra.run.smithi005.stdout:(42/131): gperftools-libs-2.7-9.el8.x86_64.rpm 642 kB/s | 306 kB 00:00 2023-10-16T13:35:47.037 INFO:teuthology.orchestra.run.smithi005.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 398 kB/s | 33 kB 00:00 2023-10-16T13:35:47.062 INFO:teuthology.orchestra.run.smithi005.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-10-16T13:35:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-16T13:35:47.113 INFO:teuthology.orchestra.run.smithi005.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-10-16T13:35:47.138 INFO:teuthology.orchestra.run.smithi005.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-16T13:35:47.168 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T13:35:47.171 INFO:teuthology.orchestra.run.smithi005.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-16T13:35:47.206 INFO:teuthology.orchestra.run.smithi005.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-10-16T13:35:47.264 INFO:teuthology.orchestra.run.smithi005.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-10-16T13:35:47.298 INFO:teuthology.orchestra.run.smithi005.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2023-10-16T13:35:47.323 INFO:teuthology.orchestra.run.smithi005.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 831 kB/s | 49 kB 00:00 2023-10-16T13:35:47.357 INFO:teuthology.orchestra.run.smithi005.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-16T13:35:47.376 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T13:35:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-10-16T13:35:47.440 INFO:teuthology.orchestra.run.smithi005.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-10-16T13:35:47.483 INFO:teuthology.orchestra.run.smithi005.stdout:(56/131): python3-kubernetes-11.0.0-6.el8.noarc 4.2 MB/s | 1.2 MB 00:00 2023-10-16T13:35:47.527 INFO:teuthology.orchestra.run.smithi005.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 389 kB/s | 34 kB 00:00 2023-10-16T13:35:47.558 INFO:teuthology.orchestra.run.smithi005.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-10-16T13:35:47.575 INFO:teuthology.orchestra.run.smithi005.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-10-16T13:35:47.600 INFO:teuthology.orchestra.run.smithi005.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-10-16T13:35:47.617 INFO:teuthology.orchestra.run.smithi005.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 317 kB/s | 19 kB 00:00 2023-10-16T13:35:47.634 INFO:teuthology.orchestra.run.smithi005.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 406 kB/s | 24 kB 00:00 2023-10-16T13:35:47.651 INFO:teuthology.orchestra.run.smithi005.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 578 kB/s | 29 kB 00:00 2023-10-16T13:35:47.668 INFO:teuthology.orchestra.run.smithi005.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 543 kB/s | 27 kB 00:00 2023-10-16T13:35:47.710 INFO:teuthology.orchestra.run.smithi005.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-10-16T13:35:47.735 INFO:teuthology.orchestra.run.smithi005.stdout:(66/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-16T13:35:47.760 INFO:teuthology.orchestra.run.smithi005.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-16T13:35:47.777 INFO:teuthology.orchestra.run.smithi005.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 549 kB/s | 23 kB 00:00 2023-10-16T13:35:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T13:35:47.831 INFO:teuthology.orchestra.run.smithi005.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 709 kB/s | 85 kB 00:00 2023-10-16T13:35:47.862 INFO:teuthology.orchestra.run.smithi005.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 833 kB/s | 70 kB 00:00 2023-10-16T13:35:47.937 INFO:teuthology.orchestra.run.smithi005.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-16T13:35:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-16T13:35:48.021 INFO:teuthology.orchestra.run.smithi005.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-16T13:35:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T13:35:48.063 INFO:teuthology.orchestra.run.smithi005.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-16T13:35:48.126 INFO:teuthology.orchestra.run.smithi005.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2023-10-16T13:35:48.146 INFO:teuthology.orchestra.run.smithi005.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 465 kB/s | 39 kB 00:00 2023-10-16T13:35:48.205 INFO:teuthology.orchestra.run.smithi005.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-10-16T13:35:48.247 INFO:teuthology.orchestra.run.smithi005.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.6 MB/s | 688 kB 00:00 2023-10-16T13:35:48.272 INFO:teuthology.orchestra.run.smithi005.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-16T13:35:48.297 INFO:teuthology.orchestra.run.smithi005.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-16T13:35:48.340 INFO:teuthology.orchestra.run.smithi005.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-16T13:35:48.381 INFO:teuthology.orchestra.run.smithi005.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-10-16T13:35:48.449 INFO:teuthology.orchestra.run.smithi005.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2023-10-16T13:35:48.490 INFO:teuthology.orchestra.run.smithi005.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-10-16T13:35:48.641 INFO:teuthology.orchestra.run.smithi005.stdout:(85/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-10-16T13:35:48.741 INFO:teuthology.orchestra.run.smithi005.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-10-16T13:35:48.774 INFO:teuthology.orchestra.run.smithi005.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-10-16T13:35:48.800 INFO:teuthology.orchestra.run.smithi005.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-10-16T13:35:48.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:35:48.825 INFO:teuthology.orchestra.run.smithi005.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-10-16T13:35:48.850 INFO:teuthology.orchestra.run.smithi005.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-16T13:35:48.875 INFO:teuthology.orchestra.run.smithi005.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-16T13:35:48.901 INFO:teuthology.orchestra.run.smithi005.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-16T13:35:48.925 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:35:49.090 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:35:49.136 INFO:teuthology.orchestra.run.smithi005.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 2.7 MB/s | 709 kB 00:00 2023-10-16T13:35:49.227 INFO:teuthology.orchestra.run.smithi005.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-10-16T13:35:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:35:49.327 INFO:teuthology.orchestra.run.smithi005.stdout:(95/131): python3-numpy-1.14.3-10.el8.x86_64.rp 4.5 MB/s | 3.7 MB 00:00 2023-10-16T13:35:49.369 INFO:teuthology.orchestra.run.smithi005.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-16T13:35:49.411 INFO:teuthology.orchestra.run.smithi005.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T13:35:49.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T13:35:49.486 INFO:teuthology.orchestra.run.smithi005.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 8.3 MB/s | 4.9 MB 00:00 2023-10-16T13:35:49.571 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T13:35:49.578 INFO:teuthology.orchestra.run.smithi005.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-10-16T13:35:49.628 INFO:teuthology.orchestra.run.smithi005.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-10-16T13:35:49.670 INFO:teuthology.orchestra.run.smithi005.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-16T13:35:49.712 INFO:teuthology.orchestra.run.smithi005.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-16T13:35:49.738 INFO:teuthology.orchestra.run.smithi005.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-16T13:35:49.741 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T13:35:49.763 INFO:teuthology.orchestra.run.smithi005.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-16T13:35:49.788 INFO:teuthology.orchestra.run.smithi005.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T13:35:49.813 INFO:teuthology.orchestra.run.smithi005.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-10-16T13:35:49.839 INFO:teuthology.orchestra.run.smithi005.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-16T13:35:49.864 INFO:teuthology.orchestra.run.smithi005.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-10-16T13:35:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:35:49.922 INFO:teuthology.orchestra.run.smithi005.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.3 MB/s | 109 kB 00:00 2023-10-16T13:35:49.948 INFO:teuthology.orchestra.run.smithi005.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-10-16T13:35:49.981 INFO:teuthology.orchestra.run.smithi005.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-16T13:35:49.998 INFO:teuthology.orchestra.run.smithi005.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-10-16T13:35:50.055 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T13:35:50.074 INFO:teuthology.orchestra.run.smithi005.stdout:(113/131): postgresql-server-10.21-2.module+el8 7.6 MB/s | 5.1 MB 00:00 2023-10-16T13:35:50.099 INFO:teuthology.orchestra.run.smithi005.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-10-16T13:35:50.124 INFO:teuthology.orchestra.run.smithi005.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-10-16T13:35:50.189 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:35:50.193 INFO:teuthology.orchestra.run.smithi005.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 2.8 MB/s | 559 kB 00:00 2023-10-16T13:35:50.225 INFO:teuthology.orchestra.run.smithi005.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-16T13:35:50.250 INFO:teuthology.orchestra.run.smithi005.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-10-16T13:35:50.275 INFO:teuthology.orchestra.run.smithi005.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-16T13:35:50.301 INFO:teuthology.orchestra.run.smithi005.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T13:35:50.326 INFO:teuthology.orchestra.run.smithi005.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-16T13:35:50.343 INFO:teuthology.orchestra.run.smithi005.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-10-16T13:35:50.368 INFO:teuthology.orchestra.run.smithi005.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.4 MB/s | 58 kB 00:00 2023-10-16T13:35:50.394 INFO:teuthology.orchestra.run.smithi005.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-10-16T13:35:50.452 INFO:teuthology.orchestra.run.smithi005.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-10-16T13:35:50.503 INFO:teuthology.orchestra.run.smithi005.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.5 MB/s | 171 kB 00:00 2023-10-16T13:35:50.528 INFO:teuthology.orchestra.run.smithi005.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.8 MB/s | 138 kB 00:00 2023-10-16T13:35:50.587 INFO:teuthology.orchestra.run.smithi005.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-10-16T13:35:50.645 INFO:teuthology.orchestra.run.smithi005.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-16T13:35:50.811 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T13:35:50.904 INFO:teuthology.orchestra.run.smithi005.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 9.9 MB/s | 3.7 MB 00:00 2023-10-16T13:35:51.014 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:35:51.095 INFO:teuthology.orchestra.run.smithi005.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 6.3 MB/s | 3.7 MB 00:00 2023-10-16T13:35:51.100 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:35:51.101 INFO:teuthology.orchestra.run.smithi005.stdout:Total 19 MB/s | 209 MB 00:10 2023-10-16T13:35:51.614 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T13:35:51.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:35:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-10-16T13:35:52.093 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-10-16T13:35:52.093 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-10-16T13:35:52.499 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T13:35:52.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T13:35:52.928 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T13:35:53.140 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T13:35:53.296 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-10-16T13:35:53.301 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-10-16T13:35:53.303 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T13:35:53.466 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T13:35:53.701 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T13:35:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:35:55.941 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T13:35:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T13:35:57.262 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T13:35:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T13:35:57.777 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T13:35:58.000 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T13:35:58.174 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T13:35:58.394 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T13:35:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T13:35:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-10-16T13:35:58.670 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T13:35:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T13:35:58.831 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T13:35:58.986 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T13:35:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:35:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T13:35:59.168 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-16T13:35:59.311 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T13:35:59.359 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T13:35:59.497 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T13:35:59.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T13:35:59.755 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:35:59.820 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T13:36:00.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T13:36:00.042 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T13:36:00.212 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T13:36:00.393 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T13:36:00.468 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T13:36:00.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T13:36:00.675 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:36:00.757 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T13:36:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T13:36:01.108 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:36:01.121 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T13:36:01.311 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T13:36:01.325 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:36:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:36:01.625 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:36:01.711 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:36:01.712 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T13:36:01.891 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T13:36:02.015 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T13:36:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T13:36:02.216 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T13:36:02.412 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T13:36:02.493 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T13:36:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T13:36:02.864 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T13:36:03.038 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T13:36:03.133 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T13:36:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T13:36:03.333 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:36:03.431 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T13:36:03.489 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T13:36:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:36:03.694 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T13:36:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T13:36:03.833 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T13:36:03.885 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T13:36:03.979 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T13:36:04.041 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T13:36:04.150 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T13:36:04.370 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T13:36:04.624 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T13:36:04.807 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T13:36:04.842 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T13:36:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T13:36:05.114 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T13:36:05.271 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T13:36:05.483 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T13:36:05.663 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T13:36:05.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T13:36:05.999 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T13:36:06.045 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T13:36:06.200 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T13:36:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T13:36:06.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T13:36:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T13:36:06.767 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T13:36:06.983 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T13:36:07.039 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-16T13:36:07.124 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T13:36:07.244 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T13:36:07.250 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-16T13:36:07.471 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-16T13:36:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T13:36:07.682 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-16T13:36:07.708 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T13:36:07.888 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-16T13:36:07.918 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T13:36:08.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T13:36:08.176 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T13:36:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T13:36:08.378 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T13:36:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T13:36:08.528 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T13:36:08.764 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T13:36:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T13:36:09.723 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-16T13:36:09.839 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T13:36:09.997 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-16T13:36:10.116 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T13:36:10.233 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-16T13:36:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T13:36:10.432 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T13:36:10.663 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T13:36:10.972 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T13:36:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T13:36:11.994 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T13:36:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:36:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:36:12.331 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T13:36:12.412 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T13:36:12.677 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-16T13:36:12.898 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T13:36:13.079 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T13:36:13.272 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T13:36:13.432 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T13:36:13.586 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-16T13:36:13.782 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-16T13:36:13.943 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-16T13:36:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-16T13:36:14.326 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-16T13:36:14.542 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-16T13:36:14.929 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-16T13:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-16T13:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-16T13:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-16T13:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-16T13:36:16.157 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-16T13:36:16.378 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-16T13:36:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-16T13:36:16.960 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:36:17.008 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-16T13:36:17.208 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-16T13:36:17.249 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:36:17.313 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:36:17.428 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-16T13:36:17.469 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:36:17.713 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-16T13:36:17.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-16T13:36:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-16T13:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-16T13:36:18.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-16T13:36:18.850 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-16T13:36:19.014 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T13:36:19.111 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T13:36:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-16T13:36:19.561 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-16T13:36:19.714 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T13:36:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T13:36:20.040 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-16T13:36:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-16T13:36:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T13:36:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T13:36:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T13:36:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T13:36:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T13:36:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T13:36:21.669 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T13:36:21.887 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T13:36:22.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T13:36:22.234 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T13:36:22.404 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T13:36:22.606 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T13:36:22.827 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T13:36:23.170 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T13:36:23.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T13:36:23.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T13:36:23.898 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T13:36:24.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T13:36:25.242 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T13:36:25.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T13:36:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T13:36:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T13:36:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T13:36:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T13:36:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T13:36:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:36:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T13:36:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T13:36:32.040 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:36:32.238 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:36:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T13:36:33.179 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:36:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T13:36:33.436 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:36:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:36:36.079 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2023-10-16T13:36:36.080 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2023-10-16T13:36:36.080 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-10-16T13:36:36.080 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2023-10-16T13:36:36.080 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2023-10-16T13:36:36.080 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2023-10-16T13:36:36.081 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2023-10-16T13:36:36.081 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2023-10-16T13:36:36.081 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-10-16T13:36:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:36:36.450 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:36:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:36:38.221 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:36:38.440 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:36:38.617 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:36:39.078 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:36:39.250 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:36:39.266 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:36:40.951 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:36:41.132 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:36:41.267 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T13:36:41.440 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T13:36:41.599 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:36:41.820 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:36:42.187 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:36:43.146 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:36:43.274 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:36:43.364 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:36:43.764 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T13:36:43.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:36:43.955 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:36:44.140 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:36:44.152 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:36:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T13:36:45.694 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:36:45.727 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:36:45.883 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:36:45.923 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:36:46.066 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:36:46.439 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:36:46.632 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:36:51.271 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:36:52.150 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T13:36:52.476 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T13:36:52.639 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T13:36:52.939 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T13:36:53.089 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:36:53.278 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T13:36:53.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T13:36:53.651 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T13:36:53.759 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T13:36:53.759 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2023-10-16T13:36:53.759 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2023-10-16T13:36:53.760 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-10-16T13:36:53.760 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2023-10-16T13:36:53.760 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2023-10-16T13:36:53.760 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2023-10-16T13:36:53.760 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2023-10-16T13:36:53.761 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2023-10-16T13:36:53.761 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-10-16T13:36:53.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:36:53.807 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T13:36:54.076 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:36:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T13:36:55.933 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:36:55.976 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:36:56.198 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:36:56.209 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T13:36:56.214 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:36:56.376 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:36:56.436 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T13:36:56.697 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T13:36:56.870 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T13:36:56.998 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T13:36:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:36:57.051 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T13:36:57.366 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T13:36:57.580 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:36:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T13:36:57.897 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:36:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T13:36:58.064 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:36:58.071 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T13:36:58.224 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T13:36:58.225 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:36:58.425 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:36:58.425 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:36:58.717 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:36:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:36:58.977 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:36:59.195 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T13:36:59.298 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T13:36:59.400 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:36:59.401 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T13:36:59.401 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T13:36:59.401 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T13:36:59.402 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T13:36:59.402 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T13:36:59.402 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:36:59.403 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:36:59.403 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:36:59.403 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T13:36:59.404 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T13:36:59.404 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T13:36:59.404 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T13:36:59.405 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T13:36:59.405 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T13:36:59.405 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T13:36:59.406 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T13:36:59.406 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T13:36:59.406 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T13:36:59.407 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T13:36:59.407 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T13:36:59.407 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T13:36:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T13:36:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T13:36:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T13:36:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T13:36:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T13:36:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T13:36:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T13:36:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T13:36:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T13:36:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T13:36:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T13:36:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T13:36:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T13:36:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T13:36:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T13:36:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T13:36:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T13:36:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T13:36:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T13:36:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T13:36:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T13:36:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T13:36:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T13:36:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T13:36:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T13:36:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T13:36:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T13:36:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T13:36:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T13:36:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T13:36:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T13:36:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T13:36:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T13:36:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T13:36:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T13:36:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T13:36:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T13:36:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T13:36:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T13:36:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T13:36:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T13:36:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T13:36:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T13:36:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T13:36:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T13:36:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T13:36:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T13:36:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T13:36:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T13:36:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T13:36:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T13:36:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T13:36:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T13:36:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T13:36:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T13:36:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T13:36:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T13:36:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T13:36:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T13:36:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T13:36:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T13:36:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T13:36:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T13:36:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T13:36:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T13:36:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T13:36:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T13:36:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T13:36:59.426 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T13:36:59.426 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T13:36:59.426 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T13:36:59.426 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T13:36:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T13:36:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T13:36:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T13:36:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T13:36:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T13:36:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T13:36:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T13:36:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T13:36:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T13:36:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T13:36:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T13:36:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T13:36:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T13:36:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T13:36:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T13:36:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T13:36:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T13:36:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T13:36:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T13:36:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T13:36:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T13:36:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T13:36:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T13:36:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T13:36:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T13:36:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T13:36:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T13:36:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T13:36:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T13:36:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T13:36:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T13:36:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T13:36:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T13:36:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T13:36:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T13:36:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T13:36:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T13:36:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T13:36:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:36:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T13:36:59.509 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T13:36:59.825 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:37:00.052 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T13:37:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:37:01.371 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T13:37:01.550 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:37:01.645 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T13:37:02.055 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T13:37:02.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:37:02.109 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:48 ago on Mon 16 Oct 2023 01:35:14 PM UTC. 2023-10-16T13:37:02.275 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:37:02.311 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T13:37:02.524 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:37:02.536 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T13:37:03.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T13:37:04.195 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:37:04.230 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T13:37:04.375 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:37:04.418 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T13:37:04.600 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:37:04.941 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2023-10-16T13:37:05.004 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T13:37:05.166 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:37:05.174 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:05.174 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2023-10-16T13:37:05.175 INFO:teuthology.orchestra.run.smithi112.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T13:37:05.175 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.175 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.175 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2023-10-16T13:37:05.175 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T13:37:05.176 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T13:37:05.176 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T13:37:05.176 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.176 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.176 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.177 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.177 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.177 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.177 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.177 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.178 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.178 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.178 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.178 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.178 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.179 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.179 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.179 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.179 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.179 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.180 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.180 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.180 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.180 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.180 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:05.181 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T13:37:05.181 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T13:37:05.181 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T13:37:05.181 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T13:37:05.181 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.6-3.el8.x86_64 2023-10-16T13:37:05.182 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T13:37:05.182 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T13:37:05.182 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T13:37:05.182 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.182 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.183 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.183 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T13:37:05.183 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:37:05.183 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T13:37:05.183 INFO:teuthology.orchestra.run.smithi112.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T13:37:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:37:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T13:37:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T13:37:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.185 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T13:37:05.185 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T13:37:05.185 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T13:37:05.185 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T13:37:05.185 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T13:37:05.186 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T13:37:05.186 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T13:37:05.186 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T13:37:05.186 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T13:37:05.186 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T13:37:05.187 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T13:37:05.187 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T13:37:05.187 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T13:37:05.187 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T13:37:05.187 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:37:05.188 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:37:05.188 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:37:05.188 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T13:37:05.188 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T13:37:05.188 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T13:37:05.189 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T13:37:05.189 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T13:37:05.189 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.189 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.189 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T13:37:05.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T13:37:05.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T13:37:05.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T13:37:05.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T13:37:05.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T13:37:05.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T13:37:05.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T13:37:05.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T13:37:05.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T13:37:05.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T13:37:05.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T13:37:05.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T13:37:05.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T13:37:05.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T13:37:05.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T13:37:05.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T13:37:05.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T13:37:05.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T13:37:05.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T13:37:05.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T13:37:05.194 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T13:37:05.194 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T13:37:05.194 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T13:37:05.194 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T13:37:05.194 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T13:37:05.195 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T13:37:05.195 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T13:37:05.195 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T13:37:05.195 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.195 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.195 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T13:37:05.196 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T13:37:05.196 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.196 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T13:37:05.196 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T13:37:05.196 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T13:37:05.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T13:37:05.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T13:37:05.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T13:37:05.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T13:37:05.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T13:37:05.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T13:37:05.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T13:37:05.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T13:37:05.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T13:37:05.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T13:37:05.199 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.199 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.199 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:05.199 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T13:37:05.200 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T13:37:05.200 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T13:37:05.200 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T13:37:05.200 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T13:37:05.201 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T13:37:05.201 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:05.201 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-16T13:37:05.392 DEBUG:teuthology.parallel:result is None 2023-10-16T13:37:10.115 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T13:37:10.418 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T13:37:10.590 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T13:37:10.793 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T13:37:11.766 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-16T13:37:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-16T13:37:12.341 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-16T13:37:12.536 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T13:37:12.727 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T13:37:13.033 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T13:37:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:37:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:37:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T13:37:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T13:37:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T13:37:16.728 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T13:37:17.058 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T13:37:17.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T13:37:17.206 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T13:37:17.397 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-16T13:37:17.564 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T13:37:17.654 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T13:37:17.856 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T13:37:17.870 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T13:37:17.870 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:37:18.043 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:37:18.043 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:37:18.321 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T13:37:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:37:19.080 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:37:19.080 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T13:37:19.081 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T13:37:19.081 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T13:37:19.081 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T13:37:19.081 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T13:37:19.082 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T13:37:19.082 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T13:37:19.082 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T13:37:19.085 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T13:37:19.085 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T13:37:19.085 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T13:37:19.085 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T13:37:19.086 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T13:37:19.086 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T13:37:19.086 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T13:37:19.086 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T13:37:19.086 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T13:37:19.087 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T13:37:19.087 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T13:37:19.087 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T13:37:19.087 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T13:37:19.087 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T13:37:19.088 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T13:37:19.088 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T13:37:19.088 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T13:37:19.088 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T13:37:19.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T13:37:19.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T13:37:19.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T13:37:19.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T13:37:19.100 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T13:37:19.100 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T13:37:19.100 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T13:37:19.100 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T13:37:19.100 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T13:37:19.101 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T13:37:19.101 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T13:37:19.101 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T13:37:19.101 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T13:37:19.101 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T13:37:19.102 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T13:37:19.102 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T13:37:19.102 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T13:37:19.102 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T13:37:19.102 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T13:37:19.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T13:37:19.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T13:37:19.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T13:37:19.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T13:37:19.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T13:37:19.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T13:37:19.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T13:37:19.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T13:37:19.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T13:37:19.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T13:37:19.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T13:37:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T13:37:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T13:37:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T13:37:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T13:37:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T13:37:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T13:37:19.106 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T13:37:19.106 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T13:37:19.106 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T13:37:19.106 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T13:37:19.106 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T13:37:19.107 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T13:37:19.107 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T13:37:19.107 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T13:37:19.107 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T13:37:19.107 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-16T13:37:19.108 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-16T13:37:19.108 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-16T13:37:19.108 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-16T13:37:19.108 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-16T13:37:19.108 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-16T13:37:19.109 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-16T13:37:19.109 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-16T13:37:19.109 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-16T13:37:19.109 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-16T13:37:19.109 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-16T13:37:19.110 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-16T13:37:19.110 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-16T13:37:19.110 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-16T13:37:19.110 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-16T13:37:19.110 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-16T13:37:19.110 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-16T13:37:19.111 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-16T13:37:19.111 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-16T13:37:19.111 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-16T13:37:19.111 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-16T13:37:19.111 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-16T13:37:19.112 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-16T13:37:19.112 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-16T13:37:19.112 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-16T13:37:19.112 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-16T13:37:19.112 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-16T13:37:19.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-16T13:37:19.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-16T13:37:19.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-16T13:37:19.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-16T13:37:19.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-16T13:37:19.113 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-16T13:37:19.114 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-16T13:37:19.114 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-16T13:37:19.114 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-16T13:37:19.114 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-16T13:37:19.114 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-16T13:37:19.115 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-16T13:37:19.115 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-16T13:37:19.115 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-16T13:37:19.115 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-16T13:37:19.115 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-16T13:37:19.116 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-16T13:37:19.116 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-16T13:37:19.116 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-16T13:37:19.116 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-16T13:37:19.116 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-16T13:37:19.116 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T13:37:19.117 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-16T13:37:19.117 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T13:37:19.117 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-16T13:37:19.117 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-16T13:37:19.117 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-16T13:37:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-16T13:37:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-16T13:37:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T13:37:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T13:37:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T13:37:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T13:37:19.119 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T13:37:19.119 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T13:37:22.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T13:37:22.104 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:55 ago on Mon 16 Oct 2023 01:35:27 PM UTC. 2023-10-16T13:37:24.690 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-10-16T13:37:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:24.938 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-10-16T13:37:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T13:37:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.938 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-10-16T13:37:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T13:37:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T13:37:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T13:37:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T13:37:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T13:37:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T13:37:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T13:37:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T13:37:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-3.el8.x86_64 2023-10-16T13:37:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T13:37:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T13:37:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T13:37:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T13:37:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:37:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T13:37:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T13:37:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T13:37:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T13:37:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T13:37:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T13:37:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T13:37:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T13:37:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T13:37:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T13:37:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T13:37:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T13:37:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T13:37:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T13:37:24.950 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T13:37:24.950 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T13:37:24.950 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T13:37:24.950 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T13:37:24.950 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T13:37:24.951 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:37:24.951 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:37:24.951 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T13:37:24.951 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T13:37:24.951 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T13:37:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T13:37:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T13:37:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T13:37:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.953 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.953 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T13:37:24.953 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T13:37:24.953 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T13:37:24.953 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T13:37:24.954 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T13:37:24.954 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T13:37:24.954 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T13:37:24.954 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T13:37:24.954 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T13:37:24.955 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T13:37:24.955 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T13:37:24.955 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T13:37:24.955 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T13:37:24.955 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T13:37:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T13:37:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T13:37:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T13:37:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T13:37:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T13:37:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T13:37:24.957 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T13:37:24.957 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T13:37:24.957 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T13:37:24.957 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T13:37:24.957 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T13:37:24.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T13:37:24.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T13:37:24.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T13:37:24.958 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T13:37:24.959 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.959 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.959 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T13:37:24.959 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T13:37:24.959 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.959 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T13:37:24.960 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T13:37:24.960 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T13:37:24.960 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T13:37:24.960 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T13:37:24.960 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T13:37:24.961 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T13:37:24.961 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T13:37:24.961 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T13:37:24.961 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T13:37:24.961 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T13:37:24.962 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T13:37:24.962 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T13:37:24.962 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.962 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.963 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T13:37:24.963 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T13:37:24.963 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T13:37:24.963 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T13:37:24.963 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T13:37:24.964 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T13:37:24.964 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T13:37:24.964 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:24.964 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-16T13:37:25.132 DEBUG:teuthology.parallel:result is None 2023-10-16T13:37:25.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:37:25.404 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T13:37:25.429 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T13:37:25.430 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T13:37:25.430 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T13:37:25.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T13:37:25.663 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T13:37:25.693 INFO:teuthology.orchestra.run.smithi112.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T13:37:25.694 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T13:37:25.694 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T13:37:25.694 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T13:37:25.695 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:25.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T13:37:25.741 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:25.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T13:37:25.787 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T13:37:25.787 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:25.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T13:37:25.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T13:37:25.884 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:25.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T13:37:25.915 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T13:37:25.984 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T13:37:25.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:25.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T13:37:26.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T13:37:26.081 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:26.081 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T13:37:26.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T13:37:26.178 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T13:37:26.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:26.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T13:37:26.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T13:37:26.275 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:26.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T13:37:26.302 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T13:37:26.369 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T13:37:26.436 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T13:37:26.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2023-10-16T13:37:26.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2023-10-16T13:37:26.465 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T13:37:26.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T13:37:26.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T13:37:26.532 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T13:37:26.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T13:37:26.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T13:37:26.605 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T13:37:26.605 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T13:37:26.606 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T13:37:26.606 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:26.607 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T13:37:26.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T13:37:26.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T13:37:26.818 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:26.818 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T13:37:26.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T13:37:26.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T13:37:27.003 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T13:37:27.003 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T13:37:27.004 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020', 'branch': 'rishabh-2023oct13', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': None, 'first_in_suite': False, 'job_id': '7429020', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-b2', 'sha1': '33be745ec4531df08cd1bb70b4c9c1f89be58078'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-b2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '33be745ec4531df08cd1bb70b4c9c1f89be58078', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes', 'tasks.cephfs.test_subvolume.TestSubvolume']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_12:17:50', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T13:37:27.005 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T13:37:27.007 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T13:37:27.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T13:37:27.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T13:37:27.119 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:27.120 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T13:37:27.147 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T13:37:27.148 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-10-16T13:37:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T13:37:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:27.205 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 387530 Links: 1 2023-10-16T13:37:27.205 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:27.206 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:27.206 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-16 13:37:18.769150283 +0000 2023-10-16T13:37:27.206 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-16 13:34:28.266445232 +0000 2023-10-16T13:37:27.206 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-16 13:34:28.266445232 +0000 2023-10-16T13:37:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-16T13:37:27.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T13:37:27.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-16T13:37:27.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-16T13:37:27.272 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000120988 s, 4.2 MB/s 2023-10-16T13:37:27.273 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T13:37:27.332 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-10-16T13:37:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T13:37:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:27.390 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 382792 Links: 1 2023-10-16T13:37:27.391 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:27.391 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:27.391 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-16 13:37:18.769150283 +0000 2023-10-16T13:37:27.391 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-16 13:34:28.784435173 +0000 2023-10-16T13:37:27.391 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-16 13:34:28.784435173 +0000 2023-10-16T13:37:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-16T13:37:27.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T13:37:27.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-16T13:37:27.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-16T13:37:27.457 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.2967e-05 s, 5.5 MB/s 2023-10-16T13:37:27.458 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T13:37:27.517 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-10-16T13:37:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T13:37:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:27.575 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 394669 Links: 1 2023-10-16T13:37:27.575 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:27.575 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:27.575 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-16 13:37:18.769150283 +0000 2023-10-16T13:37:27.576 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-16 13:34:29.288425384 +0000 2023-10-16T13:37:27.576 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-16 13:34:29.288425384 +0000 2023-10-16T13:37:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-16T13:37:27.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T13:37:27.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-16T13:37:27.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-16T13:37:27.640 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000110324 s, 4.6 MB/s 2023-10-16T13:37:27.641 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T13:37:27.699 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-10-16T13:37:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T13:37:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:27.757 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 393861 Links: 1 2023-10-16T13:37:27.757 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:27.757 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:27.757 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-16 13:37:18.769150283 +0000 2023-10-16T13:37:27.758 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-16 13:34:29.795415538 +0000 2023-10-16T13:37:27.758 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-16 13:34:29.795415538 +0000 2023-10-16T13:37:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-16T13:37:27.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T13:37:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-16T13:37:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-16T13:37:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.6048e-05 s, 5.3 MB/s 2023-10-16T13:37:27.824 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T13:37:27.882 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:27.882 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:27.883 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T13:37:27.901 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T13:37:27.902 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2023-10-16T13:37:27.960 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T13:37:27.960 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:27.960 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 389435 Links: 1 2023-10-16T13:37:27.960 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:27.961 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:27.961 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-16 13:36:59.087547639 +0000 2023-10-16T13:37:27.961 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-16 13:34:20.912006489 +0000 2023-10-16T13:37:27.961 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-16 13:34:20.912006489 +0000 2023-10-16T13:37:27.961 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-16T13:37:27.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T13:37:28.027 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-16T13:37:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-16T13:37:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000258361 s, 2.0 MB/s 2023-10-16T13:37:28.029 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T13:37:28.088 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2023-10-16T13:37:28.146 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T13:37:28.146 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:28.146 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 389489 Links: 1 2023-10-16T13:37:28.146 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:28.147 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:28.147 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-16 13:36:59.087547639 +0000 2023-10-16T13:37:28.147 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-16 13:34:21.408993409 +0000 2023-10-16T13:37:28.147 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-16 13:34:21.408993409 +0000 2023-10-16T13:37:28.147 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-16T13:37:28.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T13:37:28.212 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-16T13:37:28.212 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-16T13:37:28.213 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00027496 s, 1.9 MB/s 2023-10-16T13:37:28.213 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T13:37:28.272 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2023-10-16T13:37:28.329 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T13:37:28.330 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:28.330 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 393520 Links: 1 2023-10-16T13:37:28.330 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:28.331 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:28.331 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-16 13:36:59.087547639 +0000 2023-10-16T13:37:28.331 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-16 13:34:21.934979564 +0000 2023-10-16T13:37:28.331 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-16 13:34:21.934979564 +0000 2023-10-16T13:37:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-16T13:37:28.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T13:37:28.394 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-16T13:37:28.395 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-16T13:37:28.395 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000232452 s, 2.2 MB/s 2023-10-16T13:37:28.396 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T13:37:28.453 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2023-10-16T13:37:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T13:37:28.510 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T13:37:28.511 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 392769 Links: 1 2023-10-16T13:37:28.511 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T13:37:28.511 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T13:37:28.511 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-16 13:36:59.087547639 +0000 2023-10-16T13:37:28.511 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-16 13:34:22.434966405 +0000 2023-10-16T13:37:28.512 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-16 13:34:22.434966405 +0000 2023-10-16T13:37:28.512 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-16T13:37:28.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T13:37:28.575 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-16T13:37:28.575 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-16T13:37:28.576 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000215956 s, 2.4 MB/s 2023-10-16T13:37:28.577 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T13:37:28.635 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:28.635 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T13:37:28.635 INFO:tasks.ceph:Generating config... 2023-10-16T13:37:28.637 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T13:37:28.637 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T13:37:28.637 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T13:37:28.637 INFO:tasks.ceph:[client] pid file = 2023-10-16T13:37:28.638 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T13:37:28.638 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T13:37:28.638 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-16T13:37:28.638 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T13:37:28.639 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T13:37:28.639 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T13:37:28.639 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T13:37:28.639 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T13:37:28.640 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T13:37:28.640 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T13:37:28.640 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T13:37:28.640 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T13:37:28.640 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T13:37:28.641 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-16T13:37:28.641 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-16T13:37:28.641 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T13:37:28.641 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T13:37:28.642 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T13:37:28.642 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T13:37:28.642 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T13:37:28.642 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T13:37:28.643 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-16T13:37:28.643 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-16T13:37:28.643 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-16T13:37:28.643 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T13:37:28.644 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T13:37:28.644 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-16T13:37:28.644 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-16T13:37:28.644 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T13:37:28.644 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T13:37:28.645 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-16T13:37:28.645 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T13:37:28.645 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T13:37:28.645 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T13:37:28.646 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T13:37:28.646 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T13:37:28.646 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T13:37:28.646 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T13:37:28.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T13:37:28.738 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T13:37:28.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T13:37:28.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T13:37:28.846 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]')] 2023-10-16T13:37:28.847 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T13:37:28.848 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:28.848 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T13:37:28.928 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:29.020 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:29.020 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c 2023-10-16T13:37:29.020 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-10-16T13:37:29.020 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2023-10-16T13:37:29.021 INFO:teuthology.orchestra.run.smithi005.stdout:fsid c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c 2023-10-16T13:37:29.021 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2023-10-16T13:37:29.018472+0000 2023-10-16T13:37:29.021 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-10-16T13:37:29.018472+0000 2023-10-16T13:37:29.021 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2023-10-16T13:37:29.021 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2023-10-16T13:37:29.022 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-10-16T13:37:29.022 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2023-10-16T13:37:29.022 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2023-10-16T13:37:29.022 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T13:37:29.023 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T13:37:29.041 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c... 2023-10-16T13:37:29.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T13:37:29.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T13:37:29.129 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-10-16T13:37:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2023-10-16T13:37:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T13:37:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2023-10-16T13:37:29.130 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2023-10-16T13:37:29.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.133 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2023-10-16T13:37:29.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.134 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2023-10-16T13:37:29.134 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2023-10-16T13:37:29.134 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.134 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2023-10-16T13:37:29.134 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2023-10-16T13:37:29.135 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.135 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T13:37:29.135 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2023-10-16T13:37:29.135 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.135 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T13:37:29.136 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T13:37:29.136 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.136 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2023-10-16T13:37:29.136 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.136 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2023-10-16T13:37:29.137 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2023-10-16T13:37:29.137 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2023-10-16T13:37:29.137 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2023-10-16T13:37:29.137 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2023-10-16T13:37:29.137 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2023-10-16T13:37:29.137 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2023-10-16T13:37:29.138 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T13:37:29.138 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T13:37:29.138 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2023-10-16T13:37:29.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.138 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T13:37:29.139 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.139 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2023-10-16T13:37:29.139 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.139 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2023-10-16T13:37:29.140 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.140 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2023-10-16T13:37:29.140 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2023-10-16T13:37:29.140 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2023-10-16T13:37:29.140 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2023-10-16T13:37:29.140 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2023-10-16T13:37:29.141 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c 2023-10-16T13:37:29.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.141 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2023-10-16T13:37:29.141 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2023-10-16T13:37:29.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.142 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2023-10-16T13:37:29.142 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2023-10-16T13:37:29.142 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2023-10-16T13:37:29.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.143 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2023-10-16T13:37:29.143 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2023-10-16T13:37:29.143 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.143 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2023-10-16T13:37:29.143 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2023-10-16T13:37:29.144 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2023-10-16T13:37:29.144 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.144 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2023-10-16T13:37:29.144 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2023-10-16T13:37:29.144 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.145 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2023-10-16T13:37:29.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.145 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2023-10-16T13:37:29.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.145 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2023-10-16T13:37:29.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.146 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2023-10-16T13:37:29.146 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2023-10-16T13:37:29.146 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.147 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2023-10-16T13:37:29.147 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2023-10-16T13:37:29.147 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2023-10-16T13:37:29.147 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2023-10-16T13:37:29.147 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2023-10-16T13:37:29.148 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2023-10-16T13:37:29.148 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2023-10-16T13:37:29.148 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2023-10-16T13:37:29.148 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2023-10-16T13:37:29.148 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-10-16T13:37:29.149 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2023-10-16T13:37:29.149 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2023-10-16T13:37:29.149 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T13:37:29.149 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2023-10-16T13:37:29.149 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2023-10-16T13:37:29.150 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2023-10-16T13:37:29.150 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2023-10-16T13:37:29.150 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-10-16T13:37:29.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.150 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2023-10-16T13:37:29.151 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-10-16T13:37:29.151 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2023-10-16T13:37:29.151 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-10-16T13:37:29.151 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-10-16T13:37:29.151 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-10-16T13:37:29.152 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-10-16T13:37:29.152 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2023-10-16T13:37:29.152 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-10-16T13:37:29.152 INFO:teuthology.orchestra.run.smithi005.stdout: debug finisher = 20 2023-10-16T13:37:29.152 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.152 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2023-10-16T13:37:29.153 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-10-16T13:37:29.153 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-10-16T13:37:29.153 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2023-10-16T13:37:29.153 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-10-16T13:37:29.153 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2023-10-16T13:37:29.154 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2023-10-16T13:37:29.154 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-10-16T13:37:29.154 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2023-10-16T13:37:29.154 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2023-10-16T13:37:29.154 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-10-16T13:37:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T13:37:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T13:37:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T13:37:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T13:37:29.156 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T13:37:29.156 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T13:37:29.156 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.156 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2023-10-16T13:37:29.156 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2023-10-16T13:37:29.157 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.157 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2023-10-16T13:37:29.157 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2023-10-16T13:37:29.157 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:37:29.157 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2023-10-16T13:37:29.158 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2023-10-16T13:37:29.158 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2023-10-16T13:37:29.158 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2023-10-16T13:37:29.158 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T13:37:29.158 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T13:37:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2023-10-16T13:37:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-10-16T13:37:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-10-16T13:37:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2023-10-16T13:37:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-10-16T13:37:29.159 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-10-16T13:37:29.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2023-10-16T13:37:29.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2023-10-16T13:37:29.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2023-10-16T13:37:29.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-10-16T13:37:29.160 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-10-16T13:37:29.161 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-10-16T13:37:29.161 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-10-16T13:37:29.161 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2023-10-16T13:37:29.161 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2023-10-16T13:37:29.161 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2023-10-16T13:37:29.161 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-10-16T13:37:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2023-10-16T13:37:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2023-10-16T13:37:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2023-10-16T13:37:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2023-10-16T13:37:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-10-16T13:37:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-10-16T13:37:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-10-16T13:37:29.165 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2023-10-16T13:37:29.165 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2023-10-16T13:37:29.165 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T13:37:29.165 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2023-10-16T13:37:29.165 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2023-10-16T13:37:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2023-10-16T13:37:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2023-10-16T13:37:29.167 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2023-10-16T13:37:29.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.167 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2023-10-16T13:37:29.167 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2023-10-16T13:37:29.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.168 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T13:37:29.168 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2023-10-16T13:37:29.168 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.168 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T13:37:29.168 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T13:37:29.168 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.169 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2023-10-16T13:37:29.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.169 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2023-10-16T13:37:29.169 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2023-10-16T13:37:29.169 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2023-10-16T13:37:29.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2023-10-16T13:37:29.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2023-10-16T13:37:29.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2023-10-16T13:37:29.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2023-10-16T13:37:29.170 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T13:37:29.171 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T13:37:29.171 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2023-10-16T13:37:29.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.171 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T13:37:29.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.172 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2023-10-16T13:37:29.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.172 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2023-10-16T13:37:29.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.172 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2023-10-16T13:37:29.172 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2023-10-16T13:37:29.173 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2023-10-16T13:37:29.173 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.5,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2023-10-16T13:37:29.173 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2023-10-16T13:37:29.173 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c 2023-10-16T13:37:29.173 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.174 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2023-10-16T13:37:29.174 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2023-10-16T13:37:29.174 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.174 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2023-10-16T13:37:29.174 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2023-10-16T13:37:29.175 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2023-10-16T13:37:29.175 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.175 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2023-10-16T13:37:29.175 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2023-10-16T13:37:29.175 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.175 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2023-10-16T13:37:29.176 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2023-10-16T13:37:29.176 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2023-10-16T13:37:29.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.176 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2023-10-16T13:37:29.176 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2023-10-16T13:37:29.177 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.177 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2023-10-16T13:37:29.177 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.177 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2023-10-16T13:37:29.177 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.177 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2023-10-16T13:37:29.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.178 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2023-10-16T13:37:29.178 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2023-10-16T13:37:29.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.178 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2023-10-16T13:37:29.178 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2023-10-16T13:37:29.179 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2023-10-16T13:37:29.179 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2023-10-16T13:37:29.179 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2023-10-16T13:37:29.179 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2023-10-16T13:37:29.179 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2023-10-16T13:37:29.179 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2023-10-16T13:37:29.180 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2023-10-16T13:37:29.180 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-16T13:37:29.180 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2023-10-16T13:37:29.180 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2023-10-16T13:37:29.180 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T13:37:29.180 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2023-10-16T13:37:29.181 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2023-10-16T13:37:29.181 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2023-10-16T13:37:29.181 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2023-10-16T13:37:29.181 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2023-10-16T13:37:29.181 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.182 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2023-10-16T13:37:29.182 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-16T13:37:29.182 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2023-10-16T13:37:29.182 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-10-16T13:37:29.182 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-10-16T13:37:29.182 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-10-16T13:37:29.183 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-10-16T13:37:29.183 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2023-10-16T13:37:29.183 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2023-10-16T13:37:29.183 INFO:teuthology.orchestra.run.smithi112.stdout: debug finisher = 20 2023-10-16T13:37:29.183 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.183 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2023-10-16T13:37:29.184 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-16T13:37:29.184 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-10-16T13:37:29.184 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2023-10-16T13:37:29.184 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-10-16T13:37:29.184 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2023-10-16T13:37:29.184 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2023-10-16T13:37:29.185 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-10-16T13:37:29.185 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2023-10-16T13:37:29.185 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2023-10-16T13:37:29.185 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-10-16T13:37:29.185 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.186 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T13:37:29.186 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T13:37:29.186 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T13:37:29.186 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.186 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T13:37:29.187 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T13:37:29.187 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T13:37:29.187 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.187 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2023-10-16T13:37:29.187 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2023-10-16T13:37:29.187 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.188 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2023-10-16T13:37:29.188 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2023-10-16T13:37:29.188 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-16T13:37:29.188 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2023-10-16T13:37:29.188 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2023-10-16T13:37:29.188 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2023-10-16T13:37:29.189 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2023-10-16T13:37:29.189 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T13:37:29.189 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T13:37:29.189 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2023-10-16T13:37:29.189 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2023-10-16T13:37:29.189 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-16T13:37:29.190 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2023-10-16T13:37:29.190 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2023-10-16T13:37:29.190 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2023-10-16T13:37:29.190 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2023-10-16T13:37:29.190 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2023-10-16T13:37:29.191 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2023-10-16T13:37:29.191 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-10-16T13:37:29.191 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-10-16T13:37:29.191 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-10-16T13:37:29.191 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-10-16T13:37:29.192 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2023-10-16T13:37:29.192 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2023-10-16T13:37:29.192 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2023-10-16T13:37:29.192 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-16T13:37:29.192 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2023-10-16T13:37:29.192 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2023-10-16T13:37:29.193 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2023-10-16T13:37:29.193 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2023-10-16T13:37:29.193 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2023-10-16T13:37:29.193 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2023-10-16T13:37:29.193 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2023-10-16T13:37:29.194 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T13:37:29.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T13:37:29.354 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T13:37:29.355 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:29.355 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T13:37:29.372 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:29.372 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T13:37:29.429 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:37:29.429 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:29.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T13:37:29.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T13:37:29.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:29.507 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:29.565 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:37:29.565 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:29.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T13:37:29.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T13:37:29.604 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:29.605 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:29.661 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T13:37:29.661 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T13:37:29.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T13:37:29.717 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T13:37:29.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T13:37:29.810 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T13:37:29.812 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T13:37:29.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T13:37:29.868 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T13:37:29.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T13:37:29.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T13:37:29.993 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T13:37:29.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T13:37:30.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T13:37:30.077 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T13:37:30.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T13:37:30.105 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T13:37:30.198 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T13:37:30.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T13:37:30.226 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T13:37:30.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T13:37:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T13:37:30.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T13:37:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T13:37:30.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T13:37:30.385 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T13:37:30.398 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-16T13:37:30.481 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-16T13:37:30.494 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T13:37:30.494 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T13:37:30.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T13:37:30.522 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:30.523 INFO:tasks.ceph:role: osd.0 2023-10-16T13:37:30.523 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:37:30.523 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T13:37:30.589 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:30.589 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:30.589 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:30.590 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:30.590 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:30.590 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:30.590 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:30.591 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:30.591 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:30.591 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:30.612 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-10-16T13:37:30.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-10-16T13:37:30.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T13:37:30.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T13:37:30.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T13:37:30.834 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:30.835 INFO:tasks.ceph:role: osd.1 2023-10-16T13:37:30.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:37:30.835 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T13:37:30.901 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:30.901 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:30.901 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:30.902 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:30.902 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:30.903 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:30.923 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-10-16T13:37:30.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-10-16T13:37:30.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T13:37:31.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T13:37:31.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T13:37:31.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:31.145 INFO:tasks.ceph:role: osd.2 2023-10-16T13:37:31.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:37:31.146 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T13:37:31.211 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:31.212 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:31.212 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:31.212 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:31.212 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:31.212 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:31.212 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:31.213 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:31.213 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:31.213 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:31.234 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-10-16T13:37:31.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-10-16T13:37:31.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T13:37:31.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T13:37:31.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T13:37:31.454 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:31.455 INFO:tasks.ceph:role: osd.3 2023-10-16T13:37:31.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:37:31.455 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T13:37:31.520 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:31.521 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:31.521 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:31.521 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:31.521 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:31.521 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:31.522 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:31.522 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:31.522 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:31.522 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:31.543 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-10-16T13:37:31.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-10-16T13:37:31.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T13:37:31.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T13:37:31.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:31.827+0000 7ffbf89c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T13:37:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:31.827+0000 7ffbf89c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T13:37:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:31.828+0000 7ffbf89c2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T13:37:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:31.828+0000 7ffbf89c2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T13:37:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:31.828+0000 7ffbf89c2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T13:37:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:31.828+0000 7ffbf89c2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T13:37:34.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T13:37:34.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:34.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:34.824+0000 7f4324f45640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T13:37:34.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:34.824+0000 7f4324f45640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T13:37:34.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:34.824+0000 7f4324f45640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T13:37:34.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:34.824+0000 7f4324f45640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T13:37:34.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:34.824+0000 7f4324f45640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T13:37:34.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:34.824+0000 7f4324f45640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T13:37:37.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T13:37:37.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:37.821+0000 7fef31143640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T13:37:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:37.821+0000 7fef31143640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T13:37:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:37.821+0000 7fef31143640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T13:37:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:37.821+0000 7fef31143640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T13:37:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:37.821+0000 7fef31143640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T13:37:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:37.821+0000 7fef31143640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T13:37:40.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T13:37:40.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:40.812+0000 7f81ae3c6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T13:37:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:40.812+0000 7f81ae3c6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T13:37:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:40.812+0000 7f81ae3c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T13:37:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:40.812+0000 7f81ae3c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T13:37:40.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:40.812+0000 7f81ae3c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T13:37:40.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:37:40.812+0000 7f81ae3c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T13:37:43.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T13:37:43.728 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T13:37:43.761 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:43.761 INFO:tasks.ceph:role: osd.4 2023-10-16T13:37:43.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:37:43.762 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T13:37:43.839 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:43.839 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:43.840 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:43.840 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:43.840 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:43.840 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:43.840 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:43.841 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:43.841 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:43.841 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:44.269 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-16T13:37:44.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-16T13:37:44.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T13:37:44.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T13:37:44.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T13:37:44.539 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:44.540 INFO:tasks.ceph:role: osd.5 2023-10-16T13:37:44.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:37:44.541 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T13:37:44.616 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:44.617 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:44.617 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:44.617 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:44.617 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:44.617 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:44.618 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:44.618 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:44.618 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:44.618 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:45.041 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-16T13:37:45.043 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-16T13:37:45.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T13:37:45.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T13:37:45.195 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T13:37:45.263 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:45.264 INFO:tasks.ceph:role: osd.6 2023-10-16T13:37:45.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:37:45.264 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T13:37:45.340 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:45.340 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:45.340 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:45.341 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:45.341 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:45.341 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:45.341 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:45.341 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:45.342 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:45.342 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:45.789 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-16T13:37:45.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-16T13:37:45.792 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T13:37:45.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T13:37:45.992 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T13:37:46.060 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T13:37:46.061 INFO:tasks.ceph:role: osd.7 2023-10-16T13:37:46.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:37:46.061 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T13:37:46.135 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T13:37:46.135 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T13:37:46.135 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T13:37:46.135 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T13:37:46.136 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T13:37:46.136 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-16T13:37:46.136 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T13:37:46.136 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T13:37:46.136 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T13:37:46.137 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T13:37:46.573 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-16T13:37:46.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-16T13:37:46.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T13:37:46.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T13:37:46.758 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:46.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:46.861+0000 7f0b23971640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T13:37:46.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:46.861+0000 7f0b23971640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T13:37:46.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:46.861+0000 7f0b23971640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T13:37:46.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:46.861+0000 7f0b23971640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T13:37:46.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:46.861+0000 7f0b23971640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T13:37:46.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:46.862+0000 7f0b23971640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T13:37:49.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T13:37:49.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:49.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:49.837+0000 7f03fef76640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T13:37:49.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:49.837+0000 7f03fef76640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T13:37:49.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:49.837+0000 7f03fef76640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T13:37:49.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:49.838+0000 7f03fef76640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T13:37:49.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:49.838+0000 7f03fef76640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T13:37:49.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:49.838+0000 7f03fef76640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T13:37:52.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T13:37:52.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:52.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:52.833+0000 7fbb95d7e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T13:37:52.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:52.833+0000 7fbb95d7e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T13:37:52.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:52.833+0000 7fbb95d7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T13:37:52.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:52.833+0000 7fbb95d7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T13:37:52.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:52.833+0000 7fbb95d7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T13:37:52.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:52.834+0000 7fbb95d7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T13:37:55.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T13:37:55.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:37:55.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:55.825+0000 7f11f7460640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T13:37:55.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:55.825+0000 7f11f7460640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T13:37:55.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:55.825+0000 7f11f7460640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T13:37:55.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:55.825+0000 7f11f7460640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T13:37:55.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:55.825+0000 7f11f7460640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T13:37:55.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:37:55.826+0000 7f11f7460640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T13:37:57.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:37:57.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:37:58.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T13:37:58.733 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T13:37:58.733 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:58.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T13:37:58.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:58.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T13:37:58.838 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:58.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T13:37:58.908 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:58.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T13:37:58.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:58.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T13:37:59.049 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:59.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T13:37:59.119 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:59.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T13:37:59.189 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T13:37:59.221 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T13:37:59.292 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.293 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T13:37:59.363 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T13:37:59.433 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T13:37:59.502 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T13:37:59.570 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.571 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T13:37:59.638 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:59.639 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T13:37:59.660 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:37:59.660 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T13:37:59.721 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.721 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T13:37:59.739 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:37:59.739 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-16T13:37:59.796 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T13:37:59.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T13:37:59.800 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T13:37:59.839 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2023-10-16T13:37:59.840 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA== 2023-10-16T13:37:59.840 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-10-16T13:37:59.840 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g== 2023-10-16T13:37:59.840 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-10-16T13:37:59.841 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w== 2023-10-16T13:37:59.841 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2023-10-16T13:37:59.841 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ== 2023-10-16T13:37:59.841 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2023-10-16T13:37:59.841 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ== 2023-10-16T13:37:59.842 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2023-10-16T13:37:59.842 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w== 2023-10-16T13:37:59.842 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2023-10-16T13:37:59.842 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A== 2023-10-16T13:37:59.842 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2023-10-16T13:37:59.843 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ== 2023-10-16T13:37:59.843 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-10-16T13:37:59.843 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ== 2023-10-16T13:37:59.843 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-10-16T13:37:59.843 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug== 2023-10-16T13:37:59.844 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2023-10-16T13:37:59.844 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ== 2023-10-16T13:37:59.844 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2023-10-16T13:37:59.844 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg== 2023-10-16T13:37:59.844 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2023-10-16T13:37:59.844 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA== 2023-10-16T13:37:59.845 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2023-10-16T13:37:59.845 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw== 2023-10-16T13:37:59.845 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:37:59.845 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:37:59.845 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2023-10-16T13:37:59.846 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw== 2023-10-16T13:37:59.846 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2023-10-16T13:37:59.846 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw== 2023-10-16T13:37:59.846 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2023-10-16T13:37:59.846 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg== 2023-10-16T13:37:59.862 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2023-10-16T13:37:59.862 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA== 2023-10-16T13:37:59.862 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-10-16T13:37:59.863 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g== 2023-10-16T13:37:59.863 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-10-16T13:37:59.863 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w== 2023-10-16T13:37:59.863 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2023-10-16T13:37:59.863 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ== 2023-10-16T13:37:59.864 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2023-10-16T13:37:59.864 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ== 2023-10-16T13:37:59.864 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2023-10-16T13:37:59.864 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w== 2023-10-16T13:37:59.864 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2023-10-16T13:37:59.865 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A== 2023-10-16T13:37:59.865 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2023-10-16T13:37:59.865 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ== 2023-10-16T13:37:59.865 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-10-16T13:37:59.865 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ== 2023-10-16T13:37:59.865 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-10-16T13:37:59.866 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug== 2023-10-16T13:37:59.866 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2023-10-16T13:37:59.866 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ== 2023-10-16T13:37:59.866 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2023-10-16T13:37:59.866 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg== 2023-10-16T13:37:59.867 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2023-10-16T13:37:59.867 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA== 2023-10-16T13:37:59.867 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2023-10-16T13:37:59.867 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw== 2023-10-16T13:37:59.867 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2023-10-16T13:37:59.867 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:37:59.868 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2023-10-16T13:37:59.868 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw== 2023-10-16T13:37:59.868 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2023-10-16T13:37:59.868 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw== 2023-10-16T13:37:59.868 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2023-10-16T13:37:59.869 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg== 2023-10-16T13:37:59.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T13:37:59.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T13:37:59.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:37:59.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.088 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T13:38:00.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T13:38:00.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.426 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T13:38:00.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.651 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T13:38:00.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T13:38:00.942 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T13:38:00.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T13:38:00.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T13:38:01.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T13:38:01.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T13:38:01.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T13:38:01.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T13:38:01.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T13:38:01.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T13:38:01.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T13:38:01.443 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:38:01.445 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T13:38:01.500 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T13:38:01.500 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T13:38:01.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T13:38:01.503 INFO:tasks.ceph.mon.a:Started 2023-10-16T13:38:01.504 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T13:38:01.504 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T13:38:01.542 INFO:tasks.ceph.mon.b:Started 2023-10-16T13:38:01.543 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T13:38:01.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T13:38:01.545 INFO:tasks.ceph.mon.c:Started 2023-10-16T13:38:01.546 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T13:38:01.546 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T13:38:01.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T13:38:01.549 INFO:tasks.ceph.mgr.y:Started 2023-10-16T13:38:01.549 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T13:38:01.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T13:38:01.552 INFO:tasks.ceph.mgr.x:Started 2023-10-16T13:38:01.552 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T13:38:01.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T13:38:01.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.678+0000 7f3d71416700 1 Processor -- start 2023-10-16T13:38:01.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 -- start start 2023-10-16T13:38:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c15e4e0 con 0x7f3d6c15dbc0 2023-10-16T13:38:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c0b7560 con 0x7f3d6c0b7050 2023-10-16T13:38:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d71416700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0b7840 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.679+0000 7f3d6affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41246/0 (socket says 172.21.15.5:41246) 2023-10-16T13:38:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6affd700 1 -- 172.21.15.5:0/1284664759 learned_addr learned my addr 172.21.15.5:0/1284664759 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6b7fe700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6affd700 1 -- 172.21.15.5:0/1284664759 >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 msgr2=0x7f3d6c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T13:38:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6affd700 1 -- 172.21.15.5:0/1284664759 >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 msgr2=0x7f3d6c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T13:38:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6affd700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T13:38:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6b7fe700 1 -- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 msgr2=0x7f3d6c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T13:38:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6b7fe700 1 -- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 msgr2=0x7f3d6c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T13:38:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6b7fe700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T13:38:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6b7fe700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:38:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6a7fc700 1 -- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 msgr2=0x7f3d6c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T13:38:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6affd700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:38:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6a7fc700 1 -- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 msgr2=0x7f3d6c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T13:38:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T13:38:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.680+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T13:38:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6b7fe700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 -- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 msgr2=0x7f3d6c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 -- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 msgr2=0x7f3d6c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 -- 172.21.15.5:0/1284664759 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0b7b20 con 0x7f3d6c15dbc0 2023-10-16T13:38:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d6affd700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c08daa0 tx=0x7f3d60009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8080fbf22637f94f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d69ffb700 1 -- 172.21.15.5:0/1284664759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60017070 con 0x7f3d6c15dbc0 2023-10-16T13:38:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d69ffb700 1 -- 172.21.15.5:0/1284664759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60005a20 con 0x7f3d6c15dbc0 2023-10-16T13:38:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.881+0000 7f3d69ffb700 1 -- 172.21.15.5:0/1284664759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000c070 con 0x7f3d6c15dbc0 2023-10-16T13:38:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 -- 172.21.15.5:0/1284664759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15dbc0 msgr2=0x7f3d6c15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c08daa0 tx=0x7f3d60009c30 comp rx=0 tx=0).stop 2023-10-16T13:38:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 -- 172.21.15.5:0/1284664759 shutdown_connections 2023-10-16T13:38:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 --2- 172.21.15.5:0/1284664759 >> v2:172.21.15.112:3300/0 conn(0x7f3d6c0b7050 0x7f3d6c0d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c15dfa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 --2- 172.21.15.5:0/1284664759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0d3fc0 0x7f3d6c0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 -- 172.21.15.5:0/1284664759 >> 172.21.15.5:0/1284664759 conn(0x7f3d6c09cb40 msgr2=0x7f3d6c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 -- 172.21.15.5:0/1284664759 shutdown_connections 2023-10-16T13:38:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.882+0000 7f3d71416700 1 -- 172.21.15.5:0/1284664759 wait complete. 2023-10-16T13:38:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 Processor -- start 2023-10-16T13:38:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 -- start start 2023-10-16T13:38:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0b7050 0x7f3d6c1f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 0x7f3d6c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c1f31b0 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0cb4b0 con 0x7f3d6c15dbc0 2023-10-16T13:38:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d71416700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0cb790 con 0x7f3d6c0b7050 2023-10-16T13:38:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.884+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 0x7f3d6c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 0x7f3d6c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41274/0 (socket says 172.21.15.5:41274) 2023-10-16T13:38:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 -- 172.21.15.5:0/3871311463 learned_addr learned my addr 172.21.15.5:0/3871311463 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6b7fe700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6affd700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0b7050 0x7f3d6c1f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 -- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0b7050 msgr2=0x7f3d6c1f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0b7050 0x7f3d6c1f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 -- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d6c15dbc0 msgr2=0x7f3d6c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 -- 172.21.15.5:0/3871311463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009560 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6b7fe700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d6a7fc700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 0x7f3d6c15be00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009730 tx=0x7f3d5c009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c014610 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c014770 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c0cba70 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c014ae0 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c153cf0 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3d5c014c40 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.885+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3d5c01ddf0 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.887+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c1589d0 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.889+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3d5c03cb40 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.955 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:01.952+0000 7fdd93edb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:38:01.959 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:01.956+0000 7ff60c19d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T13:38:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.968+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3d6c04ebb0 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.969+0000 7f3d537fe700 1 -- 172.21.15.5:0/3871311463 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3d5c02b070 con 0x7f3d6c0d3fc0 2023-10-16T13:38:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 msgr2=0x7f3d6c15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 0x7f3d6c15be00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009730 tx=0x7f3d5c009a40 comp rx=0 tx=0).stop 2023-10-16T13:38:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 shutdown_connections 2023-10-16T13:38:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d6c15dbc0 0x7f3d6c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d6c0b7050 0x7f3d6c1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 --2- 172.21.15.5:0/3871311463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0d3fc0 0x7f3d6c15be00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 >> 172.21.15.5:0/3871311463 conn(0x7f3d6c09cb40 msgr2=0x7f3d6c06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 shutdown_connections 2023-10-16T13:38:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:01.970+0000 7f3d71416700 1 -- 172.21.15.5:0/3871311463 wait complete. 2023-10-16T13:38:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-10-16T13:38:01.985 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T13:38:01.986 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T13:38:01.986 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:01.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T13:38:02.014 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:02.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T13:38:02.020 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.018+0000 7fdd93edb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:38:02.030 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.028+0000 7ff60c19d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T13:38:02.057 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:02.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T13:38:02.095 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.093+0000 7fdd93edb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:38:02.111 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.109+0000 7ff60c19d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T13:38:02.125 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:02.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T13:38:02.173 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.170+0000 7fdd93edb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:38:02.195 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:02.195 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T13:38:02.199 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.197+0000 7ff60c19d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T13:38:02.222 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:02.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T13:38:02.287 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:02.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T13:38:02.319 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.317+0000 7fdd93edb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:38:02.344 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:02.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T13:38:02.349 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.346+0000 7ff60c19d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T13:38:02.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a 0 2023-10-16T13:38:02.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 Processor -- start 2023-10-16T13:38:02.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 -- start start 2023-10-16T13:38:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 0x7fdbfc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdbfc0cfc60 0x7fdbfc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc15e7a0 con 0x7fdbfc15ab10 2023-10-16T13:38:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0d00d0 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.568+0000 7fdc01c8c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0b29a0 con 0x7fdbfc15f1f0 2023-10-16T13:38:02.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 0x7fdbfc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 0x7fdbfc0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43798/0 (socket says 172.21.15.112:43798) 2023-10-16T13:38:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 -- 172.21.15.112:0/1533897926 learned_addr learned my addr 172.21.15.112:0/1533897926 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfbfff700 1 --2- 172.21.15.112:0/1533897926 >> v2:172.21.15.5:3300/0 conn(0x7fdbfc0cfc60 0x7fdbfc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 -- 172.21.15.112:0/1533897926 >> v2:172.21.15.5:3300/0 conn(0x7fdbfc0cfc60 msgr2=0x7fdbfc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:02.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 --2- 172.21.15.112:0/1533897926 >> v2:172.21.15.5:3300/0 conn(0x7fdbfc0cfc60 0x7fdbfc0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfa7fc700 1 -- 172.21.15.112:0/1533897926 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630668853 0 0) 0x7fdbfc15e7a0 con 0x7fdbfc15ab10 2023-10-16T13:38:02.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 -- 172.21.15.112:0/1533897926 >> v1:172.21.15.112:6789/0 conn(0x7fdbfc15ab10 legacy=0x7fdbfc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 -- 172.21.15.112:0/1533897926 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0b2c80 con 0x7fdbfc15f1f0 2023-10-16T13:38:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfaffd700 1 --2- 172.21.15.112:0/1533897926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 0x7fdbfc0cf720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0006fd0 tx=0x7fdbf000be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc36ab8861973d35 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfa7fc700 1 -- 172.21.15.112:0/1533897926 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0005e30 con 0x7fdbfc15f1f0 2023-10-16T13:38:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfa7fc700 1 -- 172.21.15.112:0/1533897926 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0004030 con 0x7fdbfc15f1f0 2023-10-16T13:38:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.569+0000 7fdbfa7fc700 1 -- 172.21.15.112:0/1533897926 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00043e0 con 0x7fdbfc15f1f0 2023-10-16T13:38:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1533897926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 msgr2=0x7fdbfc0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1533897926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 0x7fdbfc0cf720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0006fd0 tx=0x7fdbf000be70 comp rx=0 tx=0).stop 2023-10-16T13:38:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1533897926 shutdown_connections 2023-10-16T13:38:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1533897926 >> v2:172.21.15.5:3300/0 conn(0x7fdbfc0cfc60 0x7fdbfc0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1533897926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc15f1f0 0x7fdbfc0cf720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1533897926 >> 172.21.15.112:0/1533897926 conn(0x7fdbfc06dae0 msgr2=0x7fdbfc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1533897926 shutdown_connections 2023-10-16T13:38:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.570+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1533897926 wait complete. 2023-10-16T13:38:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.571+0000 7fdc01c8c700 1 Processor -- start 2023-10-16T13:38:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.571+0000 7fdc01c8c700 1 -- start start 2023-10-16T13:38:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdc01c8c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 0x7fdbfc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdc01c8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc15ab10 0x7fdbfc06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdc01c8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbfc15f1f0 0x7fdbfc06e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdc01c8c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c78c0 con 0x7fdbfc15f1f0 2023-10-16T13:38:02.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdc01c8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc154780 con 0x7fdbfc15ab10 2023-10-16T13:38:02.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdc01c8c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c91b0 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdbfb7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 0x7fdbfc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdbfaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc15ab10 0x7fdbfc06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdbfb7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 0x7fdbfc1535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43804/0 (socket says 172.21.15.112:43804) 2023-10-16T13:38:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdbfb7fe700 1 -- 172.21.15.112:0/1646377037 learned_addr learned my addr 172.21.15.112:0/1646377037 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.572+0000 7fdbfbfff700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbfc15f1f0 0x7fdbfc06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfb7fe700 1 -- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc15ab10 msgr2=0x7fdbfc06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfb7fe700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc15ab10 0x7fdbfc06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfb7fe700 1 -- 172.21.15.112:0/1646377037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbfc15f1f0 msgr2=0x7fdbfc06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfb7fe700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbfc15f1f0 0x7fdbfc06e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfb7fe700 1 -- 172.21.15.112:0/1646377037 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf000b7a0 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfaffd700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc15ab10 0x7fdbfc06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbfb7fe700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 0x7fdbfc1535e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0011e0 tx=0x7fdbec00ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0054e0 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec003680 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc1549d0 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec003a30 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc154f90 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.573+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdbec01c440 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.574+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdbec012740 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.574+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc067d20 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.576+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdbec017070 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.658+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a", "id": 0} v 0) v1 -- 0x7fdbfc0afc10 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.661+0000 7fdbe3fff700 1 -- 172.21.15.112:0/1646377037 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbec01c8d0 con 0x7fdbfc0cfc60 2023-10-16T13:38:02.664 INFO:teuthology.orchestra.run.smithi112.stdout:0 2023-10-16T13:38:02.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 msgr2=0x7fdbfc1535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 0x7fdbfc1535e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0011e0 tx=0x7fdbec00ca30 comp rx=0 tx=0).stop 2023-10-16T13:38:02.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 shutdown_connections 2023-10-16T13:38:02.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbfc15f1f0 0x7fdbfc06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdbfc0cfc60 0x7fdbfc1535e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 --2- 172.21.15.112:0/1646377037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbfc15ab10 0x7fdbfc06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 >> 172.21.15.112:0/1646377037 conn(0x7fdbfc06dae0 msgr2=0x7fdbfc0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:02.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 shutdown_connections 2023-10-16T13:38:02.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.662+0000 7fdc01c8c700 1 -- 172.21.15.112:0/1646377037 wait complete. 2023-10-16T13:38:02.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 8e9ffbf0-550d-4af3-945f-a1c2f251ff96 1 2023-10-16T13:38:02.715 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.712+0000 7fdd93edb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:38:02.771 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.768+0000 7ff60c19d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T13:38:02.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.794+0000 7fca35684700 1 Processor -- start 2023-10-16T13:38:02.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.794+0000 7fca35684700 1 -- start start 2023-10-16T13:38:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca35684700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca300cd950 0x7fca3015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca35684700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300cf260 con 0x7fca3006a840 2023-10-16T13:38:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca35684700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300b2d60 con 0x7fca300cede0 2023-10-16T13:38:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca35684700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca301619a0 con 0x7fca300cd950 2023-10-16T13:38:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca300cd950 0x7fca3015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2e7fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fca300cede0 0x7fca3015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49318/0 (socket says 172.21.15.112:49318) 2023-10-16T13:38:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2e7fc700 1 -- 172.21.15.112:0/1180998120 learned_addr learned my addr 172.21.15.112:0/1180998120 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-16T13:38:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2dffb700 1 -- 172.21.15.112:0/1180998120 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688375113 0 0) 0x7fca300b2d60 con 0x7fca300cede0 2023-10-16T13:38:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2effd700 1 -- 172.21.15.112:0/1180998120 >> v1:172.21.15.112:6789/0 conn(0x7fca300cede0 legacy=0x7fca3015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2effd700 1 -- 172.21.15.112:0/1180998120 >> v1:172.21.15.5:6789/0 conn(0x7fca3006a840 legacy=0x7fca30161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.795+0000 7fca2effd700 1 -- 172.21.15.112:0/1180998120 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300cdd30 con 0x7fca300cd950 2023-10-16T13:38:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca2effd700 1 --2- 172.21.15.112:0/1180998120 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca300cd950 0x7fca3015e2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca20009870 tx=0x7fca20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82f1206b3d74315 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca2dffb700 1 -- 172.21.15.112:0/1180998120 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20011830 con 0x7fca300cd950 2023-10-16T13:38:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca2dffb700 1 -- 172.21.15.112:0/1180998120 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20011990 con 0x7fca300cd950 2023-10-16T13:38:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca2dffb700 1 -- 172.21.15.112:0/1180998120 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20011d20 con 0x7fca300cd950 2023-10-16T13:38:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 -- 172.21.15.112:0/1180998120 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca300cd950 msgr2=0x7fca3015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 --2- 172.21.15.112:0/1180998120 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca300cd950 0x7fca3015e2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca20009870 tx=0x7fca20009b80 comp rx=0 tx=0).stop 2023-10-16T13:38:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 -- 172.21.15.112:0/1180998120 shutdown_connections 2023-10-16T13:38:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 --2- 172.21.15.112:0/1180998120 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca300cd950 0x7fca3015e2f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 -- 172.21.15.112:0/1180998120 >> 172.21.15.112:0/1180998120 conn(0x7fca3006dae0 msgr2=0x7fca3006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 -- 172.21.15.112:0/1180998120 shutdown_connections 2023-10-16T13:38:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.796+0000 7fca35684700 1 -- 172.21.15.112:0/1180998120 wait complete. 2023-10-16T13:38:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.798+0000 7fca35684700 1 Processor -- start 2023-10-16T13:38:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.798+0000 7fca35684700 1 -- start start 2023-10-16T13:38:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.798+0000 7fca35684700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 0x7fca301f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca35684700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca300cd950 0x7fca300ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca35684700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca300cede0 0x7fca300ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:02.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca35684700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c98a0 con 0x7fca300cede0 2023-10-16T13:38:02.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca35684700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c9410 con 0x7fca300cd950 2023-10-16T13:38:02.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca35684700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c8800 con 0x7fca3006a840 2023-10-16T13:38:02.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 0x7fca301f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 0x7fca301f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43816/0 (socket says 172.21.15.112:43816) 2023-10-16T13:38:02.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 -- 172.21.15.112:0/2569038789 learned_addr learned my addr 172.21.15.112:0/2569038789 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:02.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2f7fe700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca300cede0 0x7fca300ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2e7fc700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca300cd950 0x7fca300ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:02.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 -- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca300cd950 msgr2=0x7fca300ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca300cd950 0x7fca300ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 -- 172.21.15.112:0/2569038789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca300cede0 msgr2=0x7fca300ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca300cede0 0x7fca300ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 -- 172.21.15.112:0/2569038789 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200094a0 con 0x7fca3006a840 2023-10-16T13:38:02.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2e7fc700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca300cd950 0x7fca300ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:02.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2f7fe700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca300cede0 0x7fca300ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:02.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca2effd700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 0x7fca301f3290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca20000c00 tx=0x7fca20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:02.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200036a0 con 0x7fca3006a840 2023-10-16T13:38:02.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2001f070 con 0x7fca3006a840 2023-10-16T13:38:02.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca300c8ae0 con 0x7fca3006a840 2023-10-16T13:38:02.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.799+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20003a20 con 0x7fca3006a840 2023-10-16T13:38:02.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.800+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300c90a0 con 0x7fca3006a840 2023-10-16T13:38:02.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.800+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca20026480 con 0x7fca3006a840 2023-10-16T13:38:02.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.800+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fca20021070 con 0x7fca3006a840 2023-10-16T13:38:02.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.801+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca30067d20 con 0x7fca3006a840 2023-10-16T13:38:02.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.803+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fca20015020 con 0x7fca3006a840 2023-10-16T13:38:02.835 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.833+0000 7fdd93edb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:38:02.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.886+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e9ffbf0-550d-4af3-945f-a1c2f251ff96", "id": 1} v 0) v1 -- 0x7fca300b2630 con 0x7fca3006a840 2023-10-16T13:38:02.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.889+0000 7fca177fe700 1 -- 172.21.15.112:0/2569038789 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e9ffbf0-550d-4af3-945f-a1c2f251ff96", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca20026a40 con 0x7fca3006a840 2023-10-16T13:38:02.892 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:38:02.892 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.889+0000 7ff60c19d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T13:38:02.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 msgr2=0x7fca301f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:02.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 0x7fca301f3290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca20000c00 tx=0x7fca20004750 comp rx=0 tx=0).stop 2023-10-16T13:38:02.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 shutdown_connections 2023-10-16T13:38:02.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca300cede0 0x7fca300ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca3006a840 0x7fca301f3290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 --2- 172.21.15.112:0/2569038789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca300cd950 0x7fca300ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:02.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 >> 172.21.15.112:0/2569038789 conn(0x7fca3006dae0 msgr2=0x7fca30160640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:02.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 shutdown_connections 2023-10-16T13:38:02.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:02.890+0000 7fca35684700 1 -- 172.21.15.112:0/2569038789 wait complete. 2023-10-16T13:38:02.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 9dfd2a3e-7a40-415b-855b-aace5e923ee8 2 2023-10-16T13:38:02.929 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:02.927+0000 7fdd93edb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:38:02.988 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:02.985+0000 7ff60c19d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T13:38:03.014 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:03.011+0000 7fdd93edb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:38:03.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.046+0000 7fa798073700 1 Processor -- start 2023-10-16T13:38:03.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.046+0000 7fa798073700 1 -- start start 2023-10-16T13:38:03.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa798073700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa79015ab10 0x7fa79015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa798073700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900cfe30 0x7fa7900cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa798073700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79015e7a0 con 0x7fa7900b1f50 2023-10-16T13:38:03.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa798073700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79015f730 con 0x7fa79015ab10 2023-10-16T13:38:03.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa798073700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900b29a0 con 0x7fa7900cfe30 2023-10-16T13:38:03.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa795e0f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa79015ab10 0x7fa79015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa796610700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900cfe30 0x7fa7900cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa79560e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa7900b1f50 0x7fa7900cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49330/0 (socket says 172.21.15.112:49330) 2023-10-16T13:38:03.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.047+0000 7fa79560e700 1 -- 172.21.15.112:0/2646685771 learned_addr learned my addr 172.21.15.112:0/2646685771 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-16T13:38:03.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa795e0f700 1 -- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900cfe30 msgr2=0x7fa7900cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:03.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa795e0f700 1 --2- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900cfe30 0x7fa7900cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa795e0f700 1 -- 172.21.15.112:0/2646685771 >> v1:172.21.15.112:6789/0 conn(0x7fa7900b1f50 legacy=0x7fa7900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa794e0d700 1 -- 172.21.15.112:0/2646685771 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503807100 0 0) 0x7fa79015e7a0 con 0x7fa7900b1f50 2023-10-16T13:38:03.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa795e0f700 1 -- 172.21.15.112:0/2646685771 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7900b2c80 con 0x7fa79015ab10 2023-10-16T13:38:03.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa795e0f700 1 --2- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa79015f1f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009840 tx=0x7fa78c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=665ab0927e93b315 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa794e0d700 1 -- 172.21.15.112:0/2646685771 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c011830 con 0x7fa79015ab10 2023-10-16T13:38:03.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa794e0d700 1 -- 172.21.15.112:0/2646685771 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c011990 con 0x7fa79015ab10 2023-10-16T13:38:03.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa794e0d700 1 -- 172.21.15.112:0/2646685771 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c011d20 con 0x7fa79015ab10 2023-10-16T13:38:03.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa798073700 1 -- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 msgr2=0x7fa79015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.048+0000 7fa798073700 1 --2- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa79015f1f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009840 tx=0x7fa78c009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:03.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.049+0000 7fa798073700 1 -- 172.21.15.112:0/2646685771 shutdown_connections 2023-10-16T13:38:03.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.049+0000 7fa798073700 1 --2- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa79015f1f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.049+0000 7fa798073700 1 --2- 172.21.15.112:0/2646685771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900cfe30 0x7fa7900cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.049+0000 7fa798073700 1 -- 172.21.15.112:0/2646685771 >> 172.21.15.112:0/2646685771 conn(0x7fa79006dae0 msgr2=0x7fa79006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.049+0000 7fa798073700 1 -- 172.21.15.112:0/2646685771 shutdown_connections 2023-10-16T13:38:03.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.049+0000 7fa798073700 1 -- 172.21.15.112:0/2646685771 wait complete. 2023-10-16T13:38:03.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 Processor -- start 2023-10-16T13:38:03.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 -- start start 2023-10-16T13:38:03.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900b1f50 0x7fa790156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7900cfe30 0x7fa7900c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa7900c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900c5660 con 0x7fa7900cfe30 2023-10-16T13:38:03.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900c4a50 con 0x7fa79015ab10 2023-10-16T13:38:03.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.050+0000 7fa798073700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900c4d30 con 0x7fa7900b1f50 2023-10-16T13:38:03.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa7900c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa7900c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32770/0 (socket says 172.21.15.112:32770) 2023-10-16T13:38:03.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 -- 172.21.15.112:0/3127225126 learned_addr learned my addr 172.21.15.112:0/3127225126 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa79560e700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7900cfe30 0x7fa7900c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa795e0f700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900b1f50 0x7fa790156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 -- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900b1f50 msgr2=0x7fa790156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900b1f50 0x7fa790156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 -- 172.21.15.112:0/3127225126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7900cfe30 msgr2=0x7fa7900c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7900cfe30 0x7fa7900c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 -- 172.21.15.112:0/3127225126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0094a0 con 0x7fa79015ab10 2023-10-16T13:38:03.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa79560e700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7900cfe30 0x7fa7900c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:03.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa796610700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa7900c5af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa78800ef90 tx=0x7fa78800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788009b20 con 0x7fa79015ab10 2023-10-16T13:38:03.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78800f040 con 0x7fa79015ab10 2023-10-16T13:38:03.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7900c5010 con 0x7fa79015ab10 2023-10-16T13:38:03.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788009e50 con 0x7fa79015ab10 2023-10-16T13:38:03.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7900b53b0 con 0x7fa79015ab10 2023-10-16T13:38:03.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa788014780 con 0x7fa79015ab10 2023-10-16T13:38:03.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.051+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa78801ddc0 con 0x7fa79015ab10 2023-10-16T13:38:03.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.052+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7900c57d0 con 0x7fa79015ab10 2023-10-16T13:38:03.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.054+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa78803bb40 con 0x7fa79015ab10 2023-10-16T13:38:03.073 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:03.070+0000 7ff60c19d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T13:38:03.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.137+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9dfd2a3e-7a40-415b-855b-aace5e923ee8", "id": 2} v 0) v1 -- 0x7fa790067d20 con 0x7fa79015ab10 2023-10-16T13:38:03.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.140+0000 7fa7867fc700 1 -- 172.21.15.112:0/3127225126 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9dfd2a3e-7a40-415b-855b-aace5e923ee8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa78802a030 con 0x7fa79015ab10 2023-10-16T13:38:03.143 INFO:teuthology.orchestra.run.smithi112.stdout:2 2023-10-16T13:38:03.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.141+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 msgr2=0x7fa7900c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.141+0000 7fa798073700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa7900c5af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa78800ef90 tx=0x7fa78800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.141+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 shutdown_connections 2023-10-16T13:38:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.141+0000 7fa798073700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa79015ab10 0x7fa7900c5af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.141+0000 7fa798073700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7900b1f50 0x7fa790156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.141+0000 7fa798073700 1 --2- 172.21.15.112:0/3127225126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7900cfe30 0x7fa7900c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.142+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 >> 172.21.15.112:0/3127225126 conn(0x7fa79006dae0 msgr2=0x7fa79006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.142+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 shutdown_connections 2023-10-16T13:38:03.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.142+0000 7fa798073700 1 -- 172.21.15.112:0/3127225126 wait complete. 2023-10-16T13:38:03.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 117a625d-a91d-4ff9-be04-2441cc71c6ce 3 2023-10-16T13:38:03.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.275+0000 7f35ee4e8700 1 Processor -- start 2023-10-16T13:38:03.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.275+0000 7f35ee4e8700 1 -- start start 2023-10-16T13:38:03.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35ee4e8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35e8160e30 0x7f35e80d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35ee4e8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80b6610 con 0x7f35e8161210 2023-10-16T13:38:03.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35ee4e8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80d1da0 con 0x7f35e80d08a0 2023-10-16T13:38:03.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35ee4e8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80d2080 con 0x7f35e8160e30 2023-10-16T13:38:03.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35eca85700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f35e80d08a0 0x7f35e80ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49342/0 (socket says 172.21.15.112:49342) 2023-10-16T13:38:03.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35eca85700 1 -- 172.21.15.112:0/333109520 learned_addr learned my addr 172.21.15.112:0/333109520 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-16T13:38:03.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35e7fff700 1 --2- 172.21.15.112:0/333109520 >> v2:172.21.15.5:3300/0 conn(0x7f35e8160e30 0x7f35e80d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521997865 0 0) 0x7f35e80d1da0 con 0x7f35e80d08a0 2023-10-16T13:38:03.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d00035b0 con 0x7f35e80d08a0 2023-10-16T13:38:03.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98061505 0 0) 0x7f35e80b6610 con 0x7f35e8161210 2023-10-16T13:38:03.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.276+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e80d1da0 con 0x7f35e8161210 2023-10-16T13:38:03.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e7fff700 1 -- 172.21.15.112:0/333109520 >> v1:172.21.15.112:6789/0 conn(0x7f35e80d08a0 legacy=0x7f35e80ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e7fff700 1 -- 172.21.15.112:0/333109520 >> v1:172.21.15.5:6789/0 conn(0x7f35e8161210 legacy=0x7f35e80d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e7fff700 1 -- 172.21.15.112:0/333109520 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80d2360 con 0x7f35e8160e30 2023-10-16T13:38:03.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e7fff700 1 --2- 172.21.15.112:0/333109520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8160e30 0x7f35e80d4200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009820 tx=0x7f35d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c20bf88837ae785 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8005e30 con 0x7f35e8160e30 2023-10-16T13:38:03.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8006030 con 0x7f35e8160e30 2023-10-16T13:38:03.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35e6ffd700 1 -- 172.21.15.112:0/333109520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80063c0 con 0x7f35e8160e30 2023-10-16T13:38:03.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35ee4e8700 1 -- 172.21.15.112:0/333109520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8160e30 msgr2=0x7f35e80d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.277+0000 7f35ee4e8700 1 --2- 172.21.15.112:0/333109520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8160e30 0x7f35e80d4200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009820 tx=0x7f35d8009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:03.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.278+0000 7f35ee4e8700 1 -- 172.21.15.112:0/333109520 shutdown_connections 2023-10-16T13:38:03.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.278+0000 7f35ee4e8700 1 --2- 172.21.15.112:0/333109520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8160e30 0x7f35e80d4200 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.278+0000 7f35ee4e8700 1 -- 172.21.15.112:0/333109520 >> 172.21.15.112:0/333109520 conn(0x7f35e809cb40 msgr2=0x7f35e80d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.278+0000 7f35ee4e8700 1 -- 172.21.15.112:0/333109520 shutdown_connections 2023-10-16T13:38:03.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.278+0000 7f35ee4e8700 1 -- 172.21.15.112:0/333109520 wait complete. 2023-10-16T13:38:03.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.279+0000 7f35ee4e8700 1 Processor -- start 2023-10-16T13:38:03.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.279+0000 7f35ee4e8700 1 -- start start 2023-10-16T13:38:03.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35ee4e8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 0x7f35e8155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35ee4e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e8160e30 0x7f35e80cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35ee4e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8161210 0x7f35e80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35ee4e8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8156330 con 0x7f35e8161210 2023-10-16T13:38:03.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35ee4e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c7550 con 0x7f35e8160e30 2023-10-16T13:38:03.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35ee4e8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c7830 con 0x7f35e80d08a0 2023-10-16T13:38:03.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 0x7f35e8155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e8160e30 0x7f35e80cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 0x7f35e8155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43838/0 (socket says 172.21.15.112:43838) 2023-10-16T13:38:03.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35e7fff700 1 -- 172.21.15.112:0/827607924 learned_addr learned my addr 172.21.15.112:0/827607924 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.280+0000 7f35eca85700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8161210 0x7f35e80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e7fff700 1 -- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e8160e30 msgr2=0x7f35e80cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e7fff700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e8160e30 0x7f35e80cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e7fff700 1 -- 172.21.15.112:0/827607924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8161210 msgr2=0x7f35e80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e7fff700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8161210 0x7f35e80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e7fff700 1 -- 172.21.15.112:0/827607924 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8009430 con 0x7f35e80d08a0 2023-10-16T13:38:03.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e7fff700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 0x7f35e8155df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f35d8013040 tx=0x7f35d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8006770 con 0x7f35e80d08a0 2023-10-16T13:38:03.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8020070 con 0x7f35e80d08a0 2023-10-16T13:38:03.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e80c7b10 con 0x7f35e80d08a0 2023-10-16T13:38:03.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8025430 con 0x7f35e80d08a0 2023-10-16T13:38:03.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e80c80d0 con 0x7f35e80d08a0 2023-10-16T13:38:03.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f35d8022030 con 0x7f35e80d08a0 2023-10-16T13:38:03.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.281+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f35d80118b0 con 0x7f35e80d08a0 2023-10-16T13:38:03.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.282+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e8067d20 con 0x7f35e80d08a0 2023-10-16T13:38:03.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.284+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f35d80114d0 con 0x7f35e80d08a0 2023-10-16T13:38:03.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.367+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "117a625d-a91d-4ff9-be04-2441cc71c6ce", "id": 3} v 0) v1 -- 0x7f35e806d7b0 con 0x7f35e80d08a0 2023-10-16T13:38:03.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.370+0000 7f35e4ff9700 1 -- 172.21.15.112:0/827607924 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "117a625d-a91d-4ff9-be04-2441cc71c6ce", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35d8011b10 con 0x7f35e80d08a0 2023-10-16T13:38:03.373 INFO:teuthology.orchestra.run.smithi112.stdout:3 2023-10-16T13:38:03.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 msgr2=0x7f35e8155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 0x7f35e8155df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f35d8013040 tx=0x7f35d8004750 comp rx=0 tx=0).stop 2023-10-16T13:38:03.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 shutdown_connections 2023-10-16T13:38:03.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35e8161210 0x7f35e80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80d08a0 0x7f35e8155df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 --2- 172.21.15.112:0/827607924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e8160e30 0x7f35e80cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 >> 172.21.15.112:0/827607924 conn(0x7f35e809cb40 msgr2=0x7f35e806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 shutdown_connections 2023-10-16T13:38:03.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.371+0000 7f35ee4e8700 1 -- 172.21.15.112:0/827607924 wait complete. 2023-10-16T13:38:03.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 4e2a8368-8e71-4077-b01a-ef05d0e93192 4 2023-10-16T13:38:03.481 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:03.478+0000 7fdd93edb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:38:03.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.503+0000 7fe62de4b700 1 Processor -- start 2023-10-16T13:38:03.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.503+0000 7fe62de4b700 1 -- start start 2023-10-16T13:38:03.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe62de4b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 0x7fe6280cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe62de4b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6280cf6d0 0x7fe6280d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe62de4b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280ccc20 con 0x7fe6280d1bc0 2023-10-16T13:38:03.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe62de4b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280cfb50 con 0x7fe6280cf6d0 2023-10-16T13:38:03.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe62de4b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62815ee90 con 0x7fe62815eab0 2023-10-16T13:38:03.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6277fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 0x7fe6280cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6280cf6d0 0x7fe6280d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6277fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 0x7fe6280cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43844/0 (socket says 172.21.15.112:43844) 2023-10-16T13:38:03.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6280cf6d0 0x7fe6280d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32782/0 (socket says 172.21.15.112:32782) 2023-10-16T13:38:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6277fe700 1 -- 172.21.15.112:0/3614721675 learned_addr learned my addr 172.21.15.112:0/3614721675 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 -- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 msgr2=0x7fe6280cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 --2- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 0x7fe6280cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 -- 172.21.15.112:0/3614721675 >> v1:172.21.15.5:6789/0 conn(0x7fe6280d1bc0 legacy=0x7fe628161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 -- 172.21.15.112:0/3614721675 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628158370 con 0x7fe6280cf6d0 2023-10-16T13:38:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6277fe700 1 --2- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 0x7fe6280cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe626ffd700 1 --2- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280d1680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009840 tx=0x7fe61c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81cc83b72cb1dbe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6267fc700 1 -- 172.21.15.112:0/3614721675 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c011830 con 0x7fe6280cf6d0 2023-10-16T13:38:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6267fc700 1 -- 172.21.15.112:0/3614721675 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c011990 con 0x7fe6280cf6d0 2023-10-16T13:38:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.504+0000 7fe6267fc700 1 -- 172.21.15.112:0/3614721675 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c011d20 con 0x7fe6280cf6d0 2023-10-16T13:38:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 -- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 msgr2=0x7fe6280d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 --2- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280d1680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009840 tx=0x7fe61c009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 -- 172.21.15.112:0/3614721675 shutdown_connections 2023-10-16T13:38:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 --2- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe62815eab0 0x7fe6280cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 --2- 172.21.15.112:0/3614721675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280d1680 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 -- 172.21.15.112:0/3614721675 >> 172.21.15.112:0/3614721675 conn(0x7fe6280665a0 msgr2=0x7fe628066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 -- 172.21.15.112:0/3614721675 shutdown_connections 2023-10-16T13:38:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.505+0000 7fe62de4b700 1 -- 172.21.15.112:0/3614721675 wait complete. 2023-10-16T13:38:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.506+0000 7fe62de4b700 1 Processor -- start 2023-10-16T13:38:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 -- start start 2023-10-16T13:38:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 0x7fe6281610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62815eab0 0x7fe6281615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c6cf0 con 0x7fe62815eab0 2023-10-16T13:38:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c8d80 con 0x7fe6280cf6d0 2023-10-16T13:38:03.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe62de4b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c87c0 con 0x7fe6280d1bc0 2023-10-16T13:38:03.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe6277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.507+0000 7fe626ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 0x7fe6281610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe626ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 0x7fe6281610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43850/0 (socket says 172.21.15.112:43850) 2023-10-16T13:38:03.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32786/0 (socket says 172.21.15.112:32786) 2023-10-16T13:38:03.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe626ffd700 1 -- 172.21.15.112:0/2899346142 learned_addr learned my addr 172.21.15.112:0/2899346142 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe627fff700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62815eab0 0x7fe6281615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 -- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 msgr2=0x7fe6281610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 0x7fe6281610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 -- 172.21.15.112:0/2899346142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62815eab0 msgr2=0x7fe6281615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62815eab0 0x7fe6281615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 -- 172.21.15.112:0/2899346142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618009550 con 0x7fe6280cf6d0 2023-10-16T13:38:03.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe626ffd700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 0x7fe6281610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:03.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe6277fe700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280c74b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe61800e9a0 tx=0x7fe61800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618004030 con 0x7fe6280cf6d0 2023-10-16T13:38:03.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe618004190 con 0x7fe6280cf6d0 2023-10-16T13:38:03.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c0094a0 con 0x7fe6280cf6d0 2023-10-16T13:38:03.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618004520 con 0x7fe6280cf6d0 2023-10-16T13:38:03.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6280c6f90 con 0x7fe6280cf6d0 2023-10-16T13:38:03.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe618005d20 con 0x7fe6280cf6d0 2023-10-16T13:38:03.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.508+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe61800cd60 con 0x7fe6280cf6d0 2023-10-16T13:38:03.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.509+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6280d20c0 con 0x7fe6280cf6d0 2023-10-16T13:38:03.527 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:03.523+0000 7ff60c19d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T13:38:03.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.511+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe618020060 con 0x7fe6280cf6d0 2023-10-16T13:38:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.594+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4e2a8368-8e71-4077-b01a-ef05d0e93192", "id": 4} v 0) v1 -- 0x7fe628067d20 con 0x7fe6280cf6d0 2023-10-16T13:38:03.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.597+0000 7fe60ffff700 1 -- 172.21.15.112:0/2899346142 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4e2a8368-8e71-4077-b01a-ef05d0e93192", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe618028020 con 0x7fe6280cf6d0 2023-10-16T13:38:03.599 INFO:teuthology.orchestra.run.smithi112.stdout:4 2023-10-16T13:38:03.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 msgr2=0x7fe6280c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280c74b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe61800e9a0 tx=0x7fe61800ecb0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 shutdown_connections 2023-10-16T13:38:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62815eab0 0x7fe6281615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6280cf6d0 0x7fe6280c74b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 --2- 172.21.15.112:0/2899346142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6280d1bc0 0x7fe6281610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 >> 172.21.15.112:0/2899346142 conn(0x7fe6280665a0 msgr2=0x7fe62815dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 shutdown_connections 2023-10-16T13:38:03.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.598+0000 7fe62de4b700 1 -- 172.21.15.112:0/2899346142 wait complete. 2023-10-16T13:38:03.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new b748812e-fdac-4919-b5c1-50ff24ab3fe9 5 2023-10-16T13:38:03.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.728+0000 7fe0e3e3f700 1 Processor -- start 2023-10-16T13:38:03.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.728+0000 7fe0e3e3f700 1 -- start start 2023-10-16T13:38:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e3e3f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0dc15e030 0x7fe0dc0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e3e3f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0dc0ce280 0x7fe0dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e3e3f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc06adb0 con 0x7fe0dc06a840 2023-10-16T13:38:03.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e3e3f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc06b090 con 0x7fe0dc0ce280 2023-10-16T13:38:03.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e3e3f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc06b370 con 0x7fe0dc15e030 2023-10-16T13:38:03.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0dc15e030 0x7fe0dc0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0dc15e030 0x7fe0dc0cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32792/0 (socket says 172.21.15.112:32792) 2023-10-16T13:38:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 -- 172.21.15.112:0/1341651817 learned_addr learned my addr 172.21.15.112:0/1341651817 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e23dc700 1 --2- 172.21.15.112:0/1341651817 >> v2:172.21.15.5:3300/0 conn(0x7fe0dc0ce280 0x7fe0dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 -- 172.21.15.112:0/1341651817 >> v2:172.21.15.5:3300/0 conn(0x7fe0dc0ce280 msgr2=0x7fe0dc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 --2- 172.21.15.112:0/1341651817 >> v2:172.21.15.5:3300/0 conn(0x7fe0dc0ce280 0x7fe0dc06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 -- 172.21.15.112:0/1341651817 >> v1:172.21.15.5:6789/0 conn(0x7fe0dc06a840 legacy=0x7fe0dc0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.729+0000 7fe0e1bdb700 1 -- 172.21.15.112:0/1341651817 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc06b650 con 0x7fe0dc15e030 2023-10-16T13:38:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e1bdb700 1 --2- 172.21.15.112:0/1341651817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc15e030 0x7fe0dc0cb3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0746a0 tx=0x7fe0d8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cacfccf8f5f80b80 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e0bd9700 1 -- 172.21.15.112:0/1341651817 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011830 con 0x7fe0dc15e030 2023-10-16T13:38:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e0bd9700 1 -- 172.21.15.112:0/1341651817 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8011990 con 0x7fe0dc15e030 2023-10-16T13:38:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e0bd9700 1 -- 172.21.15.112:0/1341651817 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011d20 con 0x7fe0dc15e030 2023-10-16T13:38:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1341651817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc15e030 msgr2=0x7fe0dc0cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1341651817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc15e030 0x7fe0dc0cb3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0746a0 tx=0x7fe0d8009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1341651817 shutdown_connections 2023-10-16T13:38:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1341651817 >> v2:172.21.15.5:3300/0 conn(0x7fe0dc0ce280 0x7fe0dc06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1341651817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc15e030 0x7fe0dc0cb3a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1341651817 >> 172.21.15.112:0/1341651817 conn(0x7fe0dc0cc6f0 msgr2=0x7fe0dc0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.730+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1341651817 shutdown_connections 2023-10-16T13:38:03.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.731+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1341651817 wait complete. 2023-10-16T13:38:03.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 Processor -- start 2023-10-16T13:38:03.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 -- start start 2023-10-16T13:38:03.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 0x7fe0dc1f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 0x7fe0dc0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0dc15e030 0x7fe0dc1e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1e96d0 con 0x7fe0dc15e030 2023-10-16T13:38:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1e87e0 con 0x7fe0dc06a840 2023-10-16T13:38:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.732+0000 7fe0e3e3f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1e8ac0 con 0x7fe0dc0ce280 2023-10-16T13:38:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e1bdb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 0x7fe0dc1f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 0x7fe0dc0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 0x7fe0dc0ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43862/0 (socket says 172.21.15.112:43862) 2023-10-16T13:38:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e1bdb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 0x7fe0dc1f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32798/0 (socket says 172.21.15.112:32798) 2023-10-16T13:38:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 -- 172.21.15.112:0/1936565398 learned_addr learned my addr 172.21.15.112:0/1936565398 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e23dc700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0dc15e030 0x7fe0dc1e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 -- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 msgr2=0x7fe0dc1f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 0x7fe0dc1f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 -- 172.21.15.112:0/1936565398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0dc15e030 msgr2=0x7fe0dc1e9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0dc15e030 0x7fe0dc1e9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 -- 172.21.15.112:0/1936565398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009550 con 0x7fe0dc0ce280 2023-10-16T13:38:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e1bdb700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 0x7fe0dc1f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e13da700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 0x7fe0dc0ae770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c450 tx=0x7fe0cc00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0052d0 con 0x7fe0dc0ce280 2023-10-16T13:38:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc005430 con 0x7fe0dc0ce280 2023-10-16T13:38:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc1e8da0 con 0x7fe0dc0ce280 2023-10-16T13:38:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0038c0 con 0x7fe0dc0ce280 2023-10-16T13:38:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc1e9360 con 0x7fe0dc0ce280 2023-10-16T13:38:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe0cc003d20 con 0x7fe0dc0ce280 2023-10-16T13:38:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.733+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe0cc011cc0 con 0x7fe0dc0ce280 2023-10-16T13:38:03.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.734+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc1e94f0 con 0x7fe0dc0ce280 2023-10-16T13:38:03.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.736+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe0cc017070 con 0x7fe0dc0ce280 2023-10-16T13:38:03.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.819+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b748812e-fdac-4919-b5c1-50ff24ab3fe9", "id": 5} v 0) v1 -- 0x7fe0dc1e9840 con 0x7fe0dc0ce280 2023-10-16T13:38:03.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.823+0000 7fe0d27fc700 1 -- 172.21.15.112:0/1936565398 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b748812e-fdac-4919-b5c1-50ff24ab3fe9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe0cc011590 con 0x7fe0dc0ce280 2023-10-16T13:38:03.825 INFO:teuthology.orchestra.run.smithi112.stdout:5 2023-10-16T13:38:03.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.823+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 msgr2=0x7fe0dc0ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.823+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 0x7fe0dc0ae770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c450 tx=0x7fe0cc00c760 comp rx=0 tx=0).stop 2023-10-16T13:38:03.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 shutdown_connections 2023-10-16T13:38:03.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0dc15e030 0x7fe0dc1e9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0dc06a840 0x7fe0dc1f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 --2- 172.21.15.112:0/1936565398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0dc0ce280 0x7fe0dc0ae770 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 >> 172.21.15.112:0/1936565398 conn(0x7fe0dc0cc6f0 msgr2=0x7fe0dc0af840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 shutdown_connections 2023-10-16T13:38:03.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.824+0000 7fe0e3e3f700 1 -- 172.21.15.112:0/1936565398 wait complete. 2023-10-16T13:38:03.838 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d8174fc3-16fc-4611-9604-3faa9fd3c78c 6 2023-10-16T13:38:03.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.979+0000 7f13de6b0700 1 Processor -- start 2023-10-16T13:38:03.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.979+0000 7f13de6b0700 1 -- start start 2023-10-16T13:38:03.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13de6b0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13d806e750 0x7f13d80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13de6b0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13d80b54f0 0x7f13d80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13de6b0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80b5c70 con 0x7f13d806eb30 2023-10-16T13:38:03.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13de6b0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80b5990 con 0x7f13d80b54f0 2023-10-16T13:38:03.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13de6b0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d815b2b0 con 0x7f13d806e750 2023-10-16T13:38:03.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13d806e750 0x7f13d80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13d806e750 0x7f13d80ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32804/0 (socket says 172.21.15.112:32804) 2023-10-16T13:38:03.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d77fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f13d806eb30 0x7f13d815e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49374/0 (socket says 172.21.15.112:49374) 2023-10-16T13:38:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 -- 172.21.15.112:0/1189141861 learned_addr learned my addr 172.21.15.112:0/1189141861 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13dcc4d700 1 --2- 172.21.15.112:0/1189141861 >> v2:172.21.15.5:3300/0 conn(0x7f13d80b54f0 0x7f13d80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 -- 172.21.15.112:0/1189141861 >> v2:172.21.15.5:3300/0 conn(0x7f13d80b54f0 msgr2=0x7f13d80cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 --2- 172.21.15.112:0/1189141861 >> v2:172.21.15.5:3300/0 conn(0x7f13d80b54f0 0x7f13d80cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 -- 172.21.15.112:0/1189141861 >> v1:172.21.15.112:6789/0 conn(0x7f13d806eb30 legacy=0x7f13d815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 -- 172.21.15.112:0/1189141861 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d815b590 con 0x7f13d806e750 2023-10-16T13:38:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d6ffd700 1 -- 172.21.15.112:0/1189141861 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449226970 0 0) 0x7f13d80b5c70 con 0x7f13d806eb30 2023-10-16T13:38:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.980+0000 7f13d7fff700 1 --2- 172.21.15.112:0/1189141861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d806e750 0x7f13d80ceec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13c800bb90 tx=0x7f13c800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e176308026ff3e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13d6ffd700 1 -- 172.21.15.112:0/1189141861 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800dd10 con 0x7f13d806e750 2023-10-16T13:38:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13d6ffd700 1 -- 172.21.15.112:0/1189141861 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800de70 con 0x7f13d806e750 2023-10-16T13:38:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13d6ffd700 1 -- 172.21.15.112:0/1189141861 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8010670 con 0x7f13d806e750 2023-10-16T13:38:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 -- 172.21.15.112:0/1189141861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d806e750 msgr2=0x7f13d80ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1189141861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d806e750 0x7f13d80ceec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13c800bb90 tx=0x7f13c800bea0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 -- 172.21.15.112:0/1189141861 shutdown_connections 2023-10-16T13:38:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1189141861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d806e750 0x7f13d80ceec0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1189141861 >> v2:172.21.15.5:3300/0 conn(0x7f13d80b54f0 0x7f13d80cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 -- 172.21.15.112:0/1189141861 >> 172.21.15.112:0/1189141861 conn(0x7f13d80cc6f0 msgr2=0x7f13d80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:03.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 -- 172.21.15.112:0/1189141861 shutdown_connections 2023-10-16T13:38:03.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.981+0000 7f13de6b0700 1 -- 172.21.15.112:0/1189141861 wait complete. 2023-10-16T13:38:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.982+0000 7f13de6b0700 1 Processor -- start 2023-10-16T13:38:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 -- start start 2023-10-16T13:38:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 0x7f13d8143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d806eb30 0x7f13d8144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 0x7f13d80c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:03.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80c9070 con 0x7f13d806eb30 2023-10-16T13:38:03.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d81441d0 con 0x7f13d80b54f0 2023-10-16T13:38:03.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13de6b0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80c8780 con 0x7f13d806e750 2023-10-16T13:38:03.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13dcc4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 0x7f13d80c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13d7fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 0x7f13d8143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13dcc4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 0x7f13d80c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32814/0 (socket says 172.21.15.112:32814) 2023-10-16T13:38:03.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13d7fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 0x7f13d8143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43872/0 (socket says 172.21.15.112:43872) 2023-10-16T13:38:03.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.983+0000 7f13dcc4d700 1 -- 172.21.15.112:0/1609947985 learned_addr learned my addr 172.21.15.112:0/1609947985 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:03.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13d77fe700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d806eb30 0x7f13d8144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:03.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13dcc4d700 1 -- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 msgr2=0x7f13d8143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13dcc4d700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 0x7f13d8143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13dcc4d700 1 -- 172.21.15.112:0/1609947985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d806eb30 msgr2=0x7f13d8144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:03.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13dcc4d700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d806eb30 0x7f13d8144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:03.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13dcc4d700 1 -- 172.21.15.112:0/1609947985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c800b7f0 con 0x7f13d80b54f0 2023-10-16T13:38:03.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13d7fff700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 0x7f13d8143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:03.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13dcc4d700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 0x7f13d80c9490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13d0007e30 tx=0x7f13d000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:03.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000ed30 con 0x7f13d80b54f0 2023-10-16T13:38:03.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d000ee90 con 0x7f13d80b54f0 2023-10-16T13:38:03.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d8159cd0 con 0x7f13d80b54f0 2023-10-16T13:38:04.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0014660 con 0x7f13d80b54f0 2023-10-16T13:38:04.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.984+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d80c89b0 con 0x7f13d80b54f0 2023-10-16T13:38:04.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.985+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f13d0014ac0 con 0x7f13d80b54f0 2023-10-16T13:38:04.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.985+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f13d001ebe0 con 0x7f13d80b54f0 2023-10-16T13:38:04.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.985+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d8067ae0 con 0x7f13d80b54f0 2023-10-16T13:38:04.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:03.987+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f13d001e510 con 0x7f13d80b54f0 2023-10-16T13:38:04.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.070+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8174fc3-16fc-4611-9604-3faa9fd3c78c", "id": 6} v 0) v1 -- 0x7f13d8067d20 con 0x7f13d80b54f0 2023-10-16T13:38:04.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.075+0000 7f13d4ff9700 1 -- 172.21.15.112:0/1609947985 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8174fc3-16fc-4611-9604-3faa9fd3c78c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f13d001e6b0 con 0x7f13d80b54f0 2023-10-16T13:38:04.078 INFO:teuthology.orchestra.run.smithi112.stdout:6 2023-10-16T13:38:04.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.076+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 msgr2=0x7f13d80c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.076+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 0x7f13d80c9490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13d0007e30 tx=0x7f13d000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.076+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 shutdown_connections 2023-10-16T13:38:04.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.076+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d80b54f0 0x7f13d80c9490 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.076+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d806e750 0x7f13d8143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.076+0000 7f13de6b0700 1 --2- 172.21.15.112:0/1609947985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d806eb30 0x7f13d8144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.077+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 >> 172.21.15.112:0/1609947985 conn(0x7f13d80cc6f0 msgr2=0x7f13d80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:04.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.077+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 shutdown_connections 2023-10-16T13:38:04.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.077+0000 7f13de6b0700 1 -- 172.21.15.112:0/1609947985 wait complete. 2023-10-16T13:38:04.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 18a2d786-9fcc-4477-913b-2d2e2eb4d1e1 7 2023-10-16T13:38:04.149 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:04.146+0000 7fdd93edb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:38:04.194 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:04.192+0000 7ff60c19d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T13:38:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.211+0000 7f60062b4700 1 Processor -- start 2023-10-16T13:38:04.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.211+0000 7f60062b4700 1 -- start start 2023-10-16T13:38:04.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f60062b4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f60000cd950 0x7f600015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f60062b4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60000cede0 0x7f600015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f60062b4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60000cf290 con 0x7f600006a840 2023-10-16T13:38:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f60062b4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60001619a0 con 0x7f60000cede0 2023-10-16T13:38:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f60062b4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000b2d60 con 0x7f60000cd950 2023-10-16T13:38:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f60000cd950 0x7f600015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f60000cd950 0x7f600015e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32816/0 (socket says 172.21.15.112:32816) 2023-10-16T13:38:04.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 -- 172.21.15.112:0/4230220834 learned_addr learned my addr 172.21.15.112:0/4230220834 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:04.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5fff7fe700 1 --2- 172.21.15.112:0/4230220834 >> v2:172.21.15.5:3300/0 conn(0x7f60000cede0 0x7f600015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 -- 172.21.15.112:0/4230220834 >> v2:172.21.15.5:3300/0 conn(0x7f60000cede0 msgr2=0x7f600015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 --2- 172.21.15.112:0/4230220834 >> v2:172.21.15.5:3300/0 conn(0x7f60000cede0 0x7f600015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 -- 172.21.15.112:0/4230220834 >> v1:172.21.15.5:6789/0 conn(0x7f600006a840 legacy=0x7f6000161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 -- 172.21.15.112:0/4230220834 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000cdd30 con 0x7f60000cd950 2023-10-16T13:38:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5fff7fe700 1 --2- 172.21.15.112:0/4230220834 >> v2:172.21.15.5:3300/0 conn(0x7f60000cede0 0x7f600015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffffff700 1 --2- 172.21.15.112:0/4230220834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cd950 0x7f600015e2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6000161ae0 tx=0x7f5ff0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a4b3223f47cce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffeffd700 1 -- 172.21.15.112:0/4230220834 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0004230 con 0x7f60000cd950 2023-10-16T13:38:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffeffd700 1 -- 172.21.15.112:0/4230220834 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0004390 con 0x7f60000cd950 2023-10-16T13:38:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.212+0000 7f5ffeffd700 1 -- 172.21.15.112:0/4230220834 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00036a0 con 0x7f60000cd950 2023-10-16T13:38:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 -- 172.21.15.112:0/4230220834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cd950 msgr2=0x7f600015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 --2- 172.21.15.112:0/4230220834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cd950 0x7f600015e2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6000161ae0 tx=0x7f5ff0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 -- 172.21.15.112:0/4230220834 shutdown_connections 2023-10-16T13:38:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 --2- 172.21.15.112:0/4230220834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cd950 0x7f600015e2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 --2- 172.21.15.112:0/4230220834 >> v2:172.21.15.5:3300/0 conn(0x7f60000cede0 0x7f600015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 -- 172.21.15.112:0/4230220834 >> 172.21.15.112:0/4230220834 conn(0x7f600006dae0 msgr2=0x7f600006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 -- 172.21.15.112:0/4230220834 shutdown_connections 2023-10-16T13:38:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.213+0000 7f60062b4700 1 -- 172.21.15.112:0/4230220834 wait complete. 2023-10-16T13:38:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.214+0000 7f60062b4700 1 Processor -- start 2023-10-16T13:38:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.214+0000 7f60062b4700 1 -- start start 2023-10-16T13:38:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f60062b4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 0x7f60001f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f60062b4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60000cd950 0x7f60000b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f60062b4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cede0 0x7f60000b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f60062b4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b5a80 con 0x7f60000cd950 2023-10-16T13:38:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f60062b4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000c7bf0 con 0x7f60000cede0 2023-10-16T13:38:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f60062b4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000c7ed0 con 0x7f600006a840 2023-10-16T13:38:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 0x7f60001f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 0x7f60001f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:43884/0 (socket says 172.21.15.112:43884) 2023-10-16T13:38:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f6004851700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cede0 0x7f60000b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f5ffffff700 1 -- 172.21.15.112:0/4217434983 learned_addr learned my addr 172.21.15.112:0/4217434983 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-16T13:38:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.215+0000 7f5fff7fe700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60000cd950 0x7f60000b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffffff700 1 -- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cede0 msgr2=0x7f60000b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffffff700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cede0 0x7f60000b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffffff700 1 -- 172.21.15.112:0/4217434983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60000cd950 msgr2=0x7f60000b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffffff700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60000cd950 0x7f60000b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffffff700 1 -- 172.21.15.112:0/4217434983 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0009550 con 0x7f600006a840 2023-10-16T13:38:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f6004851700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cede0 0x7f60000b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffffff700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 0x7f60001f2fd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0000c00 tx=0x7f5ff0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0003d20 con 0x7f600006a840 2023-10-16T13:38:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0003e80 con 0x7f600006a840 2023-10-16T13:38:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60000c81b0 con 0x7f600006a840 2023-10-16T13:38:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000b8b0 con 0x7f600006a840 2023-10-16T13:38:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60000c8770 con 0x7f600006a840 2023-10-16T13:38:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5ff0021070 con 0x7f600006a840 2023-10-16T13:38:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.216+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5ff0024b50 con 0x7f600006a840 2023-10-16T13:38:04.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.217+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60000c8990 con 0x7f600006a840 2023-10-16T13:38:04.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.219+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5ff0024db0 con 0x7f600006a840 2023-10-16T13:38:04.230 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:04.220+0000 7fdd93edb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:38:04.266 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:04.264+0000 7ff60c19d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T13:38:04.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.302+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "18a2d786-9fcc-4477-913b-2d2e2eb4d1e1", "id": 7} v 0) v1 -- 0x7f6000067d20 con 0x7f600006a840 2023-10-16T13:38:04.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.309+0000 7f5ffcff9700 1 -- 172.21.15.112:0/4217434983 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18a2d786-9fcc-4477-913b-2d2e2eb4d1e1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ff0024470 con 0x7f600006a840 2023-10-16T13:38:04.312 INFO:teuthology.orchestra.run.smithi112.stdout:7 2023-10-16T13:38:04.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 msgr2=0x7f60001f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 0x7f60001f2fd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0000c00 tx=0x7f5ff0004750 comp rx=0 tx=0).stop 2023-10-16T13:38:04.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 shutdown_connections 2023-10-16T13:38:04.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60000cede0 0x7f60000b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f600006a840 0x7f60001f2fd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 --2- 172.21.15.112:0/4217434983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60000cd950 0x7f60000b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.310+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 >> 172.21.15.112:0/4217434983 conn(0x7f600006dae0 msgr2=0x7f600006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:04.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.311+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 shutdown_connections 2023-10-16T13:38:04.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-16T13:38:04.311+0000 7f60062b4700 1 -- 172.21.15.112:0/4217434983 wait complete. 2023-10-16T13:38:04.325 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T13:38:04.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T13:38:04.327 INFO:tasks.ceph.osd.0:Started 2023-10-16T13:38:04.328 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T13:38:04.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T13:38:04.330 INFO:tasks.ceph.osd.1:Started 2023-10-16T13:38:04.331 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T13:38:04.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T13:38:04.333 INFO:tasks.ceph.osd.2:Started 2023-10-16T13:38:04.333 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T13:38:04.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T13:38:04.336 INFO:tasks.ceph.osd.3:Started 2023-10-16T13:38:04.336 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T13:38:04.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T13:38:04.339 INFO:tasks.ceph.osd.4:Started 2023-10-16T13:38:04.339 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T13:38:04.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T13:38:04.341 INFO:tasks.ceph.osd.5:Started 2023-10-16T13:38:04.342 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T13:38:04.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T13:38:04.344 INFO:tasks.ceph.osd.6:Started 2023-10-16T13:38:04.345 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T13:38:04.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T13:38:04.347 INFO:tasks.ceph.osd.7:Started 2023-10-16T13:38:04.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.506+0000 7f4340f5e700 1 Processor -- start 2023-10-16T13:38:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.507+0000 7f4340f5e700 1 -- start start 2023-10-16T13:38:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.507+0000 7f4340f5e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f433c15eab0 0x7f433c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.507+0000 7f4340f5e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c0d2170 con 0x7f433c0cf6d0 2023-10-16T13:38:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.507+0000 7f4340f5e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c15ee90 con 0x7f433c0d1d90 2023-10-16T13:38:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.507+0000 7f4340f5e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c0cfb60 con 0x7f433c15eab0 2023-10-16T13:38:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f433c15eab0 0x7f433c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f433c15eab0 0x7f433c0cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41310/0 (socket says 172.21.15.5:41310) 2023-10-16T13:38:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 -- 172.21.15.5:0/305575278 learned_addr learned my addr 172.21.15.5:0/305575278 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f4339d9b700 1 --1- 172.21.15.5:0/305575278 >> v1:172.21.15.5:6789/0 conn(0x7f433c0cf6d0 0x7f433c0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51314/0 (socket says 172.21.15.5:51314) 2023-10-16T13:38:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 -- 172.21.15.5:0/305575278 >> v1:172.21.15.112:6789/0 conn(0x7f433c0d1d90 legacy=0x7f433c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 -- 172.21.15.5:0/305575278 >> v1:172.21.15.5:6789/0 conn(0x7f433c0cf6d0 legacy=0x7f433c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433959a700 1 -- 172.21.15.5:0/305575278 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228552406 0 0) 0x7f432c001110 con 0x7f433c0cf6d0 2023-10-16T13:38:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 -- 172.21.15.5:0/305575278 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c158370 con 0x7f433c15eab0 2023-10-16T13:38:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433a59c700 1 --2- 172.21.15.5:0/305575278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c15eab0 0x7f433c0cf190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43300098f0 tx=0x7f4330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425bee97b9abc8f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433959a700 1 -- 172.21.15.5:0/305575278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000b8a0 con 0x7f433c15eab0 2023-10-16T13:38:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433959a700 1 -- 172.21.15.5:0/305575278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433000ba00 con 0x7f433c15eab0 2023-10-16T13:38:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.508+0000 7f433959a700 1 -- 172.21.15.5:0/305575278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000bd90 con 0x7f433c15eab0 2023-10-16T13:38:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 -- 172.21.15.5:0/305575278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c15eab0 msgr2=0x7f433c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 --2- 172.21.15.5:0/305575278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c15eab0 0x7f433c0cf190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43300098f0 tx=0x7f4330009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 -- 172.21.15.5:0/305575278 shutdown_connections 2023-10-16T13:38:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 --2- 172.21.15.5:0/305575278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c15eab0 0x7f433c0cf190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 -- 172.21.15.5:0/305575278 >> 172.21.15.5:0/305575278 conn(0x7f433c0665a0 msgr2=0x7f433c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 -- 172.21.15.5:0/305575278 shutdown_connections 2023-10-16T13:38:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.509+0000 7f4340f5e700 1 -- 172.21.15.5:0/305575278 wait complete. 2023-10-16T13:38:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.510+0000 7f4340f5e700 1 Processor -- start 2023-10-16T13:38:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.510+0000 7f4340f5e700 1 -- start start 2023-10-16T13:38:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4340f5e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f433c0cf6d0 0x7f433c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4340f5e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 0x7f433c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4340f5e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f433c15eab0 0x7f433c0c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4340f5e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1e8a80 con 0x7f433c0d1d90 2023-10-16T13:38:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4340f5e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1e7e70 con 0x7f433c0cf6d0 2023-10-16T13:38:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4340f5e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1e8150 con 0x7f433c15eab0 2023-10-16T13:38:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4339d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 0x7f433c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4339d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 0x7f433c0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41316/0 (socket says 172.21.15.5:41316) 2023-10-16T13:38:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f4339d9b700 1 -- 172.21.15.5:0/2359632698 learned_addr learned my addr 172.21.15.5:0/2359632698 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f433a59c700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f433c0cf6d0 0x7f433c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.511+0000 7f433ad9d700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f433c15eab0 0x7f433c0c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4339d9b700 1 -- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f433c15eab0 msgr2=0x7f433c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4339d9b700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f433c15eab0 0x7f433c0c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4339d9b700 1 -- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f433c0cf6d0 msgr2=0x7f433c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4339d9b700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f433c0cf6d0 0x7f433c1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4339d9b700 1 -- 172.21.15.5:0/2359632698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009550 con 0x7f433c0d1d90 2023-10-16T13:38:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4339d9b700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 0x7f433c0cc270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f432c00c520 tx=0x7f432c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c004c80 con 0x7f433c0d1d90 2023-10-16T13:38:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c004de0 con 0x7f433c0d1d90 2023-10-16T13:38:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c1e8430 con 0x7f433c0d1d90 2023-10-16T13:38:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c007310 con 0x7f433c0d1d90 2023-10-16T13:38:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c157710 con 0x7f433c0d1d90 2023-10-16T13:38:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f432c01d3f0 con 0x7f433c0d1d90 2023-10-16T13:38:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.512+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f432c013a90 con 0x7f433c0d1d90 2023-10-16T13:38:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.513+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c0cda00 con 0x7f433c0d1d90 2023-10-16T13:38:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.516+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f433c0cda00 con 0x7f433c0d1d90 2023-10-16T13:38:04.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.585+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f433c1e8bf0 con 0x7f433c0d1d90 2023-10-16T13:38:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.586+0000 7f432affd700 1 -- 172.21.15.5:0/2359632698 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f433c0d2170 con 0x7f433c0d1d90 2023-10-16T13:38:04.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:04.589 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:04.303908+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 msgr2=0x7f433c0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 0x7f433c0cc270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f432c00c520 tx=0x7f432c00c830 comp rx=0 tx=0).stop 2023-10-16T13:38:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 shutdown_connections 2023-10-16T13:38:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f433c15eab0 0x7f433c0c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f433c0cf6d0 0x7f433c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 --2- 172.21.15.5:0/2359632698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f433c0d1d90 0x7f433c0cc270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 >> 172.21.15.5:0/2359632698 conn(0x7f433c0665a0 msgr2=0x7f433c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 shutdown_connections 2023-10-16T13:38:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:04.587+0000 7f4340f5e700 1 -- 172.21.15.5:0/2359632698 wait complete. 2023-10-16T13:38:04.602 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T13:38:04.602 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T13:38:04.937 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:04.934+0000 7fdd93edb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:38:04.950 INFO:tasks.ceph.osd.6.smithi112.stderr:2023-10-16T13:38:04.947+0000 7f66624bd640 -1 Falling back to public interface 2023-10-16T13:38:04.953 INFO:tasks.ceph.osd.5.smithi112.stderr:2023-10-16T13:38:04.950+0000 7f0e09884640 -1 Falling back to public interface 2023-10-16T13:38:04.955 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-10-16T13:38:04.952+0000 7f63b45af640 -1 Falling back to public interface 2023-10-16T13:38:04.960 INFO:tasks.ceph.osd.4.smithi112.stderr:2023-10-16T13:38:04.957+0000 7f0e8163e640 -1 Falling back to public interface 2023-10-16T13:38:04.965 INFO:tasks.ceph.osd.7.smithi112.stderr:2023-10-16T13:38:04.962+0000 7fde2f0fc640 -1 Falling back to public interface 2023-10-16T13:38:04.969 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-10-16T13:38:04.966+0000 7f69ec9b8640 -1 Falling back to public interface 2023-10-16T13:38:04.976 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-10-16T13:38:04.973+0000 7f1d3648c640 -1 Falling back to public interface 2023-10-16T13:38:04.979 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-10-16T13:38:04.977+0000 7fcb43fc1640 -1 Falling back to public interface 2023-10-16T13:38:05.016 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:05.014+0000 7fdd93edb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:38:05.034 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:05.031+0000 7ff60c19d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:38:05.114 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:05.112+0000 7ff60c19d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T13:38:05.156 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:05.153+0000 7fdd93edb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:38:05.263 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:05.261+0000 7ff60c19d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T13:38:05.393 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:05.390+0000 7fdd93edb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:38:05.408 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:05.513 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:05.510+0000 7ff60c19d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T13:38:05.523 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.521+0000 7f77a4e05700 1 Processor -- start 2023-10-16T13:38:05.524 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.521+0000 7f77a4e05700 1 -- start start 2023-10-16T13:38:05.524 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f77a4e05700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a00d1e60 0x7f77a0162060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:05.525 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f77a4e05700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77a015dce0 0x7f77a00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:05.525 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f77a4e05700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a01625a0 con 0x7f77a00d1480 2023-10-16T13:38:05.525 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f77a4e05700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a00cf7a0 con 0x7f77a015dce0 2023-10-16T13:38:05.525 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f77a4e05700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00cf310 con 0x7f77a00d1e60 2023-10-16T13:38:05.526 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f779ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77a015dce0 0x7f77a00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:05.526 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f779e59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a00d1e60 0x7f77a0162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:05.526 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f779dd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f77a00d1480 0x7f77a015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:42302/0 (socket says 172.21.15.5:42302) 2023-10-16T13:38:05.526 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.522+0000 7f779dd9b700 1 -- 172.21.15.5:0/2314328421 learned_addr learned my addr 172.21.15.5:0/2314328421 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:05.528 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779e59c700 1 -- 172.21.15.5:0/2314328421 >> v2:172.21.15.112:3300/0 conn(0x7f77a015dce0 msgr2=0x7f77a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:05.528 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779e59c700 1 --2- 172.21.15.5:0/2314328421 >> v2:172.21.15.112:3300/0 conn(0x7f77a015dce0 0x7f77a00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.528 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779e59c700 1 -- 172.21.15.5:0/2314328421 >> v1:172.21.15.112:6789/0 conn(0x7f77a00d1480 legacy=0x7f77a015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:05.528 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779e59c700 1 -- 172.21.15.5:0/2314328421 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00ce700 con 0x7f77a00d1e60 2023-10-16T13:38:05.529 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779ed9d700 1 --2- 172.21.15.5:0/2314328421 >> v2:172.21.15.112:3300/0 conn(0x7f77a015dce0 0x7f77a00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:05.529 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779d59a700 1 -- 172.21.15.5:0/2314328421 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052332770 0 0) 0x7f7794001110 con 0x7f77a00d1480 2023-10-16T13:38:05.529 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779e59c700 1 --2- 172.21.15.5:0/2314328421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a00d1e60 0x7f77a0162060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7790009820 tx=0x7f7790009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b64be67588e186a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:05.529 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779d59a700 1 -- 172.21.15.5:0/2314328421 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790005e30 con 0x7f77a00d1e60 2023-10-16T13:38:05.529 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779d59a700 1 -- 172.21.15.5:0/2314328421 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790006030 con 0x7f77a00d1e60 2023-10-16T13:38:05.529 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.523+0000 7f779d59a700 1 -- 172.21.15.5:0/2314328421 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900063c0 con 0x7f77a00d1e60 2023-10-16T13:38:05.530 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 -- 172.21.15.5:0/2314328421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a00d1e60 msgr2=0x7f77a0162060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:05.530 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2314328421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a00d1e60 0x7f77a0162060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7790009820 tx=0x7f7790009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:05.530 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 -- 172.21.15.5:0/2314328421 shutdown_connections 2023-10-16T13:38:05.530 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2314328421 >> v2:172.21.15.112:3300/0 conn(0x7f77a015dce0 0x7f77a00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.530 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2314328421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a00d1e60 0x7f77a0162060 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.531 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 -- 172.21.15.5:0/2314328421 >> 172.21.15.5:0/2314328421 conn(0x7f77a00d36c0 msgr2=0x7f77a00d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:05.531 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 -- 172.21.15.5:0/2314328421 shutdown_connections 2023-10-16T13:38:05.531 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.524+0000 7f77a4e05700 1 -- 172.21.15.5:0/2314328421 wait complete. 2023-10-16T13:38:05.531 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.525+0000 7f77a4e05700 1 Processor -- start 2023-10-16T13:38:05.531 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.525+0000 7f77a4e05700 1 -- start start 2023-10-16T13:38:05.533 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f77a4e05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a00d1480 0x7f77a01f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:05.533 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f77a4e05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 0x7f77a00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:05.534 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f77a4e05700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a015dce0 0x7f77a00b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:05.534 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f77a4e05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00caaa0 con 0x7f77a00d1e60 2023-10-16T13:38:05.534 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f77a4e05700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00cad80 con 0x7f77a00d1480 2023-10-16T13:38:05.534 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f77a4e05700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00cb060 con 0x7f77a015dce0 2023-10-16T13:38:05.534 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 0x7f77a00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:05.534 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 0x7f77a00c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41328/0 (socket says 172.21.15.5:41328) 2023-10-16T13:38:05.535 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 -- 172.21.15.5:0/2413845279 learned_addr learned my addr 172.21.15.5:0/2413845279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:05.535 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a00d1480 0x7f77a01f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:05.535 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779ed9d700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a015dce0 0x7f77a00b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:05.535 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 -- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a015dce0 msgr2=0x7f77a00b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:05.535 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a015dce0 0x7f77a00b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.536 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 -- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a00d1480 msgr2=0x7f77a01f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:05.536 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a00d1480 0x7f77a01f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.536 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 -- 172.21.15.5:0/2413845279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798009a70 con 0x7f77a00d1e60 2023-10-16T13:38:05.536 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.526+0000 7f779dd9b700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 0x7f77a00c98e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f779400c550 tx=0x7f779400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:05.536 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794004c80 con 0x7f77a00d1e60 2023-10-16T13:38:05.536 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794004e00 con 0x7f77a00d1e60 2023-10-16T13:38:05.537 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7790009430 con 0x7f77a00d1e60 2023-10-16T13:38:05.537 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794007310 con 0x7f77a00d1e60 2023-10-16T13:38:05.537 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a00cb620 con 0x7f77a00d1e60 2023-10-16T13:38:05.537 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f779401d3f0 con 0x7f77a00d1e60 2023-10-16T13:38:05.537 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.527+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7794013a90 con 0x7f77a00d1e60 2023-10-16T13:38:05.537 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.528+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00cb810 con 0x7f77a00d1e60 2023-10-16T13:38:05.538 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.532+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f77a01625a0 con 0x7f77a00d1e60 2023-10-16T13:38:05.604 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:05.602+0000 7fdd93edb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:38:05.605 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.602+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77a0074d70 con 0x7f77a00d1e60 2023-10-16T13:38:05.606 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.603+0000 7f778effd700 1 -- 172.21.15.5:0/2413845279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7794013e00 con 0x7f77a00d1e60 2023-10-16T13:38:05.606 INFO:teuthology.misc.health.smithi005.stdout: 2023-10-16T13:38:05.606 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:04.303908+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:05.607 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 msgr2=0x7f77a00c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:05.608 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 0x7f77a00c98e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f779400c550 tx=0x7f779400c860 comp rx=0 tx=0).stop 2023-10-16T13:38:05.608 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 shutdown_connections 2023-10-16T13:38:05.608 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a015dce0 0x7f77a00b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.608 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a00d1480 0x7f77a01f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.608 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 --2- 172.21.15.5:0/2413845279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a00d1e60 0x7f77a00c98e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:05.609 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 >> 172.21.15.5:0/2413845279 conn(0x7f77a00d36c0 msgr2=0x7f77a015ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:05.609 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 shutdown_connections 2023-10-16T13:38:05.609 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:05.604+0000 7f77a4e05700 1 -- 172.21.15.5:0/2413845279 wait complete. 2023-10-16T13:38:05.619 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T13:38:05.736 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:05.734+0000 7fdd93edb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:38:05.737 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:05.734+0000 7ff60c19d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T13:38:05.877 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:05.874+0000 7ff60c19d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T13:38:05.956 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:05.954+0000 7fdd93edb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:38:06.105 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:06.102+0000 7ff60c19d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T13:38:06.113 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:06.111+0000 7fdd93edb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:38:06.227 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:06.225+0000 7fdd93edb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:38:06.266 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:06.264+0000 7ff60c19d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T13:38:06.387 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:06.384+0000 7ff60c19d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T13:38:06.549 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:06.547+0000 7fdd93edb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:38:06.651 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:06.648+0000 7fdd93edb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:38:06.721 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:06.719+0000 7ff60c19d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T13:38:06.825 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:06.823+0000 7ff60c19d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T13:38:06.836 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:06.834+0000 7fdd93edb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:38:07.020 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:07.017+0000 7ff60c19d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T13:38:07.436 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:07.433+0000 7fdd93edb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:38:07.659 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-10-16T13:38:07.657+0000 7ff60c19d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T13:38:08.462 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:08.460+0000 7fdd4be69700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T13:38:08.463 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:38:08.460+0000 7fdd4be69700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T13:38:08.470 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-10-16T13:38:08.467+0000 7f63b45af640 -1 osd.1 0 log_to_monitors true 2023-10-16T13:38:08.495 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-10-16T13:38:08.492+0000 7fcb43fc1640 -1 osd.3 0 log_to_monitors true 2023-10-16T13:38:08.505 INFO:tasks.ceph.osd.6.smithi112.stderr:2023-10-16T13:38:08.503+0000 7f66624bd640 -1 osd.6 0 log_to_monitors true 2023-10-16T13:38:08.506 INFO:tasks.ceph.osd.4.smithi112.stderr:2023-10-16T13:38:08.503+0000 7f0e8163e640 -1 osd.4 0 log_to_monitors true 2023-10-16T13:38:08.506 INFO:tasks.ceph.osd.5.smithi112.stderr:2023-10-16T13:38:08.504+0000 7f0e09884640 -1 osd.5 0 log_to_monitors true 2023-10-16T13:38:08.507 INFO:tasks.ceph.osd.7.smithi112.stderr:2023-10-16T13:38:08.505+0000 7fde2f0fc640 -1 osd.7 0 log_to_monitors true 2023-10-16T13:38:08.514 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-10-16T13:38:08.512+0000 7f69ec9b8640 -1 osd.0 0 log_to_monitors true 2023-10-16T13:38:08.517 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-10-16T13:38:08.515+0000 7f1d3648c640 -1 osd.2 0 log_to_monitors true 2023-10-16T13:38:11.853 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-10-16T13:38:11.850+0000 7f69e056f700 -1 osd.0 0 waiting for initial osdmap 2023-10-16T13:38:11.865 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-10-16T13:38:11.862+0000 7f69d894a700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:11.865 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-10-16T13:38:11.861+0000 7fcb37b78700 -1 osd.3 0 waiting for initial osdmap 2023-10-16T13:38:11.877 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-10-16T13:38:11.875+0000 7fcb2ff53700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:11.882 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-10-16T13:38:11.880+0000 7f63a8166700 -1 osd.1 0 waiting for initial osdmap 2023-10-16T13:38:11.901 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-10-16T13:38:11.899+0000 7f63a0541700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:11.910 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-10-16T13:38:11.908+0000 7f1d2a043700 -1 osd.2 0 waiting for initial osdmap 2023-10-16T13:38:11.922 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-10-16T13:38:11.920+0000 7f1d2241e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:12.424 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:12.548 INFO:tasks.ceph.osd.6.smithi112.stderr:2023-10-16T13:38:12.546+0000 7f6656074700 -1 osd.6 0 waiting for initial osdmap 2023-10-16T13:38:12.549 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.546+0000 7f9f39511700 1 Processor -- start 2023-10-16T13:38:12.549 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.546+0000 7f9f39511700 1 -- start start 2023-10-16T13:38:12.550 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f39511700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f3415dce0 0x7f9f34162060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.550 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f39511700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f341625a0 con 0x7f9f340d1480 2023-10-16T13:38:12.551 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f39511700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340cf310 con 0x7f9f340d1e60 2023-10-16T13:38:12.551 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f39511700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340cf7a0 con 0x7f9f3415dce0 2023-10-16T13:38:12.551 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f337fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f3415dce0 0x7f9f34162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.551 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f327fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f340d1480 0x7f9f340b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51390/0 (socket says 172.21.15.5:51390) 2023-10-16T13:38:12.551 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f327fc700 1 -- 172.21.15.5:0/4164589382 learned_addr learned my addr 172.21.15.5:0/4164589382 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:12.551 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.547+0000 7f9f337fe700 1 --2- 172.21.15.5:0/4164589382 >> v2:172.21.15.5:3300/0 conn(0x7f9f3415dce0 0x7f9f34162060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41388/0 (socket says 172.21.15.5:41388) 2023-10-16T13:38:12.552 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.548+0000 7f9f337fe700 1 -- 172.21.15.5:0/4164589382 >> v1:172.21.15.112:6789/0 conn(0x7f9f340d1e60 legacy=0x7f9f3415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.552 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.548+0000 7f9f337fe700 1 -- 172.21.15.5:0/4164589382 >> v1:172.21.15.5:6789/0 conn(0x7f9f340d1480 legacy=0x7f9f340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.552 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.548+0000 7f9f337fe700 1 -- 172.21.15.5:0/4164589382 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340ce700 con 0x7f9f3415dce0 2023-10-16T13:38:12.552 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.548+0000 7f9f337fe700 1 --2- 172.21.15.5:0/4164589382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3415dce0 0x7f9f34162060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009d90 tx=0x7f9f2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde161afb827236e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:12.553 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.549+0000 7f9f31ffb700 1 -- 172.21.15.5:0/4164589382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00e070 con 0x7f9f3415dce0 2023-10-16T13:38:12.553 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.549+0000 7f9f31ffb700 1 -- 172.21.15.5:0/4164589382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c00bbd0 con 0x7f9f3415dce0 2023-10-16T13:38:12.554 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.549+0000 7f9f31ffb700 1 -- 172.21.15.5:0/4164589382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c012430 con 0x7f9f3415dce0 2023-10-16T13:38:12.554 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 -- 172.21.15.5:0/4164589382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3415dce0 msgr2=0x7f9f34162060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.554 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 --2- 172.21.15.5:0/4164589382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3415dce0 0x7f9f34162060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009d90 tx=0x7f9f2c00b330 comp rx=0 tx=0).stop 2023-10-16T13:38:12.554 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 -- 172.21.15.5:0/4164589382 shutdown_connections 2023-10-16T13:38:12.554 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 --2- 172.21.15.5:0/4164589382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3415dce0 0x7f9f34162060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.555 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 -- 172.21.15.5:0/4164589382 >> 172.21.15.5:0/4164589382 conn(0x7f9f340d36c0 msgr2=0x7f9f340d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:12.555 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 -- 172.21.15.5:0/4164589382 shutdown_connections 2023-10-16T13:38:12.555 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.550+0000 7f9f39511700 1 -- 172.21.15.5:0/4164589382 wait complete. 2023-10-16T13:38:12.557 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.551+0000 7f9f39511700 1 Processor -- start 2023-10-16T13:38:12.558 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.551+0000 7f9f39511700 1 -- start start 2023-10-16T13:38:12.558 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f39511700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 0x7f9f341f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.558 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f39511700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f340d1e60 0x7f9f341f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.558 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f39511700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f3415dce0 0x7f9f34157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.558 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f39511700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f34158b90 con 0x7f9f340d1480 2023-10-16T13:38:12.559 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f39511700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340c8920 con 0x7f9f340d1e60 2023-10-16T13:38:12.559 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f39511700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f341588b0 con 0x7f9f3415dce0 2023-10-16T13:38:12.559 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f32ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 0x7f9f341f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.559 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f32ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 0x7f9f341f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41390/0 (socket says 172.21.15.5:41390) 2023-10-16T13:38:12.559 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f32ffd700 1 -- 172.21.15.5:0/3760848888 learned_addr learned my addr 172.21.15.5:0/3760848888 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:12.559 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f327fc700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f340d1e60 0x7f9f341f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.560 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.552+0000 7f9f337fe700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f3415dce0 0x7f9f34157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.560 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f32ffd700 1 -- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f3415dce0 msgr2=0x7f9f34157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.560 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f32ffd700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f3415dce0 0x7f9f34157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.560 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f32ffd700 1 -- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f340d1e60 msgr2=0x7f9f341f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.560 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f32ffd700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f340d1e60 0x7f9f341f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.561 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f32ffd700 1 -- 172.21.15.5:0/3760848888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009a70 con 0x7f9f340d1480 2023-10-16T13:38:12.561 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f32ffd700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 0x7f9f341f3250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c4d0 tx=0x7f9f2400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:12.561 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240052d0 con 0x7f9f340d1480 2023-10-16T13:38:12.561 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24005430 con 0x7f9f340d1480 2023-10-16T13:38:12.561 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f340c8b30 con 0x7f9f340d1480 2023-10-16T13:38:12.561 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240038f0 con 0x7f9f340d1480 2023-10-16T13:38:12.562 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.553+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f340c90f0 con 0x7f9f340d1480 2023-10-16T13:38:12.562 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.554+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f340624e0 con 0x7f9f340d1480 2023-10-16T13:38:12.562 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.555+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f9f24003a50 con 0x7f9f340d1480 2023-10-16T13:38:12.562 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.555+0000 7f9f1b7fe700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f2006ae70 0x7f9f2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.562 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.555+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f9f24087a80 con 0x7f9f340d1480 2023-10-16T13:38:12.563 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.555+0000 7f9f327fc700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f2006ae70 0x7f9f2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.563 INFO:tasks.ceph.osd.7.smithi112.stderr:2023-10-16T13:38:12.553+0000 7fde22cb3700 -1 osd.7 0 waiting for initial osdmap 2023-10-16T13:38:12.563 INFO:tasks.ceph.osd.6.smithi112.stderr:2023-10-16T13:38:12.558+0000 7f664e44f700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:12.564 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.556+0000 7f9f327fc700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f2006ae70 0x7f9f2006d330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f34157870 tx=0x7f9f28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:12.564 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.562+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f24089e60 con 0x7f9f340d1480 2023-10-16T13:38:12.569 INFO:tasks.ceph.osd.5.smithi112.stderr:2023-10-16T13:38:12.566+0000 7f0dfd43b700 -1 osd.5 0 waiting for initial osdmap 2023-10-16T13:38:12.570 INFO:tasks.ceph.osd.7.smithi112.stderr:2023-10-16T13:38:12.568+0000 7fde1b08e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:12.585 INFO:tasks.ceph.osd.5.smithi112.stderr:2023-10-16T13:38:12.583+0000 7f0df5816700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:12.592 INFO:tasks.ceph.osd.4.smithi112.stderr:2023-10-16T13:38:12.590+0000 7f0e751f5700 -1 osd.4 0 waiting for initial osdmap 2023-10-16T13:38:12.607 INFO:tasks.ceph.osd.4.smithi112.stderr:2023-10-16T13:38:12.605+0000 7f0e6d5d0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T13:38:12.772 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.769+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f340c6c60 con 0x7f9f340d1480 2023-10-16T13:38:12.772 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.770+0000 7f9f1b7fe700 1 -- 172.21.15.5:0/3760848888 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10836 (secure 0 0 0) 0x7f9f24017020 con 0x7f9f340d1480 2023-10-16T13:38:12.773 INFO:teuthology.misc.health.smithi005.stdout: 2023-10-16T13:38:12.773 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":13,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:12.622723+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:12.775 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f2006ae70 msgr2=0x7f9f2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.775 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f2006ae70 0x7f9f2006d330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f34157870 tx=0x7f9f28009040 comp rx=0 tx=0).stop 2023-10-16T13:38:12.775 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 msgr2=0x7f9f341f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.776 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 0x7f9f341f3250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c4d0 tx=0x7f9f2400c7e0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.776 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 shutdown_connections 2023-10-16T13:38:12.776 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f2006ae70 0x7f9f2006d330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.776 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f3415dce0 0x7f9f34157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.776 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340d1480 0x7f9f341f3250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.777 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 --2- 172.21.15.5:0/3760848888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f340d1e60 0x7f9f341f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.777 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 >> 172.21.15.5:0/3760848888 conn(0x7f9f340d36c0 msgr2=0x7f9f3406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:12.777 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 shutdown_connections 2023-10-16T13:38:12.777 INFO:teuthology.misc.health.smithi005.stderr:2023-10-16T13:38:12.772+0000 7f9f39511700 1 -- 172.21.15.5:0/3760848888 wait complete. 2023-10-16T13:38:12.786 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T13:38:12.786 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T13:38:12.787 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:38:12.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:38:12.789 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:38:12.790 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:38:12.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:38:12.794 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:38:12.795 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:38:12.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:38:12.798 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:38:12.799 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:38:12.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:38:12.801 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:38:12.801 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T13:38:12.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:12.874 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:38:12.874 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:38:12.879 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:38:12.880 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:38:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.931+0000 7f052661f700 1 Processor -- start 2023-10-16T13:38:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.931+0000 7f052661f700 1 -- start start 2023-10-16T13:38:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f052661f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f052015e2f0 0x7f05200cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f052661f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200b2d60 con 0x7f052006a840 2023-10-16T13:38:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f052661f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200cdd30 con 0x7f05200cd950 2023-10-16T13:38:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f052661f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05201619a0 con 0x7f052015e2f0 2023-10-16T13:38:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f0524bbc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f052006a840 0x7f052006ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51542/0 (socket says 172.21.15.5:51542) 2023-10-16T13:38:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f0524bbc700 1 -- 172.21.15.5:0/3382118324 learned_addr learned my addr 172.21.15.5:0/3382118324 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f051f7fe700 1 --2- 172.21.15.5:0/3382118324 >> v2:172.21.15.112:3300/0 conn(0x7f052015e2f0 0x7f05200cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f051effd700 1 -- 172.21.15.5:0/3382118324 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029353052 0 0) 0x7f05200b2d60 con 0x7f052006a840 2023-10-16T13:38:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f051effd700 1 -- 172.21.15.5:0/3382118324 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0035b0 con 0x7f052006a840 2023-10-16T13:38:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f051f7fe700 1 -- 172.21.15.5:0/3382118324 >> v1:172.21.15.112:6789/0 conn(0x7f05200cd950 legacy=0x7f052015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f051f7fe700 1 -- 172.21.15.5:0/3382118324 >> v1:172.21.15.5:6789/0 conn(0x7f052006a840 legacy=0x7f052006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.932+0000 7f051f7fe700 1 -- 172.21.15.5:0/3382118324 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052015e920 con 0x7f052015e2f0 2023-10-16T13:38:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f051f7fe700 1 --2- 172.21.15.5:0/3382118324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200cede0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0508009820 tx=0x7f0508009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e64767b31ae639 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f051effd700 1 -- 172.21.15.5:0/3382118324 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508005e30 con 0x7f052015e2f0 2023-10-16T13:38:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f051effd700 1 -- 172.21.15.5:0/3382118324 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508006030 con 0x7f052015e2f0 2023-10-16T13:38:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f051effd700 1 -- 172.21.15.5:0/3382118324 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080063c0 con 0x7f052015e2f0 2023-10-16T13:38:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 -- 172.21.15.5:0/3382118324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 msgr2=0x7f05200cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 --2- 172.21.15.5:0/3382118324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200cede0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0508009820 tx=0x7f0508009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 -- 172.21.15.5:0/3382118324 shutdown_connections 2023-10-16T13:38:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 --2- 172.21.15.5:0/3382118324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200cede0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 -- 172.21.15.5:0/3382118324 >> 172.21.15.5:0/3382118324 conn(0x7f052006dae0 msgr2=0x7f052006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 -- 172.21.15.5:0/3382118324 shutdown_connections 2023-10-16T13:38:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.933+0000 7f052661f700 1 -- 172.21.15.5:0/3382118324 wait complete. 2023-10-16T13:38:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 Processor -- start 2023-10-16T13:38:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 -- start start 2023-10-16T13:38:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 0x7f05200c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05200cd950 0x7f05200caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200b1820 con 0x7f052006a840 2023-10-16T13:38:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200adaa0 con 0x7f052015e2f0 2023-10-16T13:38:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.935+0000 7f052661f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200c5360 con 0x7f05200cd950 2023-10-16T13:38:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 0x7f05200c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 0x7f05200c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41540/0 (socket says 172.21.15.5:41540) 2023-10-16T13:38:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 -- 172.21.15.5:0/2950887021 learned_addr learned my addr 172.21.15.5:0/2950887021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f0524bbc700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051f7fe700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05200cd950 0x7f05200caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 -- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05200cd950 msgr2=0x7f05200caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05200cd950 0x7f05200caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 -- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 msgr2=0x7f05200b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 -- 172.21.15.5:0/2950887021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009430 con 0x7f052006a840 2023-10-16T13:38:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051f7fe700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05200cd950 0x7f05200caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051ffff700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 0x7f05200c4a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f051000c700 tx=0x7f051000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05100052d0 con 0x7f052006a840 2023-10-16T13:38:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510005430 con 0x7f052006a840 2023-10-16T13:38:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05200c5080 con 0x7f052006a840 2023-10-16T13:38:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510003880 con 0x7f052006a840 2023-10-16T13:38:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.936+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05200adfb0 con 0x7f052006a840 2023-10-16T13:38:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.937+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200b2630 con 0x7f052006a840 2023-10-16T13:38:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.938+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f05100039e0 con 0x7f052006a840 2023-10-16T13:38:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.938+0000 7f051cff9700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f050006ae70 0x7f050006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.938+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f0510088300 con 0x7f052006a840 2023-10-16T13:38:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.938+0000 7f051f7fe700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f050006ae70 0x7f050006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.939+0000 7f051f7fe700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f050006ae70 0x7f050006d330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0508009b70 tx=0x7f0508008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:12.943+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0510053aa0 con 0x7f052006a840 2023-10-16T13:38:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.144+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f052015fdb0 con 0x7f052006a840 2023-10-16T13:38:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.145+0000 7f051cff9700 1 -- 172.21.15.5:0/2950887021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10836 (secure 0 0 0) 0x7f05100570c0 con 0x7f052006a840 2023-10-16T13:38:13.148 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:13.148 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:12.622723+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f050006ae70 msgr2=0x7f050006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f050006ae70 0x7f050006d330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0508009b70 tx=0x7f0508008070 comp rx=0 tx=0).stop 2023-10-16T13:38:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 msgr2=0x7f05200c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 0x7f05200c4a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f051000c700 tx=0x7f051000ca10 comp rx=0 tx=0).stop 2023-10-16T13:38:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 shutdown_connections 2023-10-16T13:38:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f052015e2f0 0x7f05200b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f052006a840 0x7f05200c4a10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f050006ae70 0x7f050006d330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 --2- 172.21.15.5:0/2950887021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05200cd950 0x7f05200caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 >> 172.21.15.5:0/2950887021 conn(0x7f052006dae0 msgr2=0x7f052006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 shutdown_connections 2023-10-16T13:38:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.147+0000 7f052661f700 1 -- 172.21.15.5:0/2950887021 wait complete. 2023-10-16T13:38:13.162 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-16T13:38:13.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:38:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.284+0000 7f31d292d700 1 Processor -- start 2023-10-16T13:38:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.284+0000 7f31d292d700 1 -- start start 2023-10-16T13:38:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31d292d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31cc15bb50 0x7f31cc06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31d292d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc0ce280 0x7f31cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31d292d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc15bf30 con 0x7f31cc06ed50 2023-10-16T13:38:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31d292d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc06f1d0 con 0x7f31cc15bb50 2023-10-16T13:38:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31d292d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0b2d70 con 0x7f31cc0ce280 2023-10-16T13:38:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31cb7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f31cc06ed50 0x7f31cc0cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51572/0 (socket says 172.21.15.5:51572) 2023-10-16T13:38:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31cb7fe700 1 -- 172.21.15.5:0/3364993967 learned_addr learned my addr 172.21.15.5:0/3364993967 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31d0eca700 1 --2- 172.21.15.5:0/3364993967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc0ce280 0x7f31cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.285+0000 7f31cbfff700 1 --2- 172.21.15.5:0/3364993967 >> v2:172.21.15.112:3300/0 conn(0x7f31cc15bb50 0x7f31cc06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31caffd700 1 -- 172.21.15.5:0/3364993967 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105201765 0 0) 0x7f31cc15bf30 con 0x7f31cc06ed50 2023-10-16T13:38:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31caffd700 1 -- 172.21.15.5:0/3364993967 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b80035b0 con 0x7f31cc06ed50 2023-10-16T13:38:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31d0eca700 1 -- 172.21.15.5:0/3364993967 >> v2:172.21.15.112:3300/0 conn(0x7f31cc15bb50 msgr2=0x7f31cc06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31d0eca700 1 --2- 172.21.15.5:0/3364993967 >> v2:172.21.15.112:3300/0 conn(0x7f31cc15bb50 0x7f31cc06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31d0eca700 1 -- 172.21.15.5:0/3364993967 >> v1:172.21.15.5:6789/0 conn(0x7f31cc06ed50 legacy=0x7f31cc0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31d0eca700 1 -- 172.21.15.5:0/3364993967 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc06d500 con 0x7f31cc0ce280 2023-10-16T13:38:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31d0eca700 1 --2- 172.21.15.5:0/3364993967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc0ce280 0x7f31cc06a840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009d90 tx=0x7f31c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbfb23a2d9d88ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31caffd700 1 -- 172.21.15.5:0/3364993967 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400e070 con 0x7f31cc0ce280 2023-10-16T13:38:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31caffd700 1 -- 172.21.15.5:0/3364993967 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400bb20 con 0x7f31cc0ce280 2023-10-16T13:38:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.286+0000 7f31caffd700 1 -- 172.21.15.5:0/3364993967 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4012430 con 0x7f31cc0ce280 2023-10-16T13:38:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 -- 172.21.15.5:0/3364993967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc0ce280 msgr2=0x7f31cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 --2- 172.21.15.5:0/3364993967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc0ce280 0x7f31cc06a840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009d90 tx=0x7f31c400b330 comp rx=0 tx=0).stop 2023-10-16T13:38:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 -- 172.21.15.5:0/3364993967 shutdown_connections 2023-10-16T13:38:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 --2- 172.21.15.5:0/3364993967 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc0ce280 0x7f31cc06a840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 --2- 172.21.15.5:0/3364993967 >> v2:172.21.15.112:3300/0 conn(0x7f31cc15bb50 0x7f31cc06e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 -- 172.21.15.5:0/3364993967 >> 172.21.15.5:0/3364993967 conn(0x7f31cc0cc6f0 msgr2=0x7f31cc0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 -- 172.21.15.5:0/3364993967 shutdown_connections 2023-10-16T13:38:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.287+0000 7f31d292d700 1 -- 172.21.15.5:0/3364993967 wait complete. 2023-10-16T13:38:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.288+0000 7f31d292d700 1 Processor -- start 2023-10-16T13:38:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.288+0000 7f31d292d700 1 -- start start 2023-10-16T13:38:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 0x7f31cc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31cc0ce280 0x7f31cc0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc15bb50 0x7f31cc15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1f0280 con 0x7f31cc06ed50 2023-10-16T13:38:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0c6250 con 0x7f31cc0ce280 2023-10-16T13:38:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1ef420 con 0x7f31cc15bb50 2023-10-16T13:38:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 0x7f31cc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 0x7f31cc0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41574/0 (socket says 172.21.15.5:41574) 2023-10-16T13:38:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 -- 172.21.15.5:0/1185656102 learned_addr learned my addr 172.21.15.5:0/1185656102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d0eca700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc15bb50 0x7f31cc15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cb7fe700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31cc0ce280 0x7f31cc0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 -- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc15bb50 msgr2=0x7f31cc15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc15bb50 0x7f31cc15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 -- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31cc0ce280 msgr2=0x7f31cc0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31cc0ce280 0x7f31cc0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 -- 172.21.15.5:0/1185656102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4009a70 con 0x7f31cc06ed50 2023-10-16T13:38:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31cbfff700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 0x7f31cc0c5d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e9b0 tx=0x7f31bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009710 con 0x7f31cc06ed50 2023-10-16T13:38:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00ee50 con 0x7f31cc06ed50 2023-10-16T13:38:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc1f04d0 con 0x7f31cc06ed50 2023-10-16T13:38:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.289+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00ca50 con 0x7f31cc06ed50 2023-10-16T13:38:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.290+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc1f0a90 con 0x7f31cc06ed50 2023-10-16T13:38:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.290+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc06e070 con 0x7f31cc06ed50 2023-10-16T13:38:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.291+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f31bc00cbb0 con 0x7f31cc06ed50 2023-10-16T13:38:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.291+0000 7f31c8ff9700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31ac06ae70 0x7f31ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.291+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f31bc0890f0 con 0x7f31cc06ed50 2023-10-16T13:38:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.291+0000 7f31cb7fe700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31ac06ae70 0x7f31ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.292+0000 7f31cb7fe700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31ac06ae70 0x7f31ac06d330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0b5a10 tx=0x7f31b4007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.296+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31bc054630 con 0x7f31cc06ed50 2023-10-16T13:38:13.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.543+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31cc0668b0 con 0x7f31cc06ed50 2023-10-16T13:38:13.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.543+0000 7f31c8ff9700 1 -- 172.21.15.5:0/1185656102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f31bc00ce60 con 0x7f31cc06ed50 2023-10-16T13:38:13.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:13.547 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T13:38:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31ac06ae70 msgr2=0x7f31ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31ac06ae70 0x7f31ac06d330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0b5a10 tx=0x7f31b4007dc0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 msgr2=0x7f31cc0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 0x7f31cc0c5d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e9b0 tx=0x7f31bc00ecc0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 shutdown_connections 2023-10-16T13:38:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31ac06ae70 0x7f31ac06d330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31cc15bb50 0x7f31cc15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31cc06ed50 0x7f31cc0c5d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 --2- 172.21.15.5:0/1185656102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31cc0ce280 0x7f31cc0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 >> 172.21.15.5:0/1185656102 conn(0x7f31cc0cc6f0 msgr2=0x7f31cc06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 shutdown_connections 2023-10-16T13:38:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:13.546+0000 7f31d292d700 1 -- 172.21.15.5:0/1185656102 wait complete. 2023-10-16T13:38:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2023-10-16T13:38:15.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:38:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.684+0000 7f88b5acd700 1 Processor -- start 2023-10-16T13:38:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.684+0000 7f88b5acd700 1 -- start start 2023-10-16T13:38:15.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88b5acd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00cd950 0x7f88b015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:15.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88b5acd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b00cf260 con 0x7f88b00cede0 2023-10-16T13:38:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88b5acd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b00b2d60 con 0x7f88b006a840 2023-10-16T13:38:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88b5acd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01619a0 con 0x7f88b00cd950 2023-10-16T13:38:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88aeffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88b00cede0 0x7f88b015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51632/0 (socket says 172.21.15.5:51632) 2023-10-16T13:38:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88aeffd700 1 -- 172.21.15.5:0/2336262892 learned_addr learned my addr 172.21.15.5:0/2336262892 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88af7fe700 1 --2- 172.21.15.5:0/2336262892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00cd950 0x7f88b015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861950958 0 0) 0x7f88b00cf260 con 0x7f88b00cede0 2023-10-16T13:38:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88980035b0 con 0x7f88b00cede0 2023-10-16T13:38:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116946369 0 0) 0x7f88b00b2d60 con 0x7f88b006a840 2023-10-16T13:38:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b00cf260 con 0x7f88b006a840 2023-10-16T13:38:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88af7fe700 1 -- 172.21.15.5:0/2336262892 >> v1:172.21.15.112:6789/0 conn(0x7f88b006a840 legacy=0x7f88b0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88af7fe700 1 -- 172.21.15.5:0/2336262892 >> v1:172.21.15.5:6789/0 conn(0x7f88b00cede0 legacy=0x7f88b015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.685+0000 7f88af7fe700 1 -- 172.21.15.5:0/2336262892 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00cdd30 con 0x7f88b00cd950 2023-10-16T13:38:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88af7fe700 1 --2- 172.21.15.5:0/2336262892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00cd950 0x7f88b015e2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009870 tx=0x7f88a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d493eb72a4411123 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4011830 con 0x7f88b00cd950 2023-10-16T13:38:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4011990 con 0x7f88b00cd950 2023-10-16T13:38:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88ae7fc700 1 -- 172.21.15.5:0/2336262892 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4011d20 con 0x7f88b00cd950 2023-10-16T13:38:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 -- 172.21.15.5:0/2336262892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00cd950 msgr2=0x7f88b015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 --2- 172.21.15.5:0/2336262892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00cd950 0x7f88b015e2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009870 tx=0x7f88a4009b80 comp rx=0 tx=0).stop 2023-10-16T13:38:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 -- 172.21.15.5:0/2336262892 shutdown_connections 2023-10-16T13:38:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 --2- 172.21.15.5:0/2336262892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00cd950 0x7f88b015e2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 -- 172.21.15.5:0/2336262892 >> 172.21.15.5:0/2336262892 conn(0x7f88b006dae0 msgr2=0x7f88b006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 -- 172.21.15.5:0/2336262892 shutdown_connections 2023-10-16T13:38:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.686+0000 7f88b5acd700 1 -- 172.21.15.5:0/2336262892 wait complete. 2023-10-16T13:38:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.688+0000 7f88b5acd700 1 Processor -- start 2023-10-16T13:38:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.688+0000 7f88b5acd700 1 -- start start 2023-10-16T13:38:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.688+0000 7f88b5acd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b006a840 0x7f88b0153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 0x7f88b01568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00cede0 0x7f88b00ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01f7120 con 0x7f88b00cd950 2023-10-16T13:38:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01556c0 con 0x7f88b00cede0 2023-10-16T13:38:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01559a0 con 0x7f88b006a840 2023-10-16T13:38:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 0x7f88b01568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 0x7f88b01568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41636/0 (socket says 172.21.15.5:41636) 2023-10-16T13:38:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 -- 172.21.15.5:0/1949658075 learned_addr learned my addr 172.21.15.5:0/1949658075 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88af7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b006a840 0x7f88b0153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88affff700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00cede0 0x7f88b00ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 -- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b006a840 msgr2=0x7f88b0153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b006a840 0x7f88b0153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 -- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00cede0 msgr2=0x7f88b00ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00cede0 0x7f88b00ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 -- 172.21.15.5:0/1949658075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40094a0 con 0x7f88b00cd950 2023-10-16T13:38:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88aeffd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 0x7f88b01568b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c700 tx=0x7f88a000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00074e0 con 0x7f88b00cd950 2023-10-16T13:38:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0007640 con 0x7f88b00cd950 2023-10-16T13:38:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b0155c80 con 0x7f88b00cd950 2023-10-16T13:38:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0005a30 con 0x7f88b00cd950 2023-10-16T13:38:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.689+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b0153f70 con 0x7f88b00cd950 2023-10-16T13:38:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.690+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b01f72d0 con 0x7f88b00cd950 2023-10-16T13:38:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.691+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f88a0005b90 con 0x7f88b00cd950 2023-10-16T13:38:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.691+0000 7f8897fff700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889c06ae70 0x7f889c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.691+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f88a0088530 con 0x7f88b00cd950 2023-10-16T13:38:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.692+0000 7f88af7fe700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889c06ae70 0x7f889c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.692+0000 7f88af7fe700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889c06ae70 0x7f889c06d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88a40097c0 tx=0x7f88a401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.696+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88b01f72d0 con 0x7f88b00cd950 2023-10-16T13:38:15.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.949+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b0067ae0 con 0x7f88b00cd950 2023-10-16T13:38:15.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.949+0000 7f8897fff700 1 -- 172.21.15.5:0/1949658075 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f88a0017070 con 0x7f88b00cd950 2023-10-16T13:38:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:15.952 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T13:38:15.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889c06ae70 msgr2=0x7f889c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889c06ae70 0x7f889c06d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88a40097c0 tx=0x7f88a401c040 comp rx=0 tx=0).stop 2023-10-16T13:38:15.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 msgr2=0x7f88b01568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:15.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 0x7f88b01568b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c700 tx=0x7f88a000ca10 comp rx=0 tx=0).stop 2023-10-16T13:38:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 shutdown_connections 2023-10-16T13:38:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00cede0 0x7f88b00ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889c06ae70 0x7f889c06d330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b006a840 0x7f88b0153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 --2- 172.21.15.5:0/1949658075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b00cd950 0x7f88b01568b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 >> 172.21.15.5:0/1949658075 conn(0x7f88b006dae0 msgr2=0x7f88b00ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 shutdown_connections 2023-10-16T13:38:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:15.951+0000 7f88b5acd700 1 -- 172.21.15.5:0/1949658075 wait complete. 2023-10-16T13:38:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-10-16T13:38:15.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.089+0000 7fccfa306700 1 Processor -- start 2023-10-16T13:38:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.089+0000 7fccfa306700 1 -- start start 2023-10-16T13:38:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccfa306700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fccf406eb30 0x7fccf415e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccfa306700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fccf40b54f0 0x7fccf415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccfa306700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf40b5c70 con 0x7fccf406e750 2023-10-16T13:38:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccfa306700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf40b5990 con 0x7fccf40b54f0 2023-10-16T13:38:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccfa306700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf415b2b0 con 0x7fccf406eb30 2023-10-16T13:38:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf88a3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fccf40b54f0 0x7fccf415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf88a3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fccf40b54f0 0x7fccf415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41646/0 (socket says 172.21.15.5:41646) 2023-10-16T13:38:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf88a3700 1 -- 172.21.15.5:0/3886293544 learned_addr learned my addr 172.21.15.5:0/3886293544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf37fe700 1 --2- 172.21.15.5:0/3886293544 >> v2:172.21.15.112:3300/0 conn(0x7fccf406eb30 0x7fccf415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf88a3700 1 -- 172.21.15.5:0/3886293544 >> v2:172.21.15.112:3300/0 conn(0x7fccf406eb30 msgr2=0x7fccf415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf88a3700 1 --2- 172.21.15.5:0/3886293544 >> v2:172.21.15.112:3300/0 conn(0x7fccf406eb30 0x7fccf415e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.090+0000 7fccf88a3700 1 -- 172.21.15.5:0/3886293544 >> v1:172.21.15.112:6789/0 conn(0x7fccf406e750 legacy=0x7fccf40ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccf88a3700 1 -- 172.21.15.5:0/3886293544 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf415b590 con 0x7fccf40b54f0 2023-10-16T13:38:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccf88a3700 1 --2- 172.21.15.5:0/3886293544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf415ec40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fccec009e50 tx=0x7fccec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0db4733d81934 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccf2ffd700 1 -- 172.21.15.5:0/3886293544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00e070 con 0x7fccf40b54f0 2023-10-16T13:38:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccf2ffd700 1 -- 172.21.15.5:0/3886293544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec003a20 con 0x7fccf40b54f0 2023-10-16T13:38:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccf2ffd700 1 -- 172.21.15.5:0/3886293544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec003dd0 con 0x7fccf40b54f0 2023-10-16T13:38:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 -- 172.21.15.5:0/3886293544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 msgr2=0x7fccf415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 --2- 172.21.15.5:0/3886293544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf415ec40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fccec009e50 tx=0x7fccec00b330 comp rx=0 tx=0).stop 2023-10-16T13:38:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 -- 172.21.15.5:0/3886293544 shutdown_connections 2023-10-16T13:38:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 --2- 172.21.15.5:0/3886293544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf415ec40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 --2- 172.21.15.5:0/3886293544 >> v2:172.21.15.112:3300/0 conn(0x7fccf406eb30 0x7fccf415e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 -- 172.21.15.5:0/3886293544 >> 172.21.15.5:0/3886293544 conn(0x7fccf40cc6f0 msgr2=0x7fccf40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 -- 172.21.15.5:0/3886293544 shutdown_connections 2023-10-16T13:38:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.091+0000 7fccfa306700 1 -- 172.21.15.5:0/3886293544 wait complete. 2023-10-16T13:38:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.093+0000 7fccfa306700 1 Processor -- start 2023-10-16T13:38:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.093+0000 7fccfa306700 1 -- start start 2023-10-16T13:38:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccfa306700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccf406e750 0x7fccf40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccfa306700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf406eb30 0x7fccf406d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccfa306700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf41f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccfa306700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40c94a0 con 0x7fccf40b54f0 2023-10-16T13:38:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccfa306700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41f5a10 con 0x7fccf406eb30 2023-10-16T13:38:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccfa306700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40c8b40 con 0x7fccf406e750 2023-10-16T13:38:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf41f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf41f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41652/0 (socket says 172.21.15.5:41652) 2023-10-16T13:38:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 -- 172.21.15.5:0/2559331449 learned_addr learned my addr 172.21.15.5:0/2559331449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf37fe700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf406eb30 0x7fccf406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf3fff700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccf406e750 0x7fccf40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 -- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccf406e750 msgr2=0x7fccf40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccf406e750 0x7fccf40c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 -- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf406eb30 msgr2=0x7fccf406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf406eb30 0x7fccf406d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 -- 172.21.15.5:0/2559331449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009b30 con 0x7fccf40b54f0 2023-10-16T13:38:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf88a3700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf41f4a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fccec015040 tx=0x7fccec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.094+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec004440 con 0x7fccf40b54f0 2023-10-16T13:38:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.095+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec0045c0 con 0x7fccf40b54f0 2023-10-16T13:38:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.095+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf41f5730 con 0x7fccf40b54f0 2023-10-16T13:38:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.095+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec004970 con 0x7fccf40b54f0 2023-10-16T13:38:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.095+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf40c90c0 con 0x7fccf40b54f0 2023-10-16T13:38:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.096+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80052f0 con 0x7fccf40b54f0 2023-10-16T13:38:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.096+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fccec012430 con 0x7fccf40b54f0 2023-10-16T13:38:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.097+0000 7fccf0ff9700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccd406ae70 0x7fccd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.097+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fccec08a400 con 0x7fccf40b54f0 2023-10-16T13:38:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.097+0000 7fccf3fff700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccd406ae70 0x7fccd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.097+0000 7fccf3fff700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccd406ae70 0x7fccd406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcce4007fd0 tx=0x7fcce4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.102+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fccec055970 con 0x7fccf40b54f0 2023-10-16T13:38:16.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.145+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fccec055d40 con 0x7fccf40b54f0 2023-10-16T13:38:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.306+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd80055a0 con 0x7fccf40b54f0 2023-10-16T13:38:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.306+0000 7fccf0ff9700 1 -- 172.21.15.5:0/2559331449 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7fccec084930 con 0x7fccf40b54f0 2023-10-16T13:38:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:16.310 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:15.886434+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccd406ae70 msgr2=0x7fccd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccd406ae70 0x7fccd406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcce4007fd0 tx=0x7fcce4009040 comp rx=0 tx=0).stop 2023-10-16T13:38:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 msgr2=0x7fccf41f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf41f4a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fccec015040 tx=0x7fccec004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 shutdown_connections 2023-10-16T13:38:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf40b54f0 0x7fccf41f4a40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccd406ae70 0x7fccd406d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccf406e750 0x7fccf40c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 --2- 172.21.15.5:0/2559331449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf406eb30 0x7fccf406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.308+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 >> 172.21.15.5:0/2559331449 conn(0x7fccf40cc6f0 msgr2=0x7fccf415e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.309+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 shutdown_connections 2023-10-16T13:38:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.309+0000 7fccfa306700 1 -- 172.21.15.5:0/2559331449 wait complete. 2023-10-16T13:38:16.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:16.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.449+0000 7fda9ca27700 1 Processor -- start 2023-10-16T13:38:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.449+0000 7fda9ca27700 1 -- start start 2023-10-16T13:38:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9ca27700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda980ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9ca27700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda980b54f0 0x7fda980cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9ca27700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980b5c70 con 0x7fda9806eb30 2023-10-16T13:38:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9ca27700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda980b5990 con 0x7fda980b54f0 2023-10-16T13:38:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9ca27700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9815b2b0 con 0x7fda9806e750 2023-10-16T13:38:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda980b54f0 0x7fda980cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda980b54f0 0x7fda980cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37556/0 (socket says 172.21.15.5:37556) 2023-10-16T13:38:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 -- 172.21.15.5:0/3327285576 learned_addr learned my addr 172.21.15.5:0/3327285576 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9659c700 1 --2- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda980ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 -- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 msgr2=0x7fda980ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 --2- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda980ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 -- 172.21.15.5:0/3327285576 >> v1:172.21.15.112:6789/0 conn(0x7fda9806eb30 legacy=0x7fda9815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda96d9d700 1 -- 172.21.15.5:0/3327285576 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9815b590 con 0x7fda980b54f0 2023-10-16T13:38:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.450+0000 7fda9559a700 1 -- 172.21.15.5:0/3327285576 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279709570 0 0) 0x7fda980b5c70 con 0x7fda9806eb30 2023-10-16T13:38:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda96d9d700 1 --2- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda980b54f0 0x7fda980cf400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda9000d150 tx=0x7fda9000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c548a125318b5be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9559a700 1 -- 172.21.15.5:0/3327285576 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90010070 con 0x7fda980b54f0 2023-10-16T13:38:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9559a700 1 -- 172.21.15.5:0/3327285576 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9000dd10 con 0x7fda980b54f0 2023-10-16T13:38:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9559a700 1 -- 172.21.15.5:0/3327285576 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000b310 con 0x7fda980b54f0 2023-10-16T13:38:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 -- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda980b54f0 msgr2=0x7fda980cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 --2- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda980b54f0 0x7fda980cf400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda9000d150 tx=0x7fda9000d460 comp rx=0 tx=0).stop 2023-10-16T13:38:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 -- 172.21.15.5:0/3327285576 shutdown_connections 2023-10-16T13:38:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 --2- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda980b54f0 0x7fda980cf400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 --2- 172.21.15.5:0/3327285576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda980ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 -- 172.21.15.5:0/3327285576 >> 172.21.15.5:0/3327285576 conn(0x7fda980cc6f0 msgr2=0x7fda980ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 -- 172.21.15.5:0/3327285576 shutdown_connections 2023-10-16T13:38:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.451+0000 7fda9ca27700 1 -- 172.21.15.5:0/3327285576 wait complete. 2023-10-16T13:38:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.453+0000 7fda9ca27700 1 Processor -- start 2023-10-16T13:38:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.453+0000 7fda9ca27700 1 -- start start 2023-10-16T13:38:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.453+0000 7fda9ca27700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda98155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.453+0000 7fda9ca27700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda9806eb30 0x7fda980ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.453+0000 7fda9ca27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 0x7fda9806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda9ca27700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda98155a50 con 0x7fda980b54f0 2023-10-16T13:38:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda9ca27700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda98159090 con 0x7fda9806eb30 2023-10-16T13:38:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda9ca27700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda98159370 con 0x7fda9806e750 2023-10-16T13:38:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 0x7fda9806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 0x7fda9806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41666/0 (socket says 172.21.15.5:41666) 2023-10-16T13:38:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda9659c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda98155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 -- 172.21.15.5:0/2036108470 learned_addr learned my addr 172.21.15.5:0/2036108470 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda95d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda9806eb30 0x7fda980ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 -- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 msgr2=0x7fda98155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda98155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 -- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda9806eb30 msgr2=0x7fda980ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda9806eb30 0x7fda980ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 -- 172.21.15.5:0/2036108470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9000bd40 con 0x7fda980b54f0 2023-10-16T13:38:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda95d9b700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda9806eb30 0x7fda980ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda96d9d700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 0x7fda9806d3d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda9000d7b0 tx=0x7fda90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90009a10 con 0x7fda980b54f0 2023-10-16T13:38:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90009b70 con 0x7fda980b54f0 2023-10-16T13:38:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda98159650 con 0x7fda980b54f0 2023-10-16T13:38:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000b4c0 con 0x7fda980b54f0 2023-10-16T13:38:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.454+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda98159c10 con 0x7fda980b54f0 2023-10-16T13:38:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.455+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda980ca110 con 0x7fda980b54f0 2023-10-16T13:38:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.456+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda90004040 con 0x7fda980b54f0 2023-10-16T13:38:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.456+0000 7fda8effd700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda7806af00 0x7fda7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.456+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda9008a9d0 con 0x7fda980b54f0 2023-10-16T13:38:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.456+0000 7fda9659c700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda7806af00 0x7fda7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.457+0000 7fda9659c700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda7806af00 0x7fda7806d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fda88009be0 tx=0x7fda88009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.461+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda90055de0 con 0x7fda980b54f0 2023-10-16T13:38:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.663+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda980c6800 con 0x7fda980b54f0 2023-10-16T13:38:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.664+0000 7fda8effd700 1 -- 172.21.15.5:0/2036108470 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda90059400 con 0x7fda980b54f0 2023-10-16T13:38:16.667 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:16.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda7806af00 msgr2=0x7fda7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda7806af00 0x7fda7806d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fda88009be0 tx=0x7fda88009210 comp rx=0 tx=0).stop 2023-10-16T13:38:16.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 msgr2=0x7fda9806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 0x7fda9806d3d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda9000d7b0 tx=0x7fda90004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 shutdown_connections 2023-10-16T13:38:16.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda980b54f0 0x7fda9806d3d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda7806af00 0x7fda7806d3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda9806e750 0x7fda98155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 --2- 172.21.15.5:0/2036108470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda9806eb30 0x7fda980ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 >> 172.21.15.5:0/2036108470 conn(0x7fda980cc6f0 msgr2=0x7fda981561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:16.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 shutdown_connections 2023-10-16T13:38:16.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.666+0000 7fda9ca27700 1 -- 172.21.15.5:0/2036108470 wait complete. 2023-10-16T13:38:16.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:38:16.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.803+0000 7fe78e343700 1 Processor -- start 2023-10-16T13:38:16.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.803+0000 7fe78e343700 1 -- start start 2023-10-16T13:38:16.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78e343700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7880cfe30 0x7fe7880cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78e343700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78815e7a0 con 0x7fe78815ab10 2023-10-16T13:38:16.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78e343700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7880b29a0 con 0x7fe78815f1f0 2023-10-16T13:38:16.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78e343700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880b2c80 con 0x7fe7880cfe30 2023-10-16T13:38:16.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe787fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe78815ab10 0x7fe7880b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51674/0 (socket says 172.21.15.5:51674) 2023-10-16T13:38:16.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe787fff700 1 -- 172.21.15.5:0/3988959719 learned_addr learned my addr 172.21.15.5:0/3988959719 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:16.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78c8e0700 1 --2- 172.21.15.5:0/3988959719 >> v2:172.21.15.112:3300/0 conn(0x7fe7880cfe30 0x7fe7880cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe786ffd700 1 -- 172.21.15.5:0/3988959719 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631206338 0 0) 0x7fe78815e7a0 con 0x7fe78815ab10 2023-10-16T13:38:16.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe786ffd700 1 -- 172.21.15.5:0/3988959719 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7700035b0 con 0x7fe78815ab10 2023-10-16T13:38:16.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78c8e0700 1 -- 172.21.15.5:0/3988959719 >> v1:172.21.15.112:6789/0 conn(0x7fe78815f1f0 legacy=0x7fe7880cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe786ffd700 1 -- 172.21.15.5:0/3988959719 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102999577 0 0) 0x7fe7880b29a0 con 0x7fe78815f1f0 2023-10-16T13:38:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78c8e0700 1 -- 172.21.15.5:0/3988959719 >> v1:172.21.15.5:6789/0 conn(0x7fe78815ab10 legacy=0x7fe7880b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.804+0000 7fe78c8e0700 1 -- 172.21.15.5:0/3988959719 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78815e9f0 con 0x7fe7880cfe30 2023-10-16T13:38:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78c8e0700 1 --2- 172.21.15.5:0/3988959719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880cbf40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe780009d90 tx=0x7fe78000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fd6d29581e800c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe786ffd700 1 -- 172.21.15.5:0/3988959719 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000e070 con 0x7fe7880cfe30 2023-10-16T13:38:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe786ffd700 1 -- 172.21.15.5:0/3988959719 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000bb20 con 0x7fe7880cfe30 2023-10-16T13:38:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe786ffd700 1 -- 172.21.15.5:0/3988959719 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000bed0 con 0x7fe7880cfe30 2023-10-16T13:38:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 -- 172.21.15.5:0/3988959719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 msgr2=0x7fe7880cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 --2- 172.21.15.5:0/3988959719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880cbf40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe780009d90 tx=0x7fe78000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 -- 172.21.15.5:0/3988959719 shutdown_connections 2023-10-16T13:38:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 --2- 172.21.15.5:0/3988959719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880cbf40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 -- 172.21.15.5:0/3988959719 >> 172.21.15.5:0/3988959719 conn(0x7fe78806dae0 msgr2=0x7fe78806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:16.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 -- 172.21.15.5:0/3988959719 shutdown_connections 2023-10-16T13:38:16.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.805+0000 7fe78e343700 1 -- 172.21.15.5:0/3988959719 wait complete. 2023-10-16T13:38:16.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.806+0000 7fe78e343700 1 Processor -- start 2023-10-16T13:38:16.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 -- start start 2023-10-16T13:38:16.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 0x7fe78814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe78815f1f0 0x7fe78814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78814fce0 con 0x7fe78815ab10 2023-10-16T13:38:16.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b1b90 con 0x7fe7880cfe30 2023-10-16T13:38:16.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe78e343700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b0f80 con 0x7fe78815f1f0 2023-10-16T13:38:16.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe7877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 0x7fe78814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe7877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 0x7fe78814f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41678/0 (socket says 172.21.15.5:41678) 2023-10-16T13:38:16.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.807+0000 7fe7877fe700 1 -- 172.21.15.5:0/925969697 learned_addr learned my addr 172.21.15.5:0/925969697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:16.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe78c8e0700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe78815f1f0 0x7fe78814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe787fff700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe7877fe700 1 -- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe78815f1f0 msgr2=0x7fe78814f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe7877fe700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe78815f1f0 0x7fe78814f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe7877fe700 1 -- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 msgr2=0x7fe7880c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:16.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe7877fe700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:16.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe7877fe700 1 -- 172.21.15.5:0/925969697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780009a70 con 0x7fe78815ab10 2023-10-16T13:38:16.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe7877fe700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 0x7fe78814f260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c550 tx=0x7fe77800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7780054e0 con 0x7fe78815ab10 2023-10-16T13:38:16.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7780036d0 con 0x7fe78815ab10 2023-10-16T13:38:16.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7880b1260 con 0x7fe78815ab10 2023-10-16T13:38:16.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778003a80 con 0x7fe78815ab10 2023-10-16T13:38:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.808+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7880b1820 con 0x7fe78815ab10 2023-10-16T13:38:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.809+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7880afc10 con 0x7fe78815ab10 2023-10-16T13:38:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.809+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe778003be0 con 0x7fe78815ab10 2023-10-16T13:38:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.810+0000 7fe784ff9700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe77406af00 0x7fe77406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.810+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe778088680 con 0x7fe78815ab10 2023-10-16T13:38:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.810+0000 7fe787fff700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe77406af00 0x7fe77406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.811+0000 7fe787fff700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe77406af00 0x7fe77406d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe77c007fd0 tx=0x7fe77c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:16.815+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe778053b10 con 0x7fe78815ab10 2023-10-16T13:38:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.019+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe7880cf8c0 con 0x7fe78815ab10 2023-10-16T13:38:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.019+0000 7fe784ff9700 1 -- 172.21.15.5:0/925969697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe778017020 con 0x7fe78815ab10 2023-10-16T13:38:17.022 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:38:17.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:38:17.023 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:38:17.023 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:38:17.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:38:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:38:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe77406af00 msgr2=0x7fe77406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe77406af00 0x7fe77406d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe77c007fd0 tx=0x7fe77c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 msgr2=0x7fe78814f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 0x7fe78814f260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c550 tx=0x7fe77800c860 comp rx=0 tx=0).stop 2023-10-16T13:38:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 shutdown_connections 2023-10-16T13:38:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe77406af00 0x7fe77406d3c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe78815f1f0 0x7fe78814f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7880cfe30 0x7fe7880c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 --2- 172.21.15.5:0/925969697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe78815ab10 0x7fe78814f260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 >> 172.21.15.5:0/925969697 conn(0x7fe78806dae0 msgr2=0x7fe7881592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 shutdown_connections 2023-10-16T13:38:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.021+0000 7fe78e343700 1 -- 172.21.15.5:0/925969697 wait complete. 2023-10-16T13:38:17.036 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:38:17.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:38:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.163+0000 7f34ddfca700 1 Processor -- start 2023-10-16T13:38:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.163+0000 7f34ddfca700 1 -- start start 2023-10-16T13:38:17.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34ddfca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34d80727e0 0x7f34d80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34ddfca700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34d806da30 0x7f34d806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34ddfca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80b2e40 con 0x7f34d8151680 2023-10-16T13:38:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34ddfca700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d806e420 con 0x7f34d80727e0 2023-10-16T13:38:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34ddfca700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d815e7c0 con 0x7f34d806da30 2023-10-16T13:38:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34d80727e0 0x7f34d80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34d8151680 0x7f34d815ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51688/0 (socket says 172.21.15.5:51688) 2023-10-16T13:38:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d77fe700 1 -- 172.21.15.5:0/1326547884 learned_addr learned my addr 172.21.15.5:0/1326547884 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d7fff700 1 --2- 172.21.15.5:0/1326547884 >> v2:172.21.15.112:3300/0 conn(0x7f34d806da30 0x7f34d806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d6ffd700 1 -- 172.21.15.5:0/1326547884 >> v2:172.21.15.112:3300/0 conn(0x7f34d806da30 msgr2=0x7f34d806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d6ffd700 1 --2- 172.21.15.5:0/1326547884 >> v2:172.21.15.112:3300/0 conn(0x7f34d806da30 0x7f34d806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d6ffd700 1 -- 172.21.15.5:0/1326547884 >> v1:172.21.15.5:6789/0 conn(0x7f34d8151680 legacy=0x7f34d815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d67fc700 1 -- 172.21.15.5:0/1326547884 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617050004 0 0) 0x7f34c8001110 con 0x7f34d8151680 2023-10-16T13:38:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d6ffd700 1 -- 172.21.15.5:0/1326547884 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80b2880 con 0x7f34d80727e0 2023-10-16T13:38:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.164+0000 7f34d6ffd700 1 --2- 172.21.15.5:0/1326547884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d80727e0 0x7f34d80b1f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34d815be00 tx=0x7f34c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d6f5e5d9fa8f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34d67fc700 1 -- 172.21.15.5:0/1326547884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0011830 con 0x7f34d80727e0 2023-10-16T13:38:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34d67fc700 1 -- 172.21.15.5:0/1326547884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c0011990 con 0x7f34d80727e0 2023-10-16T13:38:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34d67fc700 1 -- 172.21.15.5:0/1326547884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0011d20 con 0x7f34d80727e0 2023-10-16T13:38:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 -- 172.21.15.5:0/1326547884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d80727e0 msgr2=0x7f34d80b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1326547884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d80727e0 0x7f34d80b1f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34d815be00 tx=0x7f34c0009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 -- 172.21.15.5:0/1326547884 shutdown_connections 2023-10-16T13:38:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1326547884 >> v2:172.21.15.112:3300/0 conn(0x7f34d806da30 0x7f34d806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1326547884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d80727e0 0x7f34d80b1f10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 -- 172.21.15.5:0/1326547884 >> 172.21.15.5:0/1326547884 conn(0x7f34d806bd70 msgr2=0x7f34d806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:17.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 -- 172.21.15.5:0/1326547884 shutdown_connections 2023-10-16T13:38:17.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.165+0000 7f34ddfca700 1 -- 172.21.15.5:0/1326547884 wait complete. 2023-10-16T13:38:17.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.166+0000 7f34ddfca700 1 Processor -- start 2023-10-16T13:38:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 -- start start 2023-10-16T13:38:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 0x7f34d815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80727e0 0x7f34d81f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34d8151680 0x7f34d815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d815de30 con 0x7f34d806da30 2023-10-16T13:38:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81f3f80 con 0x7f34d80727e0 2023-10-16T13:38:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34ddfca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81f36e0 con 0x7f34d8151680 2023-10-16T13:38:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34d77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 0x7f34d815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34d77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 0x7f34d815d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41690/0 (socket says 172.21.15.5:41690) 2023-10-16T13:38:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.167+0000 7f34d77fe700 1 -- 172.21.15.5:0/1162549389 learned_addr learned my addr 172.21.15.5:0/1162549389 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34d77fe700 1 -- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34d8151680 msgr2=0x7f34d815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34d77fe700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34d8151680 0x7f34d815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34d77fe700 1 -- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80727e0 msgr2=0x7f34d81f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34d77fe700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80727e0 0x7f34d81f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34d77fe700 1 -- 172.21.15.5:0/1162549389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00094a0 con 0x7f34d806da30 2023-10-16T13:38:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34d77fe700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 0x7f34d815d8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c550 tx=0x7f34c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8004c80 con 0x7f34d806da30 2023-10-16T13:38:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8004e00 con 0x7f34d806da30 2023-10-16T13:38:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d81f39c0 con 0x7f34d806da30 2023-10-16T13:38:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8007310 con 0x7f34d806da30 2023-10-16T13:38:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.168+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d81f6790 con 0x7f34d806da30 2023-10-16T13:38:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.169+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d8072e10 con 0x7f34d806da30 2023-10-16T13:38:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.169+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f34c8007470 con 0x7f34d806da30 2023-10-16T13:38:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.170+0000 7f34cffff700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34b806af00 0x7f34b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.170+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34c8088d80 con 0x7f34d806da30 2023-10-16T13:38:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.170+0000 7f34d6ffd700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34b806af00 0x7f34b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.171+0000 7f34d6ffd700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34b806af00 0x7f34b806d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f34d815a350 tx=0x7f34c0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.175+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34c8054210 con 0x7f34d806da30 2023-10-16T13:38:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.379+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f34d80b2e40 con 0x7f34d806da30 2023-10-16T13:38:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.942+0000 7f34cffff700 1 -- 172.21.15.5:0/1162549389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f34d80b2e40 con 0x7f34d806da30 2023-10-16T13:38:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.945+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34b806af00 msgr2=0x7f34b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.945+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34b806af00 0x7f34b806d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f34d815a350 tx=0x7f34c0010000 comp rx=0 tx=0).stop 2023-10-16T13:38:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.945+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 msgr2=0x7f34d815d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.945+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 0x7f34d815d8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c550 tx=0x7f34c800c910 comp rx=0 tx=0).stop 2023-10-16T13:38:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.946+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 shutdown_connections 2023-10-16T13:38:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.946+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34b806af00 0x7f34b806d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.946+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34d8151680 0x7f34d815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.946+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d806da30 0x7f34d815d8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.946+0000 7f34ddfca700 1 --2- 172.21.15.5:0/1162549389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80727e0 0x7f34d81f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.946+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 >> 172.21.15.5:0/1162549389 conn(0x7f34d806bd70 msgr2=0x7f34d815ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:17.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.947+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 shutdown_connections 2023-10-16T13:38:17.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:17.947+0000 7f34ddfca700 1 -- 172.21.15.5:0/1162549389 wait complete. 2023-10-16T13:38:17.954 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:38:17.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:38:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.103+0000 7fc06c438700 1 Processor -- start 2023-10-16T13:38:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.103+0000 7fc06c438700 1 -- start start 2023-10-16T13:38:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.104+0000 7fc06c438700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc0640cd5a0 0x7fc0640cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.104+0000 7fc06c438700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640b6400 con 0x7fc06415a730 2023-10-16T13:38:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.104+0000 7fc06c438700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06415ea30 con 0x7fc0640b5e20 2023-10-16T13:38:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.104+0000 7fc06c438700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640b1fc0 con 0x7fc0640cd5a0 2023-10-16T13:38:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.104+0000 7fc06a1d4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc06415a730 0x7fc06415e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51702/0 (socket says 172.21.15.5:51702) 2023-10-16T13:38:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.104+0000 7fc06a1d4700 1 -- 172.21.15.5:0/1192559792 learned_addr learned my addr 172.21.15.5:0/1192559792 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a9d5700 1 --2- 172.21.15.5:0/1192559792 >> v2:172.21.15.112:3300/0 conn(0x7fc0640cd5a0 0x7fc0640cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676696785 0 0) 0x7fc0640b6400 con 0x7fc06415a730 2023-10-16T13:38:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0500035b0 con 0x7fc06415a730 2023-10-16T13:38:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696222216 0 0) 0x7fc06415ea30 con 0x7fc0640b5e20 2023-10-16T13:38:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0640b6400 con 0x7fc0640b5e20 2023-10-16T13:38:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163271941 0 0) 0x7fc0500035b0 con 0x7fc06415a730 2023-10-16T13:38:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 >> v2:172.21.15.112:3300/0 conn(0x7fc0640cd5a0 msgr2=0x7fc0640cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 --2- 172.21.15.5:0/1192559792 >> v2:172.21.15.112:3300/0 conn(0x7fc0640cd5a0 0x7fc0640cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 >> v1:172.21.15.112:6789/0 conn(0x7fc0640b5e20 legacy=0x7fc0640cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640ce450 con 0x7fc06415a730 2023-10-16T13:38:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fc054001670 con 0x7fc06415a730 2023-10-16T13:38:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 >> v1:172.21.15.5:6789/0 conn(0x7fc06415a730 legacy=0x7fc06415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc050003b90 0x7fc050003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc050004850 0x7fc050004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050005210 0x7fc05000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640b1fc0 con 0x7fc050003b90 2023-10-16T13:38:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05000c090 con 0x7fc050004850 2023-10-16T13:38:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05000c250 con 0x7fc050005210 2023-10-16T13:38:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc050003b90 0x7fc050003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc0699d3700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc050004850 0x7fc050004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a9d5700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050005210 0x7fc05000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a1d4700 1 -- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050005210 msgr2=0x7fc05000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050005210 0x7fc05000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a1d4700 1 -- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc050004850 msgr2=0x7fc050004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc050004850 0x7fc050004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a1d4700 1 -- 172.21.15.5:0/1192559792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500035b0 con 0x7fc050003b90 2023-10-16T13:38:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.105+0000 7fc06a9d5700 1 -- 172.21.15.5:0/1192559792 reap_dead start 2023-10-16T13:38:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc050003b90 0x7fc050003f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c240 tx=0x7fc050005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e2014159f9ee11 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400cd80 con 0x7fc050003b90 2023-10-16T13:38:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054005960 con 0x7fc050003b90 2023-10-16T13:38:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc0691d2700 1 -- 172.21.15.5:0/1192559792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054005d10 con 0x7fc050003b90 2023-10-16T13:38:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 -- 172.21.15.5:0/1192559792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc050003b90 msgr2=0x7fc050003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc050003b90 0x7fc050003f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c240 tx=0x7fc050005880 comp rx=0 tx=0).stop 2023-10-16T13:38:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 -- 172.21.15.5:0/1192559792 shutdown_connections 2023-10-16T13:38:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 --2- 172.21.15.5:0/1192559792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc050003b90 0x7fc050003f90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 -- 172.21.15.5:0/1192559792 >> 172.21.15.5:0/1192559792 conn(0x7fc06406dac0 msgr2=0x7fc06406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 -- 172.21.15.5:0/1192559792 shutdown_connections 2023-10-16T13:38:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.106+0000 7fc06c438700 1 -- 172.21.15.5:0/1192559792 wait complete. 2023-10-16T13:38:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 Processor -- start 2023-10-16T13:38:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 -- start start 2023-10-16T13:38:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050003b90 0x7fc06415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 0x7fc0640c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0640b0c00 0x7fc0640b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415dda0 con 0x7fc0640c7580 2023-10-16T13:38:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640b15f0 con 0x7fc0640b0c00 2023-10-16T13:38:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.108+0000 7fc06c438700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640c8750 con 0x7fc050003b90 2023-10-16T13:38:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 0x7fc0640c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 0x7fc0640c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41712/0 (socket says 172.21.15.5:41712) 2023-10-16T13:38:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 -- 172.21.15.5:0/724496293 learned_addr learned my addr 172.21.15.5:0/724496293 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050003b90 0x7fc06415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc06a9d5700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0640b0c00 0x7fc0640b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 -- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050003b90 msgr2=0x7fc06415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050003b90 0x7fc06415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 -- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0640b0c00 msgr2=0x7fc0640b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0640b0c00 0x7fc0640b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 -- 172.21.15.5:0/724496293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640c6da0 con 0x7fc0640c7580 2023-10-16T13:38:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc06a9d5700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0640b0c00 0x7fc0640b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050003b90 0x7fc06415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc0699d3700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 0x7fc0640c6860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc06000f900 tx=0x7fc06000fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600052d0 con 0x7fc0640c7580 2023-10-16T13:38:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060005430 con 0x7fc0640c7580 2023-10-16T13:38:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640c4830 con 0x7fc0640c7580 2023-10-16T13:38:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060006aa0 con 0x7fc0640c7580 2023-10-16T13:38:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.109+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0640c7e20 con 0x7fc0640c7580 2023-10-16T13:38:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.110+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064067d20 con 0x7fc0640c7580 2023-10-16T13:38:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.111+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc06000d7d0 con 0x7fc0640c7580 2023-10-16T13:38:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.111+0000 7fc05affd700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc04806af00 0x7fc04806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.111+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc060089870 con 0x7fc0640c7580 2023-10-16T13:38:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.111+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc04806af00 0x7fc04806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.112+0000 7fc06a1d4700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc04806af00 0x7fc04806d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0640cd030 tx=0x7fc054007f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.116+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc060054b00 con 0x7fc0640c7580 2023-10-16T13:38:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.316+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc0640c8890 con 0x7fc0640c7580 2023-10-16T13:38:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.944+0000 7fc05affd700 1 -- 172.21.15.5:0/724496293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc06001e0d0 con 0x7fc0640c7580 2023-10-16T13:38:18.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc04806af00 msgr2=0x7fc04806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc04806af00 0x7fc04806d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0640cd030 tx=0x7fc054007f90 comp rx=0 tx=0).stop 2023-10-16T13:38:18.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 msgr2=0x7fc0640c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 0x7fc0640c6860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc06000f900 tx=0x7fc06000fcc0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 shutdown_connections 2023-10-16T13:38:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0640b0c00 0x7fc0640b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc04806af00 0x7fc04806d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc050003b90 0x7fc06415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 --2- 172.21.15.5:0/724496293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0640c7580 0x7fc0640c6860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 >> 172.21.15.5:0/724496293 conn(0x7fc06406dac0 msgr2=0x7fc0640cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 shutdown_connections 2023-10-16T13:38:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:18.947+0000 7fc06c438700 1 -- 172.21.15.5:0/724496293 wait complete. 2023-10-16T13:38:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:38:18.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:38:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.109+0000 7fca6d3cc700 1 Processor -- start 2023-10-16T13:38:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.109+0000 7fca6d3cc700 1 -- start start 2023-10-16T13:38:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca6d3cc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca6815e2f0 0x7fca680cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca6d3cc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6806a840 0x7fca6806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca6d3cc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca680b2d60 con 0x7fca680cd950 2023-10-16T13:38:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca6d3cc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca681619a0 con 0x7fca6815e2f0 2023-10-16T13:38:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca6d3cc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6806b1f0 con 0x7fca6806a840 2023-10-16T13:38:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca66ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca680cd950 0x7fca6815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51722/0 (socket says 172.21.15.5:51722) 2023-10-16T13:38:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca66ffd700 1 -- 172.21.15.5:0/1600845145 learned_addr learned my addr 172.21.15.5:0/1600845145 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca677fe700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6806a840 0x7fca6806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca667fc700 1 --2- 172.21.15.5:0/1600845145 >> v2:172.21.15.112:3300/0 conn(0x7fca6815e2f0 0x7fca680cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.110+0000 7fca65ffb700 1 -- 172.21.15.5:0/1600845145 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436810720 0 0) 0x7fca680b2d60 con 0x7fca680cd950 2023-10-16T13:38:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca65ffb700 1 -- 172.21.15.5:0/1600845145 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca500035b0 con 0x7fca680cd950 2023-10-16T13:38:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca667fc700 1 -- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6806a840 msgr2=0x7fca6806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca65ffb700 1 -- 172.21.15.5:0/1600845145 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2483743504 0 0) 0x7fca500035b0 con 0x7fca680cd950 2023-10-16T13:38:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca667fc700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6806a840 0x7fca6806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca667fc700 1 -- 172.21.15.5:0/1600845145 >> v1:172.21.15.5:6789/0 conn(0x7fca680cd950 legacy=0x7fca6815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca667fc700 1 -- 172.21.15.5:0/1600845145 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680cdd30 con 0x7fca6815e2f0 2023-10-16T13:38:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca677fe700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6806a840 0x7fca6806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca667fc700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6815e2f0 0x7fca680cede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca68161ae0 tx=0x7fca58009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99fadc796158511c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca65ffb700 1 -- 172.21.15.5:0/1600845145 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c001670 con 0x7fca6815e2f0 2023-10-16T13:38:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca65ffb700 1 -- 172.21.15.5:0/1600845145 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58005c30 con 0x7fca6815e2f0 2023-10-16T13:38:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.111+0000 7fca65ffb700 1 -- 172.21.15.5:0/1600845145 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58004030 con 0x7fca6815e2f0 2023-10-16T13:38:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 -- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6815e2f0 msgr2=0x7fca680cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6815e2f0 0x7fca680cede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca68161ae0 tx=0x7fca58009b00 comp rx=0 tx=0).stop 2023-10-16T13:38:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 -- 172.21.15.5:0/1600845145 shutdown_connections 2023-10-16T13:38:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6806a840 0x7fca6806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/1600845145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6815e2f0 0x7fca680cede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 -- 172.21.15.5:0/1600845145 >> 172.21.15.5:0/1600845145 conn(0x7fca6806dae0 msgr2=0x7fca6806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 -- 172.21.15.5:0/1600845145 shutdown_connections 2023-10-16T13:38:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.112+0000 7fca6d3cc700 1 -- 172.21.15.5:0/1600845145 wait complete. 2023-10-16T13:38:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.113+0000 7fca6d3cc700 1 Processor -- start 2023-10-16T13:38:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.113+0000 7fca6d3cc700 1 -- start start 2023-10-16T13:38:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca6d3cc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6806a840 0x7fca680ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca6d3cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 0x7fca680cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca6d3cc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6815e2f0 0x7fca680cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca6d3cc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca680ae990 con 0x7fca680cd950 2023-10-16T13:38:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca6d3cc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca680aec70 con 0x7fca6806a840 2023-10-16T13:38:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca6d3cc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca680aef50 con 0x7fca6815e2f0 2023-10-16T13:38:19.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 0x7fca680cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:19.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 0x7fca680cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41726/0 (socket says 172.21.15.5:41726) 2023-10-16T13:38:19.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 -- 172.21.15.5:0/4225371942 learned_addr learned my addr 172.21.15.5:0/4225371942 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:19.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca677fe700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6815e2f0 0x7fca680cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca66ffd700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6806a840 0x7fca680ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 -- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6815e2f0 msgr2=0x7fca680cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6815e2f0 0x7fca680cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 -- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6806a840 msgr2=0x7fca680ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6806a840 0x7fca680ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 -- 172.21.15.5:0/4225371942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009a70 con 0x7fca680cd950 2023-10-16T13:38:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca66ffd700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6806a840 0x7fca680ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.114+0000 7fca667fc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 0x7fca680cc2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca58009b40 tx=0x7fca58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.115+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58006ea0 con 0x7fca680cd950 2023-10-16T13:38:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.115+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58003dd0 con 0x7fca680cd950 2023-10-16T13:38:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.115+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58009430 con 0x7fca680cd950 2023-10-16T13:38:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.115+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58006270 con 0x7fca680cd950 2023-10-16T13:38:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.115+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca680af510 con 0x7fca680cd950 2023-10-16T13:38:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.116+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca680cd0f0 con 0x7fca680cd950 2023-10-16T13:38:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.116+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca580063d0 con 0x7fca680cd950 2023-10-16T13:38:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.117+0000 7fca4f7fe700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fca5406af00 0x7fca5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.117+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fca5808aa80 con 0x7fca680cd950 2023-10-16T13:38:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.117+0000 7fca66ffd700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fca5406af00 0x7fca5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.117+0000 7fca66ffd700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fca5406af00 0x7fca5406d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca5c001eb0 tx=0x7fca5c001d80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.122+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca58055d40 con 0x7fca680cd950 2023-10-16T13:38:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.367+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fca68067d20 con 0x7fca680cd950 2023-10-16T13:38:19.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.976+0000 7fca4f7fe700 1 -- 172.21.15.5:0/4225371942 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca58017020 con 0x7fca680cd950 2023-10-16T13:38:19.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fca5406af00 msgr2=0x7fca5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:19.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fca5406af00 0x7fca5406d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca5c001eb0 tx=0x7fca5c001d80 comp rx=0 tx=0).stop 2023-10-16T13:38:19.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 msgr2=0x7fca680cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:19.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 0x7fca680cc2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca58009b40 tx=0x7fca58004750 comp rx=0 tx=0).stop 2023-10-16T13:38:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 shutdown_connections 2023-10-16T13:38:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fca5406af00 0x7fca5406d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca6815e2f0 0x7fca680cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6806a840 0x7fca680ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 --2- 172.21.15.5:0/4225371942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca680cd950 0x7fca680cc2c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.983+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 >> 172.21.15.5:0/4225371942 conn(0x7fca6806dae0 msgr2=0x7fca68160390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.984+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 shutdown_connections 2023-10-16T13:38:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:19.986+0000 7fca6d3cc700 1 -- 172.21.15.5:0/4225371942 wait complete. 2023-10-16T13:38:19.997 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T13:38:20.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.141+0000 7f55a69dd700 1 Processor -- start 2023-10-16T13:38:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.141+0000 7f55a69dd700 1 -- start start 2023-10-16T13:38:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f55a69dd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 0x7f55a015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f55a69dd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55a00cfe30 0x7f55a00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f55a69dd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a015e7a0 con 0x7f55a00b1f50 2023-10-16T13:38:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f55a69dd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a015f730 con 0x7f55a00cfe30 2023-10-16T13:38:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f55a69dd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00b29a0 con 0x7f55a015ab10 2023-10-16T13:38:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f559ffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 0x7f55a015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f55a4f7a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55a00cfe30 0x7f55a00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f559ffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 0x7f55a015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:39636/0 (socket says 172.21.15.5:39636) 2023-10-16T13:38:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.142+0000 7f559ffff700 1 -- 172.21.15.5:0/3161989937 learned_addr learned my addr 172.21.15.5:0/3161989937 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559ffff700 1 -- 172.21.15.5:0/3161989937 >> v2:172.21.15.112:3300/0 conn(0x7f55a00cfe30 msgr2=0x7f55a00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559ffff700 1 --2- 172.21.15.5:0/3161989937 >> v2:172.21.15.112:3300/0 conn(0x7f55a00cfe30 0x7f55a00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559ffff700 1 -- 172.21.15.5:0/3161989937 >> v1:172.21.15.112:6789/0 conn(0x7f55a00b1f50 legacy=0x7f55a00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559effd700 1 -- 172.21.15.5:0/3161989937 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414876846 0 0) 0x7f55a015e7a0 con 0x7f55a00b1f50 2023-10-16T13:38:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559ffff700 1 -- 172.21.15.5:0/3161989937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00b2c80 con 0x7f55a015ab10 2023-10-16T13:38:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f55a4f7a700 1 --2- 172.21.15.5:0/3161989937 >> v2:172.21.15.112:3300/0 conn(0x7f55a00cfe30 0x7f55a00cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559ffff700 1 --2- 172.21.15.5:0/3161989937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 0x7f55a015f1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f558800bb90 tx=0x7f558800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12382af9823a6cf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559effd700 1 -- 172.21.15.5:0/3161989937 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558800dd30 con 0x7f55a015ab10 2023-10-16T13:38:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559effd700 1 -- 172.21.15.5:0/3161989937 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558800de90 con 0x7f55a015ab10 2023-10-16T13:38:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.143+0000 7f559effd700 1 -- 172.21.15.5:0/3161989937 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588010690 con 0x7f55a015ab10 2023-10-16T13:38:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 -- 172.21.15.5:0/3161989937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 msgr2=0x7f55a015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 --2- 172.21.15.5:0/3161989937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 0x7f55a015f1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f558800bb90 tx=0x7f558800bea0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 -- 172.21.15.5:0/3161989937 shutdown_connections 2023-10-16T13:38:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 --2- 172.21.15.5:0/3161989937 >> v2:172.21.15.112:3300/0 conn(0x7f55a00cfe30 0x7f55a00cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 --2- 172.21.15.5:0/3161989937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a015ab10 0x7f55a015f1f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 -- 172.21.15.5:0/3161989937 >> 172.21.15.5:0/3161989937 conn(0x7f55a006dae0 msgr2=0x7f55a006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 -- 172.21.15.5:0/3161989937 shutdown_connections 2023-10-16T13:38:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.144+0000 7f55a69dd700 1 -- 172.21.15.5:0/3161989937 wait complete. 2023-10-16T13:38:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.145+0000 7f55a69dd700 1 Processor -- start 2023-10-16T13:38:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.145+0000 7f55a69dd700 1 -- start start 2023-10-16T13:38:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a69dd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b1f50 0x7f55a014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a69dd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 0x7f55a01ef020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a69dd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a015ab10 0x7f55a00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a69dd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a014e340 con 0x7f55a00cfe30 2023-10-16T13:38:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a69dd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a01ef560 con 0x7f55a015ab10 2023-10-16T13:38:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a69dd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a015c6c0 con 0x7f55a00b1f50 2023-10-16T13:38:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 0x7f55a01ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 0x7f55a01ef020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41740/0 (socket says 172.21.15.5:41740) 2023-10-16T13:38:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 -- 172.21.15.5:0/1841514150 learned_addr learned my addr 172.21.15.5:0/1841514150 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559ffff700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b1f50 0x7f55a014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f55a4f7a700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a015ab10 0x7f55a00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 -- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b1f50 msgr2=0x7f55a014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b1f50 0x7f55a014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 -- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a015ab10 msgr2=0x7f55a00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a015ab10 0x7f55a00b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 -- 172.21.15.5:0/1841514150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598009a70 con 0x7f55a00cfe30 2023-10-16T13:38:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.146+0000 7f559f7fe700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 0x7f55a01ef020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f559000c430 tx=0x7f559000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.147+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900054e0 con 0x7f55a00cfe30 2023-10-16T13:38:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.147+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559000ce40 con 0x7f55a00cfe30 2023-10-16T13:38:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.147+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558800b7f0 con 0x7f55a00cfe30 2023-10-16T13:38:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.147+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590003910 con 0x7f55a00cfe30 2023-10-16T13:38:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.147+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a015be90 con 0x7f55a00cfe30 2023-10-16T13:38:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.148+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a0067d20 con 0x7f55a00cfe30 2023-10-16T13:38:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.148+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5590003a70 con 0x7f55a00cfe30 2023-10-16T13:38:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.148+0000 7f559cff9700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f558006af00 0x7f558006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.149+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55900888e0 con 0x7f55a00cfe30 2023-10-16T13:38:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.149+0000 7f559ffff700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f558006af00 0x7f558006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.149+0000 7f559ffff700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f558006af00 0x7f558006d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f558800bee0 tx=0x7f5588013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.153+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55900539a0 con 0x7f55a00cfe30 2023-10-16T13:38:20.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.352+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55a00afc10 con 0x7f55a00cfe30 2023-10-16T13:38:20.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.354+0000 7f559cff9700 1 -- 172.21.15.5:0/1841514150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16446 (secure 0 0 0) 0x7f5590056fc0 con 0x7f55a00cfe30 2023-10-16T13:38:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:20.358 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:19.370151+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f558006af00 msgr2=0x7f558006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f558006af00 0x7f558006d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f558800bee0 tx=0x7f5588013000 comp rx=0 tx=0).stop 2023-10-16T13:38:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 msgr2=0x7f55a01ef020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 0x7f55a01ef020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f559000c430 tx=0x7f559000c740 comp rx=0 tx=0).stop 2023-10-16T13:38:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 shutdown_connections 2023-10-16T13:38:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a015ab10 0x7f55a00b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f558006af00 0x7f558006d3c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b1f50 0x7f55a014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 --2- 172.21.15.5:0/1841514150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55a00cfe30 0x7f55a01ef020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 >> 172.21.15.5:0/1841514150 conn(0x7f55a006dae0 msgr2=0x7f55a006ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 shutdown_connections 2023-10-16T13:38:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.356+0000 7f55a69dd700 1 -- 172.21.15.5:0/1841514150 wait complete. 2023-10-16T13:38:20.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.492+0000 7fadfce27700 1 Processor -- start 2023-10-16T13:38:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.492+0000 7fadfce27700 1 -- start start 2023-10-16T13:38:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.493+0000 7fadfce27700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cd950 0x7fadf815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.493+0000 7fadfce27700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadf806a840 0x7fadf806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.493+0000 7fadfce27700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80cf260 con 0x7fadf80cede0 2023-10-16T13:38:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.493+0000 7fadfce27700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf81619a0 con 0x7fadf806a840 2023-10-16T13:38:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.493+0000 7fadfce27700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf806b1f0 con 0x7fadf80cd950 2023-10-16T13:38:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadf806a840 0x7fadf806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf5d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fadf80cede0 0x7fadf815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51752/0 (socket says 172.21.15.5:51752) 2023-10-16T13:38:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf5d9b700 1 -- 172.21.15.5:0/2040721623 learned_addr learned my addr 172.21.15.5:0/2040721623 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf659c700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cd950 0x7fadf815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf6d9d700 1 -- 172.21.15.5:0/2040721623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cd950 msgr2=0x7fadf815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf6d9d700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cd950 0x7fadf815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf6d9d700 1 -- 172.21.15.5:0/2040721623 >> v1:172.21.15.5:6789/0 conn(0x7fadf80cede0 legacy=0x7fadf815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf6d9d700 1 -- 172.21.15.5:0/2040721623 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80b2d60 con 0x7fadf806a840 2023-10-16T13:38:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf559a700 1 -- 172.21.15.5:0/2040721623 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116576142 0 0) 0x7fadf80cf260 con 0x7fadf80cede0 2023-10-16T13:38:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf659c700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cd950 0x7fadf815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf6d9d700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf806acb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009d90 tx=0x7fadf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad1f2542fb3b447 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf559a700 1 -- 172.21.15.5:0/2040721623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000e070 con 0x7fadf806a840 2023-10-16T13:38:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf559a700 1 -- 172.21.15.5:0/2040721623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000bbd0 con 0x7fadf806a840 2023-10-16T13:38:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.494+0000 7fadf559a700 1 -- 172.21.15.5:0/2040721623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012430 con 0x7fadf806a840 2023-10-16T13:38:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 -- 172.21.15.5:0/2040721623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 msgr2=0x7fadf806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf806acb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009d90 tx=0x7fadf000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 -- 172.21.15.5:0/2040721623 shutdown_connections 2023-10-16T13:38:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf806acb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 --2- 172.21.15.5:0/2040721623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cd950 0x7fadf815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 -- 172.21.15.5:0/2040721623 >> 172.21.15.5:0/2040721623 conn(0x7fadf806dae0 msgr2=0x7fadf806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 -- 172.21.15.5:0/2040721623 shutdown_connections 2023-10-16T13:38:20.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.495+0000 7fadfce27700 1 -- 172.21.15.5:0/2040721623 wait complete. 2023-10-16T13:38:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.496+0000 7fadfce27700 1 Processor -- start 2023-10-16T13:38:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.496+0000 7fadfce27700 1 -- start start 2023-10-16T13:38:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadfce27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf80b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadfce27700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadf80cd950 0x7fadf80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadfce27700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cede0 0x7fadf80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadfce27700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80adbb0 con 0x7fadf806a840 2023-10-16T13:38:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadfce27700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80ad2c0 con 0x7fadf80cd950 2023-10-16T13:38:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadfce27700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80c72d0 con 0x7fadf80cede0 2023-10-16T13:38:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf80b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf80b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41752/0 (socket says 172.21.15.5:41752) 2023-10-16T13:38:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 -- 172.21.15.5:0/4082866587 learned_addr learned my addr 172.21.15.5:0/4082866587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf6d9d700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cede0 0x7fadf80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf5d9b700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadf80cd950 0x7fadf80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 -- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cede0 msgr2=0x7fadf80b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cede0 0x7fadf80b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 -- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadf80cd950 msgr2=0x7fadf80c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadf80cd950 0x7fadf80c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf659c700 1 -- 172.21.15.5:0/4082866587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0009a70 con 0x7fadf806a840 2023-10-16T13:38:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.497+0000 7fadf5d9b700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadf80cd950 0x7fadf80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.498+0000 7fadf659c700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf80b4cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadec00e810 tx=0x7fadec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.498+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec004230 con 0x7fadf806a840 2023-10-16T13:38:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.498+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec0043b0 con 0x7fadf806a840 2023-10-16T13:38:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.498+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf80b52d0 con 0x7fadf806a840 2023-10-16T13:38:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.498+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec0038e0 con 0x7fadf806a840 2023-10-16T13:38:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.498+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf80ad840 con 0x7fadf806a840 2023-10-16T13:38:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.499+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8067d20 con 0x7fadf806a840 2023-10-16T13:38:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.499+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fadec003a40 con 0x7fadf806a840 2023-10-16T13:38:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.500+0000 7fade6ffd700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadd806af00 0x7fadd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.500+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadec0890e0 con 0x7fadf806a840 2023-10-16T13:38:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.500+0000 7fadf5d9b700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadd806af00 0x7fadd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.500+0000 7fadf5d9b700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadd806af00 0x7fadd806d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fadf80c69c0 tx=0x7fade8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.504+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadec054100 con 0x7fadf806a840 2023-10-16T13:38:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.707+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf80b2630 con 0x7fadf806a840 2023-10-16T13:38:20.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.708+0000 7fade6ffd700 1 -- 172.21.15.5:0/4082866587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16446 (secure 0 0 0) 0x7fadec0094c0 con 0x7fadf806a840 2023-10-16T13:38:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:20.712 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:19.370151+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadd806af00 msgr2=0x7fadd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadd806af00 0x7fadd806d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fadf80c69c0 tx=0x7fade8009040 comp rx=0 tx=0).stop 2023-10-16T13:38:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 msgr2=0x7fadf80b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf80b4cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadec00e810 tx=0x7fadec00eb20 comp rx=0 tx=0).stop 2023-10-16T13:38:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 shutdown_connections 2023-10-16T13:38:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadd806af00 0x7fadd806d3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadf80cede0 0x7fadf80b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf806a840 0x7fadf80b4cb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 --2- 172.21.15.5:0/4082866587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadf80cd950 0x7fadf80c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 >> 172.21.15.5:0/4082866587 conn(0x7fadf806dae0 msgr2=0x7fadf8160820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 shutdown_connections 2023-10-16T13:38:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.711+0000 7fadfce27700 1 -- 172.21.15.5:0/4082866587 wait complete. 2023-10-16T13:38:20.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:38:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.852+0000 7f4a97d15700 1 Processor -- start 2023-10-16T13:38:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.852+0000 7f4a97d15700 1 -- start start 2023-10-16T13:38:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a97d15700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a9015ab10 0x7f4a9015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a97d15700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a900cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a97d15700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9015e7a0 con 0x7f4a900b1f50 2023-10-16T13:38:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a97d15700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9015f730 con 0x7f4a9015ab10 2023-10-16T13:38:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a97d15700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900b29a0 con 0x7f4a900cfe30 2023-10-16T13:38:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a900cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a95ab1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a9015ab10 0x7f4a9015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a900cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:39664/0 (socket says 172.21.15.5:39664) 2023-10-16T13:38:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 -- 172.21.15.5:0/4122717632 learned_addr learned my addr 172.21.15.5:0/4122717632 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a952b0700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4a900b1f50 0x7f4a900cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:42740/0 (socket says 172.21.15.5:42740) 2023-10-16T13:38:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 -- 172.21.15.5:0/4122717632 >> v2:172.21.15.112:3300/0 conn(0x7f4a9015ab10 msgr2=0x7f4a9015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 --2- 172.21.15.5:0/4122717632 >> v2:172.21.15.112:3300/0 conn(0x7f4a9015ab10 0x7f4a9015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 -- 172.21.15.5:0/4122717632 >> v1:172.21.15.112:6789/0 conn(0x7f4a900b1f50 legacy=0x7f4a900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.853+0000 7f4a962b2700 1 -- 172.21.15.5:0/4122717632 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900b2c80 con 0x7f4a900cfe30 2023-10-16T13:38:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a962b2700 1 --2- 172.21.15.5:0/4122717632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a900cbf40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009e50 tx=0x7f4a8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c3fce19b0eafb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a94aaf700 1 -- 172.21.15.5:0/4122717632 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800e070 con 0x7f4a900cfe30 2023-10-16T13:38:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a94aaf700 1 -- 172.21.15.5:0/4122717632 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8800b910 con 0x7f4a900cfe30 2023-10-16T13:38:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a94aaf700 1 -- 172.21.15.5:0/4122717632 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800bcc0 con 0x7f4a900cfe30 2023-10-16T13:38:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 -- 172.21.15.5:0/4122717632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 msgr2=0x7f4a900cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 --2- 172.21.15.5:0/4122717632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a900cbf40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009e50 tx=0x7f4a8800b330 comp rx=0 tx=0).stop 2023-10-16T13:38:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 -- 172.21.15.5:0/4122717632 shutdown_connections 2023-10-16T13:38:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 --2- 172.21.15.5:0/4122717632 >> v2:172.21.15.112:3300/0 conn(0x7f4a9015ab10 0x7f4a9015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 --2- 172.21.15.5:0/4122717632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a900cbf40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 -- 172.21.15.5:0/4122717632 >> 172.21.15.5:0/4122717632 conn(0x7f4a9006dae0 msgr2=0x7f4a9006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 -- 172.21.15.5:0/4122717632 shutdown_connections 2023-10-16T13:38:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.854+0000 7f4a97d15700 1 -- 172.21.15.5:0/4122717632 wait complete. 2023-10-16T13:38:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 Processor -- start 2023-10-16T13:38:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 -- start start 2023-10-16T13:38:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 0x7f4a900aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a901f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9015ab10 0x7f4a900cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a901f6a40 con 0x7f4a900b1f50 2023-10-16T13:38:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900ca8b0 con 0x7f4a9015ab10 2023-10-16T13:38:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a97d15700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900ac9c0 con 0x7f4a900cfe30 2023-10-16T13:38:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.856+0000 7f4a95ab1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 0x7f4a900aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 0x7f4a900aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41764/0 (socket says 172.21.15.5:41764) 2023-10-16T13:38:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 -- 172.21.15.5:0/2962858417 learned_addr learned my addr 172.21.15.5:0/2962858417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a962b2700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9015ab10 0x7f4a900cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a952b0700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a901f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 -- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 msgr2=0x7f4a901f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a901f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 -- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9015ab10 msgr2=0x7f4a900cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9015ab10 0x7f4a900cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 -- 172.21.15.5:0/2962858417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a88009b30 con 0x7f4a900b1f50 2023-10-16T13:38:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a95ab1700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 0x7f4a900aed30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000e9e0 tx=0x7f4a8000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80009710 con 0x7f4a900b1f50 2023-10-16T13:38:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8000ee80 con 0x7f4a900b1f50 2023-10-16T13:38:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000ca50 con 0x7f4a900b1f50 2023-10-16T13:38:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a900acca0 con 0x7f4a900b1f50 2023-10-16T13:38:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.857+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9015dcb0 con 0x7f4a900b1f50 2023-10-16T13:38:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.858+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a900b5a80 con 0x7f4a900b1f50 2023-10-16T13:38:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.859+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a8000cbb0 con 0x7f4a900b1f50 2023-10-16T13:38:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.859+0000 7f4a867fc700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a7406af00 0x7f4a7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.859+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a800895b0 con 0x7f4a900b1f50 2023-10-16T13:38:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.859+0000 7f4a952b0700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a7406af00 0x7f4a7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.860+0000 7f4a952b0700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a7406af00 0x7f4a7406d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a901f6910 tx=0x7f4a8c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:20.865+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a80054660 con 0x7f4a900b1f50 2023-10-16T13:38:21.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.109+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4a90067d20 con 0x7f4a900b1f50 2023-10-16T13:38:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.990+0000 7f4a867fc700 1 -- 172.21.15.5:0/2962858417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4a80057c80 con 0x7f4a900b1f50 2023-10-16T13:38:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a7406af00 msgr2=0x7f4a7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a7406af00 0x7f4a7406d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a901f6910 tx=0x7f4a8c000bc0 comp rx=0 tx=0).stop 2023-10-16T13:38:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 msgr2=0x7f4a900aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 0x7f4a900aed30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000e9e0 tx=0x7f4a8000ecf0 comp rx=0 tx=0).stop 2023-10-16T13:38:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 shutdown_connections 2023-10-16T13:38:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9015ab10 0x7f4a900cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a900b1f50 0x7f4a900aed30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a7406af00 0x7f4a7406d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 --2- 172.21.15.5:0/2962858417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a900cfe30 0x7f4a901f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 >> 172.21.15.5:0/2962858417 conn(0x7f4a9006dae0 msgr2=0x7f4a900cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 shutdown_connections 2023-10-16T13:38:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:21.993+0000 7f4a97d15700 1 -- 172.21.15.5:0/2962858417 wait complete. 2023-10-16T13:38:22.011 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:38:22.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:38:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.142+0000 7f1749255700 1 Processor -- start 2023-10-16T13:38:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.142+0000 7f1749255700 1 -- start start 2023-10-16T13:38:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f1749255700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17440cd950 0x7f174415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f1749255700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17440cede0 0x7f174415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f1749255700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440cf260 con 0x7f174406a840 2023-10-16T13:38:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f1749255700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17441619a0 con 0x7f17440cede0 2023-10-16T13:38:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f1749255700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b2d60 con 0x7f17440cd950 2023-10-16T13:38:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f174259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17440cede0 0x7f174415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f174359e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f174406a840 0x7f1744161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51778/0 (socket says 172.21.15.5:51778) 2023-10-16T13:38:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.143+0000 7f174359e700 1 -- 172.21.15.5:0/417280590 learned_addr learned my addr 172.21.15.5:0/417280590 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f1742d9d700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17440cd950 0x7f174415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f174259c700 1 -- 172.21.15.5:0/417280590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17440cd950 msgr2=0x7f174415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f174259c700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17440cd950 0x7f174415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f174259c700 1 -- 172.21.15.5:0/417280590 >> v1:172.21.15.5:6789/0 conn(0x7f174406a840 legacy=0x7f1744161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f174259c700 1 -- 172.21.15.5:0/417280590 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17440cdd30 con 0x7f17440cede0 2023-10-16T13:38:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f1741d9b700 1 -- 172.21.15.5:0/417280590 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721590781 0 0) 0x7f17440cf260 con 0x7f174406a840 2023-10-16T13:38:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f1742d9d700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17440cd950 0x7f174415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f174259c700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cede0 0x7f174415f570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1734009820 tx=0x7f1734009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a92646597b3a195 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f1741d9b700 1 -- 172.21.15.5:0/417280590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734005e30 con 0x7f17440cede0 2023-10-16T13:38:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f1741d9b700 1 -- 172.21.15.5:0/417280590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734006030 con 0x7f17440cede0 2023-10-16T13:38:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.144+0000 7f1741d9b700 1 -- 172.21.15.5:0/417280590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17340063e0 con 0x7f17440cede0 2023-10-16T13:38:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 -- 172.21.15.5:0/417280590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cede0 msgr2=0x7f174415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cede0 0x7f174415f570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1734009820 tx=0x7f1734009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 -- 172.21.15.5:0/417280590 shutdown_connections 2023-10-16T13:38:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17440cd950 0x7f174415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 --2- 172.21.15.5:0/417280590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cede0 0x7f174415f570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 -- 172.21.15.5:0/417280590 >> 172.21.15.5:0/417280590 conn(0x7f174406dae0 msgr2=0x7f174406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 -- 172.21.15.5:0/417280590 shutdown_connections 2023-10-16T13:38:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.145+0000 7f1749255700 1 -- 172.21.15.5:0/417280590 wait complete. 2023-10-16T13:38:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.146+0000 7f1749255700 1 Processor -- start 2023-10-16T13:38:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.146+0000 7f1749255700 1 -- start start 2023-10-16T13:38:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1749255700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f174406a840 0x7f1744153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1749255700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 0x7f17440b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1749255700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17440cede0 0x7f17440ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1749255700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17440aeea0 con 0x7f17440cd950 2023-10-16T13:38:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1749255700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1744153cb0 con 0x7f17440cede0 2023-10-16T13:38:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1749255700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b3590 con 0x7f174406a840 2023-10-16T13:38:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f174259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 0x7f17440b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f174259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 0x7f17440b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41780/0 (socket says 172.21.15.5:41780) 2023-10-16T13:38:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f174259c700 1 -- 172.21.15.5:0/159362726 learned_addr learned my addr 172.21.15.5:0/159362726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f1742d9d700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f174406a840 0x7f1744153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.147+0000 7f174359e700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17440cede0 0x7f17440ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174259c700 1 -- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f174406a840 msgr2=0x7f1744153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174259c700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f174406a840 0x7f1744153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174259c700 1 -- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17440cede0 msgr2=0x7f17440ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174259c700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17440cede0 0x7f17440ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174259c700 1 -- 172.21.15.5:0/159362726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734009430 con 0x7f17440cd950 2023-10-16T13:38:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174359e700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17440cede0 0x7f17440ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f1742d9d700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f174406a840 0x7f1744153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f174259c700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 0x7f17440b05a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1734000c00 tx=0x7f1734004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734004040 con 0x7f17440cd950 2023-10-16T13:38:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734020070 con 0x7f17440cd950 2023-10-16T13:38:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17440ae8e0 con 0x7f17440cd950 2023-10-16T13:38:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734004400 con 0x7f17440cd950 2023-10-16T13:38:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.148+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440b3220 con 0x7f17440cd950 2023-10-16T13:38:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.149+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1744067d20 con 0x7f17440cd950 2023-10-16T13:38:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.149+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1734022030 con 0x7f17440cd950 2023-10-16T13:38:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.150+0000 7f173b7fe700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f172406af00 0x7f172406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.150+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f173408ad80 con 0x7f17440cd950 2023-10-16T13:38:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.150+0000 7f1742d9d700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f172406af00 0x7f172406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.151+0000 7f1742d9d700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f172406af00 0x7f172406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f172c006fd0 tx=0x7f172c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.155+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1734055da0 con 0x7f17440cd950 2023-10-16T13:38:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.402+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f17440b2630 con 0x7f17440cd950 2023-10-16T13:38:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.992+0000 7f173b7fe700 1 -- 172.21.15.5:0/159362726 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1734019e60 con 0x7f17440cd950 2023-10-16T13:38:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f172406af00 msgr2=0x7f172406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f172406af00 0x7f172406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f172c006fd0 tx=0x7f172c008040 comp rx=0 tx=0).stop 2023-10-16T13:38:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 msgr2=0x7f17440b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 0x7f17440b05a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1734000c00 tx=0x7f1734004750 comp rx=0 tx=0).stop 2023-10-16T13:38:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 shutdown_connections 2023-10-16T13:38:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17440cede0 0x7f17440ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f172406af00 0x7f172406d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f174406a840 0x7f1744153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 --2- 172.21.15.5:0/159362726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17440cd950 0x7f17440b05a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 >> 172.21.15.5:0/159362726 conn(0x7f174406dae0 msgr2=0x7f17440b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.995+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 shutdown_connections 2023-10-16T13:38:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:22.996+0000 7f1749255700 1 -- 172.21.15.5:0/159362726 wait complete. 2023-10-16T13:38:23.013 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:38:23.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:38:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.143+0000 7f31c4892700 1 Processor -- start 2023-10-16T13:38:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.143+0000 7f31c4892700 1 -- start start 2023-10-16T13:38:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31c4892700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 0x7f31c015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31c4892700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31c00b1f50 0x7f31c00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31c4892700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c015e7a0 con 0x7f31c00b23d0 2023-10-16T13:38:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31c4892700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c015f730 con 0x7f31c00b1f50 2023-10-16T13:38:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31c4892700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00b29a0 con 0x7f31c015ab10 2023-10-16T13:38:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 0x7f31c015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 0x7f31c015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:39690/0 (socket says 172.21.15.5:39690) 2023-10-16T13:38:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 -- 172.21.15.5:0/2358767932 learned_addr learned my addr 172.21.15.5:0/2358767932 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31bdd9b700 1 --2- 172.21.15.5:0/2358767932 >> v2:172.21.15.112:3300/0 conn(0x7f31c00b1f50 0x7f31c00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 -- 172.21.15.5:0/2358767932 >> v2:172.21.15.112:3300/0 conn(0x7f31c00b1f50 msgr2=0x7f31c00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 --2- 172.21.15.5:0/2358767932 >> v2:172.21.15.112:3300/0 conn(0x7f31c00b1f50 0x7f31c00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 -- 172.21.15.5:0/2358767932 >> v1:172.21.15.112:6789/0 conn(0x7f31c00b23d0 legacy=0x7f31c00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31bd59a700 1 -- 172.21.15.5:0/2358767932 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725107378 0 0) 0x7f31c015e7a0 con 0x7f31c00b23d0 2023-10-16T13:38:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 -- 172.21.15.5:0/2358767932 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00b2c80 con 0x7f31c015ab10 2023-10-16T13:38:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.144+0000 7f31be59c700 1 --2- 172.21.15.5:0/2358767932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 0x7f31c015f1f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f31b00098f0 tx=0x7f31b0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9ac9fbd21a742fd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31bd59a700 1 -- 172.21.15.5:0/2358767932 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0011830 con 0x7f31c015ab10 2023-10-16T13:38:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31bd59a700 1 -- 172.21.15.5:0/2358767932 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b0011990 con 0x7f31c015ab10 2023-10-16T13:38:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31bd59a700 1 -- 172.21.15.5:0/2358767932 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0011d20 con 0x7f31c015ab10 2023-10-16T13:38:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 -- 172.21.15.5:0/2358767932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 msgr2=0x7f31c015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 --2- 172.21.15.5:0/2358767932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 0x7f31c015f1f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f31b00098f0 tx=0x7f31b0009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 -- 172.21.15.5:0/2358767932 shutdown_connections 2023-10-16T13:38:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 --2- 172.21.15.5:0/2358767932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c015ab10 0x7f31c015f1f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 --2- 172.21.15.5:0/2358767932 >> v2:172.21.15.112:3300/0 conn(0x7f31c00b1f50 0x7f31c00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 -- 172.21.15.5:0/2358767932 >> 172.21.15.5:0/2358767932 conn(0x7f31c006dae0 msgr2=0x7f31c006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 -- 172.21.15.5:0/2358767932 shutdown_connections 2023-10-16T13:38:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.145+0000 7f31c4892700 1 -- 172.21.15.5:0/2358767932 wait complete. 2023-10-16T13:38:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.147+0000 7f31c4892700 1 Processor -- start 2023-10-16T13:38:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.147+0000 7f31c4892700 1 -- start start 2023-10-16T13:38:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31c4892700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 0x7f31c014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31c4892700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c00b23d0 0x7f31c015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31c4892700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c015ab10 0x7f31c0157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31c4892700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c014e3d0 con 0x7f31c00b1f50 2023-10-16T13:38:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31c4892700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00b5720 con 0x7f31c015ab10 2023-10-16T13:38:23.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31c4892700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00b4830 con 0x7f31c00b23d0 2023-10-16T13:38:23.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 0x7f31c014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 0x7f31c014de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41790/0 (socket says 172.21.15.5:41790) 2023-10-16T13:38:23.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 -- 172.21.15.5:0/2094561631 learned_addr learned my addr 172.21.15.5:0/2094561631 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:23.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31bdd9b700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c00b23d0 0x7f31c015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31bed9d700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c015ab10 0x7f31c0157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 -- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c00b23d0 msgr2=0x7f31c015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c00b23d0 0x7f31c015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 -- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c015ab10 msgr2=0x7f31c0157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.148+0000 7f31be59c700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c015ab10 0x7f31c0157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31be59c700 1 -- 172.21.15.5:0/2094561631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009550 con 0x7f31c00b1f50 2023-10-16T13:38:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31be59c700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 0x7f31c014de90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000c00 tx=0x7f31b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0020070 con 0x7f31c00b1f50 2023-10-16T13:38:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b0004410 con 0x7f31c00b1f50 2023-10-16T13:38:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c00b4b10 con 0x7f31c00b1f50 2023-10-16T13:38:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00038a0 con 0x7f31c00b1f50 2023-10-16T13:38:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.149+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c00b50d0 con 0x7f31c00b1f50 2023-10-16T13:38:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.150+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0067d20 con 0x7f31c00b1f50 2023-10-16T13:38:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.150+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f31b0003a00 con 0x7f31c00b1f50 2023-10-16T13:38:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.151+0000 7f31aeffd700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31a006af00 0x7f31a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.151+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31b008c6e0 con 0x7f31c00b1f50 2023-10-16T13:38:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.151+0000 7f31bdd9b700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31a006af00 0x7f31a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.152+0000 7f31bdd9b700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31a006af00 0x7f31a006d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31c01f36b0 tx=0x7f31b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.156+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31b00577b0 con 0x7f31c00b1f50 2023-10-16T13:38:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.399+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c00c8120 con 0x7f31c00b1f50 2023-10-16T13:38:23.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.400+0000 7f31aeffd700 1 -- 172.21.15.5:0/2094561631 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f31b005add0 con 0x7f31c00b1f50 2023-10-16T13:38:23.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:23.403 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:38:23.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31a006af00 msgr2=0x7f31a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31a006af00 0x7f31a006d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31c01f36b0 tx=0x7f31b4008040 comp rx=0 tx=0).stop 2023-10-16T13:38:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 msgr2=0x7f31c014de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 0x7f31c014de90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000c00 tx=0x7f31b0004750 comp rx=0 tx=0).stop 2023-10-16T13:38:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 shutdown_connections 2023-10-16T13:38:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c015ab10 0x7f31c0157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00b1f50 0x7f31c014de90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31a006af00 0x7f31a006d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 --2- 172.21.15.5:0/2094561631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31c00b23d0 0x7f31c015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 >> 172.21.15.5:0/2094561631 conn(0x7f31c006dae0 msgr2=0x7f31c0158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 shutdown_connections 2023-10-16T13:38:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.402+0000 7f31c4892700 1 -- 172.21.15.5:0/2094561631 wait complete. 2023-10-16T13:38:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:38:23.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.540+0000 7fb58ce70700 1 Processor -- start 2023-10-16T13:38:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.540+0000 7fb58ce70700 1 -- start start 2023-10-16T13:38:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58ce70700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58815e2f0 0x7fb5880cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58ce70700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb58806a840 0x7fb58806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58ce70700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880b2d60 con 0x7fb5880cd950 2023-10-16T13:38:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58ce70700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5881619a0 con 0x7fb58806a840 2023-10-16T13:38:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58ce70700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58806b1f0 con 0x7fb58815e2f0 2023-10-16T13:38:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5880cd950 0x7fb58815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51802/0 (socket says 172.21.15.5:51802) 2023-10-16T13:38:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58659c700 1 -- 172.21.15.5:0/2721718968 learned_addr learned my addr 172.21.15.5:0/2721718968 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb586d9d700 1 --2- 172.21.15.5:0/2721718968 >> v2:172.21.15.112:3300/0 conn(0x7fb58806a840 0x7fb58806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb585d9b700 1 --2- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58815e2f0 0x7fb5880cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58559a700 1 -- 172.21.15.5:0/2721718968 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370265063 0 0) 0x7fb5880b2d60 con 0x7fb5880cd950 2023-10-16T13:38:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.541+0000 7fb58559a700 1 -- 172.21.15.5:0/2721718968 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5700035b0 con 0x7fb5880cd950 2023-10-16T13:38:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb586d9d700 1 -- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58815e2f0 msgr2=0x7fb5880cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb586d9d700 1 --2- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58815e2f0 0x7fb5880cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb586d9d700 1 -- 172.21.15.5:0/2721718968 >> v1:172.21.15.5:6789/0 conn(0x7fb5880cd950 legacy=0x7fb58815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb58559a700 1 -- 172.21.15.5:0/2721718968 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664870374 0 0) 0x7fb5700035b0 con 0x7fb5880cd950 2023-10-16T13:38:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb586d9d700 1 -- 172.21.15.5:0/2721718968 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5880cdd30 con 0x7fb58806a840 2023-10-16T13:38:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb586d9d700 1 --2- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58806a840 0x7fb58806acb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb580009d90 tx=0x7fb58000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723389a3e25672cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb58559a700 1 -- 172.21.15.5:0/2721718968 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000e070 con 0x7fb58806a840 2023-10-16T13:38:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb58559a700 1 -- 172.21.15.5:0/2721718968 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58000bb20 con 0x7fb58806a840 2023-10-16T13:38:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.542+0000 7fb58559a700 1 -- 172.21.15.5:0/2721718968 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580012430 con 0x7fb58806a840 2023-10-16T13:38:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 -- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58806a840 msgr2=0x7fb58806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58806a840 0x7fb58806acb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb580009d90 tx=0x7fb58000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 -- 172.21.15.5:0/2721718968 shutdown_connections 2023-10-16T13:38:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58806a840 0x7fb58806acb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2721718968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58815e2f0 0x7fb5880cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 -- 172.21.15.5:0/2721718968 >> 172.21.15.5:0/2721718968 conn(0x7fb58806dae0 msgr2=0x7fb58806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 -- 172.21.15.5:0/2721718968 shutdown_connections 2023-10-16T13:38:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.543+0000 7fb58ce70700 1 -- 172.21.15.5:0/2721718968 wait complete. 2023-10-16T13:38:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.544+0000 7fb58ce70700 1 Processor -- start 2023-10-16T13:38:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.544+0000 7fb58ce70700 1 -- start start 2023-10-16T13:38:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58ce70700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58806a840 0x7fb5881509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58ce70700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 0x7fb5880c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58ce70700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58815e2f0 0x7fb5880c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58ce70700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880c6ed0 con 0x7fb5880cd950 2023-10-16T13:38:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58ce70700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814e300 con 0x7fb58815e2f0 2023-10-16T13:38:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58ce70700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880c6bf0 con 0x7fb58806a840 2023-10-16T13:38:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 0x7fb5880c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 0x7fb5880c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41806/0 (socket says 172.21.15.5:41806) 2023-10-16T13:38:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 -- 172.21.15.5:0/2718688167 learned_addr learned my addr 172.21.15.5:0/2718688167 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb58659c700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58806a840 0x7fb5881509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb586d9d700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58815e2f0 0x7fb5880c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 -- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58806a840 msgr2=0x7fb5881509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58806a840 0x7fb5881509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 -- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58815e2f0 msgr2=0x7fb5880c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58815e2f0 0x7fb5880c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 -- 172.21.15.5:0/2718688167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009a70 con 0x7fb5880cd950 2023-10-16T13:38:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.545+0000 7fb585d9b700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 0x7fb5880c5e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb57800e900 tx=0x7fb57800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.546+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578009650 con 0x7fb5880cd950 2023-10-16T13:38:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.546+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58814e5a0 con 0x7fb5880cd950 2023-10-16T13:38:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.546+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57800c850 con 0x7fb5880cd950 2023-10-16T13:38:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.546+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800cbc0 con 0x7fb5880cd950 2023-10-16T13:38:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.546+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5880c6900 con 0x7fb5880cd950 2023-10-16T13:38:23.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.547+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58814ebf0 con 0x7fb5880cd950 2023-10-16T13:38:23.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.547+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb57800cd20 con 0x7fb5880cd950 2023-10-16T13:38:23.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.548+0000 7fb576ffd700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb56806af00 0x7fb56806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.548+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb578089a70 con 0x7fb5880cd950 2023-10-16T13:38:23.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.548+0000 7fb58659c700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb56806af00 0x7fb56806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.549+0000 7fb58659c700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb56806af00 0x7fb56806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0013c0 tx=0x7fb57c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.553+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb578054aa0 con 0x7fb5880cd950 2023-10-16T13:38:23.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.751+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb58814e160 con 0x7fb5880cd950 2023-10-16T13:38:23.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.752+0000 7fb576ffd700 1 -- 172.21.15.5:0/2718688167 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fb58814e160 con 0x7fb5880cd950 2023-10-16T13:38:23.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:23.755 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb56806af00 msgr2=0x7fb56806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb56806af00 0x7fb56806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0013c0 tx=0x7fb57c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 msgr2=0x7fb5880c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 0x7fb5880c5e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb57800e900 tx=0x7fb57800ecc0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 shutdown_connections 2023-10-16T13:38:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58815e2f0 0x7fb5880c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb56806af00 0x7fb56806d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb58806a840 0x7fb5881509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 --2- 172.21.15.5:0/2718688167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5880cd950 0x7fb5880c5e80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 >> 172.21.15.5:0/2718688167 conn(0x7fb58806dae0 msgr2=0x7fb58815d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 shutdown_connections 2023-10-16T13:38:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.754+0000 7fb58ce70700 1 -- 172.21.15.5:0/2718688167 wait complete. 2023-10-16T13:38:23.771 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:38:23.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:23.892 INFO:tasks.ceph.mds.b.smithi112.stderr:2023-10-16T13:38:23.889+0000 7ff6c1334700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:38:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.894+0000 7fbd08d1b700 1 Processor -- start 2023-10-16T13:38:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.894+0000 7fbd08d1b700 1 -- start start 2023-10-16T13:38:23.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd08d1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0415f050 0x7fbd040cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd08d1b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbd040d0530 0x7fbd0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd08d1b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040b0a80 con 0x7fbd040b0580 2023-10-16T13:38:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd08d1b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd040ccee0 con 0x7fbd040d0530 2023-10-16T13:38:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd08d1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040cd1c0 con 0x7fbd0415f050 2023-10-16T13:38:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd01d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbd040b0580 0x7fbd040ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51816/0 (socket says 172.21.15.5:51816) 2023-10-16T13:38:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd01d9b700 1 -- 172.21.15.5:0/2433479922 learned_addr learned my addr 172.21.15.5:0/2433479922 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0259c700 1 --2- 172.21.15.5:0/2433479922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0415f050 0x7fbd040cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd02d9d700 1 --2- 172.21.15.5:0/2433479922 >> v2:172.21.15.112:3300/0 conn(0x7fbd040d0530 0x7fbd0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0159a700 1 -- 172.21.15.5:0/2433479922 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749404473 0 0) 0x7fbd040b0a80 con 0x7fbd040b0580 2023-10-16T13:38:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0159a700 1 -- 172.21.15.5:0/2433479922 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcec0035b0 con 0x7fbd040b0580 2023-10-16T13:38:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0159a700 1 -- 172.21.15.5:0/2433479922 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1379349842 0 0) 0x7fbcec0035b0 con 0x7fbd040b0580 2023-10-16T13:38:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0259c700 1 -- 172.21.15.5:0/2433479922 >> v2:172.21.15.112:3300/0 conn(0x7fbd040d0530 msgr2=0x7fbd0406ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0259c700 1 --2- 172.21.15.5:0/2433479922 >> v2:172.21.15.112:3300/0 conn(0x7fbd040d0530 0x7fbd0406ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0259c700 1 -- 172.21.15.5:0/2433479922 >> v1:172.21.15.5:6789/0 conn(0x7fbd040b0580 legacy=0x7fbd040ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.895+0000 7fbd0259c700 1 -- 172.21.15.5:0/2433479922 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040cd4a0 con 0x7fbd0415f050 2023-10-16T13:38:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd0259c700 1 --2- 172.21.15.5:0/2433479922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0415f050 0x7fbd040cdba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009840 tx=0x7fbcf4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=404c157204f8d181 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd0159a700 1 -- 172.21.15.5:0/2433479922 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8001670 con 0x7fbd0415f050 2023-10-16T13:38:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd0159a700 1 -- 172.21.15.5:0/2433479922 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf4004030 con 0x7fbd0415f050 2023-10-16T13:38:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd0159a700 1 -- 172.21.15.5:0/2433479922 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40043c0 con 0x7fbd0415f050 2023-10-16T13:38:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 -- 172.21.15.5:0/2433479922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0415f050 msgr2=0x7fbd040cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/2433479922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0415f050 0x7fbd040cdba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009840 tx=0x7fbcf4009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 -- 172.21.15.5:0/2433479922 shutdown_connections 2023-10-16T13:38:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/2433479922 >> v2:172.21.15.112:3300/0 conn(0x7fbd040d0530 0x7fbd0406ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/2433479922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0415f050 0x7fbd040cdba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 -- 172.21.15.5:0/2433479922 >> 172.21.15.5:0/2433479922 conn(0x7fbd040d1620 msgr2=0x7fbd040d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 -- 172.21.15.5:0/2433479922 shutdown_connections 2023-10-16T13:38:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.896+0000 7fbd08d1b700 1 -- 172.21.15.5:0/2433479922 wait complete. 2023-10-16T13:38:23.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 Processor -- start 2023-10-16T13:38:23.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 -- start start 2023-10-16T13:38:23.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 0x7fbd0406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd0415f050 0x7fbd04154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0406d1a0 0x7fbd040c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0406be90 con 0x7fbd040b0580 2023-10-16T13:38:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0415c420 con 0x7fbd0415f050 2023-10-16T13:38:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.898+0000 7fbd08d1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0406c0c0 con 0x7fbd0406d1a0 2023-10-16T13:38:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 0x7fbd0406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 0x7fbd0406b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41816/0 (socket says 172.21.15.5:41816) 2023-10-16T13:38:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 -- 172.21.15.5:0/4165001199 learned_addr learned my addr 172.21.15.5:0/4165001199 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd02d9d700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0406d1a0 0x7fbd040c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd01d9b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd0415f050 0x7fbd04154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 -- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0406d1a0 msgr2=0x7fbd040c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0406d1a0 0x7fbd040c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 -- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd0415f050 msgr2=0x7fbd04154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd0415f050 0x7fbd04154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 -- 172.21.15.5:0/4165001199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40094a0 con 0x7fbd040b0580 2023-10-16T13:38:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd0259c700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 0x7fbd0406b950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40090b0 tx=0x7fbcf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4003e20 con 0x7fbd040b0580 2023-10-16T13:38:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf401f070 con 0x7fbd040b0580 2023-10-16T13:38:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0406c3a0 con 0x7fbd040b0580 2023-10-16T13:38:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4011870 con 0x7fbd040b0580 2023-10-16T13:38:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.899+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd040c8980 con 0x7fbd040b0580 2023-10-16T13:38:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.900+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0406c8c0 con 0x7fbd040b0580 2023-10-16T13:38:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.901+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbcf40119d0 con 0x7fbd040b0580 2023-10-16T13:38:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.901+0000 7fbcf2ffd700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbce406af00 0x7fbce406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.901+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcf4021070 con 0x7fbd040b0580 2023-10-16T13:38:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.901+0000 7fbd01d9b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbce406af00 0x7fbce406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.902+0000 7fbd01d9b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbce406af00 0x7fbce406d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001eb0 tx=0x7fbcf8001c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:23.906+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd0406c8c0 con 0x7fbd040b0580 2023-10-16T13:38:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.102+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd0415f430 con 0x7fbce406af00 2023-10-16T13:38:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.109+0000 7fbcf2ffd700 1 -- 172.21.15.5:0/4165001199 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252741 (secure 0 0 0) 0x7fbcf8005df0 con 0x7fbce406af00 2023-10-16T13:38:24.116 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbce406af00 msgr2=0x7fbce406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbce406af00 0x7fbce406d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001eb0 tx=0x7fbcf8001c40 comp rx=0 tx=0).stop 2023-10-16T13:38:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 msgr2=0x7fbd0406b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 0x7fbd0406b950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40090b0 tx=0x7fbcf4004750 comp rx=0 tx=0).stop 2023-10-16T13:38:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 shutdown_connections 2023-10-16T13:38:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbce406af00 0x7fbce406d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd0406d1a0 0x7fbd040c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd040b0580 0x7fbd0406b950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 --2- 172.21.15.5:0/4165001199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd0415f050 0x7fbd04154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 >> 172.21.15.5:0/4165001199 conn(0x7fbd040d1620 msgr2=0x7fbd040c7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 shutdown_connections 2023-10-16T13:38:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.113+0000 7fbd08d1b700 1 -- 172.21.15.5:0/4165001199 wait complete. 2023-10-16T13:38:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:24.127 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-16T13:38:23.456794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":2449408,"data_stored":1556180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.509760"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946410+0000","last_change":"2023-10-16T13:38:17.946410+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946410+0000","last_undegraded":"2023-10-16T13:38:17.946410+0000","last_fullsized":"2023-10-16T13:38:17.946410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951182+0000","last_change":"2023-10-16T13:38:17.951182+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951182+0000","last_undegraded":"2023-10-16T13:38:17.951182+0000","last_fullsized":"2023-10-16T13:38:17.951182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949084+0000","last_change":"2023-10-16T13:38:17.949084+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949084+0000","last_undegraded":"2023-10-16T13:38:17.949084+0000","last_fullsized":"2023-10-16T13:38:17.949084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948787+0000","last_change":"2023-10-16T13:38:17.948787+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948787+0000","last_undegraded":"2023-10-16T13:38:17.948787+0000","last_fullsized":"2023-10-16T13:38:17.948787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.952814+0000","last_change":"2023-10-16T13:38:17.952814+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.952814+0000","last_undegraded":"2023-10-16T13:38:17.952814+0000","last_fullsized":"2023-10-16T13:38:17.952814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950131+0000","last_change":"2023-10-16T13:38:17.950131+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950131+0000","last_undegraded":"2023-10-16T13:38:17.950131+0000","last_fullsized":"2023-10-16T13:38:17.950131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.952031+0000","last_change":"2023-10-16T13:38:17.952031+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.952031+0000","last_undegraded":"2023-10-16T13:38:17.952031+0000","last_fullsized":"2023-10-16T13:38:17.952031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946404+0000","last_change":"2023-10-16T13:38:17.946404+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946404+0000","last_undegraded":"2023-10-16T13:38:17.946404+0000","last_fullsized":"2023-10-16T13:38:17.946404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951170+0000","last_change":"2023-10-16T13:38:17.951170+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951170+0000","last_undegraded":"2023-10-16T13:38:17.951170+0000","last_fullsized":"2023-10-16T13:38:17.951170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946401+0000","last_change":"2023-10-16T13:38:17.946401+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946401+0000","last_undegraded":"2023-10-16T13:38:17.946401+0000","last_fullsized":"2023-10-16T13:38:17.946401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950040+0000","last_change":"2023-10-16T13:38:17.950040+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950040+0000","last_undegraded":"2023-10-16T13:38:17.950040+0000","last_fullsized":"2023-10-16T13:38:17.950040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949934+0000","last_change":"2023-10-16T13:38:17.949934+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949934+0000","last_undegraded":"2023-10-16T13:38:17.949934+0000","last_fullsized":"2023-10-16T13:38:17.949934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946317+0000","last_change":"2023-10-16T13:38:17.946317+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946317+0000","last_undegraded":"2023-10-16T13:38:17.946317+0000","last_fullsized":"2023-10-16T13:38:17.946317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.947090+0000","last_change":"2023-10-16T13:38:17.947090+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.947090+0000","last_undegraded":"2023-10-16T13:38:17.947090+0000","last_fullsized":"2023-10-16T13:38:17.947090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949972+0000","last_change":"2023-10-16T13:38:17.949972+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949972+0000","last_undegraded":"2023-10-16T13:38:17.949972+0000","last_fullsized":"2023-10-16T13:38:17.949972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950901+0000","last_change":"2023-10-16T13:38:17.950901+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950901+0000","last_undegraded":"2023-10-16T13:38:17.950901+0000","last_fullsized":"2023-10-16T13:38:17.950901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949954+0000","last_change":"2023-10-16T13:38:17.949954+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949954+0000","last_undegraded":"2023-10-16T13:38:17.949954+0000","last_fullsized":"2023-10-16T13:38:17.949954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949312+0000","last_change":"2023-10-16T13:38:17.949312+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949312+0000","last_undegraded":"2023-10-16T13:38:17.949312+0000","last_fullsized":"2023-10-16T13:38:17.949312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946413+0000","last_change":"2023-10-16T13:38:17.946413+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946413+0000","last_undegraded":"2023-10-16T13:38:17.946413+0000","last_fullsized":"2023-10-16T13:38:17.946413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950756+0000","last_change":"2023-10-16T13:38:17.950756+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950756+0000","last_undegraded":"2023-10-16T13:38:17.950756+0000","last_fullsized":"2023-10-16T13:38:17.950756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946410+0000","last_change":"2023-10-16T13:38:17.946410+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946410+0000","last_undegraded":"2023-10-16T13:38:17.946410+0000","last_fullsized":"2023-10-16T13:38:17.946410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T13:38:17.945857+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:17.945857+0000","last_peered":"2023-10-16T13:38:17.945857+0000","last_clean":"2023-10-16T13:38:17.945857+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:17.945857+0000","last_undegraded":"2023-10-16T13:38:17.945857+0000","last_fullsized":"2023-10-16T13:38:17.945857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948569+0000","last_change":"2023-10-16T13:38:17.948569+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948569+0000","last_undegraded":"2023-10-16T13:38:17.948569+0000","last_fullsized":"2023-10-16T13:38:17.948569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948424+0000","last_change":"2023-10-16T13:38:17.948424+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948424+0000","last_undegraded":"2023-10-16T13:38:17.948424+0000","last_fullsized":"2023-10-16T13:38:17.948424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949347+0000","last_change":"2023-10-16T13:38:17.949347+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949347+0000","last_undegraded":"2023-10-16T13:38:17.949347+0000","last_fullsized":"2023-10-16T13:38:17.949347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950490+0000","last_change":"2023-10-16T13:38:17.950490+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950490+0000","last_undegraded":"2023-10-16T13:38:17.950490+0000","last_fullsized":"2023-10-16T13:38:17.950490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949089+0000","last_change":"2023-10-16T13:38:17.949089+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949089+0000","last_undegraded":"2023-10-16T13:38:17.949089+0000","last_fullsized":"2023-10-16T13:38:17.949089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949768+0000","last_change":"2023-10-16T13:38:17.949768+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949768+0000","last_undegraded":"2023-10-16T13:38:17.949768+0000","last_fullsized":"2023-10-16T13:38:17.949768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949480+0000","last_change":"2023-10-16T13:38:17.949480+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949480+0000","last_undegraded":"2023-10-16T13:38:17.949480+0000","last_fullsized":"2023-10-16T13:38:17.949480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948444+0000","last_change":"2023-10-16T13:38:17.948444+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948444+0000","last_undegraded":"2023-10-16T13:38:17.948444+0000","last_fullsized":"2023-10-16T13:38:17.948444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950890+0000","last_change":"2023-10-16T13:38:17.950890+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950890+0000","last_undegraded":"2023-10-16T13:38:17.950890+0000","last_fullsized":"2023-10-16T13:38:17.950890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949424+0000","last_change":"2023-10-16T13:38:17.949424+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949424+0000","last_undegraded":"2023-10-16T13:38:17.949424+0000","last_fullsized":"2023-10-16T13:38:17.949424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951649+0000","last_change":"2023-10-16T13:38:17.951649+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951649+0000","last_undegraded":"2023-10-16T13:38:17.951649+0000","last_fullsized":"2023-10-16T13:38:17.951649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":635080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":50529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:24.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.291+0000 7f14da7df700 1 Processor -- start 2023-10-16T13:38:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.291+0000 7f14da7df700 1 -- start start 2023-10-16T13:38:24.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14da7df700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f14d40cd950 0x7f14d415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14da7df700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14d406a840 0x7f14d406ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14da7df700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40cf290 con 0x7f14d40cede0 2023-10-16T13:38:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14da7df700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d41619a0 con 0x7f14d406a840 2023-10-16T13:38:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14da7df700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d406b1b0 con 0x7f14d40cd950 2023-10-16T13:38:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14d8d7c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14d406a840 0x7f14d406ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14d8d7c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14d406a840 0x7f14d406ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41828/0 (socket says 172.21.15.5:41828) 2023-10-16T13:38:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14d8d7c700 1 -- 172.21.15.5:0/3188816030 learned_addr learned my addr 172.21.15.5:0/3188816030 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.292+0000 7f14d3fff700 1 --2- 172.21.15.5:0/3188816030 >> v2:172.21.15.112:3300/0 conn(0x7f14d40cd950 0x7f14d415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d8d7c700 1 -- 172.21.15.5:0/3188816030 >> v2:172.21.15.112:3300/0 conn(0x7f14d40cd950 msgr2=0x7f14d415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d8d7c700 1 --2- 172.21.15.5:0/3188816030 >> v2:172.21.15.112:3300/0 conn(0x7f14d40cd950 0x7f14d415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d8d7c700 1 -- 172.21.15.5:0/3188816030 >> v1:172.21.15.112:6789/0 conn(0x7f14d40cede0 legacy=0x7f14d415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d8d7c700 1 -- 172.21.15.5:0/3188816030 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40b2d60 con 0x7f14d406a840 2023-10-16T13:38:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d8d7c700 1 --2- 172.21.15.5:0/3188816030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d406a840 0x7f14d406ac70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14d40d0430 tx=0x7f14cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8ecef1413118b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d2ffd700 1 -- 172.21.15.5:0/3188816030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00e070 con 0x7f14d406a840 2023-10-16T13:38:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d2ffd700 1 -- 172.21.15.5:0/3188816030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc00b910 con 0x7f14d406a840 2023-10-16T13:38:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14d2ffd700 1 -- 172.21.15.5:0/3188816030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00bcc0 con 0x7f14d406a840 2023-10-16T13:38:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14da7df700 1 -- 172.21.15.5:0/3188816030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d406a840 msgr2=0x7f14d406ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14da7df700 1 --2- 172.21.15.5:0/3188816030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d406a840 0x7f14d406ac70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14d40d0430 tx=0x7f14cc00b330 comp rx=0 tx=0).stop 2023-10-16T13:38:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14da7df700 1 -- 172.21.15.5:0/3188816030 shutdown_connections 2023-10-16T13:38:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14da7df700 1 --2- 172.21.15.5:0/3188816030 >> v2:172.21.15.112:3300/0 conn(0x7f14d40cd950 0x7f14d415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14da7df700 1 --2- 172.21.15.5:0/3188816030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d406a840 0x7f14d406ac70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.293+0000 7f14da7df700 1 -- 172.21.15.5:0/3188816030 >> 172.21.15.5:0/3188816030 conn(0x7f14d406dae0 msgr2=0x7f14d406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.294+0000 7f14da7df700 1 -- 172.21.15.5:0/3188816030 shutdown_connections 2023-10-16T13:38:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.294+0000 7f14da7df700 1 -- 172.21.15.5:0/3188816030 wait complete. 2023-10-16T13:38:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.295+0000 7f14da7df700 1 Processor -- start 2023-10-16T13:38:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.295+0000 7f14da7df700 1 -- start start 2023-10-16T13:38:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14d406a840 0x7f14d40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 0x7f14d40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14d40cede0 0x7f14d41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41f6de0 con 0x7f14d40cd950 2023-10-16T13:38:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41f70c0 con 0x7f14d40cede0 2023-10-16T13:38:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41f73a0 con 0x7f14d406a840 2023-10-16T13:38:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 0x7f14d40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 0x7f14d40b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41832/0 (socket says 172.21.15.5:41832) 2023-10-16T13:38:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 -- 172.21.15.5:0/981782716 learned_addr learned my addr 172.21.15.5:0/981782716 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d8d7c700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14d40cede0 0x7f14d41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d3fff700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14d406a840 0x7f14d40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 -- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14d406a840 msgr2=0x7f14d40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14d406a840 0x7f14d40c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 -- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14d40cede0 msgr2=0x7f14d41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14d40cede0 0x7f14d41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 -- 172.21.15.5:0/981782716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009b30 con 0x7f14d40cd950 2023-10-16T13:38:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d37fe700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 0x7f14d40b32f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14c400c4d0 tx=0x7f14c400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c40052d0 con 0x7f14d40cd950 2023-10-16T13:38:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c4005430 con 0x7f14d40cd950 2023-10-16T13:38:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d41f7680 con 0x7f14d40cd950 2023-10-16T13:38:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.296+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c40038f0 con 0x7f14d40cd950 2023-10-16T13:38:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.297+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d40c7010 con 0x7f14d40cd950 2023-10-16T13:38:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.298+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d4067d20 con 0x7f14d40cd950 2023-10-16T13:38:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.298+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14c4003a50 con 0x7f14d40cd950 2023-10-16T13:38:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.298+0000 7f14d0ff9700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f14b406af00 0x7f14b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.298+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c4088930 con 0x7f14d40cd950 2023-10-16T13:38:24.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.299+0000 7f14d3fff700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f14b406af00 0x7f14b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.299+0000 7f14d3fff700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f14b406af00 0x7f14b406d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009be0 tx=0x7f14bc009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:24.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.303+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14c40539e0 con 0x7f14d40cd950 2023-10-16T13:38:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.502+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14d41f7230 con 0x7f14b406af00 2023-10-16T13:38:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.509+0000 7f14d0ff9700 1 -- 172.21.15.5:0/981782716 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252741 (secure 0 0 0) 0x7f14d41f7230 con 0x7f14b406af00 2023-10-16T13:38:24.515 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f14b406af00 msgr2=0x7f14b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f14b406af00 0x7f14b406d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009be0 tx=0x7f14bc009210 comp rx=0 tx=0).stop 2023-10-16T13:38:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 msgr2=0x7f14d40b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 0x7f14d40b32f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14c400c4d0 tx=0x7f14c400c7e0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 shutdown_connections 2023-10-16T13:38:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14d40cede0 0x7f14d41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f14b406af00 0x7f14b406d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14d406a840 0x7f14d40c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 --2- 172.21.15.5:0/981782716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d40cd950 0x7f14d40b32f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.512+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 >> 172.21.15.5:0/981782716 conn(0x7f14d406dae0 msgr2=0x7f14d4160ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.513+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 shutdown_connections 2023-10-16T13:38:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.513+0000 7f14da7df700 1 -- 172.21.15.5:0/981782716 wait complete. 2023-10-16T13:38:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:24.527 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-16T13:38:23.456794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":2449408,"data_stored":1556180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.509760"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946410+0000","last_change":"2023-10-16T13:38:17.946410+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946410+0000","last_undegraded":"2023-10-16T13:38:17.946410+0000","last_fullsized":"2023-10-16T13:38:17.946410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951182+0000","last_change":"2023-10-16T13:38:17.951182+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951182+0000","last_undegraded":"2023-10-16T13:38:17.951182+0000","last_fullsized":"2023-10-16T13:38:17.951182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949084+0000","last_change":"2023-10-16T13:38:17.949084+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949084+0000","last_undegraded":"2023-10-16T13:38:17.949084+0000","last_fullsized":"2023-10-16T13:38:17.949084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948787+0000","last_change":"2023-10-16T13:38:17.948787+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948787+0000","last_undegraded":"2023-10-16T13:38:17.948787+0000","last_fullsized":"2023-10-16T13:38:17.948787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.952814+0000","last_change":"2023-10-16T13:38:17.952814+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.952814+0000","last_undegraded":"2023-10-16T13:38:17.952814+0000","last_fullsized":"2023-10-16T13:38:17.952814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950131+0000","last_change":"2023-10-16T13:38:17.950131+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950131+0000","last_undegraded":"2023-10-16T13:38:17.950131+0000","last_fullsized":"2023-10-16T13:38:17.950131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.952031+0000","last_change":"2023-10-16T13:38:17.952031+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.952031+0000","last_undegraded":"2023-10-16T13:38:17.952031+0000","last_fullsized":"2023-10-16T13:38:17.952031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946404+0000","last_change":"2023-10-16T13:38:17.946404+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946404+0000","last_undegraded":"2023-10-16T13:38:17.946404+0000","last_fullsized":"2023-10-16T13:38:17.946404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951170+0000","last_change":"2023-10-16T13:38:17.951170+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951170+0000","last_undegraded":"2023-10-16T13:38:17.951170+0000","last_fullsized":"2023-10-16T13:38:17.951170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946401+0000","last_change":"2023-10-16T13:38:17.946401+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946401+0000","last_undegraded":"2023-10-16T13:38:17.946401+0000","last_fullsized":"2023-10-16T13:38:17.946401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950040+0000","last_change":"2023-10-16T13:38:17.950040+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950040+0000","last_undegraded":"2023-10-16T13:38:17.950040+0000","last_fullsized":"2023-10-16T13:38:17.950040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949934+0000","last_change":"2023-10-16T13:38:17.949934+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949934+0000","last_undegraded":"2023-10-16T13:38:17.949934+0000","last_fullsized":"2023-10-16T13:38:17.949934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946317+0000","last_change":"2023-10-16T13:38:17.946317+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946317+0000","last_undegraded":"2023-10-16T13:38:17.946317+0000","last_fullsized":"2023-10-16T13:38:17.946317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.947090+0000","last_change":"2023-10-16T13:38:17.947090+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.947090+0000","last_undegraded":"2023-10-16T13:38:17.947090+0000","last_fullsized":"2023-10-16T13:38:17.947090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949972+0000","last_change":"2023-10-16T13:38:17.949972+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949972+0000","last_undegraded":"2023-10-16T13:38:17.949972+0000","last_fullsized":"2023-10-16T13:38:17.949972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950901+0000","last_change":"2023-10-16T13:38:17.950901+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950901+0000","last_undegraded":"2023-10-16T13:38:17.950901+0000","last_fullsized":"2023-10-16T13:38:17.950901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949954+0000","last_change":"2023-10-16T13:38:17.949954+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949954+0000","last_undegraded":"2023-10-16T13:38:17.949954+0000","last_fullsized":"2023-10-16T13:38:17.949954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949312+0000","last_change":"2023-10-16T13:38:17.949312+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949312+0000","last_undegraded":"2023-10-16T13:38:17.949312+0000","last_fullsized":"2023-10-16T13:38:17.949312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946413+0000","last_change":"2023-10-16T13:38:17.946413+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946413+0000","last_undegraded":"2023-10-16T13:38:17.946413+0000","last_fullsized":"2023-10-16T13:38:17.946413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950756+0000","last_change":"2023-10-16T13:38:17.950756+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950756+0000","last_undegraded":"2023-10-16T13:38:17.950756+0000","last_fullsized":"2023-10-16T13:38:17.950756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946410+0000","last_change":"2023-10-16T13:38:17.946410+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946410+0000","last_undegraded":"2023-10-16T13:38:17.946410+0000","last_fullsized":"2023-10-16T13:38:17.946410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T13:38:17.945857+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:17.945857+0000","last_peered":"2023-10-16T13:38:17.945857+0000","last_clean":"2023-10-16T13:38:17.945857+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:17.945857+0000","last_undegraded":"2023-10-16T13:38:17.945857+0000","last_fullsized":"2023-10-16T13:38:17.945857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948569+0000","last_change":"2023-10-16T13:38:17.948569+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948569+0000","last_undegraded":"2023-10-16T13:38:17.948569+0000","last_fullsized":"2023-10-16T13:38:17.948569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948424+0000","last_change":"2023-10-16T13:38:17.948424+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948424+0000","last_undegraded":"2023-10-16T13:38:17.948424+0000","last_fullsized":"2023-10-16T13:38:17.948424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949347+0000","last_change":"2023-10-16T13:38:17.949347+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949347+0000","last_undegraded":"2023-10-16T13:38:17.949347+0000","last_fullsized":"2023-10-16T13:38:17.949347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950490+0000","last_change":"2023-10-16T13:38:17.950490+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950490+0000","last_undegraded":"2023-10-16T13:38:17.950490+0000","last_fullsized":"2023-10-16T13:38:17.950490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949089+0000","last_change":"2023-10-16T13:38:17.949089+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949089+0000","last_undegraded":"2023-10-16T13:38:17.949089+0000","last_fullsized":"2023-10-16T13:38:17.949089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949768+0000","last_change":"2023-10-16T13:38:17.949768+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949768+0000","last_undegraded":"2023-10-16T13:38:17.949768+0000","last_fullsized":"2023-10-16T13:38:17.949768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949480+0000","last_change":"2023-10-16T13:38:17.949480+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949480+0000","last_undegraded":"2023-10-16T13:38:17.949480+0000","last_fullsized":"2023-10-16T13:38:17.949480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948444+0000","last_change":"2023-10-16T13:38:17.948444+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948444+0000","last_undegraded":"2023-10-16T13:38:17.948444+0000","last_fullsized":"2023-10-16T13:38:17.948444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950890+0000","last_change":"2023-10-16T13:38:17.950890+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950890+0000","last_undegraded":"2023-10-16T13:38:17.950890+0000","last_fullsized":"2023-10-16T13:38:17.950890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949424+0000","last_change":"2023-10-16T13:38:17.949424+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949424+0000","last_undegraded":"2023-10-16T13:38:17.949424+0000","last_fullsized":"2023-10-16T13:38:17.949424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951649+0000","last_change":"2023-10-16T13:38:17.951649+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951649+0000","last_undegraded":"2023-10-16T13:38:17.951649+0000","last_fullsized":"2023-10-16T13:38:17.951649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":635080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":50529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:24.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.689+0000 7f7fee3cb700 1 Processor -- start 2023-10-16T13:38:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fee3cb700 1 -- start start 2023-10-16T13:38:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fee3cb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fe815f130 0x7f7fe80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fee3cb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80b3530 con 0x7f7fe80b28b0 2023-10-16T13:38:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fee3cb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80cd180 con 0x7f7fe806af50 2023-10-16T13:38:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fee3cb700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe80cde00 con 0x7f7fe815f130 2023-10-16T13:38:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fe77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7fe80b28b0 0x7f7fe806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51842/0 (socket says 172.21.15.5:51842) 2023-10-16T13:38:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.690+0000 7f7fe77fe700 1 -- 172.21.15.5:0/2529908819 learned_addr learned my addr 172.21.15.5:0/2529908819 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe7fff700 1 --2- 172.21.15.5:0/2529908819 >> v2:172.21.15.112:3300/0 conn(0x7f7fe815f130 0x7f7fe80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe6ffd700 1 -- 172.21.15.5:0/2529908819 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448017974 0 0) 0x7f7fe80b3530 con 0x7f7fe80b28b0 2023-10-16T13:38:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe6ffd700 1 -- 172.21.15.5:0/2529908819 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd40035b0 con 0x7f7fe80b28b0 2023-10-16T13:38:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe7fff700 1 -- 172.21.15.5:0/2529908819 >> v1:172.21.15.112:6789/0 conn(0x7f7fe806af50 legacy=0x7f7fe80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe7fff700 1 -- 172.21.15.5:0/2529908819 >> v1:172.21.15.5:6789/0 conn(0x7f7fe80b28b0 legacy=0x7f7fe806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe7fff700 1 -- 172.21.15.5:0/2529908819 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80cd460 con 0x7f7fe815f130 2023-10-16T13:38:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe7fff700 1 --2- 172.21.15.5:0/2529908819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80cede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009840 tx=0x7f7fd8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee6b219d3d2ed513 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe6ffd700 1 -- 172.21.15.5:0/2529908819 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8011830 con 0x7f7fe815f130 2023-10-16T13:38:24.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe6ffd700 1 -- 172.21.15.5:0/2529908819 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8011990 con 0x7f7fe815f130 2023-10-16T13:38:24.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.691+0000 7f7fe6ffd700 1 -- 172.21.15.5:0/2529908819 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8011d00 con 0x7f7fe815f130 2023-10-16T13:38:24.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 -- 172.21.15.5:0/2529908819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 msgr2=0x7f7fe80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/2529908819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80cede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009840 tx=0x7f7fd8009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:24.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 -- 172.21.15.5:0/2529908819 shutdown_connections 2023-10-16T13:38:24.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/2529908819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80cede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 -- 172.21.15.5:0/2529908819 >> 172.21.15.5:0/2529908819 conn(0x7f7fe806dae0 msgr2=0x7f7fe806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:24.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 -- 172.21.15.5:0/2529908819 shutdown_connections 2023-10-16T13:38:24.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.692+0000 7f7fee3cb700 1 -- 172.21.15.5:0/2529908819 wait complete. 2023-10-16T13:38:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.693+0000 7f7fee3cb700 1 Processor -- start 2023-10-16T13:38:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.694+0000 7f7fee3cb700 1 -- start start 2023-10-16T13:38:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 0x7f7fe80c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fe80b28b0 0x7f7fe80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80cbcc0 con 0x7f7fe806af50 2023-10-16T13:38:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80cb6e0 con 0x7f7fe815f130 2023-10-16T13:38:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80ad420 con 0x7f7fe80b28b0 2023-10-16T13:38:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 0x7f7fe80c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 0x7f7fe80c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41844/0 (socket says 172.21.15.5:41844) 2023-10-16T13:38:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 -- 172.21.15.5:0/509570244 learned_addr learned my addr 172.21.15.5:0/509570244 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe77fe700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fe80b28b0 0x7f7fe80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fec968700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 -- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fe80b28b0 msgr2=0x7f7fe80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fe80b28b0 0x7f7fe80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 -- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 msgr2=0x7f7fe80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 -- 172.21.15.5:0/509570244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80094a0 con 0x7f7fe806af50 2023-10-16T13:38:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe7fff700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 0x7f7fe80c85f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009fd0 tx=0x7f7fd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8004550 con 0x7f7fe806af50 2023-10-16T13:38:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd801f070 con 0x7f7fe806af50 2023-10-16T13:38:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe80ad700 con 0x7f7fe806af50 2023-10-16T13:38:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80038c0 con 0x7f7fe806af50 2023-10-16T13:38:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.695+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81f6c10 con 0x7f7fe806af50 2023-10-16T13:38:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.696+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe80b30f0 con 0x7f7fe806af50 2023-10-16T13:38:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.697+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7fd8003a20 con 0x7f7fe806af50 2023-10-16T13:38:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.697+0000 7f7fe4ff9700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7fc806af00 0x7f7fc806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.697+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fd8021070 con 0x7f7fe806af50 2023-10-16T13:38:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.698+0000 7f7fe77fe700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7fc806af00 0x7f7fc806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.698+0000 7f7fe77fe700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7fc806af00 0x7f7fc806d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80ca5a0 tx=0x7f7fd0007c70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.702+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fd8055ec0 con 0x7f7fe806af50 2023-10-16T13:38:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.897+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fe80cda20 con 0x7f7fc806af00 2023-10-16T13:38:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.904+0000 7f7fe4ff9700 1 -- 172.21.15.5:0/509570244 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252741 (secure 0 0 0) 0x7f7fd0005830 con 0x7f7fc806af00 2023-10-16T13:38:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7fc806af00 msgr2=0x7f7fc806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7fc806af00 0x7f7fc806d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80ca5a0 tx=0x7f7fd0007c70 comp rx=0 tx=0).stop 2023-10-16T13:38:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 msgr2=0x7f7fe80c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 0x7f7fe80c85f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009fd0 tx=0x7f7fd8004750 comp rx=0 tx=0).stop 2023-10-16T13:38:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 shutdown_connections 2023-10-16T13:38:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fe815f130 0x7f7fe80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fe806af50 0x7f7fe80c85f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7fc806af00 0x7f7fc806d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 --2- 172.21.15.5:0/509570244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fe80b28b0 0x7f7fe80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 >> 172.21.15.5:0/509570244 conn(0x7f7fe806dae0 msgr2=0x7f7fe815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 shutdown_connections 2023-10-16T13:38:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:24.908+0000 7f7fee3cb700 1 -- 172.21.15.5:0/509570244 wait complete. 2023-10-16T13:38:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:24.922 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-16T13:38:23.456794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":2449408,"data_stored":1556180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.509760"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946410+0000","last_change":"2023-10-16T13:38:17.946410+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946410+0000","last_undegraded":"2023-10-16T13:38:17.946410+0000","last_fullsized":"2023-10-16T13:38:17.946410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951182+0000","last_change":"2023-10-16T13:38:17.951182+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951182+0000","last_undegraded":"2023-10-16T13:38:17.951182+0000","last_fullsized":"2023-10-16T13:38:17.951182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949084+0000","last_change":"2023-10-16T13:38:17.949084+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949084+0000","last_undegraded":"2023-10-16T13:38:17.949084+0000","last_fullsized":"2023-10-16T13:38:17.949084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948787+0000","last_change":"2023-10-16T13:38:17.948787+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948787+0000","last_undegraded":"2023-10-16T13:38:17.948787+0000","last_fullsized":"2023-10-16T13:38:17.948787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.952814+0000","last_change":"2023-10-16T13:38:17.952814+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.952814+0000","last_undegraded":"2023-10-16T13:38:17.952814+0000","last_fullsized":"2023-10-16T13:38:17.952814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950131+0000","last_change":"2023-10-16T13:38:17.950131+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950131+0000","last_undegraded":"2023-10-16T13:38:17.950131+0000","last_fullsized":"2023-10-16T13:38:17.950131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.952031+0000","last_change":"2023-10-16T13:38:17.952031+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.952031+0000","last_undegraded":"2023-10-16T13:38:17.952031+0000","last_fullsized":"2023-10-16T13:38:17.952031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946404+0000","last_change":"2023-10-16T13:38:17.946404+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946404+0000","last_undegraded":"2023-10-16T13:38:17.946404+0000","last_fullsized":"2023-10-16T13:38:17.946404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951170+0000","last_change":"2023-10-16T13:38:17.951170+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951170+0000","last_undegraded":"2023-10-16T13:38:17.951170+0000","last_fullsized":"2023-10-16T13:38:17.951170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946401+0000","last_change":"2023-10-16T13:38:17.946401+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946401+0000","last_undegraded":"2023-10-16T13:38:17.946401+0000","last_fullsized":"2023-10-16T13:38:17.946401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950040+0000","last_change":"2023-10-16T13:38:17.950040+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950040+0000","last_undegraded":"2023-10-16T13:38:17.950040+0000","last_fullsized":"2023-10-16T13:38:17.950040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949934+0000","last_change":"2023-10-16T13:38:17.949934+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949934+0000","last_undegraded":"2023-10-16T13:38:17.949934+0000","last_fullsized":"2023-10-16T13:38:17.949934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946317+0000","last_change":"2023-10-16T13:38:17.946317+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946317+0000","last_undegraded":"2023-10-16T13:38:17.946317+0000","last_fullsized":"2023-10-16T13:38:17.946317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.947090+0000","last_change":"2023-10-16T13:38:17.947090+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.947090+0000","last_undegraded":"2023-10-16T13:38:17.947090+0000","last_fullsized":"2023-10-16T13:38:17.947090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949972+0000","last_change":"2023-10-16T13:38:17.949972+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949972+0000","last_undegraded":"2023-10-16T13:38:17.949972+0000","last_fullsized":"2023-10-16T13:38:17.949972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950901+0000","last_change":"2023-10-16T13:38:17.950901+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950901+0000","last_undegraded":"2023-10-16T13:38:17.950901+0000","last_fullsized":"2023-10-16T13:38:17.950901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949954+0000","last_change":"2023-10-16T13:38:17.949954+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949954+0000","last_undegraded":"2023-10-16T13:38:17.949954+0000","last_fullsized":"2023-10-16T13:38:17.949954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949312+0000","last_change":"2023-10-16T13:38:17.949312+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949312+0000","last_undegraded":"2023-10-16T13:38:17.949312+0000","last_fullsized":"2023-10-16T13:38:17.949312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946413+0000","last_change":"2023-10-16T13:38:17.946413+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946413+0000","last_undegraded":"2023-10-16T13:38:17.946413+0000","last_fullsized":"2023-10-16T13:38:17.946413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950756+0000","last_change":"2023-10-16T13:38:17.950756+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950756+0000","last_undegraded":"2023-10-16T13:38:17.950756+0000","last_fullsized":"2023-10-16T13:38:17.950756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.946410+0000","last_change":"2023-10-16T13:38:17.946410+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.946410+0000","last_undegraded":"2023-10-16T13:38:17.946410+0000","last_fullsized":"2023-10-16T13:38:17.946410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T13:38:17.945857+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:17.945857+0000","last_peered":"2023-10-16T13:38:17.945857+0000","last_clean":"2023-10-16T13:38:17.945857+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:17.945857+0000","last_undegraded":"2023-10-16T13:38:17.945857+0000","last_fullsized":"2023-10-16T13:38:17.945857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948569+0000","last_change":"2023-10-16T13:38:17.948569+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948569+0000","last_undegraded":"2023-10-16T13:38:17.948569+0000","last_fullsized":"2023-10-16T13:38:17.948569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948424+0000","last_change":"2023-10-16T13:38:17.948424+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948424+0000","last_undegraded":"2023-10-16T13:38:17.948424+0000","last_fullsized":"2023-10-16T13:38:17.948424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949347+0000","last_change":"2023-10-16T13:38:17.949347+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949347+0000","last_undegraded":"2023-10-16T13:38:17.949347+0000","last_fullsized":"2023-10-16T13:38:17.949347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950490+0000","last_change":"2023-10-16T13:38:17.950490+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950490+0000","last_undegraded":"2023-10-16T13:38:17.950490+0000","last_fullsized":"2023-10-16T13:38:17.950490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949089+0000","last_change":"2023-10-16T13:38:17.949089+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949089+0000","last_undegraded":"2023-10-16T13:38:17.949089+0000","last_fullsized":"2023-10-16T13:38:17.949089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949768+0000","last_change":"2023-10-16T13:38:17.949768+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949768+0000","last_undegraded":"2023-10-16T13:38:17.949768+0000","last_fullsized":"2023-10-16T13:38:17.949768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949480+0000","last_change":"2023-10-16T13:38:17.949480+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949480+0000","last_undegraded":"2023-10-16T13:38:17.949480+0000","last_fullsized":"2023-10-16T13:38:17.949480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.948444+0000","last_change":"2023-10-16T13:38:17.948444+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.948444+0000","last_undegraded":"2023-10-16T13:38:17.948444+0000","last_fullsized":"2023-10-16T13:38:17.948444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.950890+0000","last_change":"2023-10-16T13:38:17.950890+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.950890+0000","last_undegraded":"2023-10-16T13:38:17.950890+0000","last_fullsized":"2023-10-16T13:38:17.950890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.949424+0000","last_change":"2023-10-16T13:38:17.949424+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.949424+0000","last_undegraded":"2023-10-16T13:38:17.949424+0000","last_fullsized":"2023-10-16T13:38:17.949424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-10-16T13:38:17.951649+0000","last_change":"2023-10-16T13:38:17.951649+0000","last_active":"2023-10-16T13:38:17.939845+0000","last_peered":"2023-10-16T13:38:17.939845+0000","last_clean":"2023-10-16T13:38:17.939845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:17.951649+0000","last_undegraded":"2023-10-16T13:38:17.951649+0000","last_fullsized":"2023-10-16T13:38:17.951649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:38:18.943624+0000","last_change":"2023-10-16T13:38:18.943624+0000","last_active":"2023-10-16T13:38:18.943624+0000","last_peered":"2023-10-16T13:38:18.943624+0000","last_clean":"2023-10-16T13:38:18.943624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:38:18.943624+0000","last_undegraded":"2023-10-16T13:38:18.943624+0000","last_fullsized":"2023-10-16T13:38:18.943624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":635080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":50529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:24.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-16T13:38:24.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-16T13:38:24.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-16T13:38:24.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-16T13:38:24.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-16T13:38:24.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-16T13:38:24.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-16T13:38:24.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-16T13:38:24.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-16T13:38:24.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-16T13:38:24.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-16T13:38:24.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-16T13:38:24.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-16T13:38:24.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-16T13:38:24.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-16T13:38:24.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-16T13:38:24.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-16T13:38:24.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-16T13:38:24.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-16T13:38:24.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-10-16T13:38:24.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.946410+0000', 'last_change': '2023-10-16T13:38:17.946410+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.946410+0000', 'last_undegraded': '2023-10-16T13:38:17.946410+0000', 'last_fullsized': '2023-10-16T13:38:17.946410+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:38:24.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-16T13:38:24.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-10-16T13:38:24.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.951182+0000', 'last_change': '2023-10-16T13:38:17.951182+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.951182+0000', 'last_undegraded': '2023-10-16T13:38:17.951182+0000', 'last_fullsized': '2023-10-16T13:38:17.951182+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:38:24.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-16T13:38:24.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-10-16T13:38:24.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949084+0000', 'last_change': '2023-10-16T13:38:17.949084+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949084+0000', 'last_undegraded': '2023-10-16T13:38:17.949084+0000', 'last_fullsized': '2023-10-16T13:38:17.949084+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:38:24.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-16T13:38:24.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-10-16T13:38:24.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.948787+0000', 'last_change': '2023-10-16T13:38:17.948787+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.948787+0000', 'last_undegraded': '2023-10-16T13:38:17.948787+0000', 'last_fullsized': '2023-10-16T13:38:17.948787+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:38:24.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-16T13:38:24.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-10-16T13:38:24.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.952814+0000', 'last_change': '2023-10-16T13:38:17.952814+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.952814+0000', 'last_undegraded': '2023-10-16T13:38:17.952814+0000', 'last_fullsized': '2023-10-16T13:38:17.952814+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:38:24.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-16T13:38:24.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-10-16T13:38:24.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.950131+0000', 'last_change': '2023-10-16T13:38:17.950131+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.950131+0000', 'last_undegraded': '2023-10-16T13:38:17.950131+0000', 'last_fullsized': '2023-10-16T13:38:17.950131+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:38:24.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-16T13:38:24.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-10-16T13:38:24.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.952031+0000', 'last_change': '2023-10-16T13:38:17.952031+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.952031+0000', 'last_undegraded': '2023-10-16T13:38:17.952031+0000', 'last_fullsized': '2023-10-16T13:38:17.952031+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:38:24.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-16T13:38:24.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-10-16T13:38:24.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.946404+0000', 'last_change': '2023-10-16T13:38:17.946404+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.946404+0000', 'last_undegraded': '2023-10-16T13:38:17.946404+0000', 'last_fullsized': '2023-10-16T13:38:17.946404+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:38:24.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-16T13:38:24.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-10-16T13:38:24.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.951170+0000', 'last_change': '2023-10-16T13:38:17.951170+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.951170+0000', 'last_undegraded': '2023-10-16T13:38:17.951170+0000', 'last_fullsized': '2023-10-16T13:38:17.951170+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:38:24.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-16T13:38:24.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-10-16T13:38:24.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.946401+0000', 'last_change': '2023-10-16T13:38:17.946401+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.946401+0000', 'last_undegraded': '2023-10-16T13:38:17.946401+0000', 'last_fullsized': '2023-10-16T13:38:17.946401+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:38:24.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-16T13:38:24.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-10-16T13:38:24.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.950040+0000', 'last_change': '2023-10-16T13:38:17.950040+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.950040+0000', 'last_undegraded': '2023-10-16T13:38:17.950040+0000', 'last_fullsized': '2023-10-16T13:38:17.950040+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:38:24.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-16T13:38:24.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-10-16T13:38:24.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949934+0000', 'last_change': '2023-10-16T13:38:17.949934+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949934+0000', 'last_undegraded': '2023-10-16T13:38:17.949934+0000', 'last_fullsized': '2023-10-16T13:38:17.949934+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:38:24.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-16T13:38:24.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-10-16T13:38:24.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.946317+0000', 'last_change': '2023-10-16T13:38:17.946317+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.946317+0000', 'last_undegraded': '2023-10-16T13:38:17.946317+0000', 'last_fullsized': '2023-10-16T13:38:17.946317+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:38:24.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-16T13:38:24.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-10-16T13:38:24.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.947090+0000', 'last_change': '2023-10-16T13:38:17.947090+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.947090+0000', 'last_undegraded': '2023-10-16T13:38:17.947090+0000', 'last_fullsized': '2023-10-16T13:38:17.947090+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:38:24.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-16T13:38:24.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-10-16T13:38:24.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949972+0000', 'last_change': '2023-10-16T13:38:17.949972+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949972+0000', 'last_undegraded': '2023-10-16T13:38:17.949972+0000', 'last_fullsized': '2023-10-16T13:38:17.949972+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:38:24.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-16T13:38:24.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-10-16T13:38:24.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.950901+0000', 'last_change': '2023-10-16T13:38:17.950901+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.950901+0000', 'last_undegraded': '2023-10-16T13:38:17.950901+0000', 'last_fullsized': '2023-10-16T13:38:17.950901+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:38:24.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-16T13:38:24.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-10-16T13:38:24.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949954+0000', 'last_change': '2023-10-16T13:38:17.949954+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949954+0000', 'last_undegraded': '2023-10-16T13:38:17.949954+0000', 'last_fullsized': '2023-10-16T13:38:17.949954+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:38:24.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-16T13:38:24.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-10-16T13:38:24.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949312+0000', 'last_change': '2023-10-16T13:38:17.949312+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949312+0000', 'last_undegraded': '2023-10-16T13:38:17.949312+0000', 'last_fullsized': '2023-10-16T13:38:17.949312+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:38:24.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-16T13:38:24.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-10-16T13:38:24.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.946413+0000', 'last_change': '2023-10-16T13:38:17.946413+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.946413+0000', 'last_undegraded': '2023-10-16T13:38:17.946413+0000', 'last_fullsized': '2023-10-16T13:38:17.946413+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:38:24.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-16T13:38:24.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-16T13:38:24.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-10-16T13:38:24.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.950756+0000', 'last_change': '2023-10-16T13:38:17.950756+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.950756+0000', 'last_undegraded': '2023-10-16T13:38:17.950756+0000', 'last_fullsized': '2023-10-16T13:38:17.950756+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:38:24.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-16T13:38:24.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-10-16T13:38:24.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.946410+0000', 'last_change': '2023-10-16T13:38:17.946410+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.946410+0000', 'last_undegraded': '2023-10-16T13:38:17.946410+0000', 'last_fullsized': '2023-10-16T13:38:17.946410+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:38:24.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-16T13:38:24.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-10-16T13:38:24.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.948569+0000', 'last_change': '2023-10-16T13:38:17.948569+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.948569+0000', 'last_undegraded': '2023-10-16T13:38:17.948569+0000', 'last_fullsized': '2023-10-16T13:38:17.948569+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:38:24.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-10-16T13:38:24.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.948424+0000', 'last_change': '2023-10-16T13:38:17.948424+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.948424+0000', 'last_undegraded': '2023-10-16T13:38:17.948424+0000', 'last_fullsized': '2023-10-16T13:38:17.948424+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:38:24.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-16T13:38:24.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-10-16T13:38:24.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949347+0000', 'last_change': '2023-10-16T13:38:17.949347+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949347+0000', 'last_undegraded': '2023-10-16T13:38:17.949347+0000', 'last_fullsized': '2023-10-16T13:38:17.949347+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:38:24.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-16T13:38:24.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-10-16T13:38:24.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.950490+0000', 'last_change': '2023-10-16T13:38:17.950490+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.950490+0000', 'last_undegraded': '2023-10-16T13:38:17.950490+0000', 'last_fullsized': '2023-10-16T13:38:17.950490+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:38:24.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-16T13:38:24.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-10-16T13:38:24.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949089+0000', 'last_change': '2023-10-16T13:38:17.949089+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949089+0000', 'last_undegraded': '2023-10-16T13:38:17.949089+0000', 'last_fullsized': '2023-10-16T13:38:17.949089+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:38:24.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-16T13:38:24.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-10-16T13:38:24.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949768+0000', 'last_change': '2023-10-16T13:38:17.949768+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949768+0000', 'last_undegraded': '2023-10-16T13:38:17.949768+0000', 'last_fullsized': '2023-10-16T13:38:17.949768+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:38:24.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-16T13:38:24.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-10-16T13:38:24.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949480+0000', 'last_change': '2023-10-16T13:38:17.949480+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949480+0000', 'last_undegraded': '2023-10-16T13:38:17.949480+0000', 'last_fullsized': '2023-10-16T13:38:17.949480+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:38:24.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-16T13:38:24.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-10-16T13:38:24.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.948444+0000', 'last_change': '2023-10-16T13:38:17.948444+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.948444+0000', 'last_undegraded': '2023-10-16T13:38:17.948444+0000', 'last_fullsized': '2023-10-16T13:38:17.948444+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:38:24.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-16T13:38:24.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-10-16T13:38:24.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.950890+0000', 'last_change': '2023-10-16T13:38:17.950890+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.950890+0000', 'last_undegraded': '2023-10-16T13:38:17.950890+0000', 'last_fullsized': '2023-10-16T13:38:17.950890+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:38:24.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-16T13:38:24.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-10-16T13:38:24.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.949424+0000', 'last_change': '2023-10-16T13:38:17.949424+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.949424+0000', 'last_undegraded': '2023-10-16T13:38:17.949424+0000', 'last_fullsized': '2023-10-16T13:38:17.949424+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:38:24.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-16T13:38:24.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-10-16T13:38:24.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:38:17.951649+0000', 'last_change': '2023-10-16T13:38:17.951649+0000', 'last_active': '2023-10-16T13:38:17.939845+0000', 'last_peered': '2023-10-16T13:38:17.939845+0000', 'last_clean': '2023-10-16T13:38:17.939845+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:17.951649+0000', 'last_undegraded': '2023-10-16T13:38:17.951649+0000', 'last_fullsized': '2023-10-16T13:38:17.951649+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:17.939845+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:38:24.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-16T13:38:24.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-16T13:38:24.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-16T13:38:24.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-16T13:38:24.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-16T13:38:24.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-16T13:38:24.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-16T13:38:24.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-16T13:38:24.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-16T13:38:24.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-16T13:38:24.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-16T13:38:24.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-16T13:38:24.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-16T13:38:24.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-16T13:38:24.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:38:18.943624+0000', 'last_change': '2023-10-16T13:38:18.943624+0000', 'last_active': '2023-10-16T13:38:18.943624+0000', 'last_peered': '2023-10-16T13:38:18.943624+0000', 'last_clean': '2023-10-16T13:38:18.943624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:38:18.943624+0000', 'last_undegraded': '2023-10-16T13:38:18.943624+0000', 'last_fullsized': '2023-10-16T13:38:18.943624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'last_clean_scrub_stamp': '2023-10-16T13:38:18.943624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:38:24.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T13:38:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.115+0000 7f6180d05700 1 Processor -- start 2023-10-16T13:38:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.115+0000 7f6180d05700 1 -- start start 2023-10-16T13:38:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f6180d05700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f617c0cf330 0x7f617c0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f6180d05700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c15ee20 con 0x7f617c0cf710 2023-10-16T13:38:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f6180d05700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c15f100 con 0x7f617c0b5120 2023-10-16T13:38:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f6180d05700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c15bd30 con 0x7f617c0cf330 2023-10-16T13:38:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f6179d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f617c0cf710 0x7f617c15e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51856/0 (socket says 172.21.15.5:51856) 2023-10-16T13:38:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f6179d9b700 1 -- 172.21.15.5:0/3989310944 learned_addr learned my addr 172.21.15.5:0/3989310944 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617a59c700 1 --2- 172.21.15.5:0/3989310944 >> v2:172.21.15.112:3300/0 conn(0x7f617c0cf330 0x7f617c0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317337982 0 0) 0x7f617c15ee20 con 0x7f617c0cf710 2023-10-16T13:38:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61640035b0 con 0x7f617c0cf710 2023-10-16T13:38:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956245815 0 0) 0x7f61640035b0 con 0x7f617c0cf710 2023-10-16T13:38:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 >> v2:172.21.15.112:3300/0 conn(0x7f617c0cf330 msgr2=0x7f617c0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 --2- 172.21.15.5:0/3989310944 >> v2:172.21.15.112:3300/0 conn(0x7f617c0cf330 0x7f617c0ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 >> v1:172.21.15.112:6789/0 conn(0x7f617c0b5120 legacy=0x7f617c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0cda50 con 0x7f617c0cf710 2023-10-16T13:38:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6170001670 con 0x7f617c0cf710 2023-10-16T13:38:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.116+0000 7f617a59c700 1 --2- 172.21.15.5:0/3989310944 >> v2:172.21.15.112:3300/0 conn(0x7f617c0cf330 0x7f617c0ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 >> v1:172.21.15.5:6789/0 conn(0x7f617c0cf710 legacy=0x7f617c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6164003a00 0x7f6164003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6164004850 0x7f6164004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164005210 0x7f616400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616400c080 con 0x7f6164004850 2023-10-16T13:38:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616400c1f0 con 0x7f6164005210 2023-10-16T13:38:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616400c3b0 con 0x7f6164003a00 2023-10-16T13:38:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6164004850 0x7f6164004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617a59c700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6164003a00 0x7f6164003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617ad9d700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164005210 0x7f616400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 -- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6164003a00 msgr2=0x7f6164003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6164003a00 0x7f6164003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 -- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164005210 msgr2=0x7f616400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164005210 0x7f616400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 -- 172.21.15.5:0/3989310944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640035b0 con 0x7f6164004850 2023-10-16T13:38:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617ad9d700 1 -- 172.21.15.5:0/3989310944 reap_dead start 2023-10-16T13:38:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f6179d9b700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6164004850 0x7f6164004cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f617000c240 tx=0x7f6164005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6d7ffe7629aca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170007c10 con 0x7f6164004850 2023-10-16T13:38:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000ce00 con 0x7f6164004850 2023-10-16T13:38:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.117+0000 7f617959a700 1 -- 172.21.15.5:0/3989310944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170005ba0 con 0x7f6164004850 2023-10-16T13:38:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 -- 172.21.15.5:0/3989310944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6164004850 msgr2=0x7f6164004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6164004850 0x7f6164004cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f617000c240 tx=0x7f6164005880 comp rx=0 tx=0).stop 2023-10-16T13:38:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 -- 172.21.15.5:0/3989310944 shutdown_connections 2023-10-16T13:38:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 --2- 172.21.15.5:0/3989310944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6164004850 0x7f6164004cd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 -- 172.21.15.5:0/3989310944 >> 172.21.15.5:0/3989310944 conn(0x7f617c0b17f0 msgr2=0x7f617c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 -- 172.21.15.5:0/3989310944 shutdown_connections 2023-10-16T13:38:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.118+0000 7f6180d05700 1 -- 172.21.15.5:0/3989310944 wait complete. 2023-10-16T13:38:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.119+0000 7f6180d05700 1 Processor -- start 2023-10-16T13:38:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.119+0000 7f6180d05700 1 -- start start 2023-10-16T13:38:25.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6180d05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164004850 0x7f617c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6180d05700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f617c0c9450 0x7f617c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6180d05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 0x7f617c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6180d05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0adcf0 con 0x7f617c06ad80 2023-10-16T13:38:25.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6180d05700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0c98d0 con 0x7f6164004850 2023-10-16T13:38:25.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6180d05700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c150880 con 0x7f617c0c9450 2023-10-16T13:38:25.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f617ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 0x7f617c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f617ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 0x7f617c06b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41866/0 (socket says 172.21.15.5:41866) 2023-10-16T13:38:25.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f617ad9d700 1 -- 172.21.15.5:0/1334100466 learned_addr learned my addr 172.21.15.5:0/1334100466 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:25.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f617a59c700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164004850 0x7f617c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.120+0000 7f6179d9b700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f617c0c9450 0x7f617c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f617ad9d700 1 -- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f617c0c9450 msgr2=0x7f617c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f617ad9d700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f617c0c9450 0x7f617c06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f617ad9d700 1 -- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164004850 msgr2=0x7f617c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f617ad9d700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164004850 0x7f617c0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f617ad9d700 1 -- 172.21.15.5:0/1334100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c1505a0 con 0x7f617c06ad80 2023-10-16T13:38:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f6179d9b700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f617c0c9450 0x7f617c06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f617ad9d700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 0x7f617c06b200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f617c06c640 tx=0x7f617400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174003c10 con 0x7f617c06ad80 2023-10-16T13:38:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174003d90 con 0x7f617c06ad80 2023-10-16T13:38:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174005310 con 0x7f617c06ad80 2023-10-16T13:38:25.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c0adf00 con 0x7f617c06ad80 2023-10-16T13:38:25.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.121+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c0ae4c0 con 0x7f617c06ad80 2023-10-16T13:38:25.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.122+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c04ec20 con 0x7f617c06ad80 2023-10-16T13:38:25.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.122+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6174005470 con 0x7f617c06ad80 2023-10-16T13:38:25.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.123+0000 7f616affd700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f615c06af00 0x7f615c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.123+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6174089520 con 0x7f617c06ad80 2023-10-16T13:38:25.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.123+0000 7f617a59c700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f615c06af00 0x7f615c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.123+0000 7f617a59c700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f615c06af00 0x7f615c06d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f616c009c90 tx=0x7f616c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:25.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.128+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6174054690 con 0x7f617c06ad80 2023-10-16T13:38:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.413+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f617c04ec20 con 0x7f617c06ad80 2023-10-16T13:38:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.413+0000 7f616affd700 1 -- 172.21.15.5:0/1334100466 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7f617401a310 con 0x7f617c06ad80 2023-10-16T13:38:25.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:25.417 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1697463492,"num_in_osds":8,"osd_in_since":1697463484,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224444416,"bytes_avail":772869668864,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4270}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-16T13:38:01.821904+0000","services":{}},"progress_events":{}} 2023-10-16T13:38:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f615c06af00 msgr2=0x7f615c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f615c06af00 0x7f615c06d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f616c009c90 tx=0x7f616c008040 comp rx=0 tx=0).stop 2023-10-16T13:38:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 msgr2=0x7f617c06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 0x7f617c06b200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f617c06c640 tx=0x7f617400ee00 comp rx=0 tx=0).stop 2023-10-16T13:38:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 shutdown_connections 2023-10-16T13:38:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f617c06ad80 0x7f617c06b200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6164004850 0x7f617c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f615c06af00 0x7f615c06d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 --2- 172.21.15.5:0/1334100466 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f617c0c9450 0x7f617c06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 >> 172.21.15.5:0/1334100466 conn(0x7f617c0b17f0 msgr2=0x7f617c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 shutdown_connections 2023-10-16T13:38:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.415+0000 7f6180d05700 1 -- 172.21.15.5:0/1334100466 wait complete. 2023-10-16T13:38:25.430 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T13:38:25.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:25.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.553+0000 7fdf9a43a700 1 Processor -- start 2023-10-16T13:38:25.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.553+0000 7fdf9a43a700 1 -- start start 2023-10-16T13:38:25.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.553+0000 7fdf9a43a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf9406af50 0x7fdf940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.553+0000 7fdf9a43a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940b2d60 con 0x7fdf940cd950 2023-10-16T13:38:25.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf9a43a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940cdd30 con 0x7fdf9415e2f0 2023-10-16T13:38:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf9a43a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf941619a0 con 0x7fdf9406af50 2023-10-16T13:38:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf93fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf940cd950 0x7fdf9415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51874/0 (socket says 172.21.15.5:51874) 2023-10-16T13:38:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf93fff700 1 -- 172.21.15.5:0/155583072 learned_addr learned my addr 172.21.15.5:0/155583072 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf989d7700 1 --2- 172.21.15.5:0/155583072 >> v2:172.21.15.112:3300/0 conn(0x7fdf9406af50 0x7fdf940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940124278 0 0) 0x7fdf940b2d60 con 0x7fdf940cd950 2023-10-16T13:38:25.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c0035b0 con 0x7fdf940cd950 2023-10-16T13:38:25.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078389610 0 0) 0x7fdf7c0035b0 con 0x7fdf940cd950 2023-10-16T13:38:25.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 >> v2:172.21.15.112:3300/0 conn(0x7fdf9406af50 msgr2=0x7fdf940cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:25.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 --2- 172.21.15.5:0/155583072 >> v2:172.21.15.112:3300/0 conn(0x7fdf9406af50 0x7fdf940cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 >> v1:172.21.15.112:6789/0 conn(0x7fdf9415e2f0 legacy=0x7fdf9406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9415e920 con 0x7fdf940cd950 2023-10-16T13:38:25.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fdf84001670 con 0x7fdf940cd950 2023-10-16T13:38:25.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 >> v1:172.21.15.5:6789/0 conn(0x7fdf940cd950 legacy=0x7fdf9415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c003a00 0x7fdf7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf7c004400 0x7fdf7c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf7c0050d0 0x7fdf7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941619a0 con 0x7fdf7c004400 2023-10-16T13:38:25.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c00c030 con 0x7fdf7c0050d0 2023-10-16T13:38:25.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c00c1f0 con 0x7fdf7c003a00 2023-10-16T13:38:25.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf937fe700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf7c004400 0x7fdf7c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.554+0000 7fdf989d7700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf7c0050d0 0x7fdf7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf93fff700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c003a00 0x7fdf7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf937fe700 1 -- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c003a00 msgr2=0x7fdf7c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf937fe700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c003a00 0x7fdf7c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf937fe700 1 -- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf7c0050d0 msgr2=0x7fdf7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf937fe700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf7c0050d0 0x7fdf7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf937fe700 1 -- 172.21.15.5:0/155583072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0035b0 con 0x7fdf7c004400 2023-10-16T13:38:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf989d7700 1 -- 172.21.15.5:0/155583072 reap_dead start 2023-10-16T13:38:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf93fff700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c003a00 0x7fdf7c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf937fe700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf7c004400 0x7fdf7c0048d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf880018e0 tx=0x7fdf7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d97b293ce73f44 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880052d0 con 0x7fdf7c004400 2023-10-16T13:38:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88005430 con 0x7fdf7c004400 2023-10-16T13:38:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.555+0000 7fdf92ffd700 1 -- 172.21.15.5:0/155583072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88003910 con 0x7fdf7c004400 2023-10-16T13:38:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 -- 172.21.15.5:0/155583072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf7c004400 msgr2=0x7fdf7c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf7c004400 0x7fdf7c0048d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf880018e0 tx=0x7fdf7c005880 comp rx=0 tx=0).stop 2023-10-16T13:38:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 -- 172.21.15.5:0/155583072 shutdown_connections 2023-10-16T13:38:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/155583072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf7c004400 0x7fdf7c0048d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 -- 172.21.15.5:0/155583072 >> 172.21.15.5:0/155583072 conn(0x7fdf9406dae0 msgr2=0x7fdf9406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:25.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 -- 172.21.15.5:0/155583072 shutdown_connections 2023-10-16T13:38:25.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.556+0000 7fdf9a43a700 1 -- 172.21.15.5:0/155583072 wait complete. 2023-10-16T13:38:25.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.557+0000 7fdf9a43a700 1 Processor -- start 2023-10-16T13:38:25.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.557+0000 7fdf9a43a700 1 -- start start 2023-10-16T13:38:25.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf9a43a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c004400 0x7fdf94152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf9a43a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 0x7fdf940b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf9a43a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf940b0bd0 0x7fdf940b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf9a43a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940b1060 con 0x7fdf940c5380 2023-10-16T13:38:25.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf9a43a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c4000 con 0x7fdf940b0bd0 2023-10-16T13:38:25.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf9a43a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c42e0 con 0x7fdf7c004400 2023-10-16T13:38:25.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 0x7fdf940b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 0x7fdf940b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41886/0 (socket says 172.21.15.5:41886) 2023-10-16T13:38:25.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 -- 172.21.15.5:0/3678684845 learned_addr learned my addr 172.21.15.5:0/3678684845 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:25.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf93fff700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c004400 0x7fdf94152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf989d7700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf940b0bd0 0x7fdf940b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 -- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c004400 msgr2=0x7fdf94152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c004400 0x7fdf94152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 -- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf940b0bd0 msgr2=0x7fdf940b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf940b0bd0 0x7fdf940b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 -- 172.21.15.5:0/3678684845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940c45c0 con 0x7fdf940c5380 2023-10-16T13:38:25.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf937fe700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 0x7fdf940b0690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf880011f0 tx=0x7fdf88001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:25.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.558+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801d620 con 0x7fdf940c5380 2023-10-16T13:38:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.559+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8801d780 con 0x7fdf940c5380 2023-10-16T13:38:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.559+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf940c48a0 con 0x7fdf940c5380 2023-10-16T13:38:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.559+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801db10 con 0x7fdf940c5380 2023-10-16T13:38:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.559+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf940c4e60 con 0x7fdf940c5380 2023-10-16T13:38:25.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.560+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf940c5020 con 0x7fdf940c5380 2023-10-16T13:38:25.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.560+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf8801dc70 con 0x7fdf940c5380 2023-10-16T13:38:25.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.561+0000 7fdf90ff9700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf8006af00 0x7fdf8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:25.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.561+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf8808a7a0 con 0x7fdf940c5380 2023-10-16T13:38:25.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.561+0000 7fdf93fff700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf8006af00 0x7fdf8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:25.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.561+0000 7fdf93fff700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf8006af00 0x7fdf8006d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf84001ca0 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:25.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.565+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf880558e0 con 0x7fdf940c5380 2023-10-16T13:38:25.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.761+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf940c6440 con 0x7fdf8006af00 2023-10-16T13:38:25.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.769+0000 7fdf90ff9700 1 -- 172.21.15.5:0/3678684845 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264788 (secure 0 0 0) 0x7fdf940c6440 con 0x7fdf8006af00 2023-10-16T13:38:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:25.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf8006af00 msgr2=0x7fdf8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf8006af00 0x7fdf8006d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf84001ca0 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2023-10-16T13:38:25.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 msgr2=0x7fdf940b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:25.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 0x7fdf940b0690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf880011f0 tx=0x7fdf88001160 comp rx=0 tx=0).stop 2023-10-16T13:38:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 shutdown_connections 2023-10-16T13:38:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf940b0bd0 0x7fdf940b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf8006af00 0x7fdf8006d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf7c004400 0x7fdf94152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 --2- 172.21.15.5:0/3678684845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf940c5380 0x7fdf940b0690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 >> 172.21.15.5:0/3678684845 conn(0x7fdf9406dae0 msgr2=0x7fdf9415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 shutdown_connections 2023-10-16T13:38:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:25.772+0000 7fdf9a43a700 1 -- 172.21.15.5:0/3678684845 wait complete. 2023-10-16T13:38:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:25.787 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-16T13:38:25.457230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2883584,"data_stored":1750702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.510196"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312791+0000","last_change":"2023-10-16T13:38:19.985659+0000","last_active":"2023-10-16T13:38:21.312791+0000","last_peered":"2023-10-16T13:38:21.312791+0000","last_clean":"2023-10-16T13:38:21.312791+0000","last_became_active":"2023-10-16T13:38:19.985250+0000","last_became_peered":"2023-10-16T13:38:19.985250+0000","last_unstale":"2023-10-16T13:38:21.312791+0000","last_undegraded":"2023-10-16T13:38:21.312791+0000","last_fullsized":"2023-10-16T13:38:21.312791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:21:57.591824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988596+0000","last_change":"2023-10-16T13:38:19.985144+0000","last_active":"2023-10-16T13:38:20.988596+0000","last_peered":"2023-10-16T13:38:20.988596+0000","last_clean":"2023-10-16T13:38:20.988596+0000","last_became_active":"2023-10-16T13:38:19.984801+0000","last_became_peered":"2023-10-16T13:38:19.984801+0000","last_unstale":"2023-10-16T13:38:20.988596+0000","last_undegraded":"2023-10-16T13:38:20.988596+0000","last_fullsized":"2023-10-16T13:38:20.988596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417314+0000","last_change":"2023-10-16T13:38:19.992389+0000","last_active":"2023-10-16T13:38:21.417314+0000","last_peered":"2023-10-16T13:38:21.417314+0000","last_clean":"2023-10-16T13:38:21.417314+0000","last_became_active":"2023-10-16T13:38:19.991965+0000","last_became_peered":"2023-10-16T13:38:19.991965+0000","last_unstale":"2023-10-16T13:38:21.417314+0000","last_undegraded":"2023-10-16T13:38:21.417314+0000","last_fullsized":"2023-10-16T13:38:21.417314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996709+0000","last_change":"2023-10-16T13:38:19.994269+0000","last_active":"2023-10-16T13:38:20.996709+0000","last_peered":"2023-10-16T13:38:20.996709+0000","last_clean":"2023-10-16T13:38:20.996709+0000","last_became_active":"2023-10-16T13:38:19.989727+0000","last_became_peered":"2023-10-16T13:38:19.989727+0000","last_unstale":"2023-10-16T13:38:20.996709+0000","last_undegraded":"2023-10-16T13:38:20.996709+0000","last_fullsized":"2023-10-16T13:38:20.996709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312381+0000","last_change":"2023-10-16T13:38:19.988406+0000","last_active":"2023-10-16T13:38:21.312381+0000","last_peered":"2023-10-16T13:38:21.312381+0000","last_clean":"2023-10-16T13:38:21.312381+0000","last_became_active":"2023-10-16T13:38:19.985680+0000","last_became_peered":"2023-10-16T13:38:19.985680+0000","last_unstale":"2023-10-16T13:38:21.312381+0000","last_undegraded":"2023-10-16T13:38:21.312381+0000","last_fullsized":"2023-10-16T13:38:21.312381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996738+0000","last_change":"2023-10-16T13:38:19.997527+0000","last_active":"2023-10-16T13:38:20.996738+0000","last_peered":"2023-10-16T13:38:20.996738+0000","last_clean":"2023-10-16T13:38:20.996738+0000","last_became_active":"2023-10-16T13:38:19.997232+0000","last_became_peered":"2023-10-16T13:38:19.997232+0000","last_unstale":"2023-10-16T13:38:20.996738+0000","last_undegraded":"2023-10-16T13:38:20.996738+0000","last_fullsized":"2023-10-16T13:38:20.996738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312178+0000","last_change":"2023-10-16T13:38:19.994384+0000","last_active":"2023-10-16T13:38:21.312178+0000","last_peered":"2023-10-16T13:38:21.312178+0000","last_clean":"2023-10-16T13:38:21.312178+0000","last_became_active":"2023-10-16T13:38:19.993971+0000","last_became_peered":"2023-10-16T13:38:19.993971+0000","last_unstale":"2023-10-16T13:38:21.312178+0000","last_undegraded":"2023-10-16T13:38:21.312178+0000","last_fullsized":"2023-10-16T13:38:21.312178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397908+0000","last_change":"2023-10-16T13:38:19.995124+0000","last_active":"2023-10-16T13:38:21.397908+0000","last_peered":"2023-10-16T13:38:21.397908+0000","last_clean":"2023-10-16T13:38:21.397908+0000","last_became_active":"2023-10-16T13:38:19.994763+0000","last_became_peered":"2023-10-16T13:38:19.994763+0000","last_unstale":"2023-10-16T13:38:21.397908+0000","last_undegraded":"2023-10-16T13:38:21.397908+0000","last_fullsized":"2023-10-16T13:38:21.397908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312737+0000","last_change":"2023-10-16T13:38:19.992050+0000","last_active":"2023-10-16T13:38:21.312737+0000","last_peered":"2023-10-16T13:38:21.312737+0000","last_clean":"2023-10-16T13:38:21.312737+0000","last_became_active":"2023-10-16T13:38:19.991296+0000","last_became_peered":"2023-10-16T13:38:19.991296+0000","last_unstale":"2023-10-16T13:38:21.312737+0000","last_undegraded":"2023-10-16T13:38:21.312737+0000","last_fullsized":"2023-10-16T13:38:21.312737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:16.455246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876286+0000","last_change":"2023-10-16T13:38:19.998323+0000","last_active":"2023-10-16T13:38:21.876286+0000","last_peered":"2023-10-16T13:38:21.876286+0000","last_clean":"2023-10-16T13:38:21.876286+0000","last_became_active":"2023-10-16T13:38:19.998022+0000","last_became_peered":"2023-10-16T13:38:19.998022+0000","last_unstale":"2023-10-16T13:38:21.876286+0000","last_undegraded":"2023-10-16T13:38:21.876286+0000","last_fullsized":"2023-10-16T13:38:21.876286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876144+0000","last_change":"2023-10-16T13:38:19.998317+0000","last_active":"2023-10-16T13:38:21.876144+0000","last_peered":"2023-10-16T13:38:21.876144+0000","last_clean":"2023-10-16T13:38:21.876144+0000","last_became_active":"2023-10-16T13:38:19.998043+0000","last_became_peered":"2023-10-16T13:38:19.998043+0000","last_unstale":"2023-10-16T13:38:21.876144+0000","last_undegraded":"2023-10-16T13:38:21.876144+0000","last_fullsized":"2023-10-16T13:38:21.876144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997767+0000","last_change":"2023-10-16T13:38:19.985697+0000","last_active":"2023-10-16T13:38:20.997767+0000","last_peered":"2023-10-16T13:38:20.997767+0000","last_clean":"2023-10-16T13:38:20.997767+0000","last_became_active":"2023-10-16T13:38:19.985438+0000","last_became_peered":"2023-10-16T13:38:19.985438+0000","last_unstale":"2023-10-16T13:38:20.997767+0000","last_undegraded":"2023-10-16T13:38:20.997767+0000","last_fullsized":"2023-10-16T13:38:20.997767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:17.751681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398231+0000","last_change":"2023-10-16T13:38:19.984535+0000","last_active":"2023-10-16T13:38:21.398231+0000","last_peered":"2023-10-16T13:38:21.398231+0000","last_clean":"2023-10-16T13:38:21.398231+0000","last_became_active":"2023-10-16T13:38:19.984237+0000","last_became_peered":"2023-10-16T13:38:19.984237+0000","last_unstale":"2023-10-16T13:38:21.398231+0000","last_undegraded":"2023-10-16T13:38:21.398231+0000","last_fullsized":"2023-10-16T13:38:21.398231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417158+0000","last_change":"2023-10-16T13:38:19.992598+0000","last_active":"2023-10-16T13:38:21.417158+0000","last_peered":"2023-10-16T13:38:21.417158+0000","last_clean":"2023-10-16T13:38:21.417158+0000","last_became_active":"2023-10-16T13:38:19.990440+0000","last_became_peered":"2023-10-16T13:38:19.990440+0000","last_unstale":"2023-10-16T13:38:21.417158+0000","last_undegraded":"2023-10-16T13:38:21.417158+0000","last_fullsized":"2023-10-16T13:38:21.417158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988246+0000","last_change":"2023-10-16T13:38:19.994076+0000","last_active":"2023-10-16T13:38:20.988246+0000","last_peered":"2023-10-16T13:38:20.988246+0000","last_clean":"2023-10-16T13:38:20.988246+0000","last_became_active":"2023-10-16T13:38:19.993816+0000","last_became_peered":"2023-10-16T13:38:19.993816+0000","last_unstale":"2023-10-16T13:38:20.988246+0000","last_undegraded":"2023-10-16T13:38:20.988246+0000","last_fullsized":"2023-10-16T13:38:20.988246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996244+0000","last_change":"2023-10-16T13:38:19.997326+0000","last_active":"2023-10-16T13:38:20.996244+0000","last_peered":"2023-10-16T13:38:20.996244+0000","last_clean":"2023-10-16T13:38:20.996244+0000","last_became_active":"2023-10-16T13:38:19.997047+0000","last_became_peered":"2023-10-16T13:38:19.997047+0000","last_unstale":"2023-10-16T13:38:20.996244+0000","last_undegraded":"2023-10-16T13:38:20.996244+0000","last_fullsized":"2023-10-16T13:38:20.996244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997157+0000","last_change":"2023-10-16T13:38:19.990024+0000","last_active":"2023-10-16T13:38:20.997157+0000","last_peered":"2023-10-16T13:38:20.997157+0000","last_clean":"2023-10-16T13:38:20.997157+0000","last_became_active":"2023-10-16T13:38:19.989585+0000","last_became_peered":"2023-10-16T13:38:19.989585+0000","last_unstale":"2023-10-16T13:38:20.997157+0000","last_undegraded":"2023-10-16T13:38:20.997157+0000","last_fullsized":"2023-10-16T13:38:20.997157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821413+0000","last_change":"2023-10-16T13:38:19.985061+0000","last_active":"2023-10-16T13:38:21.821413+0000","last_peered":"2023-10-16T13:38:21.821413+0000","last_clean":"2023-10-16T13:38:21.821413+0000","last_became_active":"2023-10-16T13:38:19.984723+0000","last_became_peered":"2023-10-16T13:38:19.984723+0000","last_unstale":"2023-10-16T13:38:21.821413+0000","last_undegraded":"2023-10-16T13:38:21.821413+0000","last_fullsized":"2023-10-16T13:38:21.821413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:40.348223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312495+0000","last_change":"2023-10-16T13:38:19.986577+0000","last_active":"2023-10-16T13:38:21.312495+0000","last_peered":"2023-10-16T13:38:21.312495+0000","last_clean":"2023-10-16T13:38:21.312495+0000","last_became_active":"2023-10-16T13:38:19.986061+0000","last_became_peered":"2023-10-16T13:38:19.986061+0000","last_unstale":"2023-10-16T13:38:21.312495+0000","last_undegraded":"2023-10-16T13:38:21.312495+0000","last_fullsized":"2023-10-16T13:38:21.312495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.008095+0000","last_change":"2023-10-16T13:38:18.965787+0000","last_active":"2023-10-16T13:38:20.008095+0000","last_peered":"2023-10-16T13:38:20.008095+0000","last_clean":"2023-10-16T13:38:20.008095+0000","last_became_active":"2023-10-16T13:38:18.965323+0000","last_became_peered":"2023-10-16T13:38:18.965323+0000","last_unstale":"2023-10-16T13:38:20.008095+0000","last_undegraded":"2023-10-16T13:38:20.008095+0000","last_fullsized":"2023-10-16T13:38:20.008095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398158+0000","last_change":"2023-10-16T13:38:19.985506+0000","last_active":"2023-10-16T13:38:21.398158+0000","last_peered":"2023-10-16T13:38:21.398158+0000","last_clean":"2023-10-16T13:38:21.398158+0000","last_became_active":"2023-10-16T13:38:19.985155+0000","last_became_peered":"2023-10-16T13:38:19.985155+0000","last_unstale":"2023-10-16T13:38:21.398158+0000","last_undegraded":"2023-10-16T13:38:21.398158+0000","last_fullsized":"2023-10-16T13:38:21.398158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002649+0000","last_change":"2023-10-16T13:38:18.965668+0000","last_active":"2023-10-16T13:38:20.002649+0000","last_peered":"2023-10-16T13:38:20.002649+0000","last_clean":"2023-10-16T13:38:20.002649+0000","last_became_active":"2023-10-16T13:38:18.965214+0000","last_became_peered":"2023-10-16T13:38:18.965214+0000","last_unstale":"2023-10-16T13:38:20.002649+0000","last_undegraded":"2023-10-16T13:38:20.002649+0000","last_fullsized":"2023-10-16T13:38:20.002649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417258+0000","last_change":"2023-10-16T13:38:19.997063+0000","last_active":"2023-10-16T13:38:21.417258+0000","last_peered":"2023-10-16T13:38:21.417258+0000","last_clean":"2023-10-16T13:38:21.417258+0000","last_became_active":"2023-10-16T13:38:19.996754+0000","last_became_peered":"2023-10-16T13:38:19.996754+0000","last_unstale":"2023-10-16T13:38:21.417258+0000","last_undegraded":"2023-10-16T13:38:21.417258+0000","last_fullsized":"2023-10-16T13:38:21.417258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000617+0000","last_change":"2023-10-16T13:38:18.968962+0000","last_active":"2023-10-16T13:38:20.000617+0000","last_peered":"2023-10-16T13:38:20.000617+0000","last_clean":"2023-10-16T13:38:20.000617+0000","last_became_active":"2023-10-16T13:38:18.968414+0000","last_became_peered":"2023-10-16T13:38:18.968414+0000","last_unstale":"2023-10-16T13:38:20.000617+0000","last_undegraded":"2023-10-16T13:38:20.000617+0000","last_fullsized":"2023-10-16T13:38:20.000617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:42.951075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997004+0000","last_change":"2023-10-16T13:38:19.996471+0000","last_active":"2023-10-16T13:38:20.997004+0000","last_peered":"2023-10-16T13:38:20.997004+0000","last_clean":"2023-10-16T13:38:20.997004+0000","last_became_active":"2023-10-16T13:38:19.994710+0000","last_became_peered":"2023-10-16T13:38:19.994710+0000","last_unstale":"2023-10-16T13:38:20.997004+0000","last_undegraded":"2023-10-16T13:38:20.997004+0000","last_fullsized":"2023-10-16T13:38:20.997004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002919+0000","last_change":"2023-10-16T13:38:18.964941+0000","last_active":"2023-10-16T13:38:20.002919+0000","last_peered":"2023-10-16T13:38:20.002919+0000","last_clean":"2023-10-16T13:38:20.002919+0000","last_became_active":"2023-10-16T13:38:18.964675+0000","last_became_peered":"2023-10-16T13:38:18.964675+0000","last_unstale":"2023-10-16T13:38:20.002919+0000","last_undegraded":"2023-10-16T13:38:20.002919+0000","last_fullsized":"2023-10-16T13:38:20.002919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:03.073989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997402+0000","last_change":"2023-10-16T13:38:19.989785+0000","last_active":"2023-10-16T13:38:20.997402+0000","last_peered":"2023-10-16T13:38:20.997402+0000","last_clean":"2023-10-16T13:38:20.997402+0000","last_became_active":"2023-10-16T13:38:19.989508+0000","last_became_peered":"2023-10-16T13:38:19.989508+0000","last_unstale":"2023-10-16T13:38:20.997402+0000","last_undegraded":"2023-10-16T13:38:20.997402+0000","last_fullsized":"2023-10-16T13:38:20.997402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002679+0000","last_change":"2023-10-16T13:38:18.966501+0000","last_active":"2023-10-16T13:38:20.002679+0000","last_peered":"2023-10-16T13:38:20.002679+0000","last_clean":"2023-10-16T13:38:20.002679+0000","last_became_active":"2023-10-16T13:38:18.966198+0000","last_became_peered":"2023-10-16T13:38:18.966198+0000","last_unstale":"2023-10-16T13:38:20.002679+0000","last_undegraded":"2023-10-16T13:38:20.002679+0000","last_fullsized":"2023-10-16T13:38:20.002679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:16.747902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996442+0000","last_change":"2023-10-16T13:38:19.987636+0000","last_active":"2023-10-16T13:38:20.996442+0000","last_peered":"2023-10-16T13:38:20.996442+0000","last_clean":"2023-10-16T13:38:20.996442+0000","last_became_active":"2023-10-16T13:38:19.986780+0000","last_became_peered":"2023-10-16T13:38:19.986780+0000","last_unstale":"2023-10-16T13:38:20.996442+0000","last_undegraded":"2023-10-16T13:38:20.996442+0000","last_fullsized":"2023-10-16T13:38:20.996442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:04.661176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.999597+0000","last_change":"2023-10-16T13:38:18.965928+0000","last_active":"2023-10-16T13:38:19.999597+0000","last_peered":"2023-10-16T13:38:19.999597+0000","last_clean":"2023-10-16T13:38:19.999597+0000","last_became_active":"2023-10-16T13:38:18.964562+0000","last_became_peered":"2023-10-16T13:38:18.964562+0000","last_unstale":"2023-10-16T13:38:19.999597+0000","last_undegraded":"2023-10-16T13:38:19.999597+0000","last_fullsized":"2023-10-16T13:38:19.999597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417479+0000","last_change":"2023-10-16T13:38:19.992457+0000","last_active":"2023-10-16T13:38:21.417479+0000","last_peered":"2023-10-16T13:38:21.417479+0000","last_clean":"2023-10-16T13:38:21.417479+0000","last_became_active":"2023-10-16T13:38:19.992036+0000","last_became_peered":"2023-10-16T13:38:19.992036+0000","last_unstale":"2023-10-16T13:38:21.417479+0000","last_undegraded":"2023-10-16T13:38:21.417479+0000","last_fullsized":"2023-10-16T13:38:21.417479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.974530+0000","last_change":"2023-10-16T13:38:18.968885+0000","last_active":"2023-10-16T13:38:19.974530+0000","last_peered":"2023-10-16T13:38:19.974530+0000","last_clean":"2023-10-16T13:38:19.974530+0000","last_became_active":"2023-10-16T13:38:18.968534+0000","last_became_peered":"2023-10-16T13:38:18.968534+0000","last_unstale":"2023-10-16T13:38:19.974530+0000","last_undegraded":"2023-10-16T13:38:19.974530+0000","last_fullsized":"2023-10-16T13:38:19.974530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398198+0000","last_change":"2023-10-16T13:38:19.993434+0000","last_active":"2023-10-16T13:38:21.398198+0000","last_peered":"2023-10-16T13:38:21.398198+0000","last_clean":"2023-10-16T13:38:21.398198+0000","last_became_active":"2023-10-16T13:38:19.993043+0000","last_became_peered":"2023-10-16T13:38:19.993043+0000","last_unstale":"2023-10-16T13:38:21.398198+0000","last_undegraded":"2023-10-16T13:38:21.398198+0000","last_fullsized":"2023-10-16T13:38:21.398198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980065+0000","last_change":"2023-10-16T13:38:18.955699+0000","last_active":"2023-10-16T13:38:19.980065+0000","last_peered":"2023-10-16T13:38:19.980065+0000","last_clean":"2023-10-16T13:38:19.980065+0000","last_became_active":"2023-10-16T13:38:18.955087+0000","last_became_peered":"2023-10-16T13:38:18.955087+0000","last_unstale":"2023-10-16T13:38:19.980065+0000","last_undegraded":"2023-10-16T13:38:19.980065+0000","last_fullsized":"2023-10-16T13:38:19.980065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.979256+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.978905+0000","last_became_peered":"2023-10-16T13:38:19.978905+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.977616+0000","last_change":"2023-10-16T13:38:18.966953+0000","last_active":"2023-10-16T13:38:19.977616+0000","last_peered":"2023-10-16T13:38:19.977616+0000","last_clean":"2023-10-16T13:38:19.977616+0000","last_became_active":"2023-10-16T13:38:18.966671+0000","last_became_peered":"2023-10-16T13:38:18.966671+0000","last_unstale":"2023-10-16T13:38:19.977616+0000","last_undegraded":"2023-10-16T13:38:19.977616+0000","last_fullsized":"2023-10-16T13:38:19.977616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997077+0000","last_change":"2023-10-16T13:38:19.996864+0000","last_active":"2023-10-16T13:38:20.997077+0000","last_peered":"2023-10-16T13:38:20.997077+0000","last_clean":"2023-10-16T13:38:20.997077+0000","last_became_active":"2023-10-16T13:38:19.996566+0000","last_became_peered":"2023-10-16T13:38:19.996566+0000","last_unstale":"2023-10-16T13:38:20.997077+0000","last_undegraded":"2023-10-16T13:38:20.997077+0000","last_fullsized":"2023-10-16T13:38:20.997077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980833+0000","last_change":"2023-10-16T13:38:18.965714+0000","last_active":"2023-10-16T13:38:19.980833+0000","last_peered":"2023-10-16T13:38:19.980833+0000","last_clean":"2023-10-16T13:38:19.980833+0000","last_became_active":"2023-10-16T13:38:18.965358+0000","last_became_peered":"2023-10-16T13:38:18.965358+0000","last_unstale":"2023-10-16T13:38:19.980833+0000","last_undegraded":"2023-10-16T13:38:19.980833+0000","last_fullsized":"2023-10-16T13:38:19.980833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:41.112357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417437+0000","last_change":"2023-10-16T13:38:19.997120+0000","last_active":"2023-10-16T13:38:21.417437+0000","last_peered":"2023-10-16T13:38:21.417437+0000","last_clean":"2023-10-16T13:38:21.417437+0000","last_became_active":"2023-10-16T13:38:19.996803+0000","last_became_peered":"2023-10-16T13:38:19.996803+0000","last_unstale":"2023-10-16T13:38:21.417437+0000","last_undegraded":"2023-10-16T13:38:21.417437+0000","last_fullsized":"2023-10-16T13:38:21.417437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002233+0000","last_change":"2023-10-16T13:38:18.970973+0000","last_active":"2023-10-16T13:38:20.002233+0000","last_peered":"2023-10-16T13:38:20.002233+0000","last_clean":"2023-10-16T13:38:20.002233+0000","last_became_active":"2023-10-16T13:38:18.970277+0000","last_became_peered":"2023-10-16T13:38:18.970277+0000","last_unstale":"2023-10-16T13:38:20.002233+0000","last_undegraded":"2023-10-16T13:38:20.002233+0000","last_fullsized":"2023-10-16T13:38:20.002233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997634+0000","last_change":"2023-10-16T13:38:19.995792+0000","last_active":"2023-10-16T13:38:20.997634+0000","last_peered":"2023-10-16T13:38:20.997634+0000","last_clean":"2023-10-16T13:38:20.997634+0000","last_became_active":"2023-10-16T13:38:19.995382+0000","last_became_peered":"2023-10-16T13:38:19.995382+0000","last_unstale":"2023-10-16T13:38:20.997634+0000","last_undegraded":"2023-10-16T13:38:20.997634+0000","last_fullsized":"2023-10-16T13:38:20.997634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:04.077768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.005046+0000","last_change":"2023-10-16T13:38:18.966915+0000","last_active":"2023-10-16T13:38:20.005046+0000","last_peered":"2023-10-16T13:38:20.005046+0000","last_clean":"2023-10-16T13:38:20.005046+0000","last_became_active":"2023-10-16T13:38:18.966651+0000","last_became_peered":"2023-10-16T13:38:18.966651+0000","last_unstale":"2023-10-16T13:38:20.005046+0000","last_undegraded":"2023-10-16T13:38:20.005046+0000","last_fullsized":"2023-10-16T13:38:20.005046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:48.542445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312472+0000","last_change":"2023-10-16T13:38:19.990649+0000","last_active":"2023-10-16T13:38:21.312472+0000","last_peered":"2023-10-16T13:38:21.312472+0000","last_clean":"2023-10-16T13:38:21.312472+0000","last_became_active":"2023-10-16T13:38:19.990367+0000","last_became_peered":"2023-10-16T13:38:19.990367+0000","last_unstale":"2023-10-16T13:38:21.312472+0000","last_undegraded":"2023-10-16T13:38:21.312472+0000","last_fullsized":"2023-10-16T13:38:21.312472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001177+0000","last_change":"2023-10-16T13:38:18.966144+0000","last_active":"2023-10-16T13:38:20.001177+0000","last_peered":"2023-10-16T13:38:20.001177+0000","last_clean":"2023-10-16T13:38:20.001177+0000","last_became_active":"2023-10-16T13:38:18.965756+0000","last_became_peered":"2023-10-16T13:38:18.965756+0000","last_unstale":"2023-10-16T13:38:20.001177+0000","last_undegraded":"2023-10-16T13:38:20.001177+0000","last_fullsized":"2023-10-16T13:38:20.001177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417086+0000","last_change":"2023-10-16T13:38:19.993169+0000","last_active":"2023-10-16T13:38:21.417086+0000","last_peered":"2023-10-16T13:38:21.417086+0000","last_clean":"2023-10-16T13:38:21.417086+0000","last_became_active":"2023-10-16T13:38:19.992834+0000","last_became_peered":"2023-10-16T13:38:19.992834+0000","last_unstale":"2023-10-16T13:38:21.417086+0000","last_undegraded":"2023-10-16T13:38:21.417086+0000","last_fullsized":"2023-10-16T13:38:21.417086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:25.539196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980640+0000","last_change":"2023-10-16T13:38:18.966091+0000","last_active":"2023-10-16T13:38:19.980640+0000","last_peered":"2023-10-16T13:38:19.980640+0000","last_clean":"2023-10-16T13:38:19.980640+0000","last_became_active":"2023-10-16T13:38:18.965722+0000","last_became_peered":"2023-10-16T13:38:18.965722+0000","last_unstale":"2023-10-16T13:38:19.980640+0000","last_undegraded":"2023-10-16T13:38:19.980640+0000","last_fullsized":"2023-10-16T13:38:19.980640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312449+0000","last_change":"2023-10-16T13:38:19.987249+0000","last_active":"2023-10-16T13:38:21.312449+0000","last_peered":"2023-10-16T13:38:21.312449+0000","last_clean":"2023-10-16T13:38:21.312449+0000","last_became_active":"2023-10-16T13:38:19.986977+0000","last_became_peered":"2023-10-16T13:38:19.986977+0000","last_unstale":"2023-10-16T13:38:21.312449+0000","last_undegraded":"2023-10-16T13:38:21.312449+0000","last_fullsized":"2023-10-16T13:38:21.312449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.975945+0000","last_change":"2023-10-16T13:38:18.965295+0000","last_active":"2023-10-16T13:38:19.975945+0000","last_peered":"2023-10-16T13:38:19.975945+0000","last_clean":"2023-10-16T13:38:19.975945+0000","last_became_active":"2023-10-16T13:38:18.964991+0000","last_became_peered":"2023-10-16T13:38:18.964991+0000","last_unstale":"2023-10-16T13:38:19.975945+0000","last_undegraded":"2023-10-16T13:38:19.975945+0000","last_fullsized":"2023-10-16T13:38:19.975945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875921+0000","last_change":"2023-10-16T13:38:19.993337+0000","last_active":"2023-10-16T13:38:21.875921+0000","last_peered":"2023-10-16T13:38:21.875921+0000","last_clean":"2023-10-16T13:38:21.875921+0000","last_became_active":"2023-10-16T13:38:19.993037+0000","last_became_peered":"2023-10-16T13:38:19.993037+0000","last_unstale":"2023-10-16T13:38:21.875921+0000","last_undegraded":"2023-10-16T13:38:21.875921+0000","last_fullsized":"2023-10-16T13:38:21.875921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002049+0000","last_change":"2023-10-16T13:38:18.971941+0000","last_active":"2023-10-16T13:38:20.002049+0000","last_peered":"2023-10-16T13:38:20.002049+0000","last_clean":"2023-10-16T13:38:20.002049+0000","last_became_active":"2023-10-16T13:38:18.971486+0000","last_became_peered":"2023-10-16T13:38:18.971486+0000","last_unstale":"2023-10-16T13:38:20.002049+0000","last_undegraded":"2023-10-16T13:38:20.002049+0000","last_fullsized":"2023-10-16T13:38:20.002049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:55.029520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312272+0000","last_change":"2023-10-16T13:38:19.995763+0000","last_active":"2023-10-16T13:38:21.312272+0000","last_peered":"2023-10-16T13:38:21.312272+0000","last_clean":"2023-10-16T13:38:21.312272+0000","last_became_active":"2023-10-16T13:38:19.994356+0000","last_became_peered":"2023-10-16T13:38:19.994356+0000","last_unstale":"2023-10-16T13:38:21.312272+0000","last_undegraded":"2023-10-16T13:38:21.312272+0000","last_fullsized":"2023-10-16T13:38:21.312272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002621+0000","last_change":"2023-10-16T13:38:18.964587+0000","last_active":"2023-10-16T13:38:20.002621+0000","last_peered":"2023-10-16T13:38:20.002621+0000","last_clean":"2023-10-16T13:38:20.002621+0000","last_became_active":"2023-10-16T13:38:18.964045+0000","last_became_peered":"2023-10-16T13:38:18.964045+0000","last_unstale":"2023-10-16T13:38:20.002621+0000","last_undegraded":"2023-10-16T13:38:20.002621+0000","last_fullsized":"2023-10-16T13:38:20.002621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312674+0000","last_change":"2023-10-16T13:38:19.987703+0000","last_active":"2023-10-16T13:38:21.312674+0000","last_peered":"2023-10-16T13:38:21.312674+0000","last_clean":"2023-10-16T13:38:21.312674+0000","last_became_active":"2023-10-16T13:38:19.987424+0000","last_became_peered":"2023-10-16T13:38:19.987424+0000","last_unstale":"2023-10-16T13:38:21.312674+0000","last_undegraded":"2023-10-16T13:38:21.312674+0000","last_fullsized":"2023-10-16T13:38:21.312674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.976739+0000","last_change":"2023-10-16T13:38:18.971397+0000","last_active":"2023-10-16T13:38:19.976739+0000","last_peered":"2023-10-16T13:38:19.976739+0000","last_clean":"2023-10-16T13:38:19.976739+0000","last_became_active":"2023-10-16T13:38:18.970730+0000","last_became_peered":"2023-10-16T13:38:18.970730+0000","last_unstale":"2023-10-16T13:38:19.976739+0000","last_undegraded":"2023-10-16T13:38:19.976739+0000","last_fullsized":"2023-10-16T13:38:19.976739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997490+0000","last_change":"2023-10-16T13:38:19.989906+0000","last_active":"2023-10-16T13:38:20.997490+0000","last_peered":"2023-10-16T13:38:20.997490+0000","last_clean":"2023-10-16T13:38:20.997490+0000","last_became_active":"2023-10-16T13:38:19.989392+0000","last_became_peered":"2023-10-16T13:38:19.989392+0000","last_unstale":"2023-10-16T13:38:20.997490+0000","last_undegraded":"2023-10-16T13:38:20.997490+0000","last_fullsized":"2023-10-16T13:38:20.997490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980449+0000","last_change":"2023-10-16T13:38:18.971405+0000","last_active":"2023-10-16T13:38:19.980449+0000","last_peered":"2023-10-16T13:38:19.980449+0000","last_clean":"2023-10-16T13:38:19.980449+0000","last_became_active":"2023-10-16T13:38:18.970833+0000","last_became_peered":"2023-10-16T13:38:18.970833+0000","last_unstale":"2023-10-16T13:38:19.980449+0000","last_undegraded":"2023-10-16T13:38:19.980449+0000","last_fullsized":"2023-10-16T13:38:19.980449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.527487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996443+0000","last_change":"2023-10-16T13:38:19.994155+0000","last_active":"2023-10-16T13:38:20.996443+0000","last_peered":"2023-10-16T13:38:20.996443+0000","last_clean":"2023-10-16T13:38:20.996443+0000","last_became_active":"2023-10-16T13:38:19.993613+0000","last_became_peered":"2023-10-16T13:38:19.993613+0000","last_unstale":"2023-10-16T13:38:20.996443+0000","last_undegraded":"2023-10-16T13:38:20.996443+0000","last_fullsized":"2023-10-16T13:38:20.996443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:42.991395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988581+0000","last_change":"2023-10-16T13:38:19.985531+0000","last_active":"2023-10-16T13:38:20.988581+0000","last_peered":"2023-10-16T13:38:20.988581+0000","last_clean":"2023-10-16T13:38:20.988581+0000","last_became_active":"2023-10-16T13:38:19.985266+0000","last_became_peered":"2023-10-16T13:38:19.985266+0000","last_unstale":"2023-10-16T13:38:20.988581+0000","last_undegraded":"2023-10-16T13:38:20.988581+0000","last_fullsized":"2023-10-16T13:38:20.988581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972216+0000","last_change":"2023-10-16T13:38:18.964493+0000","last_active":"2023-10-16T13:38:19.972216+0000","last_peered":"2023-10-16T13:38:19.972216+0000","last_clean":"2023-10-16T13:38:19.972216+0000","last_became_active":"2023-10-16T13:38:18.964187+0000","last_became_peered":"2023-10-16T13:38:18.964187+0000","last_unstale":"2023-10-16T13:38:19.972216+0000","last_undegraded":"2023-10-16T13:38:19.972216+0000","last_fullsized":"2023-10-16T13:38:19.972216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398312+0000","last_change":"2023-10-16T13:38:19.997708+0000","last_active":"2023-10-16T13:38:21.398312+0000","last_peered":"2023-10-16T13:38:21.398312+0000","last_clean":"2023-10-16T13:38:21.398312+0000","last_became_active":"2023-10-16T13:38:19.997371+0000","last_became_peered":"2023-10-16T13:38:19.997371+0000","last_unstale":"2023-10-16T13:38:21.398312+0000","last_undegraded":"2023-10-16T13:38:21.398312+0000","last_fullsized":"2023-10-16T13:38:21.398312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980595+0000","last_change":"2023-10-16T13:38:18.954177+0000","last_active":"2023-10-16T13:38:19.980595+0000","last_peered":"2023-10-16T13:38:19.980595+0000","last_clean":"2023-10-16T13:38:19.980595+0000","last_became_active":"2023-10-16T13:38:18.953859+0000","last_became_peered":"2023-10-16T13:38:18.953859+0000","last_unstale":"2023-10-16T13:38:19.980595+0000","last_undegraded":"2023-10-16T13:38:19.980595+0000","last_fullsized":"2023-10-16T13:38:19.980595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:07.912567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972935+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:19.972935+0000","last_peered":"2023-10-16T13:38:19.972935+0000","last_clean":"2023-10-16T13:38:19.972935+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:19.972935+0000","last_undegraded":"2023-10-16T13:38:19.972935+0000","last_fullsized":"2023-10-16T13:38:19.972935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417024+0000","last_change":"2023-10-16T13:38:19.989240+0000","last_active":"2023-10-16T13:38:21.417024+0000","last_peered":"2023-10-16T13:38:21.417024+0000","last_clean":"2023-10-16T13:38:21.417024+0000","last_became_active":"2023-10-16T13:38:19.988888+0000","last_became_peered":"2023-10-16T13:38:19.988888+0000","last_unstale":"2023-10-16T13:38:21.417024+0000","last_undegraded":"2023-10-16T13:38:21.417024+0000","last_fullsized":"2023-10-16T13:38:21.417024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:46.323232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973036+0000","last_change":"2023-10-16T13:38:18.971283+0000","last_active":"2023-10-16T13:38:19.973036+0000","last_peered":"2023-10-16T13:38:19.973036+0000","last_clean":"2023-10-16T13:38:19.973036+0000","last_became_active":"2023-10-16T13:38:18.970896+0000","last_became_peered":"2023-10-16T13:38:18.970896+0000","last_unstale":"2023-10-16T13:38:19.973036+0000","last_undegraded":"2023-10-16T13:38:19.973036+0000","last_fullsized":"2023-10-16T13:38:19.973036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.978893+0000","last_change":"2023-10-16T13:38:18.969135+0000","last_active":"2023-10-16T13:38:19.978893+0000","last_peered":"2023-10-16T13:38:19.978893+0000","last_clean":"2023-10-16T13:38:19.978893+0000","last_became_active":"2023-10-16T13:38:18.968811+0000","last_became_peered":"2023-10-16T13:38:18.968811+0000","last_unstale":"2023-10-16T13:38:19.978893+0000","last_undegraded":"2023-10-16T13:38:19.978893+0000","last_fullsized":"2023-10-16T13:38:19.978893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988509+0000","last_change":"2023-10-16T13:38:19.987139+0000","last_active":"2023-10-16T13:38:20.988509+0000","last_peered":"2023-10-16T13:38:20.988509+0000","last_clean":"2023-10-16T13:38:20.988509+0000","last_became_active":"2023-10-16T13:38:19.986018+0000","last_became_peered":"2023-10-16T13:38:19.986018+0000","last_unstale":"2023-10-16T13:38:20.988509+0000","last_undegraded":"2023-10-16T13:38:20.988509+0000","last_fullsized":"2023-10-16T13:38:20.988509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988441+0000","last_change":"2023-10-16T13:38:18.969084+0000","last_active":"2023-10-16T13:38:20.988441+0000","last_peered":"2023-10-16T13:38:20.988441+0000","last_clean":"2023-10-16T13:38:20.988441+0000","last_became_active":"2023-10-16T13:38:18.968714+0000","last_became_peered":"2023-10-16T13:38:18.968714+0000","last_unstale":"2023-10-16T13:38:20.988441+0000","last_undegraded":"2023-10-16T13:38:20.988441+0000","last_fullsized":"2023-10-16T13:38:20.988441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398414+0000","last_change":"2023-10-16T13:38:19.987735+0000","last_active":"2023-10-16T13:38:21.398414+0000","last_peered":"2023-10-16T13:38:21.398414+0000","last_clean":"2023-10-16T13:38:21.398414+0000","last_became_active":"2023-10-16T13:38:19.986959+0000","last_became_peered":"2023-10-16T13:38:19.986959+0000","last_unstale":"2023-10-16T13:38:21.398414+0000","last_undegraded":"2023-10-16T13:38:21.398414+0000","last_fullsized":"2023-10-16T13:38:21.398414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000677+0000","last_change":"2023-10-16T13:38:18.967312+0000","last_active":"2023-10-16T13:38:20.000677+0000","last_peered":"2023-10-16T13:38:20.000677+0000","last_clean":"2023-10-16T13:38:20.000677+0000","last_became_active":"2023-10-16T13:38:18.966996+0000","last_became_peered":"2023-10-16T13:38:18.966996+0000","last_unstale":"2023-10-16T13:38:20.000677+0000","last_undegraded":"2023-10-16T13:38:20.000677+0000","last_fullsized":"2023-10-16T13:38:20.000677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417342+0000","last_change":"2023-10-16T13:38:19.991995+0000","last_active":"2023-10-16T13:38:21.417342+0000","last_peered":"2023-10-16T13:38:21.417342+0000","last_clean":"2023-10-16T13:38:21.417342+0000","last_became_active":"2023-10-16T13:38:19.991675+0000","last_became_peered":"2023-10-16T13:38:19.991675+0000","last_unstale":"2023-10-16T13:38:21.417342+0000","last_undegraded":"2023-10-16T13:38:21.417342+0000","last_fullsized":"2023-10-16T13:38:21.417342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972826+0000","last_change":"2023-10-16T13:38:18.965736+0000","last_active":"2023-10-16T13:38:19.972826+0000","last_peered":"2023-10-16T13:38:19.972826+0000","last_clean":"2023-10-16T13:38:19.972826+0000","last_became_active":"2023-10-16T13:38:18.965488+0000","last_became_peered":"2023-10-16T13:38:18.965488+0000","last_unstale":"2023-10-16T13:38:19.972826+0000","last_undegraded":"2023-10-16T13:38:19.972826+0000","last_fullsized":"2023-10-16T13:38:19.972826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997267+0000","last_change":"2023-10-16T13:38:19.988592+0000","last_active":"2023-10-16T13:38:20.997267+0000","last_peered":"2023-10-16T13:38:20.997267+0000","last_clean":"2023-10-16T13:38:20.997267+0000","last_became_active":"2023-10-16T13:38:19.988222+0000","last_became_peered":"2023-10-16T13:38:19.988222+0000","last_unstale":"2023-10-16T13:38:20.997267+0000","last_undegraded":"2023-10-16T13:38:20.997267+0000","last_fullsized":"2023-10-16T13:38:20.997267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:09.486295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973837+0000","last_change":"2023-10-16T13:38:18.970765+0000","last_active":"2023-10-16T13:38:19.973837+0000","last_peered":"2023-10-16T13:38:19.973837+0000","last_clean":"2023-10-16T13:38:19.973837+0000","last_became_active":"2023-10-16T13:38:18.970373+0000","last_became_peered":"2023-10-16T13:38:18.970373+0000","last_unstale":"2023-10-16T13:38:19.973837+0000","last_undegraded":"2023-10-16T13:38:19.973837+0000","last_fullsized":"2023-10-16T13:38:19.973837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397986+0000","last_change":"2023-10-16T13:38:19.987493+0000","last_active":"2023-10-16T13:38:21.397986+0000","last_peered":"2023-10-16T13:38:21.397986+0000","last_clean":"2023-10-16T13:38:21.397986+0000","last_became_active":"2023-10-16T13:38:19.987196+0000","last_became_peered":"2023-10-16T13:38:19.987196+0000","last_unstale":"2023-10-16T13:38:21.397986+0000","last_undegraded":"2023-10-16T13:38:21.397986+0000","last_fullsized":"2023-10-16T13:38:21.397986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972485+0000","last_change":"2023-10-16T13:38:18.971500+0000","last_active":"2023-10-16T13:38:19.972485+0000","last_peered":"2023-10-16T13:38:19.972485+0000","last_clean":"2023-10-16T13:38:19.972485+0000","last_became_active":"2023-10-16T13:38:18.971072+0000","last_became_peered":"2023-10-16T13:38:18.971072+0000","last_unstale":"2023-10-16T13:38:19.972485+0000","last_undegraded":"2023-10-16T13:38:19.972485+0000","last_fullsized":"2023-10-16T13:38:19.972485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398558+0000","last_change":"2023-10-16T13:38:19.993658+0000","last_active":"2023-10-16T13:38:21.398558+0000","last_peered":"2023-10-16T13:38:21.398558+0000","last_clean":"2023-10-16T13:38:21.398558+0000","last_became_active":"2023-10-16T13:38:19.993109+0000","last_became_peered":"2023-10-16T13:38:19.993109+0000","last_unstale":"2023-10-16T13:38:21.398558+0000","last_undegraded":"2023-10-16T13:38:21.398558+0000","last_fullsized":"2023-10-16T13:38:21.398558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000611+0000","last_change":"2023-10-16T13:38:18.969196+0000","last_active":"2023-10-16T13:38:20.000611+0000","last_peered":"2023-10-16T13:38:20.000611+0000","last_clean":"2023-10-16T13:38:20.000611+0000","last_became_active":"2023-10-16T13:38:18.968947+0000","last_became_peered":"2023-10-16T13:38:18.968947+0000","last_unstale":"2023-10-16T13:38:20.000611+0000","last_undegraded":"2023-10-16T13:38:20.000611+0000","last_fullsized":"2023-10-16T13:38:20.000611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876093+0000","last_change":"2023-10-16T13:38:19.987465+0000","last_active":"2023-10-16T13:38:21.876093+0000","last_peered":"2023-10-16T13:38:21.876093+0000","last_clean":"2023-10-16T13:38:21.876093+0000","last_became_active":"2023-10-16T13:38:19.987060+0000","last_became_peered":"2023-10-16T13:38:19.987060+0000","last_unstale":"2023-10-16T13:38:21.876093+0000","last_undegraded":"2023-10-16T13:38:21.876093+0000","last_fullsized":"2023-10-16T13:38:21.876093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973130+0000","last_change":"2023-10-16T13:38:18.955240+0000","last_active":"2023-10-16T13:38:19.973130+0000","last_peered":"2023-10-16T13:38:19.973130+0000","last_clean":"2023-10-16T13:38:19.973130+0000","last_became_active":"2023-10-16T13:38:18.954854+0000","last_became_peered":"2023-10-16T13:38:18.954854+0000","last_unstale":"2023-10-16T13:38:19.973130+0000","last_undegraded":"2023-10-16T13:38:19.973130+0000","last_fullsized":"2023-10-16T13:38:19.973130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312661+0000","last_change":"2023-10-16T13:38:19.999600+0000","last_active":"2023-10-16T13:38:21.312661+0000","last_peered":"2023-10-16T13:38:21.312661+0000","last_clean":"2023-10-16T13:38:21.312661+0000","last_became_active":"2023-10-16T13:38:19.999328+0000","last_became_peered":"2023-10-16T13:38:19.999328+0000","last_unstale":"2023-10-16T13:38:21.312661+0000","last_undegraded":"2023-10-16T13:38:21.312661+0000","last_fullsized":"2023-10-16T13:38:21.312661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001300+0000","last_change":"2023-10-16T13:38:18.972416+0000","last_active":"2023-10-16T13:38:20.001300+0000","last_peered":"2023-10-16T13:38:20.001300+0000","last_clean":"2023-10-16T13:38:20.001300+0000","last_became_active":"2023-10-16T13:38:18.972134+0000","last_became_peered":"2023-10-16T13:38:18.972134+0000","last_unstale":"2023-10-16T13:38:20.001300+0000","last_undegraded":"2023-10-16T13:38:20.001300+0000","last_fullsized":"2023-10-16T13:38:20.001300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997167+0000","last_change":"2023-10-16T13:38:19.989464+0000","last_active":"2023-10-16T13:38:20.997167+0000","last_peered":"2023-10-16T13:38:20.997167+0000","last_clean":"2023-10-16T13:38:20.997167+0000","last_became_active":"2023-10-16T13:38:19.988949+0000","last_became_peered":"2023-10-16T13:38:19.988949+0000","last_unstale":"2023-10-16T13:38:20.997167+0000","last_undegraded":"2023-10-16T13:38:20.997167+0000","last_fullsized":"2023-10-16T13:38:20.997167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.003246+0000","last_change":"2023-10-16T13:38:18.962000+0000","last_active":"2023-10-16T13:38:20.003246+0000","last_peered":"2023-10-16T13:38:20.003246+0000","last_clean":"2023-10-16T13:38:20.003246+0000","last_became_active":"2023-10-16T13:38:18.961681+0000","last_became_peered":"2023-10-16T13:38:18.961681+0000","last_unstale":"2023-10-16T13:38:20.003246+0000","last_undegraded":"2023-10-16T13:38:20.003246+0000","last_fullsized":"2023-10-16T13:38:20.003246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312823+0000","last_change":"2023-10-16T13:38:19.991640+0000","last_active":"2023-10-16T13:38:21.312823+0000","last_peered":"2023-10-16T13:38:21.312823+0000","last_clean":"2023-10-16T13:38:21.312823+0000","last_became_active":"2023-10-16T13:38:19.990115+0000","last_became_peered":"2023-10-16T13:38:19.990115+0000","last_unstale":"2023-10-16T13:38:21.312823+0000","last_undegraded":"2023-10-16T13:38:21.312823+0000","last_fullsized":"2023-10-16T13:38:21.312823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:21:33.323265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875839+0000","last_change":"2023-10-16T13:38:19.995109+0000","last_active":"2023-10-16T13:38:21.875839+0000","last_peered":"2023-10-16T13:38:21.875839+0000","last_clean":"2023-10-16T13:38:21.875839+0000","last_became_active":"2023-10-16T13:38:19.994801+0000","last_became_peered":"2023-10-16T13:38:19.994801+0000","last_unstale":"2023-10-16T13:38:21.875839+0000","last_undegraded":"2023-10-16T13:38:21.875839+0000","last_fullsized":"2023-10-16T13:38:21.875839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821362+0000","last_change":"2023-10-16T13:38:19.990599+0000","last_active":"2023-10-16T13:38:21.821362+0000","last_peered":"2023-10-16T13:38:21.821362+0000","last_clean":"2023-10-16T13:38:21.821362+0000","last_became_active":"2023-10-16T13:38:19.990337+0000","last_became_peered":"2023-10-16T13:38:19.990337+0000","last_unstale":"2023-10-16T13:38:21.821362+0000","last_undegraded":"2023-10-16T13:38:21.821362+0000","last_fullsized":"2023-10-16T13:38:21.821362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:42.945644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996891+0000","last_change":"2023-10-16T13:38:19.996805+0000","last_active":"2023-10-16T13:38:20.996891+0000","last_peered":"2023-10-16T13:38:20.996891+0000","last_clean":"2023-10-16T13:38:20.996891+0000","last_became_active":"2023-10-16T13:38:19.996509+0000","last_became_peered":"2023-10-16T13:38:19.996509+0000","last_unstale":"2023-10-16T13:38:20.996891+0000","last_undegraded":"2023-10-16T13:38:20.996891+0000","last_fullsized":"2023-10-16T13:38:20.996891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417362+0000","last_change":"2023-10-16T13:38:19.992691+0000","last_active":"2023-10-16T13:38:21.417362+0000","last_peered":"2023-10-16T13:38:21.417362+0000","last_clean":"2023-10-16T13:38:21.417362+0000","last_became_active":"2023-10-16T13:38:19.992360+0000","last_became_peered":"2023-10-16T13:38:19.992360+0000","last_unstale":"2023-10-16T13:38:21.417362+0000","last_undegraded":"2023-10-16T13:38:21.417362+0000","last_fullsized":"2023-10-16T13:38:21.417362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398282+0000","last_change":"2023-10-16T13:38:19.985294+0000","last_active":"2023-10-16T13:38:21.398282+0000","last_peered":"2023-10-16T13:38:21.398282+0000","last_clean":"2023-10-16T13:38:21.398282+0000","last_became_active":"2023-10-16T13:38:19.985063+0000","last_became_peered":"2023-10-16T13:38:19.985063+0000","last_unstale":"2023-10-16T13:38:21.398282+0000","last_undegraded":"2023-10-16T13:38:21.398282+0000","last_fullsized":"2023-10-16T13:38:21.398282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.980791+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.980473+0000","last_became_peered":"2023-10-16T13:38:19.980473+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876183+0000","last_change":"2023-10-16T13:38:19.986596+0000","last_active":"2023-10-16T13:38:21.876183+0000","last_peered":"2023-10-16T13:38:21.876183+0000","last_clean":"2023-10-16T13:38:21.876183+0000","last_became_active":"2023-10-16T13:38:19.986288+0000","last_became_peered":"2023-10-16T13:38:19.986288+0000","last_unstale":"2023-10-16T13:38:21.876183+0000","last_undegraded":"2023-10-16T13:38:21.876183+0000","last_fullsized":"2023-10-16T13:38:21.876183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398398+0000","last_change":"2023-10-16T13:38:19.983880+0000","last_active":"2023-10-16T13:38:21.398398+0000","last_peered":"2023-10-16T13:38:21.398398+0000","last_clean":"2023-10-16T13:38:21.398398+0000","last_became_active":"2023-10-16T13:38:19.983548+0000","last_became_peered":"2023-10-16T13:38:19.983548+0000","last_unstale":"2023-10-16T13:38:21.398398+0000","last_undegraded":"2023-10-16T13:38:21.398398+0000","last_fullsized":"2023-10-16T13:38:21.398398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996462+0000","last_change":"2023-10-16T13:38:19.996604+0000","last_active":"2023-10-16T13:38:20.996462+0000","last_peered":"2023-10-16T13:38:20.996462+0000","last_clean":"2023-10-16T13:38:20.996462+0000","last_became_active":"2023-10-16T13:38:19.995929+0000","last_became_peered":"2023-10-16T13:38:19.995929+0000","last_unstale":"2023-10-16T13:38:20.996462+0000","last_undegraded":"2023-10-16T13:38:20.996462+0000","last_fullsized":"2023-10-16T13:38:20.996462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398082+0000","last_change":"2023-10-16T13:38:19.986068+0000","last_active":"2023-10-16T13:38:21.398082+0000","last_peered":"2023-10-16T13:38:21.398082+0000","last_clean":"2023-10-16T13:38:21.398082+0000","last_became_active":"2023-10-16T13:38:19.985755+0000","last_became_peered":"2023-10-16T13:38:19.985755+0000","last_unstale":"2023-10-16T13:38:21.398082+0000","last_undegraded":"2023-10-16T13:38:21.398082+0000","last_fullsized":"2023-10-16T13:38:21.398082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997136+0000","last_change":"2023-10-16T13:38:19.995901+0000","last_active":"2023-10-16T13:38:20.997136+0000","last_peered":"2023-10-16T13:38:20.997136+0000","last_clean":"2023-10-16T13:38:20.997136+0000","last_became_active":"2023-10-16T13:38:19.994807+0000","last_became_peered":"2023-10-16T13:38:19.994807+0000","last_unstale":"2023-10-16T13:38:20.997136+0000","last_undegraded":"2023-10-16T13:38:20.997136+0000","last_fullsized":"2023-10-16T13:38:20.997136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417224+0000","last_change":"2023-10-16T13:38:20.001012+0000","last_active":"2023-10-16T13:38:21.417224+0000","last_peered":"2023-10-16T13:38:21.417224+0000","last_clean":"2023-10-16T13:38:21.417224+0000","last_became_active":"2023-10-16T13:38:20.000625+0000","last_became_peered":"2023-10-16T13:38:20.000625+0000","last_unstale":"2023-10-16T13:38:21.417224+0000","last_undegraded":"2023-10-16T13:38:21.417224+0000","last_fullsized":"2023-10-16T13:38:21.417224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876030+0000","last_change":"2023-10-16T13:38:19.987393+0000","last_active":"2023-10-16T13:38:21.876030+0000","last_peered":"2023-10-16T13:38:21.876030+0000","last_clean":"2023-10-16T13:38:21.876030+0000","last_became_active":"2023-10-16T13:38:19.987088+0000","last_became_peered":"2023-10-16T13:38:19.987088+0000","last_unstale":"2023-10-16T13:38:21.876030+0000","last_undegraded":"2023-10-16T13:38:21.876030+0000","last_fullsized":"2023-10-16T13:38:21.876030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:27.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:38:27.086 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:38:28.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:28.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.930+0000 7f042cb1b700 1 Processor -- start 2023-10-16T13:38:28.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.930+0000 7f042cb1b700 1 -- start start 2023-10-16T13:38:28.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.931+0000 7f042cb1b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f042806af50 0x7f0428168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:28.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.931+0000 7f042cb1b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0428161390 con 0x7f0428160fb0 2023-10-16T13:38:28.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.931+0000 7f042cb1b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280b23f0 con 0x7f04280cee40 2023-10-16T13:38:28.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.931+0000 7f042cb1b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280cf2f0 con 0x7f042806af50 2023-10-16T13:38:28.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0428160fb0 0x7f04280727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51894/0 (socket says 172.21.15.5:51894) 2023-10-16T13:38:28.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042659c700 1 -- 172.21.15.5:0/3703133007 learned_addr learned my addr 172.21.15.5:0/3703133007 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:28.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f0426d9d700 1 --2- 172.21.15.5:0/3703133007 >> v2:172.21.15.112:3300/0 conn(0x7f042806af50 0x7f0428168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:28.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042559a700 1 -- 172.21.15.5:0/3703133007 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117590349 0 0) 0x7f0428161390 con 0x7f0428160fb0 2023-10-16T13:38:28.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042559a700 1 -- 172.21.15.5:0/3703133007 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04100035b0 con 0x7f0428160fb0 2023-10-16T13:38:28.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f0426d9d700 1 -- 172.21.15.5:0/3703133007 >> v1:172.21.15.112:6789/0 conn(0x7f04280cee40 legacy=0x7f042806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:28.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f0426d9d700 1 -- 172.21.15.5:0/3703133007 >> v1:172.21.15.5:6789/0 conn(0x7f0428160fb0 legacy=0x7f04280727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:28.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042559a700 1 -- 172.21.15.5:0/3703133007 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519813319 0 0) 0x7f04280b23f0 con 0x7f04280cee40 2023-10-16T13:38:28.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f0426d9d700 1 -- 172.21.15.5:0/3703133007 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280b26b0 con 0x7f042806af50 2023-10-16T13:38:28.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f0426d9d700 1 --2- 172.21.15.5:0/3703133007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f042806af50 0x7f0428168930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0420009d90 tx=0x7f042000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736550d633ac774 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:28.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042559a700 1 -- 172.21.15.5:0/3703133007 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042000e070 con 0x7f042806af50 2023-10-16T13:38:28.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.932+0000 7f042559a700 1 -- 172.21.15.5:0/3703133007 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420003a20 con 0x7f042806af50 2023-10-16T13:38:28.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042559a700 1 -- 172.21.15.5:0/3703133007 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418001770 con 0x7f042806af50 2023-10-16T13:38:28.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 -- 172.21.15.5:0/3703133007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f042806af50 msgr2=0x7f0428168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:28.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3703133007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f042806af50 0x7f0428168930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0420009d90 tx=0x7f042000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:28.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 -- 172.21.15.5:0/3703133007 shutdown_connections 2023-10-16T13:38:28.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3703133007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f042806af50 0x7f0428168930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:28.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 -- 172.21.15.5:0/3703133007 >> 172.21.15.5:0/3703133007 conn(0x7f04280cd270 msgr2=0x7f04280cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:28.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 -- 172.21.15.5:0/3703133007 shutdown_connections 2023-10-16T13:38:28.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.933+0000 7f042cb1b700 1 -- 172.21.15.5:0/3703133007 wait complete. 2023-10-16T13:38:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 Processor -- start 2023-10-16T13:38:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 -- start start 2023-10-16T13:38:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f042806af50 0x7f04280aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 0x7f04280b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0428160fb0 0x7f04281514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280ad3f0 con 0x7f04280cee40 2023-10-16T13:38:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280aca50 con 0x7f0428160fb0 2023-10-16T13:38:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.935+0000 7f042cb1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04280acd30 con 0x7f042806af50 2023-10-16T13:38:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 0x7f04280b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 0x7f04280b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41898/0 (socket says 172.21.15.5:41898) 2023-10-16T13:38:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 -- 172.21.15.5:0/3856047590 learned_addr learned my addr 172.21.15.5:0/3856047590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0426d9d700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0428160fb0 0x7f04281514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f042659c700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f042806af50 0x7f04280aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 -- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f042806af50 msgr2=0x7f04280aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f042806af50 0x7f04280aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 -- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0428160fb0 msgr2=0x7f04281514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0428160fb0 0x7f04281514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 -- 172.21.15.5:0/3856047590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009a70 con 0x7f04280cee40 2023-10-16T13:38:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f042659c700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f042806af50 0x7f04280aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0425d9b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 0x7f04280b3e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f041c00c780 tx=0x7f041c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c0054e0 con 0x7f04280cee40 2023-10-16T13:38:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c003680 con 0x7f04280cee40 2023-10-16T13:38:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280ad010 con 0x7f04280cee40 2023-10-16T13:38:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c003a30 con 0x7f04280cee40 2023-10-16T13:38:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.936+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04281519f0 con 0x7f04280cee40 2023-10-16T13:38:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.937+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04280ad530 con 0x7f04280cee40 2023-10-16T13:38:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.938+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f041c003b90 con 0x7f04280cee40 2023-10-16T13:38:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.938+0000 7f0416ffd700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f040806af30 0x7f040806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.938+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f041c088a70 con 0x7f04280cee40 2023-10-16T13:38:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.938+0000 7f042659c700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f040806af30 0x7f040806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.939+0000 7f042659c700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f040806af30 0x7f040806d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04180018a0 tx=0x7f0418009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:28.943+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f041c053b20 con 0x7f04280cee40 2023-10-16T13:38:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.141+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04280acbc0 con 0x7f040806af30 2023-10-16T13:38:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.149+0000 7f0416ffd700 1 -- 172.21.15.5:0/3856047590 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264788 (secure 0 0 0) 0x7f04280acbc0 con 0x7f040806af30 2023-10-16T13:38:29.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.151+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f040806af30 msgr2=0x7f040806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.151+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f040806af30 0x7f040806d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04180018a0 tx=0x7f0418009040 comp rx=0 tx=0).stop 2023-10-16T13:38:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 msgr2=0x7f04280b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 0x7f04280b3e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f041c00c780 tx=0x7f041c00ca90 comp rx=0 tx=0).stop 2023-10-16T13:38:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 shutdown_connections 2023-10-16T13:38:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0428160fb0 0x7f04281514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f040806af30 0x7f040806d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f042806af50 0x7f04280aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 --2- 172.21.15.5:0/3856047590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04280cee40 0x7f04280b3e00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 >> 172.21.15.5:0/3856047590 conn(0x7f04280cd270 msgr2=0x7f04280cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 shutdown_connections 2023-10-16T13:38:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.152+0000 7f042cb1b700 1 -- 172.21.15.5:0/3856047590 wait complete. 2023-10-16T13:38:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:29.169 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-16T13:38:27.457895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2883584,"data_stored":1750702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002059"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312791+0000","last_change":"2023-10-16T13:38:19.985659+0000","last_active":"2023-10-16T13:38:21.312791+0000","last_peered":"2023-10-16T13:38:21.312791+0000","last_clean":"2023-10-16T13:38:21.312791+0000","last_became_active":"2023-10-16T13:38:19.985250+0000","last_became_peered":"2023-10-16T13:38:19.985250+0000","last_unstale":"2023-10-16T13:38:21.312791+0000","last_undegraded":"2023-10-16T13:38:21.312791+0000","last_fullsized":"2023-10-16T13:38:21.312791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:21:57.591824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988596+0000","last_change":"2023-10-16T13:38:19.985144+0000","last_active":"2023-10-16T13:38:20.988596+0000","last_peered":"2023-10-16T13:38:20.988596+0000","last_clean":"2023-10-16T13:38:20.988596+0000","last_became_active":"2023-10-16T13:38:19.984801+0000","last_became_peered":"2023-10-16T13:38:19.984801+0000","last_unstale":"2023-10-16T13:38:20.988596+0000","last_undegraded":"2023-10-16T13:38:20.988596+0000","last_fullsized":"2023-10-16T13:38:20.988596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417314+0000","last_change":"2023-10-16T13:38:19.992389+0000","last_active":"2023-10-16T13:38:21.417314+0000","last_peered":"2023-10-16T13:38:21.417314+0000","last_clean":"2023-10-16T13:38:21.417314+0000","last_became_active":"2023-10-16T13:38:19.991965+0000","last_became_peered":"2023-10-16T13:38:19.991965+0000","last_unstale":"2023-10-16T13:38:21.417314+0000","last_undegraded":"2023-10-16T13:38:21.417314+0000","last_fullsized":"2023-10-16T13:38:21.417314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996709+0000","last_change":"2023-10-16T13:38:19.994269+0000","last_active":"2023-10-16T13:38:20.996709+0000","last_peered":"2023-10-16T13:38:20.996709+0000","last_clean":"2023-10-16T13:38:20.996709+0000","last_became_active":"2023-10-16T13:38:19.989727+0000","last_became_peered":"2023-10-16T13:38:19.989727+0000","last_unstale":"2023-10-16T13:38:20.996709+0000","last_undegraded":"2023-10-16T13:38:20.996709+0000","last_fullsized":"2023-10-16T13:38:20.996709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312381+0000","last_change":"2023-10-16T13:38:19.988406+0000","last_active":"2023-10-16T13:38:21.312381+0000","last_peered":"2023-10-16T13:38:21.312381+0000","last_clean":"2023-10-16T13:38:21.312381+0000","last_became_active":"2023-10-16T13:38:19.985680+0000","last_became_peered":"2023-10-16T13:38:19.985680+0000","last_unstale":"2023-10-16T13:38:21.312381+0000","last_undegraded":"2023-10-16T13:38:21.312381+0000","last_fullsized":"2023-10-16T13:38:21.312381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996738+0000","last_change":"2023-10-16T13:38:19.997527+0000","last_active":"2023-10-16T13:38:20.996738+0000","last_peered":"2023-10-16T13:38:20.996738+0000","last_clean":"2023-10-16T13:38:20.996738+0000","last_became_active":"2023-10-16T13:38:19.997232+0000","last_became_peered":"2023-10-16T13:38:19.997232+0000","last_unstale":"2023-10-16T13:38:20.996738+0000","last_undegraded":"2023-10-16T13:38:20.996738+0000","last_fullsized":"2023-10-16T13:38:20.996738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312178+0000","last_change":"2023-10-16T13:38:19.994384+0000","last_active":"2023-10-16T13:38:21.312178+0000","last_peered":"2023-10-16T13:38:21.312178+0000","last_clean":"2023-10-16T13:38:21.312178+0000","last_became_active":"2023-10-16T13:38:19.993971+0000","last_became_peered":"2023-10-16T13:38:19.993971+0000","last_unstale":"2023-10-16T13:38:21.312178+0000","last_undegraded":"2023-10-16T13:38:21.312178+0000","last_fullsized":"2023-10-16T13:38:21.312178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397908+0000","last_change":"2023-10-16T13:38:19.995124+0000","last_active":"2023-10-16T13:38:21.397908+0000","last_peered":"2023-10-16T13:38:21.397908+0000","last_clean":"2023-10-16T13:38:21.397908+0000","last_became_active":"2023-10-16T13:38:19.994763+0000","last_became_peered":"2023-10-16T13:38:19.994763+0000","last_unstale":"2023-10-16T13:38:21.397908+0000","last_undegraded":"2023-10-16T13:38:21.397908+0000","last_fullsized":"2023-10-16T13:38:21.397908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312737+0000","last_change":"2023-10-16T13:38:19.992050+0000","last_active":"2023-10-16T13:38:21.312737+0000","last_peered":"2023-10-16T13:38:21.312737+0000","last_clean":"2023-10-16T13:38:21.312737+0000","last_became_active":"2023-10-16T13:38:19.991296+0000","last_became_peered":"2023-10-16T13:38:19.991296+0000","last_unstale":"2023-10-16T13:38:21.312737+0000","last_undegraded":"2023-10-16T13:38:21.312737+0000","last_fullsized":"2023-10-16T13:38:21.312737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:16.455246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876286+0000","last_change":"2023-10-16T13:38:19.998323+0000","last_active":"2023-10-16T13:38:21.876286+0000","last_peered":"2023-10-16T13:38:21.876286+0000","last_clean":"2023-10-16T13:38:21.876286+0000","last_became_active":"2023-10-16T13:38:19.998022+0000","last_became_peered":"2023-10-16T13:38:19.998022+0000","last_unstale":"2023-10-16T13:38:21.876286+0000","last_undegraded":"2023-10-16T13:38:21.876286+0000","last_fullsized":"2023-10-16T13:38:21.876286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876144+0000","last_change":"2023-10-16T13:38:19.998317+0000","last_active":"2023-10-16T13:38:21.876144+0000","last_peered":"2023-10-16T13:38:21.876144+0000","last_clean":"2023-10-16T13:38:21.876144+0000","last_became_active":"2023-10-16T13:38:19.998043+0000","last_became_peered":"2023-10-16T13:38:19.998043+0000","last_unstale":"2023-10-16T13:38:21.876144+0000","last_undegraded":"2023-10-16T13:38:21.876144+0000","last_fullsized":"2023-10-16T13:38:21.876144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997767+0000","last_change":"2023-10-16T13:38:19.985697+0000","last_active":"2023-10-16T13:38:20.997767+0000","last_peered":"2023-10-16T13:38:20.997767+0000","last_clean":"2023-10-16T13:38:20.997767+0000","last_became_active":"2023-10-16T13:38:19.985438+0000","last_became_peered":"2023-10-16T13:38:19.985438+0000","last_unstale":"2023-10-16T13:38:20.997767+0000","last_undegraded":"2023-10-16T13:38:20.997767+0000","last_fullsized":"2023-10-16T13:38:20.997767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:17.751681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398231+0000","last_change":"2023-10-16T13:38:19.984535+0000","last_active":"2023-10-16T13:38:21.398231+0000","last_peered":"2023-10-16T13:38:21.398231+0000","last_clean":"2023-10-16T13:38:21.398231+0000","last_became_active":"2023-10-16T13:38:19.984237+0000","last_became_peered":"2023-10-16T13:38:19.984237+0000","last_unstale":"2023-10-16T13:38:21.398231+0000","last_undegraded":"2023-10-16T13:38:21.398231+0000","last_fullsized":"2023-10-16T13:38:21.398231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417158+0000","last_change":"2023-10-16T13:38:19.992598+0000","last_active":"2023-10-16T13:38:21.417158+0000","last_peered":"2023-10-16T13:38:21.417158+0000","last_clean":"2023-10-16T13:38:21.417158+0000","last_became_active":"2023-10-16T13:38:19.990440+0000","last_became_peered":"2023-10-16T13:38:19.990440+0000","last_unstale":"2023-10-16T13:38:21.417158+0000","last_undegraded":"2023-10-16T13:38:21.417158+0000","last_fullsized":"2023-10-16T13:38:21.417158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988246+0000","last_change":"2023-10-16T13:38:19.994076+0000","last_active":"2023-10-16T13:38:20.988246+0000","last_peered":"2023-10-16T13:38:20.988246+0000","last_clean":"2023-10-16T13:38:20.988246+0000","last_became_active":"2023-10-16T13:38:19.993816+0000","last_became_peered":"2023-10-16T13:38:19.993816+0000","last_unstale":"2023-10-16T13:38:20.988246+0000","last_undegraded":"2023-10-16T13:38:20.988246+0000","last_fullsized":"2023-10-16T13:38:20.988246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996244+0000","last_change":"2023-10-16T13:38:19.997326+0000","last_active":"2023-10-16T13:38:20.996244+0000","last_peered":"2023-10-16T13:38:20.996244+0000","last_clean":"2023-10-16T13:38:20.996244+0000","last_became_active":"2023-10-16T13:38:19.997047+0000","last_became_peered":"2023-10-16T13:38:19.997047+0000","last_unstale":"2023-10-16T13:38:20.996244+0000","last_undegraded":"2023-10-16T13:38:20.996244+0000","last_fullsized":"2023-10-16T13:38:20.996244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997157+0000","last_change":"2023-10-16T13:38:19.990024+0000","last_active":"2023-10-16T13:38:20.997157+0000","last_peered":"2023-10-16T13:38:20.997157+0000","last_clean":"2023-10-16T13:38:20.997157+0000","last_became_active":"2023-10-16T13:38:19.989585+0000","last_became_peered":"2023-10-16T13:38:19.989585+0000","last_unstale":"2023-10-16T13:38:20.997157+0000","last_undegraded":"2023-10-16T13:38:20.997157+0000","last_fullsized":"2023-10-16T13:38:20.997157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821413+0000","last_change":"2023-10-16T13:38:19.985061+0000","last_active":"2023-10-16T13:38:21.821413+0000","last_peered":"2023-10-16T13:38:21.821413+0000","last_clean":"2023-10-16T13:38:21.821413+0000","last_became_active":"2023-10-16T13:38:19.984723+0000","last_became_peered":"2023-10-16T13:38:19.984723+0000","last_unstale":"2023-10-16T13:38:21.821413+0000","last_undegraded":"2023-10-16T13:38:21.821413+0000","last_fullsized":"2023-10-16T13:38:21.821413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:40.348223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312495+0000","last_change":"2023-10-16T13:38:19.986577+0000","last_active":"2023-10-16T13:38:21.312495+0000","last_peered":"2023-10-16T13:38:21.312495+0000","last_clean":"2023-10-16T13:38:21.312495+0000","last_became_active":"2023-10-16T13:38:19.986061+0000","last_became_peered":"2023-10-16T13:38:19.986061+0000","last_unstale":"2023-10-16T13:38:21.312495+0000","last_undegraded":"2023-10-16T13:38:21.312495+0000","last_fullsized":"2023-10-16T13:38:21.312495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.008095+0000","last_change":"2023-10-16T13:38:18.965787+0000","last_active":"2023-10-16T13:38:20.008095+0000","last_peered":"2023-10-16T13:38:20.008095+0000","last_clean":"2023-10-16T13:38:20.008095+0000","last_became_active":"2023-10-16T13:38:18.965323+0000","last_became_peered":"2023-10-16T13:38:18.965323+0000","last_unstale":"2023-10-16T13:38:20.008095+0000","last_undegraded":"2023-10-16T13:38:20.008095+0000","last_fullsized":"2023-10-16T13:38:20.008095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398158+0000","last_change":"2023-10-16T13:38:19.985506+0000","last_active":"2023-10-16T13:38:21.398158+0000","last_peered":"2023-10-16T13:38:21.398158+0000","last_clean":"2023-10-16T13:38:21.398158+0000","last_became_active":"2023-10-16T13:38:19.985155+0000","last_became_peered":"2023-10-16T13:38:19.985155+0000","last_unstale":"2023-10-16T13:38:21.398158+0000","last_undegraded":"2023-10-16T13:38:21.398158+0000","last_fullsized":"2023-10-16T13:38:21.398158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002649+0000","last_change":"2023-10-16T13:38:18.965668+0000","last_active":"2023-10-16T13:38:20.002649+0000","last_peered":"2023-10-16T13:38:20.002649+0000","last_clean":"2023-10-16T13:38:20.002649+0000","last_became_active":"2023-10-16T13:38:18.965214+0000","last_became_peered":"2023-10-16T13:38:18.965214+0000","last_unstale":"2023-10-16T13:38:20.002649+0000","last_undegraded":"2023-10-16T13:38:20.002649+0000","last_fullsized":"2023-10-16T13:38:20.002649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417258+0000","last_change":"2023-10-16T13:38:19.997063+0000","last_active":"2023-10-16T13:38:21.417258+0000","last_peered":"2023-10-16T13:38:21.417258+0000","last_clean":"2023-10-16T13:38:21.417258+0000","last_became_active":"2023-10-16T13:38:19.996754+0000","last_became_peered":"2023-10-16T13:38:19.996754+0000","last_unstale":"2023-10-16T13:38:21.417258+0000","last_undegraded":"2023-10-16T13:38:21.417258+0000","last_fullsized":"2023-10-16T13:38:21.417258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000617+0000","last_change":"2023-10-16T13:38:18.968962+0000","last_active":"2023-10-16T13:38:20.000617+0000","last_peered":"2023-10-16T13:38:20.000617+0000","last_clean":"2023-10-16T13:38:20.000617+0000","last_became_active":"2023-10-16T13:38:18.968414+0000","last_became_peered":"2023-10-16T13:38:18.968414+0000","last_unstale":"2023-10-16T13:38:20.000617+0000","last_undegraded":"2023-10-16T13:38:20.000617+0000","last_fullsized":"2023-10-16T13:38:20.000617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:42.951075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997004+0000","last_change":"2023-10-16T13:38:19.996471+0000","last_active":"2023-10-16T13:38:20.997004+0000","last_peered":"2023-10-16T13:38:20.997004+0000","last_clean":"2023-10-16T13:38:20.997004+0000","last_became_active":"2023-10-16T13:38:19.994710+0000","last_became_peered":"2023-10-16T13:38:19.994710+0000","last_unstale":"2023-10-16T13:38:20.997004+0000","last_undegraded":"2023-10-16T13:38:20.997004+0000","last_fullsized":"2023-10-16T13:38:20.997004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002919+0000","last_change":"2023-10-16T13:38:18.964941+0000","last_active":"2023-10-16T13:38:20.002919+0000","last_peered":"2023-10-16T13:38:20.002919+0000","last_clean":"2023-10-16T13:38:20.002919+0000","last_became_active":"2023-10-16T13:38:18.964675+0000","last_became_peered":"2023-10-16T13:38:18.964675+0000","last_unstale":"2023-10-16T13:38:20.002919+0000","last_undegraded":"2023-10-16T13:38:20.002919+0000","last_fullsized":"2023-10-16T13:38:20.002919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:03.073989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997402+0000","last_change":"2023-10-16T13:38:19.989785+0000","last_active":"2023-10-16T13:38:20.997402+0000","last_peered":"2023-10-16T13:38:20.997402+0000","last_clean":"2023-10-16T13:38:20.997402+0000","last_became_active":"2023-10-16T13:38:19.989508+0000","last_became_peered":"2023-10-16T13:38:19.989508+0000","last_unstale":"2023-10-16T13:38:20.997402+0000","last_undegraded":"2023-10-16T13:38:20.997402+0000","last_fullsized":"2023-10-16T13:38:20.997402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002679+0000","last_change":"2023-10-16T13:38:18.966501+0000","last_active":"2023-10-16T13:38:20.002679+0000","last_peered":"2023-10-16T13:38:20.002679+0000","last_clean":"2023-10-16T13:38:20.002679+0000","last_became_active":"2023-10-16T13:38:18.966198+0000","last_became_peered":"2023-10-16T13:38:18.966198+0000","last_unstale":"2023-10-16T13:38:20.002679+0000","last_undegraded":"2023-10-16T13:38:20.002679+0000","last_fullsized":"2023-10-16T13:38:20.002679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:16.747902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996442+0000","last_change":"2023-10-16T13:38:19.987636+0000","last_active":"2023-10-16T13:38:20.996442+0000","last_peered":"2023-10-16T13:38:20.996442+0000","last_clean":"2023-10-16T13:38:20.996442+0000","last_became_active":"2023-10-16T13:38:19.986780+0000","last_became_peered":"2023-10-16T13:38:19.986780+0000","last_unstale":"2023-10-16T13:38:20.996442+0000","last_undegraded":"2023-10-16T13:38:20.996442+0000","last_fullsized":"2023-10-16T13:38:20.996442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:04.661176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.999597+0000","last_change":"2023-10-16T13:38:18.965928+0000","last_active":"2023-10-16T13:38:19.999597+0000","last_peered":"2023-10-16T13:38:19.999597+0000","last_clean":"2023-10-16T13:38:19.999597+0000","last_became_active":"2023-10-16T13:38:18.964562+0000","last_became_peered":"2023-10-16T13:38:18.964562+0000","last_unstale":"2023-10-16T13:38:19.999597+0000","last_undegraded":"2023-10-16T13:38:19.999597+0000","last_fullsized":"2023-10-16T13:38:19.999597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417479+0000","last_change":"2023-10-16T13:38:19.992457+0000","last_active":"2023-10-16T13:38:21.417479+0000","last_peered":"2023-10-16T13:38:21.417479+0000","last_clean":"2023-10-16T13:38:21.417479+0000","last_became_active":"2023-10-16T13:38:19.992036+0000","last_became_peered":"2023-10-16T13:38:19.992036+0000","last_unstale":"2023-10-16T13:38:21.417479+0000","last_undegraded":"2023-10-16T13:38:21.417479+0000","last_fullsized":"2023-10-16T13:38:21.417479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.974530+0000","last_change":"2023-10-16T13:38:18.968885+0000","last_active":"2023-10-16T13:38:19.974530+0000","last_peered":"2023-10-16T13:38:19.974530+0000","last_clean":"2023-10-16T13:38:19.974530+0000","last_became_active":"2023-10-16T13:38:18.968534+0000","last_became_peered":"2023-10-16T13:38:18.968534+0000","last_unstale":"2023-10-16T13:38:19.974530+0000","last_undegraded":"2023-10-16T13:38:19.974530+0000","last_fullsized":"2023-10-16T13:38:19.974530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398198+0000","last_change":"2023-10-16T13:38:19.993434+0000","last_active":"2023-10-16T13:38:21.398198+0000","last_peered":"2023-10-16T13:38:21.398198+0000","last_clean":"2023-10-16T13:38:21.398198+0000","last_became_active":"2023-10-16T13:38:19.993043+0000","last_became_peered":"2023-10-16T13:38:19.993043+0000","last_unstale":"2023-10-16T13:38:21.398198+0000","last_undegraded":"2023-10-16T13:38:21.398198+0000","last_fullsized":"2023-10-16T13:38:21.398198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980065+0000","last_change":"2023-10-16T13:38:18.955699+0000","last_active":"2023-10-16T13:38:19.980065+0000","last_peered":"2023-10-16T13:38:19.980065+0000","last_clean":"2023-10-16T13:38:19.980065+0000","last_became_active":"2023-10-16T13:38:18.955087+0000","last_became_peered":"2023-10-16T13:38:18.955087+0000","last_unstale":"2023-10-16T13:38:19.980065+0000","last_undegraded":"2023-10-16T13:38:19.980065+0000","last_fullsized":"2023-10-16T13:38:19.980065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.979256+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.978905+0000","last_became_peered":"2023-10-16T13:38:19.978905+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.977616+0000","last_change":"2023-10-16T13:38:18.966953+0000","last_active":"2023-10-16T13:38:19.977616+0000","last_peered":"2023-10-16T13:38:19.977616+0000","last_clean":"2023-10-16T13:38:19.977616+0000","last_became_active":"2023-10-16T13:38:18.966671+0000","last_became_peered":"2023-10-16T13:38:18.966671+0000","last_unstale":"2023-10-16T13:38:19.977616+0000","last_undegraded":"2023-10-16T13:38:19.977616+0000","last_fullsized":"2023-10-16T13:38:19.977616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997077+0000","last_change":"2023-10-16T13:38:19.996864+0000","last_active":"2023-10-16T13:38:20.997077+0000","last_peered":"2023-10-16T13:38:20.997077+0000","last_clean":"2023-10-16T13:38:20.997077+0000","last_became_active":"2023-10-16T13:38:19.996566+0000","last_became_peered":"2023-10-16T13:38:19.996566+0000","last_unstale":"2023-10-16T13:38:20.997077+0000","last_undegraded":"2023-10-16T13:38:20.997077+0000","last_fullsized":"2023-10-16T13:38:20.997077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980833+0000","last_change":"2023-10-16T13:38:18.965714+0000","last_active":"2023-10-16T13:38:19.980833+0000","last_peered":"2023-10-16T13:38:19.980833+0000","last_clean":"2023-10-16T13:38:19.980833+0000","last_became_active":"2023-10-16T13:38:18.965358+0000","last_became_peered":"2023-10-16T13:38:18.965358+0000","last_unstale":"2023-10-16T13:38:19.980833+0000","last_undegraded":"2023-10-16T13:38:19.980833+0000","last_fullsized":"2023-10-16T13:38:19.980833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:41.112357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417437+0000","last_change":"2023-10-16T13:38:19.997120+0000","last_active":"2023-10-16T13:38:21.417437+0000","last_peered":"2023-10-16T13:38:21.417437+0000","last_clean":"2023-10-16T13:38:21.417437+0000","last_became_active":"2023-10-16T13:38:19.996803+0000","last_became_peered":"2023-10-16T13:38:19.996803+0000","last_unstale":"2023-10-16T13:38:21.417437+0000","last_undegraded":"2023-10-16T13:38:21.417437+0000","last_fullsized":"2023-10-16T13:38:21.417437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002233+0000","last_change":"2023-10-16T13:38:18.970973+0000","last_active":"2023-10-16T13:38:20.002233+0000","last_peered":"2023-10-16T13:38:20.002233+0000","last_clean":"2023-10-16T13:38:20.002233+0000","last_became_active":"2023-10-16T13:38:18.970277+0000","last_became_peered":"2023-10-16T13:38:18.970277+0000","last_unstale":"2023-10-16T13:38:20.002233+0000","last_undegraded":"2023-10-16T13:38:20.002233+0000","last_fullsized":"2023-10-16T13:38:20.002233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997634+0000","last_change":"2023-10-16T13:38:19.995792+0000","last_active":"2023-10-16T13:38:20.997634+0000","last_peered":"2023-10-16T13:38:20.997634+0000","last_clean":"2023-10-16T13:38:20.997634+0000","last_became_active":"2023-10-16T13:38:19.995382+0000","last_became_peered":"2023-10-16T13:38:19.995382+0000","last_unstale":"2023-10-16T13:38:20.997634+0000","last_undegraded":"2023-10-16T13:38:20.997634+0000","last_fullsized":"2023-10-16T13:38:20.997634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:04.077768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.005046+0000","last_change":"2023-10-16T13:38:18.966915+0000","last_active":"2023-10-16T13:38:20.005046+0000","last_peered":"2023-10-16T13:38:20.005046+0000","last_clean":"2023-10-16T13:38:20.005046+0000","last_became_active":"2023-10-16T13:38:18.966651+0000","last_became_peered":"2023-10-16T13:38:18.966651+0000","last_unstale":"2023-10-16T13:38:20.005046+0000","last_undegraded":"2023-10-16T13:38:20.005046+0000","last_fullsized":"2023-10-16T13:38:20.005046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:48.542445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312472+0000","last_change":"2023-10-16T13:38:19.990649+0000","last_active":"2023-10-16T13:38:21.312472+0000","last_peered":"2023-10-16T13:38:21.312472+0000","last_clean":"2023-10-16T13:38:21.312472+0000","last_became_active":"2023-10-16T13:38:19.990367+0000","last_became_peered":"2023-10-16T13:38:19.990367+0000","last_unstale":"2023-10-16T13:38:21.312472+0000","last_undegraded":"2023-10-16T13:38:21.312472+0000","last_fullsized":"2023-10-16T13:38:21.312472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001177+0000","last_change":"2023-10-16T13:38:18.966144+0000","last_active":"2023-10-16T13:38:20.001177+0000","last_peered":"2023-10-16T13:38:20.001177+0000","last_clean":"2023-10-16T13:38:20.001177+0000","last_became_active":"2023-10-16T13:38:18.965756+0000","last_became_peered":"2023-10-16T13:38:18.965756+0000","last_unstale":"2023-10-16T13:38:20.001177+0000","last_undegraded":"2023-10-16T13:38:20.001177+0000","last_fullsized":"2023-10-16T13:38:20.001177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417086+0000","last_change":"2023-10-16T13:38:19.993169+0000","last_active":"2023-10-16T13:38:21.417086+0000","last_peered":"2023-10-16T13:38:21.417086+0000","last_clean":"2023-10-16T13:38:21.417086+0000","last_became_active":"2023-10-16T13:38:19.992834+0000","last_became_peered":"2023-10-16T13:38:19.992834+0000","last_unstale":"2023-10-16T13:38:21.417086+0000","last_undegraded":"2023-10-16T13:38:21.417086+0000","last_fullsized":"2023-10-16T13:38:21.417086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:25.539196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980640+0000","last_change":"2023-10-16T13:38:18.966091+0000","last_active":"2023-10-16T13:38:19.980640+0000","last_peered":"2023-10-16T13:38:19.980640+0000","last_clean":"2023-10-16T13:38:19.980640+0000","last_became_active":"2023-10-16T13:38:18.965722+0000","last_became_peered":"2023-10-16T13:38:18.965722+0000","last_unstale":"2023-10-16T13:38:19.980640+0000","last_undegraded":"2023-10-16T13:38:19.980640+0000","last_fullsized":"2023-10-16T13:38:19.980640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312449+0000","last_change":"2023-10-16T13:38:19.987249+0000","last_active":"2023-10-16T13:38:21.312449+0000","last_peered":"2023-10-16T13:38:21.312449+0000","last_clean":"2023-10-16T13:38:21.312449+0000","last_became_active":"2023-10-16T13:38:19.986977+0000","last_became_peered":"2023-10-16T13:38:19.986977+0000","last_unstale":"2023-10-16T13:38:21.312449+0000","last_undegraded":"2023-10-16T13:38:21.312449+0000","last_fullsized":"2023-10-16T13:38:21.312449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.975945+0000","last_change":"2023-10-16T13:38:18.965295+0000","last_active":"2023-10-16T13:38:19.975945+0000","last_peered":"2023-10-16T13:38:19.975945+0000","last_clean":"2023-10-16T13:38:19.975945+0000","last_became_active":"2023-10-16T13:38:18.964991+0000","last_became_peered":"2023-10-16T13:38:18.964991+0000","last_unstale":"2023-10-16T13:38:19.975945+0000","last_undegraded":"2023-10-16T13:38:19.975945+0000","last_fullsized":"2023-10-16T13:38:19.975945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875921+0000","last_change":"2023-10-16T13:38:19.993337+0000","last_active":"2023-10-16T13:38:21.875921+0000","last_peered":"2023-10-16T13:38:21.875921+0000","last_clean":"2023-10-16T13:38:21.875921+0000","last_became_active":"2023-10-16T13:38:19.993037+0000","last_became_peered":"2023-10-16T13:38:19.993037+0000","last_unstale":"2023-10-16T13:38:21.875921+0000","last_undegraded":"2023-10-16T13:38:21.875921+0000","last_fullsized":"2023-10-16T13:38:21.875921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002049+0000","last_change":"2023-10-16T13:38:18.971941+0000","last_active":"2023-10-16T13:38:20.002049+0000","last_peered":"2023-10-16T13:38:20.002049+0000","last_clean":"2023-10-16T13:38:20.002049+0000","last_became_active":"2023-10-16T13:38:18.971486+0000","last_became_peered":"2023-10-16T13:38:18.971486+0000","last_unstale":"2023-10-16T13:38:20.002049+0000","last_undegraded":"2023-10-16T13:38:20.002049+0000","last_fullsized":"2023-10-16T13:38:20.002049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:55.029520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312272+0000","last_change":"2023-10-16T13:38:19.995763+0000","last_active":"2023-10-16T13:38:21.312272+0000","last_peered":"2023-10-16T13:38:21.312272+0000","last_clean":"2023-10-16T13:38:21.312272+0000","last_became_active":"2023-10-16T13:38:19.994356+0000","last_became_peered":"2023-10-16T13:38:19.994356+0000","last_unstale":"2023-10-16T13:38:21.312272+0000","last_undegraded":"2023-10-16T13:38:21.312272+0000","last_fullsized":"2023-10-16T13:38:21.312272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002621+0000","last_change":"2023-10-16T13:38:18.964587+0000","last_active":"2023-10-16T13:38:20.002621+0000","last_peered":"2023-10-16T13:38:20.002621+0000","last_clean":"2023-10-16T13:38:20.002621+0000","last_became_active":"2023-10-16T13:38:18.964045+0000","last_became_peered":"2023-10-16T13:38:18.964045+0000","last_unstale":"2023-10-16T13:38:20.002621+0000","last_undegraded":"2023-10-16T13:38:20.002621+0000","last_fullsized":"2023-10-16T13:38:20.002621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312674+0000","last_change":"2023-10-16T13:38:19.987703+0000","last_active":"2023-10-16T13:38:21.312674+0000","last_peered":"2023-10-16T13:38:21.312674+0000","last_clean":"2023-10-16T13:38:21.312674+0000","last_became_active":"2023-10-16T13:38:19.987424+0000","last_became_peered":"2023-10-16T13:38:19.987424+0000","last_unstale":"2023-10-16T13:38:21.312674+0000","last_undegraded":"2023-10-16T13:38:21.312674+0000","last_fullsized":"2023-10-16T13:38:21.312674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.976739+0000","last_change":"2023-10-16T13:38:18.971397+0000","last_active":"2023-10-16T13:38:19.976739+0000","last_peered":"2023-10-16T13:38:19.976739+0000","last_clean":"2023-10-16T13:38:19.976739+0000","last_became_active":"2023-10-16T13:38:18.970730+0000","last_became_peered":"2023-10-16T13:38:18.970730+0000","last_unstale":"2023-10-16T13:38:19.976739+0000","last_undegraded":"2023-10-16T13:38:19.976739+0000","last_fullsized":"2023-10-16T13:38:19.976739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997490+0000","last_change":"2023-10-16T13:38:19.989906+0000","last_active":"2023-10-16T13:38:20.997490+0000","last_peered":"2023-10-16T13:38:20.997490+0000","last_clean":"2023-10-16T13:38:20.997490+0000","last_became_active":"2023-10-16T13:38:19.989392+0000","last_became_peered":"2023-10-16T13:38:19.989392+0000","last_unstale":"2023-10-16T13:38:20.997490+0000","last_undegraded":"2023-10-16T13:38:20.997490+0000","last_fullsized":"2023-10-16T13:38:20.997490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980449+0000","last_change":"2023-10-16T13:38:18.971405+0000","last_active":"2023-10-16T13:38:19.980449+0000","last_peered":"2023-10-16T13:38:19.980449+0000","last_clean":"2023-10-16T13:38:19.980449+0000","last_became_active":"2023-10-16T13:38:18.970833+0000","last_became_peered":"2023-10-16T13:38:18.970833+0000","last_unstale":"2023-10-16T13:38:19.980449+0000","last_undegraded":"2023-10-16T13:38:19.980449+0000","last_fullsized":"2023-10-16T13:38:19.980449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.527487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996443+0000","last_change":"2023-10-16T13:38:19.994155+0000","last_active":"2023-10-16T13:38:20.996443+0000","last_peered":"2023-10-16T13:38:20.996443+0000","last_clean":"2023-10-16T13:38:20.996443+0000","last_became_active":"2023-10-16T13:38:19.993613+0000","last_became_peered":"2023-10-16T13:38:19.993613+0000","last_unstale":"2023-10-16T13:38:20.996443+0000","last_undegraded":"2023-10-16T13:38:20.996443+0000","last_fullsized":"2023-10-16T13:38:20.996443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:42.991395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988581+0000","last_change":"2023-10-16T13:38:19.985531+0000","last_active":"2023-10-16T13:38:20.988581+0000","last_peered":"2023-10-16T13:38:20.988581+0000","last_clean":"2023-10-16T13:38:20.988581+0000","last_became_active":"2023-10-16T13:38:19.985266+0000","last_became_peered":"2023-10-16T13:38:19.985266+0000","last_unstale":"2023-10-16T13:38:20.988581+0000","last_undegraded":"2023-10-16T13:38:20.988581+0000","last_fullsized":"2023-10-16T13:38:20.988581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972216+0000","last_change":"2023-10-16T13:38:18.964493+0000","last_active":"2023-10-16T13:38:19.972216+0000","last_peered":"2023-10-16T13:38:19.972216+0000","last_clean":"2023-10-16T13:38:19.972216+0000","last_became_active":"2023-10-16T13:38:18.964187+0000","last_became_peered":"2023-10-16T13:38:18.964187+0000","last_unstale":"2023-10-16T13:38:19.972216+0000","last_undegraded":"2023-10-16T13:38:19.972216+0000","last_fullsized":"2023-10-16T13:38:19.972216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398312+0000","last_change":"2023-10-16T13:38:19.997708+0000","last_active":"2023-10-16T13:38:21.398312+0000","last_peered":"2023-10-16T13:38:21.398312+0000","last_clean":"2023-10-16T13:38:21.398312+0000","last_became_active":"2023-10-16T13:38:19.997371+0000","last_became_peered":"2023-10-16T13:38:19.997371+0000","last_unstale":"2023-10-16T13:38:21.398312+0000","last_undegraded":"2023-10-16T13:38:21.398312+0000","last_fullsized":"2023-10-16T13:38:21.398312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980595+0000","last_change":"2023-10-16T13:38:18.954177+0000","last_active":"2023-10-16T13:38:19.980595+0000","last_peered":"2023-10-16T13:38:19.980595+0000","last_clean":"2023-10-16T13:38:19.980595+0000","last_became_active":"2023-10-16T13:38:18.953859+0000","last_became_peered":"2023-10-16T13:38:18.953859+0000","last_unstale":"2023-10-16T13:38:19.980595+0000","last_undegraded":"2023-10-16T13:38:19.980595+0000","last_fullsized":"2023-10-16T13:38:19.980595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:07.912567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972935+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:19.972935+0000","last_peered":"2023-10-16T13:38:19.972935+0000","last_clean":"2023-10-16T13:38:19.972935+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:19.972935+0000","last_undegraded":"2023-10-16T13:38:19.972935+0000","last_fullsized":"2023-10-16T13:38:19.972935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417024+0000","last_change":"2023-10-16T13:38:19.989240+0000","last_active":"2023-10-16T13:38:21.417024+0000","last_peered":"2023-10-16T13:38:21.417024+0000","last_clean":"2023-10-16T13:38:21.417024+0000","last_became_active":"2023-10-16T13:38:19.988888+0000","last_became_peered":"2023-10-16T13:38:19.988888+0000","last_unstale":"2023-10-16T13:38:21.417024+0000","last_undegraded":"2023-10-16T13:38:21.417024+0000","last_fullsized":"2023-10-16T13:38:21.417024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:46.323232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973036+0000","last_change":"2023-10-16T13:38:18.971283+0000","last_active":"2023-10-16T13:38:19.973036+0000","last_peered":"2023-10-16T13:38:19.973036+0000","last_clean":"2023-10-16T13:38:19.973036+0000","last_became_active":"2023-10-16T13:38:18.970896+0000","last_became_peered":"2023-10-16T13:38:18.970896+0000","last_unstale":"2023-10-16T13:38:19.973036+0000","last_undegraded":"2023-10-16T13:38:19.973036+0000","last_fullsized":"2023-10-16T13:38:19.973036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.978893+0000","last_change":"2023-10-16T13:38:18.969135+0000","last_active":"2023-10-16T13:38:19.978893+0000","last_peered":"2023-10-16T13:38:19.978893+0000","last_clean":"2023-10-16T13:38:19.978893+0000","last_became_active":"2023-10-16T13:38:18.968811+0000","last_became_peered":"2023-10-16T13:38:18.968811+0000","last_unstale":"2023-10-16T13:38:19.978893+0000","last_undegraded":"2023-10-16T13:38:19.978893+0000","last_fullsized":"2023-10-16T13:38:19.978893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988509+0000","last_change":"2023-10-16T13:38:19.987139+0000","last_active":"2023-10-16T13:38:20.988509+0000","last_peered":"2023-10-16T13:38:20.988509+0000","last_clean":"2023-10-16T13:38:20.988509+0000","last_became_active":"2023-10-16T13:38:19.986018+0000","last_became_peered":"2023-10-16T13:38:19.986018+0000","last_unstale":"2023-10-16T13:38:20.988509+0000","last_undegraded":"2023-10-16T13:38:20.988509+0000","last_fullsized":"2023-10-16T13:38:20.988509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988441+0000","last_change":"2023-10-16T13:38:18.969084+0000","last_active":"2023-10-16T13:38:20.988441+0000","last_peered":"2023-10-16T13:38:20.988441+0000","last_clean":"2023-10-16T13:38:20.988441+0000","last_became_active":"2023-10-16T13:38:18.968714+0000","last_became_peered":"2023-10-16T13:38:18.968714+0000","last_unstale":"2023-10-16T13:38:20.988441+0000","last_undegraded":"2023-10-16T13:38:20.988441+0000","last_fullsized":"2023-10-16T13:38:20.988441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398414+0000","last_change":"2023-10-16T13:38:19.987735+0000","last_active":"2023-10-16T13:38:21.398414+0000","last_peered":"2023-10-16T13:38:21.398414+0000","last_clean":"2023-10-16T13:38:21.398414+0000","last_became_active":"2023-10-16T13:38:19.986959+0000","last_became_peered":"2023-10-16T13:38:19.986959+0000","last_unstale":"2023-10-16T13:38:21.398414+0000","last_undegraded":"2023-10-16T13:38:21.398414+0000","last_fullsized":"2023-10-16T13:38:21.398414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000677+0000","last_change":"2023-10-16T13:38:18.967312+0000","last_active":"2023-10-16T13:38:20.000677+0000","last_peered":"2023-10-16T13:38:20.000677+0000","last_clean":"2023-10-16T13:38:20.000677+0000","last_became_active":"2023-10-16T13:38:18.966996+0000","last_became_peered":"2023-10-16T13:38:18.966996+0000","last_unstale":"2023-10-16T13:38:20.000677+0000","last_undegraded":"2023-10-16T13:38:20.000677+0000","last_fullsized":"2023-10-16T13:38:20.000677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417342+0000","last_change":"2023-10-16T13:38:19.991995+0000","last_active":"2023-10-16T13:38:21.417342+0000","last_peered":"2023-10-16T13:38:21.417342+0000","last_clean":"2023-10-16T13:38:21.417342+0000","last_became_active":"2023-10-16T13:38:19.991675+0000","last_became_peered":"2023-10-16T13:38:19.991675+0000","last_unstale":"2023-10-16T13:38:21.417342+0000","last_undegraded":"2023-10-16T13:38:21.417342+0000","last_fullsized":"2023-10-16T13:38:21.417342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972826+0000","last_change":"2023-10-16T13:38:18.965736+0000","last_active":"2023-10-16T13:38:19.972826+0000","last_peered":"2023-10-16T13:38:19.972826+0000","last_clean":"2023-10-16T13:38:19.972826+0000","last_became_active":"2023-10-16T13:38:18.965488+0000","last_became_peered":"2023-10-16T13:38:18.965488+0000","last_unstale":"2023-10-16T13:38:19.972826+0000","last_undegraded":"2023-10-16T13:38:19.972826+0000","last_fullsized":"2023-10-16T13:38:19.972826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997267+0000","last_change":"2023-10-16T13:38:19.988592+0000","last_active":"2023-10-16T13:38:20.997267+0000","last_peered":"2023-10-16T13:38:20.997267+0000","last_clean":"2023-10-16T13:38:20.997267+0000","last_became_active":"2023-10-16T13:38:19.988222+0000","last_became_peered":"2023-10-16T13:38:19.988222+0000","last_unstale":"2023-10-16T13:38:20.997267+0000","last_undegraded":"2023-10-16T13:38:20.997267+0000","last_fullsized":"2023-10-16T13:38:20.997267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:09.486295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973837+0000","last_change":"2023-10-16T13:38:18.970765+0000","last_active":"2023-10-16T13:38:19.973837+0000","last_peered":"2023-10-16T13:38:19.973837+0000","last_clean":"2023-10-16T13:38:19.973837+0000","last_became_active":"2023-10-16T13:38:18.970373+0000","last_became_peered":"2023-10-16T13:38:18.970373+0000","last_unstale":"2023-10-16T13:38:19.973837+0000","last_undegraded":"2023-10-16T13:38:19.973837+0000","last_fullsized":"2023-10-16T13:38:19.973837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397986+0000","last_change":"2023-10-16T13:38:19.987493+0000","last_active":"2023-10-16T13:38:21.397986+0000","last_peered":"2023-10-16T13:38:21.397986+0000","last_clean":"2023-10-16T13:38:21.397986+0000","last_became_active":"2023-10-16T13:38:19.987196+0000","last_became_peered":"2023-10-16T13:38:19.987196+0000","last_unstale":"2023-10-16T13:38:21.397986+0000","last_undegraded":"2023-10-16T13:38:21.397986+0000","last_fullsized":"2023-10-16T13:38:21.397986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972485+0000","last_change":"2023-10-16T13:38:18.971500+0000","last_active":"2023-10-16T13:38:19.972485+0000","last_peered":"2023-10-16T13:38:19.972485+0000","last_clean":"2023-10-16T13:38:19.972485+0000","last_became_active":"2023-10-16T13:38:18.971072+0000","last_became_peered":"2023-10-16T13:38:18.971072+0000","last_unstale":"2023-10-16T13:38:19.972485+0000","last_undegraded":"2023-10-16T13:38:19.972485+0000","last_fullsized":"2023-10-16T13:38:19.972485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398558+0000","last_change":"2023-10-16T13:38:19.993658+0000","last_active":"2023-10-16T13:38:21.398558+0000","last_peered":"2023-10-16T13:38:21.398558+0000","last_clean":"2023-10-16T13:38:21.398558+0000","last_became_active":"2023-10-16T13:38:19.993109+0000","last_became_peered":"2023-10-16T13:38:19.993109+0000","last_unstale":"2023-10-16T13:38:21.398558+0000","last_undegraded":"2023-10-16T13:38:21.398558+0000","last_fullsized":"2023-10-16T13:38:21.398558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000611+0000","last_change":"2023-10-16T13:38:18.969196+0000","last_active":"2023-10-16T13:38:20.000611+0000","last_peered":"2023-10-16T13:38:20.000611+0000","last_clean":"2023-10-16T13:38:20.000611+0000","last_became_active":"2023-10-16T13:38:18.968947+0000","last_became_peered":"2023-10-16T13:38:18.968947+0000","last_unstale":"2023-10-16T13:38:20.000611+0000","last_undegraded":"2023-10-16T13:38:20.000611+0000","last_fullsized":"2023-10-16T13:38:20.000611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876093+0000","last_change":"2023-10-16T13:38:19.987465+0000","last_active":"2023-10-16T13:38:21.876093+0000","last_peered":"2023-10-16T13:38:21.876093+0000","last_clean":"2023-10-16T13:38:21.876093+0000","last_became_active":"2023-10-16T13:38:19.987060+0000","last_became_peered":"2023-10-16T13:38:19.987060+0000","last_unstale":"2023-10-16T13:38:21.876093+0000","last_undegraded":"2023-10-16T13:38:21.876093+0000","last_fullsized":"2023-10-16T13:38:21.876093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973130+0000","last_change":"2023-10-16T13:38:18.955240+0000","last_active":"2023-10-16T13:38:19.973130+0000","last_peered":"2023-10-16T13:38:19.973130+0000","last_clean":"2023-10-16T13:38:19.973130+0000","last_became_active":"2023-10-16T13:38:18.954854+0000","last_became_peered":"2023-10-16T13:38:18.954854+0000","last_unstale":"2023-10-16T13:38:19.973130+0000","last_undegraded":"2023-10-16T13:38:19.973130+0000","last_fullsized":"2023-10-16T13:38:19.973130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312661+0000","last_change":"2023-10-16T13:38:19.999600+0000","last_active":"2023-10-16T13:38:21.312661+0000","last_peered":"2023-10-16T13:38:21.312661+0000","last_clean":"2023-10-16T13:38:21.312661+0000","last_became_active":"2023-10-16T13:38:19.999328+0000","last_became_peered":"2023-10-16T13:38:19.999328+0000","last_unstale":"2023-10-16T13:38:21.312661+0000","last_undegraded":"2023-10-16T13:38:21.312661+0000","last_fullsized":"2023-10-16T13:38:21.312661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001300+0000","last_change":"2023-10-16T13:38:18.972416+0000","last_active":"2023-10-16T13:38:20.001300+0000","last_peered":"2023-10-16T13:38:20.001300+0000","last_clean":"2023-10-16T13:38:20.001300+0000","last_became_active":"2023-10-16T13:38:18.972134+0000","last_became_peered":"2023-10-16T13:38:18.972134+0000","last_unstale":"2023-10-16T13:38:20.001300+0000","last_undegraded":"2023-10-16T13:38:20.001300+0000","last_fullsized":"2023-10-16T13:38:20.001300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997167+0000","last_change":"2023-10-16T13:38:19.989464+0000","last_active":"2023-10-16T13:38:20.997167+0000","last_peered":"2023-10-16T13:38:20.997167+0000","last_clean":"2023-10-16T13:38:20.997167+0000","last_became_active":"2023-10-16T13:38:19.988949+0000","last_became_peered":"2023-10-16T13:38:19.988949+0000","last_unstale":"2023-10-16T13:38:20.997167+0000","last_undegraded":"2023-10-16T13:38:20.997167+0000","last_fullsized":"2023-10-16T13:38:20.997167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.003246+0000","last_change":"2023-10-16T13:38:18.962000+0000","last_active":"2023-10-16T13:38:20.003246+0000","last_peered":"2023-10-16T13:38:20.003246+0000","last_clean":"2023-10-16T13:38:20.003246+0000","last_became_active":"2023-10-16T13:38:18.961681+0000","last_became_peered":"2023-10-16T13:38:18.961681+0000","last_unstale":"2023-10-16T13:38:20.003246+0000","last_undegraded":"2023-10-16T13:38:20.003246+0000","last_fullsized":"2023-10-16T13:38:20.003246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312823+0000","last_change":"2023-10-16T13:38:19.991640+0000","last_active":"2023-10-16T13:38:21.312823+0000","last_peered":"2023-10-16T13:38:21.312823+0000","last_clean":"2023-10-16T13:38:21.312823+0000","last_became_active":"2023-10-16T13:38:19.990115+0000","last_became_peered":"2023-10-16T13:38:19.990115+0000","last_unstale":"2023-10-16T13:38:21.312823+0000","last_undegraded":"2023-10-16T13:38:21.312823+0000","last_fullsized":"2023-10-16T13:38:21.312823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:21:33.323265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875839+0000","last_change":"2023-10-16T13:38:19.995109+0000","last_active":"2023-10-16T13:38:21.875839+0000","last_peered":"2023-10-16T13:38:21.875839+0000","last_clean":"2023-10-16T13:38:21.875839+0000","last_became_active":"2023-10-16T13:38:19.994801+0000","last_became_peered":"2023-10-16T13:38:19.994801+0000","last_unstale":"2023-10-16T13:38:21.875839+0000","last_undegraded":"2023-10-16T13:38:21.875839+0000","last_fullsized":"2023-10-16T13:38:21.875839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821362+0000","last_change":"2023-10-16T13:38:19.990599+0000","last_active":"2023-10-16T13:38:21.821362+0000","last_peered":"2023-10-16T13:38:21.821362+0000","last_clean":"2023-10-16T13:38:21.821362+0000","last_became_active":"2023-10-16T13:38:19.990337+0000","last_became_peered":"2023-10-16T13:38:19.990337+0000","last_unstale":"2023-10-16T13:38:21.821362+0000","last_undegraded":"2023-10-16T13:38:21.821362+0000","last_fullsized":"2023-10-16T13:38:21.821362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:42.945644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996891+0000","last_change":"2023-10-16T13:38:19.996805+0000","last_active":"2023-10-16T13:38:20.996891+0000","last_peered":"2023-10-16T13:38:20.996891+0000","last_clean":"2023-10-16T13:38:20.996891+0000","last_became_active":"2023-10-16T13:38:19.996509+0000","last_became_peered":"2023-10-16T13:38:19.996509+0000","last_unstale":"2023-10-16T13:38:20.996891+0000","last_undegraded":"2023-10-16T13:38:20.996891+0000","last_fullsized":"2023-10-16T13:38:20.996891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417362+0000","last_change":"2023-10-16T13:38:19.992691+0000","last_active":"2023-10-16T13:38:21.417362+0000","last_peered":"2023-10-16T13:38:21.417362+0000","last_clean":"2023-10-16T13:38:21.417362+0000","last_became_active":"2023-10-16T13:38:19.992360+0000","last_became_peered":"2023-10-16T13:38:19.992360+0000","last_unstale":"2023-10-16T13:38:21.417362+0000","last_undegraded":"2023-10-16T13:38:21.417362+0000","last_fullsized":"2023-10-16T13:38:21.417362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398282+0000","last_change":"2023-10-16T13:38:19.985294+0000","last_active":"2023-10-16T13:38:21.398282+0000","last_peered":"2023-10-16T13:38:21.398282+0000","last_clean":"2023-10-16T13:38:21.398282+0000","last_became_active":"2023-10-16T13:38:19.985063+0000","last_became_peered":"2023-10-16T13:38:19.985063+0000","last_unstale":"2023-10-16T13:38:21.398282+0000","last_undegraded":"2023-10-16T13:38:21.398282+0000","last_fullsized":"2023-10-16T13:38:21.398282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.980791+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.980473+0000","last_became_peered":"2023-10-16T13:38:19.980473+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876183+0000","last_change":"2023-10-16T13:38:19.986596+0000","last_active":"2023-10-16T13:38:21.876183+0000","last_peered":"2023-10-16T13:38:21.876183+0000","last_clean":"2023-10-16T13:38:21.876183+0000","last_became_active":"2023-10-16T13:38:19.986288+0000","last_became_peered":"2023-10-16T13:38:19.986288+0000","last_unstale":"2023-10-16T13:38:21.876183+0000","last_undegraded":"2023-10-16T13:38:21.876183+0000","last_fullsized":"2023-10-16T13:38:21.876183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398398+0000","last_change":"2023-10-16T13:38:19.983880+0000","last_active":"2023-10-16T13:38:21.398398+0000","last_peered":"2023-10-16T13:38:21.398398+0000","last_clean":"2023-10-16T13:38:21.398398+0000","last_became_active":"2023-10-16T13:38:19.983548+0000","last_became_peered":"2023-10-16T13:38:19.983548+0000","last_unstale":"2023-10-16T13:38:21.398398+0000","last_undegraded":"2023-10-16T13:38:21.398398+0000","last_fullsized":"2023-10-16T13:38:21.398398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996462+0000","last_change":"2023-10-16T13:38:19.996604+0000","last_active":"2023-10-16T13:38:20.996462+0000","last_peered":"2023-10-16T13:38:20.996462+0000","last_clean":"2023-10-16T13:38:20.996462+0000","last_became_active":"2023-10-16T13:38:19.995929+0000","last_became_peered":"2023-10-16T13:38:19.995929+0000","last_unstale":"2023-10-16T13:38:20.996462+0000","last_undegraded":"2023-10-16T13:38:20.996462+0000","last_fullsized":"2023-10-16T13:38:20.996462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398082+0000","last_change":"2023-10-16T13:38:19.986068+0000","last_active":"2023-10-16T13:38:21.398082+0000","last_peered":"2023-10-16T13:38:21.398082+0000","last_clean":"2023-10-16T13:38:21.398082+0000","last_became_active":"2023-10-16T13:38:19.985755+0000","last_became_peered":"2023-10-16T13:38:19.985755+0000","last_unstale":"2023-10-16T13:38:21.398082+0000","last_undegraded":"2023-10-16T13:38:21.398082+0000","last_fullsized":"2023-10-16T13:38:21.398082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997136+0000","last_change":"2023-10-16T13:38:19.995901+0000","last_active":"2023-10-16T13:38:20.997136+0000","last_peered":"2023-10-16T13:38:20.997136+0000","last_clean":"2023-10-16T13:38:20.997136+0000","last_became_active":"2023-10-16T13:38:19.994807+0000","last_became_peered":"2023-10-16T13:38:19.994807+0000","last_unstale":"2023-10-16T13:38:20.997136+0000","last_undegraded":"2023-10-16T13:38:20.997136+0000","last_fullsized":"2023-10-16T13:38:20.997136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417224+0000","last_change":"2023-10-16T13:38:20.001012+0000","last_active":"2023-10-16T13:38:21.417224+0000","last_peered":"2023-10-16T13:38:21.417224+0000","last_clean":"2023-10-16T13:38:21.417224+0000","last_became_active":"2023-10-16T13:38:20.000625+0000","last_became_peered":"2023-10-16T13:38:20.000625+0000","last_unstale":"2023-10-16T13:38:21.417224+0000","last_undegraded":"2023-10-16T13:38:21.417224+0000","last_fullsized":"2023-10-16T13:38:21.417224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876030+0000","last_change":"2023-10-16T13:38:19.987393+0000","last_active":"2023-10-16T13:38:21.876030+0000","last_peered":"2023-10-16T13:38:21.876030+0000","last_clean":"2023-10-16T13:38:21.876030+0000","last_became_active":"2023-10-16T13:38:19.987088+0000","last_became_peered":"2023-10-16T13:38:19.987088+0000","last_unstale":"2023-10-16T13:38:21.876030+0000","last_undegraded":"2023-10-16T13:38:21.876030+0000","last_fullsized":"2023-10-16T13:38:21.876030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:29.175 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:38:29.175 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T13:38:29.176 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T13:38:29.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T13:38:29.177 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T13:38:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.328+0000 7f263475d700 1 Processor -- start 2023-10-16T13:38:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.328+0000 7f263475d700 1 -- start start 2023-10-16T13:38:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f263475d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c15e2f0 0x7f262c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f263475d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f262c06a840 0x7f262c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f263475d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0b2d60 con 0x7f262c0cd950 2023-10-16T13:38:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f263475d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c1619a0 con 0x7f262c06a840 2023-10-16T13:38:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f263475d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c06b1f0 con 0x7f262c15e2f0 2023-10-16T13:38:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f2632cfa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f262c06a840 0x7f262c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f2632cfa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f262c06a840 0x7f262c06acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41908/0 (socket says 172.21.15.5:41908) 2023-10-16T13:38:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f2632cfa700 1 -- 172.21.15.5:0/2261994050 learned_addr learned my addr 172.21.15.5:0/2261994050 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.329+0000 7f2631cf8700 1 --2- 172.21.15.5:0/2261994050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c15e2f0 0x7f262c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f2632cfa700 1 -- 172.21.15.5:0/2261994050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c15e2f0 msgr2=0x7f262c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f2632cfa700 1 --2- 172.21.15.5:0/2261994050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c15e2f0 0x7f262c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f2632cfa700 1 -- 172.21.15.5:0/2261994050 >> v1:172.21.15.112:6789/0 conn(0x7f262c0cd950 legacy=0x7f262c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f2632cfa700 1 -- 172.21.15.5:0/2261994050 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0cdd30 con 0x7f262c06a840 2023-10-16T13:38:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f2632cfa700 1 --2- 172.21.15.5:0/2261994050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06a840 0x7f262c06acb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2624009e50 tx=0x7f262400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4978edaa9e9444bf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f26314f7700 1 -- 172.21.15.5:0/2261994050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400e070 con 0x7f262c06a840 2023-10-16T13:38:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f26314f7700 1 -- 172.21.15.5:0/2261994050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262400b910 con 0x7f262c06a840 2023-10-16T13:38:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f26314f7700 1 -- 172.21.15.5:0/2261994050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400bcc0 con 0x7f262c06a840 2023-10-16T13:38:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f263475d700 1 -- 172.21.15.5:0/2261994050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06a840 msgr2=0x7f262c06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f263475d700 1 --2- 172.21.15.5:0/2261994050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06a840 0x7f262c06acb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2624009e50 tx=0x7f262400b330 comp rx=0 tx=0).stop 2023-10-16T13:38:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f263475d700 1 -- 172.21.15.5:0/2261994050 shutdown_connections 2023-10-16T13:38:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f263475d700 1 --2- 172.21.15.5:0/2261994050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06a840 0x7f262c06acb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.330+0000 7f263475d700 1 --2- 172.21.15.5:0/2261994050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c15e2f0 0x7f262c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.331+0000 7f263475d700 1 -- 172.21.15.5:0/2261994050 >> 172.21.15.5:0/2261994050 conn(0x7f262c06dae0 msgr2=0x7f262c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.331+0000 7f263475d700 1 -- 172.21.15.5:0/2261994050 shutdown_connections 2023-10-16T13:38:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.331+0000 7f263475d700 1 -- 172.21.15.5:0/2261994050 wait complete. 2023-10-16T13:38:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.332+0000 7f263475d700 1 Processor -- start 2023-10-16T13:38:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.332+0000 7f263475d700 1 -- start start 2023-10-16T13:38:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262c06a840 0x7f262c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c0cd950 0x7f262c1f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 0x7f262c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0b3920 con 0x7f262c15e2f0 2023-10-16T13:38:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1f71f0 con 0x7f262c06a840 2023-10-16T13:38:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0ac8b0 con 0x7f262c0cd950 2023-10-16T13:38:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 0x7f262c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f26324f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262c06a840 0x7f262c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 0x7f262c0aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41914/0 (socket says 172.21.15.5:41914) 2023-10-16T13:38:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 -- 172.21.15.5:0/3141687979 learned_addr learned my addr 172.21.15.5:0/3141687979 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2631cf8700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c0cd950 0x7f262c1f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 -- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c0cd950 msgr2=0x7f262c1f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c0cd950 0x7f262c1f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 -- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262c06a840 msgr2=0x7f262c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262c06a840 0x7f262c0b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 -- 172.21.15.5:0/3141687979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624009b30 con 0x7f262c15e2f0 2023-10-16T13:38:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2632cfa700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 0x7f262c0aef40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f262400b680 tx=0x7f2624004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624004830 con 0x7f262c15e2f0 2023-10-16T13:38:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240092e0 con 0x7f262c15e2f0 2023-10-16T13:38:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c1f7420 con 0x7f262c15e2f0 2023-10-16T13:38:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262401c660 con 0x7f262c15e2f0 2023-10-16T13:38:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.333+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c1f79e0 con 0x7f262c15e2f0 2023-10-16T13:38:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.334+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c067d20 con 0x7f262c15e2f0 2023-10-16T13:38:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.335+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f262401c7c0 con 0x7f262c15e2f0 2023-10-16T13:38:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.335+0000 7f2622ffd700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f261006af00 0x7f261006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.335+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f262408b140 con 0x7f262c15e2f0 2023-10-16T13:38:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.335+0000 7f26324f9700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f261006af00 0x7f261006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.336+0000 7f26324f9700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f261006af00 0x7f261006d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f261c007fd0 tx=0x7f261c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.340+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2624056280 con 0x7f262c15e2f0 2023-10-16T13:38:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.605+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f262c0b2100 con 0x7f262c15e2f0 2023-10-16T13:38:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.608+0000 7f2622ffd700 1 -- 172.21.15.5:0/3141687979 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171037 (secure 0 0 0) 0x7f26240598a0 con 0x7f262c15e2f0 2023-10-16T13:38:29.612 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f261006af00 msgr2=0x7f261006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f261006af00 0x7f261006d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f261c007fd0 tx=0x7f261c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 msgr2=0x7f262c0aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 0x7f262c0aef40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f262400b680 tx=0x7f2624004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 shutdown_connections 2023-10-16T13:38:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c15e2f0 0x7f262c0aef40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262c06a840 0x7f262c0b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f261006af00 0x7f261006d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 --2- 172.21.15.5:0/3141687979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262c0cd950 0x7f262c1f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.610+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 >> 172.21.15.5:0/3141687979 conn(0x7f262c06dae0 msgr2=0x7f262c15cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.611+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 shutdown_connections 2023-10-16T13:38:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.611+0000 7f263475d700 1 -- 172.21.15.5:0/3141687979 wait complete. 2023-10-16T13:38:29.625 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3065671710},{"type":"v1","addr":"172.21.15.112:6833","nonce":3065671710}]},"active_addr":"172.21.15.112:6833/3065671710","active_change":"2023-10-16T13:38:07.448708+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3799417278}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3987641435}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2129442799}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2561304166}]}]} 2023-10-16T13:38:29.629 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T13:38:29.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T13:38:29.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 Processor -- start 2023-10-16T13:38:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 -- start start 2023-10-16T13:38:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1dc015f050 0x7f1dc00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1dc00b0580 0x7f1dc00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc00b0a80 con 0x7f1dc00ce620 2023-10-16T13:38:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc00cea50 con 0x7f1dc015f050 2023-10-16T13:38:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.752+0000 7f1dc52fc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc00ccee0 con 0x7f1dc00b0580 2023-10-16T13:38:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbeffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1dc015f050 0x7f1dc00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbf7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1dc00ce620 0x7f1dc00cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51924/0 (socket says 172.21.15.5:51924) 2023-10-16T13:38:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbf7fe700 1 -- 172.21.15.5:0/2793040975 learned_addr learned my addr 172.21.15.5:0/2793040975 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbe7fc700 1 --2- 172.21.15.5:0/2793040975 >> v2:172.21.15.112:3300/0 conn(0x7f1dc00b0580 0x7f1dc00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbeffd700 1 -- 172.21.15.5:0/2793040975 >> v2:172.21.15.112:3300/0 conn(0x7f1dc00b0580 msgr2=0x7f1dc00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbeffd700 1 --2- 172.21.15.5:0/2793040975 >> v2:172.21.15.112:3300/0 conn(0x7f1dc00b0580 0x7f1dc00ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbeffd700 1 -- 172.21.15.5:0/2793040975 >> v1:172.21.15.5:6789/0 conn(0x7f1dc00ce620 legacy=0x7f1dc00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbeffd700 1 -- 172.21.15.5:0/2793040975 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00cd1c0 con 0x7f1dc015f050 2023-10-16T13:38:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbdffb700 1 -- 172.21.15.5:0/2793040975 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721222469 0 0) 0x7f1dc00b0a80 con 0x7f1dc00ce620 2023-10-16T13:38:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbeffd700 1 --2- 172.21.15.5:0/2793040975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc015f050 0x7f1dc00cdba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00b1050 tx=0x7f1db0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f99ec38c67af3e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbdffb700 1 -- 172.21.15.5:0/2793040975 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0011830 con 0x7f1dc015f050 2023-10-16T13:38:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbdffb700 1 -- 172.21.15.5:0/2793040975 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0011990 con 0x7f1dc015f050 2023-10-16T13:38:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.753+0000 7f1dbdffb700 1 -- 172.21.15.5:0/2793040975 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0011d20 con 0x7f1dc015f050 2023-10-16T13:38:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2793040975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc015f050 msgr2=0x7f1dc00cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2793040975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc015f050 0x7f1dc00cdba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00b1050 tx=0x7f1db0009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2793040975 shutdown_connections 2023-10-16T13:38:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2793040975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc015f050 0x7f1dc00cdba0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2793040975 >> v2:172.21.15.112:3300/0 conn(0x7f1dc00b0580 0x7f1dc00ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2793040975 >> 172.21.15.5:0/2793040975 conn(0x7f1dc00d1620 msgr2=0x7f1dc00d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2793040975 shutdown_connections 2023-10-16T13:38:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.754+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2793040975 wait complete. 2023-10-16T13:38:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.755+0000 7f1dc52fc700 1 Processor -- start 2023-10-16T13:38:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.755+0000 7f1dc52fc700 1 -- start start 2023-10-16T13:38:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dc52fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc00b0580 0x7f1dc0154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dc52fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 0x7f1dc0144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dc52fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dc015f050 0x7f1dc00cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dc52fc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc0155630 con 0x7f1dc00ce620 2023-10-16T13:38:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dc52fc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc0154a20 con 0x7f1dc00b0580 2023-10-16T13:38:29.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dc52fc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc0154d00 con 0x7f1dc015f050 2023-10-16T13:38:29.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 0x7f1dc0144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 0x7f1dc0144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41926/0 (socket says 172.21.15.5:41926) 2023-10-16T13:38:29.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 -- 172.21.15.5:0/2663588902 learned_addr learned my addr 172.21.15.5:0/2663588902 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:29.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbf7fe700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dc015f050 0x7f1dc00cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbeffd700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc00b0580 0x7f1dc0154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 -- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dc015f050 msgr2=0x7f1dc00cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dc015f050 0x7f1dc00cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 -- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc00b0580 msgr2=0x7f1dc0154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc00b0580 0x7f1dc0154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbe7fc700 1 -- 172.21.15.5:0/2663588902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00094a0 con 0x7f1dc00ce620 2023-10-16T13:38:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.756+0000 7f1dbeffd700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc00b0580 0x7f1dc0154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.757+0000 7f1dbe7fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 0x7f1dc0144dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1db400e810 tx=0x7f1db400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.757+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4013610 con 0x7f1dc00ce620 2023-10-16T13:38:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.757+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4013770 con 0x7f1dc00ce620 2023-10-16T13:38:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.757+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc0154fe0 con 0x7f1dc00ce620 2023-10-16T13:38:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.757+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4013b20 con 0x7f1dc00ce620 2023-10-16T13:38:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.757+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc0145310 con 0x7f1dc00ce620 2023-10-16T13:38:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.758+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc0067d20 con 0x7f1dc00ce620 2023-10-16T13:38:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.758+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1db4013c80 con 0x7f1dc00ce620 2023-10-16T13:38:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.759+0000 7f1da77fe700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1dac06aed0 0x7f1dac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.759+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1db4089310 con 0x7f1dc00ce620 2023-10-16T13:38:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.759+0000 7f1dbeffd700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1dac06aed0 0x7f1dac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.759+0000 7f1dbeffd700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1dac06aed0 0x7f1dac06d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1db00090b0 tx=0x7f1db0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.764+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1db40543d0 con 0x7f1dc00ce620 2023-10-16T13:38:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.966+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dc00cecb0 con 0x7f1dc00ce620 2023-10-16T13:38:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.967+0000 7f1da77fe700 1 -- 172.21.15.5:0/2663588902 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f1db40579f0 con 0x7f1dc00ce620 2023-10-16T13:38:29.970 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:29.971 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1dac06aed0 msgr2=0x7f1dac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1dac06aed0 0x7f1dac06d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1db00090b0 tx=0x7f1db0008030 comp rx=0 tx=0).stop 2023-10-16T13:38:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 msgr2=0x7f1dc0144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 0x7f1dc0144dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1db400e810 tx=0x7f1db400ebd0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 shutdown_connections 2023-10-16T13:38:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1dac06aed0 0x7f1dac06d390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1dc015f050 0x7f1dc00cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1dc00b0580 0x7f1dc0154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 --2- 172.21.15.5:0/2663588902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dc00ce620 0x7f1dc0144dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.969+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 >> 172.21.15.5:0/2663588902 conn(0x7f1dc00d1620 msgr2=0x7f1dc00ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.970+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 shutdown_connections 2023-10-16T13:38:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:29.970+0000 7f1dc52fc700 1 -- 172.21.15.5:0/2663588902 wait complete. 2023-10-16T13:38:29.984 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T13:38:29.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:30.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.107+0000 7fa778ddf700 1 Processor -- start 2023-10-16T13:38:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.107+0000 7fa778ddf700 1 -- start start 2023-10-16T13:38:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa778ddf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa77415f1f0 0x7fa7740cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa778ddf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa7740cfc60 0x7fa7740cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa778ddf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77415e7a0 con 0x7fa77415ab10 2023-10-16T13:38:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa778ddf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7740d0090 con 0x7fa77415f1f0 2023-10-16T13:38:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa778ddf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7740b29a0 con 0x7fa7740cfc60 2023-10-16T13:38:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa771d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa77415f1f0 0x7fa7740cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa77259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa77415ab10 0x7fa7740b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51936/0 (socket says 172.21.15.5:51936) 2023-10-16T13:38:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa77259c700 1 -- 172.21.15.5:0/505676919 learned_addr learned my addr 172.21.15.5:0/505676919 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa772d9d700 1 --2- 172.21.15.5:0/505676919 >> v2:172.21.15.112:3300/0 conn(0x7fa7740cfc60 0x7fa7740cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa771d9b700 1 -- 172.21.15.5:0/505676919 >> v2:172.21.15.112:3300/0 conn(0x7fa7740cfc60 msgr2=0x7fa7740cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa771d9b700 1 --2- 172.21.15.5:0/505676919 >> v2:172.21.15.112:3300/0 conn(0x7fa7740cfc60 0x7fa7740cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa771d9b700 1 -- 172.21.15.5:0/505676919 >> v1:172.21.15.5:6789/0 conn(0x7fa77415ab10 legacy=0x7fa7740b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa771d9b700 1 -- 172.21.15.5:0/505676919 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740b2c80 con 0x7fa77415f1f0 2023-10-16T13:38:30.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa77159a700 1 -- 172.21.15.5:0/505676919 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234739707 0 0) 0x7fa77415e7a0 con 0x7fa77415ab10 2023-10-16T13:38:30.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.108+0000 7fa771d9b700 1 --2- 172.21.15.5:0/505676919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415f1f0 0x7fa7740cf720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7740d03e0 tx=0x7fa768009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400f07a73543f394 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa77159a700 1 -- 172.21.15.5:0/505676919 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768005e30 con 0x7fa77415f1f0 2023-10-16T13:38:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa77159a700 1 -- 172.21.15.5:0/505676919 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768006030 con 0x7fa77415f1f0 2023-10-16T13:38:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa77159a700 1 -- 172.21.15.5:0/505676919 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680063c0 con 0x7fa77415f1f0 2023-10-16T13:38:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 -- 172.21.15.5:0/505676919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415f1f0 msgr2=0x7fa7740cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 --2- 172.21.15.5:0/505676919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415f1f0 0x7fa7740cf720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7740d03e0 tx=0x7fa768009b00 comp rx=0 tx=0).stop 2023-10-16T13:38:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 -- 172.21.15.5:0/505676919 shutdown_connections 2023-10-16T13:38:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 --2- 172.21.15.5:0/505676919 >> v2:172.21.15.112:3300/0 conn(0x7fa7740cfc60 0x7fa7740cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 --2- 172.21.15.5:0/505676919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415f1f0 0x7fa7740cf720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 -- 172.21.15.5:0/505676919 >> 172.21.15.5:0/505676919 conn(0x7fa77406dae0 msgr2=0x7fa77406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 -- 172.21.15.5:0/505676919 shutdown_connections 2023-10-16T13:38:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.109+0000 7fa778ddf700 1 -- 172.21.15.5:0/505676919 wait complete. 2023-10-16T13:38:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 Processor -- start 2023-10-16T13:38:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 -- start start 2023-10-16T13:38:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740cfc60 0x7fa77415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 0x7fa77406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa77415f1f0 0x7fa7741ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740c4000 con 0x7fa77415ab10 2023-10-16T13:38:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7741eff20 con 0x7fa7740cfc60 2023-10-16T13:38:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa778ddf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7741f0200 con 0x7fa77415f1f0 2023-10-16T13:38:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa771d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 0x7fa77406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa771d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 0x7fa77406e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41940/0 (socket says 172.21.15.5:41940) 2023-10-16T13:38:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.111+0000 7fa771d9b700 1 -- 172.21.15.5:0/3713240196 learned_addr learned my addr 172.21.15.5:0/3713240196 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa77259c700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740cfc60 0x7fa77415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa772d9d700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa77415f1f0 0x7fa7741ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa771d9b700 1 -- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa77415f1f0 msgr2=0x7fa7741ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa771d9b700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa77415f1f0 0x7fa7741ef3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa771d9b700 1 -- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740cfc60 msgr2=0x7fa77415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa771d9b700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740cfc60 0x7fa77415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa771d9b700 1 -- 172.21.15.5:0/3713240196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009430 con 0x7fa77415ab10 2023-10-16T13:38:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa772d9d700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa77415f1f0 0x7fa7741ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa771d9b700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 0x7fa77406e130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa768000c00 tx=0x7fa768004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768021070 con 0x7fa77415ab10 2023-10-16T13:38:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768004260 con 0x7fa77415ab10 2023-10-16T13:38:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7740c4210 con 0x7fa77415ab10 2023-10-16T13:38:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680045f0 con 0x7fa77415ab10 2023-10-16T13:38:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.112+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77415c480 con 0x7fa77415ab10 2023-10-16T13:38:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.113+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7740c4730 con 0x7fa77415ab10 2023-10-16T13:38:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.113+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7680036a0 con 0x7fa77415ab10 2023-10-16T13:38:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.114+0000 7fa762ffd700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa75406af00 0x7fa75406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.114+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa76808c930 con 0x7fa77415ab10 2023-10-16T13:38:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.114+0000 7fa77259c700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa75406af00 0x7fa75406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.114+0000 7fa77259c700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa75406af00 0x7fa75406d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa764000f60 tx=0x7fa764007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.118+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7740c4730 con 0x7fa77415ab10 2023-10-16T13:38:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.320+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7740c4730 con 0x7fa77415ab10 2023-10-16T13:38:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.322+0000 7fa762ffd700 1 -- 172.21.15.5:0/3713240196 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fa7740c4730 con 0x7fa77415ab10 2023-10-16T13:38:30.325 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa75406af00 msgr2=0x7fa75406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa75406af00 0x7fa75406d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa764000f60 tx=0x7fa764007c90 comp rx=0 tx=0).stop 2023-10-16T13:38:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 msgr2=0x7fa77406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 0x7fa77406e130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa768000c00 tx=0x7fa768004750 comp rx=0 tx=0).stop 2023-10-16T13:38:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 shutdown_connections 2023-10-16T13:38:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa75406af00 0x7fa75406d3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa77415f1f0 0x7fa7741ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740cfc60 0x7fa77415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 --2- 172.21.15.5:0/3713240196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77415ab10 0x7fa77406e130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 >> 172.21.15.5:0/3713240196 conn(0x7fa77406dae0 msgr2=0x7fa774159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 shutdown_connections 2023-10-16T13:38:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.324+0000 7fa778ddf700 1 -- 172.21.15.5:0/3713240196 wait complete. 2023-10-16T13:38:30.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T13:38:30.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T13:38:30.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T13:38:30.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T13:38:30.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T13:38:30.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T13:38:30.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T13:38:30.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T13:38:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.534+0000 7fa0271fa700 1 Processor -- start 2023-10-16T13:38:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.535+0000 7fa0271fa700 1 -- start start 2023-10-16T13:38:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.536+0000 7fa0271fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0200cff10 0x7fa02015df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.536+0000 7fa0271fa700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02015af20 con 0x7fa0200c9fc0 2023-10-16T13:38:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.536+0000 7fa0271fa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa020157960 con 0x7fa020159fa0 2023-10-16T13:38:30.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.536+0000 7fa0271fa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02015e470 con 0x7fa0200cff10 2023-10-16T13:38:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.537+0000 7fa01ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0200c9fc0 0x7fa020157250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51950/0 (socket says 172.21.15.5:51950) 2023-10-16T13:38:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.537+0000 7fa01ffff700 1 -- 172.21.15.5:0/2189360278 learned_addr learned my addr 172.21.15.5:0/2189360278 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.537+0000 7fa024f96700 1 --2- 172.21.15.5:0/2189360278 >> v2:172.21.15.112:3300/0 conn(0x7fa0200cff10 0x7fa02015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.537+0000 7fa024f96700 1 -- 172.21.15.5:0/2189360278 >> v1:172.21.15.112:6789/0 conn(0x7fa020159fa0 legacy=0x7fa02006c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.537+0000 7fa024f96700 1 -- 172.21.15.5:0/2189360278 >> v1:172.21.15.5:6789/0 conn(0x7fa0200c9fc0 legacy=0x7fa020157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.537+0000 7fa024f96700 1 -- 172.21.15.5:0/2189360278 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02015a960 con 0x7fa0200cff10 2023-10-16T13:38:30.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.538+0000 7fa024f96700 1 --2- 172.21.15.5:0/2189360278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 0x7fa02015df30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa014009840 tx=0x7fa014009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc1b2c98e7c828c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.539+0000 7fa01f7fe700 1 -- 172.21.15.5:0/2189360278 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014004230 con 0x7fa0200cff10 2023-10-16T13:38:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.539+0000 7fa01f7fe700 1 -- 172.21.15.5:0/2189360278 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014004390 con 0x7fa0200cff10 2023-10-16T13:38:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.539+0000 7fa01f7fe700 1 -- 172.21.15.5:0/2189360278 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140036a0 con 0x7fa0200cff10 2023-10-16T13:38:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 -- 172.21.15.5:0/2189360278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 msgr2=0x7fa02015df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 --2- 172.21.15.5:0/2189360278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 0x7fa02015df30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa014009840 tx=0x7fa014009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 -- 172.21.15.5:0/2189360278 shutdown_connections 2023-10-16T13:38:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 --2- 172.21.15.5:0/2189360278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 0x7fa02015df30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 -- 172.21.15.5:0/2189360278 >> 172.21.15.5:0/2189360278 conn(0x7fa0200cf3f0 msgr2=0x7fa0200cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 -- 172.21.15.5:0/2189360278 shutdown_connections 2023-10-16T13:38:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.540+0000 7fa0271fa700 1 -- 172.21.15.5:0/2189360278 wait complete. 2023-10-16T13:38:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.542+0000 7fa0271fa700 1 Processor -- start 2023-10-16T13:38:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.542+0000 7fa0271fa700 1 -- start start 2023-10-16T13:38:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa0271fa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0200c9fc0 0x7fa020072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa0271fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 0x7fa020156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa0271fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa020159fa0 0x7fa020156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa0271fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa020149c50 con 0x7fa020159fa0 2023-10-16T13:38:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa0271fa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0200b4310 con 0x7fa0200cff10 2023-10-16T13:38:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa0271fa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0200b45f0 con 0x7fa0200c9fc0 2023-10-16T13:38:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa020159fa0 0x7fa020156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa020159fa0 0x7fa020156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41956/0 (socket says 172.21.15.5:41956) 2023-10-16T13:38:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 -- 172.21.15.5:0/4134158760 learned_addr learned my addr 172.21.15.5:0/4134158760 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 -- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0200c9fc0 msgr2=0x7fa020072110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0200c9fc0 0x7fa020072110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 -- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 msgr2=0x7fa020156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0200cff10 0x7fa020156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.544+0000 7fa025797700 1 -- 172.21.15.5:0/4134158760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140094a0 con 0x7fa020159fa0 2023-10-16T13:38:30.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.545+0000 7fa025797700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa020159fa0 0x7fa020156f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa01800caa0 tx=0x7fa01800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.545+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018003c00 con 0x7fa020159fa0 2023-10-16T13:38:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.545+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa018003d60 con 0x7fa020159fa0 2023-10-16T13:38:30.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.545+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01800aac0 con 0x7fa020159fa0 2023-10-16T13:38:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.545+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0200b48d0 con 0x7fa020159fa0 2023-10-16T13:38:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.545+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0200b3fc0 con 0x7fa020159fa0 2023-10-16T13:38:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.546+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa02015d730 con 0x7fa020159fa0 2023-10-16T13:38:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.548+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa01800ac20 con 0x7fa020159fa0 2023-10-16T13:38:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.548+0000 7fa01d7fa700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa00406afa0 0x7fa00406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.549+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0180894a0 con 0x7fa020159fa0 2023-10-16T13:38:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.549+0000 7fa01d7fa700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fa0040731c0 0x7fa0040755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.549+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 --> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa004075c90 con 0x7fa0040731c0 2023-10-16T13:38:30.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.549+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa01808bac0 con 0x7fa020159fa0 2023-10-16T13:38:30.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.551+0000 7fa01ffff700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fa0040731c0 0x7fa0040755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.551+0000 7fa024f96700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa00406afa0 0x7fa00406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.552+0000 7fa024f96700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa00406afa0 0x7fa00406d460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa014009b90 tx=0x7fa014008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.552+0000 7fa01ffff700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fa0040731c0 0x7fa0040755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.553+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== osd.4 v2:172.21.15.112:6816/3896016116 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa004075c90 con 0x7fa0040731c0 2023-10-16T13:38:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.560+0000 7ffa7f9b5700 1 Processor -- start 2023-10-16T13:38:30.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.560+0000 7fba66fb5700 1 Processor -- start 2023-10-16T13:38:30.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.560+0000 7fba66fb5700 1 -- start start 2023-10-16T13:38:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.560+0000 7ffa7f9b5700 1 -- start start 2023-10-16T13:38:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.561+0000 7f6d286c8700 1 Processor -- start 2023-10-16T13:38:30.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7ffa7f9b5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa780cc6e0 0x7ffa780cac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7ffa7f9b5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780cf0d0 con 0x7ffa7806a840 2023-10-16T13:38:30.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7ffa7f9b5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780ce450 con 0x7ffa780c3ac0 2023-10-16T13:38:30.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7ffa7f9b5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780ce730 con 0x7ffa780cc6e0 2023-10-16T13:38:30.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7ffa7df52700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa7806a840 0x7ffa7806ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51970/0 (socket says 172.21.15.5:51970) 2023-10-16T13:38:30.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7ffa7df52700 1 -- 172.21.15.5:0/3316921730 learned_addr learned my addr 172.21.15.5:0/3316921730 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba66fb5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba600cc3f0 0x7fba600cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba66fb5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba60071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba66fb5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba60071ab0 con 0x7fba60161670 2023-10-16T13:38:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba66fb5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba60161bc0 con 0x7fba600cc3f0 2023-10-16T13:38:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba66fb5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba60161ea0 con 0x7fba6006af50 2023-10-16T13:38:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba64d51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba600cc3f0 0x7fba600cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba64d51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba600cc3f0 0x7fba600cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37860/0 (socket says 172.21.15.5:37860) 2023-10-16T13:38:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba64d51700 1 -- 172.21.15.5:0/514549733 learned_addr learned my addr 172.21.15.5:0/514549733 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.562+0000 7fba65552700 1 --2- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba60071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba64d51700 1 -- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 msgr2=0x7fba60071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba64d51700 1 --2- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba60071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba64d51700 1 -- 172.21.15.5:0/514549733 >> v1:172.21.15.5:6789/0 conn(0x7fba60161670 legacy=0x7fba6006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba64d51700 1 -- 172.21.15.5:0/514549733 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60162180 con 0x7fba600cc3f0 2023-10-16T13:38:30.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f97ecb01700 1 Processor -- start 2023-10-16T13:38:30.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7ffa7d751700 1 --2- 172.21.15.5:0/3316921730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa780cc6e0 0x7ffa780cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7ffa7d751700 1 -- 172.21.15.5:0/3316921730 >> v1:172.21.15.112:6789/0 conn(0x7ffa780c3ac0 legacy=0x7ffa781664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7ffa6ffff700 1 -- 172.21.15.5:0/3316921730 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960518571 0 0) 0x7ffa780cf0d0 con 0x7ffa7806a840 2023-10-16T13:38:30.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7ffa7d751700 1 -- 172.21.15.5:0/3316921730 >> v1:172.21.15.5:6789/0 conn(0x7ffa7806a840 legacy=0x7ffa7806ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7ffa7d751700 1 -- 172.21.15.5:0/3316921730 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780cea10 con 0x7ffa780cc6e0 2023-10-16T13:38:30.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba64d51700 1 --2- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba600cc3f0 0x7fba600cc7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba500098f0 tx=0x7fba50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5269ea5005c07e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba5f7fe700 1 -- 172.21.15.5:0/514549733 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50011830 con 0x7fba600cc3f0 2023-10-16T13:38:30.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba5f7fe700 1 -- 172.21.15.5:0/514549733 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba50011990 con 0x7fba600cc3f0 2023-10-16T13:38:30.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7fba5f7fe700 1 -- 172.21.15.5:0/514549733 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50011d20 con 0x7fba600cc3f0 2023-10-16T13:38:30.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.561+0000 7f6d286c8700 1 -- start start 2023-10-16T13:38:30.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d286c8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d20157630 0x7f6d2006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d286c8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2015af20 con 0x7f6d200c9fc0 2023-10-16T13:38:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d286c8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2015a6b0 con 0x7f6d20157250 2023-10-16T13:38:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d286c8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2015a960 con 0x7f6d20157630 2023-10-16T13:38:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d26c65700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d20157630 0x7f6d2006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d26c65700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d20157630 0x7f6d2006c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37872/0 (socket says 172.21.15.5:37872) 2023-10-16T13:38:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f6d26c65700 1 -- 172.21.15.5:0/1090045706 learned_addr learned my addr 172.21.15.5:0/1090045706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f6d26c65700 1 -- 172.21.15.5:0/1090045706 >> v1:172.21.15.112:6789/0 conn(0x7f6d20157250 legacy=0x7f6d2015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f6d26c65700 1 -- 172.21.15.5:0/1090045706 >> v1:172.21.15.5:6789/0 conn(0x7f6d200c9fc0 legacy=0x7f6d20159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f6d26c65700 1 -- 172.21.15.5:0/1090045706 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2015ac40 con 0x7f6d20157630 2023-10-16T13:38:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.563+0000 7f97ecb01700 1 -- start start 2023-10-16T13:38:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f6d26c65700 1 --2- 172.21.15.5:0/1090045706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d20157630 0x7f6d2006c9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800d370 tx=0x7f6d1800d680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ef5f452cf540c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7ffa7d751700 1 --2- 172.21.15.5:0/3316921730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa780cc6e0 0x7ffa780cac90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009dc0 tx=0x7ffa7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b231f037905e9a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f97ecb01700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97e8072450 0x7f97e80cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f97ecb01700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e80aca20 0x7f97e80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f97ecb01700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e80ace50 con 0x7f97e80cf2e0 2023-10-16T13:38:30.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f97ecb01700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e80cfcb0 con 0x7f97e8072450 2023-10-16T13:38:30.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.564+0000 7f97ecb01700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cdf80 con 0x7f97e80aca20 2023-10-16T13:38:30.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97e8072450 0x7f97e80cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97e8072450 0x7f97e80cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41980/0 (socket says 172.21.15.5:41980) 2023-10-16T13:38:30.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 -- 172.21.15.5:0/4126256302 learned_addr learned my addr 172.21.15.5:0/4126256302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e6d9d700 1 --2- 172.21.15.5:0/4126256302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e80aca20 0x7f97e80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 -- 172.21.15.5:0/4126256302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e80aca20 msgr2=0x7f97e80cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 --2- 172.21.15.5:0/4126256302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e80aca20 0x7f97e80cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 -- 172.21.15.5:0/4126256302 >> v1:172.21.15.5:6789/0 conn(0x7f97e80cf2e0 legacy=0x7f97e80ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 -- 172.21.15.5:0/4126256302 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80ad080 con 0x7f97e8072450 2023-10-16T13:38:30.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f97e659c700 1 --2- 172.21.15.5:0/4126256302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e8072450 0x7f97e80cda40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098f0 tx=0x7f97d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6baea2477f6951 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7fba66fb5700 1 -- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba600cc3f0 msgr2=0x7fba600cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7fba66fb5700 1 --2- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba600cc3f0 0x7fba600cc7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba500098f0 tx=0x7fba50009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:30.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f6d25462700 1 -- 172.21.15.5:0/1090045706 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18010070 con 0x7f6d20157630 2023-10-16T13:38:30.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f6d25462700 1 -- 172.21.15.5:0/1090045706 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800dcd0 con 0x7f6d20157630 2023-10-16T13:38:30.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7f6d25462700 1 -- 172.21.15.5:0/1090045706 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18007d50 con 0x7f6d20157630 2023-10-16T13:38:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.565+0000 7ffa6ffff700 1 -- 172.21.15.5:0/3316921730 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000e070 con 0x7ffa780cc6e0 2023-10-16T13:38:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7ffa6ffff700 1 -- 172.21.15.5:0/3316921730 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000bbd0 con 0x7ffa780cc6e0 2023-10-16T13:38:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7ffa6ffff700 1 -- 172.21.15.5:0/3316921730 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70012430 con 0x7ffa780cc6e0 2023-10-16T13:38:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7fba66fb5700 1 -- 172.21.15.5:0/514549733 shutdown_connections 2023-10-16T13:38:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7fba66fb5700 1 --2- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba60071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7fba66fb5700 1 --2- 172.21.15.5:0/514549733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba600cc3f0 0x7fba600cc7d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7fba66fb5700 1 -- 172.21.15.5:0/514549733 >> 172.21.15.5:0/514549733 conn(0x7fba6006dac0 msgr2=0x7fba6006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7fba66fb5700 1 -- 172.21.15.5:0/514549733 shutdown_connections 2023-10-16T13:38:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f6d286c8700 1 -- 172.21.15.5:0/1090045706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d20157630 msgr2=0x7f6d2006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f6d286c8700 1 --2- 172.21.15.5:0/1090045706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d20157630 0x7f6d2006c9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800d370 tx=0x7f6d1800d680 comp rx=0 tx=0).stop 2023-10-16T13:38:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f6d286c8700 1 -- 172.21.15.5:0/1090045706 shutdown_connections 2023-10-16T13:38:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f6d286c8700 1 --2- 172.21.15.5:0/1090045706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d20157630 0x7f6d2006c9b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f6d286c8700 1 -- 172.21.15.5:0/1090045706 >> 172.21.15.5:0/1090045706 conn(0x7f6d200cf3f0 msgr2=0x7f6d200cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f97e5d9b700 1 -- 172.21.15.5:0/4126256302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800b8a0 con 0x7f97e8072450 2023-10-16T13:38:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f97e5d9b700 1 -- 172.21.15.5:0/4126256302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800ba00 con 0x7f97e8072450 2023-10-16T13:38:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7f97e5d9b700 1 -- 172.21.15.5:0/4126256302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800bd90 con 0x7f97e8072450 2023-10-16T13:38:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7f97ecb01700 1 -- 172.21.15.5:0/4126256302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e8072450 msgr2=0x7f97e80cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7f97ecb01700 1 --2- 172.21.15.5:0/4126256302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e8072450 0x7f97e80cda40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098f0 tx=0x7f97d8009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.566+0000 7fba66fb5700 1 -- 172.21.15.5:0/514549733 wait complete. 2023-10-16T13:38:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7fba66fb5700 1 Processor -- start 2023-10-16T13:38:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7f97ecb01700 1 -- 172.21.15.5:0/4126256302 shutdown_connections 2023-10-16T13:38:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7f97ecb01700 1 --2- 172.21.15.5:0/4126256302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e80aca20 0x7f97e80cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7f97ecb01700 1 --2- 172.21.15.5:0/4126256302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e8072450 0x7f97e80cda40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7f97ecb01700 1 -- 172.21.15.5:0/4126256302 >> 172.21.15.5:0/4126256302 conn(0x7f97e8070e90 msgr2=0x7f97e8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.569+0000 7f97ecb01700 1 -- 172.21.15.5:0/4126256302 shutdown_connections 2023-10-16T13:38:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.568+0000 7fba66fb5700 1 -- start start 2023-10-16T13:38:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba66fb5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba600c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba66fb5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba600cc3f0 0x7fba60157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba66fb5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba60161670 0x7fba60155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba66fb5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba600c5740 con 0x7fba600cc3f0 2023-10-16T13:38:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba66fb5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba600ca400 con 0x7fba60161670 2023-10-16T13:38:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba66fb5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba600c4da0 con 0x7fba6006af50 2023-10-16T13:38:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba5ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba600cc3f0 0x7fba60157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba5ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba600cc3f0 0x7fba60157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41988/0 (socket says 172.21.15.5:41988) 2023-10-16T13:38:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba600c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba5ffff700 1 -- 172.21.15.5:0/3220358032 learned_addr learned my addr 172.21.15.5:0/3220358032 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba65552700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba60161670 0x7fba60155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7f6d286c8700 1 -- 172.21.15.5:0/1090045706 shutdown_connections 2023-10-16T13:38:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7f6d286c8700 1 -- 172.21.15.5:0/1090045706 wait complete. 2023-10-16T13:38:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 -- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba60161670 msgr2=0x7fba60155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba60161670 0x7fba60155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 -- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba600cc3f0 msgr2=0x7fba60157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba600cc3f0 0x7fba60157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 -- 172.21.15.5:0/3220358032 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009550 con 0x7fba6006af50 2023-10-16T13:38:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.570+0000 7fba64d51700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba600c9ba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba50016000 tx=0x7fba50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50004450 con 0x7fba6006af50 2023-10-16T13:38:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba500045d0 con 0x7fba6006af50 2023-10-16T13:38:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7fba66fb5700 1 -- 172.21.15.5:0/3220358032 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba600c5080 con 0x7fba6006af50 2023-10-16T13:38:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba500038e0 con 0x7fba6006af50 2023-10-16T13:38:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7fba66fb5700 1 -- 172.21.15.5:0/3220358032 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba600ca0e0 con 0x7fba6006af50 2023-10-16T13:38:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.573+0000 7f6d286c8700 1 Processor -- start 2023-10-16T13:38:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.573+0000 7f6d286c8700 1 -- start start 2023-10-16T13:38:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d286c8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d200c9fc0 0x7f6d2006cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d286c8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d20157630 0x7f6d20157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d286c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d200c75d0 0x7f6d200c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d286c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20159150 con 0x7f6d200c75d0 2023-10-16T13:38:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d286c8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d201584d0 con 0x7f6d200c9fc0 2023-10-16T13:38:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d286c8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d201587b0 con 0x7f6d20157630 2023-10-16T13:38:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.572+0000 7f97ecb01700 1 -- 172.21.15.5:0/4126256302 wait complete. 2023-10-16T13:38:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7f97ecb01700 1 Processor -- start 2023-10-16T13:38:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d200c9fc0 0x7f6d2006cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d200c9fc0 0x7f6d2006cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37890/0 (socket says 172.21.15.5:37890) 2023-10-16T13:38:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 -- 172.21.15.5:0/2338598029 learned_addr learned my addr 172.21.15.5:0/2338598029 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26c65700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d200c75d0 0x7f6d200c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/3316921730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa780cc6e0 msgr2=0x7ffa780cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7ffa7f9b5700 1 --2- 172.21.15.5:0/3316921730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa780cc6e0 0x7ffa780cac90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009dc0 tx=0x7ffa7000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/3316921730 shutdown_connections 2023-10-16T13:38:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7ffa7f9b5700 1 --2- 172.21.15.5:0/3316921730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa780cc6e0 0x7ffa780cac90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.571+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/3316921730 >> 172.21.15.5:0/3316921730 conn(0x7ffa7806dac0 msgr2=0x7ffa7806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.572+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/3316921730 shutdown_connections 2023-10-16T13:38:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.572+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/3316921730 wait complete. 2023-10-16T13:38:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.573+0000 7ffa7f9b5700 1 Processor -- start 2023-10-16T13:38:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.573+0000 7ffa7f9b5700 1 -- start start 2023-10-16T13:38:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7ffa7f9b5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa7806a840 0x7ffa780b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7ffa7f9b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa780c3ac0 0x7ffa780b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7ffa7f9b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa780cc6e0 0x7ffa780c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7ffa7f9b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c6aa0 con 0x7ffa780cc6e0 2023-10-16T13:38:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7ffa7f9b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c5e90 con 0x7ffa780c3ac0 2023-10-16T13:38:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7ffa7f9b5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c6170 con 0x7ffa7806a840 2023-10-16T13:38:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 -- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d20157630 msgr2=0x7f6d20157af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d20157630 0x7f6d20157af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 -- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d200c75d0 msgr2=0x7f6d200c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d200c75d0 0x7f6d200c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 -- 172.21.15.5:0/2338598029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1800d050 con 0x7f6d200c9fc0 2023-10-16T13:38:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26c65700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d200c75d0 0x7f6d200c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f6d26464700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d200c9fc0 0x7f6d2006cc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c430 tx=0x7f6d1000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7ffa7df52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa780cc6e0 0x7ffa780c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7ffa7df52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa780cc6e0 0x7ffa780c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42000/0 (socket says 172.21.15.5:42000) 2023-10-16T13:38:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7ffa7df52700 1 -- 172.21.15.5:0/2535530656 learned_addr learned my addr 172.21.15.5:0/2535530656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7efe1299d700 1 Processor -- start 2023-10-16T13:38:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7efe1299d700 1 -- start start 2023-10-16T13:38:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7efe1299d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe0c0ceae0 0x7efe0c08a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7efe1299d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c16f060 0x7efe0c08a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7efe1299d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0cf250 con 0x7efe0c0ca450 2023-10-16T13:38:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7efe1299d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c16ebd0 con 0x7efe0c0ceae0 2023-10-16T13:38:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7efe1299d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0ca900 con 0x7efe0c16f060 2023-10-16T13:38:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe0c0ceae0 0x7efe0c08a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe0c0ceae0 0x7efe0c08a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42008/0 (socket says 172.21.15.5:42008) 2023-10-16T13:38:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 -- 172.21.15.5:0/930974061 learned_addr learned my addr 172.21.15.5:0/930974061 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 -- 172.21.15.5:0/930974061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c16f060 msgr2=0x7efe0c08a9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 --2- 172.21.15.5:0/930974061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c16f060 0x7efe0c08a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 -- 172.21.15.5:0/930974061 >> v1:172.21.15.5:6789/0 conn(0x7efe0c0ca450 legacy=0x7efe0c06def0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 -- 172.21.15.5:0/930974061 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c16e580 con 0x7efe0c0ceae0 2023-10-16T13:38:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0bfff700 1 --2- 172.21.15.5:0/930974061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c0ceae0 0x7efe0c08a490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00bb90 tx=0x7efdfc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14db46463c8038d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7efe0affd700 1 -- 172.21.15.5:0/930974061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00dd10 con 0x7efe0c0ceae0 2023-10-16T13:38:30.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe0affd700 1 -- 172.21.15.5:0/930974061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc00de70 con 0x7efe0c0ceae0 2023-10-16T13:38:30.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe0affd700 1 -- 172.21.15.5:0/930974061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc004230 con 0x7efe0c0ceae0 2023-10-16T13:38:30.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011790 con 0x7f6d200c9fc0 2023-10-16T13:38:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100118f0 con 0x7f6d200c9fc0 2023-10-16T13:38:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011ca0 con 0x7f6d200c9fc0 2023-10-16T13:38:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d20158a90 con 0x7f6d200c9fc0 2023-10-16T13:38:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2006d160 con 0x7f6d200c9fc0 2023-10-16T13:38:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d08000fc0 con 0x7f6d200c9fc0 2023-10-16T13:38:30.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 -- 172.21.15.5:0/930974061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c0ceae0 msgr2=0x7efe0c08a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 --2- 172.21.15.5:0/930974061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c0ceae0 0x7efe0c08a490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00bb90 tx=0x7efdfc00bea0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 -- 172.21.15.5:0/930974061 shutdown_connections 2023-10-16T13:38:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 --2- 172.21.15.5:0/930974061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c0ceae0 0x7efe0c08a490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 --2- 172.21.15.5:0/930974061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c16f060 0x7efe0c08a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 -- 172.21.15.5:0/930974061 >> 172.21.15.5:0/930974061 conn(0x7efe0c0cf3f0 msgr2=0x7efe0c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 -- 172.21.15.5:0/930974061 shutdown_connections 2023-10-16T13:38:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7efe1299d700 1 -- 172.21.15.5:0/930974061 wait complete. 2023-10-16T13:38:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa7df52700 1 -- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa7806a840 msgr2=0x7ffa780b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa7df52700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa7806a840 0x7ffa780b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa7df52700 1 -- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa780c3ac0 msgr2=0x7ffa780b43b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:38:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa7df52700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa780c3ac0 0x7ffa780b43b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa7df52700 1 -- 172.21.15.5:0/2535530656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009a70 con 0x7ffa780cc6e0 2023-10-16T13:38:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7efe1299d700 1 Processor -- start 2023-10-16T13:38:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa7df52700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa780cc6e0 0x7ffa780c3fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c410 tx=0x7ffa7400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74004c80 con 0x7ffa780cc6e0 2023-10-16T13:38:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74004de0 con 0x7ffa780cc6e0 2023-10-16T13:38:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74007310 con 0x7ffa780cc6e0 2023-10-16T13:38:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d1001c460 con 0x7f6d200c9fc0 2023-10-16T13:38:30.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba38000fc0 con 0x7fba6006af50 2023-10-16T13:38:30.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fba50003a40 con 0x7fba6006af50 2023-10-16T13:38:30.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7fba5d7fa700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fba4c06af00 0x7fba4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba5008a8e0 con 0x7fba6006af50 2023-10-16T13:38:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7fba5d7fa700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7fba4c073120 0x7fba4c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 --> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba4c075bf0 con 0x7fba4c073120 2023-10-16T13:38:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba5008f220 con 0x7fba6006af50 2023-10-16T13:38:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7fba5ffff700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fba4c06af00 0x7fba4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7fba5ffff700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fba4c06af00 0x7fba4c06d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba600b2680 tx=0x7fba54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.577+0000 7fba65552700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7fba4c073120 0x7fba4c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.578+0000 7fba65552700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7fba4c073120 0x7fba4c075540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f6d16ffd700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d0406af50 0x7f6d0406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d10089c90 con 0x7f6d200c9fc0 2023-10-16T13:38:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.574+0000 7f97ecb01700 1 -- start start 2023-10-16T13:38:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f97ecb01700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e8072450 0x7f97e80af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.575+0000 7f97ecb01700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e80aca20 0x7f97e809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f97ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e80aca20 0x7f97e809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.576+0000 7f97ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e80aca20 0x7f97e809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42004/0 (socket says 172.21.15.5:42004) 2023-10-16T13:38:30.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa780c6450 con 0x7ffa780cc6e0 2023-10-16T13:38:30.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa780b3e10 con 0x7ffa780cc6e0 2023-10-16T13:38:30.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa780cecf0 con 0x7ffa780cc6e0 2023-10-16T13:38:30.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== osd.1 v2:172.21.15.5:6800/3441513170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fba4c075bf0 con 0x7fba4c073120 2023-10-16T13:38:30.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.580+0000 7efe1299d700 1 -- start start 2023-10-16T13:38:30.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe1299d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c0ca450 0x7efe0c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe1299d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe0c16f060 0x7efe0c207fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe1299d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c06e490 0x7efe0c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe1299d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c06ee60 con 0x7efe0c06e490 2023-10-16T13:38:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe1299d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b2010 con 0x7efe0c16f060 2023-10-16T13:38:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe1299d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b2220 con 0x7efe0c0ca450 2023-10-16T13:38:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe0c16f060 0x7efe0c207fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe0c16f060 0x7efe0c207fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37908/0 (socket says 172.21.15.5:37908) 2023-10-16T13:38:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7efe0b7fe700 1 -- 172.21.15.5:0/4117847417 learned_addr learned my addr 172.21.15.5:0/4117847417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7efe0b7fe700 1 -- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c0ca450 msgr2=0x7efe0c0c5820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7efe0b7fe700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe0c0ca450 0x7efe0c0c5820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7efe0b7fe700 1 -- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c06e490 msgr2=0x7efe0c06e920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:38:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7efe0b7fe700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe0c06e490 0x7efe0c06e920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7efe0b7fe700 1 -- 172.21.15.5:0/4117847417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc00b7f0 con 0x7efe0c16f060 2023-10-16T13:38:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7efe0b7fe700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe0c16f060 0x7efe0c207fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe0000b450 tx=0x7efe0000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.583+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00011830 con 0x7efe0c16f060 2023-10-16T13:38:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.583+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00011990 con 0x7efe0c16f060 2023-10-16T13:38:30.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.583+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00011d20 con 0x7efe0c16f060 2023-10-16T13:38:30.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.583+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c0b2500 con 0x7efe0c16f060 2023-10-16T13:38:30.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.583+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c0b2ac0 con 0x7efe0c16f060 2023-10-16T13:38:30.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f6d16ffd700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7f6d04073170 0x7f6d04075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 --> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d04075c40 con 0x7f6d04073170 2023-10-16T13:38:30.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d1008a130 con 0x7f6d200c9fc0 2023-10-16T13:38:30.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f6d26c65700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7f6d04073170 0x7f6d04075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f6d25c63700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d0406af50 0x7f6d0406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f6d26c65700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7f6d04073170 0x7f6d04075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.583+0000 7f6d25c63700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d0406af50 0x7f6d0406d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000f60 tx=0x7f6d1c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f97ecb01700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e80cf2e0 0x7f97e809af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f97ecb01700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8099a30 con 0x7f97e80aca20 2023-10-16T13:38:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f97ecb01700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8200070 con 0x7f97e80cf2e0 2023-10-16T13:38:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.581+0000 7f97ecb01700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8099c80 con 0x7f97e8072450 2023-10-16T13:38:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 -- 172.21.15.5:0/22878884 learned_addr learned my addr 172.21.15.5:0/22878884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 -- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e8072450 msgr2=0x7f97e80af9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97e8072450 0x7f97e80af9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 -- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e80cf2e0 msgr2=0x7f97e809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97e80cf2e0 0x7f97e809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 -- 172.21.15.5:0/22878884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8009550 con 0x7f97e80aca20 2023-10-16T13:38:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.582+0000 7f97ddd9b700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e80aca20 0x7f97e809aa40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f97d000c4e0 tx=0x7f97d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.584+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe0c16e860 con 0x7efe0c16f060 2023-10-16T13:38:30.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.585+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 --> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa02015ac40 con 0x7fa0040731c0 2023-10-16T13:38:30.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.585+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== osd.3 v2:172.21.15.5:6824/81511064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6d04075c40 con 0x7f6d04073170 2023-10-16T13:38:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.585+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa74007470 con 0x7ffa780cc6e0 2023-10-16T13:38:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa6dffb700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa5c06af00 0x7ffa5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa74089280 con 0x7ffa780cc6e0 2023-10-16T13:38:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa7d751700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa5c06af00 0x7ffa5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa6dffb700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7ffa5c0730a0 0x7ffa5c0754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 --> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa5c075b70 con 0x7ffa5c0730a0 2023-10-16T13:38:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa7408b910 con 0x7ffa780cc6e0 2023-10-16T13:38:30.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.585+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efe0001a400 con 0x7efe0c16f060 2023-10-16T13:38:30.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe08ff9700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdf806af00 0x7efdf806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe00089cf0 con 0x7efe0c16f060 2023-10-16T13:38:30.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe0bfff700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdf806af00 0x7efdf806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe08ff9700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7efdf8073120 0x7efdf8075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 --> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdf8075bf0 con 0x7efdf8073120 2023-10-16T13:38:30.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe0008a0a0 con 0x7efe0c16f060 2023-10-16T13:38:30.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.585+0000 7fa01d7fa700 1 -- 172.21.15.5:0/4134158760 <== osd.4 v2:172.21.15.112:6816/3896016116 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa010004cb0 con 0x7fa0040731c0 2023-10-16T13:38:30.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa7cf50700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7ffa5c0730a0 0x7ffa5c0754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7efe10f3a700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7efdf8073120 0x7efdf8075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.586+0000 7ffa7d751700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa5c06af00 0x7ffa5c06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa70014040 tx=0x7ffa70010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.587+0000 7efe0bfff700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdf806af00 0x7efdf806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe0c070580 tx=0x7efdfc013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.587+0000 7ffa7cf50700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7ffa5c0730a0 0x7ffa5c0754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.587+0000 7efe10f3a700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7efdf8073120 0x7efdf8075540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.587+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== osd.0 v2:172.21.15.5:6808/2363290793 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ffa5c075b70 con 0x7ffa5c0730a0 2023-10-16T13:38:30.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.588+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== osd.2 v2:172.21.15.5:6816/1041667004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7efdf8075bf0 con 0x7efdf8073120 2023-10-16T13:38:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00052d0 con 0x7f97e80aca20 2023-10-16T13:38:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e8099f60 con 0x7f97e80aca20 2023-10-16T13:38:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e809a520 con 0x7f97e80aca20 2023-10-16T13:38:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0005430 con 0x7f97e80aca20 2023-10-16T13:38:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0003880 con 0x7f97e80aca20 2023-10-16T13:38:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fa0040731c0 msgr2=0x7fa0040755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.589+0000 7fa0271fa700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fa0040731c0 0x7fa0040755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.590+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97e80ad640 con 0x7f97e80aca20 2023-10-16T13:38:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.591+0000 7f4f97374700 1 Processor -- start 2023-10-16T13:38:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.591+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f97d00039e0 con 0x7f97e80aca20 2023-10-16T13:38:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97df7fe700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f97c806af50 0x7f97c806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97d0089300 con 0x7f97e80aca20 2023-10-16T13:38:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97df7fe700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f97c8073170 0x7f97c8075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 --> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97c8075c40 con 0x7f97c8073170 2023-10-16T13:38:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97d00897a0 con 0x7f97e80aca20 2023-10-16T13:38:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97e659c700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f97c806af50 0x7f97c806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f97e6d9d700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f97c8073170 0x7f97c8075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.591+0000 7f4f97374700 1 -- start start 2023-10-16T13:38:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f4f97374700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f90157250 0x7f4f9015df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f4f97374700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f900c9fc0 0x7f4f90159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f4f97374700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9015af20 con 0x7f4f9015a4e0 2023-10-16T13:38:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f4f97374700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9015e470 con 0x7f4f90157250 2023-10-16T13:38:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.592+0000 7f4f97374700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015a960 con 0x7f4f900c9fc0 2023-10-16T13:38:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f90157250 0x7f4f9015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f90157250 0x7f4f9015df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42036/0 (socket says 172.21.15.5:42036) 2023-10-16T13:38:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 -- 172.21.15.5:0/3908932078 learned_addr learned my addr 172.21.15.5:0/3908932078 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f97e6d9d700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f97c8073170 0x7f97c8075590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 -- 172.21.15.5:0/3908932078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f900c9fc0 msgr2=0x7f4f90159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 --2- 172.21.15.5:0/3908932078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f900c9fc0 0x7f4f90159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 -- 172.21.15.5:0/3908932078 >> v1:172.21.15.112:6789/0 conn(0x7f4f9015a4e0 legacy=0x7f4f9006c9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:38:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 -- 172.21.15.5:0/3908932078 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9015ac40 con 0x7f4f90157250 2023-10-16T13:38:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f95110700 1 --2- 172.21.15.5:0/3908932078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f90157250 0x7f4f9015df30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009160 tx=0x7f4f80009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad31015823f6d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f87fff700 1 -- 172.21.15.5:0/3908932078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80004230 con 0x7f4f90157250 2023-10-16T13:38:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.594+0000 7f97e659c700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f97c806af50 0x7f97c806d410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f97d8014040 tx=0x7f97d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f87fff700 1 -- 172.21.15.5:0/3908932078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80004390 con 0x7f4f90157250 2023-10-16T13:38:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.593+0000 7f4f87fff700 1 -- 172.21.15.5:0/3908932078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800036a0 con 0x7f4f90157250 2023-10-16T13:38:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.594+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== osd.5 v2:172.21.15.112:6808/3215612020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f97c8075c40 con 0x7f97c8073170 2023-10-16T13:38:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.594+0000 7f4f97374700 1 -- 172.21.15.5:0/3908932078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f90157250 msgr2=0x7f4f9015df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.594+0000 7f4f97374700 1 --2- 172.21.15.5:0/3908932078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f90157250 0x7f4f9015df30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009160 tx=0x7f4f80009470 comp rx=0 tx=0).stop 2023-10-16T13:38:30.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa00406afa0 msgr2=0x7fa00406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa0271fa700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa00406afa0 0x7fa00406d460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa014009b90 tx=0x7fa014008030 comp rx=0 tx=0).stop 2023-10-16T13:38:30.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa020159fa0 msgr2=0x7fa020156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa0271fa700 1 --2- 172.21.15.5:0/4134158760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa020159fa0 0x7fa020156f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa01800caa0 tx=0x7fa01800ce60 comp rx=0 tx=0).stop 2023-10-16T13:38:30.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa025797700 1 -- 172.21.15.5:0/4134158760 reap_dead start 2023-10-16T13:38:30.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 shutdown_connections 2023-10-16T13:38:30.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.596+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 >> 172.21.15.5:0/4134158760 conn(0x7fa0200cf3f0 msgr2=0x7fa02015c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.597+0000 7f4f97374700 1 -- 172.21.15.5:0/3908932078 shutdown_connections 2023-10-16T13:38:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.597+0000 7f4f97374700 1 --2- 172.21.15.5:0/3908932078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f90157250 0x7f4f9015df30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.597+0000 7f4f97374700 1 --2- 172.21.15.5:0/3908932078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f900c9fc0 0x7f4f90159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.597+0000 7f4f97374700 1 -- 172.21.15.5:0/3908932078 >> 172.21.15.5:0/3908932078 conn(0x7f4f900cf3f0 msgr2=0x7f4f900cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.604+0000 7f4f97374700 1 -- 172.21.15.5:0/3908932078 shutdown_connections 2023-10-16T13:38:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.605+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 --> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba38002d40 con 0x7fba4c073120 2023-10-16T13:38:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.605+0000 7fba5d7fa700 1 -- 172.21.15.5:0/3220358032 <== osd.1 v2:172.21.15.5:6800/3441513170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba38002d40 con 0x7fba4c073120 2023-10-16T13:38:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.605+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7fba4c073120 msgr2=0x7fba4c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.605+0000 7fba46ffd700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7fba4c073120 0x7fba4c075540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.601+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 shutdown_connections 2023-10-16T13:38:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.601+0000 7fa0271fa700 1 -- 172.21.15.5:0/4134158760 wait complete. 2023-10-16T13:38:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.609+0000 7f4f97374700 1 -- 172.21.15.5:0/3908932078 wait complete. 2023-10-16T13:38:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.610+0000 7f4f97374700 1 Processor -- start 2023-10-16T13:38:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.610+0000 7f4f97374700 1 -- start start 2023-10-16T13:38:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f97374700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f900c9fc0 0x7f4f900b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f97374700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f90157250 0x7f4f900b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f97374700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9015a4e0 0x7f4f90156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f97374700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3190 con 0x7f4f9015a4e0 2023-10-16T13:38:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f97374700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3bc0 con 0x7f4f900c9fc0 2023-10-16T13:38:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f97374700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3ea0 con 0x7f4f90157250 2023-10-16T13:38:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9015a4e0 0x7f4f90156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9015a4e0 0x7f4f90156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42046/0 (socket says 172.21.15.5:42046) 2023-10-16T13:38:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 -- 172.21.15.5:0/3366031086 learned_addr learned my addr 172.21.15.5:0/3366031086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f9490f700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f90157250 0x7f4f900b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95110700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f900c9fc0 0x7f4f900b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 -- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f90157250 msgr2=0x7f4f900b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f90157250 0x7f4f900b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 -- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f900c9fc0 msgr2=0x7f4f900b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f900c9fc0 0x7f4f900b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.611+0000 7f4f95911700 1 -- 172.21.15.5:0/3366031086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009de0 con 0x7f4f9015a4e0 2023-10-16T13:38:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.612+0000 7f4f95911700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9015a4e0 0x7f4f90156280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b6e0 tx=0x7f4f8800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.612+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800e070 con 0x7f4f9015a4e0 2023-10-16T13:38:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.612+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f880115a0 con 0x7f4f9015a4e0 2023-10-16T13:38:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.612+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88011950 con 0x7f4f9015a4e0 2023-10-16T13:38:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.612+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900b4180 con 0x7f4f9015a4e0 2023-10-16T13:38:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.612+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900b4740 con 0x7f4f9015a4e0 2023-10-16T13:38:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.614+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f88011ab0 con 0x7f4f9015a4e0 2023-10-16T13:38:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.615+0000 7f4f85ffb700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f7406af50 0x7f4f7406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.615+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f88089250 con 0x7f4f9015a4e0 2023-10-16T13:38:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.615+0000 7f4f95110700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f7406af50 0x7f4f7406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.616+0000 7f4f95110700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f7406af50 0x7f4f7406d410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f80000c00 tx=0x7f4f80008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.619+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 --> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d08002d40 con 0x7f6d04073170 2023-10-16T13:38:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.620+0000 7f6d16ffd700 1 -- 172.21.15.5:0/2338598029 <== osd.3 v2:172.21.15.5:6824/81511064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6d08002d40 con 0x7f6d04073170 2023-10-16T13:38:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.621+0000 7fbe624cd700 1 Processor -- start 2023-10-16T13:38:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.621+0000 7fbe624cd700 1 -- start start 2023-10-16T13:38:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe624cd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5c06daa0 0x7fbe5c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe624cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe624cd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0cef80 con 0x7fbe5c15a280 2023-10-16T13:38:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe624cd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c072200 con 0x7fbe5c06daa0 2023-10-16T13:38:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe624cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0cf1d0 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe53fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5c06daa0 0x7fbe5c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe5bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe5c15a280 0x7fbe5c06d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52054/0 (socket says 172.21.15.5:52054) 2023-10-16T13:38:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe5bfff700 1 -- 172.21.15.5:0/1065561939 learned_addr learned my addr 172.21.15.5:0/1065561939 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 --> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe0c04ebb0 con 0x7efdf8073120 2023-10-16T13:38:30.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7f6d04073170 msgr2=0x7f6d04075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7f6d286c8700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7f6d04073170 0x7f6d04075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fba4c06af00 msgr2=0x7fba4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fba46ffd700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fba4c06af00 0x7fba4c06d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba600b2680 tx=0x7fba54009040 comp rx=0 tx=0).stop 2023-10-16T13:38:30.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 msgr2=0x7fba600c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fba46ffd700 1 --2- 172.21.15.5:0/3220358032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba6006af50 0x7fba600c9ba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba50016000 tx=0x7fba50004750 comp rx=0 tx=0).stop 2023-10-16T13:38:30.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 --> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa780c62e0 con 0x7ffa5c0730a0 2023-10-16T13:38:30.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fba65552700 1 -- 172.21.15.5:0/3220358032 reap_dead start 2023-10-16T13:38:30.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d0406af50 msgr2=0x7f6d0406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7f6d286c8700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d0406af50 0x7f6d0406d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000f60 tx=0x7f6d1c007a40 comp rx=0 tx=0).stop 2023-10-16T13:38:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d200c9fc0 msgr2=0x7f6d2006cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7f6d286c8700 1 --2- 172.21.15.5:0/2338598029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d200c9fc0 0x7f6d2006cc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c430 tx=0x7f6d1000c7f0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe5b7fe700 1 -- 172.21.15.5:0/1065561939 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367657149 0 0) 0x7fbe5c0cef80 con 0x7fbe5c15a280 2023-10-16T13:38:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.622+0000 7fbe5b7fe700 1 -- 172.21.15.5:0/1065561939 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe480034d0 con 0x7fbe5c15a280 2023-10-16T13:38:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7f6d26c65700 1 -- 172.21.15.5:0/2338598029 reap_dead start 2023-10-16T13:38:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 shutdown_connections 2023-10-16T13:38:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 >> 172.21.15.5:0/3220358032 conn(0x7fba6006dac0 msgr2=0x7fba6015fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 shutdown_connections 2023-10-16T13:38:30.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 >> 172.21.15.5:0/2338598029 conn(0x7f6d200cf3f0 msgr2=0x7f6d200b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 shutdown_connections 2023-10-16T13:38:30.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 shutdown_connections 2023-10-16T13:38:30.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fba46ffd700 1 -- 172.21.15.5:0/3220358032 wait complete. 2023-10-16T13:38:30.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7f6d286c8700 1 -- 172.21.15.5:0/2338598029 wait complete. 2023-10-16T13:38:30.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7ffa6dffb700 1 -- 172.21.15.5:0/2535530656 <== osd.0 v2:172.21.15.5:6808/2363290793 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa780c62e0 con 0x7ffa5c0730a0 2023-10-16T13:38:30.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe53fff700 1 -- 172.21.15.5:0/1065561939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 msgr2=0x7fbe5c0cea40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:38:30.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe5b7fe700 1 -- 172.21.15.5:0/1065561939 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107704384 0 0) 0x7fbe480034d0 con 0x7fbe5c15a280 2023-10-16T13:38:30.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe53fff700 1 --2- 172.21.15.5:0/1065561939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c0cea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe53fff700 1 -- 172.21.15.5:0/1065561939 >> v1:172.21.15.5:6789/0 conn(0x7fbe5c15a280 legacy=0x7fbe5c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe53fff700 1 -- 172.21.15.5:0/1065561939 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0cafb0 con 0x7fbe5c06daa0 2023-10-16T13:38:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe53fff700 1 --2- 172.21.15.5:0/1065561939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c06daa0 0x7fbe5c0cbd70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009840 tx=0x7fbe44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed07dfd98bdc6af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe5b7fe700 1 -- 172.21.15.5:0/1065561939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c001670 con 0x7fbe5c06daa0 2023-10-16T13:38:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe5b7fe700 1 -- 172.21.15.5:0/1065561939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44004030 con 0x7fbe5c06daa0 2023-10-16T13:38:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.623+0000 7fbe5b7fe700 1 -- 172.21.15.5:0/1065561939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440043c0 con 0x7fbe5c06daa0 2023-10-16T13:38:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.624+0000 7fbe624cd700 1 -- 172.21.15.5:0/1065561939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c06daa0 msgr2=0x7fbe5c0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.624+0000 7fbe624cd700 1 --2- 172.21.15.5:0/1065561939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c06daa0 0x7fbe5c0cbd70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009840 tx=0x7fbe44009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7fbe624cd700 1 -- 172.21.15.5:0/1065561939 shutdown_connections 2023-10-16T13:38:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7fbe624cd700 1 --2- 172.21.15.5:0/1065561939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7fbe624cd700 1 --2- 172.21.15.5:0/1065561939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c06daa0 0x7fbe5c0cbd70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7fbe624cd700 1 -- 172.21.15.5:0/1065561939 >> 172.21.15.5:0/1065561939 conn(0x7fbe5c0cfc40 msgr2=0x7fbe5c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7efe08ff9700 1 -- 172.21.15.5:0/4117847417 <== osd.2 v2:172.21.15.5:6816/1041667004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe0c04ebb0 con 0x7efdf8073120 2023-10-16T13:38:30.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7fbe624cd700 1 -- 172.21.15.5:0/1065561939 shutdown_connections 2023-10-16T13:38:30.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.625+0000 7fbe624cd700 1 -- 172.21.15.5:0/1065561939 wait complete. 2023-10-16T13:38:30.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7efdf8073120 msgr2=0x7efdf8075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7efdf8073120 0x7efdf8075540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.626+0000 7fbe624cd700 1 Processor -- start 2023-10-16T13:38:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7fbe624cd700 1 -- start start 2023-10-16T13:38:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdf806af00 msgr2=0x7efdf806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdf806af00 0x7efdf806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe0c070580 tx=0x7efdfc013000 comp rx=0 tx=0).stop 2023-10-16T13:38:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe0c16f060 msgr2=0x7efe0c207fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 --2- 172.21.15.5:0/4117847417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe0c16f060 0x7efe0c207fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe0000b450 tx=0x7efe0000b810 comp rx=0 tx=0).stop 2023-10-16T13:38:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7f4f97374700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7f4f700015e0 0x7f4f70003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 --> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f70006bd0 con 0x7f4f700015e0 2023-10-16T13:38:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe10f3a700 1 -- 172.21.15.5:0/4117847417 reap_dead start 2023-10-16T13:38:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 shutdown_connections 2023-10-16T13:38:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 >> 172.21.15.5:0/4117847417 conn(0x7efe0c0cf3f0 msgr2=0x7efe0c06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.627+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 shutdown_connections 2023-10-16T13:38:30.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe624cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe5c06daa0 0x7fbe5c1f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe624cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe624cd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15a280 0x7fbe5c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe624cd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15c9c0 con 0x7fbe5c15a280 2023-10-16T13:38:30.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe624cd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15cca0 con 0x7fbe5c06daa0 2023-10-16T13:38:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe624cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15cf80 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe60a6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15a280 0x7fbe5c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c15bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:39964/0 (socket says 172.21.15.5:39964) 2023-10-16T13:38:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 -- 172.21.15.5:0/3795354008 learned_addr learned my addr 172.21.15.5:0/3795354008 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 -- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe5c06daa0 msgr2=0x7fbe5c1f2ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe5c06daa0 0x7fbe5c1f2ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 -- 172.21.15.5:0/3795354008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15a280 msgr2=0x7fbe5c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15a280 0x7fbe5c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.628+0000 7fbe53fff700 1 -- 172.21.15.5:0/3795354008 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440094a0 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.629+0000 7fbe53fff700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c15bf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400a010 tx=0x7fbe44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.629+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44003ea0 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.629+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4401f070 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.629+0000 7fbe624cd700 1 -- 172.21.15.5:0/3795354008 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c0c4210 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.629+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44011870 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.629+0000 7fbe624cd700 1 -- 172.21.15.5:0/3795354008 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c1f3410 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.630+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe440119d0 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.631+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 --> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97e80ad360 con 0x7f97c8073170 2023-10-16T13:38:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.631+0000 7fbe597fa700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3c06af00 0x7fbe3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.631+0000 7f97df7fe700 1 -- 172.21.15.5:0/22878884 <== osd.5 v2:172.21.15.112:6808/3215612020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f97e0009e90 con 0x7f97c8073170 2023-10-16T13:38:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.631+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe44021070 con 0x7fbe5c0ce5f0 2023-10-16T13:38:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.631+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f97c8073170 msgr2=0x7f97c8075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f97c8073170 0x7f97c8075590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7ffa5c0730a0 msgr2=0x7ffa5c0754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7ffa5c0730a0 0x7ffa5c0754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f97c806af50 msgr2=0x7f97c806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f97c806af50 0x7f97c806d410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f97d8014040 tx=0x7f97d8008030 comp rx=0 tx=0).stop 2023-10-16T13:38:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e80aca20 msgr2=0x7f97e809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 --2- 172.21.15.5:0/22878884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e80aca20 0x7f97e809aa40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f97d000c4e0 tx=0x7f97d000c8a0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa5c06af00 msgr2=0x7ffa5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa5c06af00 0x7ffa5c06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa70014040 tx=0x7ffa70010000 comp rx=0 tx=0).stop 2023-10-16T13:38:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa780cc6e0 msgr2=0x7ffa780c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 --2- 172.21.15.5:0/2535530656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa780cc6e0 0x7ffa780c3fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c410 tx=0x7ffa7400c7d0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7df52700 1 -- 172.21.15.5:0/2535530656 reap_dead start 2023-10-16T13:38:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97e6d9d700 1 -- 172.21.15.5:0/22878884 reap_dead start 2023-10-16T13:38:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 shutdown_connections 2023-10-16T13:38:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 >> 172.21.15.5:0/2535530656 conn(0x7ffa7806dac0 msgr2=0x7ffa780d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 shutdown_connections 2023-10-16T13:38:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 >> 172.21.15.5:0/22878884 conn(0x7f97e8070e90 msgr2=0x7f97e80cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 shutdown_connections 2023-10-16T13:38:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7f97ecb01700 1 -- 172.21.15.5:0/22878884 wait complete. 2023-10-16T13:38:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7efe1299d700 1 -- 172.21.15.5:0/4117847417 wait complete. 2023-10-16T13:38:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.632+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 shutdown_connections 2023-10-16T13:38:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.633+0000 7fbe527fc700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7fbe5c159080 0x7fbe5c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.633+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 --> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe5c0cb290 con 0x7fbe5c159080 2023-10-16T13:38:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.633+0000 7ffa7f9b5700 1 -- 172.21.15.5:0/2535530656 wait complete. 2023-10-16T13:38:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.633+0000 7fbe60a6a700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7fbe5c159080 0x7fbe5c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.634+0000 7fbe60a6a700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7fbe5c159080 0x7fbe5c14b6b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.702 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-10-16T13:38:30.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T13:38:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.634+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== osd.7 v2:172.21.15.112:6824/678489070 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbe54009bf0 con 0x7fbe5c159080 2023-10-16T13:38:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.635+0000 7f4f9490f700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7f4f700015e0 0x7f4f70003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.704 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-10-16T13:38:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.635+0000 7f4f9490f700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7f4f700015e0 0x7f4f70003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.636+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== osd.6 v2:172.21.15.112:6800/1905123765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4f70006bd0 con 0x7f4f700015e0 2023-10-16T13:38:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.635+0000 7fbe5bfff700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3c06af00 0x7fbe3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.635+0000 7fbe5bfff700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3c06af00 0x7fbe3c06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c001620 tx=0x7fbe4c001080 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T13:38:30.707 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-10-16T13:38:30.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T13:38:30.708 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:30.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T13:38:30.709 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:30.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T13:38:30.711 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:30.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T13:38:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.660+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 --> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe5c0cb850 con 0x7fbe5c159080 2023-10-16T13:38:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe597fa700 1 -- 172.21.15.5:0/3795354008 <== osd.7 v2:172.21.15.112:6824/678489070 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe5400a460 con 0x7fbe5c159080 2023-10-16T13:38:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7fbe5c159080 msgr2=0x7fbe5c14b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7fbe5c159080 0x7fbe5c14b6b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3c06af00 msgr2=0x7fbe3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3c06af00 0x7fbe3c06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c001620 tx=0x7fbe4c001080 comp rx=0 tx=0).stop 2023-10-16T13:38:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 msgr2=0x7fbe5c15bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 --2- 172.21.15.5:0/3795354008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe5c0ce5f0 0x7fbe5c15bf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400a010 tx=0x7fbe44004750 comp rx=0 tx=0).stop 2023-10-16T13:38:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe60a6a700 1 -- 172.21.15.5:0/3795354008 reap_dead start 2023-10-16T13:38:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 shutdown_connections 2023-10-16T13:38:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 >> 172.21.15.5:0/3795354008 conn(0x7fbe5c0cfc40 msgr2=0x7fbe5c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 shutdown_connections 2023-10-16T13:38:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.661+0000 7fbe527fc700 1 -- 172.21.15.5:0/3795354008 wait complete. 2023-10-16T13:38:30.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.662+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 --> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f70005cb0 con 0x7f4f700015e0 2023-10-16T13:38:30.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f85ffb700 1 -- 172.21.15.5:0/3366031086 <== osd.6 v2:172.21.15.112:6800/1905123765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f70005cb0 con 0x7f4f700015e0 2023-10-16T13:38:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7f4f700015e0 msgr2=0x7f4f70003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7f4f700015e0 0x7f4f70003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f7406af50 msgr2=0x7f4f7406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f7406af50 0x7f4f7406d410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f80000c00 tx=0x7f4f80008030 comp rx=0 tx=0).stop 2023-10-16T13:38:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9015a4e0 msgr2=0x7f4f90156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 --2- 172.21.15.5:0/3366031086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9015a4e0 0x7f4f90156280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b6e0 tx=0x7f4f8800b9f0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f95911700 1 -- 172.21.15.5:0/3366031086 reap_dead start 2023-10-16T13:38:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 shutdown_connections 2023-10-16T13:38:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 >> 172.21.15.5:0/3366031086 conn(0x7f4f900cf3f0 msgr2=0x7f4f900b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 shutdown_connections 2023-10-16T13:38:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.663+0000 7f4f97374700 1 -- 172.21.15.5:0/3366031086 wait complete. 2023-10-16T13:38:30.720 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-10-16T13:38:30.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T13:38:30.721 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:30.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T13:38:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.944+0000 7f17da128700 1 Processor -- start 2023-10-16T13:38:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.944+0000 7f17da128700 1 -- start start 2023-10-16T13:38:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.946+0000 7f17da128700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17d40c2840 0x7f17d4166620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.946+0000 7f17da128700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17d406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.946+0000 7f17da128700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40ca9f0 con 0x7f17d40c9c50 2023-10-16T13:38:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.946+0000 7f17da128700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d406d380 con 0x7f17d40c2840 2023-10-16T13:38:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.946+0000 7f17da128700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4162490 con 0x7f17d406c9b0 2023-10-16T13:38:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.947+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17d406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.947+0000 7f17d2ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17d40c9c50 0x7f17d40cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52074/0 (socket says 172.21.15.5:52074) 2023-10-16T13:38:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.947+0000 7f17d2ffd700 1 -- 172.21.15.5:0/3295558573 learned_addr learned my addr 172.21.15.5:0/3295558573 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.947+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858451129 0 0) 0x7f17d40ca9f0 con 0x7f17d40c9c50 2023-10-16T13:38:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.947+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc0035b0 con 0x7f17d40c9c50 2023-10-16T13:38:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.947+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2705310913 0 0) 0x7f17bc0035b0 con 0x7f17d40c9c50 2023-10-16T13:38:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 msgr2=0x7f17d406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17d406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 >> v2:172.21.15.112:3300/0 conn(0x7f17d40c2840 msgr2=0x7f17d4166620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d37fe700 1 --2- 172.21.15.5:0/3295558573 >> v2:172.21.15.112:3300/0 conn(0x7f17d40c2840 0x7f17d4166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 --2- 172.21.15.5:0/3295558573 >> v2:172.21.15.112:3300/0 conn(0x7f17d40c2840 0x7f17d4166620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40ca430 con 0x7f17d40c9c50 2023-10-16T13:38:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f17c8001670 con 0x7f17d40c9c50 2023-10-16T13:38:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 >> v1:172.21.15.5:6789/0 conn(0x7f17d40c9c50 legacy=0x7f17d40cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc003a30 0x7f17bc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17bc004d90 0x7f17bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d406d380 con 0x7f17bc003a30 2023-10-16T13:38:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4162490 con 0x7f17bc004d90 2023-10-16T13:38:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc00bbd0 con 0x7f17d406c9b0 2023-10-16T13:38:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d3fff700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17bc004d90 0x7f17bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.948+0000 7f17d2ffd700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d2ffd700 1 -- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17bc004d90 msgr2=0x7f17bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d2ffd700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17bc004d90 0x7f17bc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d2ffd700 1 -- 172.21.15.5:0/3295558573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc003a30 msgr2=0x7f17bc003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d2ffd700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc003a30 0x7f17bc003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d2ffd700 1 -- 172.21.15.5:0/3295558573 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40ca430 con 0x7f17d406c9b0 2023-10-16T13:38:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d2ffd700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17bc004850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f17c800c340 tx=0x7f17bc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3340047693076c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c800ce80 con 0x7f17d406c9b0 2023-10-16T13:38:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c8005960 con 0x7f17d406c9b0 2023-10-16T13:38:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.949+0000 7f17d27fc700 1 -- 172.21.15.5:0/3295558573 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8005cf0 con 0x7f17d406c9b0 2023-10-16T13:38:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.950+0000 7f17da128700 1 -- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 msgr2=0x7f17bc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.950+0000 7f17da128700 1 --2- 172.21.15.5:0/3295558573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d406c9b0 0x7f17bc004850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f17c800c340 tx=0x7f17bc005880 comp rx=0 tx=0).stop 2023-10-16T13:38:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.953+0000 7f4220b1b700 1 Processor -- start 2023-10-16T13:38:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.954+0000 7f4220b1b700 1 -- start start 2023-10-16T13:38:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f4220b1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c157630 0x7f421c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f4220b1b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c15af20 con 0x7f421c157250 2023-10-16T13:38:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f4220b1b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c15a6b0 con 0x7f421c0c9fc0 2023-10-16T13:38:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f4220b1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c15a960 con 0x7f421c157630 2023-10-16T13:38:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f421a59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f421c157250 0x7f421c15df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52082/0 (socket says 172.21.15.5:52082) 2023-10-16T13:38:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f421a59c700 1 -- 172.21.15.5:0/2422302905 learned_addr learned my addr 172.21.15.5:0/2422302905 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128317629 0 0) 0x7f421c15af20 con 0x7f421c157250 2023-10-16T13:38:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.955+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4208003e40 con 0x7f421c157250 2023-10-16T13:38:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628788163 0 0) 0x7f4208003e40 con 0x7f421c157250 2023-10-16T13:38:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c157630 msgr2=0x7f421c06c9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:38:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c157630 0x7f421c06c9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 >> v1:172.21.15.112:6789/0 conn(0x7f421c0c9fc0 legacy=0x7f421c159fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T13:38:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c15ac40 con 0x7f421c157250 2023-10-16T13:38:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f420c0019f0 con 0x7f421c157250 2023-10-16T13:38:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f17d3fff700 1 -- 172.21.15.5:0/3295558573 reap_dead start 2023-10-16T13:38:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f17da128700 1 -- 172.21.15.5:0/3295558573 shutdown_connections 2023-10-16T13:38:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f17da128700 1 -- 172.21.15.5:0/3295558573 >> 172.21.15.5:0/3295558573 conn(0x7f17d40cf3f0 msgr2=0x7f17d40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 >> v1:172.21.15.5:6789/0 conn(0x7f421c157250 legacy=0x7f421c15df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42080034d0 0x7f42080042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4208004800 0x7f42080050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4208005620 0x7f4208005aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c15a960 con 0x7f42080034d0 2023-10-16T13:38:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4208008280 con 0x7f4208004800 2023-10-16T13:38:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4208008440 con 0x7f4208005620 2023-10-16T13:38:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421a59c700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42080034d0 0x7f42080042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f4219d9b700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4208004800 0x7f42080050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.956+0000 7f421ad9d700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4208005620 0x7f4208005aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421a59c700 1 -- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4208005620 msgr2=0x7f4208005aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421a59c700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4208005620 0x7f4208005aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421a59c700 1 -- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4208004800 msgr2=0x7f42080050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421a59c700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4208004800 0x7f42080050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421a59c700 1 -- 172.21.15.5:0/2422302905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c15ac40 con 0x7f42080034d0 2023-10-16T13:38:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421a59c700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42080034d0 0x7f42080042c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f420c00a8b0 tx=0x7f4208006110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adf6a0117d4ccbf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c012600 con 0x7f42080034d0 2023-10-16T13:38:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f17da128700 1 -- 172.21.15.5:0/3295558573 shutdown_connections 2023-10-16T13:38:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c012760 con 0x7f42080034d0 2023-10-16T13:38:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f421959a700 1 -- 172.21.15.5:0/2422302905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c012af0 con 0x7f42080034d0 2023-10-16T13:38:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.957+0000 7f17da128700 1 -- 172.21.15.5:0/3295558573 wait complete. 2023-10-16T13:38:30.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.958+0000 7f4220b1b700 1 -- 172.21.15.5:0/2422302905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42080034d0 msgr2=0x7f42080042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.958+0000 7f4220b1b700 1 --2- 172.21.15.5:0/2422302905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42080034d0 0x7f42080042c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f420c00a8b0 tx=0x7f4208006110 comp rx=0 tx=0).stop 2023-10-16T13:38:30.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.959+0000 7f421ad9d700 1 -- 172.21.15.5:0/2422302905 reap_dead start 2023-10-16T13:38:30.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f4220b1b700 1 -- 172.21.15.5:0/2422302905 shutdown_connections 2023-10-16T13:38:30.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f4220b1b700 1 -- 172.21.15.5:0/2422302905 >> 172.21.15.5:0/2422302905 conn(0x7f421c0cf3f0 msgr2=0x7f421c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.964+0000 7f4220b1b700 1 -- 172.21.15.5:0/2422302905 shutdown_connections 2023-10-16T13:38:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.964+0000 7f4220b1b700 1 -- 172.21.15.5:0/2422302905 wait complete. 2023-10-16T13:38:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f4220b1b700 1 Processor -- start 2023-10-16T13:38:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.959+0000 7f17da128700 1 Processor -- start 2023-10-16T13:38:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.960+0000 7f17da128700 1 -- start start 2023-10-16T13:38:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17da128700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 0x7f17d415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17da128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d4208350 0x7f17d40b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17da128700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 0x7f17d4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17da128700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d415ca60 con 0x7f17d4208350 2023-10-16T13:38:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17da128700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40b12f0 con 0x7f17d40b0e40 2023-10-16T13:38:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17da128700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40b4f80 con 0x7f17d4207f70 2023-10-16T13:38:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 0x7f17d415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 0x7f17d4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 0x7f17d4158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37988/0 (socket says 172.21.15.5:37988) 2023-10-16T13:38:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 0x7f17d415b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:39994/0 (socket says 172.21.15.5:39994) 2023-10-16T13:38:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d3fff700 1 -- 172.21.15.5:0/3931263026 learned_addr learned my addr 172.21.15.5:0/3931263026 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d3fff700 1 -- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 msgr2=0x7f17d415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d3fff700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 0x7f17d415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.961+0000 7f17d3fff700 1 -- 172.21.15.5:0/3931263026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d4208350 msgr2=0x7f17d40b0900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:38:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17d3fff700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d4208350 0x7f17d40b0900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17d3fff700 1 -- 172.21.15.5:0/3931263026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d415bb50 con 0x7f17d40b0e40 2023-10-16T13:38:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17d37fe700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 0x7f17d415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17d3fff700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 0x7f17d4158e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f17d4070570 tx=0x7f17c4011b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4004300 con 0x7f17d40b0e40 2023-10-16T13:38:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4004480 con 0x7f17d40b0e40 2023-10-16T13:38:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d415ce80 con 0x7f17d40b0e40 2023-10-16T13:38:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40038e0 con 0x7f17d40b0e40 2023-10-16T13:38:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.962+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d415c0c0 con 0x7f17d40b0e40 2023-10-16T13:38:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.963+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d415cba0 con 0x7f17d40b0e40 2023-10-16T13:38:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.964+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17c4003a40 con 0x7f17d40b0e40 2023-10-16T13:38:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.965+0000 7f17bbfff700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f17c00aef10 0x7f17c00b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.965+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17c4089790 con 0x7f17d40b0e40 2023-10-16T13:38:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f17d37fe700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f17c00aef10 0x7f17c00b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.964+0000 7f01177c5700 1 Processor -- start 2023-10-16T13:38:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.965+0000 7f01177c5700 1 -- start start 2023-10-16T13:38:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f01177c5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01100cfa80 0x7f01100af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f01177c5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100afa60 0x7f01100b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f01177c5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01100b0650 0x7f01100cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f01177c5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100b0ac0 con 0x7f01100b0650 2023-10-16T13:38:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f01177c5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100ca420 con 0x7f01100cfa80 2023-10-16T13:38:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f01177c5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01100d02b0 con 0x7f01100afa60 2023-10-16T13:38:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f17d37fe700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f17c00aef10 0x7f17c00b13d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00d770 tx=0x7f17cc007710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f4220b1b700 1 -- start start 2023-10-16T13:38:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f4220b1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 0x7f421c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f4220b1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c1569f0 0x7f421c072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f0115561700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01100cfa80 0x7f01100af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f0115561700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01100cfa80 0x7f01100af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37992/0 (socket says 172.21.15.5:37992) 2023-10-16T13:38:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.966+0000 7f0115561700 1 -- 172.21.15.5:0/2652662008 learned_addr learned my addr 172.21.15.5:0/2652662008 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f4220b1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f421c0726c0 0x7f421c070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f4220b1b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c156e70 con 0x7f421c0726c0 2023-10-16T13:38:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f4220b1b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c1f2250 con 0x7f421c1569f0 2023-10-16T13:38:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f4220b1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0c4400 con 0x7f421c14ec10 2023-10-16T13:38:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0114d60700 1 --2- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100afa60 0x7f01100b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115d62700 1 --2- 172.21.15.5:0/2652662008 >> v2:172.21.15.5:3300/0 conn(0x7f01100b0650 0x7f01100cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115561700 1 -- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100afa60 msgr2=0x7f01100b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115561700 1 --2- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100afa60 0x7f01100b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115561700 1 -- 172.21.15.5:0/2652662008 >> v2:172.21.15.5:3300/0 conn(0x7f01100b0650 msgr2=0x7f01100cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115561700 1 --2- 172.21.15.5:0/2652662008 >> v2:172.21.15.5:3300/0 conn(0x7f01100b0650 0x7f01100cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115561700 1 -- 172.21.15.5:0/2652662008 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100c9af0 con 0x7f01100cfa80 2023-10-16T13:38:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f421a59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 0x7f421c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115d62700 1 --2- 172.21.15.5:0/2652662008 >> v2:172.21.15.5:3300/0 conn(0x7f01100b0650 0x7f01100cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f0115561700 1 --2- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100cfa80 0x7f01100af520 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01100b1eb0 tx=0x7f010800c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5bce50391f4f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f421a59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 0x7f421c1564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40006/0 (socket says 172.21.15.5:40006) 2023-10-16T13:38:30.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f421a59c700 1 -- 172.21.15.5:0/3023690164 learned_addr learned my addr 172.21.15.5:0/3023690164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f4219d9b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c1569f0 0x7f421c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f421ad9d700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f421c0726c0 0x7f421c070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7f99adaea700 1 Processor -- start 2023-10-16T13:38:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f421a59c700 1 -- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c1569f0 msgr2=0x7f421c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f421a59c700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c1569f0 0x7f421c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f421a59c700 1 -- 172.21.15.5:0/3023690164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f421c0726c0 msgr2=0x7f421c070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f421a59c700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f421c0726c0 0x7f421c070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f421a59c700 1 -- 172.21.15.5:0/3023690164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c1f24c0 con 0x7f421c14ec10 2023-10-16T13:38:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.967+0000 7ff0034c6700 1 Processor -- start 2023-10-16T13:38:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7ff0034c6700 1 -- start start 2023-10-16T13:38:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f421a59c700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 0x7f421c1564b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f420c012000 tx=0x7f420c001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f99adaea700 1 -- start start 2023-10-16T13:38:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c001f70 con 0x7f421c14ec10 2023-10-16T13:38:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c01e630 con 0x7f421c14ec10 2023-10-16T13:38:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c01e9e0 con 0x7f421c14ec10 2023-10-16T13:38:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c1f27a0 con 0x7f421c14ec10 2023-10-16T13:38:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.968+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c1f2d60 con 0x7f421c14ec10 2023-10-16T13:38:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff0034c6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feffc0c2840 0x7feffc166620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff0034c6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feffc0c9c50 0x7feffc0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff0034c6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc0ca9f0 con 0x7feffc0ce3a0 2023-10-16T13:38:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff0034c6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc162490 con 0x7feffc0c2840 2023-10-16T13:38:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff0034c6700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0ca430 con 0x7feffc0c9c50 2023-10-16T13:38:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff001262700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feffc0c2840 0x7feffc166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff001262700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feffc0c2840 0x7feffc166620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42108/0 (socket says 172.21.15.5:42108) 2023-10-16T13:38:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff001262700 1 -- 172.21.15.5:0/4209194623 learned_addr learned my addr 172.21.15.5:0/4209194623 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:30.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7ff000a61700 1 --2- 172.21.15.5:0/4209194623 >> v2:172.21.15.112:3300/0 conn(0x7feffc0c9c50 0x7feffc0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7ff001262700 1 -- 172.21.15.5:0/4209194623 >> v2:172.21.15.112:3300/0 conn(0x7feffc0c9c50 msgr2=0x7feffc0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:30.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7ff001262700 1 --2- 172.21.15.5:0/4209194623 >> v2:172.21.15.112:3300/0 conn(0x7feffc0c9c50 0x7feffc0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7ff001262700 1 -- 172.21.15.5:0/4209194623 >> v1:172.21.15.112:6789/0 conn(0x7feffc0ce3a0 legacy=0x7feffc06c9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:30.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7ff001262700 1 -- 172.21.15.5:0/4209194623 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0ca710 con 0x7feffc0c2840 2023-10-16T13:38:30.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f0107fff700 1 -- 172.21.15.5:0/2652662008 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108009e60 con 0x7f01100cfa80 2023-10-16T13:38:30.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7ff001262700 1 --2- 172.21.15.5:0/4209194623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0c2840 0x7feffc166620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feffc0d04f0 tx=0x7feff8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47c8e19a8bb8a51 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99adaea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99a80cff10 0x7f99a815df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99adaea700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99a80c9fc0 0x7f99a8157250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99adaea700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a815af20 con 0x7f99a8159fa0 2023-10-16T13:38:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99adaea700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a815e470 con 0x7f99a80c9fc0 2023-10-16T13:38:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99adaea700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a815a960 con 0x7f99a80cff10 2023-10-16T13:38:30.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99a7fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f99a8159fa0 0x7f99a806c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:43092/0 (socket says 172.21.15.5:43092) 2023-10-16T13:38:30.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99a7fff700 1 -- 172.21.15.5:0/782731104 learned_addr learned my addr 172.21.15.5:0/782731104 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:30.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.969+0000 7f99a6ffd700 1 --2- 172.21.15.5:0/782731104 >> v2:172.21.15.5:3300/0 conn(0x7f99a80c9fc0 0x7f99a8157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:30.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f99a6ffd700 1 -- 172.21.15.5:0/782731104 >> v2:172.21.15.112:3300/0 conn(0x7f99a80cff10 msgr2=0x7f99a815df30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f99a6ffd700 1 --2- 172.21.15.5:0/782731104 >> v2:172.21.15.112:3300/0 conn(0x7f99a80cff10 0x7f99a815df30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f99a6ffd700 1 -- 172.21.15.5:0/782731104 >> v1:172.21.15.112:6789/0 conn(0x7f99a8159fa0 legacy=0x7f99a806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f99a6ffd700 1 -- 172.21.15.5:0/782731104 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a815ac40 con 0x7f99a80c9fc0 2023-10-16T13:38:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f99a6ffd700 1 --2- 172.21.15.5:0/782731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80c9fc0 0x7f99a8157250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99a806f3e0 tx=0x7f999c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa7d54fb6ad0d20 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17d415cba0 con 0x7f17d40b0e40 2023-10-16T13:38:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f0107fff700 1 -- 172.21.15.5:0/2652662008 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010800cad0 con 0x7f01100cfa80 2023-10-16T13:38:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.970+0000 7f0107fff700 1 -- 172.21.15.5:0/2652662008 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010800ce60 con 0x7f01100cfa80 2023-10-16T13:38:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f01177c5700 1 -- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100cfa80 msgr2=0x7f01100af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f01177c5700 1 --2- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100cfa80 0x7f01100af520 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01100b1eb0 tx=0x7f010800c440 comp rx=0 tx=0).stop 2023-10-16T13:38:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f99a67fc700 1 -- 172.21.15.5:0/782731104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c022640 con 0x7f99a80c9fc0 2023-10-16T13:38:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f99a67fc700 1 -- 172.21.15.5:0/782731104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c0227a0 con 0x7f99a80c9fc0 2023-10-16T13:38:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f99a67fc700 1 -- 172.21.15.5:0/782731104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c022b30 con 0x7f99a80c9fc0 2023-10-16T13:38:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f01177c5700 1 -- 172.21.15.5:0/2652662008 shutdown_connections 2023-10-16T13:38:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7f01177c5700 1 --2- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100cfa80 0x7f01100af520 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7f01177c5700 1 --2- 172.21.15.5:0/2652662008 >> v2:172.21.15.5:3300/0 conn(0x7f01100b0650 0x7f01100cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7f01177c5700 1 --2- 172.21.15.5:0/2652662008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100afa60 0x7f01100b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7f01177c5700 1 -- 172.21.15.5:0/2652662008 >> 172.21.15.5:0/2652662008 conn(0x7f0110070e90 msgr2=0x7f0110071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7f99adaea700 1 -- 172.21.15.5:0/782731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80c9fc0 msgr2=0x7f99a8157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7f99adaea700 1 --2- 172.21.15.5:0/782731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80c9fc0 0x7f99a8157250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99a806f3e0 tx=0x7f999c009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f99adaea700 1 -- 172.21.15.5:0/782731104 shutdown_connections 2023-10-16T13:38:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f99adaea700 1 --2- 172.21.15.5:0/782731104 >> v2:172.21.15.112:3300/0 conn(0x7f99a80cff10 0x7f99a815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f99adaea700 1 --2- 172.21.15.5:0/782731104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80c9fc0 0x7f99a8157250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f99adaea700 1 -- 172.21.15.5:0/782731104 >> 172.21.15.5:0/782731104 conn(0x7f99a80cf3f0 msgr2=0x7f99a80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000052f0 con 0x7f421c14ec10 2023-10-16T13:38:31.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f99adaea700 1 -- 172.21.15.5:0/782731104 shutdown_connections 2023-10-16T13:38:31.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.973+0000 7f99adaea700 1 -- 172.21.15.5:0/782731104 wait complete. 2023-10-16T13:38:31.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7feff3fff700 1 -- 172.21.15.5:0/4209194623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8004230 con 0x7feffc0c2840 2023-10-16T13:38:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7feff3fff700 1 -- 172.21.15.5:0/4209194623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff8004390 con 0x7feffc0c2840 2023-10-16T13:38:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7feff3fff700 1 -- 172.21.15.5:0/4209194623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80036a0 con 0x7feffc0c2840 2023-10-16T13:38:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7ff0034c6700 1 -- 172.21.15.5:0/4209194623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0c2840 msgr2=0x7feffc166620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.971+0000 7ff0034c6700 1 --2- 172.21.15.5:0/4209194623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0c2840 0x7feffc166620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feffc0d04f0 tx=0x7feff8009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7ff0034c6700 1 -- 172.21.15.5:0/4209194623 shutdown_connections 2023-10-16T13:38:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7ff0034c6700 1 --2- 172.21.15.5:0/4209194623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0c2840 0x7feffc166620 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feffc0d04f0 tx=0x7feff8009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7ff0034c6700 1 --2- 172.21.15.5:0/4209194623 >> v2:172.21.15.112:3300/0 conn(0x7feffc0c9c50 0x7feffc0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.972+0000 7ff0034c6700 1 -- 172.21.15.5:0/4209194623 >> 172.21.15.5:0/4209194623 conn(0x7feffc0cf3f0 msgr2=0x7feffc0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.974+0000 7ff0034c6700 1 -- 172.21.15.5:0/4209194623 shutdown_connections 2023-10-16T13:38:31.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.975+0000 7f99adaea700 1 Processor -- start 2023-10-16T13:38:31.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.975+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f420c01eb40 con 0x7f421c14ec10 2023-10-16T13:38:31.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.975+0000 7f99adaea700 1 -- start start 2023-10-16T13:38:31.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99adaea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a80c9fc0 0x7f99a80c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99adaea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cff10 0x7f99a81594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99adaea700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a8159fa0 0x7f99a8151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99adaea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8159a30 con 0x7f99a80cff10 2023-10-16T13:38:31.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99adaea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c4f10 con 0x7f99a80c9fc0 2023-10-16T13:38:31.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99adaea700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c39e0 con 0x7f99a8159fa0 2023-10-16T13:38:31.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99a77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a80c9fc0 0x7f99a80c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99a7fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a8159fa0 0x7f99a8151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99a77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a80c9fc0 0x7f99a80c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38014/0 (socket says 172.21.15.5:38014) 2023-10-16T13:38:31.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f99a77fe700 1 -- 172.21.15.5:0/1065929563 learned_addr learned my addr 172.21.15.5:0/1065929563 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7f01177c5700 1 -- 172.21.15.5:0/2652662008 shutdown_connections 2023-10-16T13:38:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f99a7fff700 1 -- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a80c9fc0 msgr2=0x7f99a80c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f99a7fff700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a80c9fc0 0x7f99a80c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f99a7fff700 1 -- 172.21.15.5:0/1065929563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cff10 msgr2=0x7f99a81594f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T13:38:31.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f99a7fff700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cff10 0x7f99a81594f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f99a7fff700 1 -- 172.21.15.5:0/1065929563 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0094a0 con 0x7f99a8159fa0 2023-10-16T13:38:31.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f99a7fff700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a8159fa0 0x7f99a8151cd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99a000caa0 tx=0x7f99a000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.975+0000 7ff0034c6700 1 -- 172.21.15.5:0/4209194623 wait complete. 2023-10-16T13:38:31.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7ff0034c6700 1 Processor -- start 2023-10-16T13:38:31.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.975+0000 7f4212ffd700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41fc06af00 0x7f41fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.975+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f420c08ba90 con 0x7f421c14ec10 2023-10-16T13:38:31.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7f4219d9b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41fc06af00 0x7f41fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7ff0034c6700 1 -- start start 2023-10-16T13:38:31.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7f4219d9b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41fc06af00 0x7f41fc06d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f421c15d070 tx=0x7f4204006f70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7f01177c5700 1 -- 172.21.15.5:0/2652662008 wait complete. 2023-10-16T13:38:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7ff0034c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 0x7feffc154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7ff0034c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0ce3a0 0x7feffc0c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7ff0034c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feffc0c4040 0x7feffc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff0034c6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c5b90 con 0x7feffc0ce3a0 2023-10-16T13:38:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff0034c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c45b0 con 0x7feffc0c9c50 2023-10-16T13:38:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff0034c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c4890 con 0x7feffc0c4040 2023-10-16T13:38:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff001262700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 0x7feffc154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff001262700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 0x7feffc154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38024/0 (socket says 172.21.15.5:38024) 2023-10-16T13:38:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff001262700 1 -- 172.21.15.5:0/2681506666 learned_addr learned my addr 172.21.15.5:0/2681506666 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0ce3a0 0x7feffc0c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 -- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feffc0c4040 msgr2=0x7feffc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feffc0c4040 0x7feffc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 -- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 msgr2=0x7feffc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 0x7feffc154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 -- 172.21.15.5:0/2681506666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009550 con 0x7feffc0ce3a0 2023-10-16T13:38:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff001262700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 0x7feffc154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7ff000a61700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0ce3a0 0x7feffc0c5650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefec00e7e0 tx=0x7fefec00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.979+0000 7f01177c5700 1 Processor -- start 2023-10-16T13:38:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00c070 con 0x7feffc0ce3a0 2023-10-16T13:38:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec013610 con 0x7feffc0ce3a0 2023-10-16T13:38:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7ff0034c6700 1 -- 172.21.15.5:0/2681506666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc0c4b70 con 0x7feffc0ce3a0 2023-10-16T13:38:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7ff0034c6700 1 -- 172.21.15.5:0/2681506666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc0c5130 con 0x7feffc0ce3a0 2023-10-16T13:38:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000aa20 con 0x7f99a8159fa0 2023-10-16T13:38:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f420c056bd0 con 0x7f421c14ec10 2023-10-16T13:38:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7f01177c5700 1 -- start start 2023-10-16T13:38:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f01177c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 0x7f01100c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f01177c5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100b0650 0x7f011009b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f01177c5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100cfa80 0x7f011009b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f01177c5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01100b2f70 con 0x7f01100afa60 2023-10-16T13:38:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f01177c5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01100b3250 con 0x7f01100b0650 2023-10-16T13:38:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f01177c5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01100ad450 con 0x7f01100cfa80 2023-10-16T13:38:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7ff0034c6700 1 -- 172.21.15.5:0/2681506666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc04ebb0 con 0x7feffc0ce3a0 2023-10-16T13:38:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f0115561700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 0x7f01100c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f0115561700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 0x7f01100c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42136/0 (socket says 172.21.15.5:42136) 2023-10-16T13:38:31.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f0115561700 1 -- 172.21.15.5:0/1494072839 learned_addr learned my addr 172.21.15.5:0/1494072839 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115d62700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100cfa80 0x7f011009b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec013980 con 0x7feffc0ce3a0 2023-10-16T13:38:31.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a000ab80 con 0x7f99a8159fa0 2023-10-16T13:38:31.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.981+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0012400 con 0x7f99a8159fa0 2023-10-16T13:38:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115561700 1 -- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100cfa80 msgr2=0x7f011009b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115561700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100cfa80 0x7f011009b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115561700 1 -- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100b0650 msgr2=0x7f011009b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115561700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100b0650 0x7f011009b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115561700 1 -- 172.21.15.5:0/1494072839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010800d040 con 0x7f01100afa60 2023-10-16T13:38:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefec013ae0 con 0x7feffc0ce3a0 2023-10-16T13:38:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7feff1ffb700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefe006af00 0x7fefe006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7f0115561700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 0x7f01100c5340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0110070e20 tx=0x7f0108004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.983+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108004250 con 0x7f01100afa60 2023-10-16T13:38:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.983+0000 7ff001262700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefe006af00 0x7fefe006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.983+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01080043b0 con 0x7f01100afa60 2023-10-16T13:38:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.983+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108004760 con 0x7f01100afa60 2023-10-16T13:38:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.985+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01100ad730 con 0x7f01100afa60 2023-10-16T13:38:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.985+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01100c5880 con 0x7f01100afa60 2023-10-16T13:38:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a80c54b0 con 0x7f99a8159fa0 2023-10-16T13:38:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a80c3420 con 0x7f99a8159fa0 2023-10-16T13:38:31.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefec089310 con 0x7feffc0ce3a0 2023-10-16T13:38:31.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7ff001262700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefe006af00 0x7fefe006d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feff8009c10 tx=0x7feff8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7fa5ad6cd700 1 Processor -- start 2023-10-16T13:38:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.976+0000 7fa5ad6cd700 1 -- start start 2023-10-16T13:38:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5ad6cd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5a806ba70 0x7fa5a806be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5ad6cd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5a80d3230 0x7fa5a816e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5ad6cd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80a9bc0 con 0x7fa5a80b82a0 2023-10-16T13:38:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5ad6cd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a806c840 con 0x7fa5a806ba70 2023-10-16T13:38:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5ad6cd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80aa0f0 con 0x7fa5a80d3230 2023-10-16T13:38:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa5a80b82a0 0x7fa5a816ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52130/0 (socket says 172.21.15.5:52130) 2023-10-16T13:38:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5a806ba70 0x7fa5a806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a77fe700 1 -- 172.21.15.5:0/2679574588 learned_addr learned my addr 172.21.15.5:0/2679574588 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a67fc700 1 --2- 172.21.15.5:0/2679574588 >> v2:172.21.15.112:3300/0 conn(0x7fa5a80d3230 0x7fa5a816e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/2679574588 >> v2:172.21.15.112:3300/0 conn(0x7fa5a80d3230 msgr2=0x7fa5a816e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a6ffd700 1 --2- 172.21.15.5:0/2679574588 >> v2:172.21.15.112:3300/0 conn(0x7fa5a80d3230 0x7fa5a816e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/2679574588 >> v1:172.21.15.5:6789/0 conn(0x7fa5a80b82a0 legacy=0x7fa5a816ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/2679574588 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80a9e10 con 0x7fa5a806ba70 2023-10-16T13:38:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.977+0000 7fa5a5ffb700 1 -- 172.21.15.5:0/2679574588 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271272371 0 0) 0x7fa5a80a9bc0 con 0x7fa5a80b82a0 2023-10-16T13:38:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7fa5a6ffd700 1 --2- 172.21.15.5:0/2679574588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a806ba70 0x7fa5a806be50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80d4380 tx=0x7fa590009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a182542660c2924 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7fa5a5ffb700 1 -- 172.21.15.5:0/2679574588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590033640 con 0x7fa5a806ba70 2023-10-16T13:38:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7fa5a5ffb700 1 -- 172.21.15.5:0/2679574588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5900337a0 con 0x7fa5a806ba70 2023-10-16T13:38:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.978+0000 7fa5a5ffb700 1 -- 172.21.15.5:0/2679574588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590033b30 con 0x7fa5a806ba70 2023-10-16T13:38:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/2679574588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a806ba70 msgr2=0x7fa5a806be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.980+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/2679574588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a806ba70 0x7fa5a806be50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80d4380 tx=0x7fa590009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/2679574588 shutdown_connections 2023-10-16T13:38:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/2679574588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a806ba70 0x7fa5a806be50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/2679574588 >> v2:172.21.15.112:3300/0 conn(0x7fa5a80d3230 0x7fa5a816e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.982+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/2679574588 >> 172.21.15.5:0/2679574588 conn(0x7fa5a80d37d0 msgr2=0x7fa5a80d3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.983+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/2679574588 shutdown_connections 2023-10-16T13:38:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.983+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/2679574588 wait complete. 2023-10-16T13:38:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.985+0000 7fa5ad6cd700 1 Processor -- start 2023-10-16T13:38:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.985+0000 7fa5ad6cd700 1 -- start start 2023-10-16T13:38:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7fa5ad6cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 0x7fa5a80a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7fa5ad6cd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a80b82a0 0x7fa5a80b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7fa5ad6cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a80d3230 0x7fa5a80b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7fa5ad6cd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81d8ec0 con 0x7fa5a80b82a0 2023-10-16T13:38:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7fa5ad6cd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81d82b0 con 0x7fa5a80d3230 2023-10-16T13:38:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.986+0000 7fa5ad6cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81d8590 con 0x7fa5a806ba70 2023-10-16T13:38:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a80d3230 0x7fa5a80b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 0x7fa5a80a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 0x7fa5a80a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40046/0 (socket says 172.21.15.5:40046) 2023-10-16T13:38:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/1287856406 learned_addr learned my addr 172.21.15.5:0/1287856406 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a80d3230 msgr2=0x7fa5a80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a80d3230 0x7fa5a80b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/1287856406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a80b82a0 msgr2=0x7fa5a80b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a80b82a0 0x7fa5a80b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 -- 172.21.15.5:0/1287856406 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900094a0 con 0x7fa5a806ba70 2023-10-16T13:38:31.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.987+0000 7fa5a6ffd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 0x7fa5a80a0e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa590000c00 tx=0x7fa590004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.988+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590003ab0 con 0x7fa5a806ba70 2023-10-16T13:38:31.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.988+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa590003c10 con 0x7fa5a806ba70 2023-10-16T13:38:31.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.988+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5900045a0 con 0x7fa5a806ba70 2023-10-16T13:38:31.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.988+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a81d8870 con 0x7fa5a806ba70 2023-10-16T13:38:31.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.988+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a81d9350 con 0x7fa5a806ba70 2023-10-16T13:38:31.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.989+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa590013400 con 0x7fa5a806ba70 2023-10-16T13:38:31.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.990+0000 7fa59f7fe700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa58806af00 0x7fa58806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.990+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa59008b390 con 0x7fa5a806ba70 2023-10-16T13:38:31.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.990+0000 7fa5a67fc700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa58806af00 0x7fa58806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.991+0000 7fa5a67fc700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa58806af00 0x7fa58806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8236100 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.993+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c0052f0 con 0x7fa5a806ba70 2023-10-16T13:38:31.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.990+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f99a0012560 con 0x7f99a8159fa0 2023-10-16T13:38:31.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.991+0000 7f998ffff700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f999406af50 0x7f999406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.991+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99a00890b0 con 0x7f99a8159fa0 2023-10-16T13:38:31.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.991+0000 7f99a77fe700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f999406af50 0x7f999406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.991+0000 7f99a77fe700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f999406af50 0x7f999406d410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99980099d0 tx=0x7f9998008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.992+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a80c5640 con 0x7f99a8159fa0 2023-10-16T13:38:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.995+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01100ad950 con 0x7f01100afa60 2023-10-16T13:38:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.995+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0108020070 con 0x7f01100afa60 2023-10-16T13:38:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.995+0000 7f0105ffb700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f00f406af50 0x7f00f406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.995+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f010808aae0 con 0x7f01100afa60 2023-10-16T13:38:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.996+0000 7f0114d60700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f00f406af50 0x7f00f406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.996+0000 7f0114d60700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f00f406af50 0x7f00f406d410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0110202e90 tx=0x7f010c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.997+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefec054490 con 0x7feffc0ce3a0 2023-10-16T13:38:31.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:30.997+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99a0054280 con 0x7f99a8159fa0 2023-10-16T13:38:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.001+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0108055c20 con 0x7f01100afa60 2023-10-16T13:38:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.001+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5900566a0 con 0x7fa5a806ba70 2023-10-16T13:38:31.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.009+0000 7fc415f9f700 1 Processor -- start 2023-10-16T13:38:31.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.009+0000 7fc415f9f700 1 -- start start 2023-10-16T13:38:31.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc415f9f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc41006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc415f9f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 0x7fc4100ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc415f9f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc410070e30 con 0x7fc41006de70 2023-10-16T13:38:31.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc415f9f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100ca580 con 0x7fc4100c9bb0 2023-10-16T13:38:31.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc415f9f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc410159e00 con 0x7fc410159a20 2023-10-16T13:38:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc414f9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc41006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc41579e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 0x7fc4100ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc414f9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc41006ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40058/0 (socket says 172.21.15.5:40058) 2023-10-16T13:38:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc414f9d700 1 -- 172.21.15.5:0/789690834 learned_addr learned my addr 172.21.15.5:0/789690834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.010+0000 7fc41579e700 1 --2- 172.21.15.5:0/789690834 >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 0x7fc4100ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38052/0 (socket says 172.21.15.5:38052) 2023-10-16T13:38:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc414f9d700 1 -- 172.21.15.5:0/789690834 >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 msgr2=0x7fc4100ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc414f9d700 1 --2- 172.21.15.5:0/789690834 >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 0x7fc4100ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc414f9d700 1 -- 172.21.15.5:0/789690834 >> v1:172.21.15.5:6789/0 conn(0x7fc41006de70 legacy=0x7fc4100ccd90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc414f9d700 1 -- 172.21.15.5:0/789690834 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410071110 con 0x7fc410159a20 2023-10-16T13:38:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc41579e700 1 --2- 172.21.15.5:0/789690834 >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 0x7fc4100ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc414f9d700 1 --2- 172.21.15.5:0/789690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc41006ed90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc408009e50 tx=0x7fc40800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3046a2a099a3d8b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc40f7fe700 1 -- 172.21.15.5:0/789690834 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800e070 con 0x7fc410159a20 2023-10-16T13:38:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc40f7fe700 1 -- 172.21.15.5:0/789690834 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408003a20 con 0x7fc410159a20 2023-10-16T13:38:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.011+0000 7fc40f7fe700 1 -- 172.21.15.5:0/789690834 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408003dd0 con 0x7fc410159a20 2023-10-16T13:38:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.012+0000 7fc415f9f700 1 -- 172.21.15.5:0/789690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 msgr2=0x7fc41006ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.012+0000 7fc415f9f700 1 --2- 172.21.15.5:0/789690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc41006ed90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc408009e50 tx=0x7fc40800b330 comp rx=0 tx=0).stop 2023-10-16T13:38:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.014+0000 7fc415f9f700 1 -- 172.21.15.5:0/789690834 shutdown_connections 2023-10-16T13:38:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.014+0000 7fc415f9f700 1 --2- 172.21.15.5:0/789690834 >> v2:172.21.15.112:3300/0 conn(0x7fc4100c9bb0 0x7fc4100ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.014+0000 7fc415f9f700 1 --2- 172.21.15.5:0/789690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc41006ed90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.014+0000 7fc415f9f700 1 -- 172.21.15.5:0/789690834 >> 172.21.15.5:0/789690834 conn(0x7fc4100cf1c0 msgr2=0x7fc4100cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.021+0000 7fc415f9f700 1 -- 172.21.15.5:0/789690834 shutdown_connections 2023-10-16T13:38:31.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.021+0000 7fc4c2a94700 1 Processor -- start 2023-10-16T13:38:31.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.021+0000 7fc415f9f700 1 -- 172.21.15.5:0/789690834 wait complete. 2023-10-16T13:38:31.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.023+0000 7fc415f9f700 1 Processor -- start 2023-10-16T13:38:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.023+0000 7fc415f9f700 1 -- start start 2023-10-16T13:38:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc415f9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41006de70 0x7fc4100b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc415f9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4100c9bb0 0x7fc4101f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc415f9f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc4101547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc415f9f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4101f7b10 con 0x7fc4100c9bb0 2023-10-16T13:38:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc415f9f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100b3440 con 0x7fc41006de70 2023-10-16T13:38:31.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc415f9f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100b3720 con 0x7fc410159a20 2023-10-16T13:38:31.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.024+0000 7fc4c2a94700 1 -- start start 2023-10-16T13:38:31.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc4c2a94700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4bc0cc6e0 0x7fc4bc0cac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc4c2a94700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4bc06a840 0x7fc4bc06ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc4c2a94700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc06b1d0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc4c2a94700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc0cf0d0 con 0x7fc4bc0cc6e0 2023-10-16T13:38:31.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.025+0000 7fc4c2a94700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc0ce450 con 0x7fc4bc06a840 2023-10-16T13:38:31.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc4bbfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc4bc0c3ac0 0x7fc4bc1664c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:43146/0 (socket says 172.21.15.5:43146) 2023-10-16T13:38:31.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc4bbfff700 1 -- 172.21.15.5:0/3277663592 learned_addr learned my addr 172.21.15.5:0/3277663592 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:31.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.035+0000 7fc4c1031700 1 --2- 172.21.15.5:0/3277663592 >> v2:172.21.15.112:3300/0 conn(0x7fc4bc06a840 0x7fc4bc06ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.035+0000 7fc4c1031700 1 -- 172.21.15.5:0/3277663592 >> v2:172.21.15.5:3300/0 conn(0x7fc4bc0cc6e0 msgr2=0x7fc4bc0cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.035+0000 7fc4c1031700 1 --2- 172.21.15.5:0/3277663592 >> v2:172.21.15.5:3300/0 conn(0x7fc4bc0cc6e0 0x7fc4bc0cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.035+0000 7fc4c1031700 1 -- 172.21.15.5:0/3277663592 >> v1:172.21.15.112:6789/0 conn(0x7fc4bc0c3ac0 legacy=0x7fc4bc1664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.035+0000 7fc4c1031700 1 -- 172.21.15.5:0/3277663592 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0ce730 con 0x7fc4bc06a840 2023-10-16T13:38:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.035+0000 7fc4c1031700 1 --2- 172.21.15.5:0/3277663592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc06a840 0x7fc4bc06ac90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0cab00 tx=0x7fc4b0009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ee2aa7b0ac2ebf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc41579e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc4101547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41006de70 0x7fc4100b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc41579e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc4101547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40066/0 (socket says 172.21.15.5:40066) 2023-10-16T13:38:31.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc41579e700 1 -- 172.21.15.5:0/1604977657 learned_addr learned my addr 172.21.15.5:0/1604977657 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 -- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 msgr2=0x7fc4101547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc4101547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 -- 172.21.15.5:0/1604977657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4100c9bb0 msgr2=0x7fc4101f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4100c9bb0 0x7fc4101f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 -- 172.21.15.5:0/1604977657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040094a0 con 0x7fc41006de70 2023-10-16T13:38:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc414f9d700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41006de70 0x7fc4100b2dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc408014000 tx=0x7fc408004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.026+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080094f0 con 0x7fc41006de70 2023-10-16T13:38:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.027+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408004240 con 0x7fc41006de70 2023-10-16T13:38:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.027+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080045f0 con 0x7fc41006de70 2023-10-16T13:38:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.027+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc408009b30 con 0x7fc41006de70 2023-10-16T13:38:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.027+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4100b3ce0 con 0x7fc41006de70 2023-10-16T13:38:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.030+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc408019070 con 0x7fc41006de70 2023-10-16T13:38:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.030+0000 7fc40d7fa700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3f806b080 0x7fc3f806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.030+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc40808a2e0 con 0x7fc41006de70 2023-10-16T13:38:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.030+0000 7fc40ffff700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3f806b080 0x7fc3f806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.031+0000 7fc40ffff700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3f806b080 0x7fc3f806d540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc4100c96c0 tx=0x7fc400006cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.041+0000 7fc4bb7fe700 1 -- 172.21.15.5:0/3277663592 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0004230 con 0x7fc4bc06a840 2023-10-16T13:38:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.041+0000 7fc4bb7fe700 1 -- 172.21.15.5:0/3277663592 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b0004390 con 0x7fc4bc06a840 2023-10-16T13:38:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.041+0000 7fc4bb7fe700 1 -- 172.21.15.5:0/3277663592 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00036a0 con 0x7fc4bc06a840 2023-10-16T13:38:31.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.041+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f00052f0 con 0x7fc41006de70 2023-10-16T13:38:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3277663592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc06a840 msgr2=0x7fc4bc06ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3277663592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc06a840 0x7fc4bc06ac90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0cab00 tx=0x7fc4b0009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3277663592 shutdown_connections 2023-10-16T13:38:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3277663592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc06a840 0x7fc4bc06ac90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3277663592 >> v2:172.21.15.5:3300/0 conn(0x7fc4bc0cc6e0 0x7fc4bc0cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3277663592 >> 172.21.15.5:0/3277663592 conn(0x7fc4bc06dac0 msgr2=0x7fc4bc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3277663592 shutdown_connections 2023-10-16T13:38:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.042+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3277663592 wait complete. 2023-10-16T13:38:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.043+0000 7fc4c2a94700 1 Processor -- start 2023-10-16T13:38:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 -- start start 2023-10-16T13:38:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4bc06a840 0x7fc4bc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 0x7fc4bc14da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0cc6e0 0x7fc4bc0b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15f8c0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c8a90 con 0x7fc4bc0cc6e0 2023-10-16T13:38:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.044+0000 7fc4c2a94700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c8d70 con 0x7fc4bc06a840 2023-10-16T13:38:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 0x7fc4bc14da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 0x7fc4bc14da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42174/0 (socket says 172.21.15.5:42174) 2023-10-16T13:38:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 -- 172.21.15.5:0/3173949995 learned_addr learned my addr 172.21.15.5:0/3173949995 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 -- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4bc06a840 msgr2=0x7fc4bc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4bc06a840 0x7fc4bc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 -- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0cc6e0 msgr2=0x7fc4bc0b0470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0cc6e0 0x7fc4bc0b0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 -- 172.21.15.5:0/3173949995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00094a0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.045+0000 7fc4bbfff700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 0x7fc4bc14da40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4002130 tx=0x7fc4b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.046+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc408058f60 con 0x7fc41006de70 2023-10-16T13:38:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.046+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400aea0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.046+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b40070d0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.046+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4007440 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.046+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0c9050 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.046+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0c9610 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.049+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4b40075a0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.049+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0052f0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.050+0000 7fc4b97fa700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc4a806af50 0x7fc4a806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.050+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4b40893e0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.055+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4b40546b0 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.057+0000 7fc4c0830700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc4a806af50 0x7fc4a806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:31.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.109+0000 7fc4c0830700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc4a806af50 0x7fc4a806d410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0ca680 tx=0x7fc4ac006d20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.389+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f17d415cba0 con 0x7f17d40b0e40 2023-10-16T13:38:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.397+0000 7f17bbfff700 1 -- 172.21.15.5:0/3931263026 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17c4019020 con 0x7f17d40b0e40 2023-10-16T13:38:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.398+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4200005870 con 0x7f421c14ec10 2023-10-16T13:38:31.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.399+0000 7f4212ffd700 1 -- 172.21.15.5:0/3023690164 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f420c05a1f0 con 0x7f421c14ec10 2023-10-16T13:38:31.402 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:31.404 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-10-16T13:38:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41fc06af00 msgr2=0x7f41fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41fc06af00 0x7f41fc06d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f421c15d070 tx=0x7f4204006f70 comp rx=0 tx=0).stop 2023-10-16T13:38:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 msgr2=0x7f421c1564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 0x7f421c1564b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f420c012000 tx=0x7f420c001cb0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f17c00aef10 msgr2=0x7f17c00b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f17da128700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f17c00aef10 0x7f17c00b13d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00d770 tx=0x7f17cc007710 comp rx=0 tx=0).stop 2023-10-16T13:38:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.406+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 msgr2=0x7f17d4158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.406+0000 7f17da128700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 0x7f17d4158e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f17d4070570 tx=0x7f17c4011b40 comp rx=0 tx=0).stop 2023-10-16T13:38:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 shutdown_connections 2023-10-16T13:38:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f421c0726c0 0x7f421c070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41fc06af00 0x7f41fc06d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f421c14ec10 0x7f421c1564b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.405+0000 7f4220b1b700 1 --2- 172.21.15.5:0/3023690164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c1569f0 0x7f421c072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.406+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 >> 172.21.15.5:0/3023690164 conn(0x7f421c0cf3f0 msgr2=0x7f421c1557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.406+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 shutdown_connections 2023-10-16T13:38:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.407+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 shutdown_connections 2023-10-16T13:38:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.407+0000 7f17da128700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d40b0e40 0x7f17d4158e30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.407+0000 7f17da128700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f17c00aef10 0x7f17c00b13d0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00d770 tx=0x7f17cc007710 comp rx=0 tx=0).stop 2023-10-16T13:38:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.407+0000 7f17da128700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d4207f70 0x7f17d415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.407+0000 7f17da128700 1 --2- 172.21.15.5:0/3931263026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d4208350 0x7f17d40b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.407+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 >> 172.21.15.5:0/3931263026 conn(0x7f17d40cf3f0 msgr2=0x7f17d40af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.410+0000 7f4220b1b700 1 -- 172.21.15.5:0/3023690164 wait complete. 2023-10-16T13:38:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.410+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 shutdown_connections 2023-10-16T13:38:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.410+0000 7f17da128700 1 -- 172.21.15.5:0/3931263026 wait complete. 2023-10-16T13:38:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.410+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa58c005870 con 0x7fa5a806ba70 2023-10-16T13:38:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.411+0000 7fa59f7fe700 1 -- 172.21.15.5:0/1287856406 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa590017030 con 0x7fa5a806ba70 2023-10-16T13:38:31.415 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-10-16T13:38:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.412+0000 7ff0034c6700 1 -- 172.21.15.5:0/2681506666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feffc0ae830 con 0x7feffc0ce3a0 2023-10-16T13:38:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.412+0000 7feff1ffb700 1 -- 172.21.15.5:0/2681506666 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fefec057ab0 con 0x7feffc0ce3a0 2023-10-16T13:38:31.418 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-10-16T13:38:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 -- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefe006af00 msgr2=0x7fefe006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefe006af00 0x7fefe006d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feff8009c10 tx=0x7feff8008030 comp rx=0 tx=0).stop 2023-10-16T13:38:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 -- 172.21.15.5:0/2681506666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0ce3a0 msgr2=0x7feffc0c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0ce3a0 0x7feffc0c5650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefec00e7e0 tx=0x7fefec00eaf0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 -- 172.21.15.5:0/2681506666 shutdown_connections 2023-10-16T13:38:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefe006af00 0x7fefe006d3c0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feff8009c10 tx=0x7feff8008030 comp rx=0 tx=0).stop 2023-10-16T13:38:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feffc0c4040 0x7feffc0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feffc0c9c50 0x7feffc154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 --2- 172.21.15.5:0/2681506666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feffc0ce3a0 0x7feffc0c5650 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.416+0000 7fefe77fe700 1 -- 172.21.15.5:0/2681506666 >> 172.21.15.5:0/2681506666 conn(0x7feffc0cf3f0 msgr2=0x7feffc0af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.417+0000 7fefe77fe700 1 -- 172.21.15.5:0/2681506666 shutdown_connections 2023-10-16T13:38:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99a804ebb0 con 0x7f99a8159fa0 2023-10-16T13:38:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa58806af00 msgr2=0x7fa58806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa58806af00 0x7fa58806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8236100 tx=0x7fa598008040 comp rx=0 tx=0).stop 2023-10-16T13:38:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 msgr2=0x7fa5a80a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 0x7fa5a80a0e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa590000c00 tx=0x7fa590004750 comp rx=0 tx=0).stop 2023-10-16T13:38:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fefe77fe700 1 -- 172.21.15.5:0/2681506666 wait complete. 2023-10-16T13:38:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7f998ffff700 1 -- 172.21.15.5:0/1065929563 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99a0017030 con 0x7f99a8159fa0 2023-10-16T13:38:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f01100cd6c0 con 0x7f01100afa60 2023-10-16T13:38:31.425 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-10-16T13:38:31.425 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-10-16T13:38:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.420+0000 7f0105ffb700 1 -- 172.21.15.5:0/1494072839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0108015020 con 0x7f01100afa60 2023-10-16T13:38:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 shutdown_connections 2023-10-16T13:38:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5a80d3230 0x7fa5a80b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa58806af00 0x7fa58806d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5a806ba70 0x7fa5a80a0e90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 --2- 172.21.15.5:0/1287856406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a80b82a0 0x7fa5a80b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.419+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 >> 172.21.15.5:0/1287856406 conn(0x7fa5a80d37d0 msgr2=0x7fa5a80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.420+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 shutdown_connections 2023-10-16T13:38:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.420+0000 7fa5ad6cd700 1 -- 172.21.15.5:0/1287856406 wait complete. 2023-10-16T13:38:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.428+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f00f406af50 msgr2=0x7f00f406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.428+0000 7f01177c5700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f00f406af50 0x7f00f406d410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0110202e90 tx=0x7f010c008040 comp rx=0 tx=0).stop 2023-10-16T13:38:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.428+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 msgr2=0x7f01100c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.428+0000 7f01177c5700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 0x7f01100c5340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0110070e20 tx=0x7f0108004b40 comp rx=0 tx=0).stop 2023-10-16T13:38:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.431+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 shutdown_connections 2023-10-16T13:38:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.431+0000 7f01177c5700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f00f406af50 0x7f00f406d410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.431+0000 7f01177c5700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01100cfa80 0x7f011009b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.431+0000 7f01177c5700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01100afa60 0x7f01100c5340 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.431+0000 7f01177c5700 1 --2- 172.21.15.5:0/1494072839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01100b0650 0x7f011009b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.431+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 >> 172.21.15.5:0/1494072839 conn(0x7f0110070e90 msgr2=0x7f011016a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-16T13:38:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f999406af50 msgr2=0x7f999406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f999406af50 0x7f999406d410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99980099d0 tx=0x7f9998008040 comp rx=0 tx=0).stop 2023-10-16T13:38:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a8159fa0 msgr2=0x7f99a8151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a8159fa0 0x7f99a8151cd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99a000caa0 tx=0x7f99a000ce60 comp rx=0 tx=0).stop 2023-10-16T13:38:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 shutdown_connections 2023-10-16T13:38:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f999406af50 0x7f999406d410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a8159fa0 0x7f99a8151cd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a80c9fc0 0x7f99a80c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 --2- 172.21.15.5:0/1065929563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cff10 0x7f99a81594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.433+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 >> 172.21.15.5:0/1065929563 conn(0x7f99a80cf3f0 msgr2=0x7f99a815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.435+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 shutdown_connections 2023-10-16T13:38:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.435+0000 7f99adaea700 1 -- 172.21.15.5:0/1065929563 wait complete. 2023-10-16T13:38:31.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-16T13:38:31.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-16T13:38:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.441+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 shutdown_connections 2023-10-16T13:38:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.441+0000 7f01177c5700 1 -- 172.21.15.5:0/1494072839 wait complete. 2023-10-16T13:38:31.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-10-16T13:38:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.451+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc3f0005870 con 0x7fc41006de70 2023-10-16T13:38:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.451+0000 7fc40d7fa700 1 -- 172.21.15.5:0/1604977657 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc408017070 con 0x7fc41006de70 2023-10-16T13:38:31.454 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-10-16T13:38:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.453+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3f806b080 msgr2=0x7fc3f806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.453+0000 7fc415f9f700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3f806b080 0x7fc3f806d540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc4100c96c0 tx=0x7fc400006cd0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.453+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41006de70 msgr2=0x7fc4100b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.453+0000 7fc415f9f700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41006de70 0x7fc4100b2dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc408014000 tx=0x7fc408004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 shutdown_connections 2023-10-16T13:38:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3f806b080 0x7fc3f806d540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc410159a20 0x7fc4101547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41006de70 0x7fc4100b2dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 --2- 172.21.15.5:0/1604977657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4100c9bb0 0x7fc4101f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 >> 172.21.15.5:0/1604977657 conn(0x7fc4100cf1c0 msgr2=0x7fc4100ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 shutdown_connections 2023-10-16T13:38:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.454+0000 7fc415f9f700 1 -- 172.21.15.5:0/1604977657 wait complete. 2023-10-16T13:38:31.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-16T13:38:31.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-16T13:38:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.459+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc49c005870 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.460+0000 7fc4b97fa700 1 -- 172.21.15.5:0/3173949995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4b4018020 con 0x7fc4bc0c3ac0 2023-10-16T13:38:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-10-16T13:38:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc4a806af50 msgr2=0x7fc4a806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc4a806af50 0x7fc4a806d410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0ca680 tx=0x7fc4ac006d20 comp rx=0 tx=0).stop 2023-10-16T13:38:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 msgr2=0x7fc4bc14da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 0x7fc4bc14da40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4002130 tx=0x7fc4b400a340 comp rx=0 tx=0).stop 2023-10-16T13:38:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 shutdown_connections 2023-10-16T13:38:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0cc6e0 0x7fc4bc0b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc4a806af50 0x7fc4a806d410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4bc06a840 0x7fc4bc15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 --2- 172.21.15.5:0/3173949995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c3ac0 0x7fc4bc14da40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 >> 172.21.15.5:0/3173949995 conn(0x7fc4bc06dac0 msgr2=0x7fc4bc0ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 shutdown_connections 2023-10-16T13:38:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:31.462+0000 7fc4c2a94700 1 -- 172.21.15.5:0/3173949995 wait complete. 2023-10-16T13:38:31.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-10-16T13:38:31.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-16T13:38:32.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T13:38:32.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T13:38:32.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T13:38:32.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T13:38:32.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T13:38:32.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T13:38:32.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T13:38:32.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T13:38:32.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.647+0000 7f783e9a0700 1 Processor -- start 2023-10-16T13:38:32.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.651+0000 7f783e9a0700 1 -- start start 2023-10-16T13:38:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.653+0000 7f783e9a0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7838166620 0x7f78380cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.653+0000 7f783e9a0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380ca9f0 con 0x7f78380ce3a0 2023-10-16T13:38:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.653+0000 7f783e9a0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380ca430 con 0x7f78380c2840 2023-10-16T13:38:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.653+0000 7f783e9a0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7838162490 con 0x7f7838166620 2023-10-16T13:38:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.653+0000 7f783cf3d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78380ce3a0 0x7f783806c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52188/0 (socket says 172.21.15.5:52188) 2023-10-16T13:38:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.653+0000 7f783cf3d700 1 -- 172.21.15.5:0/3641218270 learned_addr learned my addr 172.21.15.5:0/3641218270 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.654+0000 7f782ffff700 1 --2- 172.21.15.5:0/3641218270 >> v2:172.21.15.112:3300/0 conn(0x7f7838166620 0x7f78380cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.654+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101839109 0 0) 0x7f78380ca9f0 con 0x7f78380ce3a0 2023-10-16T13:38:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.654+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78240035b0 con 0x7f78380ce3a0 2023-10-16T13:38:32.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.654+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841653764 0 0) 0x7f78380ca430 con 0x7f78380c2840 2023-10-16T13:38:32.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.654+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78380ca9f0 con 0x7f78380c2840 2023-10-16T13:38:32.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.655+0000 7f782ffff700 1 -- 172.21.15.5:0/3641218270 >> v1:172.21.15.112:6789/0 conn(0x7f78380c2840 legacy=0x7f78380c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.655+0000 7f782ffff700 1 -- 172.21.15.5:0/3641218270 >> v1:172.21.15.5:6789/0 conn(0x7f78380ce3a0 legacy=0x7f783806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.655+0000 7f782ffff700 1 -- 172.21.15.5:0/3641218270 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380ca710 con 0x7f7838166620 2023-10-16T13:38:32.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.655+0000 7f782ffff700 1 --2- 172.21.15.5:0/3641218270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7838166620 0x7f78380cde60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7828009840 tx=0x7f7828009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c1842b80929dcd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.656+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828004230 con 0x7f7838166620 2023-10-16T13:38:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.656+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828004390 con 0x7f7838166620 2023-10-16T13:38:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.656+0000 7f78377fe700 1 -- 172.21.15.5:0/3641218270 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280036a0 con 0x7f7838166620 2023-10-16T13:38:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 -- 172.21.15.5:0/3641218270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7838166620 msgr2=0x7f78380cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 --2- 172.21.15.5:0/3641218270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7838166620 0x7f78380cde60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7828009840 tx=0x7f7828009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 -- 172.21.15.5:0/3641218270 shutdown_connections 2023-10-16T13:38:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 --2- 172.21.15.5:0/3641218270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7838166620 0x7f78380cde60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 -- 172.21.15.5:0/3641218270 >> 172.21.15.5:0/3641218270 conn(0x7f78380cf3f0 msgr2=0x7f78380cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 -- 172.21.15.5:0/3641218270 shutdown_connections 2023-10-16T13:38:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.657+0000 7f783e9a0700 1 -- 172.21.15.5:0/3641218270 wait complete. 2023-10-16T13:38:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.659+0000 7f783e9a0700 1 Processor -- start 2023-10-16T13:38:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.660+0000 7f783e9a0700 1 -- start start 2023-10-16T13:38:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.661+0000 7f783e9a0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78380c2840 0x7f7838159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.661+0000 7f783e9a0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78380ce3a0 0x7f78380c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.661+0000 7f783e9a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 0x7f78380af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.661+0000 7f783e9a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838163380 con 0x7f7838166620 2023-10-16T13:38:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.661+0000 7f783e9a0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838159cb0 con 0x7f78380ce3a0 2023-10-16T13:38:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.661+0000 7f783e9a0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838162700 con 0x7f78380c2840 2023-10-16T13:38:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 0x7f78380af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 0x7f78380af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42188/0 (socket says 172.21.15.5:42188) 2023-10-16T13:38:32.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 -- 172.21.15.5:0/2235420769 learned_addr learned my addr 172.21.15.5:0/2235420769 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 -- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78380c2840 msgr2=0x7f7838159770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:32.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78380c2840 0x7f7838159770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 -- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78380ce3a0 msgr2=0x7f78380c5550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78380ce3a0 0x7f78380c5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.662+0000 7f783cf3d700 1 -- 172.21.15.5:0/2235420769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094a0 con 0x7f7838166620 2023-10-16T13:38:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.663+0000 7f783cf3d700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 0x7f78380af590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f783001dad0 tx=0x7f783001de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.664+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783001ba60 con 0x7f7838166620 2023-10-16T13:38:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.665+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783001bbc0 con 0x7f7838166620 2023-10-16T13:38:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.665+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830023400 con 0x7f7838166620 2023-10-16T13:38:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.665+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78381629e0 con 0x7f7838166620 2023-10-16T13:38:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.665+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838162fa0 con 0x7f7838166620 2023-10-16T13:38:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.669+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c0052f0 con 0x7f7838166620 2023-10-16T13:38:32.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.670+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f783002c3b0 con 0x7f7838166620 2023-10-16T13:38:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.671+0000 7f78357fa700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f782406b5e0 0x7f782406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.671+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f783009a2d0 con 0x7f7838166620 2023-10-16T13:38:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.679+0000 7f7837fff700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f782406b5e0 0x7f782406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.680+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7830065360 con 0x7f7838166620 2023-10-16T13:38:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.682+0000 7f7837fff700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f782406b5e0 0x7f782406daa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7820000f60 tx=0x7f7820007a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.706+0000 7f58e0015700 1 Processor -- start 2023-10-16T13:38:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.707+0000 7f58e0015700 1 -- start start 2023-10-16T13:38:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7fcc0c221700 1 Processor -- start 2023-10-16T13:38:32.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.709+0000 7f7c35a5a700 1 Processor -- start 2023-10-16T13:38:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7f58e0015700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8166620 0x7f58d80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7f58e0015700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d80ca9f0 con 0x7f58d80ce3a0 2023-10-16T13:38:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7f58e0015700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d80ca430 con 0x7f58d80c2840 2023-10-16T13:38:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7f58e0015700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8162490 con 0x7f58d8166620 2023-10-16T13:38:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7f58de5b2700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f58d80ce3a0 0x7f58d806c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52200/0 (socket says 172.21.15.5:52200) 2023-10-16T13:38:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7f58de5b2700 1 -- 172.21.15.5:0/3655370826 learned_addr learned my addr 172.21.15.5:0/3655370826 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:32.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.709+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002672975 0 0) 0x7f58d80ca9f0 con 0x7f58d80ce3a0 2023-10-16T13:38:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.709+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c40035b0 con 0x7f58d80ce3a0 2023-10-16T13:38:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.708+0000 7fcc0c221700 1 -- start start 2023-10-16T13:38:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.709+0000 7fcc0c221700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc04157250 0x7fcc0415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.709+0000 7fcc0c221700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc040c9fc0 0x7fcc04159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc0c221700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0415af20 con 0x7fcc0415a4e0 2023-10-16T13:38:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc0c221700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0415e470 con 0x7fcc04157250 2023-10-16T13:38:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc0c221700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0415a960 con 0x7fcc040c9fc0 2023-10-16T13:38:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc0a7be700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcc0415a4e0 0x7fcc0406c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:43180/0 (socket says 172.21.15.5:43180) 2023-10-16T13:38:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc0a7be700 1 -- 172.21.15.5:0/2201811044 learned_addr learned my addr 172.21.15.5:0/2201811044 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f784a081700 1 Processor -- start 2023-10-16T13:38:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8166620 0x7f58d80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc097bc700 1 --2- 172.21.15.5:0/2201811044 >> v2:172.21.15.112:3300/0 conn(0x7fcc040c9fc0 0x7fcc04159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f784a081700 1 -- start start 2023-10-16T13:38:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.709+0000 7f7c35a5a700 1 -- start start 2023-10-16T13:38:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f7c35a5a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015ddc0 0x7f7c30161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f7c35a5a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c30161d40 0x7f7c30167b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f7c35a5a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300ce350 con 0x7f7c3015d9e0 2023-10-16T13:38:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f7c35a5a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c301621c0 con 0x7f7c30161d40 2023-10-16T13:38:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7f7c35a5a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300b5140 con 0x7f7c3015ddc0 2023-10-16T13:38:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758251615 0 0) 0x7f58c40035b0 con 0x7f58d80ce3a0 2023-10-16T13:38:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8166620 msgr2=0x7f58d80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8166620 0x7f58d80cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 >> v1:172.21.15.112:6789/0 conn(0x7f58d80c2840 legacy=0x7f58d80c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80ca710 con 0x7f58d80ce3a0 2023-10-16T13:38:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f58d4001670 con 0x7f58d80ce3a0 2023-10-16T13:38:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 >> v1:172.21.15.5:6789/0 conn(0x7f58d80ce3a0 legacy=0x7f58d806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c4003a30 0x7f58c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c4004850 0x7f58c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58c4005210 0x7f58c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8162490 con 0x7f58c4003a30 2023-10-16T13:38:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c400bfb0 con 0x7f58c4004850 2023-10-16T13:38:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c400c170 con 0x7f58c4005210 2023-10-16T13:38:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc08fbb700 1 -- 172.21.15.5:0/2201811044 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283837248 0 0) 0x7fcc0415af20 con 0x7fcc0415a4e0 2023-10-16T13:38:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.710+0000 7fcc08fbb700 1 -- 172.21.15.5:0/2201811044 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf00035b0 con 0x7fcc0415a4e0 2023-10-16T13:38:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f7c2f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c30161d40 0x7f7c30167b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f7c2f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c30161d40 0x7f7c30167b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42206/0 (socket says 172.21.15.5:42206) 2023-10-16T13:38:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f7c2f7fe700 1 -- 172.21.15.5:0/2858222445 learned_addr learned my addr 172.21.15.5:0/2858222445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8166620 0x7f58d80cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58de5b2700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58c4005210 0x7f58c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c4004850 0x7f58c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7fcc097bc700 1 -- 172.21.15.5:0/2201811044 >> v2:172.21.15.5:3300/0 conn(0x7fcc04157250 msgr2=0x7fcc0415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7fcc097bc700 1 --2- 172.21.15.5:0/2201811044 >> v2:172.21.15.5:3300/0 conn(0x7fcc04157250 0x7fcc0415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7fcc097bc700 1 -- 172.21.15.5:0/2201811044 >> v1:172.21.15.112:6789/0 conn(0x7fcc0415a4e0 legacy=0x7fcc0406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7fcc097bc700 1 -- 172.21.15.5:0/2201811044 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0415ac40 con 0x7fcc040c9fc0 2023-10-16T13:38:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.711+0000 7f784a081700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7844157250 0x7f784415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f784a081700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784406d0c0 0x7f7844159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f784a081700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784415af20 con 0x7f78440cff10 2023-10-16T13:38:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f784a081700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784415e470 con 0x7f7844157250 2023-10-16T13:38:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f784a081700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784415a960 con 0x7f784406d0c0 2023-10-16T13:38:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58de5b2700 1 -- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c4004850 msgr2=0x7f58c4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58de5b2700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c4004850 0x7f58c4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58de5b2700 1 -- 172.21.15.5:0/3655370826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c4003a30 msgr2=0x7f58c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58de5b2700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c4003a30 0x7f58c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58de5b2700 1 -- 172.21.15.5:0/3655370826 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80ca710 con 0x7f58c4005210 2023-10-16T13:38:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7fcc097bc700 1 --2- 172.21.15.5:0/2201811044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc040c9fc0 0x7fcc04159fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc040aedf0 tx=0x7fcc00009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c10335766f7096b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7842ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f78440cff10 0x7f784406c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:43196/0 (socket says 172.21.15.5:43196) 2023-10-16T13:38:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7842ffd700 1 -- 172.21.15.5:0/289518377 learned_addr learned my addr 172.21.15.5:0/289518377 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58de5b2700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58c4005210 0x7f58c400ba10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c290 tx=0x7f58c4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44c1c1870635e4d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7fcc08fbb700 1 -- 172.21.15.5:0/2201811044 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011830 con 0x7fcc040c9fc0 2023-10-16T13:38:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7fcc08fbb700 1 -- 172.21.15.5:0/2201811044 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00011990 con 0x7fcc040c9fc0 2023-10-16T13:38:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7fcc08fbb700 1 -- 172.21.15.5:0/2201811044 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011d00 con 0x7fcc040c9fc0 2023-10-16T13:38:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4007c10 con 0x7f58c4005210 2023-10-16T13:38:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f78437fe700 1 --2- 172.21.15.5:0/289518377 >> v2:172.21.15.5:3300/0 conn(0x7f7844157250 0x7f784415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7843fff700 1 --2- 172.21.15.5:0/289518377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784406d0c0 0x7f7844159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7c2f7fe700 1 -- 172.21.15.5:0/2858222445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015ddc0 msgr2=0x7f7c30161800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T13:38:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7c2f7fe700 1 --2- 172.21.15.5:0/2858222445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015ddc0 0x7f7c30161800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7c2f7fe700 1 -- 172.21.15.5:0/2858222445 >> v1:172.21.15.5:6789/0 conn(0x7f7c3015d9e0 legacy=0x7f7c300d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f7c2f7fe700 1 -- 172.21.15.5:0/2858222445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30162630 con 0x7f7c30161d40 2023-10-16T13:38:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7c2f7fe700 1 --2- 172.21.15.5:0/2858222445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c30161d40 0x7f7c30167b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009e50 tx=0x7f7c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e33764610a3299 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d400ce50 con 0x7f58c4005210 2023-10-16T13:38:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.712+0000 7f58dcdaf700 1 -- 172.21.15.5:0/3655370826 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4005ba0 con 0x7f58c4005210 2023-10-16T13:38:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f78427fc700 1 -- 172.21.15.5:0/289518377 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501210525 0 0) 0x7f784415af20 con 0x7f78440cff10 2023-10-16T13:38:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f78427fc700 1 -- 172.21.15.5:0/289518377 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f782c0057c0 con 0x7f78440cff10 2023-10-16T13:38:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7843fff700 1 -- 172.21.15.5:0/289518377 >> v2:172.21.15.5:3300/0 conn(0x7f7844157250 msgr2=0x7f784415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7843fff700 1 --2- 172.21.15.5:0/289518377 >> v2:172.21.15.5:3300/0 conn(0x7f7844157250 0x7f784415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7843fff700 1 -- 172.21.15.5:0/289518377 >> v1:172.21.15.112:6789/0 conn(0x7f78440cff10 legacy=0x7f784406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7843fff700 1 -- 172.21.15.5:0/289518377 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784415ac40 con 0x7f784406d0c0 2023-10-16T13:38:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 -- 172.21.15.5:0/2201811044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc040c9fc0 msgr2=0x7fcc04159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2201811044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc040c9fc0 0x7fcc04159fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc040aedf0 tx=0x7fcc00009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7c2dffb700 1 -- 172.21.15.5:0/2858222445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e070 con 0x7f7c30161d40 2023-10-16T13:38:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7c2dffb700 1 -- 172.21.15.5:0/2858222445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28003a20 con 0x7f7c30161d40 2023-10-16T13:38:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7c2dffb700 1 -- 172.21.15.5:0/2858222445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28003dd0 con 0x7f7c30161d40 2023-10-16T13:38:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f7843fff700 1 --2- 172.21.15.5:0/289518377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784406d0c0 0x7f7844159fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=570caf98a7876d1e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 -- 172.21.15.5:0/2201811044 shutdown_connections 2023-10-16T13:38:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2201811044 >> v2:172.21.15.5:3300/0 conn(0x7fcc04157250 0x7fcc0415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2201811044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc040c9fc0 0x7fcc04159fa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 -- 172.21.15.5:0/2201811044 >> 172.21.15.5:0/2201811044 conn(0x7fcc040cf3f0 msgr2=0x7fcc040cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 -- 172.21.15.5:0/2201811044 shutdown_connections 2023-10-16T13:38:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f58e0015700 1 -- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58c4005210 msgr2=0x7f58c400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f58e0015700 1 --2- 172.21.15.5:0/3655370826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58c4005210 0x7f58c400ba10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c290 tx=0x7f58c4005880 comp rx=0 tx=0).stop 2023-10-16T13:38:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f58de5b2700 1 -- 172.21.15.5:0/3655370826 reap_dead start 2023-10-16T13:38:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7f58e0015700 1 -- 172.21.15.5:0/3655370826 shutdown_connections 2023-10-16T13:38:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f58e0015700 1 -- 172.21.15.5:0/3655370826 >> 172.21.15.5:0/3655370826 conn(0x7f58d80cf3f0 msgr2=0x7f58d80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f58e0015700 1 -- 172.21.15.5:0/3655370826 shutdown_connections 2023-10-16T13:38:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f78427fc700 1 -- 172.21.15.5:0/289518377 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011830 con 0x7f784406d0c0 2023-10-16T13:38:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f78427fc700 1 -- 172.21.15.5:0/289518377 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838011990 con 0x7f784406d0c0 2023-10-16T13:38:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f78427fc700 1 -- 172.21.15.5:0/289518377 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011d00 con 0x7f784406d0c0 2023-10-16T13:38:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f7c35a5a700 1 -- 172.21.15.5:0/2858222445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c30161d40 msgr2=0x7f7c30167b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/2858222445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c30161d40 0x7f7c30167b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009e50 tx=0x7f7c2800b330 comp rx=0 tx=0).stop 2023-10-16T13:38:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.713+0000 7fcc0c221700 1 -- 172.21.15.5:0/2201811044 wait complete. 2023-10-16T13:38:32.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.714+0000 7f58e0015700 1 -- 172.21.15.5:0/3655370826 wait complete. 2023-10-16T13:38:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 -- 172.21.15.5:0/289518377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784406d0c0 msgr2=0x7f7844159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 --2- 172.21.15.5:0/289518377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784406d0c0 0x7f7844159fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 -- 172.21.15.5:0/289518377 shutdown_connections 2023-10-16T13:38:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 --2- 172.21.15.5:0/289518377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784406d0c0 0x7f7844159fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 --2- 172.21.15.5:0/289518377 >> v2:172.21.15.5:3300/0 conn(0x7f7844157250 0x7f784415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 -- 172.21.15.5:0/289518377 >> 172.21.15.5:0/289518377 conn(0x7f78440cf3f0 msgr2=0x7f78440cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 -- 172.21.15.5:0/289518377 shutdown_connections 2023-10-16T13:38:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7fcc0c221700 1 Processor -- start 2023-10-16T13:38:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f58e0015700 1 Processor -- start 2023-10-16T13:38:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f58e0015700 1 -- start start 2023-10-16T13:38:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7fcc0c221700 1 -- start start 2023-10-16T13:38:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f7c35a5a700 1 -- 172.21.15.5:0/2858222445 shutdown_connections 2023-10-16T13:38:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/2858222445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c30161d40 0x7f7c30167b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/2858222445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015ddc0 0x7f7c30161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f7c35a5a700 1 -- 172.21.15.5:0/2858222445 >> 172.21.15.5:0/2858222445 conn(0x7f7c3009cb40 msgr2=0x7f7c300d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f46b8917700 1 Processor -- start 2023-10-16T13:38:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.715+0000 7f784a081700 1 -- 172.21.15.5:0/289518377 wait complete. 2023-10-16T13:38:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f7c35a5a700 1 -- 172.21.15.5:0/2858222445 shutdown_connections 2023-10-16T13:38:32.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f784a081700 1 Processor -- start 2023-10-16T13:38:32.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58e0015700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d815ff50 0x7f58d81fb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58e0015700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8160330 0x7f58d8162b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58e0015700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d80b1fe0 0x7f58d80b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58e0015700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81fbb30 con 0x7f58d80b1fe0 2023-10-16T13:38:32.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58e0015700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80b3120 con 0x7f58d815ff50 2023-10-16T13:38:32.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58e0015700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80c8640 con 0x7f58d8160330 2023-10-16T13:38:32.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58de5b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d80b1fe0 0x7f58d80b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58de5b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d80b1fe0 0x7f58d80b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42230/0 (socket says 172.21.15.5:42230) 2023-10-16T13:38:32.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58de5b2700 1 -- 172.21.15.5:0/767482164 learned_addr learned my addr 172.21.15.5:0/767482164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8160330 0x7f58d8162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc0c221700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 0x7fcc04153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc0c221700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc04157250 0x7fcc04070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc0c221700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc0415a4e0 0x7fcc04071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc0c221700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04154480 con 0x7fcc040c9fc0 2023-10-16T13:38:32.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc0c221700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c4860 con 0x7fcc0415a4e0 2023-10-16T13:38:32.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc0c221700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c4b40 con 0x7fcc04157250 2023-10-16T13:38:32.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc09fbd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 0x7fcc04153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc09fbd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 0x7fcc04153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42222/0 (socket says 172.21.15.5:42222) 2023-10-16T13:38:32.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7fcc09fbd700 1 -- 172.21.15.5:0/2152946713 learned_addr learned my addr 172.21.15.5:0/2152946713 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7fcc0a7be700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc0415a4e0 0x7fcc04071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dddb1700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d815ff50 0x7f58d81fb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dd5b0700 1 -- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d815ff50 msgr2=0x7f58d81fb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d815ff50 0x7f58d81fb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dd5b0700 1 -- 172.21.15.5:0/767482164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d80b1fe0 msgr2=0x7f58d80b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d80b1fe0 0x7f58d80b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dd5b0700 1 -- 172.21.15.5:0/767482164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80b2510 con 0x7f58d8160330 2023-10-16T13:38:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.716+0000 7f46b8917700 1 -- start start 2023-10-16T13:38:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f46b8917700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 0x7f46b41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f46b8917700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b415e9d0 con 0x7f46b415dac0 2023-10-16T13:38:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f46b8917700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b40ce2e0 con 0x7f46b415df40 2023-10-16T13:38:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f46b8917700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4154910 con 0x7f46b4153ff0 2023-10-16T13:38:32.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58dd5b0700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8160330 0x7f58d8162b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58d80c6470 tx=0x7f58c8011860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7fcc09fbd700 1 -- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc04157250 msgr2=0x7fcc04070e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T13:38:32.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7fcc09fbd700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc04157250 0x7fcc04070e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7fcc09fbd700 1 -- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc0415a4e0 msgr2=0x7fcc04071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7fcc09fbd700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc0415a4e0 0x7fcc04071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7fcc09fbd700 1 -- 172.21.15.5:0/2152946713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000094a0 con 0x7fcc040c9fc0 2023-10-16T13:38:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8004440 con 0x7f58d8160330 2023-10-16T13:38:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d80b27f0 con 0x7f58d8160330 2023-10-16T13:38:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f784a081700 1 -- start start 2023-10-16T13:38:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f784a081700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784406d0c0 0x7f78440c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f784a081700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 0x7f78440c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f784a081700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7844157250 0x7f78440c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f784a081700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c7720 con 0x7f78440cff10 2023-10-16T13:38:32.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f784a081700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c6aa0 con 0x7f784406d0c0 2023-10-16T13:38:32.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f784a081700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c6d80 con 0x7f7844157250 2023-10-16T13:38:32.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f7842ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 0x7f78440c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f7842ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 0x7f78440c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42236/0 (socket says 172.21.15.5:42236) 2023-10-16T13:38:32.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f7842ffd700 1 -- 172.21.15.5:0/4200464256 learned_addr learned my addr 172.21.15.5:0/4200464256 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f78437fe700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784406d0c0 0x7f78440c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f7843fff700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7844157250 0x7f78440c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f78437fe700 1 -- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7844157250 msgr2=0x7f78440c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f78437fe700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7844157250 0x7f78440c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f78437fe700 1 -- 172.21.15.5:0/4200464256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 msgr2=0x7f78440c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f78437fe700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 0x7f78440c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f78437fe700 1 -- 172.21.15.5:0/4200464256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380094a0 con 0x7f784406d0c0 2023-10-16T13:38:32.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7842ffd700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 0x7f78440c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:32.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.717+0000 7f7c35a5a700 1 -- 172.21.15.5:0/2858222445 wait complete. 2023-10-16T13:38:32.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f7c35a5a700 1 Processor -- start 2023-10-16T13:38:32.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f46b259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 0x7f46b41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f46b259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 0x7f46b41543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40142/0 (socket says 172.21.15.5:40142) 2023-10-16T13:38:32.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f46b259c700 1 -- 172.21.15.5:0/3841516026 learned_addr learned my addr 172.21.15.5:0/3841516026 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d80b2db0 con 0x7f58d8160330 2023-10-16T13:38:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7fcc09fbd700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 0x7fcc04153250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400b560 tx=0x7fcbf400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f78437fe700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784406d0c0 0x7f78440c64c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f783400e7e0 tx=0x7f783400eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f7c35a5a700 1 -- start start 2023-10-16T13:38:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c35a5a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015d9e0 0x7f7c301ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c35a5a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c3015ddc0 0x7f7c30160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c35a5a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c30161d40 0x7f7c3006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c35a5a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30158a70 con 0x7f7c3015ddc0 2023-10-16T13:38:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c35a5a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300ccd70 con 0x7f7c30161d40 2023-10-16T13:38:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c35a5a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300cc7b0 con 0x7f7c3015d9e0 2023-10-16T13:38:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834013610 con 0x7f784406d0c0 2023-10-16T13:38:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7834013770 con 0x7f784406d0c0 2023-10-16T13:38:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78440c7060 con 0x7f784406d0c0 2023-10-16T13:38:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c2effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015d9e0 0x7f7c301ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c2f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c30161d40 0x7f7c3006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c2f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c30161d40 0x7f7c3006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38150/0 (socket says 172.21.15.5:38150) 2023-10-16T13:38:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c2f7fe700 1 -- 172.21.15.5:0/268909639 learned_addr learned my addr 172.21.15.5:0/268909639 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f7c2e7fc700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c3015ddc0 0x7f7c30160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c80045a0 con 0x7f58d8160330 2023-10-16T13:38:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c80038e0 con 0x7f58d8160330 2023-10-16T13:38:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834013b00 con 0x7f784406d0c0 2023-10-16T13:38:32.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78440b4560 con 0x7f784406d0c0 2023-10-16T13:38:32.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f7c2effd700 1 -- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c30161d40 msgr2=0x7f7c3006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f7c2effd700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c30161d40 0x7f7c3006cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f7c2effd700 1 -- 172.21.15.5:0/268909639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c3015ddc0 msgr2=0x7f7c30160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f7c2effd700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c3015ddc0 0x7f7c30160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f7c2effd700 1 -- 172.21.15.5:0/268909639 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009b30 con 0x7f7c3015d9e0 2023-10-16T13:38:32.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c00052f0 con 0x7f58d8160330 2023-10-16T13:38:32.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f657f64e700 1 Processor -- start 2023-10-16T13:38:32.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.718+0000 7f657f64e700 1 -- start start 2023-10-16T13:38:32.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657f64e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f657808a700 0x7f65780ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657f64e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f657806d0c0 0x7f65780ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657f64e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65780ca990 con 0x7f65780ceae0 2023-10-16T13:38:32.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657f64e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780cf250 con 0x7f657806d0c0 2023-10-16T13:38:32.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657f64e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657816ebd0 con 0x7f657808a700 2023-10-16T13:38:32.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657d3ea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f657808a700 0x7f65780ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657d3ea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f657808a700 0x7f65780ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38140/0 (socket says 172.21.15.5:38140) 2023-10-16T13:38:32.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.719+0000 7f657d3ea700 1 -- 172.21.15.5:0/2167768345 learned_addr learned my addr 172.21.15.5:0/2167768345 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f657d3ea700 1 -- 172.21.15.5:0/2167768345 >> v2:172.21.15.5:3300/0 conn(0x7f657806d0c0 msgr2=0x7f65780ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:32.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.720+0000 7f657dbeb700 1 --2- 172.21.15.5:0/2167768345 >> v2:172.21.15.5:3300/0 conn(0x7f657806d0c0 0x7f65780ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f46b259c700 1 -- 172.21.15.5:0/3841516026 >> v1:172.21.15.112:6789/0 conn(0x7f46b415df40 legacy=0x7f46b40b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f46b259c700 1 -- 172.21.15.5:0/3841516026 >> v1:172.21.15.5:6789/0 conn(0x7f46b415dac0 legacy=0x7f46b40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f46b259c700 1 -- 172.21.15.5:0/3841516026 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40cee80 con 0x7f46b4153ff0 2023-10-16T13:38:32.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f657d3ea700 1 --2- 172.21.15.5:0/2167768345 >> v2:172.21.15.5:3300/0 conn(0x7f657806d0c0 0x7f65780ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f657d3ea700 1 -- 172.21.15.5:0/2167768345 >> v1:172.21.15.5:6789/0 conn(0x7f65780ceae0 legacy=0x7f657806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f657d3ea700 1 -- 172.21.15.5:0/2167768345 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780cef70 con 0x7f657808a700 2023-10-16T13:38:32.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.721+0000 7f657dbeb700 1 --2- 172.21.15.5:0/2167768345 >> v2:172.21.15.5:3300/0 conn(0x7f657806d0c0 0x7f65780ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:32.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f657d3ea700 1 --2- 172.21.15.5:0/2167768345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657808a700 0x7f65780ca450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f657806f4d0 tx=0x7f6568008c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=758cdda890270d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f7c2effd700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015d9e0 0x7f7c301ffc70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400c750 tx=0x7f7c2400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f656ffff700 1 -- 172.21.15.5:0/2167768345 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800dc90 con 0x7f657808a700 2023-10-16T13:38:32.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f656ffff700 1 -- 172.21.15.5:0/2167768345 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800ddf0 con 0x7f657808a700 2023-10-16T13:38:32.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f46b259c700 1 --2- 172.21.15.5:0/3841516026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 0x7f46b41543d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00d180 tx=0x7f46ac00d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7120e1ff8728cea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f656ffff700 1 -- 172.21.15.5:0/2167768345 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568011670 con 0x7f657808a700 2023-10-16T13:38:32.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f58c8003a40 con 0x7f58d8160330 2023-10-16T13:38:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240054e0 con 0x7f7c3015d9e0 2023-10-16T13:38:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24003680 con 0x7f7c3015d9e0 2023-10-16T13:38:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24003a30 con 0x7f7c3015d9e0 2023-10-16T13:38:32.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c300cca90 con 0x7f7c3015d9e0 2023-10-16T13:38:32.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.722+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c300cc480 con 0x7f7c3015d9e0 2023-10-16T13:38:32.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7834013c60 con 0x7f784406d0c0 2023-10-16T13:38:32.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f782bfff700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783006afd0 0x7f783006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78340891c0 con 0x7f784406d0c0 2023-10-16T13:38:32.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 -- 172.21.15.5:0/2167768345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657808a700 msgr2=0x7f65780ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 --2- 172.21.15.5:0/2167768345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657808a700 0x7f65780ca450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f657806f4d0 tx=0x7f6568008c50 comp rx=0 tx=0).stop 2023-10-16T13:38:32.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 -- 172.21.15.5:0/2167768345 shutdown_connections 2023-10-16T13:38:32.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 --2- 172.21.15.5:0/2167768345 >> v2:172.21.15.5:3300/0 conn(0x7f657806d0c0 0x7f65780ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 --2- 172.21.15.5:0/2167768345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657808a700 0x7f65780ca450 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f657806f4d0 tx=0x7f6568008c50 comp rx=0 tx=0).stop 2023-10-16T13:38:32.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 -- 172.21.15.5:0/2167768345 >> 172.21.15.5:0/2167768345 conn(0x7f65780cf3f0 msgr2=0x7f65780cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 -- 172.21.15.5:0/2167768345 shutdown_connections 2023-10-16T13:38:32.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f657f64e700 1 -- 172.21.15.5:0/2167768345 wait complete. 2023-10-16T13:38:32.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7f7842ffd700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783006afd0 0x7f783006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f58ce7fc700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f58bc06af00 0x7f58bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58c8089930 con 0x7f58d8160330 2023-10-16T13:38:32.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f58dddb1700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f58bc06af00 0x7f58bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.723+0000 7f58dddb1700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f58bc06af00 0x7f58bc06d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f58d0007fd0 tx=0x7f58d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4011830 con 0x7fcc040c9fc0 2023-10-16T13:38:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf40119b0 con 0x7fcc040c9fc0 2023-10-16T13:38:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4011d60 con 0x7fcc040c9fc0 2023-10-16T13:38:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784404ebb0 con 0x7f784406d0c0 2023-10-16T13:38:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc040c4e20 con 0x7fcc040c9fc0 2023-10-16T13:38:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.724+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc04153790 con 0x7fcc040c9fc0 2023-10-16T13:38:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.725+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c0052f0 con 0x7f7c3015d9e0 2023-10-16T13:38:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.725+0000 7f657f64e700 1 Processor -- start 2023-10-16T13:38:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.725+0000 7f7842ffd700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783006afd0 0x7f783006d490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78440cf9f0 tx=0x7f783c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.725+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc040c4c80 con 0x7fcc040c9fc0 2023-10-16T13:38:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.725+0000 7f657f64e700 1 -- start start 2023-10-16T13:38:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657f64e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657806d0c0 0x7f657816d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657f64e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65780ccfa0 0x7f65780cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657f64e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65780a8530 0x7f65780a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657f64e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780cd960 con 0x7f657806d0c0 2023-10-16T13:38:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657f64e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780ac790 con 0x7f65780a8530 2023-10-16T13:38:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657f64e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780a99e0 con 0x7f65780ccfa0 2023-10-16T13:38:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657d3ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657806d0c0 0x7f657816d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657d3ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657806d0c0 0x7f657816d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42262/0 (socket says 172.21.15.5:42262) 2023-10-16T13:38:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657d3ea700 1 -- 172.21.15.5:0/3223594108 learned_addr learned my addr 172.21.15.5:0/3223594108 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657dbeb700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65780a8530 0x7f65780a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7f657cbe9700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65780ccfa0 0x7f65780cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.726+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbf401a400 con 0x7fcc040c9fc0 2023-10-16T13:38:32.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7f657dbeb700 1 -- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65780ccfa0 msgr2=0x7f65780cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7f657dbeb700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65780ccfa0 0x7f65780cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7f657dbeb700 1 -- 172.21.15.5:0/3223594108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657806d0c0 msgr2=0x7f657816d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7f657dbeb700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657806d0c0 0x7f657816d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7f657dbeb700 1 -- 172.21.15.5:0/3223594108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680085d0 con 0x7f65780a8530 2023-10-16T13:38:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7f657dbeb700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65780a8530 0x7f65780a89b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f657000cda0 tx=0x7f657000cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7fcbfa7fc700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcbe806afd0 0x7fcbe806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbf40896e0 con 0x7fcc040c9fc0 2023-10-16T13:38:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.727+0000 7fcc097bc700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcbe806afd0 0x7fcbe806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.728+0000 7fcc097bc700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcbe806afd0 0x7fcbe806d490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009b60 tx=0x7fcc00008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.728+0000 7f531ca22700 1 Processor -- start 2023-10-16T13:38:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.728+0000 7f531ca22700 1 -- start start 2023-10-16T13:38:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f531ca22700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f531806af50 0x7f5318071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f531ca22700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5318071ab0 con 0x7f53180cc3f0 2023-10-16T13:38:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f531ca22700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5318161bc0 con 0x7f5318161670 2023-10-16T13:38:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f531ca22700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5318161ea0 con 0x7f531806af50 2023-10-16T13:38:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f46b159a700 1 -- 172.21.15.5:0/3841516026 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac010070 con 0x7f46b4153ff0 2023-10-16T13:38:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f531659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f53180cc3f0 0x7f53180cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52274/0 (socket says 172.21.15.5:52274) 2023-10-16T13:38:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f531659c700 1 -- 172.21.15.5:0/2382033589 learned_addr learned my addr 172.21.15.5:0/2382033589 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f5315d9b700 1 --1- 172.21.15.5:0/2382033589 >> v1:172.21.15.112:6789/0 conn(0x7f5318161670 0x7f531806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:43252/0 (socket says 172.21.15.5:43252) 2023-10-16T13:38:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.729+0000 7f5316d9d700 1 --2- 172.21.15.5:0/2382033589 >> v2:172.21.15.112:3300/0 conn(0x7f531806af50 0x7f5318071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f5316d9d700 1 -- 172.21.15.5:0/2382033589 >> v1:172.21.15.112:6789/0 conn(0x7f5318161670 legacy=0x7f531806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f5316d9d700 1 -- 172.21.15.5:0/2382033589 >> v1:172.21.15.5:6789/0 conn(0x7f53180cc3f0 legacy=0x7f53180cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f5316d9d700 1 -- 172.21.15.5:0/2382033589 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5318162180 con 0x7f531806af50 2023-10-16T13:38:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58c80548c0 con 0x7f58d8160330 2023-10-16T13:38:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f46b159a700 1 -- 172.21.15.5:0/3841516026 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00dbe0 con 0x7f46b4153ff0 2023-10-16T13:38:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f46b159a700 1 -- 172.21.15.5:0/3841516026 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac016400 con 0x7f46b4153ff0 2023-10-16T13:38:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.730+0000 7f5316d9d700 1 --2- 172.21.15.5:0/2382033589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f531806af50 0x7f5318071f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5310009d90 tx=0x7f531000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a62993eb522958 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.731+0000 7f46b8917700 1 -- 172.21.15.5:0/3841516026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 msgr2=0x7f46b41543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.731+0000 7f46b8917700 1 --2- 172.21.15.5:0/3841516026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 0x7f46b41543d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00d180 tx=0x7f46ac00d490 comp rx=0 tx=0).stop 2023-10-16T13:38:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.731+0000 7f46b8917700 1 -- 172.21.15.5:0/3841516026 shutdown_connections 2023-10-16T13:38:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.731+0000 7f46b8917700 1 --2- 172.21.15.5:0/3841516026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b4153ff0 0x7f46b41543d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.731+0000 7f46b8917700 1 -- 172.21.15.5:0/3841516026 >> 172.21.15.5:0/3841516026 conn(0x7f46b406afb0 msgr2=0x7f46b40cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.731+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c24003b90 con 0x7f7c3015d9e0 2023-10-16T13:38:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.732+0000 7f7c1ffff700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c1406aed0 0x7f7c1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.732+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c24088530 con 0x7f7c3015d9e0 2023-10-16T13:38:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.732+0000 7f7c2e7fc700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c1406aed0 0x7f7c1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.732+0000 7f46b8917700 1 -- 172.21.15.5:0/3841516026 shutdown_connections 2023-10-16T13:38:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.732+0000 7f46b8917700 1 -- 172.21.15.5:0/3841516026 wait complete. 2023-10-16T13:38:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.733+0000 7f7c2e7fc700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c1406aed0 0x7f7c1406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c30071f40 tx=0x7f7c20009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.733+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc040c4c80 con 0x7fcc040c9fc0 2023-10-16T13:38:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657000ac80 con 0x7f65780a8530 2023-10-16T13:38:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000ae20 con 0x7f65780a8530 2023-10-16T13:38:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570015680 con 0x7f65780a8530 2023-10-16T13:38:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f531559a700 1 -- 172.21.15.5:0/2382033589 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000e070 con 0x7f531806af50 2023-10-16T13:38:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f531559a700 1 -- 172.21.15.5:0/2382033589 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531000bbd0 con 0x7f531806af50 2023-10-16T13:38:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f531559a700 1 -- 172.21.15.5:0/2382033589 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310012430 con 0x7f531806af50 2023-10-16T13:38:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78340542e0 con 0x7f784406d0c0 2023-10-16T13:38:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f46b8917700 1 Processor -- start 2023-10-16T13:38:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.735+0000 7f531ca22700 1 -- 172.21.15.5:0/2382033589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f531806af50 msgr2=0x7f5318071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.735+0000 7f531ca22700 1 --2- 172.21.15.5:0/2382033589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f531806af50 0x7f5318071f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5310009d90 tx=0x7f531000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65780a8ef0 con 0x7f65780a8530 2023-10-16T13:38:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.734+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65780ca6e0 con 0x7f65780a8530 2023-10-16T13:38:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.735+0000 7f531ca22700 1 -- 172.21.15.5:0/2382033589 shutdown_connections 2023-10-16T13:38:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.735+0000 7f531ca22700 1 --2- 172.21.15.5:0/2382033589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f531806af50 0x7f5318071f40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.735+0000 7f531ca22700 1 -- 172.21.15.5:0/2382033589 >> 172.21.15.5:0/2382033589 conn(0x7f531806dac0 msgr2=0x7f531806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.735+0000 7f46b8917700 1 -- start start 2023-10-16T13:38:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b8917700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46b4153ff0 0x7f46b4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b8917700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b415dac0 0x7f46b40c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b8917700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b415df40 0x7f46b41588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b8917700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b415a400 con 0x7f46b415dac0 2023-10-16T13:38:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b8917700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41529b0 con 0x7f46b4153ff0 2023-10-16T13:38:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b8917700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40c83e0 con 0x7f46b415df40 2023-10-16T13:38:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46b4153ff0 0x7f46b4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46b4153ff0 0x7f46b4152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38174/0 (socket says 172.21.15.5:38174) 2023-10-16T13:38:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.736+0000 7f46b259c700 1 -- 172.21.15.5:0/1021879617 learned_addr learned my addr 172.21.15.5:0/1021879617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b1d9b700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b415dac0 0x7f46b40c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c24053750 con 0x7f7c3015d9e0 2023-10-16T13:38:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b2d9d700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b415df40 0x7f46b41588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b2d9d700 1 -- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46b4153ff0 msgr2=0x7f46b4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b2d9d700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46b4153ff0 0x7f46b4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b2d9d700 1 -- 172.21.15.5:0/1021879617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b415dac0 msgr2=0x7f46b40c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b2d9d700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b415dac0 0x7f46b40c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f46b2d9d700 1 -- 172.21.15.5:0/1021879617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac00bd40 con 0x7f46b415df40 2023-10-16T13:38:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.738+0000 7f46b2d9d700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b415df40 0x7f46b41588f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c390 tx=0x7f46a800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.737+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f65700157e0 con 0x7f65780a8530 2023-10-16T13:38:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.738+0000 7f656dffb700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f655c06af00 0x7f655c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.738+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65700898f0 con 0x7f65780a8530 2023-10-16T13:38:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.739+0000 7f657d3ea700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f655c06af00 0x7f655c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.739+0000 7f657d3ea700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f655c06af00 0x7f655c06d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f656800d220 tx=0x7f656801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.747+0000 7f531ca22700 1 -- 172.21.15.5:0/2382033589 shutdown_connections 2023-10-16T13:38:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.748+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80052d0 con 0x7f46b415df40 2023-10-16T13:38:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.748+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a8005430 con 0x7f46b415df40 2023-10-16T13:38:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.748+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80038c0 con 0x7f46b415df40 2023-10-16T13:38:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.748+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b40c86c0 con 0x7f46b415df40 2023-10-16T13:38:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.748+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b40c8c80 con 0x7f46b415df40 2023-10-16T13:38:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.748+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657804ebb0 con 0x7f65780a8530 2023-10-16T13:38:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.749+0000 7f531ca22700 1 -- 172.21.15.5:0/2382033589 wait complete. 2023-10-16T13:38:32.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.751+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46a8003a20 con 0x7f46b415df40 2023-10-16T13:38:32.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.751+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b415a5b0 con 0x7f46b415df40 2023-10-16T13:38:32.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.751+0000 7f531ca22700 1 Processor -- start 2023-10-16T13:38:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.751+0000 7f531ca22700 1 -- start start 2023-10-16T13:38:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.751+0000 7f46a2ffd700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f469406afd0 0x7f469406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.751+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46a80888f0 con 0x7f46b415df40 2023-10-16T13:38:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.752+0000 7f46b259c700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f469406afd0 0x7f469406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.752+0000 7f46b259c700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f469406afd0 0x7f469406d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00d4d0 tx=0x7f46ac012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.752+0000 7f531ca22700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 0x7f5318155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.752+0000 7f531ca22700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53180cc3f0 0x7f53180b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531ca22700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5318161670 0x7f531815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531ca22700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5318156150 con 0x7f531806af50 2023-10-16T13:38:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531ca22700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53181586f0 con 0x7f5318161670 2023-10-16T13:38:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531ca22700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53181589d0 con 0x7f53180cc3f0 2023-10-16T13:38:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 0x7f5318155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 0x7f5318155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42290/0 (socket says 172.21.15.5:42290) 2023-10-16T13:38:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 -- 172.21.15.5:0/491602807 learned_addr learned my addr 172.21.15.5:0/491602807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f5315d9b700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53180cc3f0 0x7f53180b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f5316d9d700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5318161670 0x7f531815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 -- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53180cc3f0 msgr2=0x7f53180b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53180cc3f0 0x7f53180b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 -- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5318161670 msgr2=0x7f531815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5318161670 0x7f531815f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 -- 172.21.15.5:0/491602807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310009a70 con 0x7f531806af50 2023-10-16T13:38:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f531659c700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 0x7f5318155940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f530800c520 tx=0x7f530800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.753+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308005d70 con 0x7f531806af50 2023-10-16T13:38:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.754+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080070d0 con 0x7f531806af50 2023-10-16T13:38:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.754+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53180cd060 con 0x7f531806af50 2023-10-16T13:38:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.757+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46b415a5b0 con 0x7f46b415df40 2023-10-16T13:38:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.754+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5318158f90 con 0x7f531806af50 2023-10-16T13:38:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.754+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308007440 con 0x7f531806af50 2023-10-16T13:38:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.756+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53080075a0 con 0x7f531806af50 2023-10-16T13:38:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.756+0000 7f5306ffd700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52f806af00 0x7f52f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.756+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5308088950 con 0x7f531806af50 2023-10-16T13:38:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.756+0000 7f5315d9b700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52f806af00 0x7f52f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.757+0000 7f5315d9b700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52f806af00 0x7f52f806d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53181558f0 tx=0x7f530c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.755+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f657001a080 con 0x7f65780a8530 2023-10-16T13:38:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.766+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc0052f0 con 0x7f531806af50 2023-10-16T13:38:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:32.780+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5308053a30 con 0x7f531806af50 2023-10-16T13:38:33.107 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.100+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f781c0055a0 con 0x7f7838166620 2023-10-16T13:38:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.101+0000 7f78357fa700 1 -- 172.21.15.5:0/2235420769 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7830001ad0 con 0x7f7838166620 2023-10-16T13:38:33.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.104+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f782406b5e0 msgr2=0x7f782406daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.104+0000 7f783e9a0700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f782406b5e0 0x7f782406daa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7820000f60 tx=0x7f7820007a00 comp rx=0 tx=0).stop 2023-10-16T13:38:33.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 msgr2=0x7f78380af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 0x7f78380af590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f783001dad0 tx=0x7f783001de90 comp rx=0 tx=0).stop 2023-10-16T13:38:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 shutdown_connections 2023-10-16T13:38:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7838166620 0x7f78380af590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f782406b5e0 0x7f782406daa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78380c2840 0x7f7838159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 --2- 172.21.15.5:0/2235420769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78380ce3a0 0x7f78380c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 >> 172.21.15.5:0/2235420769 conn(0x7f78380cf3f0 msgr2=0x7f783806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 shutdown_connections 2023-10-16T13:38:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.105+0000 7f783e9a0700 1 -- 172.21.15.5:0/2235420769 wait complete. 2023-10-16T13:38:33.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-16T13:38:33.126 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.137+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcc040c4c80 con 0x7fcc040c9fc0 2023-10-16T13:38:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.137+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f78440c2ea0 con 0x7f784406d0c0 2023-10-16T13:38:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.138+0000 7fcbfa7fc700 1 -- 172.21.15.5:0/2152946713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc040c4c80 con 0x7fcc040c9fc0 2023-10-16T13:38:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.138+0000 7f782bfff700 1 -- 172.21.15.5:0/4200464256 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7834021090 con 0x7f784406d0c0 2023-10-16T13:38:33.141 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:33.142 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-10-16T13:38:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783006afd0 msgr2=0x7f783006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783006afd0 0x7f783006d490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78440cf9f0 tx=0x7f783c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784406d0c0 msgr2=0x7f78440c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784406d0c0 0x7f78440c64c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f783400e7e0 tx=0x7f783400eba0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 shutdown_connections 2023-10-16T13:38:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783006afd0 0x7f783006d490 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78440cf9f0 tx=0x7f783c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7844157250 0x7f78440c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784406d0c0 0x7f78440c64c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 --2- 172.21.15.5:0/4200464256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78440cff10 0x7f78440c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.140+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 >> 172.21.15.5:0/4200464256 conn(0x7f78440cf3f0 msgr2=0x7f78440ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.141+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 shutdown_connections 2023-10-16T13:38:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.141+0000 7f784a081700 1 -- 172.21.15.5:0/4200464256 wait complete. 2023-10-16T13:38:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.141+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcbe806afd0 msgr2=0x7fcbe806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.141+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcbe806afd0 0x7fcbe806d490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009b60 tx=0x7fcc00008030 comp rx=0 tx=0).stop 2023-10-16T13:38:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.141+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 msgr2=0x7fcc04153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.141+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 0x7fcc04153250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400b560 tx=0x7fcbf400b920 comp rx=0 tx=0).stop 2023-10-16T13:38:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.143+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 shutdown_connections 2023-10-16T13:38:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.143+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc0415a4e0 0x7fcc04071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.143+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc040c9fc0 0x7fcc04153250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.143+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcbe806afd0 0x7fcbe806d490 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.143+0000 7fcc0c221700 1 --2- 172.21.15.5:0/2152946713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc04157250 0x7fcc04070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.143+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 >> 172.21.15.5:0/2152946713 conn(0x7fcc040cf3f0 msgr2=0x7fcc040cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.144+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58c00055a0 con 0x7f58d8160330 2023-10-16T13:38:33.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.144+0000 7f58ce7fc700 1 -- 172.21.15.5:0/767482164 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58c8057ee0 con 0x7f58d8160330 2023-10-16T13:38:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.146+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 shutdown_connections 2023-10-16T13:38:33.149 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.148+0000 7fcc0c221700 1 -- 172.21.15.5:0/2152946713 wait complete. 2023-10-16T13:38:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.150+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f58bc06af00 msgr2=0x7f58bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.150+0000 7f58e0015700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f58bc06af00 0x7f58bc06d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f58d0007fd0 tx=0x7f58d0009040 comp rx=0 tx=0).stop 2023-10-16T13:38:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.150+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8160330 msgr2=0x7f58d8162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.150+0000 7f58e0015700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8160330 0x7f58d8162b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58d80c6470 tx=0x7f58c8011860 comp rx=0 tx=0).stop 2023-10-16T13:38:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.151+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 shutdown_connections 2023-10-16T13:38:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.151+0000 7f58e0015700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d80b1fe0 0x7f58d80b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.151+0000 7f58e0015700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58d815ff50 0x7f58d81fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.151+0000 7f58e0015700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f58bc06af00 0x7f58bc06d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.151+0000 7f58e0015700 1 --2- 172.21.15.5:0/767482164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58d8160330 0x7f58d8162b70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.151+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 >> 172.21.15.5:0/767482164 conn(0x7f58d80cf3f0 msgr2=0x7f58d80739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.152+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7c0c005870 con 0x7f7c3015d9e0 2023-10-16T13:38:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.153+0000 7f7c1ffff700 1 -- 172.21.15.5:0/268909639 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c24017020 con 0x7f7c3015d9e0 2023-10-16T13:38:33.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-16T13:38:33.158 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.160 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-10-16T13:38:33.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.160+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c1406aed0 msgr2=0x7f7c1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.160+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c1406aed0 0x7f7c1406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c30071f40 tx=0x7f7c20009190 comp rx=0 tx=0).stop 2023-10-16T13:38:33.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.160+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015d9e0 msgr2=0x7f7c301ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.160+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015d9e0 0x7f7c301ffc70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400c750 tx=0x7f7c2400ca60 comp rx=0 tx=0).stop 2023-10-16T13:38:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 shutdown_connections 2023-10-16T13:38:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c30161d40 0x7f7c3006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c1406aed0 0x7f7c1406d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c3015d9e0 0x7f7c301ffc70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 --2- 172.21.15.5:0/268909639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c3015ddc0 0x7f7c30160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 >> 172.21.15.5:0/268909639 conn(0x7f7c3009cb40 msgr2=0x7f7c300b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 shutdown_connections 2023-10-16T13:38:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.161+0000 7f7c35a5a700 1 -- 172.21.15.5:0/268909639 wait complete. 2023-10-16T13:38:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.162+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 shutdown_connections 2023-10-16T13:38:33.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.164+0000 7f58e0015700 1 -- 172.21.15.5:0/767482164 wait complete. 2023-10-16T13:38:33.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.164+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f65780718b0 con 0x7f65780a8530 2023-10-16T13:38:33.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.165+0000 7f656dffb700 1 -- 172.21.15.5:0/3223594108 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65700549b0 con 0x7f65780a8530 2023-10-16T13:38:33.168 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-10-16T13:38:33.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.166+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46b415a570 con 0x7f46b415df40 2023-10-16T13:38:33.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.168+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f655c06af00 msgr2=0x7f655c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.168+0000 7f657f64e700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f655c06af00 0x7f655c06d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f656800d220 tx=0x7f656801c040 comp rx=0 tx=0).stop 2023-10-16T13:38:33.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.168+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65780a8530 msgr2=0x7f65780a89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.168+0000 7f657f64e700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65780a8530 0x7f65780a89b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f657000cda0 tx=0x7f657000cdd0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-16T13:38:33.172 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 shutdown_connections 2023-10-16T13:38:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65780a8530 0x7f65780a89b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657806d0c0 0x7f657816d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f655c06af00 0x7f655c06d3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 --2- 172.21.15.5:0/3223594108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65780ccfa0 0x7f65780cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 >> 172.21.15.5:0/3223594108 conn(0x7f65780cf3f0 msgr2=0x7f6578071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 shutdown_connections 2023-10-16T13:38:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.174+0000 7f657f64e700 1 -- 172.21.15.5:0/3223594108 wait complete. 2023-10-16T13:38:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.176+0000 7f46a2ffd700 1 -- 172.21.15.5:0/1021879617 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46a8017020 con 0x7f46b415df40 2023-10-16T13:38:33.180 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-10-16T13:38:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f469406afd0 msgr2=0x7f469406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f469406afd0 0x7f469406d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00d4d0 tx=0x7f46ac012000 comp rx=0 tx=0).stop 2023-10-16T13:38:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b415df40 msgr2=0x7f46b41588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b415df40 0x7f46b41588f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c390 tx=0x7f46a800c6a0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 shutdown_connections 2023-10-16T13:38:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f469406afd0 0x7f469406d490 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46b415df40 0x7f46b41588f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46b4153ff0 0x7f46b4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 --2- 172.21.15.5:0/1021879617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b415dac0 0x7f46b40c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.178+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 >> 172.21.15.5:0/1021879617 conn(0x7f46b406afb0 msgr2=0x7f46b40ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.179+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 shutdown_connections 2023-10-16T13:38:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.179+0000 7f46b8917700 1 -- 172.21.15.5:0/1021879617 wait complete. 2023-10-16T13:38:33.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-16T13:38:33.185 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-16T13:38:33.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.183+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52fc005870 con 0x7f531806af50 2023-10-16T13:38:33.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.184+0000 7f5306ffd700 1 -- 172.21.15.5:0/491602807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5308017020 con 0x7f531806af50 2023-10-16T13:38:33.187 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.187 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-10-16T13:38:33.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.186+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52f806af00 msgr2=0x7f52f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.186+0000 7f531ca22700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52f806af00 0x7f52f806d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53181558f0 tx=0x7f530c007eb0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.186+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 msgr2=0x7f5318155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.186+0000 7f531ca22700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 0x7f5318155940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f530800c520 tx=0x7f530800c830 comp rx=0 tx=0).stop 2023-10-16T13:38:33.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 shutdown_connections 2023-10-16T13:38:33.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5318161670 0x7f531815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f531806af50 0x7f5318155940 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52f806af00 0x7f52f806d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 --2- 172.21.15.5:0/491602807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53180cc3f0 0x7f53180b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 >> 172.21.15.5:0/491602807 conn(0x7f531806dac0 msgr2=0x7f53180b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 shutdown_connections 2023-10-16T13:38:33.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.188+0000 7f531ca22700 1 -- 172.21.15.5:0/491602807 wait complete. 2023-10-16T13:38:33.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-16T13:38:33.193 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-10-16T13:38:33.198 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-16T13:38:33.204 DEBUG:teuthology.parallel:result is None 2023-10-16T13:38:33.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T13:38:33.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.367+0000 7f2861c49700 1 Processor -- start 2023-10-16T13:38:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.367+0000 7f2861c49700 1 -- start start 2023-10-16T13:38:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f2861c49700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 0x7f285c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f2861c49700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f285c0b28b0 0x7f285c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f2861c49700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0b3530 con 0x7f285c15f130 2023-10-16T13:38:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f2861c49700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0cde00 con 0x7f285c0b28b0 2023-10-16T13:38:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f2861c49700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0cd180 con 0x7f285c06af50 2023-10-16T13:38:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f285c15f130 0x7f285c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52300/0 (socket says 172.21.15.5:52300) 2023-10-16T13:38:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285b7fe700 1 -- 172.21.15.5:0/3196259321 learned_addr learned my addr 172.21.15.5:0/3196259321 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285affd700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 0x7f285c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285bfff700 1 --2- 172.21.15.5:0/3196259321 >> v2:172.21.15.112:3300/0 conn(0x7f285c0b28b0 0x7f285c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848015469 0 0) 0x7f285c0b3530 con 0x7f285c15f130 2023-10-16T13:38:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28440035b0 con 0x7f285c15f130 2023-10-16T13:38:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1806506351 0 0) 0x7f28440035b0 con 0x7f285c15f130 2023-10-16T13:38:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 msgr2=0x7f285c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 0x7f285c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 >> v2:172.21.15.112:3300/0 conn(0x7f285c0b28b0 msgr2=0x7f285c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 --2- 172.21.15.5:0/3196259321 >> v2:172.21.15.112:3300/0 conn(0x7f285c0b28b0 0x7f285c0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0cd460 con 0x7f285c15f130 2023-10-16T13:38:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f284c001670 con 0x7f285c15f130 2023-10-16T13:38:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 >> v1:172.21.15.5:6789/0 conn(0x7f285c15f130 legacy=0x7f285c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 0x7f2844003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844003f80 0x7f2844004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2844004d90 0x7f2844005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0cde00 con 0x7f2844003f80 2023-10-16T13:38:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0cd180 con 0x7f2844004d90 2023-10-16T13:38:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.368+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284400ba10 con 0x7f285c06af50 2023-10-16T13:38:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844003f80 0x7f2844004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285b7fe700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 0x7f2844003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285bfff700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2844004d90 0x7f2844005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 -- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 msgr2=0x7f2844003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f285c06af50 0x7f2844003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 -- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2844004d90 msgr2=0x7f2844005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2844004d90 0x7f2844005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 -- 172.21.15.5:0/3196259321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440035b0 con 0x7f2844003f80 2023-10-16T13:38:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285bfff700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2844004d90 0x7f2844005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285affd700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844003f80 0x7f2844004850 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2850009b40 tx=0x7f2844005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5632590aae4d62a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850005a20 con 0x7f2844003f80 2023-10-16T13:38:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850005b80 con 0x7f2844003f80 2023-10-16T13:38:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.369+0000 7f285a7fc700 1 -- 172.21.15.5:0/3196259321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000e660 con 0x7f2844003f80 2023-10-16T13:38:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f2861c49700 1 -- 172.21.15.5:0/3196259321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844003f80 msgr2=0x7f2844004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f2861c49700 1 --2- 172.21.15.5:0/3196259321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844003f80 0x7f2844004850 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2850009b40 tx=0x7f2844005880 comp rx=0 tx=0).stop 2023-10-16T13:38:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f285bfff700 1 -- 172.21.15.5:0/3196259321 reap_dead start 2023-10-16T13:38:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f2861c49700 1 -- 172.21.15.5:0/3196259321 shutdown_connections 2023-10-16T13:38:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f2861c49700 1 -- 172.21.15.5:0/3196259321 >> 172.21.15.5:0/3196259321 conn(0x7f285c06dae0 msgr2=0x7f285c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f2861c49700 1 -- 172.21.15.5:0/3196259321 shutdown_connections 2023-10-16T13:38:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.370+0000 7f2861c49700 1 -- 172.21.15.5:0/3196259321 wait complete. 2023-10-16T13:38:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.371+0000 7f2861c49700 1 Processor -- start 2023-10-16T13:38:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.371+0000 7f2861c49700 1 -- start start 2023-10-16T13:38:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2861c49700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2844003f80 0x7f285c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2861c49700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285c149280 0x7f285c14b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2861c49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 0x7f285c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2861c49700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0af580 con 0x7f285c1498b0 2023-10-16T13:38:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2861c49700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0ad820 con 0x7f285c149280 2023-10-16T13:38:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2861c49700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c14be80 con 0x7f2844003f80 2023-10-16T13:38:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 0x7f285c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 0x7f285c0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42312/0 (socket says 172.21.15.5:42312) 2023-10-16T13:38:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 -- 172.21.15.5:0/3188172748 learned_addr learned my addr 172.21.15.5:0/3188172748 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285affd700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285c149280 0x7f285c14b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285b7fe700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2844003f80 0x7f285c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 -- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2844003f80 msgr2=0x7f285c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2844003f80 0x7f285c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 -- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285c149280 msgr2=0x7f285c14b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285c149280 0x7f285c14b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 -- 172.21.15.5:0/3188172748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0c5260 con 0x7f285c1498b0 2023-10-16T13:38:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285affd700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285c149280 0x7f285c14b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f285bfff700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 0x7f285c0b18d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f285c0d1560 tx=0x7f28540104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.372+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285401b070 con 0x7f285c1498b0 2023-10-16T13:38:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.373+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285400f040 con 0x7f285c1498b0 2023-10-16T13:38:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.373+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400e050 con 0x7f285c1498b0 2023-10-16T13:38:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.373+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c14c070 con 0x7f285c1498b0 2023-10-16T13:38:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.373+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c14c630 con 0x7f285c1498b0 2023-10-16T13:38:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.374+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0c53f0 con 0x7f285c1498b0 2023-10-16T13:38:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.374+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2854015440 con 0x7f285c1498b0 2023-10-16T13:38:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.375+0000 7f2843fff700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f284806af00 0x7f284806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.375+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28540897b0 con 0x7f285c1498b0 2023-10-16T13:38:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.375+0000 7f285b7fe700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f284806af00 0x7f284806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.375+0000 7f285b7fe700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f284806af00 0x7f284806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f284c000c00 tx=0x7f284c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.379+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28540548f0 con 0x7f285c1498b0 2023-10-16T13:38:33.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.576+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f285c0c5050 con 0x7f284806af00 2023-10-16T13:38:33.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.584+0000 7f2843fff700 1 -- 172.21.15.5:0/3188172748 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7f284c007030 con 0x7f284806af00 2023-10-16T13:38:33.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:33.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.587+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f284806af00 msgr2=0x7f284806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.587+0000 7f2861c49700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f284806af00 0x7f284806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f284c000c00 tx=0x7f284c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:33.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.587+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 msgr2=0x7f285c0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.587+0000 7f2861c49700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 0x7f285c0b18d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f285c0d1560 tx=0x7f28540104a0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 shutdown_connections 2023-10-16T13:38:33.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285c1498b0 0x7f285c0b18d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f284806af00 0x7f284806d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2844003f80 0x7f285c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 --2- 172.21.15.5:0/3188172748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285c149280 0x7f285c14b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 >> 172.21.15.5:0/3188172748 conn(0x7f285c06dae0 msgr2=0x7f285c0d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 shutdown_connections 2023-10-16T13:38:33.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.588+0000 7f2861c49700 1 -- 172.21.15.5:0/3188172748 wait complete. 2023-10-16T13:38:33.595 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:33.603 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-16T13:38:33.459652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2883584,"data_stored":1750702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003307"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312791+0000","last_change":"2023-10-16T13:38:19.985659+0000","last_active":"2023-10-16T13:38:21.312791+0000","last_peered":"2023-10-16T13:38:21.312791+0000","last_clean":"2023-10-16T13:38:21.312791+0000","last_became_active":"2023-10-16T13:38:19.985250+0000","last_became_peered":"2023-10-16T13:38:19.985250+0000","last_unstale":"2023-10-16T13:38:21.312791+0000","last_undegraded":"2023-10-16T13:38:21.312791+0000","last_fullsized":"2023-10-16T13:38:21.312791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:21:57.591824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988596+0000","last_change":"2023-10-16T13:38:19.985144+0000","last_active":"2023-10-16T13:38:20.988596+0000","last_peered":"2023-10-16T13:38:20.988596+0000","last_clean":"2023-10-16T13:38:20.988596+0000","last_became_active":"2023-10-16T13:38:19.984801+0000","last_became_peered":"2023-10-16T13:38:19.984801+0000","last_unstale":"2023-10-16T13:38:20.988596+0000","last_undegraded":"2023-10-16T13:38:20.988596+0000","last_fullsized":"2023-10-16T13:38:20.988596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417314+0000","last_change":"2023-10-16T13:38:19.992389+0000","last_active":"2023-10-16T13:38:21.417314+0000","last_peered":"2023-10-16T13:38:21.417314+0000","last_clean":"2023-10-16T13:38:21.417314+0000","last_became_active":"2023-10-16T13:38:19.991965+0000","last_became_peered":"2023-10-16T13:38:19.991965+0000","last_unstale":"2023-10-16T13:38:21.417314+0000","last_undegraded":"2023-10-16T13:38:21.417314+0000","last_fullsized":"2023-10-16T13:38:21.417314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996709+0000","last_change":"2023-10-16T13:38:19.994269+0000","last_active":"2023-10-16T13:38:20.996709+0000","last_peered":"2023-10-16T13:38:20.996709+0000","last_clean":"2023-10-16T13:38:20.996709+0000","last_became_active":"2023-10-16T13:38:19.989727+0000","last_became_peered":"2023-10-16T13:38:19.989727+0000","last_unstale":"2023-10-16T13:38:20.996709+0000","last_undegraded":"2023-10-16T13:38:20.996709+0000","last_fullsized":"2023-10-16T13:38:20.996709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312381+0000","last_change":"2023-10-16T13:38:19.988406+0000","last_active":"2023-10-16T13:38:21.312381+0000","last_peered":"2023-10-16T13:38:21.312381+0000","last_clean":"2023-10-16T13:38:21.312381+0000","last_became_active":"2023-10-16T13:38:19.985680+0000","last_became_peered":"2023-10-16T13:38:19.985680+0000","last_unstale":"2023-10-16T13:38:21.312381+0000","last_undegraded":"2023-10-16T13:38:21.312381+0000","last_fullsized":"2023-10-16T13:38:21.312381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996738+0000","last_change":"2023-10-16T13:38:19.997527+0000","last_active":"2023-10-16T13:38:20.996738+0000","last_peered":"2023-10-16T13:38:20.996738+0000","last_clean":"2023-10-16T13:38:20.996738+0000","last_became_active":"2023-10-16T13:38:19.997232+0000","last_became_peered":"2023-10-16T13:38:19.997232+0000","last_unstale":"2023-10-16T13:38:20.996738+0000","last_undegraded":"2023-10-16T13:38:20.996738+0000","last_fullsized":"2023-10-16T13:38:20.996738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312178+0000","last_change":"2023-10-16T13:38:19.994384+0000","last_active":"2023-10-16T13:38:21.312178+0000","last_peered":"2023-10-16T13:38:21.312178+0000","last_clean":"2023-10-16T13:38:21.312178+0000","last_became_active":"2023-10-16T13:38:19.993971+0000","last_became_peered":"2023-10-16T13:38:19.993971+0000","last_unstale":"2023-10-16T13:38:21.312178+0000","last_undegraded":"2023-10-16T13:38:21.312178+0000","last_fullsized":"2023-10-16T13:38:21.312178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397908+0000","last_change":"2023-10-16T13:38:19.995124+0000","last_active":"2023-10-16T13:38:21.397908+0000","last_peered":"2023-10-16T13:38:21.397908+0000","last_clean":"2023-10-16T13:38:21.397908+0000","last_became_active":"2023-10-16T13:38:19.994763+0000","last_became_peered":"2023-10-16T13:38:19.994763+0000","last_unstale":"2023-10-16T13:38:21.397908+0000","last_undegraded":"2023-10-16T13:38:21.397908+0000","last_fullsized":"2023-10-16T13:38:21.397908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312737+0000","last_change":"2023-10-16T13:38:19.992050+0000","last_active":"2023-10-16T13:38:21.312737+0000","last_peered":"2023-10-16T13:38:21.312737+0000","last_clean":"2023-10-16T13:38:21.312737+0000","last_became_active":"2023-10-16T13:38:19.991296+0000","last_became_peered":"2023-10-16T13:38:19.991296+0000","last_unstale":"2023-10-16T13:38:21.312737+0000","last_undegraded":"2023-10-16T13:38:21.312737+0000","last_fullsized":"2023-10-16T13:38:21.312737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:16.455246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876286+0000","last_change":"2023-10-16T13:38:19.998323+0000","last_active":"2023-10-16T13:38:21.876286+0000","last_peered":"2023-10-16T13:38:21.876286+0000","last_clean":"2023-10-16T13:38:21.876286+0000","last_became_active":"2023-10-16T13:38:19.998022+0000","last_became_peered":"2023-10-16T13:38:19.998022+0000","last_unstale":"2023-10-16T13:38:21.876286+0000","last_undegraded":"2023-10-16T13:38:21.876286+0000","last_fullsized":"2023-10-16T13:38:21.876286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876144+0000","last_change":"2023-10-16T13:38:19.998317+0000","last_active":"2023-10-16T13:38:21.876144+0000","last_peered":"2023-10-16T13:38:21.876144+0000","last_clean":"2023-10-16T13:38:21.876144+0000","last_became_active":"2023-10-16T13:38:19.998043+0000","last_became_peered":"2023-10-16T13:38:19.998043+0000","last_unstale":"2023-10-16T13:38:21.876144+0000","last_undegraded":"2023-10-16T13:38:21.876144+0000","last_fullsized":"2023-10-16T13:38:21.876144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997767+0000","last_change":"2023-10-16T13:38:19.985697+0000","last_active":"2023-10-16T13:38:20.997767+0000","last_peered":"2023-10-16T13:38:20.997767+0000","last_clean":"2023-10-16T13:38:20.997767+0000","last_became_active":"2023-10-16T13:38:19.985438+0000","last_became_peered":"2023-10-16T13:38:19.985438+0000","last_unstale":"2023-10-16T13:38:20.997767+0000","last_undegraded":"2023-10-16T13:38:20.997767+0000","last_fullsized":"2023-10-16T13:38:20.997767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:17.751681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398231+0000","last_change":"2023-10-16T13:38:19.984535+0000","last_active":"2023-10-16T13:38:21.398231+0000","last_peered":"2023-10-16T13:38:21.398231+0000","last_clean":"2023-10-16T13:38:21.398231+0000","last_became_active":"2023-10-16T13:38:19.984237+0000","last_became_peered":"2023-10-16T13:38:19.984237+0000","last_unstale":"2023-10-16T13:38:21.398231+0000","last_undegraded":"2023-10-16T13:38:21.398231+0000","last_fullsized":"2023-10-16T13:38:21.398231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417158+0000","last_change":"2023-10-16T13:38:19.992598+0000","last_active":"2023-10-16T13:38:21.417158+0000","last_peered":"2023-10-16T13:38:21.417158+0000","last_clean":"2023-10-16T13:38:21.417158+0000","last_became_active":"2023-10-16T13:38:19.990440+0000","last_became_peered":"2023-10-16T13:38:19.990440+0000","last_unstale":"2023-10-16T13:38:21.417158+0000","last_undegraded":"2023-10-16T13:38:21.417158+0000","last_fullsized":"2023-10-16T13:38:21.417158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988246+0000","last_change":"2023-10-16T13:38:19.994076+0000","last_active":"2023-10-16T13:38:20.988246+0000","last_peered":"2023-10-16T13:38:20.988246+0000","last_clean":"2023-10-16T13:38:20.988246+0000","last_became_active":"2023-10-16T13:38:19.993816+0000","last_became_peered":"2023-10-16T13:38:19.993816+0000","last_unstale":"2023-10-16T13:38:20.988246+0000","last_undegraded":"2023-10-16T13:38:20.988246+0000","last_fullsized":"2023-10-16T13:38:20.988246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996244+0000","last_change":"2023-10-16T13:38:19.997326+0000","last_active":"2023-10-16T13:38:20.996244+0000","last_peered":"2023-10-16T13:38:20.996244+0000","last_clean":"2023-10-16T13:38:20.996244+0000","last_became_active":"2023-10-16T13:38:19.997047+0000","last_became_peered":"2023-10-16T13:38:19.997047+0000","last_unstale":"2023-10-16T13:38:20.996244+0000","last_undegraded":"2023-10-16T13:38:20.996244+0000","last_fullsized":"2023-10-16T13:38:20.996244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997157+0000","last_change":"2023-10-16T13:38:19.990024+0000","last_active":"2023-10-16T13:38:20.997157+0000","last_peered":"2023-10-16T13:38:20.997157+0000","last_clean":"2023-10-16T13:38:20.997157+0000","last_became_active":"2023-10-16T13:38:19.989585+0000","last_became_peered":"2023-10-16T13:38:19.989585+0000","last_unstale":"2023-10-16T13:38:20.997157+0000","last_undegraded":"2023-10-16T13:38:20.997157+0000","last_fullsized":"2023-10-16T13:38:20.997157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821413+0000","last_change":"2023-10-16T13:38:19.985061+0000","last_active":"2023-10-16T13:38:21.821413+0000","last_peered":"2023-10-16T13:38:21.821413+0000","last_clean":"2023-10-16T13:38:21.821413+0000","last_became_active":"2023-10-16T13:38:19.984723+0000","last_became_peered":"2023-10-16T13:38:19.984723+0000","last_unstale":"2023-10-16T13:38:21.821413+0000","last_undegraded":"2023-10-16T13:38:21.821413+0000","last_fullsized":"2023-10-16T13:38:21.821413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:40.348223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312495+0000","last_change":"2023-10-16T13:38:19.986577+0000","last_active":"2023-10-16T13:38:21.312495+0000","last_peered":"2023-10-16T13:38:21.312495+0000","last_clean":"2023-10-16T13:38:21.312495+0000","last_became_active":"2023-10-16T13:38:19.986061+0000","last_became_peered":"2023-10-16T13:38:19.986061+0000","last_unstale":"2023-10-16T13:38:21.312495+0000","last_undegraded":"2023-10-16T13:38:21.312495+0000","last_fullsized":"2023-10-16T13:38:21.312495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.008095+0000","last_change":"2023-10-16T13:38:18.965787+0000","last_active":"2023-10-16T13:38:20.008095+0000","last_peered":"2023-10-16T13:38:20.008095+0000","last_clean":"2023-10-16T13:38:20.008095+0000","last_became_active":"2023-10-16T13:38:18.965323+0000","last_became_peered":"2023-10-16T13:38:18.965323+0000","last_unstale":"2023-10-16T13:38:20.008095+0000","last_undegraded":"2023-10-16T13:38:20.008095+0000","last_fullsized":"2023-10-16T13:38:20.008095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398158+0000","last_change":"2023-10-16T13:38:19.985506+0000","last_active":"2023-10-16T13:38:21.398158+0000","last_peered":"2023-10-16T13:38:21.398158+0000","last_clean":"2023-10-16T13:38:21.398158+0000","last_became_active":"2023-10-16T13:38:19.985155+0000","last_became_peered":"2023-10-16T13:38:19.985155+0000","last_unstale":"2023-10-16T13:38:21.398158+0000","last_undegraded":"2023-10-16T13:38:21.398158+0000","last_fullsized":"2023-10-16T13:38:21.398158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002649+0000","last_change":"2023-10-16T13:38:18.965668+0000","last_active":"2023-10-16T13:38:20.002649+0000","last_peered":"2023-10-16T13:38:20.002649+0000","last_clean":"2023-10-16T13:38:20.002649+0000","last_became_active":"2023-10-16T13:38:18.965214+0000","last_became_peered":"2023-10-16T13:38:18.965214+0000","last_unstale":"2023-10-16T13:38:20.002649+0000","last_undegraded":"2023-10-16T13:38:20.002649+0000","last_fullsized":"2023-10-16T13:38:20.002649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417258+0000","last_change":"2023-10-16T13:38:19.997063+0000","last_active":"2023-10-16T13:38:21.417258+0000","last_peered":"2023-10-16T13:38:21.417258+0000","last_clean":"2023-10-16T13:38:21.417258+0000","last_became_active":"2023-10-16T13:38:19.996754+0000","last_became_peered":"2023-10-16T13:38:19.996754+0000","last_unstale":"2023-10-16T13:38:21.417258+0000","last_undegraded":"2023-10-16T13:38:21.417258+0000","last_fullsized":"2023-10-16T13:38:21.417258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000617+0000","last_change":"2023-10-16T13:38:18.968962+0000","last_active":"2023-10-16T13:38:20.000617+0000","last_peered":"2023-10-16T13:38:20.000617+0000","last_clean":"2023-10-16T13:38:20.000617+0000","last_became_active":"2023-10-16T13:38:18.968414+0000","last_became_peered":"2023-10-16T13:38:18.968414+0000","last_unstale":"2023-10-16T13:38:20.000617+0000","last_undegraded":"2023-10-16T13:38:20.000617+0000","last_fullsized":"2023-10-16T13:38:20.000617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:42.951075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997004+0000","last_change":"2023-10-16T13:38:19.996471+0000","last_active":"2023-10-16T13:38:20.997004+0000","last_peered":"2023-10-16T13:38:20.997004+0000","last_clean":"2023-10-16T13:38:20.997004+0000","last_became_active":"2023-10-16T13:38:19.994710+0000","last_became_peered":"2023-10-16T13:38:19.994710+0000","last_unstale":"2023-10-16T13:38:20.997004+0000","last_undegraded":"2023-10-16T13:38:20.997004+0000","last_fullsized":"2023-10-16T13:38:20.997004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002919+0000","last_change":"2023-10-16T13:38:18.964941+0000","last_active":"2023-10-16T13:38:20.002919+0000","last_peered":"2023-10-16T13:38:20.002919+0000","last_clean":"2023-10-16T13:38:20.002919+0000","last_became_active":"2023-10-16T13:38:18.964675+0000","last_became_peered":"2023-10-16T13:38:18.964675+0000","last_unstale":"2023-10-16T13:38:20.002919+0000","last_undegraded":"2023-10-16T13:38:20.002919+0000","last_fullsized":"2023-10-16T13:38:20.002919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:03.073989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997402+0000","last_change":"2023-10-16T13:38:19.989785+0000","last_active":"2023-10-16T13:38:20.997402+0000","last_peered":"2023-10-16T13:38:20.997402+0000","last_clean":"2023-10-16T13:38:20.997402+0000","last_became_active":"2023-10-16T13:38:19.989508+0000","last_became_peered":"2023-10-16T13:38:19.989508+0000","last_unstale":"2023-10-16T13:38:20.997402+0000","last_undegraded":"2023-10-16T13:38:20.997402+0000","last_fullsized":"2023-10-16T13:38:20.997402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002679+0000","last_change":"2023-10-16T13:38:18.966501+0000","last_active":"2023-10-16T13:38:20.002679+0000","last_peered":"2023-10-16T13:38:20.002679+0000","last_clean":"2023-10-16T13:38:20.002679+0000","last_became_active":"2023-10-16T13:38:18.966198+0000","last_became_peered":"2023-10-16T13:38:18.966198+0000","last_unstale":"2023-10-16T13:38:20.002679+0000","last_undegraded":"2023-10-16T13:38:20.002679+0000","last_fullsized":"2023-10-16T13:38:20.002679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:16.747902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996442+0000","last_change":"2023-10-16T13:38:19.987636+0000","last_active":"2023-10-16T13:38:20.996442+0000","last_peered":"2023-10-16T13:38:20.996442+0000","last_clean":"2023-10-16T13:38:20.996442+0000","last_became_active":"2023-10-16T13:38:19.986780+0000","last_became_peered":"2023-10-16T13:38:19.986780+0000","last_unstale":"2023-10-16T13:38:20.996442+0000","last_undegraded":"2023-10-16T13:38:20.996442+0000","last_fullsized":"2023-10-16T13:38:20.996442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:04.661176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.999597+0000","last_change":"2023-10-16T13:38:18.965928+0000","last_active":"2023-10-16T13:38:19.999597+0000","last_peered":"2023-10-16T13:38:19.999597+0000","last_clean":"2023-10-16T13:38:19.999597+0000","last_became_active":"2023-10-16T13:38:18.964562+0000","last_became_peered":"2023-10-16T13:38:18.964562+0000","last_unstale":"2023-10-16T13:38:19.999597+0000","last_undegraded":"2023-10-16T13:38:19.999597+0000","last_fullsized":"2023-10-16T13:38:19.999597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417479+0000","last_change":"2023-10-16T13:38:19.992457+0000","last_active":"2023-10-16T13:38:21.417479+0000","last_peered":"2023-10-16T13:38:21.417479+0000","last_clean":"2023-10-16T13:38:21.417479+0000","last_became_active":"2023-10-16T13:38:19.992036+0000","last_became_peered":"2023-10-16T13:38:19.992036+0000","last_unstale":"2023-10-16T13:38:21.417479+0000","last_undegraded":"2023-10-16T13:38:21.417479+0000","last_fullsized":"2023-10-16T13:38:21.417479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.974530+0000","last_change":"2023-10-16T13:38:18.968885+0000","last_active":"2023-10-16T13:38:19.974530+0000","last_peered":"2023-10-16T13:38:19.974530+0000","last_clean":"2023-10-16T13:38:19.974530+0000","last_became_active":"2023-10-16T13:38:18.968534+0000","last_became_peered":"2023-10-16T13:38:18.968534+0000","last_unstale":"2023-10-16T13:38:19.974530+0000","last_undegraded":"2023-10-16T13:38:19.974530+0000","last_fullsized":"2023-10-16T13:38:19.974530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398198+0000","last_change":"2023-10-16T13:38:19.993434+0000","last_active":"2023-10-16T13:38:21.398198+0000","last_peered":"2023-10-16T13:38:21.398198+0000","last_clean":"2023-10-16T13:38:21.398198+0000","last_became_active":"2023-10-16T13:38:19.993043+0000","last_became_peered":"2023-10-16T13:38:19.993043+0000","last_unstale":"2023-10-16T13:38:21.398198+0000","last_undegraded":"2023-10-16T13:38:21.398198+0000","last_fullsized":"2023-10-16T13:38:21.398198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980065+0000","last_change":"2023-10-16T13:38:18.955699+0000","last_active":"2023-10-16T13:38:19.980065+0000","last_peered":"2023-10-16T13:38:19.980065+0000","last_clean":"2023-10-16T13:38:19.980065+0000","last_became_active":"2023-10-16T13:38:18.955087+0000","last_became_peered":"2023-10-16T13:38:18.955087+0000","last_unstale":"2023-10-16T13:38:19.980065+0000","last_undegraded":"2023-10-16T13:38:19.980065+0000","last_fullsized":"2023-10-16T13:38:19.980065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.979256+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.978905+0000","last_became_peered":"2023-10-16T13:38:19.978905+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.977616+0000","last_change":"2023-10-16T13:38:18.966953+0000","last_active":"2023-10-16T13:38:19.977616+0000","last_peered":"2023-10-16T13:38:19.977616+0000","last_clean":"2023-10-16T13:38:19.977616+0000","last_became_active":"2023-10-16T13:38:18.966671+0000","last_became_peered":"2023-10-16T13:38:18.966671+0000","last_unstale":"2023-10-16T13:38:19.977616+0000","last_undegraded":"2023-10-16T13:38:19.977616+0000","last_fullsized":"2023-10-16T13:38:19.977616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997077+0000","last_change":"2023-10-16T13:38:19.996864+0000","last_active":"2023-10-16T13:38:20.997077+0000","last_peered":"2023-10-16T13:38:20.997077+0000","last_clean":"2023-10-16T13:38:20.997077+0000","last_became_active":"2023-10-16T13:38:19.996566+0000","last_became_peered":"2023-10-16T13:38:19.996566+0000","last_unstale":"2023-10-16T13:38:20.997077+0000","last_undegraded":"2023-10-16T13:38:20.997077+0000","last_fullsized":"2023-10-16T13:38:20.997077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980833+0000","last_change":"2023-10-16T13:38:18.965714+0000","last_active":"2023-10-16T13:38:19.980833+0000","last_peered":"2023-10-16T13:38:19.980833+0000","last_clean":"2023-10-16T13:38:19.980833+0000","last_became_active":"2023-10-16T13:38:18.965358+0000","last_became_peered":"2023-10-16T13:38:18.965358+0000","last_unstale":"2023-10-16T13:38:19.980833+0000","last_undegraded":"2023-10-16T13:38:19.980833+0000","last_fullsized":"2023-10-16T13:38:19.980833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:41.112357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417437+0000","last_change":"2023-10-16T13:38:19.997120+0000","last_active":"2023-10-16T13:38:21.417437+0000","last_peered":"2023-10-16T13:38:21.417437+0000","last_clean":"2023-10-16T13:38:21.417437+0000","last_became_active":"2023-10-16T13:38:19.996803+0000","last_became_peered":"2023-10-16T13:38:19.996803+0000","last_unstale":"2023-10-16T13:38:21.417437+0000","last_undegraded":"2023-10-16T13:38:21.417437+0000","last_fullsized":"2023-10-16T13:38:21.417437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002233+0000","last_change":"2023-10-16T13:38:18.970973+0000","last_active":"2023-10-16T13:38:20.002233+0000","last_peered":"2023-10-16T13:38:20.002233+0000","last_clean":"2023-10-16T13:38:20.002233+0000","last_became_active":"2023-10-16T13:38:18.970277+0000","last_became_peered":"2023-10-16T13:38:18.970277+0000","last_unstale":"2023-10-16T13:38:20.002233+0000","last_undegraded":"2023-10-16T13:38:20.002233+0000","last_fullsized":"2023-10-16T13:38:20.002233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997634+0000","last_change":"2023-10-16T13:38:19.995792+0000","last_active":"2023-10-16T13:38:20.997634+0000","last_peered":"2023-10-16T13:38:20.997634+0000","last_clean":"2023-10-16T13:38:20.997634+0000","last_became_active":"2023-10-16T13:38:19.995382+0000","last_became_peered":"2023-10-16T13:38:19.995382+0000","last_unstale":"2023-10-16T13:38:20.997634+0000","last_undegraded":"2023-10-16T13:38:20.997634+0000","last_fullsized":"2023-10-16T13:38:20.997634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:04.077768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.005046+0000","last_change":"2023-10-16T13:38:18.966915+0000","last_active":"2023-10-16T13:38:20.005046+0000","last_peered":"2023-10-16T13:38:20.005046+0000","last_clean":"2023-10-16T13:38:20.005046+0000","last_became_active":"2023-10-16T13:38:18.966651+0000","last_became_peered":"2023-10-16T13:38:18.966651+0000","last_unstale":"2023-10-16T13:38:20.005046+0000","last_undegraded":"2023-10-16T13:38:20.005046+0000","last_fullsized":"2023-10-16T13:38:20.005046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:48.542445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312472+0000","last_change":"2023-10-16T13:38:19.990649+0000","last_active":"2023-10-16T13:38:21.312472+0000","last_peered":"2023-10-16T13:38:21.312472+0000","last_clean":"2023-10-16T13:38:21.312472+0000","last_became_active":"2023-10-16T13:38:19.990367+0000","last_became_peered":"2023-10-16T13:38:19.990367+0000","last_unstale":"2023-10-16T13:38:21.312472+0000","last_undegraded":"2023-10-16T13:38:21.312472+0000","last_fullsized":"2023-10-16T13:38:21.312472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001177+0000","last_change":"2023-10-16T13:38:18.966144+0000","last_active":"2023-10-16T13:38:20.001177+0000","last_peered":"2023-10-16T13:38:20.001177+0000","last_clean":"2023-10-16T13:38:20.001177+0000","last_became_active":"2023-10-16T13:38:18.965756+0000","last_became_peered":"2023-10-16T13:38:18.965756+0000","last_unstale":"2023-10-16T13:38:20.001177+0000","last_undegraded":"2023-10-16T13:38:20.001177+0000","last_fullsized":"2023-10-16T13:38:20.001177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417086+0000","last_change":"2023-10-16T13:38:19.993169+0000","last_active":"2023-10-16T13:38:21.417086+0000","last_peered":"2023-10-16T13:38:21.417086+0000","last_clean":"2023-10-16T13:38:21.417086+0000","last_became_active":"2023-10-16T13:38:19.992834+0000","last_became_peered":"2023-10-16T13:38:19.992834+0000","last_unstale":"2023-10-16T13:38:21.417086+0000","last_undegraded":"2023-10-16T13:38:21.417086+0000","last_fullsized":"2023-10-16T13:38:21.417086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:25.539196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980640+0000","last_change":"2023-10-16T13:38:18.966091+0000","last_active":"2023-10-16T13:38:19.980640+0000","last_peered":"2023-10-16T13:38:19.980640+0000","last_clean":"2023-10-16T13:38:19.980640+0000","last_became_active":"2023-10-16T13:38:18.965722+0000","last_became_peered":"2023-10-16T13:38:18.965722+0000","last_unstale":"2023-10-16T13:38:19.980640+0000","last_undegraded":"2023-10-16T13:38:19.980640+0000","last_fullsized":"2023-10-16T13:38:19.980640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312449+0000","last_change":"2023-10-16T13:38:19.987249+0000","last_active":"2023-10-16T13:38:21.312449+0000","last_peered":"2023-10-16T13:38:21.312449+0000","last_clean":"2023-10-16T13:38:21.312449+0000","last_became_active":"2023-10-16T13:38:19.986977+0000","last_became_peered":"2023-10-16T13:38:19.986977+0000","last_unstale":"2023-10-16T13:38:21.312449+0000","last_undegraded":"2023-10-16T13:38:21.312449+0000","last_fullsized":"2023-10-16T13:38:21.312449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.975945+0000","last_change":"2023-10-16T13:38:18.965295+0000","last_active":"2023-10-16T13:38:19.975945+0000","last_peered":"2023-10-16T13:38:19.975945+0000","last_clean":"2023-10-16T13:38:19.975945+0000","last_became_active":"2023-10-16T13:38:18.964991+0000","last_became_peered":"2023-10-16T13:38:18.964991+0000","last_unstale":"2023-10-16T13:38:19.975945+0000","last_undegraded":"2023-10-16T13:38:19.975945+0000","last_fullsized":"2023-10-16T13:38:19.975945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875921+0000","last_change":"2023-10-16T13:38:19.993337+0000","last_active":"2023-10-16T13:38:21.875921+0000","last_peered":"2023-10-16T13:38:21.875921+0000","last_clean":"2023-10-16T13:38:21.875921+0000","last_became_active":"2023-10-16T13:38:19.993037+0000","last_became_peered":"2023-10-16T13:38:19.993037+0000","last_unstale":"2023-10-16T13:38:21.875921+0000","last_undegraded":"2023-10-16T13:38:21.875921+0000","last_fullsized":"2023-10-16T13:38:21.875921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002049+0000","last_change":"2023-10-16T13:38:18.971941+0000","last_active":"2023-10-16T13:38:20.002049+0000","last_peered":"2023-10-16T13:38:20.002049+0000","last_clean":"2023-10-16T13:38:20.002049+0000","last_became_active":"2023-10-16T13:38:18.971486+0000","last_became_peered":"2023-10-16T13:38:18.971486+0000","last_unstale":"2023-10-16T13:38:20.002049+0000","last_undegraded":"2023-10-16T13:38:20.002049+0000","last_fullsized":"2023-10-16T13:38:20.002049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:55.029520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312272+0000","last_change":"2023-10-16T13:38:19.995763+0000","last_active":"2023-10-16T13:38:21.312272+0000","last_peered":"2023-10-16T13:38:21.312272+0000","last_clean":"2023-10-16T13:38:21.312272+0000","last_became_active":"2023-10-16T13:38:19.994356+0000","last_became_peered":"2023-10-16T13:38:19.994356+0000","last_unstale":"2023-10-16T13:38:21.312272+0000","last_undegraded":"2023-10-16T13:38:21.312272+0000","last_fullsized":"2023-10-16T13:38:21.312272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002621+0000","last_change":"2023-10-16T13:38:18.964587+0000","last_active":"2023-10-16T13:38:20.002621+0000","last_peered":"2023-10-16T13:38:20.002621+0000","last_clean":"2023-10-16T13:38:20.002621+0000","last_became_active":"2023-10-16T13:38:18.964045+0000","last_became_peered":"2023-10-16T13:38:18.964045+0000","last_unstale":"2023-10-16T13:38:20.002621+0000","last_undegraded":"2023-10-16T13:38:20.002621+0000","last_fullsized":"2023-10-16T13:38:20.002621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312674+0000","last_change":"2023-10-16T13:38:19.987703+0000","last_active":"2023-10-16T13:38:21.312674+0000","last_peered":"2023-10-16T13:38:21.312674+0000","last_clean":"2023-10-16T13:38:21.312674+0000","last_became_active":"2023-10-16T13:38:19.987424+0000","last_became_peered":"2023-10-16T13:38:19.987424+0000","last_unstale":"2023-10-16T13:38:21.312674+0000","last_undegraded":"2023-10-16T13:38:21.312674+0000","last_fullsized":"2023-10-16T13:38:21.312674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.976739+0000","last_change":"2023-10-16T13:38:18.971397+0000","last_active":"2023-10-16T13:38:19.976739+0000","last_peered":"2023-10-16T13:38:19.976739+0000","last_clean":"2023-10-16T13:38:19.976739+0000","last_became_active":"2023-10-16T13:38:18.970730+0000","last_became_peered":"2023-10-16T13:38:18.970730+0000","last_unstale":"2023-10-16T13:38:19.976739+0000","last_undegraded":"2023-10-16T13:38:19.976739+0000","last_fullsized":"2023-10-16T13:38:19.976739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997490+0000","last_change":"2023-10-16T13:38:19.989906+0000","last_active":"2023-10-16T13:38:20.997490+0000","last_peered":"2023-10-16T13:38:20.997490+0000","last_clean":"2023-10-16T13:38:20.997490+0000","last_became_active":"2023-10-16T13:38:19.989392+0000","last_became_peered":"2023-10-16T13:38:19.989392+0000","last_unstale":"2023-10-16T13:38:20.997490+0000","last_undegraded":"2023-10-16T13:38:20.997490+0000","last_fullsized":"2023-10-16T13:38:20.997490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980449+0000","last_change":"2023-10-16T13:38:18.971405+0000","last_active":"2023-10-16T13:38:19.980449+0000","last_peered":"2023-10-16T13:38:19.980449+0000","last_clean":"2023-10-16T13:38:19.980449+0000","last_became_active":"2023-10-16T13:38:18.970833+0000","last_became_peered":"2023-10-16T13:38:18.970833+0000","last_unstale":"2023-10-16T13:38:19.980449+0000","last_undegraded":"2023-10-16T13:38:19.980449+0000","last_fullsized":"2023-10-16T13:38:19.980449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.527487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996443+0000","last_change":"2023-10-16T13:38:19.994155+0000","last_active":"2023-10-16T13:38:20.996443+0000","last_peered":"2023-10-16T13:38:20.996443+0000","last_clean":"2023-10-16T13:38:20.996443+0000","last_became_active":"2023-10-16T13:38:19.993613+0000","last_became_peered":"2023-10-16T13:38:19.993613+0000","last_unstale":"2023-10-16T13:38:20.996443+0000","last_undegraded":"2023-10-16T13:38:20.996443+0000","last_fullsized":"2023-10-16T13:38:20.996443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:42.991395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988581+0000","last_change":"2023-10-16T13:38:19.985531+0000","last_active":"2023-10-16T13:38:20.988581+0000","last_peered":"2023-10-16T13:38:20.988581+0000","last_clean":"2023-10-16T13:38:20.988581+0000","last_became_active":"2023-10-16T13:38:19.985266+0000","last_became_peered":"2023-10-16T13:38:19.985266+0000","last_unstale":"2023-10-16T13:38:20.988581+0000","last_undegraded":"2023-10-16T13:38:20.988581+0000","last_fullsized":"2023-10-16T13:38:20.988581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972216+0000","last_change":"2023-10-16T13:38:18.964493+0000","last_active":"2023-10-16T13:38:19.972216+0000","last_peered":"2023-10-16T13:38:19.972216+0000","last_clean":"2023-10-16T13:38:19.972216+0000","last_became_active":"2023-10-16T13:38:18.964187+0000","last_became_peered":"2023-10-16T13:38:18.964187+0000","last_unstale":"2023-10-16T13:38:19.972216+0000","last_undegraded":"2023-10-16T13:38:19.972216+0000","last_fullsized":"2023-10-16T13:38:19.972216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398312+0000","last_change":"2023-10-16T13:38:19.997708+0000","last_active":"2023-10-16T13:38:21.398312+0000","last_peered":"2023-10-16T13:38:21.398312+0000","last_clean":"2023-10-16T13:38:21.398312+0000","last_became_active":"2023-10-16T13:38:19.997371+0000","last_became_peered":"2023-10-16T13:38:19.997371+0000","last_unstale":"2023-10-16T13:38:21.398312+0000","last_undegraded":"2023-10-16T13:38:21.398312+0000","last_fullsized":"2023-10-16T13:38:21.398312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980595+0000","last_change":"2023-10-16T13:38:18.954177+0000","last_active":"2023-10-16T13:38:19.980595+0000","last_peered":"2023-10-16T13:38:19.980595+0000","last_clean":"2023-10-16T13:38:19.980595+0000","last_became_active":"2023-10-16T13:38:18.953859+0000","last_became_peered":"2023-10-16T13:38:18.953859+0000","last_unstale":"2023-10-16T13:38:19.980595+0000","last_undegraded":"2023-10-16T13:38:19.980595+0000","last_fullsized":"2023-10-16T13:38:19.980595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:07.912567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972935+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:19.972935+0000","last_peered":"2023-10-16T13:38:19.972935+0000","last_clean":"2023-10-16T13:38:19.972935+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:19.972935+0000","last_undegraded":"2023-10-16T13:38:19.972935+0000","last_fullsized":"2023-10-16T13:38:19.972935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417024+0000","last_change":"2023-10-16T13:38:19.989240+0000","last_active":"2023-10-16T13:38:21.417024+0000","last_peered":"2023-10-16T13:38:21.417024+0000","last_clean":"2023-10-16T13:38:21.417024+0000","last_became_active":"2023-10-16T13:38:19.988888+0000","last_became_peered":"2023-10-16T13:38:19.988888+0000","last_unstale":"2023-10-16T13:38:21.417024+0000","last_undegraded":"2023-10-16T13:38:21.417024+0000","last_fullsized":"2023-10-16T13:38:21.417024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:46.323232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973036+0000","last_change":"2023-10-16T13:38:18.971283+0000","last_active":"2023-10-16T13:38:19.973036+0000","last_peered":"2023-10-16T13:38:19.973036+0000","last_clean":"2023-10-16T13:38:19.973036+0000","last_became_active":"2023-10-16T13:38:18.970896+0000","last_became_peered":"2023-10-16T13:38:18.970896+0000","last_unstale":"2023-10-16T13:38:19.973036+0000","last_undegraded":"2023-10-16T13:38:19.973036+0000","last_fullsized":"2023-10-16T13:38:19.973036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.978893+0000","last_change":"2023-10-16T13:38:18.969135+0000","last_active":"2023-10-16T13:38:19.978893+0000","last_peered":"2023-10-16T13:38:19.978893+0000","last_clean":"2023-10-16T13:38:19.978893+0000","last_became_active":"2023-10-16T13:38:18.968811+0000","last_became_peered":"2023-10-16T13:38:18.968811+0000","last_unstale":"2023-10-16T13:38:19.978893+0000","last_undegraded":"2023-10-16T13:38:19.978893+0000","last_fullsized":"2023-10-16T13:38:19.978893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988509+0000","last_change":"2023-10-16T13:38:19.987139+0000","last_active":"2023-10-16T13:38:20.988509+0000","last_peered":"2023-10-16T13:38:20.988509+0000","last_clean":"2023-10-16T13:38:20.988509+0000","last_became_active":"2023-10-16T13:38:19.986018+0000","last_became_peered":"2023-10-16T13:38:19.986018+0000","last_unstale":"2023-10-16T13:38:20.988509+0000","last_undegraded":"2023-10-16T13:38:20.988509+0000","last_fullsized":"2023-10-16T13:38:20.988509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988441+0000","last_change":"2023-10-16T13:38:18.969084+0000","last_active":"2023-10-16T13:38:20.988441+0000","last_peered":"2023-10-16T13:38:20.988441+0000","last_clean":"2023-10-16T13:38:20.988441+0000","last_became_active":"2023-10-16T13:38:18.968714+0000","last_became_peered":"2023-10-16T13:38:18.968714+0000","last_unstale":"2023-10-16T13:38:20.988441+0000","last_undegraded":"2023-10-16T13:38:20.988441+0000","last_fullsized":"2023-10-16T13:38:20.988441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398414+0000","last_change":"2023-10-16T13:38:19.987735+0000","last_active":"2023-10-16T13:38:21.398414+0000","last_peered":"2023-10-16T13:38:21.398414+0000","last_clean":"2023-10-16T13:38:21.398414+0000","last_became_active":"2023-10-16T13:38:19.986959+0000","last_became_peered":"2023-10-16T13:38:19.986959+0000","last_unstale":"2023-10-16T13:38:21.398414+0000","last_undegraded":"2023-10-16T13:38:21.398414+0000","last_fullsized":"2023-10-16T13:38:21.398414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000677+0000","last_change":"2023-10-16T13:38:18.967312+0000","last_active":"2023-10-16T13:38:20.000677+0000","last_peered":"2023-10-16T13:38:20.000677+0000","last_clean":"2023-10-16T13:38:20.000677+0000","last_became_active":"2023-10-16T13:38:18.966996+0000","last_became_peered":"2023-10-16T13:38:18.966996+0000","last_unstale":"2023-10-16T13:38:20.000677+0000","last_undegraded":"2023-10-16T13:38:20.000677+0000","last_fullsized":"2023-10-16T13:38:20.000677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417342+0000","last_change":"2023-10-16T13:38:19.991995+0000","last_active":"2023-10-16T13:38:21.417342+0000","last_peered":"2023-10-16T13:38:21.417342+0000","last_clean":"2023-10-16T13:38:21.417342+0000","last_became_active":"2023-10-16T13:38:19.991675+0000","last_became_peered":"2023-10-16T13:38:19.991675+0000","last_unstale":"2023-10-16T13:38:21.417342+0000","last_undegraded":"2023-10-16T13:38:21.417342+0000","last_fullsized":"2023-10-16T13:38:21.417342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972826+0000","last_change":"2023-10-16T13:38:18.965736+0000","last_active":"2023-10-16T13:38:19.972826+0000","last_peered":"2023-10-16T13:38:19.972826+0000","last_clean":"2023-10-16T13:38:19.972826+0000","last_became_active":"2023-10-16T13:38:18.965488+0000","last_became_peered":"2023-10-16T13:38:18.965488+0000","last_unstale":"2023-10-16T13:38:19.972826+0000","last_undegraded":"2023-10-16T13:38:19.972826+0000","last_fullsized":"2023-10-16T13:38:19.972826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997267+0000","last_change":"2023-10-16T13:38:19.988592+0000","last_active":"2023-10-16T13:38:20.997267+0000","last_peered":"2023-10-16T13:38:20.997267+0000","last_clean":"2023-10-16T13:38:20.997267+0000","last_became_active":"2023-10-16T13:38:19.988222+0000","last_became_peered":"2023-10-16T13:38:19.988222+0000","last_unstale":"2023-10-16T13:38:20.997267+0000","last_undegraded":"2023-10-16T13:38:20.997267+0000","last_fullsized":"2023-10-16T13:38:20.997267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:09.486295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973837+0000","last_change":"2023-10-16T13:38:18.970765+0000","last_active":"2023-10-16T13:38:19.973837+0000","last_peered":"2023-10-16T13:38:19.973837+0000","last_clean":"2023-10-16T13:38:19.973837+0000","last_became_active":"2023-10-16T13:38:18.970373+0000","last_became_peered":"2023-10-16T13:38:18.970373+0000","last_unstale":"2023-10-16T13:38:19.973837+0000","last_undegraded":"2023-10-16T13:38:19.973837+0000","last_fullsized":"2023-10-16T13:38:19.973837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397986+0000","last_change":"2023-10-16T13:38:19.987493+0000","last_active":"2023-10-16T13:38:21.397986+0000","last_peered":"2023-10-16T13:38:21.397986+0000","last_clean":"2023-10-16T13:38:21.397986+0000","last_became_active":"2023-10-16T13:38:19.987196+0000","last_became_peered":"2023-10-16T13:38:19.987196+0000","last_unstale":"2023-10-16T13:38:21.397986+0000","last_undegraded":"2023-10-16T13:38:21.397986+0000","last_fullsized":"2023-10-16T13:38:21.397986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972485+0000","last_change":"2023-10-16T13:38:18.971500+0000","last_active":"2023-10-16T13:38:19.972485+0000","last_peered":"2023-10-16T13:38:19.972485+0000","last_clean":"2023-10-16T13:38:19.972485+0000","last_became_active":"2023-10-16T13:38:18.971072+0000","last_became_peered":"2023-10-16T13:38:18.971072+0000","last_unstale":"2023-10-16T13:38:19.972485+0000","last_undegraded":"2023-10-16T13:38:19.972485+0000","last_fullsized":"2023-10-16T13:38:19.972485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398558+0000","last_change":"2023-10-16T13:38:19.993658+0000","last_active":"2023-10-16T13:38:21.398558+0000","last_peered":"2023-10-16T13:38:21.398558+0000","last_clean":"2023-10-16T13:38:21.398558+0000","last_became_active":"2023-10-16T13:38:19.993109+0000","last_became_peered":"2023-10-16T13:38:19.993109+0000","last_unstale":"2023-10-16T13:38:21.398558+0000","last_undegraded":"2023-10-16T13:38:21.398558+0000","last_fullsized":"2023-10-16T13:38:21.398558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000611+0000","last_change":"2023-10-16T13:38:18.969196+0000","last_active":"2023-10-16T13:38:20.000611+0000","last_peered":"2023-10-16T13:38:20.000611+0000","last_clean":"2023-10-16T13:38:20.000611+0000","last_became_active":"2023-10-16T13:38:18.968947+0000","last_became_peered":"2023-10-16T13:38:18.968947+0000","last_unstale":"2023-10-16T13:38:20.000611+0000","last_undegraded":"2023-10-16T13:38:20.000611+0000","last_fullsized":"2023-10-16T13:38:20.000611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876093+0000","last_change":"2023-10-16T13:38:19.987465+0000","last_active":"2023-10-16T13:38:21.876093+0000","last_peered":"2023-10-16T13:38:21.876093+0000","last_clean":"2023-10-16T13:38:21.876093+0000","last_became_active":"2023-10-16T13:38:19.987060+0000","last_became_peered":"2023-10-16T13:38:19.987060+0000","last_unstale":"2023-10-16T13:38:21.876093+0000","last_undegraded":"2023-10-16T13:38:21.876093+0000","last_fullsized":"2023-10-16T13:38:21.876093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973130+0000","last_change":"2023-10-16T13:38:18.955240+0000","last_active":"2023-10-16T13:38:19.973130+0000","last_peered":"2023-10-16T13:38:19.973130+0000","last_clean":"2023-10-16T13:38:19.973130+0000","last_became_active":"2023-10-16T13:38:18.954854+0000","last_became_peered":"2023-10-16T13:38:18.954854+0000","last_unstale":"2023-10-16T13:38:19.973130+0000","last_undegraded":"2023-10-16T13:38:19.973130+0000","last_fullsized":"2023-10-16T13:38:19.973130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312661+0000","last_change":"2023-10-16T13:38:19.999600+0000","last_active":"2023-10-16T13:38:21.312661+0000","last_peered":"2023-10-16T13:38:21.312661+0000","last_clean":"2023-10-16T13:38:21.312661+0000","last_became_active":"2023-10-16T13:38:19.999328+0000","last_became_peered":"2023-10-16T13:38:19.999328+0000","last_unstale":"2023-10-16T13:38:21.312661+0000","last_undegraded":"2023-10-16T13:38:21.312661+0000","last_fullsized":"2023-10-16T13:38:21.312661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001300+0000","last_change":"2023-10-16T13:38:18.972416+0000","last_active":"2023-10-16T13:38:20.001300+0000","last_peered":"2023-10-16T13:38:20.001300+0000","last_clean":"2023-10-16T13:38:20.001300+0000","last_became_active":"2023-10-16T13:38:18.972134+0000","last_became_peered":"2023-10-16T13:38:18.972134+0000","last_unstale":"2023-10-16T13:38:20.001300+0000","last_undegraded":"2023-10-16T13:38:20.001300+0000","last_fullsized":"2023-10-16T13:38:20.001300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997167+0000","last_change":"2023-10-16T13:38:19.989464+0000","last_active":"2023-10-16T13:38:20.997167+0000","last_peered":"2023-10-16T13:38:20.997167+0000","last_clean":"2023-10-16T13:38:20.997167+0000","last_became_active":"2023-10-16T13:38:19.988949+0000","last_became_peered":"2023-10-16T13:38:19.988949+0000","last_unstale":"2023-10-16T13:38:20.997167+0000","last_undegraded":"2023-10-16T13:38:20.997167+0000","last_fullsized":"2023-10-16T13:38:20.997167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.003246+0000","last_change":"2023-10-16T13:38:18.962000+0000","last_active":"2023-10-16T13:38:20.003246+0000","last_peered":"2023-10-16T13:38:20.003246+0000","last_clean":"2023-10-16T13:38:20.003246+0000","last_became_active":"2023-10-16T13:38:18.961681+0000","last_became_peered":"2023-10-16T13:38:18.961681+0000","last_unstale":"2023-10-16T13:38:20.003246+0000","last_undegraded":"2023-10-16T13:38:20.003246+0000","last_fullsized":"2023-10-16T13:38:20.003246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312823+0000","last_change":"2023-10-16T13:38:19.991640+0000","last_active":"2023-10-16T13:38:21.312823+0000","last_peered":"2023-10-16T13:38:21.312823+0000","last_clean":"2023-10-16T13:38:21.312823+0000","last_became_active":"2023-10-16T13:38:19.990115+0000","last_became_peered":"2023-10-16T13:38:19.990115+0000","last_unstale":"2023-10-16T13:38:21.312823+0000","last_undegraded":"2023-10-16T13:38:21.312823+0000","last_fullsized":"2023-10-16T13:38:21.312823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:21:33.323265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875839+0000","last_change":"2023-10-16T13:38:19.995109+0000","last_active":"2023-10-16T13:38:21.875839+0000","last_peered":"2023-10-16T13:38:21.875839+0000","last_clean":"2023-10-16T13:38:21.875839+0000","last_became_active":"2023-10-16T13:38:19.994801+0000","last_became_peered":"2023-10-16T13:38:19.994801+0000","last_unstale":"2023-10-16T13:38:21.875839+0000","last_undegraded":"2023-10-16T13:38:21.875839+0000","last_fullsized":"2023-10-16T13:38:21.875839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821362+0000","last_change":"2023-10-16T13:38:19.990599+0000","last_active":"2023-10-16T13:38:21.821362+0000","last_peered":"2023-10-16T13:38:21.821362+0000","last_clean":"2023-10-16T13:38:21.821362+0000","last_became_active":"2023-10-16T13:38:19.990337+0000","last_became_peered":"2023-10-16T13:38:19.990337+0000","last_unstale":"2023-10-16T13:38:21.821362+0000","last_undegraded":"2023-10-16T13:38:21.821362+0000","last_fullsized":"2023-10-16T13:38:21.821362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:42.945644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996891+0000","last_change":"2023-10-16T13:38:19.996805+0000","last_active":"2023-10-16T13:38:20.996891+0000","last_peered":"2023-10-16T13:38:20.996891+0000","last_clean":"2023-10-16T13:38:20.996891+0000","last_became_active":"2023-10-16T13:38:19.996509+0000","last_became_peered":"2023-10-16T13:38:19.996509+0000","last_unstale":"2023-10-16T13:38:20.996891+0000","last_undegraded":"2023-10-16T13:38:20.996891+0000","last_fullsized":"2023-10-16T13:38:20.996891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417362+0000","last_change":"2023-10-16T13:38:19.992691+0000","last_active":"2023-10-16T13:38:21.417362+0000","last_peered":"2023-10-16T13:38:21.417362+0000","last_clean":"2023-10-16T13:38:21.417362+0000","last_became_active":"2023-10-16T13:38:19.992360+0000","last_became_peered":"2023-10-16T13:38:19.992360+0000","last_unstale":"2023-10-16T13:38:21.417362+0000","last_undegraded":"2023-10-16T13:38:21.417362+0000","last_fullsized":"2023-10-16T13:38:21.417362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398282+0000","last_change":"2023-10-16T13:38:19.985294+0000","last_active":"2023-10-16T13:38:21.398282+0000","last_peered":"2023-10-16T13:38:21.398282+0000","last_clean":"2023-10-16T13:38:21.398282+0000","last_became_active":"2023-10-16T13:38:19.985063+0000","last_became_peered":"2023-10-16T13:38:19.985063+0000","last_unstale":"2023-10-16T13:38:21.398282+0000","last_undegraded":"2023-10-16T13:38:21.398282+0000","last_fullsized":"2023-10-16T13:38:21.398282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.980791+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.980473+0000","last_became_peered":"2023-10-16T13:38:19.980473+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876183+0000","last_change":"2023-10-16T13:38:19.986596+0000","last_active":"2023-10-16T13:38:21.876183+0000","last_peered":"2023-10-16T13:38:21.876183+0000","last_clean":"2023-10-16T13:38:21.876183+0000","last_became_active":"2023-10-16T13:38:19.986288+0000","last_became_peered":"2023-10-16T13:38:19.986288+0000","last_unstale":"2023-10-16T13:38:21.876183+0000","last_undegraded":"2023-10-16T13:38:21.876183+0000","last_fullsized":"2023-10-16T13:38:21.876183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398398+0000","last_change":"2023-10-16T13:38:19.983880+0000","last_active":"2023-10-16T13:38:21.398398+0000","last_peered":"2023-10-16T13:38:21.398398+0000","last_clean":"2023-10-16T13:38:21.398398+0000","last_became_active":"2023-10-16T13:38:19.983548+0000","last_became_peered":"2023-10-16T13:38:19.983548+0000","last_unstale":"2023-10-16T13:38:21.398398+0000","last_undegraded":"2023-10-16T13:38:21.398398+0000","last_fullsized":"2023-10-16T13:38:21.398398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996462+0000","last_change":"2023-10-16T13:38:19.996604+0000","last_active":"2023-10-16T13:38:20.996462+0000","last_peered":"2023-10-16T13:38:20.996462+0000","last_clean":"2023-10-16T13:38:20.996462+0000","last_became_active":"2023-10-16T13:38:19.995929+0000","last_became_peered":"2023-10-16T13:38:19.995929+0000","last_unstale":"2023-10-16T13:38:20.996462+0000","last_undegraded":"2023-10-16T13:38:20.996462+0000","last_fullsized":"2023-10-16T13:38:20.996462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398082+0000","last_change":"2023-10-16T13:38:19.986068+0000","last_active":"2023-10-16T13:38:21.398082+0000","last_peered":"2023-10-16T13:38:21.398082+0000","last_clean":"2023-10-16T13:38:21.398082+0000","last_became_active":"2023-10-16T13:38:19.985755+0000","last_became_peered":"2023-10-16T13:38:19.985755+0000","last_unstale":"2023-10-16T13:38:21.398082+0000","last_undegraded":"2023-10-16T13:38:21.398082+0000","last_fullsized":"2023-10-16T13:38:21.398082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997136+0000","last_change":"2023-10-16T13:38:19.995901+0000","last_active":"2023-10-16T13:38:20.997136+0000","last_peered":"2023-10-16T13:38:20.997136+0000","last_clean":"2023-10-16T13:38:20.997136+0000","last_became_active":"2023-10-16T13:38:19.994807+0000","last_became_peered":"2023-10-16T13:38:19.994807+0000","last_unstale":"2023-10-16T13:38:20.997136+0000","last_undegraded":"2023-10-16T13:38:20.997136+0000","last_fullsized":"2023-10-16T13:38:20.997136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417224+0000","last_change":"2023-10-16T13:38:20.001012+0000","last_active":"2023-10-16T13:38:21.417224+0000","last_peered":"2023-10-16T13:38:21.417224+0000","last_clean":"2023-10-16T13:38:21.417224+0000","last_became_active":"2023-10-16T13:38:20.000625+0000","last_became_peered":"2023-10-16T13:38:20.000625+0000","last_unstale":"2023-10-16T13:38:21.417224+0000","last_undegraded":"2023-10-16T13:38:21.417224+0000","last_fullsized":"2023-10-16T13:38:21.417224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876030+0000","last_change":"2023-10-16T13:38:19.987393+0000","last_active":"2023-10-16T13:38:21.876030+0000","last_peered":"2023-10-16T13:38:21.876030+0000","last_clean":"2023-10-16T13:38:21.876030+0000","last_became_active":"2023-10-16T13:38:19.987088+0000","last_became_peered":"2023-10-16T13:38:19.987088+0000","last_unstale":"2023-10-16T13:38:21.876030+0000","last_undegraded":"2023-10-16T13:38:21.876030+0000","last_fullsized":"2023-10-16T13:38:21.876030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:33.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:38:33.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.766+0000 7f8d7e543700 1 Processor -- start 2023-10-16T13:38:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.766+0000 7f8d7e543700 1 -- start start 2023-10-16T13:38:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.766+0000 7f8d7e543700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d7806af50 0x7f8d780cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.766+0000 7f8d7e543700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780b3530 con 0x7f8d7815f130 2023-10-16T13:38:33.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.766+0000 7f8d7e543700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780cd180 con 0x7f8d780b28b0 2023-10-16T13:38:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.766+0000 7f8d7e543700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780cde00 con 0x7f8d7806af50 2023-10-16T13:38:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d77fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8d7815f130 0x7f8d7806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52320/0 (socket says 172.21.15.5:52320) 2023-10-16T13:38:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d77fff700 1 -- 172.21.15.5:0/2663764518 learned_addr learned my addr 172.21.15.5:0/2663764518 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d777fe700 1 --2- 172.21.15.5:0/2663764518 >> v2:172.21.15.112:3300/0 conn(0x7f8d7806af50 0x7f8d780cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d76ffd700 1 -- 172.21.15.5:0/2663764518 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517204000 0 0) 0x7f8d780b3530 con 0x7f8d7815f130 2023-10-16T13:38:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d76ffd700 1 -- 172.21.15.5:0/2663764518 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d600035b0 con 0x7f8d7815f130 2023-10-16T13:38:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d777fe700 1 -- 172.21.15.5:0/2663764518 >> v1:172.21.15.112:6789/0 conn(0x7f8d780b28b0 legacy=0x7f8d780b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d777fe700 1 -- 172.21.15.5:0/2663764518 >> v1:172.21.15.5:6789/0 conn(0x7f8d7815f130 legacy=0x7f8d7806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d777fe700 1 -- 172.21.15.5:0/2663764518 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780cd460 con 0x7f8d7806af50 2023-10-16T13:38:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d777fe700 1 --2- 172.21.15.5:0/2663764518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7806af50 0x7f8d780cede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009820 tx=0x7f8d6c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea0b805d8a20dde server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.767+0000 7f8d76ffd700 1 -- 172.21.15.5:0/2663764518 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c005e30 con 0x7f8d7806af50 2023-10-16T13:38:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d76ffd700 1 -- 172.21.15.5:0/2663764518 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c006030 con 0x7f8d7806af50 2023-10-16T13:38:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d76ffd700 1 -- 172.21.15.5:0/2663764518 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0063c0 con 0x7f8d7806af50 2023-10-16T13:38:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 -- 172.21.15.5:0/2663764518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7806af50 msgr2=0x7f8d780cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 --2- 172.21.15.5:0/2663764518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7806af50 0x7f8d780cede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009820 tx=0x7f8d6c009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 -- 172.21.15.5:0/2663764518 shutdown_connections 2023-10-16T13:38:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 --2- 172.21.15.5:0/2663764518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7806af50 0x7f8d780cede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 -- 172.21.15.5:0/2663764518 >> 172.21.15.5:0/2663764518 conn(0x7f8d7806dae0 msgr2=0x7f8d7806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 -- 172.21.15.5:0/2663764518 shutdown_connections 2023-10-16T13:38:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.768+0000 7f8d7e543700 1 -- 172.21.15.5:0/2663764518 wait complete. 2023-10-16T13:38:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.769+0000 7f8d7e543700 1 Processor -- start 2023-10-16T13:38:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.769+0000 7f8d7e543700 1 -- start start 2023-10-16T13:38:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7e543700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d7806af50 0x7f8d7814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7e543700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 0x7f8d780c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7e543700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7815f130 0x7f8d7815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7e543700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c8c00 con 0x7f8d780b28b0 2023-10-16T13:38:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7e543700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c7f80 con 0x7f8d7815f130 2023-10-16T13:38:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7e543700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c8260 con 0x7f8d7806af50 2023-10-16T13:38:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 0x7f8d780c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 0x7f8d780c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42324/0 (socket says 172.21.15.5:42324) 2023-10-16T13:38:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d777fe700 1 -- 172.21.15.5:0/3966708780 learned_addr learned my addr 172.21.15.5:0/3966708780 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d7cae0700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7815f130 0x7f8d7815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.770+0000 7f8d77fff700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d7806af50 0x7f8d7814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d777fe700 1 -- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d7806af50 msgr2=0x7f8d7814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d777fe700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d7806af50 0x7f8d7814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d777fe700 1 -- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7815f130 msgr2=0x7f8d7815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d777fe700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7815f130 0x7f8d7815c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d777fe700 1 -- 172.21.15.5:0/3966708780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c009430 con 0x7f8d780b28b0 2023-10-16T13:38:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d777fe700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 0x7f8d780c75a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c000c00 tx=0x7f8d6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c004240 con 0x7f8d780b28b0 2023-10-16T13:38:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d780c8540 con 0x7f8d780b28b0 2023-10-16T13:38:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c0043a0 con 0x7f8d780b28b0 2023-10-16T13:38:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0036a0 con 0x7f8d780b28b0 2023-10-16T13:38:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.771+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d780c4190 con 0x7f8d780b28b0 2023-10-16T13:38:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.772+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d780afb10 con 0x7f8d780b28b0 2023-10-16T13:38:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.772+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d6c022070 con 0x7f8d780b28b0 2023-10-16T13:38:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.773+0000 7f8d74ff9700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8d6406af00 0x7f8d6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.773+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d6c08aeb0 con 0x7f8d780b28b0 2023-10-16T13:38:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.773+0000 7f8d77fff700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8d6406af00 0x7f8d6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.774+0000 7f8d77fff700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8d6406af00 0x7f8d6406d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d680011e0 tx=0x7f8d68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.778+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d6c055ed0 con 0x7f8d780b28b0 2023-10-16T13:38:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.973+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d780cda20 con 0x7f8d6406af00 2023-10-16T13:38:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.981+0000 7f8d74ff9700 1 -- 172.21.15.5:0/3966708780 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7f8d68001460 con 0x7f8d6406af00 2023-10-16T13:38:33.987 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:33.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8d6406af00 msgr2=0x7f8d6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8d6406af00 0x7f8d6406d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d680011e0 tx=0x7f8d68009040 comp rx=0 tx=0).stop 2023-10-16T13:38:33.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 msgr2=0x7f8d780c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:33.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 0x7f8d780c75a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c000c00 tx=0x7f8d6c004750 comp rx=0 tx=0).stop 2023-10-16T13:38:33.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 shutdown_connections 2023-10-16T13:38:33.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7815f130 0x7f8d7815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8d6406af00 0x7f8d6406d3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d7806af50 0x7f8d7814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 --2- 172.21.15.5:0/3966708780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d780b28b0 0x7f8d780c75a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 >> 172.21.15.5:0/3966708780 conn(0x7f8d7806dae0 msgr2=0x7f8d780b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 shutdown_connections 2023-10-16T13:38:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:33.984+0000 7f8d7e543700 1 -- 172.21.15.5:0/3966708780 wait complete. 2023-10-16T13:38:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:38:33.999 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-16T13:38:33.459652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2883584,"data_stored":1750702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003307"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312791+0000","last_change":"2023-10-16T13:38:19.985659+0000","last_active":"2023-10-16T13:38:21.312791+0000","last_peered":"2023-10-16T13:38:21.312791+0000","last_clean":"2023-10-16T13:38:21.312791+0000","last_became_active":"2023-10-16T13:38:19.985250+0000","last_became_peered":"2023-10-16T13:38:19.985250+0000","last_unstale":"2023-10-16T13:38:21.312791+0000","last_undegraded":"2023-10-16T13:38:21.312791+0000","last_fullsized":"2023-10-16T13:38:21.312791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:21:57.591824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988596+0000","last_change":"2023-10-16T13:38:19.985144+0000","last_active":"2023-10-16T13:38:20.988596+0000","last_peered":"2023-10-16T13:38:20.988596+0000","last_clean":"2023-10-16T13:38:20.988596+0000","last_became_active":"2023-10-16T13:38:19.984801+0000","last_became_peered":"2023-10-16T13:38:19.984801+0000","last_unstale":"2023-10-16T13:38:20.988596+0000","last_undegraded":"2023-10-16T13:38:20.988596+0000","last_fullsized":"2023-10-16T13:38:20.988596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417314+0000","last_change":"2023-10-16T13:38:19.992389+0000","last_active":"2023-10-16T13:38:21.417314+0000","last_peered":"2023-10-16T13:38:21.417314+0000","last_clean":"2023-10-16T13:38:21.417314+0000","last_became_active":"2023-10-16T13:38:19.991965+0000","last_became_peered":"2023-10-16T13:38:19.991965+0000","last_unstale":"2023-10-16T13:38:21.417314+0000","last_undegraded":"2023-10-16T13:38:21.417314+0000","last_fullsized":"2023-10-16T13:38:21.417314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996709+0000","last_change":"2023-10-16T13:38:19.994269+0000","last_active":"2023-10-16T13:38:20.996709+0000","last_peered":"2023-10-16T13:38:20.996709+0000","last_clean":"2023-10-16T13:38:20.996709+0000","last_became_active":"2023-10-16T13:38:19.989727+0000","last_became_peered":"2023-10-16T13:38:19.989727+0000","last_unstale":"2023-10-16T13:38:20.996709+0000","last_undegraded":"2023-10-16T13:38:20.996709+0000","last_fullsized":"2023-10-16T13:38:20.996709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312381+0000","last_change":"2023-10-16T13:38:19.988406+0000","last_active":"2023-10-16T13:38:21.312381+0000","last_peered":"2023-10-16T13:38:21.312381+0000","last_clean":"2023-10-16T13:38:21.312381+0000","last_became_active":"2023-10-16T13:38:19.985680+0000","last_became_peered":"2023-10-16T13:38:19.985680+0000","last_unstale":"2023-10-16T13:38:21.312381+0000","last_undegraded":"2023-10-16T13:38:21.312381+0000","last_fullsized":"2023-10-16T13:38:21.312381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996738+0000","last_change":"2023-10-16T13:38:19.997527+0000","last_active":"2023-10-16T13:38:20.996738+0000","last_peered":"2023-10-16T13:38:20.996738+0000","last_clean":"2023-10-16T13:38:20.996738+0000","last_became_active":"2023-10-16T13:38:19.997232+0000","last_became_peered":"2023-10-16T13:38:19.997232+0000","last_unstale":"2023-10-16T13:38:20.996738+0000","last_undegraded":"2023-10-16T13:38:20.996738+0000","last_fullsized":"2023-10-16T13:38:20.996738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312178+0000","last_change":"2023-10-16T13:38:19.994384+0000","last_active":"2023-10-16T13:38:21.312178+0000","last_peered":"2023-10-16T13:38:21.312178+0000","last_clean":"2023-10-16T13:38:21.312178+0000","last_became_active":"2023-10-16T13:38:19.993971+0000","last_became_peered":"2023-10-16T13:38:19.993971+0000","last_unstale":"2023-10-16T13:38:21.312178+0000","last_undegraded":"2023-10-16T13:38:21.312178+0000","last_fullsized":"2023-10-16T13:38:21.312178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397908+0000","last_change":"2023-10-16T13:38:19.995124+0000","last_active":"2023-10-16T13:38:21.397908+0000","last_peered":"2023-10-16T13:38:21.397908+0000","last_clean":"2023-10-16T13:38:21.397908+0000","last_became_active":"2023-10-16T13:38:19.994763+0000","last_became_peered":"2023-10-16T13:38:19.994763+0000","last_unstale":"2023-10-16T13:38:21.397908+0000","last_undegraded":"2023-10-16T13:38:21.397908+0000","last_fullsized":"2023-10-16T13:38:21.397908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312737+0000","last_change":"2023-10-16T13:38:19.992050+0000","last_active":"2023-10-16T13:38:21.312737+0000","last_peered":"2023-10-16T13:38:21.312737+0000","last_clean":"2023-10-16T13:38:21.312737+0000","last_became_active":"2023-10-16T13:38:19.991296+0000","last_became_peered":"2023-10-16T13:38:19.991296+0000","last_unstale":"2023-10-16T13:38:21.312737+0000","last_undegraded":"2023-10-16T13:38:21.312737+0000","last_fullsized":"2023-10-16T13:38:21.312737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:16.455246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876286+0000","last_change":"2023-10-16T13:38:19.998323+0000","last_active":"2023-10-16T13:38:21.876286+0000","last_peered":"2023-10-16T13:38:21.876286+0000","last_clean":"2023-10-16T13:38:21.876286+0000","last_became_active":"2023-10-16T13:38:19.998022+0000","last_became_peered":"2023-10-16T13:38:19.998022+0000","last_unstale":"2023-10-16T13:38:21.876286+0000","last_undegraded":"2023-10-16T13:38:21.876286+0000","last_fullsized":"2023-10-16T13:38:21.876286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876144+0000","last_change":"2023-10-16T13:38:19.998317+0000","last_active":"2023-10-16T13:38:21.876144+0000","last_peered":"2023-10-16T13:38:21.876144+0000","last_clean":"2023-10-16T13:38:21.876144+0000","last_became_active":"2023-10-16T13:38:19.998043+0000","last_became_peered":"2023-10-16T13:38:19.998043+0000","last_unstale":"2023-10-16T13:38:21.876144+0000","last_undegraded":"2023-10-16T13:38:21.876144+0000","last_fullsized":"2023-10-16T13:38:21.876144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997767+0000","last_change":"2023-10-16T13:38:19.985697+0000","last_active":"2023-10-16T13:38:20.997767+0000","last_peered":"2023-10-16T13:38:20.997767+0000","last_clean":"2023-10-16T13:38:20.997767+0000","last_became_active":"2023-10-16T13:38:19.985438+0000","last_became_peered":"2023-10-16T13:38:19.985438+0000","last_unstale":"2023-10-16T13:38:20.997767+0000","last_undegraded":"2023-10-16T13:38:20.997767+0000","last_fullsized":"2023-10-16T13:38:20.997767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:17.751681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398231+0000","last_change":"2023-10-16T13:38:19.984535+0000","last_active":"2023-10-16T13:38:21.398231+0000","last_peered":"2023-10-16T13:38:21.398231+0000","last_clean":"2023-10-16T13:38:21.398231+0000","last_became_active":"2023-10-16T13:38:19.984237+0000","last_became_peered":"2023-10-16T13:38:19.984237+0000","last_unstale":"2023-10-16T13:38:21.398231+0000","last_undegraded":"2023-10-16T13:38:21.398231+0000","last_fullsized":"2023-10-16T13:38:21.398231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417158+0000","last_change":"2023-10-16T13:38:19.992598+0000","last_active":"2023-10-16T13:38:21.417158+0000","last_peered":"2023-10-16T13:38:21.417158+0000","last_clean":"2023-10-16T13:38:21.417158+0000","last_became_active":"2023-10-16T13:38:19.990440+0000","last_became_peered":"2023-10-16T13:38:19.990440+0000","last_unstale":"2023-10-16T13:38:21.417158+0000","last_undegraded":"2023-10-16T13:38:21.417158+0000","last_fullsized":"2023-10-16T13:38:21.417158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988246+0000","last_change":"2023-10-16T13:38:19.994076+0000","last_active":"2023-10-16T13:38:20.988246+0000","last_peered":"2023-10-16T13:38:20.988246+0000","last_clean":"2023-10-16T13:38:20.988246+0000","last_became_active":"2023-10-16T13:38:19.993816+0000","last_became_peered":"2023-10-16T13:38:19.993816+0000","last_unstale":"2023-10-16T13:38:20.988246+0000","last_undegraded":"2023-10-16T13:38:20.988246+0000","last_fullsized":"2023-10-16T13:38:20.988246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996244+0000","last_change":"2023-10-16T13:38:19.997326+0000","last_active":"2023-10-16T13:38:20.996244+0000","last_peered":"2023-10-16T13:38:20.996244+0000","last_clean":"2023-10-16T13:38:20.996244+0000","last_became_active":"2023-10-16T13:38:19.997047+0000","last_became_peered":"2023-10-16T13:38:19.997047+0000","last_unstale":"2023-10-16T13:38:20.996244+0000","last_undegraded":"2023-10-16T13:38:20.996244+0000","last_fullsized":"2023-10-16T13:38:20.996244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997157+0000","last_change":"2023-10-16T13:38:19.990024+0000","last_active":"2023-10-16T13:38:20.997157+0000","last_peered":"2023-10-16T13:38:20.997157+0000","last_clean":"2023-10-16T13:38:20.997157+0000","last_became_active":"2023-10-16T13:38:19.989585+0000","last_became_peered":"2023-10-16T13:38:19.989585+0000","last_unstale":"2023-10-16T13:38:20.997157+0000","last_undegraded":"2023-10-16T13:38:20.997157+0000","last_fullsized":"2023-10-16T13:38:20.997157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821413+0000","last_change":"2023-10-16T13:38:19.985061+0000","last_active":"2023-10-16T13:38:21.821413+0000","last_peered":"2023-10-16T13:38:21.821413+0000","last_clean":"2023-10-16T13:38:21.821413+0000","last_became_active":"2023-10-16T13:38:19.984723+0000","last_became_peered":"2023-10-16T13:38:19.984723+0000","last_unstale":"2023-10-16T13:38:21.821413+0000","last_undegraded":"2023-10-16T13:38:21.821413+0000","last_fullsized":"2023-10-16T13:38:21.821413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:40.348223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312495+0000","last_change":"2023-10-16T13:38:19.986577+0000","last_active":"2023-10-16T13:38:21.312495+0000","last_peered":"2023-10-16T13:38:21.312495+0000","last_clean":"2023-10-16T13:38:21.312495+0000","last_became_active":"2023-10-16T13:38:19.986061+0000","last_became_peered":"2023-10-16T13:38:19.986061+0000","last_unstale":"2023-10-16T13:38:21.312495+0000","last_undegraded":"2023-10-16T13:38:21.312495+0000","last_fullsized":"2023-10-16T13:38:21.312495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.008095+0000","last_change":"2023-10-16T13:38:18.965787+0000","last_active":"2023-10-16T13:38:20.008095+0000","last_peered":"2023-10-16T13:38:20.008095+0000","last_clean":"2023-10-16T13:38:20.008095+0000","last_became_active":"2023-10-16T13:38:18.965323+0000","last_became_peered":"2023-10-16T13:38:18.965323+0000","last_unstale":"2023-10-16T13:38:20.008095+0000","last_undegraded":"2023-10-16T13:38:20.008095+0000","last_fullsized":"2023-10-16T13:38:20.008095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398158+0000","last_change":"2023-10-16T13:38:19.985506+0000","last_active":"2023-10-16T13:38:21.398158+0000","last_peered":"2023-10-16T13:38:21.398158+0000","last_clean":"2023-10-16T13:38:21.398158+0000","last_became_active":"2023-10-16T13:38:19.985155+0000","last_became_peered":"2023-10-16T13:38:19.985155+0000","last_unstale":"2023-10-16T13:38:21.398158+0000","last_undegraded":"2023-10-16T13:38:21.398158+0000","last_fullsized":"2023-10-16T13:38:21.398158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002649+0000","last_change":"2023-10-16T13:38:18.965668+0000","last_active":"2023-10-16T13:38:20.002649+0000","last_peered":"2023-10-16T13:38:20.002649+0000","last_clean":"2023-10-16T13:38:20.002649+0000","last_became_active":"2023-10-16T13:38:18.965214+0000","last_became_peered":"2023-10-16T13:38:18.965214+0000","last_unstale":"2023-10-16T13:38:20.002649+0000","last_undegraded":"2023-10-16T13:38:20.002649+0000","last_fullsized":"2023-10-16T13:38:20.002649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417258+0000","last_change":"2023-10-16T13:38:19.997063+0000","last_active":"2023-10-16T13:38:21.417258+0000","last_peered":"2023-10-16T13:38:21.417258+0000","last_clean":"2023-10-16T13:38:21.417258+0000","last_became_active":"2023-10-16T13:38:19.996754+0000","last_became_peered":"2023-10-16T13:38:19.996754+0000","last_unstale":"2023-10-16T13:38:21.417258+0000","last_undegraded":"2023-10-16T13:38:21.417258+0000","last_fullsized":"2023-10-16T13:38:21.417258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000617+0000","last_change":"2023-10-16T13:38:18.968962+0000","last_active":"2023-10-16T13:38:20.000617+0000","last_peered":"2023-10-16T13:38:20.000617+0000","last_clean":"2023-10-16T13:38:20.000617+0000","last_became_active":"2023-10-16T13:38:18.968414+0000","last_became_peered":"2023-10-16T13:38:18.968414+0000","last_unstale":"2023-10-16T13:38:20.000617+0000","last_undegraded":"2023-10-16T13:38:20.000617+0000","last_fullsized":"2023-10-16T13:38:20.000617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:42.951075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997004+0000","last_change":"2023-10-16T13:38:19.996471+0000","last_active":"2023-10-16T13:38:20.997004+0000","last_peered":"2023-10-16T13:38:20.997004+0000","last_clean":"2023-10-16T13:38:20.997004+0000","last_became_active":"2023-10-16T13:38:19.994710+0000","last_became_peered":"2023-10-16T13:38:19.994710+0000","last_unstale":"2023-10-16T13:38:20.997004+0000","last_undegraded":"2023-10-16T13:38:20.997004+0000","last_fullsized":"2023-10-16T13:38:20.997004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002919+0000","last_change":"2023-10-16T13:38:18.964941+0000","last_active":"2023-10-16T13:38:20.002919+0000","last_peered":"2023-10-16T13:38:20.002919+0000","last_clean":"2023-10-16T13:38:20.002919+0000","last_became_active":"2023-10-16T13:38:18.964675+0000","last_became_peered":"2023-10-16T13:38:18.964675+0000","last_unstale":"2023-10-16T13:38:20.002919+0000","last_undegraded":"2023-10-16T13:38:20.002919+0000","last_fullsized":"2023-10-16T13:38:20.002919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:03.073989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997402+0000","last_change":"2023-10-16T13:38:19.989785+0000","last_active":"2023-10-16T13:38:20.997402+0000","last_peered":"2023-10-16T13:38:20.997402+0000","last_clean":"2023-10-16T13:38:20.997402+0000","last_became_active":"2023-10-16T13:38:19.989508+0000","last_became_peered":"2023-10-16T13:38:19.989508+0000","last_unstale":"2023-10-16T13:38:20.997402+0000","last_undegraded":"2023-10-16T13:38:20.997402+0000","last_fullsized":"2023-10-16T13:38:20.997402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002679+0000","last_change":"2023-10-16T13:38:18.966501+0000","last_active":"2023-10-16T13:38:20.002679+0000","last_peered":"2023-10-16T13:38:20.002679+0000","last_clean":"2023-10-16T13:38:20.002679+0000","last_became_active":"2023-10-16T13:38:18.966198+0000","last_became_peered":"2023-10-16T13:38:18.966198+0000","last_unstale":"2023-10-16T13:38:20.002679+0000","last_undegraded":"2023-10-16T13:38:20.002679+0000","last_fullsized":"2023-10-16T13:38:20.002679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:16.747902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996442+0000","last_change":"2023-10-16T13:38:19.987636+0000","last_active":"2023-10-16T13:38:20.996442+0000","last_peered":"2023-10-16T13:38:20.996442+0000","last_clean":"2023-10-16T13:38:20.996442+0000","last_became_active":"2023-10-16T13:38:19.986780+0000","last_became_peered":"2023-10-16T13:38:19.986780+0000","last_unstale":"2023-10-16T13:38:20.996442+0000","last_undegraded":"2023-10-16T13:38:20.996442+0000","last_fullsized":"2023-10-16T13:38:20.996442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:04.661176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.999597+0000","last_change":"2023-10-16T13:38:18.965928+0000","last_active":"2023-10-16T13:38:19.999597+0000","last_peered":"2023-10-16T13:38:19.999597+0000","last_clean":"2023-10-16T13:38:19.999597+0000","last_became_active":"2023-10-16T13:38:18.964562+0000","last_became_peered":"2023-10-16T13:38:18.964562+0000","last_unstale":"2023-10-16T13:38:19.999597+0000","last_undegraded":"2023-10-16T13:38:19.999597+0000","last_fullsized":"2023-10-16T13:38:19.999597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417479+0000","last_change":"2023-10-16T13:38:19.992457+0000","last_active":"2023-10-16T13:38:21.417479+0000","last_peered":"2023-10-16T13:38:21.417479+0000","last_clean":"2023-10-16T13:38:21.417479+0000","last_became_active":"2023-10-16T13:38:19.992036+0000","last_became_peered":"2023-10-16T13:38:19.992036+0000","last_unstale":"2023-10-16T13:38:21.417479+0000","last_undegraded":"2023-10-16T13:38:21.417479+0000","last_fullsized":"2023-10-16T13:38:21.417479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:26:29.912198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.974530+0000","last_change":"2023-10-16T13:38:18.968885+0000","last_active":"2023-10-16T13:38:19.974530+0000","last_peered":"2023-10-16T13:38:19.974530+0000","last_clean":"2023-10-16T13:38:19.974530+0000","last_became_active":"2023-10-16T13:38:18.968534+0000","last_became_peered":"2023-10-16T13:38:18.968534+0000","last_unstale":"2023-10-16T13:38:19.974530+0000","last_undegraded":"2023-10-16T13:38:19.974530+0000","last_fullsized":"2023-10-16T13:38:19.974530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398198+0000","last_change":"2023-10-16T13:38:19.993434+0000","last_active":"2023-10-16T13:38:21.398198+0000","last_peered":"2023-10-16T13:38:21.398198+0000","last_clean":"2023-10-16T13:38:21.398198+0000","last_became_active":"2023-10-16T13:38:19.993043+0000","last_became_peered":"2023-10-16T13:38:19.993043+0000","last_unstale":"2023-10-16T13:38:21.398198+0000","last_undegraded":"2023-10-16T13:38:21.398198+0000","last_fullsized":"2023-10-16T13:38:21.398198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980065+0000","last_change":"2023-10-16T13:38:18.955699+0000","last_active":"2023-10-16T13:38:19.980065+0000","last_peered":"2023-10-16T13:38:19.980065+0000","last_clean":"2023-10-16T13:38:19.980065+0000","last_became_active":"2023-10-16T13:38:18.955087+0000","last_became_peered":"2023-10-16T13:38:18.955087+0000","last_unstale":"2023-10-16T13:38:19.980065+0000","last_undegraded":"2023-10-16T13:38:19.980065+0000","last_fullsized":"2023-10-16T13:38:19.980065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.979256+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.978905+0000","last_became_peered":"2023-10-16T13:38:19.978905+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.977616+0000","last_change":"2023-10-16T13:38:18.966953+0000","last_active":"2023-10-16T13:38:19.977616+0000","last_peered":"2023-10-16T13:38:19.977616+0000","last_clean":"2023-10-16T13:38:19.977616+0000","last_became_active":"2023-10-16T13:38:18.966671+0000","last_became_peered":"2023-10-16T13:38:18.966671+0000","last_unstale":"2023-10-16T13:38:19.977616+0000","last_undegraded":"2023-10-16T13:38:19.977616+0000","last_fullsized":"2023-10-16T13:38:19.977616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:39.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997077+0000","last_change":"2023-10-16T13:38:19.996864+0000","last_active":"2023-10-16T13:38:20.997077+0000","last_peered":"2023-10-16T13:38:20.997077+0000","last_clean":"2023-10-16T13:38:20.997077+0000","last_became_active":"2023-10-16T13:38:19.996566+0000","last_became_peered":"2023-10-16T13:38:19.996566+0000","last_unstale":"2023-10-16T13:38:20.997077+0000","last_undegraded":"2023-10-16T13:38:20.997077+0000","last_fullsized":"2023-10-16T13:38:20.997077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980833+0000","last_change":"2023-10-16T13:38:18.965714+0000","last_active":"2023-10-16T13:38:19.980833+0000","last_peered":"2023-10-16T13:38:19.980833+0000","last_clean":"2023-10-16T13:38:19.980833+0000","last_became_active":"2023-10-16T13:38:18.965358+0000","last_became_peered":"2023-10-16T13:38:18.965358+0000","last_unstale":"2023-10-16T13:38:19.980833+0000","last_undegraded":"2023-10-16T13:38:19.980833+0000","last_fullsized":"2023-10-16T13:38:19.980833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:41.112357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417437+0000","last_change":"2023-10-16T13:38:19.997120+0000","last_active":"2023-10-16T13:38:21.417437+0000","last_peered":"2023-10-16T13:38:21.417437+0000","last_clean":"2023-10-16T13:38:21.417437+0000","last_became_active":"2023-10-16T13:38:19.996803+0000","last_became_peered":"2023-10-16T13:38:19.996803+0000","last_unstale":"2023-10-16T13:38:21.417437+0000","last_undegraded":"2023-10-16T13:38:21.417437+0000","last_fullsized":"2023-10-16T13:38:21.417437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002233+0000","last_change":"2023-10-16T13:38:18.970973+0000","last_active":"2023-10-16T13:38:20.002233+0000","last_peered":"2023-10-16T13:38:20.002233+0000","last_clean":"2023-10-16T13:38:20.002233+0000","last_became_active":"2023-10-16T13:38:18.970277+0000","last_became_peered":"2023-10-16T13:38:18.970277+0000","last_unstale":"2023-10-16T13:38:20.002233+0000","last_undegraded":"2023-10-16T13:38:20.002233+0000","last_fullsized":"2023-10-16T13:38:20.002233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:45.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997634+0000","last_change":"2023-10-16T13:38:19.995792+0000","last_active":"2023-10-16T13:38:20.997634+0000","last_peered":"2023-10-16T13:38:20.997634+0000","last_clean":"2023-10-16T13:38:20.997634+0000","last_became_active":"2023-10-16T13:38:19.995382+0000","last_became_peered":"2023-10-16T13:38:19.995382+0000","last_unstale":"2023-10-16T13:38:20.997634+0000","last_undegraded":"2023-10-16T13:38:20.997634+0000","last_fullsized":"2023-10-16T13:38:20.997634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:04.077768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.005046+0000","last_change":"2023-10-16T13:38:18.966915+0000","last_active":"2023-10-16T13:38:20.005046+0000","last_peered":"2023-10-16T13:38:20.005046+0000","last_clean":"2023-10-16T13:38:20.005046+0000","last_became_active":"2023-10-16T13:38:18.966651+0000","last_became_peered":"2023-10-16T13:38:18.966651+0000","last_unstale":"2023-10-16T13:38:20.005046+0000","last_undegraded":"2023-10-16T13:38:20.005046+0000","last_fullsized":"2023-10-16T13:38:20.005046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:48.542445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312472+0000","last_change":"2023-10-16T13:38:19.990649+0000","last_active":"2023-10-16T13:38:21.312472+0000","last_peered":"2023-10-16T13:38:21.312472+0000","last_clean":"2023-10-16T13:38:21.312472+0000","last_became_active":"2023-10-16T13:38:19.990367+0000","last_became_peered":"2023-10-16T13:38:19.990367+0000","last_unstale":"2023-10-16T13:38:21.312472+0000","last_undegraded":"2023-10-16T13:38:21.312472+0000","last_fullsized":"2023-10-16T13:38:21.312472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:06:23.092215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001177+0000","last_change":"2023-10-16T13:38:18.966144+0000","last_active":"2023-10-16T13:38:20.001177+0000","last_peered":"2023-10-16T13:38:20.001177+0000","last_clean":"2023-10-16T13:38:20.001177+0000","last_became_active":"2023-10-16T13:38:18.965756+0000","last_became_peered":"2023-10-16T13:38:18.965756+0000","last_unstale":"2023-10-16T13:38:20.001177+0000","last_undegraded":"2023-10-16T13:38:20.001177+0000","last_fullsized":"2023-10-16T13:38:20.001177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417086+0000","last_change":"2023-10-16T13:38:19.993169+0000","last_active":"2023-10-16T13:38:21.417086+0000","last_peered":"2023-10-16T13:38:21.417086+0000","last_clean":"2023-10-16T13:38:21.417086+0000","last_became_active":"2023-10-16T13:38:19.992834+0000","last_became_peered":"2023-10-16T13:38:19.992834+0000","last_unstale":"2023-10-16T13:38:21.417086+0000","last_undegraded":"2023-10-16T13:38:21.417086+0000","last_fullsized":"2023-10-16T13:38:21.417086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:25.539196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980640+0000","last_change":"2023-10-16T13:38:18.966091+0000","last_active":"2023-10-16T13:38:19.980640+0000","last_peered":"2023-10-16T13:38:19.980640+0000","last_clean":"2023-10-16T13:38:19.980640+0000","last_became_active":"2023-10-16T13:38:18.965722+0000","last_became_peered":"2023-10-16T13:38:18.965722+0000","last_unstale":"2023-10-16T13:38:19.980640+0000","last_undegraded":"2023-10-16T13:38:19.980640+0000","last_fullsized":"2023-10-16T13:38:19.980640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312449+0000","last_change":"2023-10-16T13:38:19.987249+0000","last_active":"2023-10-16T13:38:21.312449+0000","last_peered":"2023-10-16T13:38:21.312449+0000","last_clean":"2023-10-16T13:38:21.312449+0000","last_became_active":"2023-10-16T13:38:19.986977+0000","last_became_peered":"2023-10-16T13:38:19.986977+0000","last_unstale":"2023-10-16T13:38:21.312449+0000","last_undegraded":"2023-10-16T13:38:21.312449+0000","last_fullsized":"2023-10-16T13:38:21.312449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:52.192736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.975945+0000","last_change":"2023-10-16T13:38:18.965295+0000","last_active":"2023-10-16T13:38:19.975945+0000","last_peered":"2023-10-16T13:38:19.975945+0000","last_clean":"2023-10-16T13:38:19.975945+0000","last_became_active":"2023-10-16T13:38:18.964991+0000","last_became_peered":"2023-10-16T13:38:18.964991+0000","last_unstale":"2023-10-16T13:38:19.975945+0000","last_undegraded":"2023-10-16T13:38:19.975945+0000","last_fullsized":"2023-10-16T13:38:19.975945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875921+0000","last_change":"2023-10-16T13:38:19.993337+0000","last_active":"2023-10-16T13:38:21.875921+0000","last_peered":"2023-10-16T13:38:21.875921+0000","last_clean":"2023-10-16T13:38:21.875921+0000","last_became_active":"2023-10-16T13:38:19.993037+0000","last_became_peered":"2023-10-16T13:38:19.993037+0000","last_unstale":"2023-10-16T13:38:21.875921+0000","last_undegraded":"2023-10-16T13:38:21.875921+0000","last_fullsized":"2023-10-16T13:38:21.875921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002049+0000","last_change":"2023-10-16T13:38:18.971941+0000","last_active":"2023-10-16T13:38:20.002049+0000","last_peered":"2023-10-16T13:38:20.002049+0000","last_clean":"2023-10-16T13:38:20.002049+0000","last_became_active":"2023-10-16T13:38:18.971486+0000","last_became_peered":"2023-10-16T13:38:18.971486+0000","last_unstale":"2023-10-16T13:38:20.002049+0000","last_undegraded":"2023-10-16T13:38:20.002049+0000","last_fullsized":"2023-10-16T13:38:20.002049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:55.029520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312272+0000","last_change":"2023-10-16T13:38:19.995763+0000","last_active":"2023-10-16T13:38:21.312272+0000","last_peered":"2023-10-16T13:38:21.312272+0000","last_clean":"2023-10-16T13:38:21.312272+0000","last_became_active":"2023-10-16T13:38:19.994356+0000","last_became_peered":"2023-10-16T13:38:19.994356+0000","last_unstale":"2023-10-16T13:38:21.312272+0000","last_undegraded":"2023-10-16T13:38:21.312272+0000","last_fullsized":"2023-10-16T13:38:21.312272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.002621+0000","last_change":"2023-10-16T13:38:18.964587+0000","last_active":"2023-10-16T13:38:20.002621+0000","last_peered":"2023-10-16T13:38:20.002621+0000","last_clean":"2023-10-16T13:38:20.002621+0000","last_became_active":"2023-10-16T13:38:18.964045+0000","last_became_peered":"2023-10-16T13:38:18.964045+0000","last_unstale":"2023-10-16T13:38:20.002621+0000","last_undegraded":"2023-10-16T13:38:20.002621+0000","last_fullsized":"2023-10-16T13:38:20.002621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312674+0000","last_change":"2023-10-16T13:38:19.987703+0000","last_active":"2023-10-16T13:38:21.312674+0000","last_peered":"2023-10-16T13:38:21.312674+0000","last_clean":"2023-10-16T13:38:21.312674+0000","last_became_active":"2023-10-16T13:38:19.987424+0000","last_became_peered":"2023-10-16T13:38:19.987424+0000","last_unstale":"2023-10-16T13:38:21.312674+0000","last_undegraded":"2023-10-16T13:38:21.312674+0000","last_fullsized":"2023-10-16T13:38:21.312674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.976739+0000","last_change":"2023-10-16T13:38:18.971397+0000","last_active":"2023-10-16T13:38:19.976739+0000","last_peered":"2023-10-16T13:38:19.976739+0000","last_clean":"2023-10-16T13:38:19.976739+0000","last_became_active":"2023-10-16T13:38:18.970730+0000","last_became_peered":"2023-10-16T13:38:18.970730+0000","last_unstale":"2023-10-16T13:38:19.976739+0000","last_undegraded":"2023-10-16T13:38:19.976739+0000","last_fullsized":"2023-10-16T13:38:19.976739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:07.190464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997490+0000","last_change":"2023-10-16T13:38:19.989906+0000","last_active":"2023-10-16T13:38:20.997490+0000","last_peered":"2023-10-16T13:38:20.997490+0000","last_clean":"2023-10-16T13:38:20.997490+0000","last_became_active":"2023-10-16T13:38:19.989392+0000","last_became_peered":"2023-10-16T13:38:19.989392+0000","last_unstale":"2023-10-16T13:38:20.997490+0000","last_undegraded":"2023-10-16T13:38:20.997490+0000","last_fullsized":"2023-10-16T13:38:20.997490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:46.269176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980449+0000","last_change":"2023-10-16T13:38:18.971405+0000","last_active":"2023-10-16T13:38:19.980449+0000","last_peered":"2023-10-16T13:38:19.980449+0000","last_clean":"2023-10-16T13:38:19.980449+0000","last_became_active":"2023-10-16T13:38:18.970833+0000","last_became_peered":"2023-10-16T13:38:18.970833+0000","last_unstale":"2023-10-16T13:38:19.980449+0000","last_undegraded":"2023-10-16T13:38:19.980449+0000","last_fullsized":"2023-10-16T13:38:19.980449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.527487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996443+0000","last_change":"2023-10-16T13:38:19.994155+0000","last_active":"2023-10-16T13:38:20.996443+0000","last_peered":"2023-10-16T13:38:20.996443+0000","last_clean":"2023-10-16T13:38:20.996443+0000","last_became_active":"2023-10-16T13:38:19.993613+0000","last_became_peered":"2023-10-16T13:38:19.993613+0000","last_unstale":"2023-10-16T13:38:20.996443+0000","last_undegraded":"2023-10-16T13:38:20.996443+0000","last_fullsized":"2023-10-16T13:38:20.996443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:42.991395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988581+0000","last_change":"2023-10-16T13:38:19.985531+0000","last_active":"2023-10-16T13:38:20.988581+0000","last_peered":"2023-10-16T13:38:20.988581+0000","last_clean":"2023-10-16T13:38:20.988581+0000","last_became_active":"2023-10-16T13:38:19.985266+0000","last_became_peered":"2023-10-16T13:38:19.985266+0000","last_unstale":"2023-10-16T13:38:20.988581+0000","last_undegraded":"2023-10-16T13:38:20.988581+0000","last_fullsized":"2023-10-16T13:38:20.988581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972216+0000","last_change":"2023-10-16T13:38:18.964493+0000","last_active":"2023-10-16T13:38:19.972216+0000","last_peered":"2023-10-16T13:38:19.972216+0000","last_clean":"2023-10-16T13:38:19.972216+0000","last_became_active":"2023-10-16T13:38:18.964187+0000","last_became_peered":"2023-10-16T13:38:18.964187+0000","last_unstale":"2023-10-16T13:38:19.972216+0000","last_undegraded":"2023-10-16T13:38:19.972216+0000","last_fullsized":"2023-10-16T13:38:19.972216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:35:04.993934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398312+0000","last_change":"2023-10-16T13:38:19.997708+0000","last_active":"2023-10-16T13:38:21.398312+0000","last_peered":"2023-10-16T13:38:21.398312+0000","last_clean":"2023-10-16T13:38:21.398312+0000","last_became_active":"2023-10-16T13:38:19.997371+0000","last_became_peered":"2023-10-16T13:38:19.997371+0000","last_unstale":"2023-10-16T13:38:21.398312+0000","last_undegraded":"2023-10-16T13:38:21.398312+0000","last_fullsized":"2023-10-16T13:38:21.398312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.980595+0000","last_change":"2023-10-16T13:38:18.954177+0000","last_active":"2023-10-16T13:38:19.980595+0000","last_peered":"2023-10-16T13:38:19.980595+0000","last_clean":"2023-10-16T13:38:19.980595+0000","last_became_active":"2023-10-16T13:38:18.953859+0000","last_became_peered":"2023-10-16T13:38:18.953859+0000","last_unstale":"2023-10-16T13:38:19.980595+0000","last_undegraded":"2023-10-16T13:38:19.980595+0000","last_fullsized":"2023-10-16T13:38:19.980595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:07.912567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972935+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:38:19.972935+0000","last_peered":"2023-10-16T13:38:19.972935+0000","last_clean":"2023-10-16T13:38:19.972935+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:38:19.972935+0000","last_undegraded":"2023-10-16T13:38:19.972935+0000","last_fullsized":"2023-10-16T13:38:19.972935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417024+0000","last_change":"2023-10-16T13:38:19.989240+0000","last_active":"2023-10-16T13:38:21.417024+0000","last_peered":"2023-10-16T13:38:21.417024+0000","last_clean":"2023-10-16T13:38:21.417024+0000","last_became_active":"2023-10-16T13:38:19.988888+0000","last_became_peered":"2023-10-16T13:38:19.988888+0000","last_unstale":"2023-10-16T13:38:21.417024+0000","last_undegraded":"2023-10-16T13:38:21.417024+0000","last_fullsized":"2023-10-16T13:38:21.417024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:46.323232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973036+0000","last_change":"2023-10-16T13:38:18.971283+0000","last_active":"2023-10-16T13:38:19.973036+0000","last_peered":"2023-10-16T13:38:19.973036+0000","last_clean":"2023-10-16T13:38:19.973036+0000","last_became_active":"2023-10-16T13:38:18.970896+0000","last_became_peered":"2023-10-16T13:38:18.970896+0000","last_unstale":"2023-10-16T13:38:19.973036+0000","last_undegraded":"2023-10-16T13:38:19.973036+0000","last_fullsized":"2023-10-16T13:38:19.973036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.978893+0000","last_change":"2023-10-16T13:38:18.969135+0000","last_active":"2023-10-16T13:38:19.978893+0000","last_peered":"2023-10-16T13:38:19.978893+0000","last_clean":"2023-10-16T13:38:19.978893+0000","last_became_active":"2023-10-16T13:38:18.968811+0000","last_became_peered":"2023-10-16T13:38:18.968811+0000","last_unstale":"2023-10-16T13:38:19.978893+0000","last_undegraded":"2023-10-16T13:38:19.978893+0000","last_fullsized":"2023-10-16T13:38:19.978893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:32.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988509+0000","last_change":"2023-10-16T13:38:19.987139+0000","last_active":"2023-10-16T13:38:20.988509+0000","last_peered":"2023-10-16T13:38:20.988509+0000","last_clean":"2023-10-16T13:38:20.988509+0000","last_became_active":"2023-10-16T13:38:19.986018+0000","last_became_peered":"2023-10-16T13:38:19.986018+0000","last_unstale":"2023-10-16T13:38:20.988509+0000","last_undegraded":"2023-10-16T13:38:20.988509+0000","last_fullsized":"2023-10-16T13:38:20.988509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988441+0000","last_change":"2023-10-16T13:38:18.969084+0000","last_active":"2023-10-16T13:38:20.988441+0000","last_peered":"2023-10-16T13:38:20.988441+0000","last_clean":"2023-10-16T13:38:20.988441+0000","last_became_active":"2023-10-16T13:38:18.968714+0000","last_became_peered":"2023-10-16T13:38:18.968714+0000","last_unstale":"2023-10-16T13:38:20.988441+0000","last_undegraded":"2023-10-16T13:38:20.988441+0000","last_fullsized":"2023-10-16T13:38:20.988441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398414+0000","last_change":"2023-10-16T13:38:19.987735+0000","last_active":"2023-10-16T13:38:21.398414+0000","last_peered":"2023-10-16T13:38:21.398414+0000","last_clean":"2023-10-16T13:38:21.398414+0000","last_became_active":"2023-10-16T13:38:19.986959+0000","last_became_peered":"2023-10-16T13:38:19.986959+0000","last_unstale":"2023-10-16T13:38:21.398414+0000","last_undegraded":"2023-10-16T13:38:21.398414+0000","last_fullsized":"2023-10-16T13:38:21.398414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000677+0000","last_change":"2023-10-16T13:38:18.967312+0000","last_active":"2023-10-16T13:38:20.000677+0000","last_peered":"2023-10-16T13:38:20.000677+0000","last_clean":"2023-10-16T13:38:20.000677+0000","last_became_active":"2023-10-16T13:38:18.966996+0000","last_became_peered":"2023-10-16T13:38:18.966996+0000","last_unstale":"2023-10-16T13:38:20.000677+0000","last_undegraded":"2023-10-16T13:38:20.000677+0000","last_fullsized":"2023-10-16T13:38:20.000677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417342+0000","last_change":"2023-10-16T13:38:19.991995+0000","last_active":"2023-10-16T13:38:21.417342+0000","last_peered":"2023-10-16T13:38:21.417342+0000","last_clean":"2023-10-16T13:38:21.417342+0000","last_became_active":"2023-10-16T13:38:19.991675+0000","last_became_peered":"2023-10-16T13:38:19.991675+0000","last_unstale":"2023-10-16T13:38:21.417342+0000","last_undegraded":"2023-10-16T13:38:21.417342+0000","last_fullsized":"2023-10-16T13:38:21.417342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972826+0000","last_change":"2023-10-16T13:38:18.965736+0000","last_active":"2023-10-16T13:38:19.972826+0000","last_peered":"2023-10-16T13:38:19.972826+0000","last_clean":"2023-10-16T13:38:19.972826+0000","last_became_active":"2023-10-16T13:38:18.965488+0000","last_became_peered":"2023-10-16T13:38:18.965488+0000","last_unstale":"2023-10-16T13:38:19.972826+0000","last_undegraded":"2023-10-16T13:38:19.972826+0000","last_fullsized":"2023-10-16T13:38:19.972826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997267+0000","last_change":"2023-10-16T13:38:19.988592+0000","last_active":"2023-10-16T13:38:20.997267+0000","last_peered":"2023-10-16T13:38:20.997267+0000","last_clean":"2023-10-16T13:38:20.997267+0000","last_became_active":"2023-10-16T13:38:19.988222+0000","last_became_peered":"2023-10-16T13:38:19.988222+0000","last_unstale":"2023-10-16T13:38:20.997267+0000","last_undegraded":"2023-10-16T13:38:20.997267+0000","last_fullsized":"2023-10-16T13:38:20.997267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:09.486295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973837+0000","last_change":"2023-10-16T13:38:18.970765+0000","last_active":"2023-10-16T13:38:19.973837+0000","last_peered":"2023-10-16T13:38:19.973837+0000","last_clean":"2023-10-16T13:38:19.973837+0000","last_became_active":"2023-10-16T13:38:18.970373+0000","last_became_peered":"2023-10-16T13:38:18.970373+0000","last_unstale":"2023-10-16T13:38:19.973837+0000","last_undegraded":"2023-10-16T13:38:19.973837+0000","last_fullsized":"2023-10-16T13:38:19.973837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:41.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.397986+0000","last_change":"2023-10-16T13:38:19.987493+0000","last_active":"2023-10-16T13:38:21.397986+0000","last_peered":"2023-10-16T13:38:21.397986+0000","last_clean":"2023-10-16T13:38:21.397986+0000","last_became_active":"2023-10-16T13:38:19.987196+0000","last_became_peered":"2023-10-16T13:38:19.987196+0000","last_unstale":"2023-10-16T13:38:21.397986+0000","last_undegraded":"2023-10-16T13:38:21.397986+0000","last_fullsized":"2023-10-16T13:38:21.397986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.972485+0000","last_change":"2023-10-16T13:38:18.971500+0000","last_active":"2023-10-16T13:38:19.972485+0000","last_peered":"2023-10-16T13:38:19.972485+0000","last_clean":"2023-10-16T13:38:19.972485+0000","last_became_active":"2023-10-16T13:38:18.971072+0000","last_became_peered":"2023-10-16T13:38:18.971072+0000","last_unstale":"2023-10-16T13:38:19.972485+0000","last_undegraded":"2023-10-16T13:38:19.972485+0000","last_fullsized":"2023-10-16T13:38:19.972485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:41.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398558+0000","last_change":"2023-10-16T13:38:19.993658+0000","last_active":"2023-10-16T13:38:21.398558+0000","last_peered":"2023-10-16T13:38:21.398558+0000","last_clean":"2023-10-16T13:38:21.398558+0000","last_became_active":"2023-10-16T13:38:19.993109+0000","last_became_peered":"2023-10-16T13:38:19.993109+0000","last_unstale":"2023-10-16T13:38:21.398558+0000","last_undegraded":"2023-10-16T13:38:21.398558+0000","last_fullsized":"2023-10-16T13:38:21.398558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:19.935113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.000611+0000","last_change":"2023-10-16T13:38:18.969196+0000","last_active":"2023-10-16T13:38:20.000611+0000","last_peered":"2023-10-16T13:38:20.000611+0000","last_clean":"2023-10-16T13:38:20.000611+0000","last_became_active":"2023-10-16T13:38:18.968947+0000","last_became_peered":"2023-10-16T13:38:18.968947+0000","last_unstale":"2023-10-16T13:38:20.000611+0000","last_undegraded":"2023-10-16T13:38:20.000611+0000","last_fullsized":"2023-10-16T13:38:20.000611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:24.535417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876093+0000","last_change":"2023-10-16T13:38:19.987465+0000","last_active":"2023-10-16T13:38:21.876093+0000","last_peered":"2023-10-16T13:38:21.876093+0000","last_clean":"2023-10-16T13:38:21.876093+0000","last_became_active":"2023-10-16T13:38:19.987060+0000","last_became_peered":"2023-10-16T13:38:19.987060+0000","last_unstale":"2023-10-16T13:38:21.876093+0000","last_undegraded":"2023-10-16T13:38:21.876093+0000","last_fullsized":"2023-10-16T13:38:21.876093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:59:33.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:19.973130+0000","last_change":"2023-10-16T13:38:18.955240+0000","last_active":"2023-10-16T13:38:19.973130+0000","last_peered":"2023-10-16T13:38:19.973130+0000","last_clean":"2023-10-16T13:38:19.973130+0000","last_became_active":"2023-10-16T13:38:18.954854+0000","last_became_peered":"2023-10-16T13:38:18.954854+0000","last_unstale":"2023-10-16T13:38:19.973130+0000","last_undegraded":"2023-10-16T13:38:19.973130+0000","last_fullsized":"2023-10-16T13:38:19.973130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:03.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312661+0000","last_change":"2023-10-16T13:38:19.999600+0000","last_active":"2023-10-16T13:38:21.312661+0000","last_peered":"2023-10-16T13:38:21.312661+0000","last_clean":"2023-10-16T13:38:21.312661+0000","last_became_active":"2023-10-16T13:38:19.999328+0000","last_became_peered":"2023-10-16T13:38:19.999328+0000","last_unstale":"2023-10-16T13:38:21.312661+0000","last_undegraded":"2023-10-16T13:38:21.312661+0000","last_fullsized":"2023-10-16T13:38:21.312661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:20.502169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.001300+0000","last_change":"2023-10-16T13:38:18.972416+0000","last_active":"2023-10-16T13:38:20.001300+0000","last_peered":"2023-10-16T13:38:20.001300+0000","last_clean":"2023-10-16T13:38:20.001300+0000","last_became_active":"2023-10-16T13:38:18.972134+0000","last_became_peered":"2023-10-16T13:38:18.972134+0000","last_unstale":"2023-10-16T13:38:20.001300+0000","last_undegraded":"2023-10-16T13:38:20.001300+0000","last_fullsized":"2023-10-16T13:38:20.001300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:29.505640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997167+0000","last_change":"2023-10-16T13:38:19.989464+0000","last_active":"2023-10-16T13:38:20.997167+0000","last_peered":"2023-10-16T13:38:20.997167+0000","last_clean":"2023-10-16T13:38:20.997167+0000","last_became_active":"2023-10-16T13:38:19.988949+0000","last_became_peered":"2023-10-16T13:38:19.988949+0000","last_unstale":"2023-10-16T13:38:20.997167+0000","last_undegraded":"2023-10-16T13:38:20.997167+0000","last_fullsized":"2023-10-16T13:38:20.997167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:44.344409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.003246+0000","last_change":"2023-10-16T13:38:18.962000+0000","last_active":"2023-10-16T13:38:20.003246+0000","last_peered":"2023-10-16T13:38:20.003246+0000","last_clean":"2023-10-16T13:38:20.003246+0000","last_became_active":"2023-10-16T13:38:18.961681+0000","last_became_peered":"2023-10-16T13:38:18.961681+0000","last_unstale":"2023-10-16T13:38:20.003246+0000","last_undegraded":"2023-10-16T13:38:20.003246+0000","last_fullsized":"2023-10-16T13:38:20.003246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:17.939845+0000","last_clean_scrub_stamp":"2023-10-16T13:38:17.939845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:08.482516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.312823+0000","last_change":"2023-10-16T13:38:19.991640+0000","last_active":"2023-10-16T13:38:21.312823+0000","last_peered":"2023-10-16T13:38:21.312823+0000","last_clean":"2023-10-16T13:38:21.312823+0000","last_became_active":"2023-10-16T13:38:19.990115+0000","last_became_peered":"2023-10-16T13:38:19.990115+0000","last_unstale":"2023-10-16T13:38:21.312823+0000","last_undegraded":"2023-10-16T13:38:21.312823+0000","last_fullsized":"2023-10-16T13:38:21.312823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:21:33.323265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.875839+0000","last_change":"2023-10-16T13:38:19.995109+0000","last_active":"2023-10-16T13:38:21.875839+0000","last_peered":"2023-10-16T13:38:21.875839+0000","last_clean":"2023-10-16T13:38:21.875839+0000","last_became_active":"2023-10-16T13:38:19.994801+0000","last_became_peered":"2023-10-16T13:38:19.994801+0000","last_unstale":"2023-10-16T13:38:21.875839+0000","last_undegraded":"2023-10-16T13:38:21.875839+0000","last_fullsized":"2023-10-16T13:38:21.875839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:08.194243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.821362+0000","last_change":"2023-10-16T13:38:19.990599+0000","last_active":"2023-10-16T13:38:21.821362+0000","last_peered":"2023-10-16T13:38:21.821362+0000","last_clean":"2023-10-16T13:38:21.821362+0000","last_became_active":"2023-10-16T13:38:19.990337+0000","last_became_peered":"2023-10-16T13:38:19.990337+0000","last_unstale":"2023-10-16T13:38:21.821362+0000","last_undegraded":"2023-10-16T13:38:21.821362+0000","last_fullsized":"2023-10-16T13:38:21.821362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:42.945644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996891+0000","last_change":"2023-10-16T13:38:19.996805+0000","last_active":"2023-10-16T13:38:20.996891+0000","last_peered":"2023-10-16T13:38:20.996891+0000","last_clean":"2023-10-16T13:38:20.996891+0000","last_became_active":"2023-10-16T13:38:19.996509+0000","last_became_peered":"2023-10-16T13:38:19.996509+0000","last_unstale":"2023-10-16T13:38:20.996891+0000","last_undegraded":"2023-10-16T13:38:20.996891+0000","last_fullsized":"2023-10-16T13:38:20.996891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:41.408100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417362+0000","last_change":"2023-10-16T13:38:19.992691+0000","last_active":"2023-10-16T13:38:21.417362+0000","last_peered":"2023-10-16T13:38:21.417362+0000","last_clean":"2023-10-16T13:38:21.417362+0000","last_became_active":"2023-10-16T13:38:19.992360+0000","last_became_peered":"2023-10-16T13:38:19.992360+0000","last_unstale":"2023-10-16T13:38:21.417362+0000","last_undegraded":"2023-10-16T13:38:21.417362+0000","last_fullsized":"2023-10-16T13:38:21.417362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398282+0000","last_change":"2023-10-16T13:38:19.985294+0000","last_active":"2023-10-16T13:38:21.398282+0000","last_peered":"2023-10-16T13:38:21.398282+0000","last_clean":"2023-10-16T13:38:21.398282+0000","last_became_active":"2023-10-16T13:38:19.985063+0000","last_became_peered":"2023-10-16T13:38:19.985063+0000","last_unstale":"2023-10-16T13:38:21.398282+0000","last_undegraded":"2023-10-16T13:38:21.398282+0000","last_fullsized":"2023-10-16T13:38:21.398282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:25.568080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.988353+0000","last_change":"2023-10-16T13:38:19.980791+0000","last_active":"2023-10-16T13:38:20.988353+0000","last_peered":"2023-10-16T13:38:20.988353+0000","last_clean":"2023-10-16T13:38:20.988353+0000","last_became_active":"2023-10-16T13:38:19.980473+0000","last_became_peered":"2023-10-16T13:38:19.980473+0000","last_unstale":"2023-10-16T13:38:20.988353+0000","last_undegraded":"2023-10-16T13:38:20.988353+0000","last_fullsized":"2023-10-16T13:38:20.988353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:42.116136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876183+0000","last_change":"2023-10-16T13:38:19.986596+0000","last_active":"2023-10-16T13:38:21.876183+0000","last_peered":"2023-10-16T13:38:21.876183+0000","last_clean":"2023-10-16T13:38:21.876183+0000","last_became_active":"2023-10-16T13:38:19.986288+0000","last_became_peered":"2023-10-16T13:38:19.986288+0000","last_unstale":"2023-10-16T13:38:21.876183+0000","last_undegraded":"2023-10-16T13:38:21.876183+0000","last_fullsized":"2023-10-16T13:38:21.876183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:43.954854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398398+0000","last_change":"2023-10-16T13:38:19.983880+0000","last_active":"2023-10-16T13:38:21.398398+0000","last_peered":"2023-10-16T13:38:21.398398+0000","last_clean":"2023-10-16T13:38:21.398398+0000","last_became_active":"2023-10-16T13:38:19.983548+0000","last_became_peered":"2023-10-16T13:38:19.983548+0000","last_unstale":"2023-10-16T13:38:21.398398+0000","last_undegraded":"2023-10-16T13:38:21.398398+0000","last_fullsized":"2023-10-16T13:38:21.398398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.996462+0000","last_change":"2023-10-16T13:38:19.996604+0000","last_active":"2023-10-16T13:38:20.996462+0000","last_peered":"2023-10-16T13:38:20.996462+0000","last_clean":"2023-10-16T13:38:20.996462+0000","last_became_active":"2023-10-16T13:38:19.995929+0000","last_became_peered":"2023-10-16T13:38:19.995929+0000","last_unstale":"2023-10-16T13:38:20.996462+0000","last_undegraded":"2023-10-16T13:38:20.996462+0000","last_fullsized":"2023-10-16T13:38:20.996462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:16.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.398082+0000","last_change":"2023-10-16T13:38:19.986068+0000","last_active":"2023-10-16T13:38:21.398082+0000","last_peered":"2023-10-16T13:38:21.398082+0000","last_clean":"2023-10-16T13:38:21.398082+0000","last_became_active":"2023-10-16T13:38:19.985755+0000","last_became_peered":"2023-10-16T13:38:19.985755+0000","last_unstale":"2023-10-16T13:38:21.398082+0000","last_undegraded":"2023-10-16T13:38:21.398082+0000","last_fullsized":"2023-10-16T13:38:21.398082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:20.997136+0000","last_change":"2023-10-16T13:38:19.995901+0000","last_active":"2023-10-16T13:38:20.997136+0000","last_peered":"2023-10-16T13:38:20.997136+0000","last_clean":"2023-10-16T13:38:20.997136+0000","last_became_active":"2023-10-16T13:38:19.994807+0000","last_became_peered":"2023-10-16T13:38:19.994807+0000","last_unstale":"2023-10-16T13:38:20.997136+0000","last_undegraded":"2023-10-16T13:38:20.997136+0000","last_fullsized":"2023-10-16T13:38:20.997136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:07.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.417224+0000","last_change":"2023-10-16T13:38:20.001012+0000","last_active":"2023-10-16T13:38:21.417224+0000","last_peered":"2023-10-16T13:38:21.417224+0000","last_clean":"2023-10-16T13:38:21.417224+0000","last_became_active":"2023-10-16T13:38:20.000625+0000","last_became_peered":"2023-10-16T13:38:20.000625+0000","last_unstale":"2023-10-16T13:38:21.417224+0000","last_undegraded":"2023-10-16T13:38:21.417224+0000","last_fullsized":"2023-10-16T13:38:21.417224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:43.531266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T13:38:21.876030+0000","last_change":"2023-10-16T13:38:19.987393+0000","last_active":"2023-10-16T13:38:21.876030+0000","last_peered":"2023-10-16T13:38:21.876030+0000","last_clean":"2023-10-16T13:38:21.876030+0000","last_became_active":"2023-10-16T13:38:19.987088+0000","last_became_peered":"2023-10-16T13:38:19.987088+0000","last_unstale":"2023-10-16T13:38:21.876030+0000","last_undegraded":"2023-10-16T13:38:21.876030+0000","last_fullsized":"2023-10-16T13:38:21.876030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:18.943624+0000","last_clean_scrub_stamp":"2023-10-16T13:38:18.943624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:08.916346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:38:34.004 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T13:38:34.004 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T13:38:34.004 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T13:38:34.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T13:38:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.160+0000 7fcc4c350700 1 Processor -- start 2023-10-16T13:38:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.160+0000 7fcc4c350700 1 -- start start 2023-10-16T13:38:34.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.161+0000 7fcc4c350700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc440ca9d0 0x7fcc4406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.161+0000 7fcc4c350700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440cbfd0 con 0x7fcc4415edb0 2023-10-16T13:38:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.161+0000 7fcc4c350700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4406b9c0 con 0x7fcc4406a840 2023-10-16T13:38:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.161+0000 7fcc4c350700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4415f190 con 0x7fcc440ca9d0 2023-10-16T13:38:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.161+0000 7fcc4a0ec700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc4415edb0 0x7fcc440ca2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52334/0 (socket says 172.21.15.5:52334) 2023-10-16T13:38:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.161+0000 7fcc4a0ec700 1 -- 172.21.15.5:0/4264439356 learned_addr learned my addr 172.21.15.5:0/4264439356 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:34.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248445258 0 0) 0x7fcc440cbfd0 con 0x7fcc4415edb0 2023-10-16T13:38:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc300035b0 con 0x7fcc4415edb0 2023-10-16T13:38:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 --2- 172.21.15.5:0/4264439356 >> v2:172.21.15.112:3300/0 conn(0x7fcc440ca9d0 0x7fcc4406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151726315 0 0) 0x7fcc300035b0 con 0x7fcc4415edb0 2023-10-16T13:38:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 >> v2:172.21.15.112:3300/0 conn(0x7fcc440ca9d0 msgr2=0x7fcc4406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:34.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 --2- 172.21.15.5:0/4264439356 >> v2:172.21.15.112:3300/0 conn(0x7fcc440ca9d0 0x7fcc4406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 >> v1:172.21.15.112:6789/0 conn(0x7fcc4406a840 legacy=0x7fcc440b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4406adb0 con 0x7fcc4415edb0 2023-10-16T13:38:34.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fcc34001670 con 0x7fcc4415edb0 2023-10-16T13:38:34.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 >> v1:172.21.15.5:6789/0 conn(0x7fcc4415edb0 legacy=0x7fcc440ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30003a00 0x7fcc30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc30004850 0x7fcc30004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc30005210 0x7fcc3000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415f190 con 0x7fcc30004850 2023-10-16T13:38:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3000c1b0 con 0x7fcc30003a00 2023-10-16T13:38:34.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3000c370 con 0x7fcc30005210 2023-10-16T13:38:34.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc30004850 0x7fcc30004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc4a0ec700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30003a00 0x7fcc30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc4a8ed700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc30005210 0x7fcc3000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 -- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc30005210 msgr2=0x7fcc3000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:34.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc30005210 0x7fcc3000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 -- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30003a00 msgr2=0x7fcc30003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:34.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30003a00 0x7fcc30003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc4a8ed700 1 -- 172.21.15.5:0/4264439356 reap_dead start 2023-10-16T13:38:34.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.162+0000 7fcc498eb700 1 -- 172.21.15.5:0/4264439356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300035b0 con 0x7fcc30004850 2023-10-16T13:38:34.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc498eb700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc30004850 0x7fcc30004cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009b60 tx=0x7fcc30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4514f1942fadde3d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000e6c0 con 0x7fcc30004850 2023-10-16T13:38:34.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000e820 con 0x7fcc30004850 2023-10-16T13:38:34.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc490ea700 1 -- 172.21.15.5:0/4264439356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000eb90 con 0x7fcc30004850 2023-10-16T13:38:34.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 -- 172.21.15.5:0/4264439356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc30004850 msgr2=0x7fcc30004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc30004850 0x7fcc30004cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009b60 tx=0x7fcc30005880 comp rx=0 tx=0).stop 2023-10-16T13:38:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 -- 172.21.15.5:0/4264439356 shutdown_connections 2023-10-16T13:38:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 --2- 172.21.15.5:0/4264439356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc30004850 0x7fcc30004cd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 -- 172.21.15.5:0/4264439356 >> 172.21.15.5:0/4264439356 conn(0x7fcc440b17f0 msgr2=0x7fcc440b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 -- 172.21.15.5:0/4264439356 shutdown_connections 2023-10-16T13:38:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.163+0000 7fcc4c350700 1 -- 172.21.15.5:0/4264439356 wait complete. 2023-10-16T13:38:34.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.165+0000 7fcc4c350700 1 Processor -- start 2023-10-16T13:38:34.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.165+0000 7fcc4c350700 1 -- start start 2023-10-16T13:38:34.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4c350700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30004850 0x7fcc440c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4c350700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 0x7fcc44148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4c350700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc4415c530 0x7fcc4415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4c350700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415a8d0 con 0x7fcc44147fb0 2023-10-16T13:38:34.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4c350700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44148970 con 0x7fcc30004850 2023-10-16T13:38:34.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4c350700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415d1f0 con 0x7fcc4415c530 2023-10-16T13:38:34.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 0x7fcc44148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 0x7fcc44148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42344/0 (socket says 172.21.15.5:42344) 2023-10-16T13:38:34.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 -- 172.21.15.5:0/2657468442 learned_addr learned my addr 172.21.15.5:0/2657468442 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:34.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4a8ed700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc4415c530 0x7fcc4415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 -- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc4415c530 msgr2=0x7fcc4415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc4a0ec700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30004850 0x7fcc440c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc4415c530 0x7fcc4415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 -- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30004850 msgr2=0x7fcc440c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30004850 0x7fcc440c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 -- 172.21.15.5:0/2657468442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4415d4d0 con 0x7fcc44147fb0 2023-10-16T13:38:34.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.166+0000 7fcc498eb700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 0x7fcc44148430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c180 tx=0x7fcc400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.167+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000e6c0 con 0x7fcc44147fb0 2023-10-16T13:38:34.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.167+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc40003ad0 con 0x7fcc44147fb0 2023-10-16T13:38:34.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.167+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc400045d0 con 0x7fcc44147fb0 2023-10-16T13:38:34.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.167+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4415d7b0 con 0x7fcc44147fb0 2023-10-16T13:38:34.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.167+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4415cef0 con 0x7fcc44147fb0 2023-10-16T13:38:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.168+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4415ad60 con 0x7fcc44147fb0 2023-10-16T13:38:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.168+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcc40013470 con 0x7fcc44147fb0 2023-10-16T13:38:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.168+0000 7fcc3affd700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc2806af30 0x7fcc2806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.169+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc4008b140 con 0x7fcc44147fb0 2023-10-16T13:38:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.169+0000 7fcc4a0ec700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc2806af30 0x7fcc2806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.169+0000 7fcc4a0ec700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc2806af30 0x7fcc2806d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc34001050 tx=0x7fcc34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.173+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc4415ad60 con 0x7fcc44147fb0 2023-10-16T13:38:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.419+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcc4415ad60 con 0x7fcc44147fb0 2023-10-16T13:38:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.420+0000 7fcc3affd700 1 -- 172.21.15.5:0/2657468442 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcc4415ad60 con 0x7fcc44147fb0 2023-10-16T13:38:34.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:34.423 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T13:38:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc2806af30 msgr2=0x7fcc2806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc2806af30 0x7fcc2806d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc34001050 tx=0x7fcc34009040 comp rx=0 tx=0).stop 2023-10-16T13:38:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 msgr2=0x7fcc44148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 0x7fcc44148430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c180 tx=0x7fcc400047c0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 shutdown_connections 2023-10-16T13:38:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc2806af30 0x7fcc2806d3f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc4415c530 0x7fcc4415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc30004850 0x7fcc440c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 --2- 172.21.15.5:0/2657468442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc44147fb0 0x7fcc44148430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 >> 172.21.15.5:0/2657468442 conn(0x7fcc440b17f0 msgr2=0x7fcc44159250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 shutdown_connections 2023-10-16T13:38:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.422+0000 7fcc4c350700 1 -- 172.21.15.5:0/2657468442 wait complete. 2023-10-16T13:38:34.436 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T13:38:34.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:34.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.559+0000 7ff895d8c700 1 Processor -- start 2023-10-16T13:38:34.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.559+0000 7ff895d8c700 1 -- start start 2023-10-16T13:38:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff895d8c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff89015b740 0x7ff8900d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff895d8c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900cf190 con 0x7ff8900d0c70 2023-10-16T13:38:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff895d8c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900cbd40 con 0x7ff8900ce6e0 2023-10-16T13:38:34.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff895d8c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89015bb20 con 0x7ff89015b740 2023-10-16T13:38:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff89015b740 0x7ff8900d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff8900d0c70 0x7ff8900cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52354/0 (socket says 172.21.15.5:52354) 2023-10-16T13:38:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88effd700 1 -- 172.21.15.5:0/3542685727 learned_addr learned my addr 172.21.15.5:0/3542685727 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88f7fe700 1 -- 172.21.15.5:0/3542685727 >> v1:172.21.15.112:6789/0 conn(0x7ff8900ce6e0 legacy=0x7ff8900cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88f7fe700 1 -- 172.21.15.5:0/3542685727 >> v1:172.21.15.5:6789/0 conn(0x7ff8900d0c70 legacy=0x7ff8900cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88f7fe700 1 -- 172.21.15.5:0/3542685727 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900cc020 con 0x7ff89015b740 2023-10-16T13:38:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88e7fc700 1 -- 172.21.15.5:0/3542685727 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756112723 0 0) 0x7ff8900cf190 con 0x7ff8900d0c70 2023-10-16T13:38:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/3542685727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff8900d1cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff880009840 tx=0x7ff880009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a19132fc0122cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.560+0000 7ff88e7fc700 1 -- 172.21.15.5:0/3542685727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880011830 con 0x7ff89015b740 2023-10-16T13:38:34.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff88e7fc700 1 -- 172.21.15.5:0/3542685727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880011990 con 0x7ff89015b740 2023-10-16T13:38:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff88e7fc700 1 -- 172.21.15.5:0/3542685727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880011d20 con 0x7ff89015b740 2023-10-16T13:38:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 -- 172.21.15.5:0/3542685727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 msgr2=0x7ff8900d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 --2- 172.21.15.5:0/3542685727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff8900d1cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff880009840 tx=0x7ff880009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 -- 172.21.15.5:0/3542685727 shutdown_connections 2023-10-16T13:38:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 --2- 172.21.15.5:0/3542685727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff8900d1cd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 -- 172.21.15.5:0/3542685727 >> 172.21.15.5:0/3542685727 conn(0x7ff8900665a0 msgr2=0x7ff890066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:34.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 -- 172.21.15.5:0/3542685727 shutdown_connections 2023-10-16T13:38:34.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.561+0000 7ff895d8c700 1 -- 172.21.15.5:0/3542685727 wait complete. 2023-10-16T13:38:34.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.562+0000 7ff895d8c700 1 Processor -- start 2023-10-16T13:38:34.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.562+0000 7ff895d8c700 1 -- start start 2023-10-16T13:38:34.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff895d8c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900ce6e0 0x7ff8901f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff895d8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900d0c70 0x7ff89015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff895d8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff89015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff895d8c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900b42b0 con 0x7ff89015b740 2023-10-16T13:38:34.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff895d8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900b4460 con 0x7ff8900d0c70 2023-10-16T13:38:34.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff895d8c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89015e520 con 0x7ff8900ce6e0 2023-10-16T13:38:34.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff88ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff89015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff88ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff89015cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42358/0 (socket says 172.21.15.5:42358) 2023-10-16T13:38:34.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff88ffff700 1 -- 172.21.15.5:0/1828583824 learned_addr learned my addr 172.21.15.5:0/1828583824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:34.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff88effd700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900d0c70 0x7ff89015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.563+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900ce6e0 0x7ff8901f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff88ffff700 1 -- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900ce6e0 msgr2=0x7ff8901f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff88ffff700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900ce6e0 0x7ff8901f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff88ffff700 1 -- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900d0c70 msgr2=0x7ff89015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff88ffff700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900d0c70 0x7ff89015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff88ffff700 1 -- 172.21.15.5:0/1828583824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800094a0 con 0x7ff89015b740 2023-10-16T13:38:34.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff88ffff700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff89015cc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff88800cbc0 tx=0x7ff88800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888003c00 con 0x7ff89015b740 2023-10-16T13:38:34.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888003d60 con 0x7ff89015b740 2023-10-16T13:38:34.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89015e800 con 0x7ff89015b740 2023-10-16T13:38:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800aae0 con 0x7ff89015b740 2023-10-16T13:38:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.564+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8900b4720 con 0x7ff89015b740 2023-10-16T13:38:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.565+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8900b4910 con 0x7ff89015b740 2023-10-16T13:38:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.565+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff88800ac40 con 0x7ff89015b740 2023-10-16T13:38:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.566+0000 7ff887fff700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff87006af00 0x7ff87006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.566+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff888089590 con 0x7ff89015b740 2023-10-16T13:38:34.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.566+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff87006af00 0x7ff87006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.566+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff87006af00 0x7ff87006d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8800090b0 tx=0x7ff88001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.570+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff888054640 con 0x7ff89015b740 2023-10-16T13:38:34.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.771+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff89015ef00 con 0x7ff89015b740 2023-10-16T13:38:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.773+0000 7ff887fff700 1 -- 172.21.15.5:0/1828583824 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7ff888057c60 con 0x7ff89015b740 2023-10-16T13:38:34.775 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:34.776 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff87006af00 msgr2=0x7ff87006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff87006af00 0x7ff87006d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8800090b0 tx=0x7ff88001c040 comp rx=0 tx=0).stop 2023-10-16T13:38:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 msgr2=0x7ff89015cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff89015cc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff88800cbc0 tx=0x7ff88800ced0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 shutdown_connections 2023-10-16T13:38:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015b740 0x7ff89015cc30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff87006af00 0x7ff87006d3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900ce6e0 0x7ff8901f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 --2- 172.21.15.5:0/1828583824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900d0c70 0x7ff89015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 >> 172.21.15.5:0/1828583824 conn(0x7ff8900665a0 msgr2=0x7ff89015f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:34.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 shutdown_connections 2023-10-16T13:38:34.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.775+0000 7ff895d8c700 1 -- 172.21.15.5:0/1828583824 wait complete. 2023-10-16T13:38:34.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:34.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.915+0000 7f3c69f62700 1 Processor -- start 2023-10-16T13:38:34.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.915+0000 7f3c69f62700 1 -- start start 2023-10-16T13:38:34.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c69f62700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c640b28b0 0x7f3c640cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c69f62700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640b3530 con 0x7f3c6406af50 2023-10-16T13:38:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c69f62700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640cd180 con 0x7f3c6415f130 2023-10-16T13:38:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c69f62700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c640cde00 con 0x7f3c640b28b0 2023-10-16T13:38:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c63fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c640b28b0 0x7f3c640cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c62ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c6406af50 0x7f3c640b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52368/0 (socket says 172.21.15.5:52368) 2023-10-16T13:38:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.916+0000 7f3c62ffd700 1 -- 172.21.15.5:0/1828388856 learned_addr learned my addr 172.21.15.5:0/1828388856 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c63fff700 1 -- 172.21.15.5:0/1828388856 >> v1:172.21.15.112:6789/0 conn(0x7f3c6415f130 legacy=0x7f3c6406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c63fff700 1 -- 172.21.15.5:0/1828388856 >> v1:172.21.15.5:6789/0 conn(0x7f3c6406af50 legacy=0x7f3c640b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c63fff700 1 -- 172.21.15.5:0/1828388856 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640cd460 con 0x7f3c640b28b0 2023-10-16T13:38:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c63fff700 1 --2- 172.21.15.5:0/1828388856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640cede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009d90 tx=0x7f3c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403b7f1e03406128 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c627fc700 1 -- 172.21.15.5:0/1828388856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00e070 con 0x7f3c640b28b0 2023-10-16T13:38:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c627fc700 1 -- 172.21.15.5:0/1828388856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00bbd0 con 0x7f3c640b28b0 2023-10-16T13:38:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.917+0000 7f3c627fc700 1 -- 172.21.15.5:0/1828388856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012430 con 0x7f3c640b28b0 2023-10-16T13:38:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 -- 172.21.15.5:0/1828388856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 msgr2=0x7f3c640cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1828388856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640cede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009d90 tx=0x7f3c5c00b330 comp rx=0 tx=0).stop 2023-10-16T13:38:34.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 -- 172.21.15.5:0/1828388856 shutdown_connections 2023-10-16T13:38:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1828388856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640cede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 -- 172.21.15.5:0/1828388856 >> 172.21.15.5:0/1828388856 conn(0x7f3c6406dae0 msgr2=0x7f3c6406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 -- 172.21.15.5:0/1828388856 shutdown_connections 2023-10-16T13:38:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.918+0000 7f3c69f62700 1 -- 172.21.15.5:0/1828388856 wait complete. 2023-10-16T13:38:34.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.919+0000 7f3c69f62700 1 Processor -- start 2023-10-16T13:38:34.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.919+0000 7f3c69f62700 1 -- start start 2023-10-16T13:38:34.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c69f62700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6406af50 0x7f3c640c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c69f62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c69f62700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c6415f130 0x7f3c640c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c69f62700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64154270 con 0x7f3c640b28b0 2023-10-16T13:38:34.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c69f62700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640b5a10 con 0x7f3c6406af50 2023-10-16T13:38:34.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c69f62700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640b4b80 con 0x7f3c6415f130 2023-10-16T13:38:34.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42370/0 (socket says 172.21.15.5:42370) 2023-10-16T13:38:34.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 -- 172.21.15.5:0/1859456433 learned_addr learned my addr 172.21.15.5:0/1859456433 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:34.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c637fe700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6406af50 0x7f3c640c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c63fff700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c6415f130 0x7f3c640c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 -- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c6415f130 msgr2=0x7f3c640c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c6415f130 0x7f3c640c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 -- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6406af50 msgr2=0x7f3c640c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:34.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6406af50 0x7f3c640c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:34.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 -- 172.21.15.5:0/1859456433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009a70 con 0x7f3c640b28b0 2023-10-16T13:38:34.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c62ffd700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640b4640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c4b0 tx=0x7f3c4c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.920+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0074e0 con 0x7f3c640b28b0 2023-10-16T13:38:34.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.921+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c007640 con 0x7f3c640b28b0 2023-10-16T13:38:34.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.921+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c640c72f0 con 0x7f3c640b28b0 2023-10-16T13:38:34.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.921+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c005a30 con 0x7f3c640b28b0 2023-10-16T13:38:34.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.921+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c640b50e0 con 0x7f3c640b28b0 2023-10-16T13:38:34.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.922+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c64067d20 con 0x7f3c640b28b0 2023-10-16T13:38:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.922+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c4c005b90 con 0x7f3c640b28b0 2023-10-16T13:38:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.922+0000 7f3c5bfff700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c4406af00 0x7f3c4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.923+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c4c088750 con 0x7f3c640b28b0 2023-10-16T13:38:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.923+0000 7f3c637fe700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c4406af00 0x7f3c4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.923+0000 7f3c637fe700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c4406af00 0x7f3c4406d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c54007fd0 tx=0x7f3c54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:34.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:34.927+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c4c053940 con 0x7f3c640b28b0 2023-10-16T13:38:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.127+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c640b5b50 con 0x7f3c640b28b0 2023-10-16T13:38:35.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.127+0000 7f3c5bfff700 1 -- 172.21.15.5:0/1859456433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c4c0170a0 con 0x7f3c640b28b0 2023-10-16T13:38:35.130 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:35.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c4406af00 msgr2=0x7f3c4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c4406af00 0x7f3c4406d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c54007fd0 tx=0x7f3c54009040 comp rx=0 tx=0).stop 2023-10-16T13:38:35.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 msgr2=0x7f3c640b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640b4640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c4b0 tx=0x7f3c4c00c7c0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 shutdown_connections 2023-10-16T13:38:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c4406af00 0x7f3c4406d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c6415f130 0x7f3c640c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6406af50 0x7f3c640c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 --2- 172.21.15.5:0/1859456433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c640b28b0 0x7f3c640b4640 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 >> 172.21.15.5:0/1859456433 conn(0x7f3c6406dae0 msgr2=0x7f3c640b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 shutdown_connections 2023-10-16T13:38:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.129+0000 7f3c69f62700 1 -- 172.21.15.5:0/1859456433 wait complete. 2023-10-16T13:38:35.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.269+0000 7f80a81a7700 1 Processor -- start 2023-10-16T13:38:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.269+0000 7f80a81a7700 1 -- start start 2023-10-16T13:38:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a81a7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006e750 0x7f80a00ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a81a7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80a00b54f0 0x7f80a00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a81a7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00b5c70 con 0x7f80a006eb30 2023-10-16T13:38:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a81a7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00b5990 con 0x7f80a00b54f0 2023-10-16T13:38:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a81a7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a015b2b0 con 0x7f80a006e750 2023-10-16T13:38:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80a00b54f0 0x7f80a00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80a00b54f0 0x7f80a00cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42380/0 (socket says 172.21.15.5:42380) 2023-10-16T13:38:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 -- 172.21.15.5:0/2406511770 learned_addr learned my addr 172.21.15.5:0/2406511770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a5f43700 1 --2- 172.21.15.5:0/2406511770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006e750 0x7f80a00ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 -- 172.21.15.5:0/2406511770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006e750 msgr2=0x7f80a00ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 --2- 172.21.15.5:0/2406511770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006e750 0x7f80a00ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 -- 172.21.15.5:0/2406511770 >> v1:172.21.15.112:6789/0 conn(0x7f80a006eb30 legacy=0x7f80a015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.270+0000 7f80a6744700 1 -- 172.21.15.5:0/2406511770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a015b590 con 0x7f80a00b54f0 2023-10-16T13:38:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a6744700 1 --2- 172.21.15.5:0/2406511770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a00b54f0 0x7f80a00cf400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f809800d150 tx=0x7f809800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1cf220da48a5e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a4f41700 1 -- 172.21.15.5:0/2406511770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098010070 con 0x7f80a00b54f0 2023-10-16T13:38:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a4f41700 1 -- 172.21.15.5:0/2406511770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800ddc0 con 0x7f80a00b54f0 2023-10-16T13:38:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a4f41700 1 -- 172.21.15.5:0/2406511770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800b310 con 0x7f80a00b54f0 2023-10-16T13:38:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 -- 172.21.15.5:0/2406511770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a00b54f0 msgr2=0x7f80a00cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 --2- 172.21.15.5:0/2406511770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a00b54f0 0x7f80a00cf400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f809800d150 tx=0x7f809800d460 comp rx=0 tx=0).stop 2023-10-16T13:38:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 -- 172.21.15.5:0/2406511770 shutdown_connections 2023-10-16T13:38:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 --2- 172.21.15.5:0/2406511770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a00b54f0 0x7f80a00cf400 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 --2- 172.21.15.5:0/2406511770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006e750 0x7f80a00ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 -- 172.21.15.5:0/2406511770 >> 172.21.15.5:0/2406511770 conn(0x7f80a00cc6f0 msgr2=0x7f80a00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:35.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 -- 172.21.15.5:0/2406511770 shutdown_connections 2023-10-16T13:38:35.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.271+0000 7f80a81a7700 1 -- 172.21.15.5:0/2406511770 wait complete. 2023-10-16T13:38:35.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.273+0000 7f80a81a7700 1 Processor -- start 2023-10-16T13:38:35.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.273+0000 7f80a81a7700 1 -- start start 2023-10-16T13:38:35.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a81a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 0x7f80a01489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a81a7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006eb30 0x7f80a0147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a81a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a00b54f0 0x7f80a00c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a81a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00b41e0 con 0x7f80a006e750 2023-10-16T13:38:35.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a81a7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c4cf0 con 0x7f80a00b54f0 2023-10-16T13:38:35.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a81a7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00b3b90 con 0x7f80a006eb30 2023-10-16T13:38:35.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 0x7f80a01489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 0x7f80a01489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42382/0 (socket says 172.21.15.5:42382) 2023-10-16T13:38:35.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 -- 172.21.15.5:0/579231816 learned_addr learned my addr 172.21.15.5:0/579231816 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:35.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5742700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006eb30 0x7f80a0147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a6744700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a00b54f0 0x7f80a00c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 -- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006eb30 msgr2=0x7f80a0147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006eb30 0x7f80a0147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 -- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a00b54f0 msgr2=0x7f80a00c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a00b54f0 0x7f80a00c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.274+0000 7f80a5f43700 1 -- 172.21.15.5:0/579231816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809800bd40 con 0x7f80a006e750 2023-10-16T13:38:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.275+0000 7f80a5f43700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 0x7f80a01489c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f809000e810 tx=0x7f809000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.275+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090013610 con 0x7f80a006e750 2023-10-16T13:38:35.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.275+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090013770 con 0x7f80a006e750 2023-10-16T13:38:35.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.275+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090013b00 con 0x7f80a006e750 2023-10-16T13:38:35.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.275+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a00b3e70 con 0x7f80a006e750 2023-10-16T13:38:35.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.275+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a00c48c0 con 0x7f80a006e750 2023-10-16T13:38:35.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.276+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0067d20 con 0x7f80a006e750 2023-10-16T13:38:35.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.276+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8090013c60 con 0x7f80a006e750 2023-10-16T13:38:35.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.277+0000 7f80967fc700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f808406af30 0x7f808406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.277+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8090089310 con 0x7f80a006e750 2023-10-16T13:38:35.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.277+0000 7f80a5742700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f808406af30 0x7f808406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.277+0000 7f80a5742700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f808406af30 0x7f808406d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f80a0156580 tx=0x7f809c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.281+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8090054330 con 0x7f80a006e750 2023-10-16T13:38:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.483+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80a006b950 con 0x7f80a006e750 2023-10-16T13:38:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.484+0000 7f80967fc700 1 -- 172.21.15.5:0/579231816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8090057950 con 0x7f80a006e750 2023-10-16T13:38:35.487 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f808406af30 msgr2=0x7f808406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f808406af30 0x7f808406d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f80a0156580 tx=0x7f809c009040 comp rx=0 tx=0).stop 2023-10-16T13:38:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 msgr2=0x7f80a01489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 0x7f80a01489c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f809000e810 tx=0x7f809000ebd0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 shutdown_connections 2023-10-16T13:38:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a00b54f0 0x7f80a00c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a006e750 0x7f80a01489c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f808406af30 0x7f808406d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 --2- 172.21.15.5:0/579231816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80a006eb30 0x7f80a0147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 >> 172.21.15.5:0/579231816 conn(0x7f80a00cc6f0 msgr2=0x7f80a00b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 shutdown_connections 2023-10-16T13:38:35.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.486+0000 7f80a81a7700 1 -- 172.21.15.5:0/579231816 wait complete. 2023-10-16T13:38:35.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:35.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.625+0000 7f9dafb52700 1 Processor -- start 2023-10-16T13:38:35.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.626+0000 7f9dafb52700 1 -- start start 2023-10-16T13:38:35.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.626+0000 7f9dafb52700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9da80cee90 0x7f9da815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.626+0000 7f9dafb52700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 0x7f9da80cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.626+0000 7f9dafb52700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da8158120 con 0x7f9da8157d40 2023-10-16T13:38:35.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.626+0000 7f9dafb52700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da806e560 con 0x7f9da80cee90 2023-10-16T13:38:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.626+0000 7f9dafb52700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da815e720 con 0x7f9da815e290 2023-10-16T13:38:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 0x7f9da80cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dad0ed700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9da80cee90 0x7f9da815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 0x7f9da80cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40298/0 (socket says 172.21.15.5:40298) 2023-10-16T13:38:35.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1296104548 learned_addr learned my addr 172.21.15.5:0/1296104548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:35.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1296104548 >> v2:172.21.15.112:3300/0 conn(0x7f9da80cee90 msgr2=0x7f9da815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:35.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 --2- 172.21.15.5:0/1296104548 >> v2:172.21.15.112:3300/0 conn(0x7f9da80cee90 0x7f9da815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1296104548 >> v1:172.21.15.112:6789/0 conn(0x7f9da8157d40 legacy=0x7f9da806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1296104548 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da806a840 con 0x7f9da815e290 2023-10-16T13:38:35.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dae0ef700 1 --2- 172.21.15.5:0/1296104548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 0x7f9da80cb420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009e50 tx=0x7f9da000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57070f1fc5049d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dac8ec700 1 -- 172.21.15.5:0/1296104548 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000e070 con 0x7f9da815e290 2023-10-16T13:38:35.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dac8ec700 1 -- 172.21.15.5:0/1296104548 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da000b910 con 0x7f9da815e290 2023-10-16T13:38:35.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.627+0000 7f9dac8ec700 1 -- 172.21.15.5:0/1296104548 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000bcc0 con 0x7f9da815e290 2023-10-16T13:38:35.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 -- 172.21.15.5:0/1296104548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 msgr2=0x7f9da80cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1296104548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 0x7f9da80cb420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009e50 tx=0x7f9da000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 -- 172.21.15.5:0/1296104548 shutdown_connections 2023-10-16T13:38:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1296104548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da815e290 0x7f9da80cb420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1296104548 >> v2:172.21.15.112:3300/0 conn(0x7f9da80cee90 0x7f9da815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 -- 172.21.15.5:0/1296104548 >> 172.21.15.5:0/1296104548 conn(0x7f9da80cc6f0 msgr2=0x7f9da80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 -- 172.21.15.5:0/1296104548 shutdown_connections 2023-10-16T13:38:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.628+0000 7f9dafb52700 1 -- 172.21.15.5:0/1296104548 wait complete. 2023-10-16T13:38:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.629+0000 7f9dafb52700 1 Processor -- start 2023-10-16T13:38:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.629+0000 7f9dafb52700 1 -- start start 2023-10-16T13:38:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dafb52700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da80cee90 0x7f9da81f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dafb52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da8157d40 0x7f9da81f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dafb52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 0x7f9da81f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dafb52700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81f7230 con 0x7f9da815e290 2023-10-16T13:38:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dafb52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81f6c70 con 0x7f9da8157d40 2023-10-16T13:38:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dafb52700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81f6f50 con 0x7f9da80cee90 2023-10-16T13:38:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 0x7f9da81f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 0x7f9da81f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42400/0 (socket says 172.21.15.5:42400) 2023-10-16T13:38:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1234521070 learned_addr learned my addr 172.21.15.5:0/1234521070 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dad8ee700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da80cee90 0x7f9da81f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dad0ed700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da8157d40 0x7f9da81f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da80cee90 msgr2=0x7f9da81f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da80cee90 0x7f9da81f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da8157d40 msgr2=0x7f9da81f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da8157d40 0x7f9da81f0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 -- 172.21.15.5:0/1234521070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0009b30 con 0x7f9da815e290 2023-10-16T13:38:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dad8ee700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da80cee90 0x7f9da81f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.630+0000 7f9dae0ef700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 0x7f9da81f6390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9da0004270 tx=0x7f9da0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.631+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00092e0 con 0x7f9da815e290 2023-10-16T13:38:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.631+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da001c440 con 0x7f9da815e290 2023-10-16T13:38:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.631+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da001c810 con 0x7f9da815e290 2023-10-16T13:38:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.631+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da8147f20 con 0x7f9da815e290 2023-10-16T13:38:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.631+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da81f0680 con 0x7f9da815e290 2023-10-16T13:38:35.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.632+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da8148440 con 0x7f9da815e290 2023-10-16T13:38:35.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.632+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9da001c970 con 0x7f9da815e290 2023-10-16T13:38:35.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.633+0000 7f9d9e7fc700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d8c06af30 0x7f9d8c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.633+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9da008af10 con 0x7f9da815e290 2023-10-16T13:38:35.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.633+0000 7f9dad8ee700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d8c06af30 0x7f9d8c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.633+0000 7f9dad8ee700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d8c06af30 0x7f9d8c06d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d98000f60 tx=0x7f9d98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.637+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9da8148440 con 0x7f9da815e290 2023-10-16T13:38:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.838+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9da8148440 con 0x7f9da815e290 2023-10-16T13:38:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.838+0000 7f9d9e7fc700 1 -- 172.21.15.5:0/1234521070 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9da8148440 con 0x7f9da815e290 2023-10-16T13:38:35.842 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d8c06af30 msgr2=0x7f9d8c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d8c06af30 0x7f9d8c06d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d98000f60 tx=0x7f9d98009040 comp rx=0 tx=0).stop 2023-10-16T13:38:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 msgr2=0x7f9da81f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 0x7f9da81f6390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9da0004270 tx=0x7f9da0004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 shutdown_connections 2023-10-16T13:38:35.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9da815e290 0x7f9da81f6390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d8c06af30 0x7f9d8c06d3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9da80cee90 0x7f9da81f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 --2- 172.21.15.5:0/1234521070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9da8157d40 0x7f9da81f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 >> 172.21.15.5:0/1234521070 conn(0x7f9da80cc6f0 msgr2=0x7f9da80cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:35.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 shutdown_connections 2023-10-16T13:38:35.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.841+0000 7f9dafb52700 1 -- 172.21.15.5:0/1234521070 wait complete. 2023-10-16T13:38:35.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:38:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.979+0000 7fa14fa39700 1 Processor -- start 2023-10-16T13:38:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.979+0000 7fa14fa39700 1 -- start start 2023-10-16T13:38:35.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14fa39700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa14815b740 0x7fa1480d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14fa39700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1480cf190 con 0x7fa1480ce6e0 2023-10-16T13:38:35.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14fa39700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1480cbd40 con 0x7fa1480d0c70 2023-10-16T13:38:35.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14fa39700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14815bb20 con 0x7fa14815b740 2023-10-16T13:38:35.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14dfd6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa1480ce6e0 0x7fa1480cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52412/0 (socket says 172.21.15.5:52412) 2023-10-16T13:38:35.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14dfd6700 1 -- 172.21.15.5:0/3541738643 learned_addr learned my addr 172.21.15.5:0/3541738643 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:35.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14d7d5700 1 --2- 172.21.15.5:0/3541738643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa14815b740 0x7fa1480d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439402994 0 0) 0x7fa1480cf190 con 0x7fa1480ce6e0 2023-10-16T13:38:35.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1340035b0 con 0x7fa1480ce6e0 2023-10-16T13:38:35.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506263654 0 0) 0x7fa1480cbd40 con 0x7fa1480d0c70 2023-10-16T13:38:35.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1480cf190 con 0x7fa1480d0c70 2023-10-16T13:38:35.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224178811 0 0) 0x7fa1340035b0 con 0x7fa1480ce6e0 2023-10-16T13:38:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14d7d5700 1 -- 172.21.15.5:0/3541738643 >> v1:172.21.15.112:6789/0 conn(0x7fa1480d0c70 legacy=0x7fa1480cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14d7d5700 1 -- 172.21.15.5:0/3541738643 >> v1:172.21.15.5:6789/0 conn(0x7fa1480ce6e0 legacy=0x7fa1480cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.980+0000 7fa14d7d5700 1 -- 172.21.15.5:0/3541738643 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480cc020 con 0x7fa14815b740 2023-10-16T13:38:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa14d7d5700 1 --2- 172.21.15.5:0/3541738643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa14815b740 0x7fa1480d1cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa144009870 tx=0x7fa144009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3986fa58b6022c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400019f0 con 0x7fa14815b740 2023-10-16T13:38:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144004030 con 0x7fa14815b740 2023-10-16T13:38:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa13ffff700 1 -- 172.21.15.5:0/3541738643 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440043c0 con 0x7fa14815b740 2023-10-16T13:38:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa14fa39700 1 -- 172.21.15.5:0/3541738643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa14815b740 msgr2=0x7fa1480d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa14fa39700 1 --2- 172.21.15.5:0/3541738643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa14815b740 0x7fa1480d1cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa144009870 tx=0x7fa144009b80 comp rx=0 tx=0).stop 2023-10-16T13:38:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa14fa39700 1 -- 172.21.15.5:0/3541738643 shutdown_connections 2023-10-16T13:38:35.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa14fa39700 1 --2- 172.21.15.5:0/3541738643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa14815b740 0x7fa1480d1cd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.981+0000 7fa14fa39700 1 -- 172.21.15.5:0/3541738643 >> 172.21.15.5:0/3541738643 conn(0x7fa1480665a0 msgr2=0x7fa148066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:35.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.982+0000 7fa14fa39700 1 -- 172.21.15.5:0/3541738643 shutdown_connections 2023-10-16T13:38:35.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.982+0000 7fa14fa39700 1 -- 172.21.15.5:0/3541738643 wait complete. 2023-10-16T13:38:35.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.983+0000 7fa14fa39700 1 Processor -- start 2023-10-16T13:38:35.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.983+0000 7fa14fa39700 1 -- start start 2023-10-16T13:38:35.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14fa39700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1480ce6e0 0x7fa14814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14fa39700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1480d0c70 0x7fa1480c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14fa39700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 0x7fa1480b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14fa39700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14814b6a0 con 0x7fa14815b740 2023-10-16T13:38:35.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14fa39700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1481f1760 con 0x7fa1480d0c70 2023-10-16T13:38:35.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14fa39700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1481f1a40 con 0x7fa1480ce6e0 2023-10-16T13:38:35.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 0x7fa1480b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14d7d5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1480ce6e0 0x7fa14814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14d7d5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1480ce6e0 0x7fa14814b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40314/0 (socket says 172.21.15.5:40314) 2023-10-16T13:38:35.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 0x7fa1480b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42412/0 (socket says 172.21.15.5:42412) 2023-10-16T13:38:35.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14d7d5700 1 -- 172.21.15.5:0/4071930196 learned_addr learned my addr 172.21.15.5:0/4071930196 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:35.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14cfd4700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1480d0c70 0x7fa1480c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 -- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1480ce6e0 msgr2=0x7fa14814b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1480ce6e0 0x7fa14814b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 -- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1480d0c70 msgr2=0x7fa1480c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:35.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1480d0c70 0x7fa1480c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:35.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 -- 172.21.15.5:0/4071930196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1440094a0 con 0x7fa14815b740 2023-10-16T13:38:35.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14cfd4700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1480d0c70 0x7fa1480c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:35.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.984+0000 7fa14dfd6700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 0x7fa1480b18d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa1481602d0 tx=0x7fa140009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.985+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14001c030 con 0x7fa14815b740 2023-10-16T13:38:35.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.985+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140009cd0 con 0x7fa14815b740 2023-10-16T13:38:35.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.985+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14815d530 con 0x7fa14815b740 2023-10-16T13:38:35.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.985+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000c070 con 0x7fa14815b740 2023-10-16T13:38:35.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.985+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14815daf0 con 0x7fa14815b740 2023-10-16T13:38:35.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.986+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14815dce0 con 0x7fa14815b740 2023-10-16T13:38:35.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.986+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa14001f070 con 0x7fa14815b740 2023-10-16T13:38:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.987+0000 7fa13dffb700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa12c06af00 0x7fa12c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.987+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa14001d070 con 0x7fa14815b740 2023-10-16T13:38:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.987+0000 7fa14d7d5700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa12c06af00 0x7fa12c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.988+0000 7fa14d7d5700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa12c06af00 0x7fa12c06d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa144009bc0 tx=0x7fa144008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:35.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:35.992+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa14005cbb0 con 0x7fa14815b740 2023-10-16T13:38:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.235+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1480b73f0 con 0x7fa14815b740 2023-10-16T13:38:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.236+0000 7fa13dffb700 1 -- 172.21.15.5:0/4071930196 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fa1400601d0 con 0x7fa14815b740 2023-10-16T13:38:36.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:36.239 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:38:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa12c06af00 msgr2=0x7fa12c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa12c06af00 0x7fa12c06d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa144009bc0 tx=0x7fa144008030 comp rx=0 tx=0).stop 2023-10-16T13:38:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 msgr2=0x7fa1480b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 0x7fa1480b18d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa1481602d0 tx=0x7fa140009330 comp rx=0 tx=0).stop 2023-10-16T13:38:36.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 shutdown_connections 2023-10-16T13:38:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa14815b740 0x7fa1480b18d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa12c06af00 0x7fa12c06d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1480ce6e0 0x7fa14814b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 --2- 172.21.15.5:0/4071930196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1480d0c70 0x7fa1480c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 >> 172.21.15.5:0/4071930196 conn(0x7fa1480665a0 msgr2=0x7fa148066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 shutdown_connections 2023-10-16T13:38:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.238+0000 7fa14fa39700 1 -- 172.21.15.5:0/4071930196 wait complete. 2023-10-16T13:38:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:38:36.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.375+0000 7f914694d700 1 Processor -- start 2023-10-16T13:38:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.375+0000 7f914694d700 1 -- start start 2023-10-16T13:38:36.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f914694d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f914015f130 0x7f91400cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f914694d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f914006af50 0x7f91400b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f914694d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91400b3530 con 0x7f91400b28b0 2023-10-16T13:38:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f914694d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400cde00 con 0x7f914015f130 2023-10-16T13:38:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f914694d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400cd180 con 0x7f914006af50 2023-10-16T13:38:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f914015f130 0x7f91400cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91400b28b0 0x7f914006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52424/0 (socket says 172.21.15.5:52424) 2023-10-16T13:38:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913f7fe700 1 -- 172.21.15.5:0/2220160596 learned_addr learned my addr 172.21.15.5:0/2220160596 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f9144eea700 1 --2- 172.21.15.5:0/2220160596 >> v2:172.21.15.112:3300/0 conn(0x7f914006af50 0x7f91400b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913ffff700 1 -- 172.21.15.5:0/2220160596 >> v2:172.21.15.112:3300/0 conn(0x7f914006af50 msgr2=0x7f91400b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913ffff700 1 --2- 172.21.15.5:0/2220160596 >> v2:172.21.15.112:3300/0 conn(0x7f914006af50 0x7f91400b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913ffff700 1 -- 172.21.15.5:0/2220160596 >> v1:172.21.15.5:6789/0 conn(0x7f91400b28b0 legacy=0x7f914006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913effd700 1 -- 172.21.15.5:0/2220160596 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529261571 0 0) 0x7f91400b3530 con 0x7f91400b28b0 2023-10-16T13:38:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913ffff700 1 -- 172.21.15.5:0/2220160596 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400cd460 con 0x7f914015f130 2023-10-16T13:38:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.376+0000 7f913ffff700 1 --2- 172.21.15.5:0/2220160596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f914015f130 0x7f91400cede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f914006d2f0 tx=0x7f9130009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d229de582d6157 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f913effd700 1 -- 172.21.15.5:0/2220160596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011830 con 0x7f914015f130 2023-10-16T13:38:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f913effd700 1 -- 172.21.15.5:0/2220160596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130011990 con 0x7f914015f130 2023-10-16T13:38:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f913effd700 1 -- 172.21.15.5:0/2220160596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011d20 con 0x7f914015f130 2023-10-16T13:38:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 -- 172.21.15.5:0/2220160596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f914015f130 msgr2=0x7f91400cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 --2- 172.21.15.5:0/2220160596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f914015f130 0x7f91400cede0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f914006d2f0 tx=0x7f9130009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 -- 172.21.15.5:0/2220160596 shutdown_connections 2023-10-16T13:38:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 --2- 172.21.15.5:0/2220160596 >> v2:172.21.15.112:3300/0 conn(0x7f914006af50 0x7f91400b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 --2- 172.21.15.5:0/2220160596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f914015f130 0x7f91400cede0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 -- 172.21.15.5:0/2220160596 >> 172.21.15.5:0/2220160596 conn(0x7f914006dae0 msgr2=0x7f914006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:36.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 -- 172.21.15.5:0/2220160596 shutdown_connections 2023-10-16T13:38:36.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.377+0000 7f914694d700 1 -- 172.21.15.5:0/2220160596 wait complete. 2023-10-16T13:38:36.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.379+0000 7f914694d700 1 Processor -- start 2023-10-16T13:38:36.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.379+0000 7f914694d700 1 -- start start 2023-10-16T13:38:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f914694d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f914006af50 0x7f91401f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f914694d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 0x7f914015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f914694d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f914015f130 0x7f914015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f914694d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400c6a30 con 0x7f91400b28b0 2023-10-16T13:38:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f914694d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400c6ec0 con 0x7f914015f130 2023-10-16T13:38:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f914694d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91400c5e20 con 0x7f914006af50 2023-10-16T13:38:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 0x7f914015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 0x7f914015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42426/0 (socket says 172.21.15.5:42426) 2023-10-16T13:38:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 -- 172.21.15.5:0/3182217513 learned_addr learned my addr 172.21.15.5:0/3182217513 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913ffff700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f914006af50 0x7f91401f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 -- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f914006af50 msgr2=0x7f91401f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f914006af50 0x7f91401f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 -- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f914015f130 msgr2=0x7f914015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f914015f130 0x7f914015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913f7fe700 1 -- 172.21.15.5:0/3182217513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300094a0 con 0x7f91400b28b0 2023-10-16T13:38:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.380+0000 7f913ffff700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f914006af50 0x7f91401f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.381+0000 7f913f7fe700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 0x7f914015c670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f913400c6d0 tx=0x7f913400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.381+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340074e0 con 0x7f91400b28b0 2023-10-16T13:38:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.381+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134007660 con 0x7f91400b28b0 2023-10-16T13:38:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.381+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91400c6100 con 0x7f91400b28b0 2023-10-16T13:38:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.381+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134005a70 con 0x7f91400b28b0 2023-10-16T13:38:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.381+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91400c66c0 con 0x7f91400b28b0 2023-10-16T13:38:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.382+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91400c6be0 con 0x7f91400b28b0 2023-10-16T13:38:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.382+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9134005bd0 con 0x7f91400b28b0 2023-10-16T13:38:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.383+0000 7f913cff9700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f912c06af00 0x7f912c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.383+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9134088ac0 con 0x7f91400b28b0 2023-10-16T13:38:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.383+0000 7f913ffff700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f912c06af00 0x7f912c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.383+0000 7f913ffff700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f912c06af00 0x7f912c06d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91300090b0 tx=0x7f9130008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:36.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.387+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91400c6be0 con 0x7f91400b28b0 2023-10-16T13:38:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.588+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9140067d20 con 0x7f91400b28b0 2023-10-16T13:38:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.589+0000 7f913cff9700 1 -- 172.21.15.5:0/3182217513 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f9134088e60 con 0x7f91400b28b0 2023-10-16T13:38:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:36.592 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f912c06af00 msgr2=0x7f912c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f912c06af00 0x7f912c06d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91300090b0 tx=0x7f9130008030 comp rx=0 tx=0).stop 2023-10-16T13:38:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 msgr2=0x7f914015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 0x7f914015c670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f913400c6d0 tx=0x7f913400ca90 comp rx=0 tx=0).stop 2023-10-16T13:38:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 shutdown_connections 2023-10-16T13:38:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f914015f130 0x7f914015cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f912c06af00 0x7f912c06d3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f914006af50 0x7f91401f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 --2- 172.21.15.5:0/3182217513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91400b28b0 0x7f914015c670 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 >> 172.21.15.5:0/3182217513 conn(0x7f914006dae0 msgr2=0x7f91400b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 shutdown_connections 2023-10-16T13:38:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.591+0000 7f914694d700 1 -- 172.21.15.5:0/3182217513 wait complete. 2023-10-16T13:38:36.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:36.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.732+0000 7f8238bb2700 1 Processor -- start 2023-10-16T13:38:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.732+0000 7f8238bb2700 1 -- start start 2023-10-16T13:38:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.733+0000 7f8238bb2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8234157d40 0x7f82340cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.733+0000 7f8238bb2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8234158120 con 0x7f823406de50 2023-10-16T13:38:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.733+0000 7f8238bb2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823406a840 con 0x7f823406e2b0 2023-10-16T13:38:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.733+0000 7f8238bb2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82340caef0 con 0x7f8234157d40 2023-10-16T13:38:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f8231d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f823406de50 0x7f823415dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52436/0 (socket says 172.21.15.5:52436) 2023-10-16T13:38:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f8231d9b700 1 -- 172.21.15.5:0/336646899 learned_addr learned my addr 172.21.15.5:0/336646899 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823259c700 1 --2- 172.21.15.5:0/336646899 >> v2:172.21.15.112:3300/0 conn(0x7f8234157d40 0x7f82340cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579875194 0 0) 0x7f8234158120 con 0x7f823406de50 2023-10-16T13:38:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f821c0035b0 con 0x7f823406de50 2023-10-16T13:38:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572381741 0 0) 0x7f821c0035b0 con 0x7f823406de50 2023-10-16T13:38:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 >> v2:172.21.15.112:3300/0 conn(0x7f8234157d40 msgr2=0x7f82340cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 --2- 172.21.15.5:0/336646899 >> v2:172.21.15.112:3300/0 conn(0x7f8234157d40 0x7f82340cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 >> v1:172.21.15.112:6789/0 conn(0x7f823406e2b0 legacy=0x7f82340cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823406e750 con 0x7f823406de50 2023-10-16T13:38:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f8224001670 con 0x7f823406de50 2023-10-16T13:38:36.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 >> v1:172.21.15.5:6789/0 conn(0x7f823406de50 legacy=0x7f823415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821c003a00 0x7f821c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c004850 0x7f821c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f821c005210 0x7f821c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340caef0 con 0x7f821c003a00 2023-10-16T13:38:36.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c00c1b0 con 0x7f821c005210 2023-10-16T13:38:36.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c00c370 con 0x7f821c004850 2023-10-16T13:38:36.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823259c700 1 --2- 172.21.15.5:0/336646899 >> v2:172.21.15.112:3300/0 conn(0x7f8234157d40 0x7f82340cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:36.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f823259c700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821c003a00 0x7f821c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f8231d9b700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c004850 0x7f821c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.734+0000 7f8232d9d700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f821c005210 0x7f821c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823259c700 1 -- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c004850 msgr2=0x7f821c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823259c700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c004850 0x7f821c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823259c700 1 -- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f821c005210 msgr2=0x7f821c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823259c700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f821c005210 0x7f821c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f8232d9d700 1 -- 172.21.15.5:0/336646899 reap_dead start 2023-10-16T13:38:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823259c700 1 -- 172.21.15.5:0/336646899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0035b0 con 0x7f821c003a00 2023-10-16T13:38:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823259c700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821c003a00 0x7f821c003e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f822800ad10 tx=0x7f821c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b0965c89fd8ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822800fab0 con 0x7f821c003a00 2023-10-16T13:38:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822800fc10 con 0x7f821c003a00 2023-10-16T13:38:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f823159a700 1 -- 172.21.15.5:0/336646899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228004030 con 0x7f821c003a00 2023-10-16T13:38:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f8238bb2700 1 -- 172.21.15.5:0/336646899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821c003a00 msgr2=0x7f821c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.735+0000 7f8238bb2700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821c003a00 0x7f821c003e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f822800ad10 tx=0x7f821c005880 comp rx=0 tx=0).stop 2023-10-16T13:38:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.736+0000 7f8238bb2700 1 -- 172.21.15.5:0/336646899 shutdown_connections 2023-10-16T13:38:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.736+0000 7f8238bb2700 1 --2- 172.21.15.5:0/336646899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821c003a00 0x7f821c003e20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.736+0000 7f8238bb2700 1 -- 172.21.15.5:0/336646899 >> 172.21.15.5:0/336646899 conn(0x7f82340cc6f0 msgr2=0x7f82340ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:36.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.736+0000 7f8238bb2700 1 -- 172.21.15.5:0/336646899 shutdown_connections 2023-10-16T13:38:36.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.736+0000 7f8238bb2700 1 -- 172.21.15.5:0/336646899 wait complete. 2023-10-16T13:38:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.737+0000 7f8238bb2700 1 Processor -- start 2023-10-16T13:38:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.737+0000 7f8238bb2700 1 -- start start 2023-10-16T13:38:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8238bb2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c003a00 0x7f82340c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8238bb2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82340c2810 0x7f8234151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8238bb2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 0x7f82340ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8238bb2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234152420 con 0x7f8234151fa0 2023-10-16T13:38:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8238bb2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340b0460 con 0x7f82340c2810 2023-10-16T13:38:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8238bb2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340af850 con 0x7f821c003a00 2023-10-16T13:38:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 0x7f82340ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 0x7f82340ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42448/0 (socket says 172.21.15.5:42448) 2023-10-16T13:38:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 -- 172.21.15.5:0/2161183092 learned_addr learned my addr 172.21.15.5:0/2161183092 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8231d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82340c2810 0x7f8234151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f823259c700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c003a00 0x7f82340c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 -- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c003a00 msgr2=0x7f82340c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c003a00 0x7f82340c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 -- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82340c2810 msgr2=0x7f8234151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82340c2810 0x7f8234151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 -- 172.21.15.5:0/2161183092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340afb30 con 0x7f8234151fa0 2023-10-16T13:38:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8232d9d700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 0x7f82340ae900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f82340c3450 tx=0x7f822c00ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.738+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c003cd0 con 0x7f8234151fa0 2023-10-16T13:38:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.739+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c003e30 con 0x7f8234151fa0 2023-10-16T13:38:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.739+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340afe10 con 0x7f8234151fa0 2023-10-16T13:38:36.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.739+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c005310 con 0x7f8234151fa0 2023-10-16T13:38:36.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.739+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82340c2c90 con 0x7f8234151fa0 2023-10-16T13:38:36.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.739+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8234067d20 con 0x7f8234151fa0 2023-10-16T13:38:36.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.740+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f822c005470 con 0x7f8234151fa0 2023-10-16T13:38:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.740+0000 7f8222ffd700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f821406af30 0x7f821406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.741+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f822c0895f0 con 0x7f8234151fa0 2023-10-16T13:38:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.741+0000 7f823259c700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f821406af30 0x7f821406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.741+0000 7f823259c700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f821406af30 0x7f821406d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8228008010 tx=0x7f8228015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:36.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.745+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f822c054690 con 0x7f8234151fa0 2023-10-16T13:38:36.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.946+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f823406d6e0 con 0x7f8234151fa0 2023-10-16T13:38:36.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.946+0000 7f8222ffd700 1 -- 172.21.15.5:0/2161183092 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f822c057cb0 con 0x7f8234151fa0 2023-10-16T13:38:36.949 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.948+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f821406af30 msgr2=0x7f821406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.948+0000 7f8238bb2700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f821406af30 0x7f821406d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8228008010 tx=0x7f8228015000 comp rx=0 tx=0).stop 2023-10-16T13:38:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.948+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 msgr2=0x7f82340ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.948+0000 7f8238bb2700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 0x7f82340ae900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f82340c3450 tx=0x7f822c00ff00 comp rx=0 tx=0).stop 2023-10-16T13:38:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 shutdown_connections 2023-10-16T13:38:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8234151fa0 0x7f82340ae900 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f821406af30 0x7f821406d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f821c003a00 0x7f82340c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 --2- 172.21.15.5:0/2161183092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82340c2810 0x7f8234151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 >> 172.21.15.5:0/2161183092 conn(0x7f82340cc6f0 msgr2=0x7f82340ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 shutdown_connections 2023-10-16T13:38:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:36.949+0000 7f8238bb2700 1 -- 172.21.15.5:0/2161183092 wait complete. 2023-10-16T13:38:36.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:37.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.088+0000 7f8ee5d8d700 1 Processor -- start 2023-10-16T13:38:37.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.088+0000 7f8ee5d8d700 1 -- start start 2023-10-16T13:38:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8ee5d8d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ee006ef20 0x7f8ee00cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8ee5d8d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee015bf30 con 0x7f8ee015bb50 2023-10-16T13:38:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8ee5d8d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee006d500 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8ee5d8d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee00ce540 con 0x7f8ee006ef20 2023-10-16T13:38:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8edf7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ee015bb50 0x7f8ee006e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52456/0 (socket says 172.21.15.5:52456) 2023-10-16T13:38:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8edf7fe700 1 -- 172.21.15.5:0/2084335017 learned_addr learned my addr 172.21.15.5:0/2084335017 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.089+0000 7f8edeffd700 1 --2- 172.21.15.5:0/2084335017 >> v2:172.21.15.112:3300/0 conn(0x7f8ee006ef20 0x7f8ee00cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8ede7fc700 1 -- 172.21.15.5:0/2084335017 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633113521 0 0) 0x7f8ee015bf30 con 0x7f8ee015bb50 2023-10-16T13:38:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8ede7fc700 1 -- 172.21.15.5:0/2084335017 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ecc0035b0 con 0x7f8ee015bb50 2023-10-16T13:38:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8edeffd700 1 -- 172.21.15.5:0/2084335017 >> v1:172.21.15.112:6789/0 conn(0x7f8ee00ce0b0 legacy=0x7f8ee006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8edeffd700 1 -- 172.21.15.5:0/2084335017 >> v1:172.21.15.5:6789/0 conn(0x7f8ee015bb50 legacy=0x7f8ee006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8edeffd700 1 -- 172.21.15.5:0/2084335017 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee006d7e0 con 0x7f8ee006ef20 2023-10-16T13:38:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8edeffd700 1 --2- 172.21.15.5:0/2084335017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee00cdb70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009840 tx=0x7f8ec8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b70cee86892903 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8ede7fc700 1 -- 172.21.15.5:0/2084335017 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8011830 con 0x7f8ee006ef20 2023-10-16T13:38:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8ede7fc700 1 -- 172.21.15.5:0/2084335017 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8011990 con 0x7f8ee006ef20 2023-10-16T13:38:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.090+0000 7f8ede7fc700 1 -- 172.21.15.5:0/2084335017 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8011d00 con 0x7f8ee006ef20 2023-10-16T13:38:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/2084335017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 msgr2=0x7f8ee00cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/2084335017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee00cdb70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009840 tx=0x7f8ec8009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/2084335017 shutdown_connections 2023-10-16T13:38:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/2084335017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee00cdb70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/2084335017 >> 172.21.15.5:0/2084335017 conn(0x7f8ee00cc6f0 msgr2=0x7f8ee00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:37.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/2084335017 shutdown_connections 2023-10-16T13:38:37.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.091+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/2084335017 wait complete. 2023-10-16T13:38:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.092+0000 7f8ee5d8d700 1 Processor -- start 2023-10-16T13:38:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.092+0000 7f8ee5d8d700 1 -- start start 2023-10-16T13:38:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8ee5d8d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8ee5d8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 0x7f8ee00ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8ee5d8d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ee015bb50 0x7f8ee014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8ee5d8d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00b0a10 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8ee5d8d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee014c680 con 0x7f8ee006ef20 2023-10-16T13:38:37.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8ee5d8d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00ade40 con 0x7f8ee015bb50 2023-10-16T13:38:37.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 0x7f8ee00ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 0x7f8ee00ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42458/0 (socket says 172.21.15.5:42458) 2023-10-16T13:38:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 -- 172.21.15.5:0/3230246086 learned_addr learned my addr 172.21.15.5:0/3230246086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edf7fe700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edffff700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ee015bb50 0x7f8ee014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 -- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ee015bb50 msgr2=0x7f8ee014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ee015bb50 0x7f8ee014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 -- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 msgr2=0x7f8ee014c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee014c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 -- 172.21.15.5:0/3230246086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80094a0 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.093+0000 7f8edeffd700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 0x7f8ee00ad900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009fd0 tx=0x7f8ec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.094+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80045d0 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.094+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec801f070 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.094+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee00ae110 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.094+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80038a0 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.094+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee00ae6d0 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.095+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee0067d20 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.095+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8ec8003a00 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.096+0000 7f8ed7fff700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec006af00 0x7f8ec006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.096+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ec8021070 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.096+0000 7f8edf7fe700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec006af00 0x7f8ec006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.097+0000 7f8edf7fe700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec006af00 0x7f8ec006d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0007fd0 tx=0x7f8ed0007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.100+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ec8056320 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.300+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ee00668b0 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.300+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3230246086 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ec8003cb0 con 0x7f8ee00ce0b0 2023-10-16T13:38:37.303 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec006af00 msgr2=0x7f8ec006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec006af00 0x7f8ec006d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0007fd0 tx=0x7f8ed0007dc0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 msgr2=0x7f8ee00ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 0x7f8ee00ad900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009fd0 tx=0x7f8ec8004750 comp rx=0 tx=0).stop 2023-10-16T13:38:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 shutdown_connections 2023-10-16T13:38:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec006af00 0x7f8ec006d3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ee015bb50 0x7f8ee014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ee006ef20 0x7f8ee014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 --2- 172.21.15.5:0/3230246086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee00ce0b0 0x7f8ee00ad900 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.302+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 >> 172.21.15.5:0/3230246086 conn(0x7f8ee00cc6f0 msgr2=0x7f8ee00ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.303+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 shutdown_connections 2023-10-16T13:38:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.303+0000 7f8ee5d8d700 1 -- 172.21.15.5:0/3230246086 wait complete. 2023-10-16T13:38:37.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:37.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.442+0000 7f0f458c9700 1 Processor -- start 2023-10-16T13:38:37.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.442+0000 7f0f458c9700 1 -- start start 2023-10-16T13:38:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f458c9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f400d3fc0 0x7f0f4015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f458c9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4015e4e0 con 0x7f0f4015dbc0 2023-10-16T13:38:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f458c9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f400d28e0 con 0x7f0f400b7050 2023-10-16T13:38:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f458c9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f400b7560 con 0x7f0f400d3fc0 2023-10-16T13:38:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f4015dbc0 0x7f0f400d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52468/0 (socket says 172.21.15.5:52468) 2023-10-16T13:38:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3effd700 1 -- 172.21.15.5:0/1973807917 learned_addr learned my addr 172.21.15.5:0/1973807917 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530081151 0 0) 0x7f0f4015e4e0 con 0x7f0f4015dbc0 2023-10-16T13:38:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f280035b0 con 0x7f0f4015dbc0 2023-10-16T13:38:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3e7fc700 1 --2- 172.21.15.5:0/1973807917 >> v2:172.21.15.112:3300/0 conn(0x7f0f400d3fc0 0x7f0f4015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722677006 0 0) 0x7f0f280035b0 con 0x7f0f4015dbc0 2023-10-16T13:38:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 >> v2:172.21.15.112:3300/0 conn(0x7f0f400d3fc0 msgr2=0x7f0f4015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3dffb700 1 --2- 172.21.15.5:0/1973807917 >> v2:172.21.15.112:3300/0 conn(0x7f0f400d3fc0 0x7f0f4015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.443+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 >> v1:172.21.15.112:6789/0 conn(0x7f0f400b7050 legacy=0x7f0f400d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400b7840 con 0x7f0f4015dbc0 2023-10-16T13:38:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f0f340017f0 con 0x7f0f4015dbc0 2023-10-16T13:38:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 >> v1:172.21.15.5:6789/0 conn(0x7f0f4015dbc0 legacy=0x7f0f400d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f28003a00 0x7f0f28003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28004850 0x7f0f28004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28005210 0x7f0f2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400b7560 con 0x7f0f28003a00 2023-10-16T13:38:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2800c0b0 con 0x7f0f28005210 2023-10-16T13:38:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2800c270 con 0x7f0f28004850 2023-10-16T13:38:37.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f28003a00 0x7f0f28003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3f7fe700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28005210 0x7f0f2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3e7fc700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28004850 0x7f0f28004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 -- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28004850 msgr2=0x7f0f28004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:37.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28004850 0x7f0f28004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 -- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28005210 msgr2=0x7f0f2800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28005210 0x7f0f2800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 -- 172.21.15.5:0/1973807917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280035b0 con 0x7f0f28003a00 2023-10-16T13:38:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3f7fe700 1 -- 172.21.15.5:0/1973807917 reap_dead start 2023-10-16T13:38:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3effd700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f28003a00 0x7f0f28003e20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c240 tx=0x7f0f28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b61d3bed9df47e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400cde0 con 0x7f0f28003a00 2023-10-16T13:38:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34007b80 con 0x7f0f28003a00 2023-10-16T13:38:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.444+0000 7f0f3dffb700 1 -- 172.21.15.5:0/1973807917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340072d0 con 0x7f0f28003a00 2023-10-16T13:38:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 -- 172.21.15.5:0/1973807917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f28003a00 msgr2=0x7f0f28003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f28003a00 0x7f0f28003e20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c240 tx=0x7f0f28005880 comp rx=0 tx=0).stop 2023-10-16T13:38:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 -- 172.21.15.5:0/1973807917 shutdown_connections 2023-10-16T13:38:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 --2- 172.21.15.5:0/1973807917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f28003a00 0x7f0f28003e20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 -- 172.21.15.5:0/1973807917 >> 172.21.15.5:0/1973807917 conn(0x7f0f4009cb40 msgr2=0x7f0f400d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 -- 172.21.15.5:0/1973807917 shutdown_connections 2023-10-16T13:38:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.445+0000 7f0f458c9700 1 -- 172.21.15.5:0/1973807917 wait complete. 2023-10-16T13:38:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.446+0000 7f0f458c9700 1 Processor -- start 2023-10-16T13:38:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.446+0000 7f0f458c9700 1 -- start start 2023-10-16T13:38:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f458c9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28003a00 0x7f0f401553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f458c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 0x7f0f40158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f458c9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f4015adc0 0x7f0f40158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f458c9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40157790 con 0x7f0f4015a940 2023-10-16T13:38:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f458c9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40155f60 con 0x7f0f4015adc0 2023-10-16T13:38:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f458c9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40156b10 con 0x7f0f28003a00 2023-10-16T13:38:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f3e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 0x7f0f40158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f3e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 0x7f0f40158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42478/0 (socket says 172.21.15.5:42478) 2023-10-16T13:38:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.447+0000 7f0f3e7fc700 1 -- 172.21.15.5:0/2709949546 learned_addr learned my addr 172.21.15.5:0/2709949546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3f7fe700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f4015adc0 0x7f0f40158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3effd700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28003a00 0x7f0f401553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3e7fc700 1 -- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28003a00 msgr2=0x7f0f401553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3e7fc700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28003a00 0x7f0f401553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3e7fc700 1 -- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f4015adc0 msgr2=0x7f0f40158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3e7fc700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f4015adc0 0x7f0f40158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3e7fc700 1 -- 172.21.15.5:0/2709949546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f40156df0 con 0x7f0f4015a940 2023-10-16T13:38:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3effd700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28003a00 0x7f0f401553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f3e7fc700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 0x7f0f40158900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f30011aa0 tx=0x7f0f30011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3000f9e0 con 0x7f0f4015a940 2023-10-16T13:38:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3000fb40 con 0x7f0f4015a940 2023-10-16T13:38:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f401570d0 con 0x7f0f4015a940 2023-10-16T13:38:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30014440 con 0x7f0f4015a940 2023-10-16T13:38:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.448+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f401558f0 con 0x7f0f4015a940 2023-10-16T13:38:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.449+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4004ebb0 con 0x7f0f4015a940 2023-10-16T13:38:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.449+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f300145a0 con 0x7f0f4015a940 2023-10-16T13:38:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.450+0000 7f0f27fff700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f2c06af00 0x7f0f2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.450+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f30089d10 con 0x7f0f4015a940 2023-10-16T13:38:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.450+0000 7f0f3effd700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f2c06af00 0x7f0f2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.450+0000 7f0f3effd700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f2c06af00 0x7f0f2c06d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f34015040 tx=0x7f0f34007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.455+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f30054dc0 con 0x7f0f4015a940 2023-10-16T13:38:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.658+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f401e3290 con 0x7f0f4015a940 2023-10-16T13:38:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.660+0000 7f0f27fff700 1 -- 172.21.15.5:0/2709949546 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f300583e0 con 0x7f0f4015a940 2023-10-16T13:38:37.663 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f2c06af00 msgr2=0x7f0f2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f2c06af00 0x7f0f2c06d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f34015040 tx=0x7f0f34007000 comp rx=0 tx=0).stop 2023-10-16T13:38:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 msgr2=0x7f0f40158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 0x7f0f40158900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f30011aa0 tx=0x7f0f30011e60 comp rx=0 tx=0).stop 2023-10-16T13:38:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 shutdown_connections 2023-10-16T13:38:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f4015adc0 0x7f0f40158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f2c06af00 0x7f0f2c06d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f28003a00 0x7f0f401553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 --2- 172.21.15.5:0/2709949546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4015a940 0x7f0f40158900 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 >> 172.21.15.5:0/2709949546 conn(0x7f0f4009cb40 msgr2=0x7f0f400d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 shutdown_connections 2023-10-16T13:38:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.663+0000 7f0f458c9700 1 -- 172.21.15.5:0/2709949546 wait complete. 2023-10-16T13:38:37.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:38:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.800+0000 7f6ab5f1f700 1 Processor -- start 2023-10-16T13:38:37.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.800+0000 7f6ab5f1f700 1 -- start start 2023-10-16T13:38:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.801+0000 7f6ab5f1f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ab00d0c70 0x7f6ab00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.801+0000 7f6ab5f1f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab00c5110 0x7f6ab00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.801+0000 7f6ab5f1f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00d23e0 con 0x7f6ab015b740 2023-10-16T13:38:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.801+0000 7f6ab5f1f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab015bb20 con 0x7f6ab00d0c70 2023-10-16T13:38:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.801+0000 7f6ab5f1f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cf190 con 0x7f6ab00c5110 2023-10-16T13:38:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab00c5110 0x7f6ab00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ab00d0c70 0x7f6ab00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ab00d0c70 0x7f6ab00cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:38382/0 (socket says 172.21.15.5:38382) 2023-10-16T13:38:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 -- 172.21.15.5:0/1133526307 learned_addr learned my addr 172.21.15.5:0/1133526307 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab00c5110 0x7f6ab00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40392/0 (socket says 172.21.15.5:40392) 2023-10-16T13:38:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 -- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab00c5110 msgr2=0x7f6ab00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 --2- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab00c5110 0x7f6ab00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 -- 172.21.15.5:0/1133526307 >> v1:172.21.15.112:6789/0 conn(0x7f6ab015b740 legacy=0x7f6ab00d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 -- 172.21.15.5:0/1133526307 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00cbd40 con 0x7f6ab00d0c70 2023-10-16T13:38:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aaeffd700 1 --2- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00cdfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a980098f0 tx=0x7f6a98009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fdf6595a78f921e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aae7fc700 1 -- 172.21.15.5:0/1133526307 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98011830 con 0x7f6ab00d0c70 2023-10-16T13:38:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aae7fc700 1 -- 172.21.15.5:0/1133526307 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98011990 con 0x7f6ab00d0c70 2023-10-16T13:38:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.802+0000 7f6aae7fc700 1 -- 172.21.15.5:0/1133526307 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98011d20 con 0x7f6ab00d0c70 2023-10-16T13:38:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 msgr2=0x7f6ab00cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00cdfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a980098f0 tx=0x7f6a98009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1133526307 shutdown_connections 2023-10-16T13:38:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab00c5110 0x7f6ab00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1133526307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00cdfd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1133526307 >> 172.21.15.5:0/1133526307 conn(0x7f6ab00665a0 msgr2=0x7f6ab0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1133526307 shutdown_connections 2023-10-16T13:38:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.803+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1133526307 wait complete. 2023-10-16T13:38:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.804+0000 7f6ab5f1f700 1 Processor -- start 2023-10-16T13:38:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.804+0000 7f6ab5f1f700 1 -- start start 2023-10-16T13:38:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6ab5f1f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 0x7f6ab0157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6ab5f1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6ab5f1f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015b740 0x7f6ab00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6ab5f1f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab01f32a0 con 0x7f6ab00c5110 2023-10-16T13:38:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6ab5f1f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab01f40c0 con 0x7f6ab00d0c70 2023-10-16T13:38:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6ab5f1f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0158200 con 0x7f6ab015b740 2023-10-16T13:38:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 0x7f6ab0157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 0x7f6ab0157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42490/0 (socket says 172.21.15.5:42490) 2023-10-16T13:38:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 -- 172.21.15.5:0/1849472901 learned_addr learned my addr 172.21.15.5:0/1849472901 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaffff700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015b740 0x7f6ab00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaeffd700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 -- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015b740 msgr2=0x7f6ab00c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015b740 0x7f6ab00c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 -- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 msgr2=0x7f6ab00b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 -- 172.21.15.5:0/1849472901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98009550 con 0x7f6ab00c5110 2023-10-16T13:38:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.805+0000 7f6aaf7fe700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 0x7f6ab0157cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c450 tx=0x7f6aa000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.806+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00052d0 con 0x7f6ab00c5110 2023-10-16T13:38:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.806+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005430 con 0x7f6ab00c5110 2023-10-16T13:38:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.806+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab00c4e10 con 0x7f6ab00c5110 2023-10-16T13:38:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.806+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00038c0 con 0x7f6ab00c5110 2023-10-16T13:38:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.806+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab01f3790 con 0x7f6ab00c5110 2023-10-16T13:38:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.807+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab00cccc0 con 0x7f6ab00c5110 2023-10-16T13:38:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.807+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6aa0003a20 con 0x7f6ab00c5110 2023-10-16T13:38:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.808+0000 7f6aa7fff700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006af00 0x7f6a9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.808+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aa0088700 con 0x7f6ab00c5110 2023-10-16T13:38:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.808+0000 7f6aaeffd700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006af00 0x7f6a9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.808+0000 7f6aaeffd700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006af00 0x7f6a9006d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009c40 tx=0x7f6a98008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:37.813+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6aa0053840 con 0x7f6ab00c5110 2023-10-16T13:38:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.058+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ab00d23e0 con 0x7f6ab00c5110 2023-10-16T13:38:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.059+0000 7f6aa7fff700 1 -- 172.21.15.5:0/1849472901 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6ab00d23e0 con 0x7f6ab00c5110 2023-10-16T13:38:38.062 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:38.062 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:38:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006af00 msgr2=0x7f6a9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006af00 0x7f6a9006d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009c40 tx=0x7f6a98008030 comp rx=0 tx=0).stop 2023-10-16T13:38:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 msgr2=0x7f6ab0157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 0x7f6ab0157cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c450 tx=0x7f6aa000c810 comp rx=0 tx=0).stop 2023-10-16T13:38:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 shutdown_connections 2023-10-16T13:38:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006af00 0x7f6a9006d3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015b740 0x7f6ab00c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab00c5110 0x7f6ab0157cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 --2- 172.21.15.5:0/1849472901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00d0c70 0x7f6ab00b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 >> 172.21.15.5:0/1849472901 conn(0x7f6ab00665a0 msgr2=0x7f6ab00cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 shutdown_connections 2023-10-16T13:38:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.061+0000 7f6ab5f1f700 1 -- 172.21.15.5:0/1849472901 wait complete. 2023-10-16T13:38:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:38:38.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.198+0000 7f6f4c3a8700 1 Processor -- start 2023-10-16T13:38:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.198+0000 7f6f4c3a8700 1 -- start start 2023-10-16T13:38:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f4c3a8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f440cfe30 0x7f6f440cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f4c3a8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4415e7a0 con 0x7f6f4415f1f0 2023-10-16T13:38:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f4c3a8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f440b29a0 con 0x7f6f4415ab10 2023-10-16T13:38:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f4c3a8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f440b2c80 con 0x7f6f440cfe30 2023-10-16T13:38:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f49943700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f4415f1f0 0x7f6f440cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52504/0 (socket says 172.21.15.5:52504) 2023-10-16T13:38:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f49943700 1 -- 172.21.15.5:0/742795642 learned_addr learned my addr 172.21.15.5:0/742795642 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f4a945700 1 --2- 172.21.15.5:0/742795642 >> v2:172.21.15.112:3300/0 conn(0x7f6f440cfe30 0x7f6f440cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592048162 0 0) 0x7f6f4415e7a0 con 0x7f6f4415f1f0 2023-10-16T13:38:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.199+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f300035b0 con 0x7f6f4415f1f0 2023-10-16T13:38:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283785954 0 0) 0x7f6f300035b0 con 0x7f6f4415f1f0 2023-10-16T13:38:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 >> v2:172.21.15.112:3300/0 conn(0x7f6f440cfe30 msgr2=0x7f6f440cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 --2- 172.21.15.5:0/742795642 >> v2:172.21.15.112:3300/0 conn(0x7f6f440cfe30 0x7f6f440cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 >> v1:172.21.15.112:6789/0 conn(0x7f6f4415ab10 legacy=0x7f6f440b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4415e9f0 con 0x7f6f4415f1f0 2023-10-16T13:38:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6f400017f0 con 0x7f6f4415f1f0 2023-10-16T13:38:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 --2- 172.21.15.5:0/742795642 >> v2:172.21.15.112:3300/0 conn(0x7f6f440cfe30 0x7f6f440cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 >> v1:172.21.15.5:6789/0 conn(0x7f6f4415f1f0 legacy=0x7f6f440cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30003a00 0x7f6f30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f30004850 0x7f6f30004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f3000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440b2c80 con 0x7f6f30005210 2023-10-16T13:38:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3000c0b0 con 0x7f6f30003a00 2023-10-16T13:38:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3000c270 con 0x7f6f30004850 2023-10-16T13:38:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f3000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a144700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30003a00 0x7f6f30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f49943700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f30004850 0x7f6f30004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 -- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f30004850 msgr2=0x7f6f30004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f30004850 0x7f6f30004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 -- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30003a00 msgr2=0x7f6f30003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30003a00 0x7f6f30003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 -- 172.21.15.5:0/742795642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300035b0 con 0x7f6f30005210 2023-10-16T13:38:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 -- 172.21.15.5:0/742795642 reap_dead start 2023-10-16T13:38:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.200+0000 7f6f4a945700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f3000ba10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00e320 tx=0x7f6f30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b965bfaaa880b3cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00edc0 con 0x7f6f30005210 2023-10-16T13:38:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c00f040 con 0x7f6f30005210 2023-10-16T13:38:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f49142700 1 -- 172.21.15.5:0/742795642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c003c60 con 0x7f6f30005210 2023-10-16T13:38:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/742795642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 msgr2=0x7f6f3000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f3000ba10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00e320 tx=0x7f6f30005880 comp rx=0 tx=0).stop 2023-10-16T13:38:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/742795642 shutdown_connections 2023-10-16T13:38:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/742795642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f3000ba10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/742795642 >> 172.21.15.5:0/742795642 conn(0x7f6f4406dae0 msgr2=0x7f6f4406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/742795642 shutdown_connections 2023-10-16T13:38:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.201+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/742795642 wait complete. 2023-10-16T13:38:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.202+0000 7f6f4c3a8700 1 Processor -- start 2023-10-16T13:38:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.202+0000 7f6f4c3a8700 1 -- start start 2023-10-16T13:38:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4c3a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f440ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4c3a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44148730 0x7f6f440c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4c3a8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4414e1d0 0x7f6f4414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4c3a8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4414ebc0 con 0x7f6f30005210 2023-10-16T13:38:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4c3a8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440ad2c0 con 0x7f6f44148730 2023-10-16T13:38:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4c3a8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440ad560 con 0x7f6f4414e1d0 2023-10-16T13:38:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4a144700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f440ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4a144700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f440ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42510/0 (socket says 172.21.15.5:42510) 2023-10-16T13:38:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4a144700 1 -- 172.21.15.5:0/1905389037 learned_addr learned my addr 172.21.15.5:0/1905389037 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f4a945700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4414e1d0 0x7f6f4414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.203+0000 7f6f49943700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44148730 0x7f6f440c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4a144700 1 -- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4414e1d0 msgr2=0x7f6f4414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4a144700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4414e1d0 0x7f6f4414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4a144700 1 -- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44148730 msgr2=0x7f6f440c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4a144700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44148730 0x7f6f440c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4a144700 1 -- 172.21.15.5:0/1905389037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440ad840 con 0x7f6f30005210 2023-10-16T13:38:38.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f49943700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44148730 0x7f6f440c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:38.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4a144700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f440ae600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400f820 tx=0x7f6f3400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:38.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340052e0 con 0x7f6f30005210 2023-10-16T13:38:38.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f34005440 con 0x7f6f30005210 2023-10-16T13:38:38.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f440adb20 con 0x7f6f30005210 2023-10-16T13:38:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340038c0 con 0x7f6f30005210 2023-10-16T13:38:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.204+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f440ae0e0 con 0x7f6f30005210 2023-10-16T13:38:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.205+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f440ae270 con 0x7f6f30005210 2023-10-16T13:38:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.205+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f34003a20 con 0x7f6f30005210 2023-10-16T13:38:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.206+0000 7f6f3affd700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2806af00 0x7f6f2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.206+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f34089320 con 0x7f6f30005210 2023-10-16T13:38:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.206+0000 7f6f49943700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2806af00 0x7f6f2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.206+0000 7f6f49943700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2806af00 0x7f6f2806d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f400011d0 tx=0x7f6f40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.210+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f34054330 con 0x7f6f30005210 2023-10-16T13:38:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.413+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f440afc10 con 0x7f6f30005210 2023-10-16T13:38:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.414+0000 7f6f3affd700 1 -- 172.21.15.5:0/1905389037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f6f34057950 con 0x7f6f30005210 2023-10-16T13:38:38.417 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:38.417 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.416+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2806af00 msgr2=0x7f6f2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.416+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2806af00 0x7f6f2806d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f400011d0 tx=0x7f6f40009040 comp rx=0 tx=0).stop 2023-10-16T13:38:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.416+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 msgr2=0x7f6f440ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.416+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f440ae600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400f820 tx=0x7f6f3400fb30 comp rx=0 tx=0).stop 2023-10-16T13:38:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.416+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 shutdown_connections 2023-10-16T13:38:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.416+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2806af00 0x7f6f2806d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.417+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4414e1d0 0x7f6f4414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.417+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f30005210 0x7f6f440ae600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.417+0000 7f6f4c3a8700 1 --2- 172.21.15.5:0/1905389037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44148730 0x7f6f440c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.417+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 >> 172.21.15.5:0/1905389037 conn(0x7f6f4406dae0 msgr2=0x7f6f440cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.417+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 shutdown_connections 2023-10-16T13:38:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.417+0000 7f6f4c3a8700 1 -- 172.21.15.5:0/1905389037 wait complete. 2023-10-16T13:38:38.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:38:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.554+0000 7f2442cf2700 1 Processor -- start 2023-10-16T13:38:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.554+0000 7f2442cf2700 1 -- start start 2023-10-16T13:38:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2442cf2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cd950 0x7f243c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2442cf2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f243c0cede0 0x7f243c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2442cf2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f243c06a840 0x7f243c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2442cf2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c1619a0 con 0x7f243c06a840 2023-10-16T13:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2442cf2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c06b1f0 con 0x7f243c0cede0 2023-10-16T13:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2442cf2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0cf260 con 0x7f243c0cd950 2023-10-16T13:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f243c06a840 0x7f243c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f243c06a840 0x7f243c06acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42522/0 (socket says 172.21.15.5:42522) 2023-10-16T13:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 -- 172.21.15.5:0/918084460 learned_addr learned my addr 172.21.15.5:0/918084460 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f2440a8e700 1 --2- 172.21.15.5:0/918084460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cd950 0x7f243c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f243bfff700 1 --2- 172.21.15.5:0/918084460 >> v2:172.21.15.112:3300/0 conn(0x7f243c0cede0 0x7f243c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 -- 172.21.15.5:0/918084460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cd950 msgr2=0x7f243c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 --2- 172.21.15.5:0/918084460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cd950 0x7f243c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 -- 172.21.15.5:0/918084460 >> v2:172.21.15.112:3300/0 conn(0x7f243c0cede0 msgr2=0x7f243c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 --2- 172.21.15.5:0/918084460 >> v2:172.21.15.112:3300/0 conn(0x7f243c0cede0 0x7f243c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.555+0000 7f244128f700 1 -- 172.21.15.5:0/918084460 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0b2d60 con 0x7f243c06a840 2023-10-16T13:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f244128f700 1 --2- 172.21.15.5:0/918084460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c06a840 0x7f243c06acb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f243c06d380 tx=0x7f243400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdfa4f2c00ec7f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f243b7fe700 1 -- 172.21.15.5:0/918084460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400e070 con 0x7f243c06a840 2023-10-16T13:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f243b7fe700 1 -- 172.21.15.5:0/918084460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400b910 con 0x7f243c06a840 2023-10-16T13:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f243b7fe700 1 -- 172.21.15.5:0/918084460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400bcc0 con 0x7f243c06a840 2023-10-16T13:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 -- 172.21.15.5:0/918084460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c06a840 msgr2=0x7f243c06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 --2- 172.21.15.5:0/918084460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c06a840 0x7f243c06acb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f243c06d380 tx=0x7f243400b330 comp rx=0 tx=0).stop 2023-10-16T13:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 -- 172.21.15.5:0/918084460 shutdown_connections 2023-10-16T13:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 --2- 172.21.15.5:0/918084460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c06a840 0x7f243c06acb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 --2- 172.21.15.5:0/918084460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cd950 0x7f243c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 --2- 172.21.15.5:0/918084460 >> v2:172.21.15.112:3300/0 conn(0x7f243c0cede0 0x7f243c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 -- 172.21.15.5:0/918084460 >> 172.21.15.5:0/918084460 conn(0x7f243c06dae0 msgr2=0x7f243c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 -- 172.21.15.5:0/918084460 shutdown_connections 2023-10-16T13:38:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.556+0000 7f2442cf2700 1 -- 172.21.15.5:0/918084460 wait complete. 2023-10-16T13:38:38.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.558+0000 7f2442cf2700 1 Processor -- start 2023-10-16T13:38:38.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.558+0000 7f2442cf2700 1 -- start start 2023-10-16T13:38:38.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f243c06a840 0x7f243c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 0x7f243c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cede0 0x7f243c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0c6680 con 0x7f243c0cd950 2023-10-16T13:38:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0c5a70 con 0x7f243c06a840 2023-10-16T13:38:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0c5d50 con 0x7f243c0cede0 2023-10-16T13:38:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 0x7f243c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 0x7f243c0c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42526/0 (socket says 172.21.15.5:42526) 2023-10-16T13:38:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 -- 172.21.15.5:0/907368729 learned_addr learned my addr 172.21.15.5:0/907368729 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2440a8e700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f243c06a840 0x7f243c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f244128f700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cede0 0x7f243c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 -- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cede0 msgr2=0x7f243c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cede0 0x7f243c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 -- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f243c06a840 msgr2=0x7f243c0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f243c06a840 0x7f243c0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 -- 172.21.15.5:0/907368729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434009b30 con 0x7f243c0cd950 2023-10-16T13:38:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f244128f700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cede0 0x7f243c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f243bfff700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 0x7f243c0c5220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f242800e900 tx=0x7f242800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428009650 con 0x7f243c0cd950 2023-10-16T13:38:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242800c850 con 0x7f243c0cd950 2023-10-16T13:38:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c0c6030 con 0x7f243c0cd950 2023-10-16T13:38:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800cbc0 con 0x7f243c0cd950 2023-10-16T13:38:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.559+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c0c5760 con 0x7f243c0cd950 2023-10-16T13:38:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.560+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c067d20 con 0x7f243c0cd950 2023-10-16T13:38:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.561+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f242800cd20 con 0x7f243c0cd950 2023-10-16T13:38:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.561+0000 7f24397fa700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f242006af00 0x7f242006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.561+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24280899f0 con 0x7f243c0cd950 2023-10-16T13:38:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.561+0000 7f2440a8e700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f242006af00 0x7f242006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.562+0000 7f2440a8e700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f242006af00 0x7f242006d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2430009af0 tx=0x7f2430008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.566+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2428054a90 con 0x7f243c0cd950 2023-10-16T13:38:38.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.813+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f243c160c00 con 0x7f243c0cd950 2023-10-16T13:38:38.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.813+0000 7f24397fa700 1 -- 172.21.15.5:0/907368729 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f2428021090 con 0x7f243c0cd950 2023-10-16T13:38:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:38.816 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:38:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f242006af00 msgr2=0x7f242006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f242006af00 0x7f242006d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2430009af0 tx=0x7f2430008040 comp rx=0 tx=0).stop 2023-10-16T13:38:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 msgr2=0x7f243c0c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 0x7f243c0c5220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f242800e900 tx=0x7f242800ecc0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 shutdown_connections 2023-10-16T13:38:38.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f242006af00 0x7f242006d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f243c0cede0 0x7f243c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f243c06a840 0x7f243c0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 --2- 172.21.15.5:0/907368729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f243c0cd950 0x7f243c0c5220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:38.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 >> 172.21.15.5:0/907368729 conn(0x7f243c06dae0 msgr2=0x7f243c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 shutdown_connections 2023-10-16T13:38:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:38.815+0000 7f2442cf2700 1 -- 172.21.15.5:0/907368729 wait complete. 2023-10-16T13:38:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:38:39.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:38:19.370472+0000', 'modified': '2023-10-16T13:38:22.403648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/2030805663', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 2030805663}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 2030805663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:38:39.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:38:39.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T13:38:39.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.361+0000 7f872c68a700 1 Processor -- start 2023-10-16T13:38:39.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.361+0000 7f872c68a700 1 -- start start 2023-10-16T13:38:39.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872c68a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d1d60 0x7f87240d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872c68a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87240d1560 0x7f8724161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872c68a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872415eba0 con 0x7f87240d0a10 2023-10-16T13:38:39.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872c68a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87240d2680 con 0x7f87240d1560 2023-10-16T13:38:39.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872c68a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240d4620 con 0x7f87240d1d60 2023-10-16T13:38:39.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872ac27700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87240d1560 0x7f8724161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872ac27700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87240d1560 0x7f8724161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42536/0 (socket says 172.21.15.5:42536) 2023-10-16T13:38:39.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872ac27700 1 -- 172.21.15.5:0/4224753831 learned_addr learned my addr 172.21.15.5:0/4224753831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:39.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872a426700 1 --2- 172.21.15.5:0/4224753831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d1d60 0x7f87240d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872ac27700 1 -- 172.21.15.5:0/4224753831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d1d60 msgr2=0x7f87240d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872ac27700 1 --2- 172.21.15.5:0/4224753831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d1d60 0x7f87240d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.362+0000 7f872ac27700 1 -- 172.21.15.5:0/4224753831 >> v1:172.21.15.112:6789/0 conn(0x7f87240d0a10 legacy=0x7f87241616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872ac27700 1 -- 172.21.15.5:0/4224753831 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872415e270 con 0x7f87240d1560 2023-10-16T13:38:39.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872ac27700 1 --2- 172.21.15.5:0/4224753831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f8724161de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f871c009e50 tx=0x7f871c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7430d01b109bb83b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f8729424700 1 -- 172.21.15.5:0/4224753831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00e070 con 0x7f87240d1560 2023-10-16T13:38:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f8729424700 1 -- 172.21.15.5:0/4224753831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00b9c0 con 0x7f87240d1560 2023-10-16T13:38:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f8729424700 1 -- 172.21.15.5:0/4224753831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00bd70 con 0x7f87240d1560 2023-10-16T13:38:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 -- 172.21.15.5:0/4224753831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 msgr2=0x7f8724161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 --2- 172.21.15.5:0/4224753831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f8724161de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f871c009e50 tx=0x7f871c00b330 comp rx=0 tx=0).stop 2023-10-16T13:38:39.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 -- 172.21.15.5:0/4224753831 shutdown_connections 2023-10-16T13:38:39.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 --2- 172.21.15.5:0/4224753831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f8724161de0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 --2- 172.21.15.5:0/4224753831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d1d60 0x7f87240d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 -- 172.21.15.5:0/4224753831 >> 172.21.15.5:0/4224753831 conn(0x7f872409ca80 msgr2=0x7f87240d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:39.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.363+0000 7f872c68a700 1 -- 172.21.15.5:0/4224753831 shutdown_connections 2023-10-16T13:38:39.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.364+0000 7f872c68a700 1 -- 172.21.15.5:0/4224753831 wait complete. 2023-10-16T13:38:39.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.365+0000 7f872c68a700 1 Processor -- start 2023-10-16T13:38:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.365+0000 7f872c68a700 1 -- start start 2023-10-16T13:38:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872c68a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d0a10 0x7f87240b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872c68a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f87240b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872c68a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87240d1d60 0x7f87240b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872c68a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b6dc0 con 0x7f87240d1560 2023-10-16T13:38:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872c68a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240c7580 con 0x7f87240d1d60 2023-10-16T13:38:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872c68a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b5060 con 0x7f87240d0a10 2023-10-16T13:38:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f87240b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f87240b8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42540/0 (socket says 172.21.15.5:42540) 2023-10-16T13:38:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f8729c25700 1 -- 172.21.15.5:0/3007851487 learned_addr learned my addr 172.21.15.5:0/3007851487 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872a426700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d0a10 0x7f87240b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.366+0000 7f872ac27700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87240d1d60 0x7f87240b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f8729c25700 1 -- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d0a10 msgr2=0x7f87240b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f8729c25700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d0a10 0x7f87240b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f8729c25700 1 -- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87240d1d60 msgr2=0x7f87240b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f8729c25700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87240d1d60 0x7f87240b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f8729c25700 1 -- 172.21.15.5:0/3007851487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c009b30 con 0x7f87240d1560 2023-10-16T13:38:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f8729c25700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f87240b8c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f871400c4e0 tx=0x7f871400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f871affd700 1 -- 172.21.15.5:0/3007851487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140052d0 con 0x7f87240d1560 2023-10-16T13:38:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f871affd700 1 -- 172.21.15.5:0/3007851487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714005430 con 0x7f87240d1560 2023-10-16T13:38:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87240b6ae0 con 0x7f87240d1560 2023-10-16T13:38:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f871affd700 1 -- 172.21.15.5:0/3007851487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140038c0 con 0x7f87240d1560 2023-10-16T13:38:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.367+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87240c7070 con 0x7f87240d1560 2023-10-16T13:38:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.368+0000 7f871affd700 1 -- 172.21.15.5:0/3007851487 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8714003a20 con 0x7f87240d1560 2023-10-16T13:38:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.369+0000 7f871affd700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f870806af00 0x7f870806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.369+0000 7f871affd700 1 -- 172.21.15.5:0/3007851487 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8714088960 con 0x7f87240d1560 2023-10-16T13:38:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.369+0000 7f872a426700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f870806af00 0x7f870806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.370+0000 7f872a426700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f870806af00 0x7f870806d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87240b6f20 tx=0x7f8720008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.371+0000 7f8738874b80 1 Processor -- start 2023-10-16T13:38:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.371+0000 7f8738874b80 1 -- start start 2023-10-16T13:38:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f485a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8738874b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f485fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8738874b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f3cfc20 con 0x558f8f483630 2023-10-16T13:38:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f3b4c10 con 0x558f8f459010 2023-10-16T13:38:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8f3b2530 con 0x558f8f47e220 2023-10-16T13:38:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f485fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f872a426700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f485a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f485fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42548/0 (socket says 172.21.15.5:42548) 2023-10-16T13:38:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f872ac27700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 -- 172.21.15.5:0/3463599136 learned_addr learned my addr 172.21.15.5:0/3463599136 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 -- 172.21.15.5:0/3463599136 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 msgr2=0x558f8f485a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f485a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 -- 172.21.15.5:0/3463599136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 msgr2=0x558f8f4596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 -- 172.21.15.5:0/3463599136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f8f36b3a0 con 0x558f8f483630 2023-10-16T13:38:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8729c25700 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f485fb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f871405f400 tx=0x7f8714056f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b89af77aa97e10f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8707fff700 1 -- 172.21.15.5:0/3463599136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714057d30 con 0x558f8f483630 2023-10-16T13:38:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8707fff700 1 -- 172.21.15.5:0/3463599136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714057630 con 0x558f8f483630 2023-10-16T13:38:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.372+0000 7f8707fff700 1 -- 172.21.15.5:0/3463599136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871405b780 con 0x558f8f483630 2023-10-16T13:38:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 -- 172.21.15.5:0/3463599136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 msgr2=0x558f8f485fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f485fb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f871405f400 tx=0x7f8714056f90 comp rx=0 tx=0).stop 2023-10-16T13:38:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 -- 172.21.15.5:0/3463599136 shutdown_connections 2023-10-16T13:38:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f485a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 --2- 172.21.15.5:0/3463599136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f485fb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 -- 172.21.15.5:0/3463599136 >> 172.21.15.5:0/3463599136 conn(0x558f8f388d80 msgr2=0x558f8f4a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 -- 172.21.15.5:0/3463599136 shutdown_connections 2023-10-16T13:38:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.373+0000 7f8738874b80 1 -- 172.21.15.5:0/3463599136 wait complete. 2023-10-16T13:38:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.374+0000 7f8738874b80 1 -- start start 2023-10-16T13:38:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.374+0000 7f8738874b80 1 Processor -- start 2023-10-16T13:38:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f4888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f483630 0x558f8f47fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f3ade20 con 0x558f8f47e220 2023-10-16T13:38:39.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f34a6c0 con 0x558f8f459010 2023-10-16T13:38:39.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8f34a360 con 0x558f8f483630 2023-10-16T13:38:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 10 client.0 _ll_register_callbacks cb 0x558f8f1a77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:38:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f4888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f4888a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42554/0 (socket says 172.21.15.5:42554) 2023-10-16T13:38:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 -- 172.21.15.5:0/2242949697 learned_addr learned my addr 172.21.15.5:0/2242949697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f872ac27700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f483630 0x558f8f47fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f872a426700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 -- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f483630 msgr2=0x558f8f47fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f483630 0x558f8f47fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 -- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 msgr2=0x558f8f4b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 -- 172.21.15.5:0/2242949697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87240c7070 con 0x558f8f47e220 2023-10-16T13:38:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8729c25700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f4888a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8714057100 tx=0x7f871401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dd6f211fe0afc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f87057fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:38:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f87057fa700 1 -- 172.21.15.5:0/2242949697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714056d20 con 0x558f8f47e220 2023-10-16T13:38:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f87057fa700 1 -- 172.21.15.5:0/2242949697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8714057d30 con 0x558f8f47e220 2023-10-16T13:38:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f8f44e5b0 con 0x558f8f47e220 2023-10-16T13:38:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f87057fa700 1 -- 172.21.15.5:0/2242949697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f871405f930 con 0x558f8f47e220 2023-10-16T13:38:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 10 client.4644 fetch_fsmap learned FSMap version 8 2023-10-16T13:38:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.375+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558f8f1d8d90 con 0x558f8f47e220 2023-10-16T13:38:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f87057fa700 1 -- 172.21.15.5:0/2242949697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f8f44e5b0 con 0x558f8f47e220 2023-10-16T13:38:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f87057fa700 1 -- 172.21.15.5:0/2242949697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8714082d20 con 0x558f8f47e220 2023-10-16T13:38:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f8738874b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-10-16T13:38:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f8738874b80 10 client.4644 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:38:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f8738874b80 20 client.4644 populate_metadata read hostname 'smithi005' 2023-10-16T13:38:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f8738874b80 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f480190 0x558f8f45aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f8738874b80 4 client.4644 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:38:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 --> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f8f3a6e00 con 0x558f8f480190 2023-10-16T13:38:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f872a426700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f480190 0x558f8f45aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f87057fa700 10 client.4644 ms_handle_connect on v2:172.21.15.112:6834/2030805663 2023-10-16T13:38:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.376+0000 7f872a426700 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f480190 0x558f8f45aee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=388fd54073b46376 server_cookie=85af00cf32027d81 in_seq=0 out_seq=0 2023-10-16T13:38:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f87057fa700 1 -- 172.21.15.5:0/2242949697 <== mds.0 v2:172.21.15.112:6834/2030805663 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f8f3a6e00 con 0x558f8f480190 2023-10-16T13:38:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f87057fa700 10 client.4644 handle_command_reply: tid=0 2023-10-16T13:38:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 client.4644 shutdown 2023-10-16T13:38:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 msgr2=0x558f8f4888a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f4888a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8714057100 tx=0x7f871401e070 comp rx=0 tx=0).stop 2023-10-16T13:38:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 shutdown_connections 2023-10-16T13:38:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f483630 0x558f8f47fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f480190 0x558f8f45aee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 --2- 172.21.15.5:0/2242949697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f4888a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 >> 172.21.15.5:0/2242949697 conn(0x558f8f388d80 msgr2=0x558f8f4a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f87057fa700 0 client.4644 ms_handle_reset on v2:172.21.15.112:6834/2030805663 2023-10-16T13:38:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 shutdown_connections 2023-10-16T13:38:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 1 -- 172.21.15.5:0/2242949697 wait complete. 2023-10-16T13:38:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.377+0000 7f8738874b80 20 client.4644 trim_cache size 0 max 16384 2023-10-16T13:38:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.395+0000 7f8738874b80 1 Processor -- start 2023-10-16T13:38:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.395+0000 7f8738874b80 1 -- start start 2023-10-16T13:38:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f44ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8738874b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f450480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8738874b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f22e8d0 con 0x558f8f483630 2023-10-16T13:38:39.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f45b510 con 0x558f8f459010 2023-10-16T13:38:39.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8f47d810 con 0x558f8f47e220 2023-10-16T13:38:39.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f450480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f450480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42564/0 (socket says 172.21.15.5:42564) 2023-10-16T13:38:39.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 -- 172.21.15.5:0/2056702020 learned_addr learned my addr 172.21.15.5:0/2056702020 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:39.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872a426700 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f8729c25700 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f44ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 -- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 msgr2=0x558f8f44ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f44ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 -- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 msgr2=0x558f8f4a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4a40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 -- 172.21.15.5:0/2056702020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f8f1c1c10 con 0x558f8f483630 2023-10-16T13:38:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.396+0000 7f872ac27700 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f450480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f872408dd50 tx=0x7f871c009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa76a76d7dfc2a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8718ff9700 1 -- 172.21.15.5:0/2056702020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c003c20 con 0x558f8f483630 2023-10-16T13:38:39.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8718ff9700 1 -- 172.21.15.5:0/2056702020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c023040 con 0x558f8f483630 2023-10-16T13:38:39.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8718ff9700 1 -- 172.21.15.5:0/2056702020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00bce0 con 0x558f8f483630 2023-10-16T13:38:39.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 -- 172.21.15.5:0/2056702020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 msgr2=0x558f8f450480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f450480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f872408dd50 tx=0x7f871c009000 comp rx=0 tx=0).stop 2023-10-16T13:38:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 -- 172.21.15.5:0/2056702020 shutdown_connections 2023-10-16T13:38:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f483630 0x558f8f450480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f459010 0x558f8f4a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 --2- 172.21.15.5:0/2056702020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f47e220 0x558f8f44ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 -- 172.21.15.5:0/2056702020 >> 172.21.15.5:0/2056702020 conn(0x558f8f388d80 msgr2=0x558f8f49a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 -- 172.21.15.5:0/2056702020 shutdown_connections 2023-10-16T13:38:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.397+0000 7f8738874b80 1 -- 172.21.15.5:0/2056702020 wait complete. 2023-10-16T13:38:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.398+0000 7f8738874b80 1 -- start start 2023-10-16T13:38:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.398+0000 7f8738874b80 1 Processor -- start 2023-10-16T13:38:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f459010 0x558f8f506b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f47e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f483630 0x558f8f4870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f45a780 con 0x558f8f47e220 2023-10-16T13:38:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8f47eb40 con 0x558f8f483630 2023-10-16T13:38:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8f481910 con 0x558f8f459010 2023-10-16T13:38:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 10 client.0 _ll_register_callbacks cb 0x7f871c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:38:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f47e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f47e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42568/0 (socket says 172.21.15.5:42568) 2023-10-16T13:38:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 -- 172.21.15.5:0/2559883021 learned_addr learned my addr 172.21.15.5:0/2559883021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f872a426700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f459010 0x558f8f506b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f872ac27700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f483630 0x558f8f4870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 -- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f459010 msgr2=0x558f8f506b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f459010 0x558f8f506b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 -- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f483630 msgr2=0x558f8f4870e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f483630 0x558f8f4870e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 -- 172.21.15.5:0/2559883021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872415e270 con 0x558f8f47e220 2023-10-16T13:38:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8729c25700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f47e600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8714057100 tx=0x7f8714001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e63be07d3136723 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f87057fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:38:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f87057fa700 1 -- 172.21.15.5:0/2559883021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714057d30 con 0x558f8f47e220 2023-10-16T13:38:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f87057fa700 1 -- 172.21.15.5:0/2559883021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f871405f930 con 0x558f8f47e220 2023-10-16T13:38:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8714057630 con 0x558f8f47e220 2023-10-16T13:38:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f87057fa700 1 -- 172.21.15.5:0/2559883021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f871405b780 con 0x558f8f47e220 2023-10-16T13:38:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 10 client.4650 fetch_fsmap learned FSMap version 8 2023-10-16T13:38:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.399+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558f8f1ff200 con 0x558f8f47e220 2023-10-16T13:38:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f87057fa700 1 -- 172.21.15.5:0/2559883021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714057630 con 0x558f8f47e220 2023-10-16T13:38:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f87057fa700 1 -- 172.21.15.5:0/2559883021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f871405fb80 con 0x558f8f47e220 2023-10-16T13:38:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2023-10-16T13:38:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 10 client.4650 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:38:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 20 client.4650 populate_metadata read hostname 'smithi005' 2023-10-16T13:38:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f4876c0 0x558f8f44ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 4 client.4650 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:38:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 --> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f8f3a6b20 con 0x558f8f4876c0 2023-10-16T13:38:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f872a426700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f4876c0 0x558f8f44ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f87057fa700 10 client.4650 ms_handle_connect on v2:172.21.15.112:6834/2030805663 2023-10-16T13:38:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f872a426700 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f4876c0 0x558f8f44ff40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1272f81f2a33ea89 server_cookie=d161b5bf8642ef1e in_seq=0 out_seq=0 2023-10-16T13:38:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f87057fa700 1 -- 172.21.15.5:0/2559883021 <== mds.0 v2:172.21.15.112:6834/2030805663 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558f8f3a6b20 con 0x558f8f4876c0 2023-10-16T13:38:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f87057fa700 10 client.4650 handle_command_reply: tid=0 2023-10-16T13:38:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.400+0000 7f8738874b80 1 client.4650 shutdown 2023-10-16T13:38:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 msgr2=0x558f8f47e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f47e600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8714057100 tx=0x7f8714001120 comp rx=0 tx=0).stop 2023-10-16T13:38:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 shutdown_connections 2023-10-16T13:38:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f8f483630 0x558f8f4870e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x558f8f459010 0x558f8f506b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.112:6834/2030805663,v1:172.21.15.112:6835/2030805663] conn(0x558f8f4876c0 0x558f8f44ff40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 --2- 172.21.15.5:0/2559883021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558f8f47e220 0x558f8f47e600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 >> 172.21.15.5:0/2559883021 conn(0x558f8f388d80 msgr2=0x558f8f4a4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f87057fa700 0 client.4650 ms_handle_reset on v2:172.21.15.112:6834/2030805663 2023-10-16T13:38:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 shutdown_connections 2023-10-16T13:38:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 1 -- 172.21.15.5:0/2559883021 wait complete. 2023-10-16T13:38:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f8738874b80 20 client.4650 trim_cache size 0 max 16384 2023-10-16T13:38:39.429 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:38:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:38:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:38:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4270, 2023-10-16T13:38:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:38:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:38:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:38:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 19.420042542000001, 2023-10-16T13:38:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 8, 2023-10-16T13:38:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 20, 2023-10-16T13:38:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 20, 2023-10-16T13:38:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 26.522355762 2023-10-16T13:38:39.431 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:38:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f870806af00 msgr2=0x7f870806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f870806af00 0x7f870806d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87240b6f20 tx=0x7f8720008040 comp rx=0 tx=0).stop 2023-10-16T13:38:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 msgr2=0x7f87240b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f87240b8c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f871400c4e0 tx=0x7f871400c7f0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 shutdown_connections 2023-10-16T13:38:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87240d1d60 0x7f87240b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f870806af00 0x7f870806d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87240d0a10 0x7f87240b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 --2- 172.21.15.5:0/3007851487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87240d1560 0x7f87240b8c20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 >> 172.21.15.5:0/3007851487 conn(0x7f872409ca80 msgr2=0x7f87240b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.401+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 shutdown_connections 2023-10-16T13:38:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:39.402+0000 7f872c68a700 1 -- 172.21.15.5:0/3007851487 wait complete. 2023-10-16T13:38:39.435 INFO:teuthology.run_tasks:Running task kclient... 2023-10-16T13:38:39.459 INFO:tasks.kclient:Mounting kernel clients... 2023-10-16T13:38:39.459 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-16T13:38:39.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.460 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:38:39.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-16T13:38:39.546 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-10-16T13:38:39.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:38:39.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.548 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:38:39.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-16T13:38:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-10-16T13:38:39.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:38:39.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.677 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:38:39.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-16T13:38:39.769 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-10-16T13:38:39.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:38:39.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.771 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:38:39.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:39.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-16T13:38:39.900 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-10-16T13:38:39.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:38:39.901 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-16T13:38:39.902 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T13:38:39.902 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:38:39.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:38:40.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.026+0000 7f320e006700 1 Processor -- start 2023-10-16T13:38:40.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.027+0000 7f320e006700 1 -- start start 2023-10-16T13:38:40.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f320e006700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f320815ab10 0x7f320815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f320e006700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32080b1f50 0x7f32080cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f320e006700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32080cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f320e006700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320815e7a0 con 0x7f32080b1f50 2023-10-16T13:38:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f320e006700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320815f730 con 0x7f320815ab10 2023-10-16T13:38:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f320e006700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b29a0 con 0x7f32080b2400 2023-10-16T13:38:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32080b1f50 0x7f32080cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32080b1f50 0x7f32080cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42576/0 (socket says 172.21.15.5:42576) 2023-10-16T13:38:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 -- 172.21.15.5:0/1817255186 learned_addr learned my addr 172.21.15.5:0/1817255186 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f32077fe700 1 --2- 172.21.15.5:0/1817255186 >> v2:172.21.15.112:3300/0 conn(0x7f320815ab10 0x7f320815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3207fff700 1 --2- 172.21.15.5:0/1817255186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32080cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 -- 172.21.15.5:0/1817255186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 msgr2=0x7f32080cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 --2- 172.21.15.5:0/1817255186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32080cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 -- 172.21.15.5:0/1817255186 >> v2:172.21.15.112:3300/0 conn(0x7f320815ab10 msgr2=0x7f320815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 --2- 172.21.15.5:0/1817255186 >> v2:172.21.15.112:3300/0 conn(0x7f320815ab10 0x7f320815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 -- 172.21.15.5:0/1817255186 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080b2c80 con 0x7f32080b1f50 2023-10-16T13:38:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f32077fe700 1 --2- 172.21.15.5:0/1817255186 >> v2:172.21.15.112:3300/0 conn(0x7f320815ab10 0x7f320815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.028+0000 7f3206ffd700 1 --2- 172.21.15.5:0/1817255186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32080b1f50 0x7f32080cf720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f32080d0430 tx=0x7f31f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313202c2cfdf4b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:40.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f32067fc700 1 -- 172.21.15.5:0/1817255186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0005e30 con 0x7f32080b1f50 2023-10-16T13:38:40.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f32067fc700 1 -- 172.21.15.5:0/1817255186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0004030 con 0x7f32080b1f50 2023-10-16T13:38:40.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f32067fc700 1 -- 172.21.15.5:0/1817255186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00043e0 con 0x7f32080b1f50 2023-10-16T13:38:40.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 -- 172.21.15.5:0/1817255186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32080b1f50 msgr2=0x7f32080cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:40.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 --2- 172.21.15.5:0/1817255186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32080b1f50 0x7f32080cf720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f32080d0430 tx=0x7f31f0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 -- 172.21.15.5:0/1817255186 shutdown_connections 2023-10-16T13:38:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 --2- 172.21.15.5:0/1817255186 >> v2:172.21.15.112:3300/0 conn(0x7f320815ab10 0x7f320815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 --2- 172.21.15.5:0/1817255186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32080cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 --2- 172.21.15.5:0/1817255186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32080b1f50 0x7f32080cf720 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 -- 172.21.15.5:0/1817255186 >> 172.21.15.5:0/1817255186 conn(0x7f320806dae0 msgr2=0x7f320806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 -- 172.21.15.5:0/1817255186 shutdown_connections 2023-10-16T13:38:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.029+0000 7f320e006700 1 -- 172.21.15.5:0/1817255186 wait complete. 2023-10-16T13:38:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.031+0000 7f320e006700 1 Processor -- start 2023-10-16T13:38:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.031+0000 7f320e006700 1 -- start start 2023-10-16T13:38:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f320e006700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32080b1f50 0x7f320815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f320e006700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32081f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f320e006700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 0x7f320806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f320e006700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080c8e70 con 0x7f320815ab10 2023-10-16T13:38:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f320e006700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320814c7b0 con 0x7f32080b1f50 2023-10-16T13:38:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f320e006700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080c8b40 con 0x7f32080b2400 2023-10-16T13:38:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f3207fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 0x7f320806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f3207fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 0x7f320806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42584/0 (socket says 172.21.15.5:42584) 2023-10-16T13:38:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f3207fff700 1 -- 172.21.15.5:0/3757345905 learned_addr learned my addr 172.21.15.5:0/3757345905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f3206ffd700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32081f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.032+0000 7f32077fe700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32080b1f50 0x7f320815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f3207fff700 1 -- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 msgr2=0x7f32081f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f3207fff700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32081f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f3207fff700 1 -- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32080b1f50 msgr2=0x7f320815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f3207fff700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32080b1f50 0x7f320815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f3207fff700 1 -- 172.21.15.5:0/3757345905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009500 con 0x7f320815ab10 2023-10-16T13:38:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f32077fe700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32080b1f50 0x7f320815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f3207fff700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 0x7f320806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3200007d20 tx=0x7f320000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000ede0 con 0x7f320815ab10 2023-10-16T13:38:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200007e70 con 0x7f320815ab10 2023-10-16T13:38:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200014640 con 0x7f320815ab10 2023-10-16T13:38:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320815c250 con 0x7f320815ab10 2023-10-16T13:38:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.033+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320815c810 con 0x7f320815ab10 2023-10-16T13:38:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.034+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32080c8fe0 con 0x7f320815ab10 2023-10-16T13:38:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.034+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32000147a0 con 0x7f320815ab10 2023-10-16T13:38:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.035+0000 7f31fffff700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31e806af00 0x7f31e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.035+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3200089c10 con 0x7f320815ab10 2023-10-16T13:38:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.035+0000 7f32077fe700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31e806af00 0x7f31e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.036+0000 7f32077fe700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31e806af00 0x7f31e806d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099f0 tx=0x7f31f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.040+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3200054cc0 con 0x7f320815ab10 2023-10-16T13:38:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.284+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3208067d20 con 0x7f320815ab10 2023-10-16T13:38:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.284+0000 7f31fffff700 1 -- 172.21.15.5:0/3757345905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32000582e0 con 0x7f320815ab10 2023-10-16T13:38:40.287 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:38:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31e806af00 msgr2=0x7f31e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31e806af00 0x7f31e806d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099f0 tx=0x7f31f8008040 comp rx=0 tx=0).stop 2023-10-16T13:38:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 msgr2=0x7f320806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 0x7f320806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3200007d20 tx=0x7f320000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 shutdown_connections 2023-10-16T13:38:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320815ab10 0x7f320806a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32080b1f50 0x7f320815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f31e806af00 0x7f31e806d3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 --2- 172.21.15.5:0/3757345905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32080b2400 0x7f32081f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:40.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 >> 172.21.15.5:0/3757345905 conn(0x7f320806dae0 msgr2=0x7f32080b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:40.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 shutdown_connections 2023-10-16T13:38:40.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:40.286+0000 7f320e006700 1 -- 172.21.15.5:0/3757345905 wait complete. 2023-10-16T13:38:40.301 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T13:38:40.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:38:40.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:38:40.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:38:40.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:38:40.303 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T13:38:40.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T13:38:40.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:38:40.304 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:38:40.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.304 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:38:40.321 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:40.323 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:40.323 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:40.324 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:38:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:38:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42382sec preferred_lft 42382sec 2023-10-16T13:38:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:38:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:40.325 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:40.326 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T13:38:40.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:40.327 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:40.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-10-16T13:38:40.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-10-16T13:38:40.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-10-16T13:38:40.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T13:38:40.328 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:40.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.496 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:38:40.524 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:38:40.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.525 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:38:40.608 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:38:40.608 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:38:40.608 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:38:40.609 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:38:40.609 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:38:40.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.610 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:40.610 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:40.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:38:40.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:38:40.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:38:40.611 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:40.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.852 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:38:40.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.870 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-10-16T13:38:40.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:40.927 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:40.927 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:40.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:38:40.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T13:38:40.928 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:41.022 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T13:38:41.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:41.023 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:41.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T13:38:41.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T13:38:41.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T13:38:41.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T13:38:41.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T13:38:41.025 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:41.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.233 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:41.234 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:41.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:38:41.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T13:38:41.235 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:41.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:41.340 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:38:41.362 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:38:41.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:41.363 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:38:41.419 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:38:41.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:41.517 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:41.517 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:41.641 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:41.642 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:41.642 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:41.642 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:41.642 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:41.642 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:41.643 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:41.643 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:41.724 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:41.725 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:41.725 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:41.725 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:41.725 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:41.725 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:41.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:41.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:41.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:38:41.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:38:41.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:38:41.727 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:38:41.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:38:41.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:41.843 INFO:teuthology.orchestra.run.smithi005.stdout:client4487 2023-10-16T13:38:41.844 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:41.844 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:41.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.862 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:41.950 INFO:teuthology.orchestra.run.smithi005.stdout:client4487 2023-10-16T13:38:41.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.951 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:41.998 INFO:teuthology.orchestra.run.smithi005.stdout:client4487 2023-10-16T13:38:41.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:41.999 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.client4487/status') 2023-10-16T13:38:42.053 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4487 (3)172.21.15.5:0/3656910081 2023-10-16T13:38:42.053 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-10-16T13:38:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-10-16T13:38:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-10-16T13:38:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 3.0614e-05 s, 2.3 MB/s 2023-10-16T13:38:42.055 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-16T13:38:42.056 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T13:38:42.056 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T13:38:42.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:38:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.179+0000 7f13090f0700 1 Processor -- start 2023-10-16T13:38:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.179+0000 7f13090f0700 1 -- start start 2023-10-16T13:38:42.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.179+0000 7f13090f0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040ce6e0 0x7f13040cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.179+0000 7f13090f0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040d23e0 con 0x7f130415b740 2023-10-16T13:38:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.179+0000 7f13090f0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040cf190 con 0x7f13040d0c70 2023-10-16T13:38:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.179+0000 7f13090f0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130415bb20 con 0x7f13040ce6e0 2023-10-16T13:38:42.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1302d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f130415b740 0x7f13040d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52598/0 (socket says 172.21.15.5:52598) 2023-10-16T13:38:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1302d9d700 1 -- 172.21.15.5:0/3402944206 learned_addr learned my addr 172.21.15.5:0/3402944206 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f130359e700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040ce6e0 0x7f13040cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230306117 0 0) 0x7f12ec001110 con 0x7f130415b740 2023-10-16T13:38:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f00035b0 con 0x7f130415b740 2023-10-16T13:38:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589571233 0 0) 0x7f13040cf190 con 0x7f13040d0c70 2023-10-16T13:38:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec001110 con 0x7f13040d0c70 2023-10-16T13:38:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696845395 0 0) 0x7f12f00035b0 con 0x7f130415b740 2023-10-16T13:38:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040ce6e0 msgr2=0x7f13040cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040ce6e0 0x7f13040cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 >> v1:172.21.15.112:6789/0 conn(0x7f13040d0c70 legacy=0x7f13040cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040cbd40 con 0x7f130415b740 2023-10-16T13:38:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f12ec001800 con 0x7f130415b740 2023-10-16T13:38:42.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 >> v1:172.21.15.5:6789/0 conn(0x7f130415b740 legacy=0x7f13040d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12f0003bc0 0x7f12f0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f12f0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f0005210 0x7f12f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130415bb20 con 0x7f12f0004850 2023-10-16T13:38:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f000c080 con 0x7f12f0005210 2023-10-16T13:38:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f000c240 con 0x7f12f0003bc0 2023-10-16T13:38:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f130359e700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040ce6e0 0x7f13040cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f130259c700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f12f0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f1302d9d700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12f0003bc0 0x7f12f0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.180+0000 7f130359e700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f0005210 0x7f12f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130259c700 1 -- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12f0003bc0 msgr2=0x7f12f0003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130259c700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12f0003bc0 0x7f12f0003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130259c700 1 -- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f0005210 msgr2=0x7f12f000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:42.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130259c700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f0005210 0x7f12f000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130259c700 1 -- 172.21.15.5:0/3402944206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00035b0 con 0x7f12f0004850 2023-10-16T13:38:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130259c700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f12f0004cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12f4001970 tx=0x7f12f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85255fc49d08f48 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40052d0 con 0x7f12f0004850 2023-10-16T13:38:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4005430 con 0x7f12f0004850 2023-10-16T13:38:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f1301d9b700 1 -- 172.21.15.5:0/3402944206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40038c0 con 0x7f12f0004850 2023-10-16T13:38:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f13090f0700 1 -- 172.21.15.5:0/3402944206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 msgr2=0x7f12f0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f13090f0700 1 --2- 172.21.15.5:0/3402944206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f12f0004cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12f4001970 tx=0x7f12f0005880 comp rx=0 tx=0).stop 2023-10-16T13:38:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.181+0000 7f130359e700 1 -- 172.21.15.5:0/3402944206 reap_dead start 2023-10-16T13:38:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.182+0000 7f13090f0700 1 -- 172.21.15.5:0/3402944206 shutdown_connections 2023-10-16T13:38:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.182+0000 7f13090f0700 1 -- 172.21.15.5:0/3402944206 >> 172.21.15.5:0/3402944206 conn(0x7f13040665a0 msgr2=0x7f1304066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.182+0000 7f13090f0700 1 -- 172.21.15.5:0/3402944206 shutdown_connections 2023-10-16T13:38:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.182+0000 7f13090f0700 1 -- 172.21.15.5:0/3402944206 wait complete. 2023-10-16T13:38:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.184+0000 7f13090f0700 1 Processor -- start 2023-10-16T13:38:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.184+0000 7f13090f0700 1 -- start start 2023-10-16T13:38:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f13041f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040b68f0 0x7f13041ee540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1304152290 0x7f1304152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304152c50 con 0x7f12f0004850 2023-10-16T13:38:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13041f2030 con 0x7f1304152290 2023-10-16T13:38:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13041eea80 con 0x7f13040b68f0 2023-10-16T13:38:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f13041f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f13041f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42606/0 (socket says 172.21.15.5:42606) 2023-10-16T13:38:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 -- 172.21.15.5:0/1401704654 learned_addr learned my addr 172.21.15.5:0/1401704654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f130259c700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040b68f0 0x7f13041ee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f130359e700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1304152290 0x7f1304152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 -- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040b68f0 msgr2=0x7f13041ee540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040b68f0 0x7f13041ee540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 -- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1304152290 msgr2=0x7f1304152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1304152290 0x7f1304152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 -- 172.21.15.5:0/1401704654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304150620 con 0x7f12f0004850 2023-10-16T13:38:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f130259c700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040b68f0 0x7f13041ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f130359e700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1304152290 0x7f1304152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f1302d9d700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f13041f1af0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0072c0 tx=0x7f12ec007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00f870 con 0x7f12f0004850 2023-10-16T13:38:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00f9d0 con 0x7f12f0004850 2023-10-16T13:38:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.185+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1304150900 con 0x7f12f0004850 2023-10-16T13:38:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.186+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00fd60 con 0x7f12f0004850 2023-10-16T13:38:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.186+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1304150ec0 con 0x7f12f0004850 2023-10-16T13:38:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.187+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13040d0a30 con 0x7f12f0004850 2023-10-16T13:38:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.187+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f12ec01d360 con 0x7f12f0004850 2023-10-16T13:38:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.187+0000 7f12fb7fe700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12e406af00 0x7f12e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.187+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12ec088c50 con 0x7f12f0004850 2023-10-16T13:38:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.188+0000 7f130259c700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12e406af00 0x7f12e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.188+0000 7f130259c700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12e406af00 0x7f12e406d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13041586f0 tx=0x7f12f4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.192+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12ec08e020 con 0x7f12f0004850 2023-10-16T13:38:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.439+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13040d23e0 con 0x7f12f0004850 2023-10-16T13:38:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.439+0000 7f12fb7fe700 1 -- 172.21.15.5:0/1401704654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f13040d23e0 con 0x7f12f0004850 2023-10-16T13:38:42.442 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:38:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.441+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12e406af00 msgr2=0x7f12e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12e406af00 0x7f12e406d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13041586f0 tx=0x7f12f4009030 comp rx=0 tx=0).stop 2023-10-16T13:38:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 msgr2=0x7f13041f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f13041f1af0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0072c0 tx=0x7f12ec007680 comp rx=0 tx=0).stop 2023-10-16T13:38:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 shutdown_connections 2023-10-16T13:38:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1304152290 0x7f1304152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12f0004850 0x7f13041f1af0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12e406af00 0x7f12e406d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 --2- 172.21.15.5:0/1401704654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13040b68f0 0x7f13041ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 >> 172.21.15.5:0/1401704654 conn(0x7f13040665a0 msgr2=0x7f130415aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 shutdown_connections 2023-10-16T13:38:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:42.442+0000 7f13090f0700 1 -- 172.21.15.5:0/1401704654 wait complete. 2023-10-16T13:38:42.457 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T13:38:42.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:38:42.457 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:38:42.457 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T13:38:42.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T13:38:42.458 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T13:38:42.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T13:38:42.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:38:42.459 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T13:38:42.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.459 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:38:42.477 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:42.477 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:42.477 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:42.477 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.478 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:42.478 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.478 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:42.478 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:42.478 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:42.479 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:42.479 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:38:42.479 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:42.479 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:38:42.479 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42380sec preferred_lft 42380sec 2023-10-16T13:38:42.479 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:38:42.480 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.480 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:42.480 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:42.480 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:38:42.480 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:42.481 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:38:42.481 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.481 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:38:42.481 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.481 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:38:42.482 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:38:42.482 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link tentative 2023-10-16T13:38:42.482 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.483 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:38:42.543 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:38:42.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.545 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:38:42.603 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:38:42.604 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:38:42.604 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:38:42.604 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:38:42.604 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:38:42.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.605 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:42.605 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:42.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:38:42.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:38:42.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:38:42.607 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:42.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.711 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:38:42.727 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:38:42.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.728 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-10-16T13:38:42.785 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-16T13:38:42.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.786 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:42.786 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:42.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:38:42.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-16T13:38:42.787 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T13:38:42.920 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.921 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:38:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 1a:f3:92:3f:6e:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T13:38:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T13:38:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::18f3:92ff:fe3f:6ef1/64 scope link tentative 2023-10-16T13:38:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:42.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:42.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T13:38:43.013 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:43.013 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:43.014 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:43.014 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:43.014 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:43.014 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:43.015 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:38:43.015 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 1a:f3:92:3f:6e:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T13:38:43.015 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T13:38:43.015 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:43.015 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::18f3:92ff:fe3f:6ef1/64 scope link tentative 2023-10-16T13:38:43.016 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:43.030 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-16T13:38:43.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.031 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:43.031 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:43.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-16T13:38:43.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T13:38:43.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T13:38:43.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T13:38:43.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T13:38:43.033 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:43.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:38:43.305 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:38:43.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2023-10-16T13:38:43.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T13:38:43.306 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:38:43.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:43.426 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T13:38:43.448 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T13:38:43.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:43.449 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T13:38:43.505 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-16T13:38:43.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:43.592 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:43.592 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:43.621 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:43.622 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:43.622 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:43.622 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:43.622 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:43.623 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:43.623 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:43.623 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:43.685 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:43.687 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:43.687 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:43.687 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:38:43.687 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:38:43.688 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:38:43.689 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:38:43.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T13:38:43.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.717 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:43.789 INFO:teuthology.orchestra.run.smithi005.stdout:client4665 2023-10-16T13:38:43.790 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:43.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:43.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.848 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:43.920 INFO:teuthology.orchestra.run.smithi005.stdout:client4665 2023-10-16T13:38:43.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.921 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:43.994 INFO:teuthology.orchestra.run.smithi005.stdout:client4665 2023-10-16T13:38:43.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:43.995 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.client4665/status') 2023-10-16T13:38:44.076 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4665 (3)192.168.0.2:0/1419411650 2023-10-16T13:38:44.076 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-10-16T13:38:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-10-16T13:38:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-10-16T13:38:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.5729e-05 s, 2.7 MB/s 2023-10-16T13:38:44.078 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-16T13:38:44.078 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T13:38:44.078 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:38:44.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:38:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 Processor -- start 2023-10-16T13:38:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 -- start start 2023-10-16T13:38:44.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a4006a840 0x7f5a400cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a400ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4006adb0 con 0x7f5a4015e030 2023-10-16T13:38:44.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cbab0 con 0x7f5a4006a840 2023-10-16T13:38:44.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.240+0000 7f5a46219700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4006b090 con 0x7f5a4006be50 2023-10-16T13:38:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a4015e030 0x7f5a400cb3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52630/0 (socket says 172.21.15.5:52630) 2023-10-16T13:38:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3f7fe700 1 -- 172.21.15.5:0/2481456833 learned_addr learned my addr 172.21.15.5:0/2481456833 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2481456833 >> v2:172.21.15.112:3300/0 conn(0x7f5a4006a840 0x7f5a400cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3ffff700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a400ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269966162 0 0) 0x7f5a4006adb0 con 0x7f5a4015e030 2023-10-16T13:38:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a280035b0 con 0x7f5a4015e030 2023-10-16T13:38:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 674413623 0 0) 0x7f5a280035b0 con 0x7f5a4015e030 2023-10-16T13:38:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 msgr2=0x7f5a400ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a400ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 >> v2:172.21.15.112:3300/0 conn(0x7f5a4006a840 msgr2=0x7f5a400cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 --2- 172.21.15.5:0/2481456833 >> v2:172.21.15.112:3300/0 conn(0x7f5a4006a840 0x7f5a400cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4006b370 con 0x7f5a4015e030 2023-10-16T13:38:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5a30001670 con 0x7f5a4015e030 2023-10-16T13:38:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 >> v1:172.21.15.5:6789/0 conn(0x7f5a4015e030 legacy=0x7f5a400cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a28003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a28004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a28004d90 0x7f5a28005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400cbab0 con 0x7f5a28003f80 2023-10-16T13:38:44.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4006b090 con 0x7f5a28004d90 2023-10-16T13:38:44.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2800ba10 con 0x7f5a4006be50 2023-10-16T13:38:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a28004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3f7fe700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a28003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.241+0000 7f5a3ffff700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a28004d90 0x7f5a28005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3effd700 1 -- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 msgr2=0x7f5a28003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a28003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3effd700 1 -- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a28004d90 msgr2=0x7f5a28005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a28004d90 0x7f5a28005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3effd700 1 -- 172.21.15.5:0/2481456833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280035b0 con 0x7f5a28003f80 2023-10-16T13:38:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3f7fe700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a4006be50 0x7f5a28003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a28004850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009b60 tx=0x7f5a28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c9173f7b08f234 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400e660 con 0x7f5a28003f80 2023-10-16T13:38:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400e7c0 con 0x7f5a28003f80 2023-10-16T13:38:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3e7fc700 1 -- 172.21.15.5:0/2481456833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400eb30 con 0x7f5a28003f80 2023-10-16T13:38:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a46219700 1 -- 172.21.15.5:0/2481456833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 msgr2=0x7f5a28004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:44.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a46219700 1 --2- 172.21.15.5:0/2481456833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a28004850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009b60 tx=0x7f5a28005880 comp rx=0 tx=0).stop 2023-10-16T13:38:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.242+0000 7f5a3ffff700 1 -- 172.21.15.5:0/2481456833 reap_dead start 2023-10-16T13:38:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.243+0000 7f5a46219700 1 -- 172.21.15.5:0/2481456833 shutdown_connections 2023-10-16T13:38:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.243+0000 7f5a46219700 1 -- 172.21.15.5:0/2481456833 >> 172.21.15.5:0/2481456833 conn(0x7f5a400cc6f0 msgr2=0x7f5a400ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.243+0000 7f5a46219700 1 -- 172.21.15.5:0/2481456833 shutdown_connections 2023-10-16T13:38:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.243+0000 7f5a46219700 1 -- 172.21.15.5:0/2481456833 wait complete. 2023-10-16T13:38:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.244+0000 7f5a46219700 1 Processor -- start 2023-10-16T13:38:44.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.244+0000 7f5a46219700 1 -- start start 2023-10-16T13:38:44.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a46219700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a401586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a46219700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a400ae9e0 0x7f5a400c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a46219700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a400c9430 0x7f5a400c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a46219700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400b2f50 con 0x7f5a28003f80 2023-10-16T13:38:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a46219700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40158c20 con 0x7f5a400c9430 2023-10-16T13:38:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a46219700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c99d0 con 0x7f5a400ae9e0 2023-10-16T13:38:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a401586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a401586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42638/0 (socket says 172.21.15.5:42638) 2023-10-16T13:38:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 -- 172.21.15.5:0/2697193379 learned_addr learned my addr 172.21.15.5:0/2697193379 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3ffff700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a400c9430 0x7f5a400c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a400ae9e0 0x7f5a400c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 -- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a400ae9e0 msgr2=0x7f5a400c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a400ae9e0 0x7f5a400c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 -- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a400c9430 msgr2=0x7f5a400c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a400c9430 0x7f5a400c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 -- 172.21.15.5:0/2697193379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400c9cb0 con 0x7f5a28003f80 2023-10-16T13:38:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3ffff700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a400c9430 0x7f5a400c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.245+0000 7f5a3f7fe700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a401586e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a300017e0 tx=0x7f5a300076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.246+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000f8d0 con 0x7f5a28003f80 2023-10-16T13:38:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.246+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000fa30 con 0x7f5a28003f80 2023-10-16T13:38:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.246+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000fdc0 con 0x7f5a28003f80 2023-10-16T13:38:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.246+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400b2900 con 0x7f5a28003f80 2023-10-16T13:38:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.246+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400c7440 con 0x7f5a28003f80 2023-10-16T13:38:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.246+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400cb860 con 0x7f5a28003f80 2023-10-16T13:38:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.247+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a3001d460 con 0x7f5a28003f80 2023-10-16T13:38:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.247+0000 7f5a27fff700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a2c06af00 0x7f5a2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.248+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a30089790 con 0x7f5a28003f80 2023-10-16T13:38:44.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.248+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a2c06af00 0x7f5a2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:44.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.248+0000 7f5a3effd700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a2c06af00 0x7f5a2c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a340090b0 tx=0x7f5a34008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:44.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.252+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a30054840 con 0x7f5a28003f80 2023-10-16T13:38:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.500+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a40066a30 con 0x7f5a28003f80 2023-10-16T13:38:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.500+0000 7f5a27fff700 1 -- 172.21.15.5:0/2697193379 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a30057e60 con 0x7f5a28003f80 2023-10-16T13:38:44.503 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:38:44.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a2c06af00 msgr2=0x7f5a2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:44.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a2c06af00 0x7f5a2c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a340090b0 tx=0x7f5a34008030 comp rx=0 tx=0).stop 2023-10-16T13:38:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 msgr2=0x7f5a401586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a401586e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a300017e0 tx=0x7f5a300076a0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 shutdown_connections 2023-10-16T13:38:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a400c9430 0x7f5a400c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a28003f80 0x7f5a401586e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a2c06af00 0x7f5a2c06d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 --2- 172.21.15.5:0/2697193379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a400ae9e0 0x7f5a400c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.502+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 >> 172.21.15.5:0/2697193379 conn(0x7f5a400cc6f0 msgr2=0x7f5a4006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.503+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 shutdown_connections 2023-10-16T13:38:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:44.503+0000 7f5a46219700 1 -- 172.21.15.5:0/2697193379 wait complete. 2023-10-16T13:38:44.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T13:38:44.517 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:38:44.518 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:38:44.518 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:38:44.518 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:38:44.518 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T13:38:44.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T13:38:44.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:38:44.519 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:38:44.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:44.520 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:38:44.540 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:44.541 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:44.541 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:44.541 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:44.541 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:44.542 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:44.542 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:44.542 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:44.542 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:44.542 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:44.543 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:44.543 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:44.543 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:38:44.543 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:44.543 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:38:44.544 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-10-16T13:38:44.544 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:38:44.544 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:44.544 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T13:38:44.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:44.545 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:44.545 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:44.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2023-10-16T13:38:44.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2023-10-16T13:38:44.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2023-10-16T13:38:44.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T13:38:44.547 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:44.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:44.723 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:38:44.752 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:38:44.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:44.753 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:38:44.829 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:38:44.829 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:38:44.829 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:38:44.829 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:38:44.830 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:38:44.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:44.830 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:44.831 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:44.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:38:44.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:38:44.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:38:44.832 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:45.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.062 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:38:45.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.079 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-10-16T13:38:45.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.135 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:45.136 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:45.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:38:45.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T13:38:45.137 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:45.229 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T13:38:45.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.230 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:45.230 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:45.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T13:38:45.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T13:38:45.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T13:38:45.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T13:38:45.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T13:38:45.232 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:45.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.437 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:45.438 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:45.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:38:45.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T13:38:45.439 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:45.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:45.541 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:38:45.560 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:38:45.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:45.561 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:38:45.616 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:38:45.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:45.722 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:45.723 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:45.826 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:45.827 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:45.858 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:45.859 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:38:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:38:45.860 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:38:45.861 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:38:45.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:38:45.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:45.891 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:45.963 INFO:teuthology.orchestra.run.smithi112.stdout:client4499 2023-10-16T13:38:45.963 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:45.964 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:46.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.020 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:46.092 INFO:teuthology.orchestra.run.smithi112.stdout:client4499 2023-10-16T13:38:46.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.093 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:46.164 INFO:teuthology.orchestra.run.smithi112.stdout:client4499 2023-10-16T13:38:46.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.165 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.client4499/status') 2023-10-16T13:38:46.244 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4499 (3)192.168.0.1:0/3822188457 2023-10-16T13:38:46.244 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2023-10-16T13:38:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2023-10-16T13:38:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2023-10-16T13:38:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:69 bytes copied, 2.2386e-05 s, 3.1 MB/s 2023-10-16T13:38:46.246 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-16T13:38:46.246 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T13:38:46.246 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T13:38:46.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:38:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.383+0000 7f28f8ae1700 1 Processor -- start 2023-10-16T13:38:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.383+0000 7f28f8ae1700 1 -- start start 2023-10-16T13:38:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.384+0000 7f28f8ae1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28f40cd950 0x7f28f415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.384+0000 7f28f8ae1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40cf290 con 0x7f28f406a840 2023-10-16T13:38:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.384+0000 7f28f8ae1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40b2d60 con 0x7f28f40cede0 2023-10-16T13:38:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.384+0000 7f28f8ae1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f41619a0 con 0x7f28f40cd950 2023-10-16T13:38:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f2d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28f406a840 0x7f28f4161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52652/0 (socket says 172.21.15.5:52652) 2023-10-16T13:38:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f2d9d700 1 -- 172.21.15.5:0/471645031 learned_addr learned my addr 172.21.15.5:0/471645031 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f259c700 1 --2- 172.21.15.5:0/471645031 >> v2:172.21.15.112:3300/0 conn(0x7f28f40cd950 0x7f28f415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025447444 0 0) 0x7f28f40cf290 con 0x7f28f406a840 2023-10-16T13:38:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e00035b0 con 0x7f28f406a840 2023-10-16T13:38:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351517132 0 0) 0x7f28f40b2d60 con 0x7f28f40cede0 2023-10-16T13:38:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f40cf290 con 0x7f28f40cede0 2023-10-16T13:38:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f259c700 1 -- 172.21.15.5:0/471645031 >> v1:172.21.15.112:6789/0 conn(0x7f28f40cede0 legacy=0x7f28f415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f259c700 1 -- 172.21.15.5:0/471645031 >> v1:172.21.15.5:6789/0 conn(0x7f28f406a840 legacy=0x7f28f4161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1974945036 0 0) 0x7f28e00035b0 con 0x7f28f406a840 2023-10-16T13:38:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f259c700 1 -- 172.21.15.5:0/471645031 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f40cdd30 con 0x7f28f40cd950 2023-10-16T13:38:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f259c700 1 --2- 172.21.15.5:0/471645031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cd950 0x7f28f415e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009840 tx=0x7f28e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6167850a22b5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec0019f0 con 0x7f28f40cd950 2023-10-16T13:38:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4004030 con 0x7f28f40cd950 2023-10-16T13:38:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.385+0000 7f28f159a700 1 -- 172.21.15.5:0/471645031 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40043c0 con 0x7f28f40cd950 2023-10-16T13:38:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 -- 172.21.15.5:0/471645031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cd950 msgr2=0x7f28f415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/471645031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cd950 0x7f28f415e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009840 tx=0x7f28e4009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 -- 172.21.15.5:0/471645031 shutdown_connections 2023-10-16T13:38:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/471645031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cd950 0x7f28f415e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 -- 172.21.15.5:0/471645031 >> 172.21.15.5:0/471645031 conn(0x7f28f406dae0 msgr2=0x7f28f406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 -- 172.21.15.5:0/471645031 shutdown_connections 2023-10-16T13:38:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.386+0000 7f28f8ae1700 1 -- 172.21.15.5:0/471645031 wait complete. 2023-10-16T13:38:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 Processor -- start 2023-10-16T13:38:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 -- start start 2023-10-16T13:38:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f406a840 0x7f28f40b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 0x7f28f40c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cede0 0x7f28f40c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40b0360 con 0x7f28f40cd950 2023-10-16T13:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c8cb0 con 0x7f28f40cede0 2023-10-16T13:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f8ae1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c8f90 con 0x7f28f406a840 2023-10-16T13:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.388+0000 7f28f1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 0x7f28f40c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 0x7f28f40c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42652/0 (socket says 172.21.15.5:42652) 2023-10-16T13:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 -- 172.21.15.5:0/2746787988 learned_addr learned my addr 172.21.15.5:0/2746787988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f2d9d700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cede0 0x7f28f40c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f259c700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f406a840 0x7f28f40b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 -- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f406a840 msgr2=0x7f28f40b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f406a840 0x7f28f40b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 -- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cede0 msgr2=0x7f28f40c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cede0 0x7f28f40c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 -- 172.21.15.5:0/2746787988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40094a0 con 0x7f28f40cd950 2023-10-16T13:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f1d9b700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 0x7f28f40c85f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f28dc001f00 tx=0x7f28dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0052d0 con 0x7f28f40cd950 2023-10-16T13:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc005430 con 0x7f28f40cd950 2023-10-16T13:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40c9270 con 0x7f28f40cd950 2023-10-16T13:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0038f0 con 0x7f28f40cd950 2023-10-16T13:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.389+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f40c9550 con 0x7f28f40cd950 2023-10-16T13:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.390+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f40b2630 con 0x7f28f40cd950 2023-10-16T13:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.391+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f28dc003a50 con 0x7f28f40cd950 2023-10-16T13:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.391+0000 7f28eaffd700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28d406af00 0x7f28d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.391+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28dc088a80 con 0x7f28f40cd950 2023-10-16T13:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.392+0000 7f28f259c700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28d406af00 0x7f28d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.392+0000 7f28f259c700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28d406af00 0x7f28d406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f28e40090b0 tx=0x7f28e4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.396+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28dc053bc0 con 0x7f28f40cd950 2023-10-16T13:38:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.642+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28f40c71c0 con 0x7f28f40cd950 2023-10-16T13:38:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.643+0000 7f28eaffd700 1 -- 172.21.15.5:0/2746787988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28dc017070 con 0x7f28f40cd950 2023-10-16T13:38:46.646 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:38:46.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28d406af00 msgr2=0x7f28d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28d406af00 0x7f28d406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f28e40090b0 tx=0x7f28e4008030 comp rx=0 tx=0).stop 2023-10-16T13:38:46.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 msgr2=0x7f28f40c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:46.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 0x7f28f40c85f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f28dc001f00 tx=0x7f28dc00c860 comp rx=0 tx=0).stop 2023-10-16T13:38:46.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 shutdown_connections 2023-10-16T13:38:46.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f40cede0 0x7f28f40c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28d406af00 0x7f28d406d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f406a840 0x7f28f40b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 --2- 172.21.15.5:0/2746787988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f40cd950 0x7f28f40c85f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 >> 172.21.15.5:0/2746787988 conn(0x7f28f406dae0 msgr2=0x7f28f4160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 shutdown_connections 2023-10-16T13:38:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:46.645+0000 7f28f8ae1700 1 -- 172.21.15.5:0/2746787988 wait complete. 2023-10-16T13:38:46.660 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T13:38:46.660 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:38:46.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:38:46.660 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-16T13:38:46.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T13:38:46.661 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T13:38:46.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T13:38:46.661 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:38:46.662 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-16T13:38:46.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.662 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:38:46.681 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:46.681 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:46.682 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:46.682 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:46.682 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:46.682 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:46.682 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:46.683 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:46.683 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:46.683 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:46.683 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:38:46.683 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:46.684 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:38:46.684 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:46.684 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:38:46.684 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-10-16T13:38:46.684 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:38:46.684 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:46.685 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:38:46.685 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:38:46.685 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:38:46.685 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:46.685 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:38:46.686 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:46.686 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:38:46.686 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:38:46.686 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link tentative 2023-10-16T13:38:46.686 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:46.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.687 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:38:46.748 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:38:46.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.750 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:38:46.809 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:38:46.809 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:38:46.810 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:38:46.810 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:38:46.810 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:38:46.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.811 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:46.811 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:46.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:38:46.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:38:46.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:38:46.812 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:46.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.914 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:38:46.930 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:38:46.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.931 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-10-16T13:38:46.986 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-16T13:38:46.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:46.987 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:46.987 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:46.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:38:46.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-16T13:38:46.988 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:47.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T13:38:47.122 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:47.123 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:47.123 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:47.123 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.123 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:47.123 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.124 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:38:47.124 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 22:82:75:62:f9:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T13:38:47.124 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T13:38:47.124 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.124 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2082:75ff:fe62:f90d/64 scope link 2023-10-16T13:38:47.125 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T13:38:47.212 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:38:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:38:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:38:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:38:47.213 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.214 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:38:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 22:82:75:62:f9:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T13:38:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T13:38:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.214 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2082:75ff:fe62:f90d/64 scope link 2023-10-16T13:38:47.215 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:38:47.223 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-16T13:38:47.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.224 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:47.224 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:47.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-16T13:38:47.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T13:38:47.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-16T13:38:47.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-16T13:38:47.226 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-16T13:38:47.226 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:47.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.481 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:38:47.481 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:38:47.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2023-10-16T13:38:47.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T13:38:47.482 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:38:47.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:47.590 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-16T13:38:47.613 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-16T13:38:47.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:38:47.614 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-16T13:38:47.669 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-16T13:38:47.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:47.755 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:47.755 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:47.779 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:47.780 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:47.780 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:47.780 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 3@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:47.780 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:47.781 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:47.781 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:47.781 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:47.805 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:38:47.805 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:38:47.805 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:38:47.806 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 3@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:38:47.806 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:38:47.806 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:38:47.806 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:38:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:38:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:38:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:38:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:38:47.813 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:38:47.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-16T13:38:47.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.841 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:47.912 INFO:teuthology.orchestra.run.smithi112.stdout:client4690 2023-10-16T13:38:47.913 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:47.913 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:47.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:47.971 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:48.042 INFO:teuthology.orchestra.run.smithi112.stdout:client4690 2023-10-16T13:38:48.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:48.043 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:38:48.113 INFO:teuthology.orchestra.run.smithi112.stdout:client4690 2023-10-16T13:38:48.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:48.114 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.client4690/status') 2023-10-16T13:38:48.192 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4690 (3)192.168.0.2:0/915415527 2023-10-16T13:38:48.193 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2023-10-16T13:38:48.193 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2023-10-16T13:38:48.194 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2023-10-16T13:38:48.194 INFO:teuthology.orchestra.run.smithi112.stderr:68 bytes copied, 2.2183e-05 s, 3.1 MB/s 2023-10-16T13:38:48.194 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T13:38:48.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.347+0000 7f3243224700 1 Processor -- start 2023-10-16T13:38:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.348+0000 7f3243224700 1 -- start start 2023-10-16T13:38:48.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.348+0000 7f3243224700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c15ab10 0x7f323c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.348+0000 7f3243224700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c15e7a0 con 0x7f323c0cfe30 2023-10-16T13:38:48.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.348+0000 7f3243224700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c15f730 con 0x7f323c0b1f50 2023-10-16T13:38:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.348+0000 7f3243224700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0b29a0 con 0x7f323c15ab10 2023-10-16T13:38:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.348+0000 7f32417c1700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f323c0cfe30 0x7f323c0cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52666/0 (socket says 172.21.15.5:52666) 2023-10-16T13:38:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f32417c1700 1 -- 172.21.15.5:0/2017601900 learned_addr learned my addr 172.21.15.5:0/2017601900 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f3240fc0700 1 --2- 172.21.15.5:0/2017601900 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c15ab10 0x7f323c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478207950 0 0) 0x7f323c15e7a0 con 0x7f323c0cfe30 2023-10-16T13:38:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f322c0035b0 con 0x7f323c0cfe30 2023-10-16T13:38:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145073818 0 0) 0x7f323c15f730 con 0x7f323c0b1f50 2023-10-16T13:38:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f323c15e7a0 con 0x7f323c0b1f50 2023-10-16T13:38:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f3240fc0700 1 -- 172.21.15.5:0/2017601900 >> v1:172.21.15.112:6789/0 conn(0x7f323c0b1f50 legacy=0x7f323c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f3240fc0700 1 -- 172.21.15.5:0/2017601900 >> v1:172.21.15.5:6789/0 conn(0x7f323c0cfe30 legacy=0x7f323c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f3240fc0700 1 -- 172.21.15.5:0/2017601900 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0b2c80 con 0x7f323c15ab10 2023-10-16T13:38:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f3240fc0700 1 --2- 172.21.15.5:0/2017601900 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c15ab10 0x7f323c15f1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3230009870 tx=0x7f3230009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2c4d7fa6796220 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230011830 con 0x7f323c15ab10 2023-10-16T13:38:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230011990 con 0x7f323c15ab10 2023-10-16T13:38:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.349+0000 7f323b7fe700 1 -- 172.21.15.5:0/2017601900 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230011d20 con 0x7f323c15ab10 2023-10-16T13:38:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 -- 172.21.15.5:0/2017601900 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c15ab10 msgr2=0x7f323c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 --2- 172.21.15.5:0/2017601900 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c15ab10 0x7f323c15f1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3230009870 tx=0x7f3230009b80 comp rx=0 tx=0).stop 2023-10-16T13:38:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 -- 172.21.15.5:0/2017601900 shutdown_connections 2023-10-16T13:38:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 --2- 172.21.15.5:0/2017601900 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c15ab10 0x7f323c15f1f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 -- 172.21.15.5:0/2017601900 >> 172.21.15.5:0/2017601900 conn(0x7f323c06dae0 msgr2=0x7f323c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 -- 172.21.15.5:0/2017601900 shutdown_connections 2023-10-16T13:38:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.350+0000 7f3243224700 1 -- 172.21.15.5:0/2017601900 wait complete. 2023-10-16T13:38:48.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.351+0000 7f3243224700 1 Processor -- start 2023-10-16T13:38:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.351+0000 7f3243224700 1 -- start start 2023-10-16T13:38:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3243224700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c0b1f50 0x7f323c1f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3243224700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 0x7f323c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3243224700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c15ab10 0x7f323c158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3243224700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0b4760 con 0x7f323c0cfe30 2023-10-16T13:38:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3243224700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0ca460 con 0x7f323c15ab10 2023-10-16T13:38:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3243224700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1589d0 con 0x7f323c0b1f50 2023-10-16T13:38:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f323bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 0x7f323c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f323bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 0x7f323c0c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42668/0 (socket says 172.21.15.5:42668) 2023-10-16T13:38:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f323bfff700 1 -- 172.21.15.5:0/3004657473 learned_addr learned my addr 172.21.15.5:0/3004657473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f32417c1700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c15ab10 0x7f323c158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.352+0000 7f3240fc0700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c0b1f50 0x7f323c1f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f323bfff700 1 -- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c0b1f50 msgr2=0x7f323c1f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f323bfff700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c0b1f50 0x7f323c1f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f323bfff700 1 -- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c15ab10 msgr2=0x7f323c158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f323bfff700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c15ab10 0x7f323c158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f323bfff700 1 -- 172.21.15.5:0/3004657473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300094a0 con 0x7f323c0cfe30 2023-10-16T13:38:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f323bfff700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 0x7f323c0c9af0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3228001f00 tx=0x7f322800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280052d0 con 0x7f323c0cfe30 2023-10-16T13:38:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228005430 con 0x7f323c0cfe30 2023-10-16T13:38:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c0ca180 con 0x7f323c0cfe30 2023-10-16T13:38:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280038f0 con 0x7f323c0cfe30 2023-10-16T13:38:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.353+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c0b4c70 con 0x7f323c0cfe30 2023-10-16T13:38:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.354+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c0afc10 con 0x7f323c0cfe30 2023-10-16T13:38:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.355+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3228003a50 con 0x7f323c0cfe30 2023-10-16T13:38:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.355+0000 7f32397fa700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f322006af00 0x7f322006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.355+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32280889a0 con 0x7f323c0cfe30 2023-10-16T13:38:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.355+0000 7f3240fc0700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f322006af00 0x7f322006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.356+0000 7f3240fc0700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f322006af00 0x7f322006d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32300090b0 tx=0x7f323001d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.360+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3228053a50 con 0x7f323c0cfe30 2023-10-16T13:38:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.563+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323c0aefd0 con 0x7f323c0cfe30 2023-10-16T13:38:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.564+0000 7f32397fa700 1 -- 172.21.15.5:0/3004657473 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f3228017090 con 0x7f323c0cfe30 2023-10-16T13:38:48.567 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:48.567 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f322006af00 msgr2=0x7f322006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f322006af00 0x7f322006d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32300090b0 tx=0x7f323001d040 comp rx=0 tx=0).stop 2023-10-16T13:38:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 msgr2=0x7f323c0c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 0x7f323c0c9af0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3228001f00 tx=0x7f322800c7b0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 shutdown_connections 2023-10-16T13:38:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c15ab10 0x7f323c158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f322006af00 0x7f322006d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f323c0b1f50 0x7f323c1f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 --2- 172.21.15.5:0/3004657473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c0cfe30 0x7f323c0c9af0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 >> 172.21.15.5:0/3004657473 conn(0x7f323c06dae0 msgr2=0x7f323c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 shutdown_connections 2023-10-16T13:38:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.566+0000 7f3243224700 1 -- 172.21.15.5:0/3004657473 wait complete. 2023-10-16T13:38:48.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:48.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:48.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.708+0000 7fc7eef00700 1 Processor -- start 2023-10-16T13:38:48.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.708+0000 7fc7eef00700 1 -- start start 2023-10-16T13:38:48.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7eef00700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7e815f130 0x7fc7e80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7eef00700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e80b3530 con 0x7fc7e80b28b0 2023-10-16T13:38:48.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7eef00700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e80cd180 con 0x7fc7e806af50 2023-10-16T13:38:48.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7eef00700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e80cde00 con 0x7fc7e815f130 2023-10-16T13:38:48.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7ecc9c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7e815f130 0x7fc7e80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7e7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7e80b28b0 0x7fc7e806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52680/0 (socket says 172.21.15.5:52680) 2023-10-16T13:38:48.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7e7fff700 1 -- 172.21.15.5:0/1902712741 learned_addr learned my addr 172.21.15.5:0/1902712741 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:48.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7ecc9c700 1 -- 172.21.15.5:0/1902712741 >> v1:172.21.15.112:6789/0 conn(0x7fc7e806af50 legacy=0x7fc7e80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7ecc9c700 1 -- 172.21.15.5:0/1902712741 >> v1:172.21.15.5:6789/0 conn(0x7fc7e80b28b0 legacy=0x7fc7e806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7ecc9c700 1 -- 172.21.15.5:0/1902712741 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e80cd460 con 0x7fc7e815f130 2023-10-16T13:38:48.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7e77fe700 1 -- 172.21.15.5:0/1902712741 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782921805 0 0) 0x7fc7e80b3530 con 0x7fc7e80b28b0 2023-10-16T13:38:48.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7ecc9c700 1 --2- 172.21.15.5:0/1902712741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e815f130 0x7fc7e80cede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009840 tx=0x7fc7dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1474f7c34498ffa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:48.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.709+0000 7fc7e77fe700 1 -- 172.21.15.5:0/1902712741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc011830 con 0x7fc7e815f130 2023-10-16T13:38:48.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7e77fe700 1 -- 172.21.15.5:0/1902712741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc011990 con 0x7fc7e815f130 2023-10-16T13:38:48.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7e77fe700 1 -- 172.21.15.5:0/1902712741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc011d20 con 0x7fc7e815f130 2023-10-16T13:38:48.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 -- 172.21.15.5:0/1902712741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e815f130 msgr2=0x7fc7e80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 --2- 172.21.15.5:0/1902712741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e815f130 0x7fc7e80cede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009840 tx=0x7fc7dc009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:48.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 -- 172.21.15.5:0/1902712741 shutdown_connections 2023-10-16T13:38:48.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 --2- 172.21.15.5:0/1902712741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e815f130 0x7fc7e80cede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 -- 172.21.15.5:0/1902712741 >> 172.21.15.5:0/1902712741 conn(0x7fc7e806dae0 msgr2=0x7fc7e806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:48.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 -- 172.21.15.5:0/1902712741 shutdown_connections 2023-10-16T13:38:48.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.710+0000 7fc7eef00700 1 -- 172.21.15.5:0/1902712741 wait complete. 2023-10-16T13:38:48.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.711+0000 7fc7eef00700 1 Processor -- start 2023-10-16T13:38:48.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.711+0000 7fc7eef00700 1 -- start start 2023-10-16T13:38:48.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7eef00700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e806af50 0x7fc7e8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7eef00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 0x7fc7e80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7eef00700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7e815f130 0x7fc7e80ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7eef00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80ca5e0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7eef00700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80c5c00 con 0x7fc7e806af50 2023-10-16T13:38:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7eef00700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80c5ee0 con 0x7fc7e815f130 2023-10-16T13:38:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7e7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 0x7fc7e80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7e7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 0x7fc7e80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42680/0 (socket says 172.21.15.5:42680) 2023-10-16T13:38:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7e7fff700 1 -- 172.21.15.5:0/850921644 learned_addr learned my addr 172.21.15.5:0/850921644 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7ecc9c700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e806af50 0x7fc7e8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.712+0000 7fc7ed49d700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7e815f130 0x7fc7e80ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e7fff700 1 -- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7e815f130 msgr2=0x7fc7e80ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e7fff700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7e815f130 0x7fc7e80ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e7fff700 1 -- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e806af50 msgr2=0x7fc7e8156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e7fff700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e806af50 0x7fc7e8156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e7fff700 1 -- 172.21.15.5:0/850921644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0094a0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7ecc9c700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e806af50 0x7fc7e8156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e7fff700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 0x7fc7e80c9b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c550 tx=0x7fc7d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4004c80 con 0x7fc7e80b28b0 2023-10-16T13:38:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4004de0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e80c61c0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40072f0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.713+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e80c6780 con 0x7fc7e80b28b0 2023-10-16T13:38:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.714+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e80c69a0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.715+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc7d4007450 con 0x7fc7e80b28b0 2023-10-16T13:38:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.715+0000 7fc7e57fa700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7cc06af00 0x7fc7cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.715+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7d40892e0 con 0x7fc7e80b28b0 2023-10-16T13:38:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.715+0000 7fc7ecc9c700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7cc06af00 0x7fc7cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.716+0000 7fc7ecc9c700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7cc06af00 0x7fc7cc06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80afc00 tx=0x7fc7dc01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.720+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7d4054450 con 0x7fc7e80b28b0 2023-10-16T13:38:48.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.916+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7e8067d20 con 0x7fc7e80b28b0 2023-10-16T13:38:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.917+0000 7fc7e57fa700 1 -- 172.21.15.5:0/850921644 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7d4007700 con 0x7fc7e80b28b0 2023-10-16T13:38:48.920 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7cc06af00 msgr2=0x7fc7cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7cc06af00 0x7fc7cc06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80afc00 tx=0x7fc7dc01c040 comp rx=0 tx=0).stop 2023-10-16T13:38:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 msgr2=0x7fc7e80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 0x7fc7e80c9b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c550 tx=0x7fc7d400c910 comp rx=0 tx=0).stop 2023-10-16T13:38:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 shutdown_connections 2023-10-16T13:38:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7cc06af00 0x7fc7cc06d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7e815f130 0x7fc7e80ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e806af50 0x7fc7e8156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 --2- 172.21.15.5:0/850921644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7e80b28b0 0x7fc7e80c9b60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 >> 172.21.15.5:0/850921644 conn(0x7fc7e806dae0 msgr2=0x7fc7e80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 shutdown_connections 2023-10-16T13:38:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:48.919+0000 7fc7eef00700 1 -- 172.21.15.5:0/850921644 wait complete. 2023-10-16T13:38:48.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:49.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 Processor -- start 2023-10-16T13:38:49.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 -- start start 2023-10-16T13:38:49.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05c415b740 0x7f05c40d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40ce6e0 0x7f05c40cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c40cf190 con 0x7f05c40d0c70 2023-10-16T13:38:49.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c415bb20 con 0x7f05c415b740 2023-10-16T13:38:49.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.060+0000 7f05ca5c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40cbd40 con 0x7f05c40ce6e0 2023-10-16T13:38:49.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05c415b740 0x7f05c40d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05c415b740 0x7f05c40d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42686/0 (socket says 172.21.15.5:42686) 2023-10-16T13:38:49.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 -- 172.21.15.5:0/1928279729 learned_addr learned my addr 172.21.15.5:0/1928279729 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:49.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c8b63700 1 --2- 172.21.15.5:0/1928279729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40ce6e0 0x7f05c40cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 -- 172.21.15.5:0/1928279729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40ce6e0 msgr2=0x7f05c40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:49.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 --2- 172.21.15.5:0/1928279729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40ce6e0 0x7f05c40cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 -- 172.21.15.5:0/1928279729 >> v1:172.21.15.112:6789/0 conn(0x7f05c40d0c70 legacy=0x7f05c40cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 -- 172.21.15.5:0/1928279729 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40cc020 con 0x7f05c415b740 2023-10-16T13:38:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c3fff700 1 --2- 172.21.15.5:0/1928279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c415b740 0x7f05c40d1cd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05c415bc60 tx=0x7f05b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf92715690b724 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c2ffd700 1 -- 172.21.15.5:0/1928279729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4004230 con 0x7f05c415b740 2023-10-16T13:38:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c2ffd700 1 -- 172.21.15.5:0/1928279729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4004390 con 0x7f05c415b740 2023-10-16T13:38:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.061+0000 7f05c2ffd700 1 -- 172.21.15.5:0/1928279729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40036a0 con 0x7f05c415b740 2023-10-16T13:38:49.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 -- 172.21.15.5:0/1928279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c415b740 msgr2=0x7f05c40d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/1928279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c415b740 0x7f05c40d1cd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05c415bc60 tx=0x7f05b4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 -- 172.21.15.5:0/1928279729 shutdown_connections 2023-10-16T13:38:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/1928279729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40ce6e0 0x7f05c40cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/1928279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c415b740 0x7f05c40d1cd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 -- 172.21.15.5:0/1928279729 >> 172.21.15.5:0/1928279729 conn(0x7f05c40665a0 msgr2=0x7f05c4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:49.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 -- 172.21.15.5:0/1928279729 shutdown_connections 2023-10-16T13:38:49.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.062+0000 7f05ca5c6700 1 -- 172.21.15.5:0/1928279729 wait complete. 2023-10-16T13:38:49.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.063+0000 7f05ca5c6700 1 Processor -- start 2023-10-16T13:38:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.063+0000 7f05ca5c6700 1 -- start start 2023-10-16T13:38:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05ca5c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 0x7f05c415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05ca5c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40d0c70 0x7f05c41e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05ca5c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c41e6100 0x7f05c41f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05ca5c6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41e65d0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05ca5c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41e68b0 con 0x7f05c41e6100 2023-10-16T13:38:49.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05ca5c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c415cce0 con 0x7f05c40d0c70 2023-10-16T13:38:49.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 0x7f05c415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 0x7f05c415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42690/0 (socket says 172.21.15.5:42690) 2023-10-16T13:38:49.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 -- 172.21.15.5:0/815108393 learned_addr learned my addr 172.21.15.5:0/815108393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c37fe700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40d0c70 0x7f05c41e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c8b63700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c41e6100 0x7f05c41f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 -- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40d0c70 msgr2=0x7f05c41e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40d0c70 0x7f05c41e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 -- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c41e6100 msgr2=0x7f05c41f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c41e6100 0x7f05c41f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c3fff700 1 -- 172.21.15.5:0/815108393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4009550 con 0x7f05c40ce6e0 2023-10-16T13:38:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.064+0000 7f05c37fe700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40d0c70 0x7f05c41e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.065+0000 7f05c3fff700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 0x7f05c415aa80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05b4000c00 tx=0x7f05b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.065+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4003cc0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.065+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b401f070 con 0x7f05c40ce6e0 2023-10-16T13:38:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.065+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4011870 con 0x7f05c40ce6e0 2023-10-16T13:38:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.065+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c415cfc0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.065+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c415afc0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.066+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c40cc5c0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.066+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f05b4021030 con 0x7f05c40ce6e0 2023-10-16T13:38:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.067+0000 7f05c0ff9700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f05b006af00 0x7f05b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.067+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05b408aa40 con 0x7f05c40ce6e0 2023-10-16T13:38:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.067+0000 7f05c37fe700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f05b006af00 0x7f05b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.067+0000 7f05c37fe700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f05b006af00 0x7f05b006d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05c415ec90 tx=0x7f05b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.071+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05c40cc5c0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.272+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05c40cc5c0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.272+0000 7f05c0ff9700 1 -- 172.21.15.5:0/815108393 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05c40cc5c0 con 0x7f05c40ce6e0 2023-10-16T13:38:49.275 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f05b006af00 msgr2=0x7f05b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f05b006af00 0x7f05b006d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05c415ec90 tx=0x7f05b8009040 comp rx=0 tx=0).stop 2023-10-16T13:38:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 msgr2=0x7f05c415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 0x7f05c415aa80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05b4000c00 tx=0x7f05b4004750 comp rx=0 tx=0).stop 2023-10-16T13:38:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 shutdown_connections 2023-10-16T13:38:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c41e6100 0x7f05c41f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05c40ce6e0 0x7f05c415aa80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f05b006af00 0x7f05b006d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 --2- 172.21.15.5:0/815108393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05c40d0c70 0x7f05c41e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.274+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 >> 172.21.15.5:0/815108393 conn(0x7f05c40665a0 msgr2=0x7f05c415f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:49.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.275+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 shutdown_connections 2023-10-16T13:38:49.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.275+0000 7f05ca5c6700 1 -- 172.21.15.5:0/815108393 wait complete. 2023-10-16T13:38:49.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.414+0000 7f4713642700 1 Processor -- start 2023-10-16T13:38:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.415+0000 7f4713642700 1 -- start start 2023-10-16T13:38:49.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.415+0000 7f4713642700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f470c0cd950 0x7f470c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.415+0000 7f4713642700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f470c06a840 0x7f470c06ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.415+0000 7f4713642700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c0cf290 con 0x7f470c0cede0 2023-10-16T13:38:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.415+0000 7f4713642700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c1619a0 con 0x7f470c06a840 2023-10-16T13:38:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.415+0000 7f4713642700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c06b1b0 con 0x7f470c0cd950 2023-10-16T13:38:49.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f470c06a840 0x7f470c06ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f470c06a840 0x7f470c06ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42702/0 (socket says 172.21.15.5:42702) 2023-10-16T13:38:49.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 -- 172.21.15.5:0/31443219 learned_addr learned my addr 172.21.15.5:0/31443219 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:49.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f47113de700 1 --2- 172.21.15.5:0/31443219 >> v2:172.21.15.112:3300/0 conn(0x7f470c0cd950 0x7f470c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 -- 172.21.15.5:0/31443219 >> v2:172.21.15.112:3300/0 conn(0x7f470c0cd950 msgr2=0x7f470c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:49.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 --2- 172.21.15.5:0/31443219 >> v2:172.21.15.112:3300/0 conn(0x7f470c0cd950 0x7f470c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 -- 172.21.15.5:0/31443219 >> v1:172.21.15.112:6789/0 conn(0x7f470c0cede0 legacy=0x7f470c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 -- 172.21.15.5:0/31443219 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0b2d60 con 0x7f470c06a840 2023-10-16T13:38:49.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4711bdf700 1 --2- 172.21.15.5:0/31443219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c06a840 0x7f470c06ac70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f470c0d0430 tx=0x7f470400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727882f641dbbc6b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4703fff700 1 -- 172.21.15.5:0/31443219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400e070 con 0x7f470c06a840 2023-10-16T13:38:49.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4703fff700 1 -- 172.21.15.5:0/31443219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400b910 con 0x7f470c06a840 2023-10-16T13:38:49.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.416+0000 7f4703fff700 1 -- 172.21.15.5:0/31443219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400bcc0 con 0x7f470c06a840 2023-10-16T13:38:49.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 -- 172.21.15.5:0/31443219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c06a840 msgr2=0x7f470c06ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 --2- 172.21.15.5:0/31443219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c06a840 0x7f470c06ac70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f470c0d0430 tx=0x7f470400b330 comp rx=0 tx=0).stop 2023-10-16T13:38:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 -- 172.21.15.5:0/31443219 shutdown_connections 2023-10-16T13:38:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 --2- 172.21.15.5:0/31443219 >> v2:172.21.15.112:3300/0 conn(0x7f470c0cd950 0x7f470c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 --2- 172.21.15.5:0/31443219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c06a840 0x7f470c06ac70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 -- 172.21.15.5:0/31443219 >> 172.21.15.5:0/31443219 conn(0x7f470c06dae0 msgr2=0x7f470c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 -- 172.21.15.5:0/31443219 shutdown_connections 2023-10-16T13:38:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.417+0000 7f4713642700 1 -- 172.21.15.5:0/31443219 wait complete. 2023-10-16T13:38:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.418+0000 7f4713642700 1 Processor -- start 2023-10-16T13:38:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.418+0000 7f4713642700 1 -- start start 2023-10-16T13:38:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4713642700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f470c06a840 0x7f470c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4713642700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f470c0cd950 0x7f470c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4713642700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 0x7f470c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4713642700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c158190 con 0x7f470c0cede0 2023-10-16T13:38:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4713642700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c158470 con 0x7f470c0cd950 2023-10-16T13:38:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4713642700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c158750 con 0x7f470c06a840 2023-10-16T13:38:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4711bdf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 0x7f470c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4711bdf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 0x7f470c0c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42708/0 (socket says 172.21.15.5:42708) 2023-10-16T13:38:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4711bdf700 1 -- 172.21.15.5:0/3962788903 learned_addr learned my addr 172.21.15.5:0/3962788903 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f47113de700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f470c06a840 0x7f470c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.419+0000 7f4710bdd700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f470c0cd950 0x7f470c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4711bdf700 1 -- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f470c06a840 msgr2=0x7f470c153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4711bdf700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f470c06a840 0x7f470c153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4711bdf700 1 -- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f470c0cd950 msgr2=0x7f470c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4711bdf700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f470c0cd950 0x7f470c157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4711bdf700 1 -- 172.21.15.5:0/3962788903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009b30 con 0x7f470c0cede0 2023-10-16T13:38:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4711bdf700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 0x7f470c0c6530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f470c0cf420 tx=0x7f4704004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704004880 con 0x7f470c0cede0 2023-10-16T13:38:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47040092e0 con 0x7f470c0cede0 2023-10-16T13:38:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470401c660 con 0x7f470c0cede0 2023-10-16T13:38:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c0b41c0 con 0x7f470c0cede0 2023-10-16T13:38:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.420+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c0b3de0 con 0x7f470c0cede0 2023-10-16T13:38:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.421+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c0b4000 con 0x7f470c0cede0 2023-10-16T13:38:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.422+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f470401c7c0 con 0x7f470c0cede0 2023-10-16T13:38:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.422+0000 7f4701ffb700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f46f006af00 0x7f46f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.423+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f470408b1d0 con 0x7f470c0cede0 2023-10-16T13:38:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.423+0000 7f47113de700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f46f006af00 0x7f46f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.423+0000 7f47113de700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f46f006af00 0x7f46f006d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009be0 tx=0x7f46fc009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.427+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47040563f0 con 0x7f470c0cede0 2023-10-16T13:38:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.624+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f470c067d20 con 0x7f470c0cede0 2023-10-16T13:38:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.624+0000 7f4701ffb700 1 -- 172.21.15.5:0/3962788903 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4704059a10 con 0x7f470c0cede0 2023-10-16T13:38:49.627 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:49.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f46f006af00 msgr2=0x7f46f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f46f006af00 0x7f46f006d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009be0 tx=0x7f46fc009210 comp rx=0 tx=0).stop 2023-10-16T13:38:49.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 msgr2=0x7f470c0c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 0x7f470c0c6530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f470c0cf420 tx=0x7f4704004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 shutdown_connections 2023-10-16T13:38:49.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c0cede0 0x7f470c0c6530 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f46f006af00 0x7f46f006d3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f470c06a840 0x7f470c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 --2- 172.21.15.5:0/3962788903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f470c0cd950 0x7f470c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 >> 172.21.15.5:0/3962788903 conn(0x7f470c06dae0 msgr2=0x7f470c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:49.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 shutdown_connections 2023-10-16T13:38:49.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.626+0000 7f4713642700 1 -- 172.21.15.5:0/3962788903 wait complete. 2023-10-16T13:38:49.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.765+0000 7f02f05da700 1 Processor -- start 2023-10-16T13:38:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.765+0000 7f02f05da700 1 -- start start 2023-10-16T13:38:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02f05da700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02e806ef20 0x7f02e80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02f05da700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02e80ce0b0 0x7f02e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02f05da700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e815bf30 con 0x7f02e815bb50 2023-10-16T13:38:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02f05da700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80ce540 con 0x7f02e806ef20 2023-10-16T13:38:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02f05da700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80b2d70 con 0x7f02e80ce0b0 2023-10-16T13:38:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02edb75700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02e806ef20 0x7f02e80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02ee376700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02e815bb50 0x7f02e806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52716/0 (socket says 172.21.15.5:52716) 2023-10-16T13:38:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02ee376700 1 -- 172.21.15.5:0/1739636767 learned_addr learned my addr 172.21.15.5:0/1739636767 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02eeb77700 1 --2- 172.21.15.5:0/1739636767 >> v2:172.21.15.112:3300/0 conn(0x7f02e80ce0b0 0x7f02e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02edb75700 1 -- 172.21.15.5:0/1739636767 >> v2:172.21.15.112:3300/0 conn(0x7f02e80ce0b0 msgr2=0x7f02e806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02edb75700 1 --2- 172.21.15.5:0/1739636767 >> v2:172.21.15.112:3300/0 conn(0x7f02e80ce0b0 0x7f02e806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02edb75700 1 -- 172.21.15.5:0/1739636767 >> v1:172.21.15.5:6789/0 conn(0x7f02e815bb50 legacy=0x7f02e806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02edb75700 1 -- 172.21.15.5:0/1739636767 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e806d500 con 0x7f02e806ef20 2023-10-16T13:38:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02ed374700 1 -- 172.21.15.5:0/1739636767 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922861703 0 0) 0x7f02e815bf30 con 0x7f02e815bb50 2023-10-16T13:38:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.766+0000 7f02edb75700 1 --2- 172.21.15.5:0/1739636767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e80cdb70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02e815f5a0 tx=0x7f02d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddae16df2a0a6efc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02ed374700 1 -- 172.21.15.5:0/1739636767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011830 con 0x7f02e806ef20 2023-10-16T13:38:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02ed374700 1 -- 172.21.15.5:0/1739636767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8011990 con 0x7f02e806ef20 2023-10-16T13:38:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02ed374700 1 -- 172.21.15.5:0/1739636767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011d20 con 0x7f02e806ef20 2023-10-16T13:38:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 -- 172.21.15.5:0/1739636767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 msgr2=0x7f02e80cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 --2- 172.21.15.5:0/1739636767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e80cdb70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02e815f5a0 tx=0x7f02d8009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 -- 172.21.15.5:0/1739636767 shutdown_connections 2023-10-16T13:38:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 --2- 172.21.15.5:0/1739636767 >> v2:172.21.15.112:3300/0 conn(0x7f02e80ce0b0 0x7f02e806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 --2- 172.21.15.5:0/1739636767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e80cdb70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 -- 172.21.15.5:0/1739636767 >> 172.21.15.5:0/1739636767 conn(0x7f02e80cc6f0 msgr2=0x7f02e80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 -- 172.21.15.5:0/1739636767 shutdown_connections 2023-10-16T13:38:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.767+0000 7f02f05da700 1 -- 172.21.15.5:0/1739636767 wait complete. 2023-10-16T13:38:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.768+0000 7f02f05da700 1 Processor -- start 2023-10-16T13:38:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 -- start start 2023-10-16T13:38:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e8158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02e80ce0b0 0x7f02e80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02e815bb50 0x7f02e80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80cb3d0 con 0x7f02e806ef20 2023-10-16T13:38:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80ca750 con 0x7f02e815bb50 2023-10-16T13:38:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02f05da700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80caa30 con 0x7f02e80ce0b0 2023-10-16T13:38:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02ee376700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e8158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02ee376700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e8158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42718/0 (socket says 172.21.15.5:42718) 2023-10-16T13:38:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.769+0000 7f02ee376700 1 -- 172.21.15.5:0/687517546 learned_addr learned my addr 172.21.15.5:0/687517546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02edb75700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02e80ce0b0 0x7f02e80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02eeb77700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02e815bb50 0x7f02e80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02ee376700 1 -- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02e80ce0b0 msgr2=0x7f02e80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02ee376700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02e80ce0b0 0x7f02e80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02ee376700 1 -- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02e815bb50 msgr2=0x7f02e80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02ee376700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02e815bb50 0x7f02e80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02ee376700 1 -- 172.21.15.5:0/687517546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80094a0 con 0x7f02e806ef20 2023-10-16T13:38:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02ee376700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e8158320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c550 tx=0x7f02e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4004c80 con 0x7f02e806ef20 2023-10-16T13:38:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e4004e00 con 0x7f02e806ef20 2023-10-16T13:38:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4007310 con 0x7f02e806ef20 2023-10-16T13:38:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80cad10 con 0x7f02e806ef20 2023-10-16T13:38:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.770+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80c7280 con 0x7f02e806ef20 2023-10-16T13:38:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.771+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e80cb510 con 0x7f02e806ef20 2023-10-16T13:38:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.772+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02e4007470 con 0x7f02e806ef20 2023-10-16T13:38:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.772+0000 7f02deffd700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f02cc06af30 0x7f02cc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.772+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02e4089280 con 0x7f02e806ef20 2023-10-16T13:38:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.772+0000 7f02edb75700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f02cc06af30 0x7f02cc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.773+0000 7f02edb75700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f02cc06af30 0x7f02cc06d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02d80090b0 tx=0x7f02d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.777+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02e80cb510 con 0x7f02e806ef20 2023-10-16T13:38:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.978+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02e80cb510 con 0x7f02e806ef20 2023-10-16T13:38:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.979+0000 7f02deffd700 1 -- 172.21.15.5:0/687517546 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f02e80cb510 con 0x7f02e806ef20 2023-10-16T13:38:49.982 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:49.983 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f02cc06af30 msgr2=0x7f02cc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f02cc06af30 0x7f02cc06d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02d80090b0 tx=0x7f02d8008030 comp rx=0 tx=0).stop 2023-10-16T13:38:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 msgr2=0x7f02e8158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e8158320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c550 tx=0x7f02e400c910 comp rx=0 tx=0).stop 2023-10-16T13:38:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 shutdown_connections 2023-10-16T13:38:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02e815bb50 0x7f02e80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02e806ef20 0x7f02e8158320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f02cc06af30 0x7f02cc06d3f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 --2- 172.21.15.5:0/687517546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02e80ce0b0 0x7f02e80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 >> 172.21.15.5:0/687517546 conn(0x7f02e80cc6f0 msgr2=0x7f02e815cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 shutdown_connections 2023-10-16T13:38:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:49.981+0000 7f02f05da700 1 -- 172.21.15.5:0/687517546 wait complete. 2023-10-16T13:38:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:49.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.124+0000 7fedc0afc700 1 Processor -- start 2023-10-16T13:38:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.124+0000 7fedc0afc700 1 -- start start 2023-10-16T13:38:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedc0afc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc15e2f0 0x7fedbc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedc0afc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedbc06a840 0x7fedbc06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedc0afc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedbc0b2d60 con 0x7fedbc0cd950 2023-10-16T13:38:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedc0afc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedbc1619a0 con 0x7fedbc06a840 2023-10-16T13:38:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedc0afc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc06b1f0 con 0x7fedbc15e2f0 2023-10-16T13:38:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedbc06a840 0x7fedbc06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedbc06a840 0x7fedbc06acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42730/0 (socket says 172.21.15.5:42730) 2023-10-16T13:38:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 -- 172.21.15.5:0/3276971206 learned_addr learned my addr 172.21.15.5:0/3276971206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedb9d9b700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc15e2f0 0x7fedbc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 -- 172.21.15.5:0/3276971206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc15e2f0 msgr2=0x7fedbc0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc15e2f0 0x7fedbc0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 -- 172.21.15.5:0/3276971206 >> v1:172.21.15.112:6789/0 conn(0x7fedbc0cd950 legacy=0x7fedbc15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 -- 172.21.15.5:0/3276971206 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0cdd30 con 0x7fedbc06a840 2023-10-16T13:38:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedb9d9b700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc15e2f0 0x7fedbc0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedbad9d700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc06a840 0x7fedbc06acb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009e50 tx=0x7fedb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866fe6661f4120ed server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedb959a700 1 -- 172.21.15.5:0/3276971206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400e070 con 0x7fedbc06a840 2023-10-16T13:38:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedb959a700 1 -- 172.21.15.5:0/3276971206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb400b9c0 con 0x7fedbc06a840 2023-10-16T13:38:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.125+0000 7fedb959a700 1 -- 172.21.15.5:0/3276971206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400bd70 con 0x7fedbc06a840 2023-10-16T13:38:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 -- 172.21.15.5:0/3276971206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc06a840 msgr2=0x7fedbc06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc06a840 0x7fedbc06acb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009e50 tx=0x7fedb400b330 comp rx=0 tx=0).stop 2023-10-16T13:38:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 -- 172.21.15.5:0/3276971206 shutdown_connections 2023-10-16T13:38:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc06a840 0x7fedbc06acb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3276971206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc15e2f0 0x7fedbc0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 -- 172.21.15.5:0/3276971206 >> 172.21.15.5:0/3276971206 conn(0x7fedbc06dae0 msgr2=0x7fedbc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 -- 172.21.15.5:0/3276971206 shutdown_connections 2023-10-16T13:38:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.126+0000 7fedc0afc700 1 -- 172.21.15.5:0/3276971206 wait complete. 2023-10-16T13:38:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.127+0000 7fedc0afc700 1 Processor -- start 2023-10-16T13:38:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.127+0000 7fedc0afc700 1 -- start start 2023-10-16T13:38:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedc0afc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedbc06a840 0x7fedbc0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedc0afc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc0cd950 0x7fedbc0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedc0afc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 0x7fedbc0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedc0afc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc0cca60 con 0x7fedbc15e2f0 2023-10-16T13:38:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedc0afc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc0c6970 con 0x7fedbc06a840 2023-10-16T13:38:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedc0afc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc0cbe50 con 0x7fedbc0cd950 2023-10-16T13:38:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedbad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 0x7fedbc0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedbad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 0x7fedbc0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42734/0 (socket says 172.21.15.5:42734) 2023-10-16T13:38:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.128+0000 7fedbad9d700 1 -- 172.21.15.5:0/3239126744 learned_addr learned my addr 172.21.15.5:0/3239126744 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedb9d9b700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc0cd950 0x7fedbc0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedba59c700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedbc06a840 0x7fedbc0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedbad9d700 1 -- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc0cd950 msgr2=0x7fedbc0c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedbad9d700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc0cd950 0x7fedbc0c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedbad9d700 1 -- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedbc06a840 msgr2=0x7fedbc0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedbad9d700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedbc06a840 0x7fedbc0ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedbad9d700 1 -- 172.21.15.5:0/3239126744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4009b30 con 0x7fedbc15e2f0 2023-10-16T13:38:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedbad9d700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 0x7fedbc0cb290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fedbc06d4f0 tx=0x7fedb4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4004960 con 0x7fedbc15e2f0 2023-10-16T13:38:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb40092e0 con 0x7fedbc15e2f0 2023-10-16T13:38:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc0cc130 con 0x7fedbc15e2f0 2023-10-16T13:38:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb401c660 con 0x7fedbc15e2f0 2023-10-16T13:38:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.129+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc0cc6f0 con 0x7fedbc15e2f0 2023-10-16T13:38:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.130+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc067d20 con 0x7fedbc15e2f0 2023-10-16T13:38:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.130+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedb401c7c0 con 0x7fedbc15e2f0 2023-10-16T13:38:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.131+0000 7fedaaffd700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fed9c06af00 0x7fed9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.131+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedb408b350 con 0x7fedbc15e2f0 2023-10-16T13:38:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.131+0000 7fedba59c700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fed9c06af00 0x7fed9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.131+0000 7fedba59c700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fed9c06af00 0x7fed9c06d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedac000f60 tx=0x7fedac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.135+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedb40563f0 con 0x7fedbc15e2f0 2023-10-16T13:38:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.333+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedbc0b2100 con 0x7fedbc15e2f0 2023-10-16T13:38:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.334+0000 7fedaaffd700 1 -- 172.21.15.5:0/3239126744 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedb4059a10 con 0x7fedbc15e2f0 2023-10-16T13:38:50.337 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fed9c06af00 msgr2=0x7fed9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fed9c06af00 0x7fed9c06d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedac000f60 tx=0x7fedac009040 comp rx=0 tx=0).stop 2023-10-16T13:38:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 msgr2=0x7fedbc0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 0x7fedbc0cb290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fedbc06d4f0 tx=0x7fedb4004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 shutdown_connections 2023-10-16T13:38:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc15e2f0 0x7fedbc0cb290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedbc06a840 0x7fedbc0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fed9c06af00 0x7fed9c06d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 --2- 172.21.15.5:0/3239126744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedbc0cd950 0x7fedbc0c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 >> 172.21.15.5:0/3239126744 conn(0x7fedbc06dae0 msgr2=0x7fedbc0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 shutdown_connections 2023-10-16T13:38:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.336+0000 7fedc0afc700 1 -- 172.21.15.5:0/3239126744 wait complete. 2023-10-16T13:38:50.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.477+0000 7f0ea7bca700 1 Processor -- start 2023-10-16T13:38:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.478+0000 7f0ea7bca700 1 -- start start 2023-10-16T13:38:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.478+0000 7f0ea7bca700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ea00d0c70 0x7f0ea00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.478+0000 7f0ea7bca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ea00c5110 0x7f0ea00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.478+0000 7f0ea7bca700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00d23e0 con 0x7f0ea015b740 2023-10-16T13:38:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.478+0000 7f0ea7bca700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea015bb20 con 0x7f0ea00c5110 2023-10-16T13:38:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.478+0000 7f0ea7bca700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00cf190 con 0x7f0ea00d0c70 2023-10-16T13:38:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ea00c5110 0x7f0ea00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ea00c5110 0x7f0ea00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42744/0 (socket says 172.21.15.5:42744) 2023-10-16T13:38:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 -- 172.21.15.5:0/3693765321 learned_addr learned my addr 172.21.15.5:0/3693765321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea5165700 1 --2- 172.21.15.5:0/3693765321 >> v2:172.21.15.112:3300/0 conn(0x7f0ea00d0c70 0x7f0ea00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 -- 172.21.15.5:0/3693765321 >> v2:172.21.15.112:3300/0 conn(0x7f0ea00d0c70 msgr2=0x7f0ea00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 --2- 172.21.15.5:0/3693765321 >> v2:172.21.15.112:3300/0 conn(0x7f0ea00d0c70 0x7f0ea00cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 -- 172.21.15.5:0/3693765321 >> v1:172.21.15.112:6789/0 conn(0x7f0ea015b740 legacy=0x7f0ea00d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 -- 172.21.15.5:0/3693765321 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00cbd40 con 0x7f0ea00c5110 2023-10-16T13:38:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea5165700 1 --2- 172.21.15.5:0/3693765321 >> v2:172.21.15.112:3300/0 conn(0x7f0ea00d0c70 0x7f0ea00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea6167700 1 --2- 172.21.15.5:0/3693765321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea00c5110 0x7f0ea00ce510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00cec30 tx=0x7f0e9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4845622667f550 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea4964700 1 -- 172.21.15.5:0/3693765321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800e070 con 0x7f0ea00c5110 2023-10-16T13:38:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea4964700 1 -- 172.21.15.5:0/3693765321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98003a20 con 0x7f0ea00c5110 2023-10-16T13:38:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.479+0000 7f0ea4964700 1 -- 172.21.15.5:0/3693765321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98003dd0 con 0x7f0ea00c5110 2023-10-16T13:38:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 -- 172.21.15.5:0/3693765321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea00c5110 msgr2=0x7f0ea00ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/3693765321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea00c5110 0x7f0ea00ce510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00cec30 tx=0x7f0e9800b330 comp rx=0 tx=0).stop 2023-10-16T13:38:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 -- 172.21.15.5:0/3693765321 shutdown_connections 2023-10-16T13:38:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/3693765321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea00c5110 0x7f0ea00ce510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/3693765321 >> v2:172.21.15.112:3300/0 conn(0x7f0ea00d0c70 0x7f0ea00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 -- 172.21.15.5:0/3693765321 >> 172.21.15.5:0/3693765321 conn(0x7f0ea00665a0 msgr2=0x7f0ea0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 -- 172.21.15.5:0/3693765321 shutdown_connections 2023-10-16T13:38:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.480+0000 7f0ea7bca700 1 -- 172.21.15.5:0/3693765321 wait complete. 2023-10-16T13:38:50.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.481+0000 7f0ea7bca700 1 Processor -- start 2023-10-16T13:38:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 -- start start 2023-10-16T13:38:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00c5110 0x7f0ea00c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea00d0c70 0x7f0ea00b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 0x7f0ea01488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00b48b0 con 0x7f0ea015b740 2023-10-16T13:38:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00c6b20 con 0x7f0ea00d0c70 2023-10-16T13:38:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.482+0000 7f0ea7bca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00b3f80 con 0x7f0ea00c5110 2023-10-16T13:38:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 0x7f0ea01488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 0x7f0ea01488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42750/0 (socket says 172.21.15.5:42750) 2023-10-16T13:38:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 -- 172.21.15.5:0/949623201 learned_addr learned my addr 172.21.15.5:0/949623201 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea5165700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea00d0c70 0x7f0ea00b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea5966700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00c5110 0x7f0ea00c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 -- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00c5110 msgr2=0x7f0ea00c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00c5110 0x7f0ea00c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 -- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea00d0c70 msgr2=0x7f0ea00b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea00d0c70 0x7f0ea00b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 -- 172.21.15.5:0/949623201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009b30 con 0x7f0ea015b740 2023-10-16T13:38:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea6167700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 0x7f0ea01488a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e98015040 tx=0x7f0e98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98004440 con 0x7f0ea015b740 2023-10-16T13:38:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e980092e0 con 0x7f0ea015b740 2023-10-16T13:38:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea00b4260 con 0x7f0ea015b740 2023-10-16T13:38:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98004800 con 0x7f0ea015b740 2023-10-16T13:38:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.483+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea00b73d0 con 0x7f0ea015b740 2023-10-16T13:38:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.484+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea00b4c40 con 0x7f0ea015b740 2023-10-16T13:38:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.485+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e98012430 con 0x7f0ea015b740 2023-10-16T13:38:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.485+0000 7f0e967fc700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0e8406af00 0x7f0e8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.485+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e9808a750 con 0x7f0ea015b740 2023-10-16T13:38:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.486+0000 7f0ea5966700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0e8406af00 0x7f0e8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.486+0000 7f0ea5966700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0e8406af00 0x7f0e8406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009960 tx=0x7f0e900090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.490+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e98059320 con 0x7f0ea015b740 2023-10-16T13:38:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.693+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ea00d23e0 con 0x7f0ea015b740 2023-10-16T13:38:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.693+0000 7f0e967fc700 1 -- 172.21.15.5:0/949623201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ea00d23e0 con 0x7f0ea015b740 2023-10-16T13:38:50.698 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0e8406af00 msgr2=0x7f0e8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0e8406af00 0x7f0e8406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009960 tx=0x7f0e900090e0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 msgr2=0x7f0ea01488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 0x7f0ea01488a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e98015040 tx=0x7f0e98004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 shutdown_connections 2023-10-16T13:38:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ea015b740 0x7f0ea01488a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0e8406af00 0x7f0e8406d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ea00c5110 0x7f0ea00c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 --2- 172.21.15.5:0/949623201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ea00d0c70 0x7f0ea00b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 >> 172.21.15.5:0/949623201 conn(0x7f0ea00665a0 msgr2=0x7f0ea00cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 shutdown_connections 2023-10-16T13:38:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.695+0000 7f0ea7bca700 1 -- 172.21.15.5:0/949623201 wait complete. 2023-10-16T13:38:50.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.836+0000 7f430802c700 1 Processor -- start 2023-10-16T13:38:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.836+0000 7f430802c700 1 -- start start 2023-10-16T13:38:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f430802c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43000cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f430802c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43000cc1f0 0x7f4300070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f430802c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43000cf120 con 0x7f4300159f10 2023-10-16T13:38:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f430802c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43000cc680 con 0x7f43000cc1f0 2023-10-16T13:38:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f430802c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43000ca440 con 0x7f43000cd1c0 2023-10-16T13:38:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43000cc1f0 0x7f4300070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43000cc1f0 0x7f4300070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42758/0 (socket says 172.21.15.5:42758) 2023-10-16T13:38:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f4305dc8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4300159f10 0x7f43000cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52758/0 (socket says 172.21.15.5:52758) 2023-10-16T13:38:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 -- 172.21.15.5:0/455430371 learned_addr learned my addr 172.21.15.5:0/455430371 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43055c7700 1 --2- 172.21.15.5:0/455430371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43000cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 -- 172.21.15.5:0/455430371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 msgr2=0x7f43000cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 --2- 172.21.15.5:0/455430371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43000cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 -- 172.21.15.5:0/455430371 >> v1:172.21.15.5:6789/0 conn(0x7f4300159f10 legacy=0x7f43000cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f43065c9700 1 -- 172.21.15.5:0/455430371 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000ca6a0 con 0x7f43000cc1f0 2023-10-16T13:38:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.837+0000 7f4304dc6700 1 -- 172.21.15.5:0/455430371 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589633478 0 0) 0x7f42f0001110 con 0x7f4300159f10 2023-10-16T13:38:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f43065c9700 1 --2- 172.21.15.5:0/455430371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000cc1f0 0x7f4300070a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42f800d150 tx=0x7f42f800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ce5cf8e93c5b0c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f4304dc6700 1 -- 172.21.15.5:0/455430371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8010070 con 0x7f43000cc1f0 2023-10-16T13:38:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f4304dc6700 1 -- 172.21.15.5:0/455430371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f800dd10 con 0x7f43000cc1f0 2023-10-16T13:38:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f4304dc6700 1 -- 172.21.15.5:0/455430371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800b310 con 0x7f43000cc1f0 2023-10-16T13:38:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 -- 172.21.15.5:0/455430371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000cc1f0 msgr2=0x7f4300070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 --2- 172.21.15.5:0/455430371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000cc1f0 0x7f4300070a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42f800d150 tx=0x7f42f800d460 comp rx=0 tx=0).stop 2023-10-16T13:38:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 -- 172.21.15.5:0/455430371 shutdown_connections 2023-10-16T13:38:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 --2- 172.21.15.5:0/455430371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000cc1f0 0x7f4300070a00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 --2- 172.21.15.5:0/455430371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43000cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 -- 172.21.15.5:0/455430371 >> 172.21.15.5:0/455430371 conn(0x7f430006ac60 msgr2=0x7f430006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 -- 172.21.15.5:0/455430371 shutdown_connections 2023-10-16T13:38:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.838+0000 7f430802c700 1 -- 172.21.15.5:0/455430371 wait complete. 2023-10-16T13:38:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 Processor -- start 2023-10-16T13:38:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 -- start start 2023-10-16T13:38:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000cc1f0 0x7f43001e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43001f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 0x7f43001f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430006b5b0 con 0x7f4300159f10 2023-10-16T13:38:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43001f30f0 con 0x7f43000cc1f0 2023-10-16T13:38:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f430802c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4300090cd0 con 0x7f43000cd1c0 2023-10-16T13:38:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f43065c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 0x7f43001f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f43065c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 0x7f43001f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42764/0 (socket says 172.21.15.5:42764) 2023-10-16T13:38:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.840+0000 7f43065c9700 1 -- 172.21.15.5:0/1991647468 learned_addr learned my addr 172.21.15.5:0/1991647468 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43055c7700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43001f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f4305dc8700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000cc1f0 0x7f43001e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43065c9700 1 -- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 msgr2=0x7f43001f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43065c9700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43001f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43065c9700 1 -- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000cc1f0 msgr2=0x7f43001e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43065c9700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000cc1f0 0x7f43001e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43065c9700 1 -- 172.21.15.5:0/1991647468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f800bd40 con 0x7f4300159f10 2023-10-16T13:38:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43055c7700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43001f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f4305dc8700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000cc1f0 0x7f43001e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f43065c9700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 0x7f43001f2bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f42f800d7b0 tx=0x7f42f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8009a10 con 0x7f4300159f10 2023-10-16T13:38:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8009b70 con 0x7f4300159f10 2023-10-16T13:38:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4300091200 con 0x7f4300159f10 2023-10-16T13:38:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8004040 con 0x7f4300159f10 2023-10-16T13:38:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.841+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43000c65a0 con 0x7f4300159f10 2023-10-16T13:38:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.842+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43000c6da0 con 0x7f4300159f10 2023-10-16T13:38:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.843+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f42f80041a0 con 0x7f4300159f10 2023-10-16T13:38:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.843+0000 7f42f67fc700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f42e406af00 0x7f42e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.843+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42f808ab70 con 0x7f4300159f10 2023-10-16T13:38:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.843+0000 7f4305dc8700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f42e406af00 0x7f42e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.844+0000 7f4305dc8700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f42e406af00 0x7f42e406d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000f60 tx=0x7f42f0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:50.848+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42f8055cb0 con 0x7f4300159f10 2023-10-16T13:38:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.050+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f430004ebb0 con 0x7f4300159f10 2023-10-16T13:38:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.050+0000 7f42f67fc700 1 -- 172.21.15.5:0/1991647468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42f80592d0 con 0x7f4300159f10 2023-10-16T13:38:51.053 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f42e406af00 msgr2=0x7f42e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f42e406af00 0x7f42e406d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000f60 tx=0x7f42f0007d30 comp rx=0 tx=0).stop 2023-10-16T13:38:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 msgr2=0x7f43001f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 0x7f43001f2bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f42f800d7b0 tx=0x7f42f8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 shutdown_connections 2023-10-16T13:38:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4300159f10 0x7f43001f2bb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000cc1f0 0x7f43001e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f42e406af00 0x7f42e406d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 --2- 172.21.15.5:0/1991647468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f43000cd1c0 0x7f43001f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 >> 172.21.15.5:0/1991647468 conn(0x7f430006ac60 msgr2=0x7f4300159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 shutdown_connections 2023-10-16T13:38:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.052+0000 7f430802c700 1 -- 172.21.15.5:0/1991647468 wait complete. 2023-10-16T13:38:51.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.189+0000 7f7a3d882700 1 Processor -- start 2023-10-16T13:38:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 -- start start 2023-10-16T13:38:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7a3815dbc0 0x7f7a3815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a380d3fc0 0x7f7a380d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a380d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3815e4e0 con 0x7f7a380d3fc0 2023-10-16T13:38:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a380b7560 con 0x7f7a3815dbc0 2023-10-16T13:38:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a3d882700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380b7840 con 0x7f7a380b7050 2023-10-16T13:38:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a367fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a380d3fc0 0x7f7a380d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a367fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a380d3fc0 0x7f7a380d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42768/0 (socket says 172.21.15.5:42768) 2023-10-16T13:38:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.190+0000 7f7a367fc700 1 -- 172.21.15.5:0/3932470094 learned_addr learned my addr 172.21.15.5:0/3932470094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a377fe700 1 --2- 172.21.15.5:0/3932470094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a380d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a367fc700 1 -- 172.21.15.5:0/3932470094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 msgr2=0x7f7a380d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a36ffd700 1 --2- 172.21.15.5:0/3932470094 >> v2:172.21.15.112:3300/0 conn(0x7f7a3815dbc0 0x7f7a3815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a367fc700 1 --2- 172.21.15.5:0/3932470094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a380d2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a367fc700 1 -- 172.21.15.5:0/3932470094 >> v2:172.21.15.112:3300/0 conn(0x7f7a3815dbc0 msgr2=0x7f7a3815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a367fc700 1 --2- 172.21.15.5:0/3932470094 >> v2:172.21.15.112:3300/0 conn(0x7f7a3815dbc0 0x7f7a3815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a367fc700 1 -- 172.21.15.5:0/3932470094 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380b7b20 con 0x7f7a380d3fc0 2023-10-16T13:38:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a367fc700 1 --2- 172.21.15.5:0/3932470094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380d1ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a38072db0 tx=0x7f7a28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dd3531842b137b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a35ffb700 1 -- 172.21.15.5:0/3932470094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2800b870 con 0x7f7a380d3fc0 2023-10-16T13:38:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a35ffb700 1 -- 172.21.15.5:0/3932470094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2800b9d0 con 0x7f7a380d3fc0 2023-10-16T13:38:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.191+0000 7f7a35ffb700 1 -- 172.21.15.5:0/3932470094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2800bd60 con 0x7f7a380d3fc0 2023-10-16T13:38:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 -- 172.21.15.5:0/3932470094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 msgr2=0x7f7a380d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 --2- 172.21.15.5:0/3932470094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380d1ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a38072db0 tx=0x7f7a28009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 -- 172.21.15.5:0/3932470094 shutdown_connections 2023-10-16T13:38:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 --2- 172.21.15.5:0/3932470094 >> v2:172.21.15.112:3300/0 conn(0x7f7a3815dbc0 0x7f7a3815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 --2- 172.21.15.5:0/3932470094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a380d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 --2- 172.21.15.5:0/3932470094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380d1ac0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 -- 172.21.15.5:0/3932470094 >> 172.21.15.5:0/3932470094 conn(0x7f7a3809cb40 msgr2=0x7f7a380d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:51.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 -- 172.21.15.5:0/3932470094 shutdown_connections 2023-10-16T13:38:51.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.192+0000 7f7a3d882700 1 -- 172.21.15.5:0/3932470094 wait complete. 2023-10-16T13:38:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.193+0000 7f7a3d882700 1 Processor -- start 2023-10-16T13:38:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.194+0000 7f7a3d882700 1 -- start start 2023-10-16T13:38:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.194+0000 7f7a3d882700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a3815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.194+0000 7f7a3d882700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.194+0000 7f7a3d882700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3815dbc0 0x7f7a3815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a3d882700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380a0e10 con 0x7f7a380d3fc0 2023-10-16T13:38:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a3d882700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380b2840 con 0x7f7a3815dbc0 2023-10-16T13:38:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a3d882700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380a07c0 con 0x7f7a380b7050 2023-10-16T13:38:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42776/0 (socket says 172.21.15.5:42776) 2023-10-16T13:38:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 -- 172.21.15.5:0/236148791 learned_addr learned my addr 172.21.15.5:0/236148791 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a377fe700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3815dbc0 0x7f7a3815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a36ffd700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a3815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 -- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 msgr2=0x7f7a3815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a3815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 -- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3815dbc0 msgr2=0x7f7a3815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3815dbc0 0x7f7a3815c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 -- 172.21.15.5:0/236148791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a28009550 con 0x7f7a380d3fc0 2023-10-16T13:38:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a377fe700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3815dbc0 0x7f7a3815c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a367fc700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380b1e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a3806b4b0 tx=0x7f7a28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28004310 con 0x7f7a380d3fc0 2023-10-16T13:38:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2801f070 con 0x7f7a380d3fc0 2023-10-16T13:38:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a380a0aa0 con 0x7f7a380d3fc0 2023-10-16T13:38:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280036a0 con 0x7f7a380d3fc0 2023-10-16T13:38:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.195+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a380b2b20 con 0x7f7a380d3fc0 2023-10-16T13:38:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.196+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3804ebb0 con 0x7f7a380d3fc0 2023-10-16T13:38:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.197+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a28021030 con 0x7f7a380d3fc0 2023-10-16T13:38:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.197+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a2406af00 0x7f7a2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.197+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2808abd0 con 0x7f7a380d3fc0 2023-10-16T13:38:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.197+0000 7f7a36ffd700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a2406af00 0x7f7a2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.198+0000 7f7a36ffd700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a2406af00 0x7f7a2406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a380cd010 tx=0x7f7a2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.202+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a28055d90 con 0x7f7a380d3fc0 2023-10-16T13:38:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.406+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a380a0f50 con 0x7f7a380d3fc0 2023-10-16T13:38:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.408+0000 7f7a1ffff700 1 -- 172.21.15.5:0/236148791 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f7a28015090 con 0x7f7a380d3fc0 2023-10-16T13:38:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:51.411 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a2406af00 msgr2=0x7f7a2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a2406af00 0x7f7a2406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a380cd010 tx=0x7f7a2c008040 comp rx=0 tx=0).stop 2023-10-16T13:38:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 msgr2=0x7f7a380b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380b1e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a3806b4b0 tx=0x7f7a28004750 comp rx=0 tx=0).stop 2023-10-16T13:38:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 shutdown_connections 2023-10-16T13:38:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a3815dbc0 0x7f7a3815c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a2406af00 0x7f7a2406d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a380b7050 0x7f7a3815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 --2- 172.21.15.5:0/236148791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a380d3fc0 0x7f7a380b1e60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 >> 172.21.15.5:0/236148791 conn(0x7f7a3809cb40 msgr2=0x7f7a380d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 shutdown_connections 2023-10-16T13:38:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.410+0000 7f7a3d882700 1 -- 172.21.15.5:0/236148791 wait complete. 2023-10-16T13:38:51.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:51.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:51.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.552+0000 7f93e68fd700 1 Processor -- start 2023-10-16T13:38:51.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.552+0000 7f93e68fd700 1 -- start start 2023-10-16T13:38:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93e68fd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93e015ab10 0x7f93e015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93e68fd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e015e7a0 con 0x7f93e00cfe30 2023-10-16T13:38:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93e68fd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e015f730 con 0x7f93e00b1f50 2023-10-16T13:38:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93e68fd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00b29a0 con 0x7f93e015ab10 2023-10-16T13:38:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93e015ab10 0x7f93e015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93e015ab10 0x7f93e015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42782/0 (socket says 172.21.15.5:42782) 2023-10-16T13:38:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93e4e9a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f93e00cfe30 0x7f93e00cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52790/0 (socket says 172.21.15.5:52790) 2023-10-16T13:38:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 -- 172.21.15.5:0/846463629 learned_addr learned my addr 172.21.15.5:0/846463629 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:51.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 -- 172.21.15.5:0/846463629 >> v1:172.21.15.112:6789/0 conn(0x7f93e00b1f50 legacy=0x7f93e00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:51.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 -- 172.21.15.5:0/846463629 >> v1:172.21.15.5:6789/0 conn(0x7f93e00cfe30 legacy=0x7f93e00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 -- 172.21.15.5:0/846463629 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00b2c80 con 0x7f93e015ab10 2023-10-16T13:38:51.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93dffff700 1 --2- 172.21.15.5:0/846463629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e015f1f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93d00098f0 tx=0x7f93d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ab38c08f8ca1bc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93deffd700 1 -- 172.21.15.5:0/846463629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0004230 con 0x7f93e015ab10 2023-10-16T13:38:51.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93deffd700 1 -- 172.21.15.5:0/846463629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0004390 con 0x7f93e015ab10 2023-10-16T13:38:51.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.553+0000 7f93deffd700 1 -- 172.21.15.5:0/846463629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00036a0 con 0x7f93e015ab10 2023-10-16T13:38:51.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 -- 172.21.15.5:0/846463629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 msgr2=0x7f93e015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 --2- 172.21.15.5:0/846463629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e015f1f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93d00098f0 tx=0x7f93d0009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:51.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 -- 172.21.15.5:0/846463629 shutdown_connections 2023-10-16T13:38:51.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 --2- 172.21.15.5:0/846463629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e015f1f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 -- 172.21.15.5:0/846463629 >> 172.21.15.5:0/846463629 conn(0x7f93e006dae0 msgr2=0x7f93e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:51.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 -- 172.21.15.5:0/846463629 shutdown_connections 2023-10-16T13:38:51.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.554+0000 7f93e68fd700 1 -- 172.21.15.5:0/846463629 wait complete. 2023-10-16T13:38:51.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.556+0000 7f93e68fd700 1 Processor -- start 2023-10-16T13:38:51.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.556+0000 7f93e68fd700 1 -- start start 2023-10-16T13:38:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e68fd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93e00b1f50 0x7f93e00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e68fd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93e00cfe30 0x7f93e00b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e68fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e68fd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e014ed50 con 0x7f93e015ab10 2023-10-16T13:38:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e68fd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00b4be0 con 0x7f93e00b1f50 2023-10-16T13:38:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e68fd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00b4ec0 con 0x7f93e00cfe30 2023-10-16T13:38:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e0158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42792/0 (socket says 172.21.15.5:42792) 2023-10-16T13:38:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 -- 172.21.15.5:0/1156307345 learned_addr learned my addr 172.21.15.5:0/1156307345 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93dffff700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93e00b1f50 0x7f93e00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93df7fe700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93e00cfe30 0x7f93e00b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 -- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93e00cfe30 msgr2=0x7f93e00b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93e00cfe30 0x7f93e00b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 -- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93e00b1f50 msgr2=0x7f93e00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93e00b1f50 0x7f93e00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 -- 172.21.15.5:0/1156307345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009550 con 0x7f93e015ab10 2023-10-16T13:38:51.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.557+0000 7f93e4e9a700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e0158d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93d800cbc0 tx=0x7f93d800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.558+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800a9e0 con 0x7f93e015ab10 2023-10-16T13:38:51.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.558+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800ab40 con 0x7f93e015ab10 2023-10-16T13:38:51.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.558+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e00b51a0 con 0x7f93e015ab10 2023-10-16T13:38:51.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.558+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8007070 con 0x7f93e015ab10 2023-10-16T13:38:51.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.558+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e014eff0 con 0x7f93e015ab10 2023-10-16T13:38:51.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.558+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e0067d20 con 0x7f93e015ab10 2023-10-16T13:38:51.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.559+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f93d80071d0 con 0x7f93e015ab10 2023-10-16T13:38:51.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.559+0000 7f93dcff9700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93cc06af00 0x7f93cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.560+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93d8089040 con 0x7f93e015ab10 2023-10-16T13:38:51.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.560+0000 7f93dffff700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93cc06af00 0x7f93cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.560+0000 7f93dffff700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93cc06af00 0x7f93cc06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009130 tx=0x7f93d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.564+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93d8054230 con 0x7f93e015ab10 2023-10-16T13:38:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.769+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e00afc10 con 0x7f93e015ab10 2023-10-16T13:38:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.770+0000 7f93dcff9700 1 -- 172.21.15.5:0/1156307345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93d80170a0 con 0x7f93e015ab10 2023-10-16T13:38:51.773 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93cc06af00 msgr2=0x7f93cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93cc06af00 0x7f93cc06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009130 tx=0x7f93d0008030 comp rx=0 tx=0).stop 2023-10-16T13:38:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 msgr2=0x7f93e0158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e0158d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93d800cbc0 tx=0x7f93d800ced0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 shutdown_connections 2023-10-16T13:38:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e015ab10 0x7f93e0158d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93e00b1f50 0x7f93e00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93cc06af00 0x7f93cc06d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 --2- 172.21.15.5:0/1156307345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93e00cfe30 0x7f93e00b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 >> 172.21.15.5:0/1156307345 conn(0x7f93e006dae0 msgr2=0x7f93e006a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 shutdown_connections 2023-10-16T13:38:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.772+0000 7f93e68fd700 1 -- 172.21.15.5:0/1156307345 wait complete. 2023-10-16T13:38:51.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.912+0000 7f4c3d077700 1 Processor -- start 2023-10-16T13:38:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.912+0000 7f4c3d077700 1 -- start start 2023-10-16T13:38:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c3d077700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c380cd950 0x7f4c3815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c3d077700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380cf290 con 0x7f4c3806a840 2023-10-16T13:38:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c3d077700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380b2d60 con 0x7f4c380cede0 2023-10-16T13:38:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c3d077700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c381619a0 con 0x7f4c380cd950 2023-10-16T13:38:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c36d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c380cd950 0x7f4c3815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c3759e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4c3806a840 0x7f4c38161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52802/0 (socket says 172.21.15.5:52802) 2023-10-16T13:38:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c3759e700 1 -- 172.21.15.5:0/2872680324 learned_addr learned my addr 172.21.15.5:0/2872680324 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c36d9d700 1 -- 172.21.15.5:0/2872680324 >> v1:172.21.15.112:6789/0 conn(0x7f4c380cede0 legacy=0x7f4c3815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c36d9d700 1 -- 172.21.15.5:0/2872680324 >> v1:172.21.15.5:6789/0 conn(0x7f4c3806a840 legacy=0x7f4c38161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c36d9d700 1 -- 172.21.15.5:0/2872680324 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380cdd30 con 0x7f4c380cd950 2023-10-16T13:38:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.913+0000 7f4c35d9b700 1 -- 172.21.15.5:0/2872680324 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025266550 0 0) 0x7f4c380cf290 con 0x7f4c3806a840 2023-10-16T13:38:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c36d9d700 1 --2- 172.21.15.5:0/2872680324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c380cd950 0x7f4c3815e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009840 tx=0x7f4c2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c46f096d9a12c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c35d9b700 1 -- 172.21.15.5:0/2872680324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c011830 con 0x7f4c380cd950 2023-10-16T13:38:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c35d9b700 1 -- 172.21.15.5:0/2872680324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c011990 con 0x7f4c380cd950 2023-10-16T13:38:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c35d9b700 1 -- 172.21.15.5:0/2872680324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c011d20 con 0x7f4c380cd950 2023-10-16T13:38:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 -- 172.21.15.5:0/2872680324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c380cd950 msgr2=0x7f4c3815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 --2- 172.21.15.5:0/2872680324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c380cd950 0x7f4c3815e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009840 tx=0x7f4c2c009b50 comp rx=0 tx=0).stop 2023-10-16T13:38:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 -- 172.21.15.5:0/2872680324 shutdown_connections 2023-10-16T13:38:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 --2- 172.21.15.5:0/2872680324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c380cd950 0x7f4c3815e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 -- 172.21.15.5:0/2872680324 >> 172.21.15.5:0/2872680324 conn(0x7f4c3806dae0 msgr2=0x7f4c3806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 -- 172.21.15.5:0/2872680324 shutdown_connections 2023-10-16T13:38:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.914+0000 7f4c3d077700 1 -- 172.21.15.5:0/2872680324 wait complete. 2023-10-16T13:38:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.916+0000 7f4c3d077700 1 Processor -- start 2023-10-16T13:38:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.916+0000 7f4c3d077700 1 -- start start 2023-10-16T13:38:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.916+0000 7f4c3d077700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 0x7f4c381533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c380cd950 0x7f4c380b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c380cede0 0x7f4c380b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c94f0 con 0x7f4c3806a840 2023-10-16T13:38:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c97d0 con 0x7f4c380cd950 2023-10-16T13:38:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c9ab0 con 0x7f4c380cede0 2023-10-16T13:38:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 0x7f4c381533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 0x7f4c381533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42800/0 (socket says 172.21.15.5:42800) 2023-10-16T13:38:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 -- 172.21.15.5:0/479531429 learned_addr learned my addr 172.21.15.5:0/479531429 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3759e700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c380cede0 0x7f4c380b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3659c700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c380cd950 0x7f4c380b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 -- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c380cede0 msgr2=0x7f4c380b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c380cede0 0x7f4c380b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 -- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c380cd950 msgr2=0x7f4c380b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c380cd950 0x7f4c380b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 -- 172.21.15.5:0/479531429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0094a0 con 0x7f4c3806a840 2023-10-16T13:38:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3759e700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c380cede0 0x7f4c380b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3659c700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c380cd950 0x7f4c380b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c36d9d700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 0x7f4c381533a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0090b0 tx=0x7f4c2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c01a900 con 0x7f4c3806a840 2023-10-16T13:38:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c01aa60 con 0x7f4c3806a840 2023-10-16T13:38:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c380c9d90 con 0x7f4c3806a840 2023-10-16T13:38:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c01add0 con 0x7f4c3806a840 2023-10-16T13:38:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.917+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c380c91a0 con 0x7f4c3806a840 2023-10-16T13:38:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.919+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c38067d20 con 0x7f4c3806a840 2023-10-16T13:38:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.919+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c2c022070 con 0x7f4c3806a840 2023-10-16T13:38:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.919+0000 7f4c1f7fe700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c2406af00 0x7f4c2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.919+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c2c08a7f0 con 0x7f4c3806a840 2023-10-16T13:38:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.920+0000 7f4c3659c700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c2406af00 0x7f4c2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.920+0000 7f4c3659c700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c2406af00 0x7f4c2406d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c381f6d20 tx=0x7f4c28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:51.924+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c2c055a60 con 0x7f4c3806a840 2023-10-16T13:38:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.129+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c3815ec00 con 0x7f4c3806a840 2023-10-16T13:38:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.129+0000 7f4c1f7fe700 1 -- 172.21.15.5:0/479531429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c2c059000 con 0x7f4c3806a840 2023-10-16T13:38:52.132 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c2406af00 msgr2=0x7f4c2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c2406af00 0x7f4c2406d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c381f6d20 tx=0x7f4c28009040 comp rx=0 tx=0).stop 2023-10-16T13:38:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 msgr2=0x7f4c381533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 0x7f4c381533a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0090b0 tx=0x7f4c2c004750 comp rx=0 tx=0).stop 2023-10-16T13:38:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 shutdown_connections 2023-10-16T13:38:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c2406af00 0x7f4c2406d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c380cede0 0x7f4c380b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c3806a840 0x7f4c381533a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 --2- 172.21.15.5:0/479531429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c380cd950 0x7f4c380b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 >> 172.21.15.5:0/479531429 conn(0x7f4c3806dae0 msgr2=0x7f4c380b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 shutdown_connections 2023-10-16T13:38:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.131+0000 7f4c3d077700 1 -- 172.21.15.5:0/479531429 wait complete. 2023-10-16T13:38:52.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.271+0000 7f5a2d4ab700 1 Processor -- start 2023-10-16T13:38:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.271+0000 7f5a2d4ab700 1 -- start start 2023-10-16T13:38:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a2d4ab700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a2815dbc0 0x7f5a2815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a2d4ab700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2815e4e0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a2d4ab700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280d28e0 con 0x7f5a280b7050 2023-10-16T13:38:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a2d4ab700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280b7560 con 0x7f5a2815dbc0 2023-10-16T13:38:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a267fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a280d3fc0 0x7f5a280d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52814/0 (socket says 172.21.15.5:52814) 2023-10-16T13:38:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a267fc700 1 -- 172.21.15.5:0/454340721 learned_addr learned my addr 172.21.15.5:0/454340721 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a26ffd700 1 --2- 172.21.15.5:0/454340721 >> v2:172.21.15.112:3300/0 conn(0x7f5a2815dbc0 0x7f5a2815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a25ffb700 1 -- 172.21.15.5:0/454340721 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055101503 0 0) 0x7f5a2815e4e0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a25ffb700 1 -- 172.21.15.5:0/454340721 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a100035b0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a26ffd700 1 -- 172.21.15.5:0/454340721 >> v1:172.21.15.112:6789/0 conn(0x7f5a280b7050 legacy=0x7f5a280d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a26ffd700 1 -- 172.21.15.5:0/454340721 >> v1:172.21.15.5:6789/0 conn(0x7f5a280d3fc0 legacy=0x7f5a280d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.272+0000 7f5a26ffd700 1 -- 172.21.15.5:0/454340721 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280b7840 con 0x7f5a2815dbc0 2023-10-16T13:38:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a26ffd700 1 --2- 172.21.15.5:0/454340721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2815dfa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009820 tx=0x7f5a1c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68d186b684820804 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a25ffb700 1 -- 172.21.15.5:0/454340721 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c005e30 con 0x7f5a2815dbc0 2023-10-16T13:38:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a25ffb700 1 -- 172.21.15.5:0/454340721 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c006030 con 0x7f5a2815dbc0 2023-10-16T13:38:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a25ffb700 1 -- 172.21.15.5:0/454340721 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0063c0 con 0x7f5a2815dbc0 2023-10-16T13:38:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/454340721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 msgr2=0x7f5a2815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/454340721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2815dfa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009820 tx=0x7f5a1c009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/454340721 shutdown_connections 2023-10-16T13:38:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/454340721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2815dfa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/454340721 >> 172.21.15.5:0/454340721 conn(0x7f5a2809cb40 msgr2=0x7f5a280d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/454340721 shutdown_connections 2023-10-16T13:38:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.273+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/454340721 wait complete. 2023-10-16T13:38:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 Processor -- start 2023-10-16T13:38:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 -- start start 2023-10-16T13:38:52.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a280b7050 0x7f5a280a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 0x7f5a28155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2809dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28156390 con 0x7f5a280d3fc0 2023-10-16T13:38:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2809e710 con 0x7f5a2815dbc0 2023-10-16T13:38:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.275+0000 7f5a2d4ab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2809e9f0 con 0x7f5a280b7050 2023-10-16T13:38:52.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 0x7f5a28155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 0x7f5a28155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42814/0 (socket says 172.21.15.5:42814) 2023-10-16T13:38:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 -- 172.21.15.5:0/261828472 learned_addr learned my addr 172.21.15.5:0/261828472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a277fe700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2809dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a26ffd700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a280b7050 0x7f5a280a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 -- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a280b7050 msgr2=0x7f5a280a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a280b7050 0x7f5a280a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 -- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 msgr2=0x7f5a2809dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2809dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 -- 172.21.15.5:0/261828472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c009430 con 0x7f5a280d3fc0 2023-10-16T13:38:52.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a267fc700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 0x7f5a28155e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c700 tx=0x7f5a1800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18005d70 con 0x7f5a280d3fc0 2023-10-16T13:38:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a180070d0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a28156c10 con 0x7f5a280d3fc0 2023-10-16T13:38:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18007460 con 0x7f5a280d3fc0 2023-10-16T13:38:52.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.276+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a281571d0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.277+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a281573f0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.278+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a180075c0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.278+0000 7f5a0f7fe700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a1406af00 0x7f5a1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.278+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a18088b60 con 0x7f5a280d3fc0 2023-10-16T13:38:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.278+0000 7f5a26ffd700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a1406af00 0x7f5a1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.279+0000 7f5a26ffd700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a1406af00 0x7f5a1406d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009b70 tx=0x7f5a1c008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.283+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a18053c20 con 0x7f5a280d3fc0 2023-10-16T13:38:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.484+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a2804ebb0 con 0x7f5a280d3fc0 2023-10-16T13:38:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.485+0000 7f5a0f7fe700 1 -- 172.21.15.5:0/261828472 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a18057240 con 0x7f5a280d3fc0 2023-10-16T13:38:52.488 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:52.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a1406af00 msgr2=0x7f5a1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a1406af00 0x7f5a1406d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009b70 tx=0x7f5a1c008070 comp rx=0 tx=0).stop 2023-10-16T13:38:52.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 msgr2=0x7f5a28155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 0x7f5a28155e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c700 tx=0x7f5a1800cac0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 shutdown_connections 2023-10-16T13:38:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a2815dbc0 0x7f5a2809dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a1406af00 0x7f5a1406d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a280b7050 0x7f5a280a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 --2- 172.21.15.5:0/261828472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a280d3fc0 0x7f5a28155e50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 >> 172.21.15.5:0/261828472 conn(0x7f5a2809cb40 msgr2=0x7f5a280d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 shutdown_connections 2023-10-16T13:38:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.487+0000 7f5a2d4ab700 1 -- 172.21.15.5:0/261828472 wait complete. 2023-10-16T13:38:52.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.625+0000 7f1190e0b700 1 Processor -- start 2023-10-16T13:38:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.626+0000 7f1190e0b700 1 -- start start 2023-10-16T13:38:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.626+0000 7f1190e0b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f118c15bb50 0x7f118c06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.626+0000 7f1190e0b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f118c0ce280 0x7f118c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.626+0000 7f1190e0b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c15bf30 con 0x7f118c06ed50 2023-10-16T13:38:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.626+0000 7f1190e0b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c06f1d0 con 0x7f118c0ce280 2023-10-16T13:38:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.626+0000 7f1190e0b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0b2d70 con 0x7f118c15bb50 2023-10-16T13:38:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f118c0ce280 0x7f118c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f1189d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f118c06ed50 0x7f118c0cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52826/0 (socket says 172.21.15.5:52826) 2023-10-16T13:38:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f1189d9b700 1 -- 172.21.15.5:0/1372294781 learned_addr learned my addr 172.21.15.5:0/1372294781 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118a59c700 1 --2- 172.21.15.5:0/1372294781 >> v2:172.21.15.112:3300/0 conn(0x7f118c15bb50 0x7f118c06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118ad9d700 1 -- 172.21.15.5:0/1372294781 >> v2:172.21.15.112:3300/0 conn(0x7f118c15bb50 msgr2=0x7f118c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118ad9d700 1 --2- 172.21.15.5:0/1372294781 >> v2:172.21.15.112:3300/0 conn(0x7f118c15bb50 0x7f118c06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118ad9d700 1 -- 172.21.15.5:0/1372294781 >> v1:172.21.15.5:6789/0 conn(0x7f118c06ed50 legacy=0x7f118c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118959a700 1 -- 172.21.15.5:0/1372294781 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550312938 0 0) 0x7f118c15bf30 con 0x7f118c06ed50 2023-10-16T13:38:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118ad9d700 1 -- 172.21.15.5:0/1372294781 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c06d500 con 0x7f118c0ce280 2023-10-16T13:38:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118ad9d700 1 --2- 172.21.15.5:0/1372294781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c06a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f118c074670 tx=0x7f117c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c6091c6feafa41 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118959a700 1 -- 172.21.15.5:0/1372294781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011830 con 0x7f118c0ce280 2023-10-16T13:38:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118959a700 1 -- 172.21.15.5:0/1372294781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c011990 con 0x7f118c0ce280 2023-10-16T13:38:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.627+0000 7f118959a700 1 -- 172.21.15.5:0/1372294781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011d20 con 0x7f118c0ce280 2023-10-16T13:38:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 -- 172.21.15.5:0/1372294781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 msgr2=0x7f118c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 --2- 172.21.15.5:0/1372294781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c06a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f118c074670 tx=0x7f117c009b20 comp rx=0 tx=0).stop 2023-10-16T13:38:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 -- 172.21.15.5:0/1372294781 shutdown_connections 2023-10-16T13:38:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 --2- 172.21.15.5:0/1372294781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c06a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 --2- 172.21.15.5:0/1372294781 >> v2:172.21.15.112:3300/0 conn(0x7f118c15bb50 0x7f118c06e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 -- 172.21.15.5:0/1372294781 >> 172.21.15.5:0/1372294781 conn(0x7f118c0cc6f0 msgr2=0x7f118c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 -- 172.21.15.5:0/1372294781 shutdown_connections 2023-10-16T13:38:52.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.628+0000 7f1190e0b700 1 -- 172.21.15.5:0/1372294781 wait complete. 2023-10-16T13:38:52.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.629+0000 7f1190e0b700 1 Processor -- start 2023-10-16T13:38:52.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.629+0000 7f1190e0b700 1 -- start start 2023-10-16T13:38:52.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1190e0b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f118c06ed50 0x7f118c1f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1190e0b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1190e0b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f118c15bb50 0x7f118c1f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1190e0b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1f8230 con 0x7f118c0ce280 2023-10-16T13:38:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1190e0b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1f2260 con 0x7f118c15bb50 2023-10-16T13:38:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1190e0b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c6e70 con 0x7f118c06ed50 2023-10-16T13:38:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42828/0 (socket says 172.21.15.5:42828) 2023-10-16T13:38:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f1189d9b700 1 -- 172.21.15.5:0/3458384188 learned_addr learned my addr 172.21.15.5:0/3458384188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f118a59c700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f118c06ed50 0x7f118c1f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.630+0000 7f118ad9d700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f118c15bb50 0x7f118c1f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1189d9b700 1 -- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f118c06ed50 msgr2=0x7f118c1f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1189d9b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f118c06ed50 0x7f118c1f7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1189d9b700 1 -- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f118c15bb50 msgr2=0x7f118c1f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1189d9b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f118c15bb50 0x7f118c1f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1189d9b700 1 -- 172.21.15.5:0/3458384188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0094a0 con 0x7f118c0ce280 2023-10-16T13:38:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1189d9b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c0cbde0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f11800011e0 tx=0x7f118000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180004c80 con 0x7f118c0ce280 2023-10-16T13:38:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180004e00 con 0x7f118c0ce280 2023-10-16T13:38:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0cc320 con 0x7f118c0ce280 2023-10-16T13:38:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180007310 con 0x7f118c0ce280 2023-10-16T13:38:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.631+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c1f8700 con 0x7f118c0ce280 2023-10-16T13:38:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.632+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c0b5100 con 0x7f118c0ce280 2023-10-16T13:38:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.632+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1180007470 con 0x7f118c0ce280 2023-10-16T13:38:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.633+0000 7f117affd700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f116c06af00 0x7f116c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.633+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11800891d0 con 0x7f118c0ce280 2023-10-16T13:38:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.633+0000 7f118a59c700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f116c06af00 0x7f116c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.633+0000 7f118a59c700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f116c06af00 0x7f116c06d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f118c1fb290 tx=0x7f118400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.638+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1180054280 con 0x7f118c0ce280 2023-10-16T13:38:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.839+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f118c0c6fe0 con 0x7f118c0ce280 2023-10-16T13:38:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.840+0000 7f117affd700 1 -- 172.21.15.5:0/3458384188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f11800578a0 con 0x7f118c0ce280 2023-10-16T13:38:52.843 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:52.843 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f116c06af00 msgr2=0x7f116c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f116c06af00 0x7f116c06d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f118c1fb290 tx=0x7f118400b040 comp rx=0 tx=0).stop 2023-10-16T13:38:52.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 msgr2=0x7f118c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c0cbde0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f11800011e0 tx=0x7f118000ca30 comp rx=0 tx=0).stop 2023-10-16T13:38:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 shutdown_connections 2023-10-16T13:38:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f118c15bb50 0x7f118c1f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f116c06af00 0x7f116c06d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f118c06ed50 0x7f118c1f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 --2- 172.21.15.5:0/3458384188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f118c0ce280 0x7f118c0cbde0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 >> 172.21.15.5:0/3458384188 conn(0x7f118c0cc6f0 msgr2=0x7f118c0cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 shutdown_connections 2023-10-16T13:38:52.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.842+0000 7f1190e0b700 1 -- 172.21.15.5:0/3458384188 wait complete. 2023-10-16T13:38:52.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:52.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.984+0000 7f331edee700 1 Processor -- start 2023-10-16T13:38:52.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.984+0000 7f331edee700 1 -- start start 2023-10-16T13:38:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331edee700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f331806af50 0x7f33180cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331edee700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33180b2d60 con 0x7f331815e2f0 2023-10-16T13:38:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331edee700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33180cdd30 con 0x7f33180cd950 2023-10-16T13:38:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331edee700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33181619a0 con 0x7f331806af50 2023-10-16T13:38:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331d38b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f331806af50 0x7f33180cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331d38b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f331806af50 0x7f33180cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42838/0 (socket says 172.21.15.5:42838) 2023-10-16T13:38:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331d38b700 1 -- 172.21.15.5:0/3733474665 learned_addr learned my addr 172.21.15.5:0/3733474665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331d38b700 1 -- 172.21.15.5:0/3733474665 >> v1:172.21.15.112:6789/0 conn(0x7f33180cd950 legacy=0x7f331815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331d38b700 1 -- 172.21.15.5:0/3733474665 >> v1:172.21.15.5:6789/0 conn(0x7f331815e2f0 legacy=0x7f331806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f331d38b700 1 -- 172.21.15.5:0/3733474665 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331815e920 con 0x7f331806af50 2023-10-16T13:38:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.985+0000 7f33177fe700 1 -- 172.21.15.5:0/3733474665 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395949803 0 0) 0x7f33180b2d60 con 0x7f331815e2f0 2023-10-16T13:38:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331d38b700 1 --2- 172.21.15.5:0/3733474665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331806af50 0x7f33180cede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3310009e50 tx=0x7f331000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c827b4002d4430 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f33177fe700 1 -- 172.21.15.5:0/3733474665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331000e070 con 0x7f331806af50 2023-10-16T13:38:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f33177fe700 1 -- 172.21.15.5:0/3733474665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310003a20 con 0x7f331806af50 2023-10-16T13:38:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f33177fe700 1 -- 172.21.15.5:0/3733474665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310003dd0 con 0x7f331806af50 2023-10-16T13:38:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 -- 172.21.15.5:0/3733474665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331806af50 msgr2=0x7f33180cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 --2- 172.21.15.5:0/3733474665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331806af50 0x7f33180cede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3310009e50 tx=0x7f331000b330 comp rx=0 tx=0).stop 2023-10-16T13:38:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 -- 172.21.15.5:0/3733474665 shutdown_connections 2023-10-16T13:38:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 --2- 172.21.15.5:0/3733474665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331806af50 0x7f33180cede0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 -- 172.21.15.5:0/3733474665 >> 172.21.15.5:0/3733474665 conn(0x7f331806dae0 msgr2=0x7f331806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 -- 172.21.15.5:0/3733474665 shutdown_connections 2023-10-16T13:38:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.986+0000 7f331edee700 1 -- 172.21.15.5:0/3733474665 wait complete. 2023-10-16T13:38:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.988+0000 7f331edee700 1 Processor -- start 2023-10-16T13:38:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.988+0000 7f331edee700 1 -- start start 2023-10-16T13:38:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331edee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331806af50 0x7f3318153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331edee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 0x7f3318157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331edee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815e2f0 0x7f331815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331edee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318153c40 con 0x7f33180cd950 2023-10-16T13:38:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331edee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33181f71c0 con 0x7f331806af50 2023-10-16T13:38:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331edee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3318158880 con 0x7f331815e2f0 2023-10-16T13:38:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f3317fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 0x7f3318157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f3317fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 0x7f3318157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42842/0 (socket says 172.21.15.5:42842) 2023-10-16T13:38:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f3317fff700 1 -- 172.21.15.5:0/1809599005 learned_addr learned my addr 172.21.15.5:0/1809599005 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331d38b700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815e2f0 0x7f331815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.989+0000 7f331cb8a700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331806af50 0x7f3318153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f3317fff700 1 -- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815e2f0 msgr2=0x7f331815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f3317fff700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815e2f0 0x7f331815a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f3317fff700 1 -- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331806af50 msgr2=0x7f3318153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f3317fff700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331806af50 0x7f3318153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f3317fff700 1 -- 172.21.15.5:0/1809599005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3310009b30 con 0x7f33180cd950 2023-10-16T13:38:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f3317fff700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 0x7f3318157fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f330400c500 tx=0x7f330400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040054e0 con 0x7f33180cd950 2023-10-16T13:38:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400ce90 con 0x7f33180cd950 2023-10-16T13:38:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3318158b60 con 0x7f33180cd950 2023-10-16T13:38:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040038c0 con 0x7f33180cd950 2023-10-16T13:38:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.990+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33181f6e50 con 0x7f33180cd950 2023-10-16T13:38:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.991+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3318067d20 con 0x7f33180cd950 2023-10-16T13:38:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.991+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3304003a20 con 0x7f33180cd950 2023-10-16T13:38:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.992+0000 7f33157fa700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32fc06af00 0x7f32fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.992+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33040885a0 con 0x7f33180cd950 2023-10-16T13:38:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.992+0000 7f331cb8a700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32fc06af00 0x7f32fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.993+0000 7f331cb8a700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32fc06af00 0x7f32fc06d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33181f6a30 tx=0x7f330c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:52.997+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33040535d0 con 0x7f33180cd950 2023-10-16T13:38:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.196+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33181f7300 con 0x7f33180cd950 2023-10-16T13:38:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.196+0000 7f33157fa700 1 -- 172.21.15.5:0/1809599005 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3304056bf0 con 0x7f33180cd950 2023-10-16T13:38:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32fc06af00 msgr2=0x7f32fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32fc06af00 0x7f32fc06d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33181f6a30 tx=0x7f330c007ec0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 msgr2=0x7f3318157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 0x7f3318157fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f330400c500 tx=0x7f330400c810 comp rx=0 tx=0).stop 2023-10-16T13:38:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 shutdown_connections 2023-10-16T13:38:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32fc06af00 0x7f32fc06d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815e2f0 0x7f331815a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331806af50 0x7f3318153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 --2- 172.21.15.5:0/1809599005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cd950 0x7f3318157fc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 >> 172.21.15.5:0/1809599005 conn(0x7f331806dae0 msgr2=0x7f331806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 shutdown_connections 2023-10-16T13:38:53.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.198+0000 7f331edee700 1 -- 172.21.15.5:0/1809599005 wait complete. 2023-10-16T13:38:53.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.340+0000 7f20a141c700 1 Processor -- start 2023-10-16T13:38:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.340+0000 7f20a141c700 1 -- start start 2023-10-16T13:38:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f20a141c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 0x7f209c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f20a141c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c15e4e0 con 0x7f209c15dbc0 2023-10-16T13:38:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f20a141c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c0d28e0 con 0x7f209c0b7050 2023-10-16T13:38:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f20a141c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0b7560 con 0x7f209c0d3fc0 2023-10-16T13:38:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f209affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f209c15dbc0 0x7f209c0d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52852/0 (socket says 172.21.15.5:52852) 2023-10-16T13:38:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f209affd700 1 -- 172.21.15.5:0/3308511872 learned_addr learned my addr 172.21.15.5:0/3308511872 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f209a7fc700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 0x7f209c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098414153 0 0) 0x7f209c15e4e0 con 0x7f209c15dbc0 2023-10-16T13:38:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.341+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20840035b0 con 0x7f209c15dbc0 2023-10-16T13:38:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2444598535 0 0) 0x7f20840035b0 con 0x7f209c15dbc0 2023-10-16T13:38:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 msgr2=0x7f209c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 0x7f209c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 >> v1:172.21.15.112:6789/0 conn(0x7f209c0b7050 legacy=0x7f209c0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0b7840 con 0x7f209c15dbc0 2023-10-16T13:38:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f20900017f0 con 0x7f209c15dbc0 2023-10-16T13:38:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 >> v1:172.21.15.5:6789/0 conn(0x7f209c15dbc0 legacy=0x7f209c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084003a30 0x7f2084003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 0x7f2084004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084004d90 0x7f2084005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0b7560 con 0x7f2084004d90 2023-10-16T13:38:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208400bac0 con 0x7f2084003a30 2023-10-16T13:38:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208400bc80 con 0x7f209c0d3fc0 2023-10-16T13:38:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209affd700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084003a30 0x7f2084003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209a7fc700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 0x7f2084004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084004d90 0x7f2084005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 -- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 msgr2=0x7f2084004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0d3fc0 0x7f2084004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 -- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084003a30 msgr2=0x7f2084003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084003a30 0x7f2084003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 -- 172.21.15.5:0/3308511872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840035b0 con 0x7f2084004d90 2023-10-16T13:38:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f209b7fe700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084004d90 0x7f2084005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ca810 tx=0x7f2084005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1220cd3a06ab285 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.342+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094001db0 con 0x7f2084004d90 2023-10-16T13:38:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209400cc70 con 0x7f2084004d90 2023-10-16T13:38:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f2099ffb700 1 -- 172.21.15.5:0/3308511872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094003a00 con 0x7f2084004d90 2023-10-16T13:38:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f20a141c700 1 -- 172.21.15.5:0/3308511872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084004d90 msgr2=0x7f2084005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f20a141c700 1 --2- 172.21.15.5:0/3308511872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084004d90 0x7f2084005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ca810 tx=0x7f2084005880 comp rx=0 tx=0).stop 2023-10-16T13:38:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f209b7fe700 1 -- 172.21.15.5:0/3308511872 reap_dead start 2023-10-16T13:38:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f20a141c700 1 -- 172.21.15.5:0/3308511872 shutdown_connections 2023-10-16T13:38:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f20a141c700 1 -- 172.21.15.5:0/3308511872 >> 172.21.15.5:0/3308511872 conn(0x7f209c09cb40 msgr2=0x7f209c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f20a141c700 1 -- 172.21.15.5:0/3308511872 shutdown_connections 2023-10-16T13:38:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.343+0000 7f20a141c700 1 -- 172.21.15.5:0/3308511872 wait complete. 2023-10-16T13:38:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.344+0000 7f20a141c700 1 Processor -- start 2023-10-16T13:38:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 -- start start 2023-10-16T13:38:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c14f090 0x7f209c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 0x7f209c0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0cbb50 0x7f209c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0cc540 con 0x7f209c14f470 2023-10-16T13:38:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c1f66b0 con 0x7f209c14f090 2023-10-16T13:38:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f20a141c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c1529e0 con 0x7f209c0cbb50 2023-10-16T13:38:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f209a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 0x7f209c0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f209a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 0x7f209c0b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42862/0 (socket says 172.21.15.5:42862) 2023-10-16T13:38:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f209a7fc700 1 -- 172.21.15.5:0/2016417089 learned_addr learned my addr 172.21.15.5:0/2016417089 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f209b7fe700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0cbb50 0x7f209c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.345+0000 7f209affd700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c14f090 0x7f209c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f209a7fc700 1 -- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0cbb50 msgr2=0x7f209c0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f209a7fc700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0cbb50 0x7f209c0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f209a7fc700 1 -- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c14f090 msgr2=0x7f209c1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f209a7fc700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c14f090 0x7f209c1524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f209a7fc700 1 -- 172.21.15.5:0/2016417089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0b50f0 con 0x7f209c14f470 2023-10-16T13:38:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f209a7fc700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 0x7f209c0b4bb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f208c011aa0 tx=0x7f208c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c011ed0 con 0x7f209c14f470 2023-10-16T13:38:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c00f940 con 0x7f209c14f470 2023-10-16T13:38:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c1f6900 con 0x7f209c14f470 2023-10-16T13:38:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c00fcf0 con 0x7f209c14f470 2023-10-16T13:38:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.346+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c1f6ec0 con 0x7f209c14f470 2023-10-16T13:38:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.347+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c0b6790 con 0x7f209c14f470 2023-10-16T13:38:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.348+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f208c014440 con 0x7f209c14f470 2023-10-16T13:38:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.348+0000 7f20837fe700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f208806af00 0x7f208806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.348+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f208c089bf0 con 0x7f209c14f470 2023-10-16T13:38:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.348+0000 7f209affd700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f208806af00 0x7f208806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.349+0000 7f209affd700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f208806af00 0x7f208806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2090000fd0 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.353+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f208c054d60 con 0x7f209c14f470 2023-10-16T13:38:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.551+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f209c04ebb0 con 0x7f209c14f470 2023-10-16T13:38:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.551+0000 7f20837fe700 1 -- 172.21.15.5:0/2016417089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f208c058380 con 0x7f209c14f470 2023-10-16T13:38:53.554 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f208806af00 msgr2=0x7f208806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f208806af00 0x7f208806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2090000fd0 tx=0x7f2090009040 comp rx=0 tx=0).stop 2023-10-16T13:38:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 msgr2=0x7f209c0b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 0x7f209c0b4bb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f208c011aa0 tx=0x7f208c011db0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 shutdown_connections 2023-10-16T13:38:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f208806af00 0x7f208806d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f209c0cbb50 0x7f209c0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c14f090 0x7f209c1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 --2- 172.21.15.5:0/2016417089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c14f470 0x7f209c0b4bb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 >> 172.21.15.5:0/2016417089 conn(0x7f209c09cb40 msgr2=0x7f209c0d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:53.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 shutdown_connections 2023-10-16T13:38:53.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.553+0000 7f20a141c700 1 -- 172.21.15.5:0/2016417089 wait complete. 2023-10-16T13:38:53.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.694+0000 7f016f590700 1 Processor -- start 2023-10-16T13:38:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.694+0000 7f016f590700 1 -- start start 2023-10-16T13:38:53.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016f590700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01680cd950 0x7f016815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016f590700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cede0 0x7f016815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016f590700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680cf260 con 0x7f016806a840 2023-10-16T13:38:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016f590700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01681619a0 con 0x7f01680cd950 2023-10-16T13:38:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016f590700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680b2d60 con 0x7f01680cede0 2023-10-16T13:38:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016d32c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01680cd950 0x7f016815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016d32c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01680cd950 0x7f016815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42868/0 (socket says 172.21.15.5:42868) 2023-10-16T13:38:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016d32c700 1 -- 172.21.15.5:0/4209858918 learned_addr learned my addr 172.21.15.5:0/4209858918 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.695+0000 7f016cb2b700 1 --2- 172.21.15.5:0/4209858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cede0 0x7f016815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016d32c700 1 -- 172.21.15.5:0/4209858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cede0 msgr2=0x7f016815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016d32c700 1 --2- 172.21.15.5:0/4209858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cede0 0x7f016815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016d32c700 1 -- 172.21.15.5:0/4209858918 >> v1:172.21.15.112:6789/0 conn(0x7f016806a840 legacy=0x7f0168161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016d32c700 1 -- 172.21.15.5:0/4209858918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680cdd30 con 0x7f01680cd950 2023-10-16T13:38:53.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016d32c700 1 --2- 172.21.15.5:0/4209858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680cd950 0x7f016815e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01580098f0 tx=0x7f0158009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed7998bbde7750 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f015ffff700 1 -- 172.21.15.5:0/4209858918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158011830 con 0x7f01680cd950 2023-10-16T13:38:53.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f015ffff700 1 -- 172.21.15.5:0/4209858918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158011990 con 0x7f01680cd950 2023-10-16T13:38:53.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f015ffff700 1 -- 172.21.15.5:0/4209858918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158011d20 con 0x7f01680cd950 2023-10-16T13:38:53.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016f590700 1 -- 172.21.15.5:0/4209858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680cd950 msgr2=0x7f016815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016f590700 1 --2- 172.21.15.5:0/4209858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680cd950 0x7f016815e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01580098f0 tx=0x7f0158009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:53.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016f590700 1 -- 172.21.15.5:0/4209858918 shutdown_connections 2023-10-16T13:38:53.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016f590700 1 --2- 172.21.15.5:0/4209858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680cd950 0x7f016815e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016f590700 1 --2- 172.21.15.5:0/4209858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cede0 0x7f016815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.696+0000 7f016f590700 1 -- 172.21.15.5:0/4209858918 >> 172.21.15.5:0/4209858918 conn(0x7f016806dae0 msgr2=0x7f016806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:53.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.697+0000 7f016f590700 1 -- 172.21.15.5:0/4209858918 shutdown_connections 2023-10-16T13:38:53.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.697+0000 7f016f590700 1 -- 172.21.15.5:0/4209858918 wait complete. 2023-10-16T13:38:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.698+0000 7f016f590700 1 Processor -- start 2023-10-16T13:38:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.698+0000 7f016f590700 1 -- start start 2023-10-16T13:38:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016f590700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 0x7f01680c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016f590700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cd950 0x7f01680aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016f590700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01680cede0 0x7f01680aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016f590700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01681f4150 con 0x7f016806a840 2023-10-16T13:38:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016f590700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01681f3ad0 con 0x7f01680cede0 2023-10-16T13:38:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016f590700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680c8f30 con 0x7f01680cd950 2023-10-16T13:38:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 0x7f01680c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 0x7f01680c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42874/0 (socket says 172.21.15.5:42874) 2023-10-16T13:38:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 -- 172.21.15.5:0/2332556774 learned_addr learned my addr 172.21.15.5:0/2332556774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016cb2b700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cd950 0x7f01680aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016db2d700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01680cede0 0x7f01680aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 -- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cd950 msgr2=0x7f01680aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cd950 0x7f01680aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 -- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01680cede0 msgr2=0x7f01680aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01680cede0 0x7f01680aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 -- 172.21.15.5:0/2332556774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009550 con 0x7f016806a840 2023-10-16T13:38:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.699+0000 7f016d32c700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 0x7f01680c8270 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0158000c00 tx=0x7f0158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.700+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158004400 con 0x7f016806a840 2023-10-16T13:38:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.700+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015801f070 con 0x7f016806a840 2023-10-16T13:38:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.700+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680c8c50 con 0x7f016806a840 2023-10-16T13:38:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.700+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01580038e0 con 0x7f016806a840 2023-10-16T13:38:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.700+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01681f3760 con 0x7f016806a840 2023-10-16T13:38:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.701+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0168067d20 con 0x7f016806a840 2023-10-16T13:38:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.702+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0158021030 con 0x7f016806a840 2023-10-16T13:38:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.702+0000 7f015dffb700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f014c06af00 0x7f014c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.702+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f015808a8d0 con 0x7f016806a840 2023-10-16T13:38:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.702+0000 7f016cb2b700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f014c06af00 0x7f014c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.703+0000 7f016cb2b700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f014c06af00 0x7f014c06d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0164009b20 tx=0x7f01640091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.707+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0158055ab0 con 0x7f016806a840 2023-10-16T13:38:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.906+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01680b2100 con 0x7f016806a840 2023-10-16T13:38:53.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.907+0000 7f015dffb700 1 -- 172.21.15.5:0/2332556774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0158015020 con 0x7f016806a840 2023-10-16T13:38:53.910 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f014c06af00 msgr2=0x7f014c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f014c06af00 0x7f014c06d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0164009b20 tx=0x7f01640091c0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 msgr2=0x7f01680c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 0x7f01680c8270 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0158000c00 tx=0x7f0158004750 comp rx=0 tx=0).stop 2023-10-16T13:38:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 shutdown_connections 2023-10-16T13:38:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01680cede0 0x7f01680aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016806a840 0x7f01680c8270 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f014c06af00 0x7f014c06d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 --2- 172.21.15.5:0/2332556774 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01680cd950 0x7f01680aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 >> 172.21.15.5:0/2332556774 conn(0x7f016806dae0 msgr2=0x7f01680cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 shutdown_connections 2023-10-16T13:38:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:53.909+0000 7f016f590700 1 -- 172.21.15.5:0/2332556774 wait complete. 2023-10-16T13:38:54.005 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-10-16T13:38:54.006 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:38:54.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.131+0000 7f943e736700 1 Processor -- start 2023-10-16T13:38:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.131+0000 7f943e736700 1 -- start start 2023-10-16T13:38:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f943e736700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94380728e0 0x7f943806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f943e736700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9438070040 con 0x7f94380b2980 2023-10-16T13:38:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f943e736700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94380afce0 con 0x7f943815a8e0 2023-10-16T13:38:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f943e736700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380d0420 con 0x7f94380728e0 2023-10-16T13:38:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f94377fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94380b2980 0x7f943815e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52888/0 (socket says 172.21.15.5:52888) 2023-10-16T13:38:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f94377fe700 1 -- 172.21.15.5:0/1019224312 learned_addr learned my addr 172.21.15.5:0/1019224312 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592076006 0 0) 0x7f9438070040 con 0x7f94380b2980 2023-10-16T13:38:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f943ccd3700 1 --2- 172.21.15.5:0/1019224312 >> v2:172.21.15.112:3300/0 conn(0x7f94380728e0 0x7f943806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94200057c0 con 0x7f94380b2980 2023-10-16T13:38:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509217179 0 0) 0x7f94200057c0 con 0x7f94380b2980 2023-10-16T13:38:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 >> v2:172.21.15.112:3300/0 conn(0x7f94380728e0 msgr2=0x7f943806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 --2- 172.21.15.5:0/1019224312 >> v2:172.21.15.112:3300/0 conn(0x7f94380728e0 0x7f943806fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 >> v1:172.21.15.112:6789/0 conn(0x7f943815a8e0 legacy=0x7f94380b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438071e00 con 0x7f94380b2980 2023-10-16T13:38:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f942c001670 con 0x7f94380b2980 2023-10-16T13:38:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 >> v1:172.21.15.5:6789/0 conn(0x7f94380b2980 legacy=0x7f943815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9420005c10 0x7f9420006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.132+0000 7f9436ffd700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420006a60 0x7f9420006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9420007420 0x7f942000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380d0420 con 0x7f9420007420 2023-10-16T13:38:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942000e2c0 con 0x7f9420006a60 2023-10-16T13:38:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942000e480 con 0x7f9420005c10 2023-10-16T13:38:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9420007420 0x7f942000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9437fff700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9420005c10 0x7f9420006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f94377fe700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420006a60 0x7f9420006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 -- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9420005c10 msgr2=0x7f9420006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9420005c10 0x7f9420006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 -- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420006a60 msgr2=0x7f9420006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420006a60 0x7f9420006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 -- 172.21.15.5:0/1019224312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94200057c0 con 0x7f9420007420 2023-10-16T13:38:54.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9437fff700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9420005c10 0x7f9420006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:54.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 -- 172.21.15.5:0/1019224312 reap_dead start 2023-10-16T13:38:54.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f943ccd3700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9420007420 0x7f942000dc20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9430009f90 tx=0x7f9420007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf6afb2db3a31c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430003a20 con 0x7f9420007420 2023-10-16T13:38:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000f040 con 0x7f9420007420 2023-10-16T13:38:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.133+0000 7f9436ffd700 1 -- 172.21.15.5:0/1019224312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430003de0 con 0x7f9420007420 2023-10-16T13:38:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 -- 172.21.15.5:0/1019224312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9420007420 msgr2=0x7f942000dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9420007420 0x7f942000dc20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9430009f90 tx=0x7f9420007a90 comp rx=0 tx=0).stop 2023-10-16T13:38:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 -- 172.21.15.5:0/1019224312 shutdown_connections 2023-10-16T13:38:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 --2- 172.21.15.5:0/1019224312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9420007420 0x7f942000dc20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 -- 172.21.15.5:0/1019224312 >> 172.21.15.5:0/1019224312 conn(0x7f94380cd270 msgr2=0x7f94380cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 -- 172.21.15.5:0/1019224312 shutdown_connections 2023-10-16T13:38:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.134+0000 7f943e736700 1 -- 172.21.15.5:0/1019224312 wait complete. 2023-10-16T13:38:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.135+0000 7f943e736700 1 Processor -- start 2023-10-16T13:38:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.135+0000 7f943e736700 1 -- start start 2023-10-16T13:38:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943e736700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420007420 0x7f94380c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943e736700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 0x7f94380c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943e736700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94381f2710 0x7f94381f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943e736700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380ca460 con 0x7f943815d970 2023-10-16T13:38:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943e736700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380b43e0 con 0x7f9420007420 2023-10-16T13:38:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943e736700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94381f3f10 con 0x7f94381f2710 2023-10-16T13:38:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 0x7f94380c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 0x7f94380c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42896/0 (socket says 172.21.15.5:42896) 2023-10-16T13:38:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 -- 172.21.15.5:0/2938903992 learned_addr learned my addr 172.21.15.5:0/2938903992 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f943ccd3700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94381f2710 0x7f94381f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f9437fff700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420007420 0x7f94380c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 -- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94381f2710 msgr2=0x7f94381f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94381f2710 0x7f94381f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 -- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420007420 msgr2=0x7f94380c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420007420 0x7f94380c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 -- 172.21.15.5:0/2938903992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94381f3670 con 0x7f943815d970 2023-10-16T13:38:54.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.136+0000 7f94377fe700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 0x7f94380c9f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f942c007290 tx=0x7f942c0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.137+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00f5e0 con 0x7f943815d970 2023-10-16T13:38:54.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.137+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00f740 con 0x7f943815d970 2023-10-16T13:38:54.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.137+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94381f3950 con 0x7f943815d970 2023-10-16T13:38:54.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.137+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00faf0 con 0x7f943815d970 2023-10-16T13:38:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.137+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94380c8460 con 0x7f943815d970 2023-10-16T13:38:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.138+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94380b41b0 con 0x7f943815d970 2023-10-16T13:38:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.138+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f942c00fc50 con 0x7f943815d970 2023-10-16T13:38:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.139+0000 7f9434ff9700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f942406af00 0x7f942406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.139+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f942c0894b0 con 0x7f943815d970 2023-10-16T13:38:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.139+0000 7f9437fff700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f942406af00 0x7f942406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.139+0000 7f9437fff700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f942406af00 0x7f942406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9428007fd0 tx=0x7f9428009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.143+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94380b41b0 con 0x7f943815d970 2023-10-16T13:38:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.345+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94380b41b0 con 0x7f943815d970 2023-10-16T13:38:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.347+0000 7f9434ff9700 1 -- 172.21.15.5:0/2938903992 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f94380b41b0 con 0x7f943815d970 2023-10-16T13:38:54.349 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:54.350 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f942406af00 msgr2=0x7f942406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f942406af00 0x7f942406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9428007fd0 tx=0x7f9428009040 comp rx=0 tx=0).stop 2023-10-16T13:38:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 msgr2=0x7f94380c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 0x7f94380c9f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f942c007290 tx=0x7f942c0075a0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 shutdown_connections 2023-10-16T13:38:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f942406af00 0x7f942406d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94381f2710 0x7f94381f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9420007420 0x7f94380c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 --2- 172.21.15.5:0/2938903992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f943815d970 0x7f94380c9f20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 >> 172.21.15.5:0/2938903992 conn(0x7f94380cd270 msgr2=0x7f94380cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 shutdown_connections 2023-10-16T13:38:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.349+0000 7f943e736700 1 -- 172.21.15.5:0/2938903992 wait complete. 2023-10-16T13:38:54.365 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:54.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.492+0000 7f4c0ed87700 1 Processor -- start 2023-10-16T13:38:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.492+0000 7f4c0ed87700 1 -- start start 2023-10-16T13:38:54.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0ed87700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c0815e2f0 0x7f4c080cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0ed87700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0806a840 0x7f4c0806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0ed87700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c080b2d60 con 0x7f4c080cd950 2023-10-16T13:38:54.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0ed87700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c081619a0 con 0x7f4c0815e2f0 2023-10-16T13:38:54.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0ed87700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0806b1f0 con 0x7f4c0806a840 2023-10-16T13:38:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0cb23700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4c080cd950 0x7f4c0815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52906/0 (socket says 172.21.15.5:52906) 2023-10-16T13:38:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0cb23700 1 -- 172.21.15.5:0/2851487662 learned_addr learned my addr 172.21.15.5:0/2851487662 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c07fff700 1 --2- 172.21.15.5:0/2851487662 >> v2:172.21.15.112:3300/0 conn(0x7f4c0815e2f0 0x7f4c080cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.493+0000 7f4c0d324700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0806a840 0x7f4c0806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c077fe700 1 -- 172.21.15.5:0/2851487662 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187925711 0 0) 0x7f4c080b2d60 con 0x7f4c080cd950 2023-10-16T13:38:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c077fe700 1 -- 172.21.15.5:0/2851487662 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80035b0 con 0x7f4c080cd950 2023-10-16T13:38:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c077fe700 1 -- 172.21.15.5:0/2851487662 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939065928 0 0) 0x7f4bf80035b0 con 0x7f4c080cd950 2023-10-16T13:38:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c07fff700 1 -- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0806a840 msgr2=0x7f4c0806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c07fff700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0806a840 0x7f4c0806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c07fff700 1 -- 172.21.15.5:0/2851487662 >> v1:172.21.15.5:6789/0 conn(0x7f4c080cd950 legacy=0x7f4c0815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c07fff700 1 -- 172.21.15.5:0/2851487662 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c080cdd30 con 0x7f4c0815e2f0 2023-10-16T13:38:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c0d324700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0806a840 0x7f4c0806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c07fff700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0815e2f0 0x7f4c080cede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c08161ae0 tx=0x7f4bf4009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4fa357ed9b74122 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c077fe700 1 -- 172.21.15.5:0/2851487662 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc001670 con 0x7f4c0815e2f0 2023-10-16T13:38:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c077fe700 1 -- 172.21.15.5:0/2851487662 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf4005c30 con 0x7f4c0815e2f0 2023-10-16T13:38:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.494+0000 7f4c077fe700 1 -- 172.21.15.5:0/2851487662 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4004030 con 0x7f4c0815e2f0 2023-10-16T13:38:54.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 -- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0815e2f0 msgr2=0x7f4c080cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0815e2f0 0x7f4c080cede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c08161ae0 tx=0x7f4bf4009b00 comp rx=0 tx=0).stop 2023-10-16T13:38:54.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 -- 172.21.15.5:0/2851487662 shutdown_connections 2023-10-16T13:38:54.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0806a840 0x7f4c0806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/2851487662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0815e2f0 0x7f4c080cede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 -- 172.21.15.5:0/2851487662 >> 172.21.15.5:0/2851487662 conn(0x7f4c0806dae0 msgr2=0x7f4c0806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 -- 172.21.15.5:0/2851487662 shutdown_connections 2023-10-16T13:38:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.495+0000 7f4c0ed87700 1 -- 172.21.15.5:0/2851487662 wait complete. 2023-10-16T13:38:54.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.496+0000 7f4c0ed87700 1 Processor -- start 2023-10-16T13:38:54.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.496+0000 7f4c0ed87700 1 -- start start 2023-10-16T13:38:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0ed87700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 0x7f4c080ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0ed87700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c080cd950 0x7f4c080cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0ed87700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0815e2f0 0x7f4c080cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0ed87700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080ae990 con 0x7f4c0806a840 2023-10-16T13:38:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0ed87700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080aec70 con 0x7f4c080cd950 2023-10-16T13:38:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0ed87700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080aef50 con 0x7f4c0815e2f0 2023-10-16T13:38:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 0x7f4c080ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 0x7f4c080ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42908/0 (socket says 172.21.15.5:42908) 2023-10-16T13:38:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 -- 172.21.15.5:0/3298168587 learned_addr learned my addr 172.21.15.5:0/3298168587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c07fff700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c080cd950 0x7f4c080cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0d324700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0815e2f0 0x7f4c080cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 -- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0815e2f0 msgr2=0x7f4c080cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0815e2f0 0x7f4c080cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 -- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c080cd950 msgr2=0x7f4c080cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c080cd950 0x7f4c080cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0cb23700 1 -- 172.21.15.5:0/3298168587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009a70 con 0x7f4c0806a840 2023-10-16T13:38:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.497+0000 7f4c0d324700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0815e2f0 0x7f4c080cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.498+0000 7f4c0cb23700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 0x7f4c080ae320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c780 tx=0x7f4bfc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.498+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc004c80 con 0x7f4c0806a840 2023-10-16T13:38:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.498+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc004de0 con 0x7f4c0806a840 2023-10-16T13:38:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.498+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf4009430 con 0x7f4c0806a840 2023-10-16T13:38:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.498+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0072f0 con 0x7f4c0806a840 2023-10-16T13:38:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.498+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c080af510 con 0x7f4c0806a840 2023-10-16T13:38:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.499+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c080cd0d0 con 0x7f4c0806a840 2023-10-16T13:38:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.500+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4bfc007450 con 0x7f4c0806a840 2023-10-16T13:38:54.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.500+0000 7f4c057fa700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bec06af00 0x7f4bec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.500+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bfc088b20 con 0x7f4c0806a840 2023-10-16T13:38:54.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.501+0000 7f4c07fff700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bec06af00 0x7f4bec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.501+0000 7f4c07fff700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bec06af00 0x7f4bec06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4015040 tx=0x7f4bf4008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.504+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bfc053c60 con 0x7f4c0806a840 2023-10-16T13:38:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.708+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c08067d20 con 0x7f4c0806a840 2023-10-16T13:38:54.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.710+0000 7f4c057fa700 1 -- 172.21.15.5:0/3298168587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bfc018020 con 0x7f4c0806a840 2023-10-16T13:38:54.713 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bec06af00 msgr2=0x7f4bec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bec06af00 0x7f4bec06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4015040 tx=0x7f4bf4008070 comp rx=0 tx=0).stop 2023-10-16T13:38:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 msgr2=0x7f4c080ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 0x7f4c080ae320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c780 tx=0x7f4bfc00cb40 comp rx=0 tx=0).stop 2023-10-16T13:38:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 shutdown_connections 2023-10-16T13:38:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bec06af00 0x7f4bec06d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c0815e2f0 0x7f4c080cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0806a840 0x7f4c080ae320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 --2- 172.21.15.5:0/3298168587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c080cd950 0x7f4c080cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.712+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 >> 172.21.15.5:0/3298168587 conn(0x7f4c0806dae0 msgr2=0x7f4c08160390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.713+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 shutdown_connections 2023-10-16T13:38:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.713+0000 7f4c0ed87700 1 -- 172.21.15.5:0/3298168587 wait complete. 2023-10-16T13:38:54.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.853+0000 7f2dff125700 1 Processor -- start 2023-10-16T13:38:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.853+0000 7f2dff125700 1 -- start start 2023-10-16T13:38:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dff125700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2df815bb50 0x7f2df806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dff125700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df806ed50 0x7f2df80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dff125700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2df80ce0b0 0x7f2df815f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dff125700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df806f1d0 con 0x7f2df815bb50 2023-10-16T13:38:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dff125700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df80ce540 con 0x7f2df80ce0b0 2023-10-16T13:38:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dff125700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80b2d70 con 0x7f2df806ed50 2023-10-16T13:38:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2df815bb50 0x7f2df806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2df815bb50 0x7f2df806e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42916/0 (socket says 172.21.15.5:42916) 2023-10-16T13:38:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 -- 172.21.15.5:0/2762263929 learned_addr learned my addr 172.21.15.5:0/2762263929 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfd6c2700 1 --2- 172.21.15.5:0/2762263929 >> v2:172.21.15.112:3300/0 conn(0x7f2df80ce0b0 0x7f2df815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2df7fff700 1 --2- 172.21.15.5:0/2762263929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df806ed50 0x7f2df80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 -- 172.21.15.5:0/2762263929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df806ed50 msgr2=0x7f2df80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 --2- 172.21.15.5:0/2762263929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df806ed50 0x7f2df80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 -- 172.21.15.5:0/2762263929 >> v2:172.21.15.112:3300/0 conn(0x7f2df80ce0b0 msgr2=0x7f2df815f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:54.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 --2- 172.21.15.5:0/2762263929 >> v2:172.21.15.112:3300/0 conn(0x7f2df80ce0b0 0x7f2df815f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.854+0000 7f2dfcec1700 1 -- 172.21.15.5:0/2762263929 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df815bf30 con 0x7f2df815bb50 2023-10-16T13:38:54.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dfcec1700 1 --2- 172.21.15.5:0/2762263929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df806e810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0098f0 tx=0x7f2dec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1996ec1ba072efff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2df77fe700 1 -- 172.21.15.5:0/2762263929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011830 con 0x7f2df815bb50 2023-10-16T13:38:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2df77fe700 1 -- 172.21.15.5:0/2762263929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec011990 con 0x7f2df815bb50 2023-10-16T13:38:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2df77fe700 1 -- 172.21.15.5:0/2762263929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011d20 con 0x7f2df815bb50 2023-10-16T13:38:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 -- 172.21.15.5:0/2762263929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 msgr2=0x7f2df806e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 --2- 172.21.15.5:0/2762263929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df806e810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0098f0 tx=0x7f2dec009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 -- 172.21.15.5:0/2762263929 shutdown_connections 2023-10-16T13:38:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 --2- 172.21.15.5:0/2762263929 >> v2:172.21.15.112:3300/0 conn(0x7f2df80ce0b0 0x7f2df815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 --2- 172.21.15.5:0/2762263929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df806e810 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 --2- 172.21.15.5:0/2762263929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df806ed50 0x7f2df80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 -- 172.21.15.5:0/2762263929 >> 172.21.15.5:0/2762263929 conn(0x7f2df80cc6f0 msgr2=0x7f2df80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 -- 172.21.15.5:0/2762263929 shutdown_connections 2023-10-16T13:38:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.855+0000 7f2dff125700 1 -- 172.21.15.5:0/2762263929 wait complete. 2023-10-16T13:38:54.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.857+0000 7f2dff125700 1 Processor -- start 2023-10-16T13:38:54.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.857+0000 7f2dff125700 1 -- start start 2023-10-16T13:38:54.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dff125700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2df806ed50 0x7f2df814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dff125700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df80ce0b0 0x7f2df80c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dff125700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dff125700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80c7090 con 0x7f2df815bb50 2023-10-16T13:38:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dff125700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80cb000 con 0x7f2df806ed50 2023-10-16T13:38:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dff125700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80cb2e0 con 0x7f2df80ce0b0 2023-10-16T13:38:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dfd6c2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dfd6c2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df80c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42924/0 (socket says 172.21.15.5:42924) 2023-10-16T13:38:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.858+0000 7f2dfd6c2700 1 -- 172.21.15.5:0/32042207 learned_addr learned my addr 172.21.15.5:0/32042207 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2df7fff700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df80ce0b0 0x7f2df80c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfcec1700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2df806ed50 0x7f2df814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfd6c2700 1 -- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df80ce0b0 msgr2=0x7f2df80c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfd6c2700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df80ce0b0 0x7f2df80c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfd6c2700 1 -- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2df806ed50 msgr2=0x7f2df814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:54.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfd6c2700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2df806ed50 0x7f2df814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:54.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfd6c2700 1 -- 172.21.15.5:0/32042207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec009550 con 0x7f2df815bb50 2023-10-16T13:38:54.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2df7fff700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df80ce0b0 0x7f2df80c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:54.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dfd6c2700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df80c8910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2df000efc0 tx=0x7f2df000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df000cd40 con 0x7f2df815bb50 2023-10-16T13:38:54.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df000f040 con 0x7f2df815bb50 2023-10-16T13:38:54.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df80cb5c0 con 0x7f2df815bb50 2023-10-16T13:38:54.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df00146c0 con 0x7f2df815bb50 2023-10-16T13:38:54.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.859+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df80cbb80 con 0x7f2df815bb50 2023-10-16T13:38:54.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.860+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df8067d20 con 0x7f2df815bb50 2023-10-16T13:38:54.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.861+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2df0014820 con 0x7f2df815bb50 2023-10-16T13:38:54.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.861+0000 7f2df57fa700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ddc06af00 0x7f2ddc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.861+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2df008a4f0 con 0x7f2df815bb50 2023-10-16T13:38:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.862+0000 7f2dfcec1700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ddc06af00 0x7f2ddc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.862+0000 7f2dfcec1700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ddc06af00 0x7f2ddc06d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2dec014040 tx=0x7f2dec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:54.865+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2df0055710 con 0x7f2df815bb50 2023-10-16T13:38:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.065+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2df80c94b0 con 0x7f2df815bb50 2023-10-16T13:38:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.066+0000 7f2df57fa700 1 -- 172.21.15.5:0/32042207 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2df000cea0 con 0x7f2df815bb50 2023-10-16T13:38:55.069 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ddc06af00 msgr2=0x7f2ddc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ddc06af00 0x7f2ddc06d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2dec014040 tx=0x7f2dec008030 comp rx=0 tx=0).stop 2023-10-16T13:38:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 msgr2=0x7f2df80c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df80c8910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2df000efc0 tx=0x7f2df000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 shutdown_connections 2023-10-16T13:38:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2df815bb50 0x7f2df80c8910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2df806ed50 0x7f2df814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ddc06af00 0x7f2ddc06d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 --2- 172.21.15.5:0/32042207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2df80ce0b0 0x7f2df80c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 >> 172.21.15.5:0/32042207 conn(0x7f2df80cc6f0 msgr2=0x7f2df815d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 shutdown_connections 2023-10-16T13:38:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.068+0000 7f2dff125700 1 -- 172.21.15.5:0/32042207 wait complete. 2023-10-16T13:38:55.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.209+0000 7fb1e861e700 1 Processor -- start 2023-10-16T13:38:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.209+0000 7fb1e861e700 1 -- start start 2023-10-16T13:38:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e861e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e00cd950 0x7fb1e015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e861e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb1e00cede0 0x7fb1e015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e861e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e00cf260 con 0x7fb1e006a840 2023-10-16T13:38:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e861e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e01619a0 con 0x7fb1e00cede0 2023-10-16T13:38:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e861e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b2d60 con 0x7fb1e00cd950 2023-10-16T13:38:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e6bbb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1e006a840 0x7fb1e0161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52936/0 (socket says 172.21.15.5:52936) 2023-10-16T13:38:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e6bbb700 1 -- 172.21.15.5:0/1589242073 learned_addr learned my addr 172.21.15.5:0/1589242073 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e63ba700 1 --2- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e00cd950 0x7fb1e015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e5bb9700 1 --2- 172.21.15.5:0/1589242073 >> v2:172.21.15.112:3300/0 conn(0x7fb1e00cede0 0x7fb1e015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e53b8700 1 -- 172.21.15.5:0/1589242073 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691226237 0 0) 0x7fb1e00cf260 con 0x7fb1e006a840 2023-10-16T13:38:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e53b8700 1 -- 172.21.15.5:0/1589242073 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1cc0035b0 con 0x7fb1e006a840 2023-10-16T13:38:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e53b8700 1 -- 172.21.15.5:0/1589242073 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274473663 0 0) 0x7fb1cc0035b0 con 0x7fb1e006a840 2023-10-16T13:38:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e00cd950 msgr2=0x7fb1e015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e5bb9700 1 --2- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e00cd950 0x7fb1e015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/1589242073 >> v1:172.21.15.5:6789/0 conn(0x7fb1e006a840 legacy=0x7fb1e0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.210+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/1589242073 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00cdd30 con 0x7fb1e00cede0 2023-10-16T13:38:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e5bb9700 1 --2- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015f570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009820 tx=0x7fb1d0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5122111fe430cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e53b8700 1 -- 172.21.15.5:0/1589242073 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80019f0 con 0x7fb1e00cede0 2023-10-16T13:38:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e53b8700 1 -- 172.21.15.5:0/1589242073 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0005c30 con 0x7fb1e00cede0 2023-10-16T13:38:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e53b8700 1 -- 172.21.15.5:0/1589242073 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0004030 con 0x7fb1e00cede0 2023-10-16T13:38:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 -- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 msgr2=0x7fb1e015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 --2- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015f570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009820 tx=0x7fb1d0009b30 comp rx=0 tx=0).stop 2023-10-16T13:38:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 -- 172.21.15.5:0/1589242073 shutdown_connections 2023-10-16T13:38:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 --2- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e00cd950 0x7fb1e015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 --2- 172.21.15.5:0/1589242073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015f570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 -- 172.21.15.5:0/1589242073 >> 172.21.15.5:0/1589242073 conn(0x7fb1e006dae0 msgr2=0x7fb1e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.211+0000 7fb1e861e700 1 -- 172.21.15.5:0/1589242073 shutdown_connections 2023-10-16T13:38:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.212+0000 7fb1e861e700 1 -- 172.21.15.5:0/1589242073 wait complete. 2023-10-16T13:38:55.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.213+0000 7fb1e861e700 1 Processor -- start 2023-10-16T13:38:55.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.213+0000 7fb1e861e700 1 -- start start 2023-10-16T13:38:55.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e861e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e006a840 0x7fb1e00b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e861e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 0x7fb1e00b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e861e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e861e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b3780 con 0x7fb1e00cd950 2023-10-16T13:38:55.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e861e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b3a60 con 0x7fb1e00cede0 2023-10-16T13:38:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e861e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b3d40 con 0x7fb1e006a840 2023-10-16T13:38:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e5bb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 0x7fb1e00b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e5bb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 0x7fb1e00b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42936/0 (socket says 172.21.15.5:42936) 2023-10-16T13:38:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/3848716617 learned_addr learned my addr 172.21.15.5:0/3848716617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e6bbb700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.214+0000 7fb1e63ba700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e006a840 0x7fb1e00b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e006a840 msgr2=0x7fb1e00b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e5bb9700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e006a840 0x7fb1e00b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 msgr2=0x7fb1e015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e5bb9700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e5bb9700 1 -- 172.21.15.5:0/3848716617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0009430 con 0x7fb1e00cd950 2023-10-16T13:38:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e5bb9700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 0x7fb1e00b5510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000c00 tx=0x7fb1d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0003bb0 con 0x7fb1e00cd950 2023-10-16T13:38:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0003d10 con 0x7fb1e00cd950 2023-10-16T13:38:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e00b4020 con 0x7fb1e00cd950 2023-10-16T13:38:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d001d670 con 0x7fb1e00cd950 2023-10-16T13:38:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.215+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e00b5a50 con 0x7fb1e00cd950 2023-10-16T13:38:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.216+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e0067d20 con 0x7fb1e00cd950 2023-10-16T13:38:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.216+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1d001d7d0 con 0x7fb1e00cd950 2023-10-16T13:38:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.217+0000 7fb1d6ffd700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1c406af00 0x7fb1c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.217+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d008a930 con 0x7fb1e00cd950 2023-10-16T13:38:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.217+0000 7fb1e63ba700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1c406af00 0x7fb1c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.217+0000 7fb1e63ba700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1c406af00 0x7fb1c406d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009ab0 tx=0x7fb1dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.222+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1d0055b90 con 0x7fb1e00cd950 2023-10-16T13:38:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.422+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1e00b2630 con 0x7fb1e00cd950 2023-10-16T13:38:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.423+0000 7fb1d6ffd700 1 -- 172.21.15.5:0/3848716617 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1d00160a0 con 0x7fb1e00cd950 2023-10-16T13:38:55.426 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1c406af00 msgr2=0x7fb1c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1c406af00 0x7fb1c406d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009ab0 tx=0x7fb1dc008040 comp rx=0 tx=0).stop 2023-10-16T13:38:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 msgr2=0x7fb1e00b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 0x7fb1e00b5510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000c00 tx=0x7fb1d0004750 comp rx=0 tx=0).stop 2023-10-16T13:38:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 shutdown_connections 2023-10-16T13:38:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1e00cede0 0x7fb1e015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1c406af00 0x7fb1c406d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1e006a840 0x7fb1e00b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 --2- 172.21.15.5:0/3848716617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1e00cd950 0x7fb1e00b5510 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 >> 172.21.15.5:0/3848716617 conn(0x7fb1e006dae0 msgr2=0x7fb1e00b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 shutdown_connections 2023-10-16T13:38:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.425+0000 7fb1e861e700 1 -- 172.21.15.5:0/3848716617 wait complete. 2023-10-16T13:38:55.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-16T13:38:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.562+0000 7f0894ea0700 1 Processor -- start 2023-10-16T13:38:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.562+0000 7f0894ea0700 1 -- start start 2023-10-16T13:38:55.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f0894ea0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 0x7f08900cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f0894ea0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08900cfc60 0x7f08900cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f0894ea0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089015e7a0 con 0x7f089015ab10 2023-10-16T13:38:55.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f0894ea0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900d00d0 con 0x7f08900cfc60 2023-10-16T13:38:55.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f0894ea0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900b29a0 con 0x7f089015f1f0 2023-10-16T13:38:55.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08900cfc60 0x7f08900cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088dd9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 0x7f08900cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088dd9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 0x7f08900cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:40848/0 (socket says 172.21.15.5:40848) 2023-10-16T13:38:55.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088e59c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f089015ab10 0x7f08900b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:43922/0 (socket says 172.21.15.5:43922) 2023-10-16T13:38:55.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088dd9b700 1 -- 172.21.15.5:0/1953093080 learned_addr learned my addr 172.21.15.5:0/1953093080 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:55.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088ed9d700 1 -- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 msgr2=0x7f08900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:55.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088ed9d700 1 --2- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 0x7f08900cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088ed9d700 1 -- 172.21.15.5:0/1953093080 >> v1:172.21.15.112:6789/0 conn(0x7f089015ab10 legacy=0x7f08900b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088ed9d700 1 -- 172.21.15.5:0/1953093080 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900b2c80 con 0x7f08900cfc60 2023-10-16T13:38:55.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088d59a700 1 -- 172.21.15.5:0/1953093080 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230055699 0 0) 0x7f089015e7a0 con 0x7f089015ab10 2023-10-16T13:38:55.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.564+0000 7f088dd9b700 1 --2- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 0x7f08900cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:55.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f088ed9d700 1 --2- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900cfc60 0x7f08900cbf40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0888009d90 tx=0x7f088800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7126eab39fe1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:55.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f088d59a700 1 -- 172.21.15.5:0/1953093080 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800e070 con 0x7f08900cfc60 2023-10-16T13:38:55.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f088d59a700 1 -- 172.21.15.5:0/1953093080 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800bb20 con 0x7f08900cfc60 2023-10-16T13:38:55.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f088d59a700 1 -- 172.21.15.5:0/1953093080 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888012430 con 0x7f08900cfc60 2023-10-16T13:38:55.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 -- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900cfc60 msgr2=0x7f08900cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 --2- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900cfc60 0x7f08900cbf40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0888009d90 tx=0x7f088800b330 comp rx=0 tx=0).stop 2023-10-16T13:38:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 -- 172.21.15.5:0/1953093080 shutdown_connections 2023-10-16T13:38:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 --2- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900cfc60 0x7f08900cbf40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 --2- 172.21.15.5:0/1953093080 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f089015f1f0 0x7f08900cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 -- 172.21.15.5:0/1953093080 >> 172.21.15.5:0/1953093080 conn(0x7f089006dae0 msgr2=0x7f089006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.565+0000 7f0894ea0700 1 -- 172.21.15.5:0/1953093080 shutdown_connections 2023-10-16T13:38:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.566+0000 7f0894ea0700 1 -- 172.21.15.5:0/1953093080 wait complete. 2023-10-16T13:38:55.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.567+0000 7f0894ea0700 1 Processor -- start 2023-10-16T13:38:55.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.567+0000 7f0894ea0700 1 -- start start 2023-10-16T13:38:55.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f0894ea0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08900cfc60 0x7f089014c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f0894ea0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 0x7f08900b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f0894ea0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089015f1f0 0x7f08900b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f0894ea0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089014ce70 con 0x7f089015ab10 2023-10-16T13:38:55.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f0894ea0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c7fc0 con 0x7f089015f1f0 2023-10-16T13:38:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f0894ea0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c82a0 con 0x7f08900cfc60 2023-10-16T13:38:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f088dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 0x7f08900b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f088dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 0x7f08900b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42950/0 (socket says 172.21.15.5:42950) 2023-10-16T13:38:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.568+0000 7f088dd9b700 1 -- 172.21.15.5:0/2537645983 learned_addr learned my addr 172.21.15.5:0/2537645983 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088ed9d700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089015f1f0 0x7f08900b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088e59c700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08900cfc60 0x7f089014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088dd9b700 1 -- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08900cfc60 msgr2=0x7f089014c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088dd9b700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08900cfc60 0x7f089014c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088dd9b700 1 -- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089015f1f0 msgr2=0x7f08900b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088dd9b700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089015f1f0 0x7f08900b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088dd9b700 1 -- 172.21.15.5:0/2537645983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880009500 con 0x7f089015ab10 2023-10-16T13:38:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f088dd9b700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 0x7f08900b41b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f088000ebb0 tx=0x7f088000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880005a20 con 0x7f089015ab10 2023-10-16T13:38:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0880005b80 con 0x7f089015ab10 2023-10-16T13:38:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0888009a70 con 0x7f089015ab10 2023-10-16T13:38:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000c850 con 0x7f089015ab10 2023-10-16T13:38:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.569+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08900c8860 con 0x7f089015ab10 2023-10-16T13:38:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.570+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0890067d20 con 0x7f089015ab10 2023-10-16T13:38:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.571+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f088000c9b0 con 0x7f089015ab10 2023-10-16T13:38:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.571+0000 7f087effd700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f087006af30 0x7f087006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.571+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08800897f0 con 0x7f089015ab10 2023-10-16T13:38:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.571+0000 7f088e59c700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f087006af30 0x7f087006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.572+0000 7f088e59c700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f087006af30 0x7f087006d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0884000f60 tx=0x7f0884007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.576+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08800548a0 con 0x7f089015ab10 2023-10-16T13:38:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:55.863+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f08900d0fe0 con 0x7f089015ab10 2023-10-16T13:38:56.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.714+0000 7f087effd700 1 -- 172.21.15.5:0/2537645983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0880020020 con 0x7f089015ab10 2023-10-16T13:38:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f087006af30 msgr2=0x7f087006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f087006af30 0x7f087006d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0884000f60 tx=0x7f0884007e70 comp rx=0 tx=0).stop 2023-10-16T13:38:56.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 msgr2=0x7f08900b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 0x7f08900b41b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f088000ebb0 tx=0x7f088000eec0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 shutdown_connections 2023-10-16T13:38:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089015f1f0 0x7f08900b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f087006af30 0x7f087006d3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08900cfc60 0x7f089014c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 --2- 172.21.15.5:0/2537645983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f089015ab10 0x7f08900b41b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 >> 172.21.15.5:0/2537645983 conn(0x7f089006dae0 msgr2=0x7f0890159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 shutdown_connections 2023-10-16T13:38:56.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.718+0000 7f0894ea0700 1 -- 172.21.15.5:0/2537645983 wait complete. 2023-10-16T13:38:56.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:38:56.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.868+0000 7f1c30464700 1 Processor -- start 2023-10-16T13:38:56.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.868+0000 7f1c30464700 1 -- start start 2023-10-16T13:38:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c30464700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c2815ab10 0x7f1c2815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c30464700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2815e7a0 con 0x7f1c280b1f50 2023-10-16T13:38:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c30464700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2815f730 con 0x7f1c280cfe30 2023-10-16T13:38:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c30464700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c280b29a0 con 0x7f1c2815ab10 2023-10-16T13:38:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c2e200700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c2815ab10 0x7f1c2815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c2e200700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c2815ab10 0x7f1c2815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42956/0 (socket says 172.21.15.5:42956) 2023-10-16T13:38:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c2e200700 1 -- 172.21.15.5:0/1529136604 learned_addr learned my addr 172.21.15.5:0/1529136604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.869+0000 7f1c2d9ff700 1 --1- 172.21.15.5:0/1529136604 >> v1:172.21.15.5:6789/0 conn(0x7f1c280b1f50 0x7f1c280cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52960/0 (socket says 172.21.15.5:52960) 2023-10-16T13:38:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2e200700 1 -- 172.21.15.5:0/1529136604 >> v1:172.21.15.112:6789/0 conn(0x7f1c280cfe30 legacy=0x7f1c280cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2e200700 1 -- 172.21.15.5:0/1529136604 >> v1:172.21.15.5:6789/0 conn(0x7f1c280b1f50 legacy=0x7f1c280cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2e200700 1 -- 172.21.15.5:0/1529136604 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280b2c80 con 0x7f1c2815ab10 2023-10-16T13:38:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2e200700 1 --2- 172.21.15.5:0/1529136604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c2815f1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1c240098f0 tx=0x7f1c24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160d3864a3ae12d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2d1fe700 1 -- 172.21.15.5:0/1529136604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24004230 con 0x7f1c2815ab10 2023-10-16T13:38:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2d1fe700 1 -- 172.21.15.5:0/1529136604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24004390 con 0x7f1c2815ab10 2023-10-16T13:38:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.870+0000 7f1c2d1fe700 1 -- 172.21.15.5:0/1529136604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240036a0 con 0x7f1c2815ab10 2023-10-16T13:38:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 -- 172.21.15.5:0/1529136604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 msgr2=0x7f1c2815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 --2- 172.21.15.5:0/1529136604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c2815f1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1c240098f0 tx=0x7f1c24009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 -- 172.21.15.5:0/1529136604 shutdown_connections 2023-10-16T13:38:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 --2- 172.21.15.5:0/1529136604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c2815f1f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 -- 172.21.15.5:0/1529136604 >> 172.21.15.5:0/1529136604 conn(0x7f1c2806dae0 msgr2=0x7f1c2806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 -- 172.21.15.5:0/1529136604 shutdown_connections 2023-10-16T13:38:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.871+0000 7f1c30464700 1 -- 172.21.15.5:0/1529136604 wait complete. 2023-10-16T13:38:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.872+0000 7f1c30464700 1 Processor -- start 2023-10-16T13:38:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.872+0000 7f1c30464700 1 -- start start 2023-10-16T13:38:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c30464700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c280b1f50 0x7f1c281f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c30464700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c280cfe30 0x7f1c280b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c30464700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c281f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c30464700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2815d6a0 con 0x7f1c2815ab10 2023-10-16T13:38:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c30464700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c281f46a0 con 0x7f1c280b1f50 2023-10-16T13:38:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c30464700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2815c600 con 0x7f1c280cfe30 2023-10-16T13:38:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c281f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c281f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42964/0 (socket says 172.21.15.5:42964) 2023-10-16T13:38:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 -- 172.21.15.5:0/3889595012 learned_addr learned my addr 172.21.15.5:0/3889595012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2e200700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c280b1f50 0x7f1c281f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2d9ff700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c280cfe30 0x7f1c280b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 -- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c280cfe30 msgr2=0x7f1c280b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c280cfe30 0x7f1c280b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 -- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c280b1f50 msgr2=0x7f1c281f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c280b1f50 0x7f1c281f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2ea01700 1 -- 172.21.15.5:0/3889595012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24009550 con 0x7f1c2815ab10 2023-10-16T13:38:56.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.873+0000 7f1c2d9ff700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c280cfe30 0x7f1c280b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:56.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.874+0000 7f1c2ea01700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c281f2b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000b9e0 tx=0x7f1c2000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:56.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.874+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000c9b0 con 0x7f1c2815ab10 2023-10-16T13:38:56.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.874+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2000cb50 con 0x7f1c2815ab10 2023-10-16T13:38:56.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.874+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2815c940 con 0x7f1c2815ab10 2023-10-16T13:38:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.874+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20014440 con 0x7f1c2815ab10 2023-10-16T13:38:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.874+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2815d180 con 0x7f1c2815ab10 2023-10-16T13:38:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.875+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c28067d20 con 0x7f1c2815ab10 2023-10-16T13:38:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.875+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c200145a0 con 0x7f1c2815ab10 2023-10-16T13:38:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.876+0000 7f1c1effd700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c0c06af00 0x7f1c0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.876+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c200891c0 con 0x7f1c2815ab10 2023-10-16T13:38:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.876+0000 7f1c2e200700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c0c06af00 0x7f1c0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.876+0000 7f1c2e200700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c0c06af00 0x7f1c0c06d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009130 tx=0x7f1c24008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:56.881+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c20054320 con 0x7f1c2815ab10 2023-10-16T13:38:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.081+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1c280afc10 con 0x7f1c2815ab10 2023-10-16T13:38:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.084+0000 7f1c1effd700 1 -- 172.21.15.5:0/3889595012 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c20057940 con 0x7f1c2815ab10 2023-10-16T13:38:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c0c06af00 msgr2=0x7f1c0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c0c06af00 0x7f1c0c06d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009130 tx=0x7f1c24008030 comp rx=0 tx=0).stop 2023-10-16T13:38:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 msgr2=0x7f1c281f2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c281f2b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000b9e0 tx=0x7f1c2000bda0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 shutdown_connections 2023-10-16T13:38:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2815ab10 0x7f1c281f2b40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c280b1f50 0x7f1c281f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c0c06af00 0x7f1c0c06d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 --2- 172.21.15.5:0/3889595012 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c280cfe30 0x7f1c280b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.086+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 >> 172.21.15.5:0/3889595012 conn(0x7f1c2806dae0 msgr2=0x7f1c280cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.087+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 shutdown_connections 2023-10-16T13:38:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.087+0000 7f1c30464700 1 -- 172.21.15.5:0/3889595012 wait complete. 2023-10-16T13:38:57.101 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:38:57.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:38:57.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:38:57.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:38:57.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:38:57.191 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:38:57.191 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:57.192 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:57.215 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:57.216 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:57.277 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:38:57.277 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:57.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.497+0000 7fb28c2f3700 1 Processor -- start 2023-10-16T13:38:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.497+0000 7fb28c2f3700 1 -- start start 2023-10-16T13:38:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28c2f3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb28415f130 0x7fb2840cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28c2f3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2840b28b0 0x7fb28406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28c2f3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284071af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28c2f3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2840cde00 con 0x7fb28415f130 2023-10-16T13:38:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28c2f3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2840b3530 con 0x7fb2840b28b0 2023-10-16T13:38:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28c2f3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28406b1d0 con 0x7fb28406ad80 2023-10-16T13:38:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb28415f130 0x7fb2840cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb28415f130 0x7fb2840cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42968/0 (socket says 172.21.15.5:42968) 2023-10-16T13:38:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 -- 172.21.15.5:0/932292277 learned_addr learned my addr 172.21.15.5:0/932292277 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28988e700 1 --2- 172.21.15.5:0/932292277 >> v2:172.21.15.112:3300/0 conn(0x7fb2840b28b0 0x7fb28406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a890700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 -- 172.21.15.5:0/932292277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 msgr2=0x7fb284071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 -- 172.21.15.5:0/932292277 >> v2:172.21.15.112:3300/0 conn(0x7fb2840b28b0 msgr2=0x7fb28406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 --2- 172.21.15.5:0/932292277 >> v2:172.21.15.112:3300/0 conn(0x7fb2840b28b0 0x7fb28406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a08f700 1 -- 172.21.15.5:0/932292277 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840cd180 con 0x7fb28415f130 2023-10-16T13:38:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28988e700 1 --2- 172.21.15.5:0/932292277 >> v2:172.21.15.112:3300/0 conn(0x7fb2840b28b0 0x7fb28406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.498+0000 7fb28a890700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28a08f700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb28415f130 0x7fb2840cede0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2840c3f30 tx=0x7fb274009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac83ca34ce945078 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28908d700 1 -- 172.21.15.5:0/932292277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27400b870 con 0x7fb28415f130 2023-10-16T13:38:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28908d700 1 -- 172.21.15.5:0/932292277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27400b9d0 con 0x7fb28415f130 2023-10-16T13:38:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28908d700 1 -- 172.21.15.5:0/932292277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27400bd60 con 0x7fb28415f130 2023-10-16T13:38:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 -- 172.21.15.5:0/932292277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb28415f130 msgr2=0x7fb2840cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb28415f130 0x7fb2840cede0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2840c3f30 tx=0x7fb274009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 -- 172.21.15.5:0/932292277 shutdown_connections 2023-10-16T13:38:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/932292277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb28415f130 0x7fb2840cede0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/932292277 >> v2:172.21.15.112:3300/0 conn(0x7fb2840b28b0 0x7fb28406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 -- 172.21.15.5:0/932292277 >> 172.21.15.5:0/932292277 conn(0x7fb28406dae0 msgr2=0x7fb28406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 -- 172.21.15.5:0/932292277 shutdown_connections 2023-10-16T13:38:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.499+0000 7fb28c2f3700 1 -- 172.21.15.5:0/932292277 wait complete. 2023-10-16T13:38:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 Processor -- start 2023-10-16T13:38:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 -- start start 2023-10-16T13:38:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 0x7fb2840ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28415f130 0x7fb2840c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840ada30 con 0x7fb2840b28b0 2023-10-16T13:38:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840aca30 con 0x7fb28415f130 2023-10-16T13:38:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.501+0000 7fb28c2f3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840cb810 con 0x7fb28406ad80 2023-10-16T13:38:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 0x7fb2840ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 0x7fb2840ad4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42974/0 (socket says 172.21.15.5:42974) 2023-10-16T13:38:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 -- 172.21.15.5:0/3407886562 learned_addr learned my addr 172.21.15.5:0/3407886562 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28a08f700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28a890700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28415f130 0x7fb2840c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 -- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 msgr2=0x7fb284155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 -- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28415f130 msgr2=0x7fb2840c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28415f130 0x7fb2840c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 -- 172.21.15.5:0/3407886562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009550 con 0x7fb2840b28b0 2023-10-16T13:38:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28988e700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 0x7fb2840ad4f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb28000c7f0 tx=0x7fb28000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280005c20 con 0x7fb2840b28b0 2023-10-16T13:38:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280005d80 con 0x7fb2840b28b0 2023-10-16T13:38:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2840accf0 con 0x7fb2840b28b0 2023-10-16T13:38:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280011840 con 0x7fb2840b28b0 2023-10-16T13:38:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.502+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2840c9110 con 0x7fb2840b28b0 2023-10-16T13:38:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.503+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb284067d20 con 0x7fb2840b28b0 2023-10-16T13:38:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.504+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb2800119a0 con 0x7fb2840b28b0 2023-10-16T13:38:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.504+0000 7fb27affd700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb26806af00 0x7fb26806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.504+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb280088e90 con 0x7fb2840b28b0 2023-10-16T13:38:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.504+0000 7fb28a08f700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb26806af00 0x7fb26806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.505+0000 7fb28a08f700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb26806af00 0x7fb26806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb274000c00 tx=0x7fb274008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:57.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.509+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb280053fd0 con 0x7fb2840b28b0 2023-10-16T13:38:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.712+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2840c3cf0 con 0x7fb2840b28b0 2023-10-16T13:38:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.713+0000 7fb27affd700 1 -- 172.21.15.5:0/3407886562 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fb28001e090 con 0x7fb2840b28b0 2023-10-16T13:38:57.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:57.716 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:57.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb26806af00 msgr2=0x7fb26806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb26806af00 0x7fb26806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb274000c00 tx=0x7fb274008030 comp rx=0 tx=0).stop 2023-10-16T13:38:57.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 msgr2=0x7fb2840ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 0x7fb2840ad4f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb28000c7f0 tx=0x7fb28000cb00 comp rx=0 tx=0).stop 2023-10-16T13:38:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 shutdown_connections 2023-10-16T13:38:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28415f130 0x7fb2840c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb26806af00 0x7fb26806d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28406ad80 0x7fb284155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 --2- 172.21.15.5:0/3407886562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2840b28b0 0x7fb2840ad4f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 >> 172.21.15.5:0/3407886562 conn(0x7fb28406dae0 msgr2=0x7fb2840b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 shutdown_connections 2023-10-16T13:38:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.715+0000 7fb28c2f3700 1 -- 172.21.15.5:0/3407886562 wait complete. 2023-10-16T13:38:57.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:57.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:57.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.856+0000 7f60247b1700 1 Processor -- start 2023-10-16T13:38:57.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.856+0000 7f60247b1700 1 -- start start 2023-10-16T13:38:57.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f60247b1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f601c15e030 0x7f601c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f60247b1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c06a840 0x7f601c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f60247b1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f601c06be50 0x7f601c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f60247b1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601c06adb0 con 0x7f601c06be50 2023-10-16T13:38:57.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f60247b1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601c06b090 con 0x7f601c15e030 2023-10-16T13:38:57.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f60247b1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c06b370 con 0x7f601c06a840 2023-10-16T13:38:57.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f6022d4e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f601c06be50 0x7f601c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f6022d4e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f601c06be50 0x7f601c0ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42984/0 (socket says 172.21.15.5:42984) 2023-10-16T13:38:57.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.857+0000 7f6022d4e700 1 -- 172.21.15.5:0/467481864 learned_addr learned my addr 172.21.15.5:0/467481864 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6021d4c700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c06a840 0x7f601c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f602254d700 1 --2- 172.21.15.5:0/467481864 >> v2:172.21.15.112:3300/0 conn(0x7f601c15e030 0x7f601c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6022d4e700 1 -- 172.21.15.5:0/467481864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c06a840 msgr2=0x7f601c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6022d4e700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c06a840 0x7f601c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6022d4e700 1 -- 172.21.15.5:0/467481864 >> v2:172.21.15.112:3300/0 conn(0x7f601c15e030 msgr2=0x7f601c0cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6022d4e700 1 --2- 172.21.15.5:0/467481864 >> v2:172.21.15.112:3300/0 conn(0x7f601c15e030 0x7f601c0cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6022d4e700 1 -- 172.21.15.5:0/467481864 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c06b650 con 0x7f601c06be50 2023-10-16T13:38:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6021d4c700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c06a840 0x7f601c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f6022d4e700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c0ce0b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f601c0746a0 tx=0x7f601400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1f6488e7889bdb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f602154b700 1 -- 172.21.15.5:0/467481864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400e070 con 0x7f601c06be50 2023-10-16T13:38:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f602154b700 1 -- 172.21.15.5:0/467481864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400b9c0 con 0x7f601c06be50 2023-10-16T13:38:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.858+0000 7f602154b700 1 -- 172.21.15.5:0/467481864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400bd70 con 0x7f601c06be50 2023-10-16T13:38:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 -- 172.21.15.5:0/467481864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 msgr2=0x7f601c0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c0ce0b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f601c0746a0 tx=0x7f601400b330 comp rx=0 tx=0).stop 2023-10-16T13:38:57.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 -- 172.21.15.5:0/467481864 shutdown_connections 2023-10-16T13:38:57.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 --2- 172.21.15.5:0/467481864 >> v2:172.21.15.112:3300/0 conn(0x7f601c15e030 0x7f601c0cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c0ce0b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 --2- 172.21.15.5:0/467481864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c06a840 0x7f601c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 -- 172.21.15.5:0/467481864 >> 172.21.15.5:0/467481864 conn(0x7f601c0cc6f0 msgr2=0x7f601c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:57.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 -- 172.21.15.5:0/467481864 shutdown_connections 2023-10-16T13:38:57.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.859+0000 7f60247b1700 1 -- 172.21.15.5:0/467481864 wait complete. 2023-10-16T13:38:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.860+0000 7f60247b1700 1 Processor -- start 2023-10-16T13:38:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.860+0000 7f60247b1700 1 -- start start 2023-10-16T13:38:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c06a840 0x7f601c0c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c15e030 0x7f601c0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0c6210 con 0x7f601c06be50 2023-10-16T13:38:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0c8840 con 0x7f601c06a840 2023-10-16T13:38:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0c8b20 con 0x7f601c15e030 2023-10-16T13:38:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c15e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42988/0 (socket says 172.21.15.5:42988) 2023-10-16T13:38:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 -- 172.21.15.5:0/57913304 learned_addr learned my addr 172.21.15.5:0/57913304 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f602254d700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c06a840 0x7f601c0c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6022d4e700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c15e030 0x7f601c0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 -- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c15e030 msgr2=0x7f601c0c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c15e030 0x7f601c0c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 -- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c06a840 msgr2=0x7f601c0c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c06a840 0x7f601c0c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 -- 172.21.15.5:0/57913304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009b30 con 0x7f601c06be50 2023-10-16T13:38:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6022d4e700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c15e030 0x7f601c0c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6021d4c700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c15e410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f601800c7f0 tx=0x7f601800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011800 con 0x7f601c06be50 2023-10-16T13:38:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018011960 con 0x7f601c06be50 2023-10-16T13:38:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c0c8e00 con 0x7f601c06be50 2023-10-16T13:38:57.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.861+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011cf0 con 0x7f601c06be50 2023-10-16T13:38:57.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.862+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c0c64f0 con 0x7f601c06be50 2023-10-16T13:38:57.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.862+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c0c8ff0 con 0x7f601c06be50 2023-10-16T13:38:57.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.863+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6018018360 con 0x7f601c06be50 2023-10-16T13:38:57.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.863+0000 7f6012ffd700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f600006af00 0x7f600006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:57.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.863+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6018089510 con 0x7f601c06be50 2023-10-16T13:38:57.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.864+0000 7f602254d700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f600006af00 0x7f600006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:57.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.864+0000 7f602254d700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f600006af00 0x7f600006d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f600c006b20 tx=0x7f600c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:57.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:57.868+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60180545d0 con 0x7f601c06be50 2023-10-16T13:38:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.067+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f601c067d20 con 0x7f601c06be50 2023-10-16T13:38:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.068+0000 7f6012ffd700 1 -- 172.21.15.5:0/57913304 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6018057bf0 con 0x7f601c06be50 2023-10-16T13:38:58.071 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:38:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f600006af00 msgr2=0x7f600006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f600006af00 0x7f600006d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f600c006b20 tx=0x7f600c008040 comp rx=0 tx=0).stop 2023-10-16T13:38:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 msgr2=0x7f601c15e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c15e410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f601800c7f0 tx=0x7f601800cb00 comp rx=0 tx=0).stop 2023-10-16T13:38:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 shutdown_connections 2023-10-16T13:38:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f600006af00 0x7f600006d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f601c15e030 0x7f601c0c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c06a840 0x7f601c0c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 --2- 172.21.15.5:0/57913304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f601c06be50 0x7f601c15e410 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 >> 172.21.15.5:0/57913304 conn(0x7f601c0cc6f0 msgr2=0x7f601c0ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 shutdown_connections 2023-10-16T13:38:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.070+0000 7f60247b1700 1 -- 172.21.15.5:0/57913304 wait complete. 2023-10-16T13:38:58.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:38:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.210+0000 7f561504b700 1 Processor -- start 2023-10-16T13:38:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.210+0000 7f561504b700 1 -- start start 2023-10-16T13:38:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f561504b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f561006eb30 0x7f561015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f561504b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56100b5c70 con 0x7f561006e750 2023-10-16T13:38:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f561504b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56100b5990 con 0x7f56100b54f0 2023-10-16T13:38:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f561504b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561015b2b0 con 0x7f561006eb30 2023-10-16T13:38:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560ed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f561006e750 0x7f56100ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52998/0 (socket says 172.21.15.5:52998) 2023-10-16T13:38:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560ed9d700 1 -- 172.21.15.5:0/869085304 learned_addr learned my addr 172.21.15.5:0/869085304 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560e59c700 1 --2- 172.21.15.5:0/869085304 >> v2:172.21.15.112:3300/0 conn(0x7f561006eb30 0x7f561015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167798953 0 0) 0x7f56100b5c70 con 0x7f561006e750 2023-10-16T13:38:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f80057c0 con 0x7f561006e750 2023-10-16T13:38:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82052648 0 0) 0x7f55f80057c0 con 0x7f561006e750 2023-10-16T13:38:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 >> v2:172.21.15.112:3300/0 conn(0x7f561006eb30 msgr2=0x7f561015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 --2- 172.21.15.5:0/869085304 >> v2:172.21.15.112:3300/0 conn(0x7f561006eb30 0x7f561015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 >> v1:172.21.15.112:6789/0 conn(0x7f56100b54f0 legacy=0x7f561015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561015b590 con 0x7f561006e750 2023-10-16T13:38:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5600001670 con 0x7f561006e750 2023-10-16T13:38:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560e59c700 1 --2- 172.21.15.5:0/869085304 >> v2:172.21.15.112:3300/0 conn(0x7f561006eb30 0x7f561015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:38:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 >> v1:172.21.15.5:6789/0 conn(0x7f561006e750 legacy=0x7f56100ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8005c40 0x7f55f8006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f8006a60 0x7f55f8006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f8007470 0x7f55f800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561015b2b0 con 0x7f55f8006a60 2023-10-16T13:38:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800e3a0 con 0x7f55f8005c40 2023-10-16T13:38:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800e560 con 0x7f55f8007470 2023-10-16T13:38:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560e59c700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f8006a60 0x7f55f8006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.211+0000 7f560ed9d700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8005c40 0x7f55f8006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560f59e700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f8007470 0x7f55f800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560e59c700 1 -- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f8007470 msgr2=0x7f55f800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560e59c700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f8007470 0x7f55f800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560e59c700 1 -- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8005c40 msgr2=0x7f55f8006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560e59c700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8005c40 0x7f55f8006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560e59c700 1 -- 172.21.15.5:0/869085304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80057c0 con 0x7f55f8006a60 2023-10-16T13:38:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560f59e700 1 -- 172.21.15.5:0/869085304 reap_dead start 2023-10-16T13:38:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560e59c700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f8006a60 0x7f55f8006ee0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f561006c2d0 tx=0x7f55f8007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d298f99a27f55d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604004030 con 0x7f55f8006a60 2023-10-16T13:38:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604004190 con 0x7f55f8006a60 2023-10-16T13:38:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f560dd9b700 1 -- 172.21.15.5:0/869085304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604004520 con 0x7f55f8006a60 2023-10-16T13:38:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f561504b700 1 -- 172.21.15.5:0/869085304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f8006a60 msgr2=0x7f55f8006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f561504b700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f8006a60 0x7f55f8006ee0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f561006c2d0 tx=0x7f55f8007a90 comp rx=0 tx=0).stop 2023-10-16T13:38:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f561504b700 1 -- 172.21.15.5:0/869085304 shutdown_connections 2023-10-16T13:38:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.212+0000 7f561504b700 1 --2- 172.21.15.5:0/869085304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f8006a60 0x7f55f8006ee0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.213+0000 7f561504b700 1 -- 172.21.15.5:0/869085304 >> 172.21.15.5:0/869085304 conn(0x7f56100cc6f0 msgr2=0x7f56100ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.213+0000 7f561504b700 1 -- 172.21.15.5:0/869085304 shutdown_connections 2023-10-16T13:38:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.213+0000 7f561504b700 1 -- 172.21.15.5:0/869085304 wait complete. 2023-10-16T13:38:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.214+0000 7f561504b700 1 Processor -- start 2023-10-16T13:38:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.214+0000 7f561504b700 1 -- start start 2023-10-16T13:38:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f561504b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8006a60 0x7f56101558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f561504b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 0x7f5610155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f561504b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5610158d30 0x7f561015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f561504b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56101592d0 con 0x7f561015a520 2023-10-16T13:38:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f561504b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56101595b0 con 0x7f55f8006a60 2023-10-16T13:38:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f561504b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5610159890 con 0x7f5610158d30 2023-10-16T13:38:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 0x7f5610155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 0x7f5610155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43008/0 (socket says 172.21.15.5:43008) 2023-10-16T13:38:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 -- 172.21.15.5:0/906368650 learned_addr learned my addr 172.21.15.5:0/906368650 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560ed9d700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8006a60 0x7f56101558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560f59e700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5610158d30 0x7f561015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 -- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5610158d30 msgr2=0x7f561015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5610158d30 0x7f561015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 -- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8006a60 msgr2=0x7f56101558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8006a60 0x7f56101558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 -- 172.21.15.5:0/906368650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610159b70 con 0x7f561015a520 2023-10-16T13:38:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.215+0000 7f560e59c700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 0x7f5610155e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5604000c00 tx=0x7f56040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.216+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604020070 con 0x7f561015a520 2023-10-16T13:38:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.216+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400ee60 con 0x7f561015a520 2023-10-16T13:38:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.216+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604004030 con 0x7f561015a520 2023-10-16T13:38:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.216+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561015ae30 con 0x7f561015a520 2023-10-16T13:38:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.216+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56101f3830 con 0x7f561015a520 2023-10-16T13:38:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.217+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5610159d00 con 0x7f561015a520 2023-10-16T13:38:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.217+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5604024070 con 0x7f561015a520 2023-10-16T13:38:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.217+0000 7f55f77fe700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55fc06af00 0x7f55fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.218+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f560408a6e0 con 0x7f561015a520 2023-10-16T13:38:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.218+0000 7f560ed9d700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55fc06af00 0x7f55fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.218+0000 7f560ed9d700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55fc06af00 0x7f55fc06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5600001050 tx=0x7f5600000fc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.222+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5604055940 con 0x7f561015a520 2023-10-16T13:38:58.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.422+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56100ae2a0 con 0x7f561015a520 2023-10-16T13:38:58.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.422+0000 7f55f77fe700 1 -- 172.21.15.5:0/906368650 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5604058f60 con 0x7f561015a520 2023-10-16T13:38:58.426 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:38:58.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55fc06af00 msgr2=0x7f55fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55fc06af00 0x7f55fc06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5600001050 tx=0x7f5600000fc0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 msgr2=0x7f5610155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 0x7f5610155e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5604000c00 tx=0x7f56040047c0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 shutdown_connections 2023-10-16T13:38:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55fc06af00 0x7f55fc06d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5610158d30 0x7f561015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f8006a60 0x7f56101558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 --2- 172.21.15.5:0/906368650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f561015a520 0x7f5610155e30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.424+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 >> 172.21.15.5:0/906368650 conn(0x7f56100cc6f0 msgr2=0x7f56100ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.425+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 shutdown_connections 2023-10-16T13:38:58.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.425+0000 7f561504b700 1 -- 172.21.15.5:0/906368650 wait complete. 2023-10-16T13:38:58.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:38:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.565+0000 7fec002fa700 1 Processor -- start 2023-10-16T13:38:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.565+0000 7fec002fa700 1 -- start start 2023-10-16T13:38:58.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7fec002fa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febf815f1f0 0x7febf80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7fec002fa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf80cfc60 0x7febf80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7fec002fa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf815e7a0 con 0x7febf815ab10 2023-10-16T13:38:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7fec002fa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf80d00d0 con 0x7febf815f1f0 2023-10-16T13:38:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7fec002fa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80b29a0 con 0x7febf80cfc60 2023-10-16T13:38:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7febfd895700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febf815f1f0 0x7febf80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7febfd895700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febf815f1f0 0x7febf80cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43016/0 (socket says 172.21.15.5:43016) 2023-10-16T13:38:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.566+0000 7febfd895700 1 -- 172.21.15.5:0/4209286058 learned_addr learned my addr 172.21.15.5:0/4209286058 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfe897700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf80cfc60 0x7febf80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd895700 1 -- 172.21.15.5:0/4209286058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf80cfc60 msgr2=0x7febf80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd895700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf80cfc60 0x7febf80cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd895700 1 -- 172.21.15.5:0/4209286058 >> v1:172.21.15.112:6789/0 conn(0x7febf815ab10 legacy=0x7febf80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd895700 1 -- 172.21.15.5:0/4209286058 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80b2c80 con 0x7febf815f1f0 2023-10-16T13:38:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfe897700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf80cfc60 0x7febf80cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd895700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf815f1f0 0x7febf80cf720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7febf4006fd0 tx=0x7febf400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4bdcfb9e049faa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd094700 1 -- 172.21.15.5:0/4209286058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4005e30 con 0x7febf815f1f0 2023-10-16T13:38:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd094700 1 -- 172.21.15.5:0/4209286058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400d8e0 con 0x7febf815f1f0 2023-10-16T13:38:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.567+0000 7febfd094700 1 -- 172.21.15.5:0/4209286058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400dc70 con 0x7febf815f1f0 2023-10-16T13:38:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 -- 172.21.15.5:0/4209286058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf815f1f0 msgr2=0x7febf80cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf815f1f0 0x7febf80cf720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7febf4006fd0 tx=0x7febf400be70 comp rx=0 tx=0).stop 2023-10-16T13:38:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 -- 172.21.15.5:0/4209286058 shutdown_connections 2023-10-16T13:38:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf80cfc60 0x7febf80cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 --2- 172.21.15.5:0/4209286058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf815f1f0 0x7febf80cf720 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 -- 172.21.15.5:0/4209286058 >> 172.21.15.5:0/4209286058 conn(0x7febf806dae0 msgr2=0x7febf806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 -- 172.21.15.5:0/4209286058 shutdown_connections 2023-10-16T13:38:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.568+0000 7fec002fa700 1 -- 172.21.15.5:0/4209286058 wait complete. 2023-10-16T13:38:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.569+0000 7fec002fa700 1 Processor -- start 2023-10-16T13:38:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.569+0000 7fec002fa700 1 -- start start 2023-10-16T13:38:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 0x7febf81f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf815ab10 0x7febf80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf815f1f0 0x7febf80c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf815c950 con 0x7febf80cfc60 2023-10-16T13:38:58.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf815d4d0 con 0x7febf815ab10 2023-10-16T13:38:58.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf815cba0 con 0x7febf815f1f0 2023-10-16T13:38:58.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 0x7febf81f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 0x7febf81f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43020/0 (socket says 172.21.15.5:43020) 2023-10-16T13:38:58.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 -- 172.21.15.5:0/1620260908 learned_addr learned my addr 172.21.15.5:0/1620260908 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:58.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfd895700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf815ab10 0x7febf80c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe897700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf815f1f0 0x7febf80c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 -- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf815f1f0 msgr2=0x7febf80c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf815f1f0 0x7febf80c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 -- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf815ab10 msgr2=0x7febf80c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf815ab10 0x7febf80c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 -- 172.21.15.5:0/1620260908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf400b7a0 con 0x7febf80cfc60 2023-10-16T13:38:58.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febfe096700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 0x7febf81f2e20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7febe800b4a0 tx=0x7febe800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011830 con 0x7febf80cfc60 2023-10-16T13:38:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8011990 con 0x7febf80cfc60 2023-10-16T13:38:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011d40 con 0x7febf80cfc60 2023-10-16T13:38:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.570+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf815ce80 con 0x7febf80cfc60 2023-10-16T13:38:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.571+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf81f3360 con 0x7febf80cfc60 2023-10-16T13:38:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.571+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf81f3550 con 0x7febf80cfc60 2023-10-16T13:38:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.572+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7febe801a400 con 0x7febf80cfc60 2023-10-16T13:38:58.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.572+0000 7febeeffd700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febdc06af00 0x7febdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.572+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febe8089180 con 0x7febf80cfc60 2023-10-16T13:38:58.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.572+0000 7febfd895700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febdc06af00 0x7febdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.573+0000 7febfd895700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febdc06af00 0x7febdc06d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7febf4000c00 tx=0x7febf401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.577+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febe80542c0 con 0x7febf80cfc60 2023-10-16T13:38:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.777+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febf8067d20 con 0x7febf80cfc60 2023-10-16T13:38:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.777+0000 7febeeffd700 1 -- 172.21.15.5:0/1620260908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7febe80578e0 con 0x7febf80cfc60 2023-10-16T13:38:58.780 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:38:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.779+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febdc06af00 msgr2=0x7febdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.779+0000 7fec002fa700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febdc06af00 0x7febdc06d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7febf4000c00 tx=0x7febf401c040 comp rx=0 tx=0).stop 2023-10-16T13:38:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.779+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 msgr2=0x7febf81f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.779+0000 7fec002fa700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 0x7febf81f2e20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7febe800b4a0 tx=0x7febe800b7b0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 shutdown_connections 2023-10-16T13:38:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febdc06af00 0x7febdc06d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febf815f1f0 0x7febf80c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf80cfc60 0x7febf81f2e20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 --2- 172.21.15.5:0/1620260908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf815ab10 0x7febf80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 >> 172.21.15.5:0/1620260908 conn(0x7febf806dae0 msgr2=0x7febf806b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 shutdown_connections 2023-10-16T13:38:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.780+0000 7fec002fa700 1 -- 172.21.15.5:0/1620260908 wait complete. 2023-10-16T13:38:58.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:38:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.918+0000 7faf9230d700 1 Processor -- start 2023-10-16T13:38:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.918+0000 7faf9230d700 1 -- start start 2023-10-16T13:38:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf9230d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf8c161670 0x7faf8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf9230d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 0x7faf8c06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf9230d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8c071ab0 con 0x7faf8c0cc3f0 2023-10-16T13:38:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf9230d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c161bc0 con 0x7faf8c161670 2023-10-16T13:38:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf9230d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c161ea0 con 0x7faf8c0b2950 2023-10-16T13:38:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf8c0cc3f0 0x7faf8c0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53032/0 (socket says 172.21.15.5:53032) 2023-10-16T13:38:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8bfff700 1 -- 172.21.15.5:0/2860522314 learned_addr learned my addr 172.21.15.5:0/2860522314 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:38:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf908aa700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 0x7faf8c06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8b7fe700 1 --2- 172.21.15.5:0/2860522314 >> v2:172.21.15.112:3300/0 conn(0x7faf8c161670 0x7faf8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16619397 0 0) 0x7faf8c071ab0 con 0x7faf8c0cc3f0 2023-10-16T13:38:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf780035b0 con 0x7faf8c0cc3f0 2023-10-16T13:38:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870852151 0 0) 0x7faf780035b0 con 0x7faf8c0cc3f0 2023-10-16T13:38:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 msgr2=0x7faf8c06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.919+0000 7faf8affd700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 0x7faf8c06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 >> v2:172.21.15.112:3300/0 conn(0x7faf8c161670 msgr2=0x7faf8c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 --2- 172.21.15.5:0/2860522314 >> v2:172.21.15.112:3300/0 conn(0x7faf8c161670 0x7faf8c06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c162180 con 0x7faf8c0cc3f0 2023-10-16T13:38:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7faf74001670 con 0x7faf8c0cc3f0 2023-10-16T13:38:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 >> v1:172.21.15.5:6789/0 conn(0x7faf8c0cc3f0 legacy=0x7faf8c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf78003a00 0x7faf78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 0x7faf78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78004d90 0x7faf78005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c161bc0 con 0x7faf78004d90 2023-10-16T13:38:58.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c161ea0 con 0x7faf78003a00 2023-10-16T13:38:58.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7800ba10 con 0x7faf8c0b2950 2023-10-16T13:38:58.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78004d90 0x7faf78005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8bfff700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf78003a00 0x7faf78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8b7fe700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 0x7faf78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 -- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 msgr2=0x7faf78004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0b2950 0x7faf78004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 -- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf78003a00 msgr2=0x7faf78003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf78003a00 0x7faf78003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 -- 172.21.15.5:0/2860522314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780035b0 con 0x7faf78004d90 2023-10-16T13:38:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf908aa700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78004d90 0x7faf78005210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf8400e170 tx=0x7faf78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20350675f1a2a2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400ec90 con 0x7faf78004d90 2023-10-16T13:38:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8400f040 con 0x7faf78004d90 2023-10-16T13:38:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.920+0000 7faf8affd700 1 -- 172.21.15.5:0/2860522314 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84014480 con 0x7faf78004d90 2023-10-16T13:38:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf9230d700 1 -- 172.21.15.5:0/2860522314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78004d90 msgr2=0x7faf78005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf9230d700 1 --2- 172.21.15.5:0/2860522314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78004d90 0x7faf78005210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf8400e170 tx=0x7faf78005880 comp rx=0 tx=0).stop 2023-10-16T13:38:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf908aa700 1 -- 172.21.15.5:0/2860522314 reap_dead start 2023-10-16T13:38:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf9230d700 1 -- 172.21.15.5:0/2860522314 shutdown_connections 2023-10-16T13:38:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf9230d700 1 -- 172.21.15.5:0/2860522314 >> 172.21.15.5:0/2860522314 conn(0x7faf8c06dac0 msgr2=0x7faf8c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf9230d700 1 -- 172.21.15.5:0/2860522314 shutdown_connections 2023-10-16T13:38:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.921+0000 7faf9230d700 1 -- 172.21.15.5:0/2860522314 wait complete. 2023-10-16T13:38:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.922+0000 7faf9230d700 1 Processor -- start 2023-10-16T13:38:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.922+0000 7faf9230d700 1 -- start start 2023-10-16T13:38:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf9230d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf78004d90 0x7faf8c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf9230d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b4480 0x7faf8c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf9230d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 0x7faf8c15f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf9230d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b4e60 con 0x7faf8c0b4900 2023-10-16T13:38:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf9230d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b5140 con 0x7faf8c0b4480 2023-10-16T13:38:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf9230d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b5420 con 0x7faf78004d90 2023-10-16T13:38:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 0x7faf8c15f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 0x7faf8c15f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43044/0 (socket says 172.21.15.5:43044) 2023-10-16T13:38:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 -- 172.21.15.5:0/3015912000 learned_addr learned my addr 172.21.15.5:0/3015912000 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf8bfff700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf78004d90 0x7faf8c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf8b7fe700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b4480 0x7faf8c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 -- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf78004d90 msgr2=0x7faf8c0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf78004d90 0x7faf8c0ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 -- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b4480 msgr2=0x7faf8c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b4480 0x7faf8c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf908aa700 1 -- 172.21.15.5:0/3015912000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0cd060 con 0x7faf8c0b4900 2023-10-16T13:38:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf8bfff700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf78004d90 0x7faf8c0ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.923+0000 7faf8b7fe700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b4480 0x7faf8c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.924+0000 7faf908aa700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 0x7faf8c15f9e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf84016000 tx=0x7faf84009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.924+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84007000 con 0x7faf8c0b4900 2023-10-16T13:38:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.924+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8400ee80 con 0x7faf8c0b4900 2023-10-16T13:38:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.924+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84003c60 con 0x7faf8c0b4900 2023-10-16T13:38:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.924+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c0b5700 con 0x7faf8c0b4900 2023-10-16T13:38:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.924+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c0ac9d0 con 0x7faf8c0b4900 2023-10-16T13:38:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.925+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c0acb90 con 0x7faf8c0b4900 2023-10-16T13:38:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.925+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf84023020 con 0x7faf8c0b4900 2023-10-16T13:38:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.926+0000 7faf88ff9700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf6c06af00 0x7faf6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.926+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8408abe0 con 0x7faf8c0b4900 2023-10-16T13:38:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.926+0000 7faf8bfff700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf6c06af00 0x7faf6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.927+0000 7faf8bfff700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf6c06af00 0x7faf6c06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf74000fb0 tx=0x7faf74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:58.931+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf84055e40 con 0x7faf8c0b4900 2023-10-16T13:38:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.148+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf8c067d20 con 0x7faf8c0b4900 2023-10-16T13:38:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.148+0000 7faf88ff9700 1 -- 172.21.15.5:0/3015912000 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf84059460 con 0x7faf8c0b4900 2023-10-16T13:38:59.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf6c06af00 msgr2=0x7faf6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf6c06af00 0x7faf6c06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf74000fb0 tx=0x7faf74009040 comp rx=0 tx=0).stop 2023-10-16T13:38:59.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 msgr2=0x7faf8c15f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 0x7faf8c15f9e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf84016000 tx=0x7faf84009750 comp rx=0 tx=0).stop 2023-10-16T13:38:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 shutdown_connections 2023-10-16T13:38:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0b4900 0x7faf8c15f9e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf6c06af00 0x7faf6c06d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf78004d90 0x7faf8c0ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 --2- 172.21.15.5:0/3015912000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b4480 0x7faf8c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 >> 172.21.15.5:0/3015912000 conn(0x7faf8c06dac0 msgr2=0x7faf8c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 shutdown_connections 2023-10-16T13:38:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.150+0000 7faf9230d700 1 -- 172.21.15.5:0/3015912000 wait complete. 2023-10-16T13:38:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:38:59.164 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:38:59.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:59.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-16T13:38:59.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:38:59.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:38:59.218 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:38:59.242 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:59.242 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:59.264 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:59.264 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:59.324 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:38:59.324 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:38:59.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:38:59.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.507+0000 7f5ba8532700 1 Processor -- start 2023-10-16T13:38:59.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.507+0000 7f5ba8532700 1 -- start start 2023-10-16T13:38:59.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba8532700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba015dbc0 0x7f5ba015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba8532700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ba00b7050 0x7f5ba00d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba8532700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba015e4e0 con 0x7f5ba00d3fc0 2023-10-16T13:38:59.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba8532700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba00b7560 con 0x7f5ba015dbc0 2023-10-16T13:38:59.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba8532700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba00b7840 con 0x7f5ba00b7050 2023-10-16T13:38:59.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba015dbc0 0x7f5ba015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba015dbc0 0x7f5ba015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43048/0 (socket says 172.21.15.5:43048) 2023-10-16T13:38:59.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 -- 172.21.15.5:0/2556403 learned_addr learned my addr 172.21.15.5:0/2556403 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:59.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba6acf700 1 --2- 172.21.15.5:0/2556403 >> v2:172.21.15.112:3300/0 conn(0x7f5ba00b7050 0x7f5ba00d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 -- 172.21.15.5:0/2556403 >> v2:172.21.15.112:3300/0 conn(0x7f5ba00b7050 msgr2=0x7f5ba00d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:59.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 --2- 172.21.15.5:0/2556403 >> v2:172.21.15.112:3300/0 conn(0x7f5ba00b7050 0x7f5ba00d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 -- 172.21.15.5:0/2556403 >> v1:172.21.15.112:6789/0 conn(0x7f5ba00d3fc0 legacy=0x7f5ba00d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.508+0000 7f5ba62ce700 1 -- 172.21.15.5:0/2556403 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba00b7b20 con 0x7f5ba015dbc0 2023-10-16T13:38:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba62ce700 1 --2- 172.21.15.5:0/2556403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba015dfa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00cdea0 tx=0x7f5b90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7338f4b0f3af0c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba52cc700 1 -- 172.21.15.5:0/2556403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90005e30 con 0x7f5ba015dbc0 2023-10-16T13:38:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba52cc700 1 -- 172.21.15.5:0/2556403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b90006030 con 0x7f5ba015dbc0 2023-10-16T13:38:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba52cc700 1 -- 172.21.15.5:0/2556403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900063e0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 -- 172.21.15.5:0/2556403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 msgr2=0x7f5ba015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 --2- 172.21.15.5:0/2556403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba015dfa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00cdea0 tx=0x7f5b90009bd0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 -- 172.21.15.5:0/2556403 shutdown_connections 2023-10-16T13:38:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 --2- 172.21.15.5:0/2556403 >> v2:172.21.15.112:3300/0 conn(0x7f5ba00b7050 0x7f5ba00d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 --2- 172.21.15.5:0/2556403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba015dfa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 -- 172.21.15.5:0/2556403 >> 172.21.15.5:0/2556403 conn(0x7f5ba009cb40 msgr2=0x7f5ba00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:59.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 -- 172.21.15.5:0/2556403 shutdown_connections 2023-10-16T13:38:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.509+0000 7f5ba8532700 1 -- 172.21.15.5:0/2556403 wait complete. 2023-10-16T13:38:59.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 Processor -- start 2023-10-16T13:38:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 -- start start 2023-10-16T13:38:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ba00b7050 0x7f5ba00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ba00d3fc0 0x7f5ba00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba01f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0158b90 con 0x7f5ba015dbc0 2023-10-16T13:38:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0157f10 con 0x7f5ba00b7050 2023-10-16T13:38:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.511+0000 7f5ba8532700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba01581f0 con 0x7f5ba00d3fc0 2023-10-16T13:38:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba01f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba62ce700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ba00b7050 0x7f5ba00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba01f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43058/0 (socket says 172.21.15.5:43058) 2023-10-16T13:38:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 -- 172.21.15.5:0/384063325 learned_addr learned my addr 172.21.15.5:0/384063325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:59.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba5acd700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ba00d3fc0 0x7f5ba00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 -- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ba00d3fc0 msgr2=0x7f5ba00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ba00d3fc0 0x7f5ba00cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 -- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ba00b7050 msgr2=0x7f5ba00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ba00b7050 0x7f5ba00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 -- 172.21.15.5:0/384063325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009500 con 0x7f5ba015dbc0 2023-10-16T13:38:59.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba5acd700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ba00d3fc0 0x7f5ba00cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:38:59.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba6acf700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba01f2f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b98007e40 tx=0x7f5b9800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:59.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9800ede0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98014420 con 0x7f5ba015dbc0 2023-10-16T13:38:59.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba01584d0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980147d0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.512+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba00c97b0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.513+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba0158cd0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.514+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5b98014930 con 0x7f5ba015dbc0 2023-10-16T13:38:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.515+0000 7f5b96ffd700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b8406af00 0x7f5b8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.515+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b9808a950 con 0x7f5ba015dbc0 2023-10-16T13:38:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.515+0000 7f5ba62ce700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b8406af00 0x7f5b8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.515+0000 7f5ba62ce700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b8406af00 0x7f5b8406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00cdea0 tx=0x7f5b90008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.519+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b98055b70 con 0x7f5ba015dbc0 2023-10-16T13:38:59.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.723+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba0158cd0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.725+0000 7f5b96ffd700 1 -- 172.21.15.5:0/384063325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f5ba0158cd0 con 0x7f5ba015dbc0 2023-10-16T13:38:59.727 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:38:59.728 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:38:59.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b8406af00 msgr2=0x7f5b8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b8406af00 0x7f5b8406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00cdea0 tx=0x7f5b90008070 comp rx=0 tx=0).stop 2023-10-16T13:38:59.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 msgr2=0x7f5ba01f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba01f2f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b98007e40 tx=0x7f5b9800e3c0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 shutdown_connections 2023-10-16T13:38:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba015dbc0 0x7f5ba01f2f10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ba00b7050 0x7f5ba00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b8406af00 0x7f5b8406d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 --2- 172.21.15.5:0/384063325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ba00d3fc0 0x7f5ba00cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 >> 172.21.15.5:0/384063325 conn(0x7f5ba009cb40 msgr2=0x7f5ba0155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 shutdown_connections 2023-10-16T13:38:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.727+0000 7f5ba8532700 1 -- 172.21.15.5:0/384063325 wait complete. 2023-10-16T13:38:59.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:38:59.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:38:59.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.867+0000 7f52fc4a8700 1 Processor -- start 2023-10-16T13:38:59.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.868+0000 7f52fc4a8700 1 -- start start 2023-10-16T13:38:59.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fc4a8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52f415b9c0 0x7f52f40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fc4a8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f406e220 0x7f52f40cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fc4a8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40cae20 con 0x7f52f40cf850 2023-10-16T13:38:59.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fc4a8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f40cbaa0 con 0x7f52f415b9c0 2023-10-16T13:38:59.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fc4a8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40d0210 con 0x7f52f406e220 2023-10-16T13:38:59.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52f415b9c0 0x7f52f40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52f415b9c0 0x7f52f40b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43062/0 (socket says 172.21.15.5:43062) 2023-10-16T13:38:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 -- 172.21.15.5:0/1407111572 learned_addr learned my addr 172.21.15.5:0/1407111572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52faa45700 1 --2- 172.21.15.5:0/1407111572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f406e220 0x7f52f40cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 -- 172.21.15.5:0/1407111572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f406e220 msgr2=0x7f52f40cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:38:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 --2- 172.21.15.5:0/1407111572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f406e220 0x7f52f40cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 -- 172.21.15.5:0/1407111572 >> v1:172.21.15.112:6789/0 conn(0x7f52f40cf850 legacy=0x7f52f40cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.869+0000 7f52fa244700 1 -- 172.21.15.5:0/1407111572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40cb100 con 0x7f52f415b9c0 2023-10-16T13:38:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fa244700 1 --2- 172.21.15.5:0/1407111572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f415b9c0 0x7f52f40b3aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52e40098f0 tx=0x7f52e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677d79599f5f92c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52f9242700 1 -- 172.21.15.5:0/1407111572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4011830 con 0x7f52f415b9c0 2023-10-16T13:38:59.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52f9242700 1 -- 172.21.15.5:0/1407111572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4011990 con 0x7f52f415b9c0 2023-10-16T13:38:59.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52f9242700 1 -- 172.21.15.5:0/1407111572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4011d20 con 0x7f52f415b9c0 2023-10-16T13:38:59.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 -- 172.21.15.5:0/1407111572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f415b9c0 msgr2=0x7f52f40b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/1407111572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f415b9c0 0x7f52f40b3aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52e40098f0 tx=0x7f52e4009c00 comp rx=0 tx=0).stop 2023-10-16T13:38:59.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 -- 172.21.15.5:0/1407111572 shutdown_connections 2023-10-16T13:38:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/1407111572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f406e220 0x7f52f40cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/1407111572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f415b9c0 0x7f52f40b3aa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 -- 172.21.15.5:0/1407111572 >> 172.21.15.5:0/1407111572 conn(0x7f52f406ac60 msgr2=0x7f52f406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:38:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 -- 172.21.15.5:0/1407111572 shutdown_connections 2023-10-16T13:38:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.870+0000 7f52fc4a8700 1 -- 172.21.15.5:0/1407111572 wait complete. 2023-10-16T13:38:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 Processor -- start 2023-10-16T13:38:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 -- start start 2023-10-16T13:38:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 0x7f52f40c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f40cf850 0x7f52f41584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f415b9c0 0x7f52f41f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4158a10 con 0x7f52f406e220 2023-10-16T13:38:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41f4bc0 con 0x7f52f40cf850 2023-10-16T13:38:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fc4a8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41f1090 con 0x7f52f415b9c0 2023-10-16T13:38:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fa244700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 0x7f52f40c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fa244700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 0x7f52f40c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43068/0 (socket says 172.21.15.5:43068) 2023-10-16T13:38:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.872+0000 7f52fa244700 1 -- 172.21.15.5:0/315562386 learned_addr learned my addr 172.21.15.5:0/315562386 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:38:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52f9a43700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f40cf850 0x7f52f41584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fa244700 1 -- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f415b9c0 msgr2=0x7f52f41f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52faa45700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f415b9c0 0x7f52f41f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fa244700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f415b9c0 0x7f52f41f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fa244700 1 -- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f40cf850 msgr2=0x7f52f41584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:38:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fa244700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f40cf850 0x7f52f41584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:38:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fa244700 1 -- 172.21.15.5:0/315562386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4009550 con 0x7f52f406e220 2023-10-16T13:38:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52f9a43700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f40cf850 0x7f52f41584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:38:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fa244700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 0x7f52f40c93e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009c40 tx=0x7f52e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40036a0 con 0x7f52f406e220 2023-10-16T13:38:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e401f070 con 0x7f52f406e220 2023-10-16T13:38:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f41f4e00 con 0x7f52f406e220 2023-10-16T13:38:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003a40 con 0x7f52f406e220 2023-10-16T13:38:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.873+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f41f53c0 con 0x7f52f406e220 2023-10-16T13:38:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.874+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f404ebb0 con 0x7f52f406e220 2023-10-16T13:38:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.874+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52e4003ba0 con 0x7f52f406e220 2023-10-16T13:38:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.875+0000 7f52eaffd700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52d806af00 0x7f52d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:38:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.875+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52e4021070 con 0x7f52f406e220 2023-10-16T13:38:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.875+0000 7f52f9a43700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52d806af00 0x7f52d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:38:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.876+0000 7f52f9a43700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52d806af00 0x7f52d806d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f52f41eec80 tx=0x7f52f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:38:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:38:59.880+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52e40560f0 con 0x7f52f406e220 2023-10-16T13:39:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.081+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52f4072cc0 con 0x7f52f406e220 2023-10-16T13:39:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.081+0000 7f52eaffd700 1 -- 172.21.15.5:0/315562386 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52e4015020 con 0x7f52f406e220 2023-10-16T13:39:00.084 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52d806af00 msgr2=0x7f52d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52d806af00 0x7f52d806d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f52f41eec80 tx=0x7f52f0009040 comp rx=0 tx=0).stop 2023-10-16T13:39:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 msgr2=0x7f52f40c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 0x7f52f40c93e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009c40 tx=0x7f52e4004750 comp rx=0 tx=0).stop 2023-10-16T13:39:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 shutdown_connections 2023-10-16T13:39:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f52d806af00 0x7f52d806d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52f415b9c0 0x7f52f41f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52f406e220 0x7f52f40c93e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 --2- 172.21.15.5:0/315562386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f40cf850 0x7f52f41584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 >> 172.21.15.5:0/315562386 conn(0x7f52f406ac60 msgr2=0x7f52f40b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 shutdown_connections 2023-10-16T13:39:00.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.083+0000 7f52fc4a8700 1 -- 172.21.15.5:0/315562386 wait complete. 2023-10-16T13:39:00.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:00.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.223+0000 7fefc3c5d700 1 Processor -- start 2023-10-16T13:39:00.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.223+0000 7fefc3c5d700 1 -- start start 2023-10-16T13:39:00.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc3c5d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fefbc0b7ab0 0x7fefbc0d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc3c5d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0b6610 con 0x7fefbc160e30 2023-10-16T13:39:00.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc3c5d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0d1da0 con 0x7fefbc0d08a0 2023-10-16T13:39:00.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc3c5d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc0d2080 con 0x7fefbc0b7ab0 2023-10-16T13:39:00.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc19f9700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fefbc160e30 0x7fefbc0d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53080/0 (socket says 172.21.15.5:53080) 2023-10-16T13:39:00.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc19f9700 1 -- 172.21.15.5:0/1686716232 learned_addr learned my addr 172.21.15.5:0/1686716232 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:00.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc21fa700 1 --2- 172.21.15.5:0/1686716232 >> v2:172.21.15.112:3300/0 conn(0x7fefbc0b7ab0 0x7fefbc0d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733336675 0 0) 0x7fefbc0b6610 con 0x7fefbc160e30 2023-10-16T13:39:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa80035b0 con 0x7fefbc160e30 2023-10-16T13:39:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153673608 0 0) 0x7fefa80035b0 con 0x7fefbc160e30 2023-10-16T13:39:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 >> v2:172.21.15.112:3300/0 conn(0x7fefbc0b7ab0 msgr2=0x7fefbc0d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 --2- 172.21.15.5:0/1686716232 >> v2:172.21.15.112:3300/0 conn(0x7fefbc0b7ab0 0x7fefbc0d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 >> v1:172.21.15.112:6789/0 conn(0x7fefbc0d08a0 legacy=0x7fefbc0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.224+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0d2360 con 0x7fefbc160e30 2023-10-16T13:39:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fefb80017f0 con 0x7fefbc160e30 2023-10-16T13:39:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 >> v1:172.21.15.5:6789/0 conn(0x7fefbc160e30 legacy=0x7fefbc0d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8003a00 0x7fefa8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa8004850 0x7fefa8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8005210 0x7fefa800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0d2080 con 0x7fefa8005210 2023-10-16T13:39:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa800c1b0 con 0x7fefa8004850 2023-10-16T13:39:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa800c370 con 0x7fefa8003a00 2023-10-16T13:39:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 --2- 172.21.15.5:0/1686716232 >> v2:172.21.15.112:3300/0 conn(0x7fefbc0b7ab0 0x7fefbc0d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8005210 0x7fefa800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc11f8700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa8004850 0x7fefa8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc19f9700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8003a00 0x7fefa8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 -- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8003a00 msgr2=0x7fefa8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8003a00 0x7fefa8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 -- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa8004850 msgr2=0x7fefa8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa8004850 0x7fefa8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 -- 172.21.15.5:0/1686716232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80035b0 con 0x7fefa8005210 2023-10-16T13:39:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 -- 172.21.15.5:0/1686716232 reap_dead start 2023-10-16T13:39:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc21fa700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8005210 0x7fefa800ba10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e320 tx=0x7fefa8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b6562e5cd276cf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400edc0 con 0x7fefa8005210 2023-10-16T13:39:00.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400f040 con 0x7fefa8005210 2023-10-16T13:39:00.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.225+0000 7fefc09f7700 1 -- 172.21.15.5:0/1686716232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4003c60 con 0x7fefa8005210 2023-10-16T13:39:00.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 -- 172.21.15.5:0/1686716232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8005210 msgr2=0x7fefa800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8005210 0x7fefa800ba10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e320 tx=0x7fefa8005880 comp rx=0 tx=0).stop 2023-10-16T13:39:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 -- 172.21.15.5:0/1686716232 shutdown_connections 2023-10-16T13:39:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/1686716232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8005210 0x7fefa800ba10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 -- 172.21.15.5:0/1686716232 >> 172.21.15.5:0/1686716232 conn(0x7fefbc09cb40 msgr2=0x7fefbc0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 -- 172.21.15.5:0/1686716232 shutdown_connections 2023-10-16T13:39:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.226+0000 7fefc3c5d700 1 -- 172.21.15.5:0/1686716232 wait complete. 2023-10-16T13:39:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.227+0000 7fefc3c5d700 1 Processor -- start 2023-10-16T13:39:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.227+0000 7fefc3c5d700 1 -- start start 2023-10-16T13:39:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc3c5d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8005210 0x7fefbc0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc3c5d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 0x7fefbc1f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc3c5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefbc0cb8c0 0x7fefbc0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc3c5d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1f48f0 con 0x7fefbc1f6650 2023-10-16T13:39:00.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc3c5d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0cc280 con 0x7fefbc0cb8c0 2023-10-16T13:39:00.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc3c5d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1f71c0 con 0x7fefa8005210 2023-10-16T13:39:00.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 0x7fefbc1f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 0x7fefbc1f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43090/0 (socket says 172.21.15.5:43090) 2023-10-16T13:39:00.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 -- 172.21.15.5:0/2906571675 learned_addr learned my addr 172.21.15.5:0/2906571675 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:00.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc19f9700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8005210 0x7fefbc0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc21fa700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefbc0cb8c0 0x7fefbc0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 -- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8005210 msgr2=0x7fefbc0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8005210 0x7fefbc0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 -- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefbc0cb8c0 msgr2=0x7fefbc0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefbc0cb8c0 0x7fefbc0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.228+0000 7fefc11f8700 1 -- 172.21.15.5:0/2906571675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc1f4230 con 0x7fefbc1f6650 2023-10-16T13:39:00.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.229+0000 7fefc11f8700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 0x7fefbc1f6ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefac00f610 tx=0x7fefac00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.229+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0052e0 con 0x7fefbc1f6650 2023-10-16T13:39:00.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.229+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac005440 con 0x7fefbc1f6650 2023-10-16T13:39:00.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.229+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc1f4510 con 0x7fefbc1f6650 2023-10-16T13:39:00.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.229+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0038a0 con 0x7fefbc1f6650 2023-10-16T13:39:00.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.229+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1f33a0 con 0x7fefbc1f6650 2023-10-16T13:39:00.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.230+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc067d20 con 0x7fefbc1f6650 2023-10-16T13:39:00.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.230+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefac003a00 con 0x7fefbc1f6650 2023-10-16T13:39:00.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.231+0000 7fefb27fc700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefa006af00 0x7fefa006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.231+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefac0890b0 con 0x7fefbc1f6650 2023-10-16T13:39:00.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.231+0000 7fefc19f9700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefa006af00 0x7fefa006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.231+0000 7fefc19f9700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefa006af00 0x7fefa006d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fefb8001e10 tx=0x7fefb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.235+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefac0541f0 con 0x7fefbc1f6650 2023-10-16T13:39:00.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.433+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefbc0c6e90 con 0x7fefbc1f6650 2023-10-16T13:39:00.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.434+0000 7fefb27fc700 1 -- 172.21.15.5:0/2906571675 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefac003cb0 con 0x7fefbc1f6650 2023-10-16T13:39:00.437 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:00.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefa006af00 msgr2=0x7fefa006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefa006af00 0x7fefa006d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fefb8001e10 tx=0x7fefb8009040 comp rx=0 tx=0).stop 2023-10-16T13:39:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 msgr2=0x7fefbc1f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 0x7fefbc1f6ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefac00f610 tx=0x7fefac00f920 comp rx=0 tx=0).stop 2023-10-16T13:39:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 shutdown_connections 2023-10-16T13:39:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefbc0cb8c0 0x7fefbc0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fefa006af00 0x7fefa006d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa8005210 0x7fefbc0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 --2- 172.21.15.5:0/2906571675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefbc1f6650 0x7fefbc1f6ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 >> 172.21.15.5:0/2906571675 conn(0x7fefbc09cb40 msgr2=0x7fefbc0ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:00.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 shutdown_connections 2023-10-16T13:39:00.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.436+0000 7fefc3c5d700 1 -- 172.21.15.5:0/2906571675 wait complete. 2023-10-16T13:39:00.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.577+0000 7f3574060700 1 Processor -- start 2023-10-16T13:39:00.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.577+0000 7f3574060700 1 -- start start 2023-10-16T13:39:00.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3574060700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f356c160e30 0x7f356c0d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3574060700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f356c161210 0x7f356c0d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3574060700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0b6610 con 0x7f356c0d06d0 2023-10-16T13:39:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3574060700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0d0b40 con 0x7f356c161210 2023-10-16T13:39:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3574060700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0d1da0 con 0x7f356c160e30 2023-10-16T13:39:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f356c161210 0x7f356c0d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f356c161210 0x7f356c0d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43096/0 (socket says 172.21.15.5:43096) 2023-10-16T13:39:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 -- 172.21.15.5:0/991781628 learned_addr learned my addr 172.21.15.5:0/991781628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35725fd700 1 --1- 172.21.15.5:0/991781628 >> v1:172.21.15.5:6789/0 conn(0x7f356c0d06d0 0x7f356c0b6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53102/0 (socket says 172.21.15.5:53102) 2023-10-16T13:39:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3571dfc700 1 --2- 172.21.15.5:0/991781628 >> v2:172.21.15.112:3300/0 conn(0x7f356c160e30 0x7f356c0d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 -- 172.21.15.5:0/991781628 >> v2:172.21.15.112:3300/0 conn(0x7f356c160e30 msgr2=0x7f356c0d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 --2- 172.21.15.5:0/991781628 >> v2:172.21.15.112:3300/0 conn(0x7f356c160e30 0x7f356c0d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 -- 172.21.15.5:0/991781628 >> v1:172.21.15.5:6789/0 conn(0x7f356c0d06d0 legacy=0x7f356c0b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 -- 172.21.15.5:0/991781628 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0d2080 con 0x7f356c161210 2023-10-16T13:39:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3571dfc700 1 --2- 172.21.15.5:0/991781628 >> v2:172.21.15.112:3300/0 conn(0x7f356c160e30 0x7f356c0d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f35715fb700 1 --2- 172.21.15.5:0/991781628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c161210 0x7f356c0d0190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f356c08c920 tx=0x7f355c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d288e718e9d9075 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.578+0000 7f3570dfa700 1 -- 172.21.15.5:0/991781628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00b870 con 0x7f356c161210 2023-10-16T13:39:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3570dfa700 1 -- 172.21.15.5:0/991781628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c00b9d0 con 0x7f356c161210 2023-10-16T13:39:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3570dfa700 1 -- 172.21.15.5:0/991781628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00bd60 con 0x7f356c161210 2023-10-16T13:39:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 -- 172.21.15.5:0/991781628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c161210 msgr2=0x7f356c0d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 --2- 172.21.15.5:0/991781628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c161210 0x7f356c0d0190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f356c08c920 tx=0x7f355c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 -- 172.21.15.5:0/991781628 shutdown_connections 2023-10-16T13:39:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 --2- 172.21.15.5:0/991781628 >> v2:172.21.15.112:3300/0 conn(0x7f356c160e30 0x7f356c0d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 --2- 172.21.15.5:0/991781628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c161210 0x7f356c0d0190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 -- 172.21.15.5:0/991781628 >> 172.21.15.5:0/991781628 conn(0x7f356c09cb40 msgr2=0x7f356c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 -- 172.21.15.5:0/991781628 shutdown_connections 2023-10-16T13:39:00.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.579+0000 7f3574060700 1 -- 172.21.15.5:0/991781628 wait complete. 2023-10-16T13:39:00.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.581+0000 7f3574060700 1 Processor -- start 2023-10-16T13:39:00.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.581+0000 7f3574060700 1 -- start start 2023-10-16T13:39:00.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3574060700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f356c0d06d0 0x7f356c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3574060700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 0x7f356c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3574060700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f356c161210 0x7f356c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3574060700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c15b6f0 con 0x7f356c160e30 2023-10-16T13:39:00.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3574060700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c15b990 con 0x7f356c161210 2023-10-16T13:39:00.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3574060700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c15bc70 con 0x7f356c0d06d0 2023-10-16T13:39:00.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 0x7f356c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 0x7f356c15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43102/0 (socket says 172.21.15.5:43102) 2023-10-16T13:39:00.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 -- 172.21.15.5:0/34362680 learned_addr learned my addr 172.21.15.5:0/34362680 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:00.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f3571dfc700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f356c0d06d0 0x7f356c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35725fd700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f356c161210 0x7f356c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 -- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f356c0d06d0 msgr2=0x7f356c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f356c0d06d0 0x7f356c0cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 -- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f356c161210 msgr2=0x7f356c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f356c161210 0x7f356c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35715fb700 1 -- 172.21.15.5:0/34362680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009550 con 0x7f356c160e30 2023-10-16T13:39:00.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.582+0000 7f35725fd700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f356c161210 0x7f356c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:00.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.583+0000 7f35715fb700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 0x7f356c15ca30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c00 tx=0x7f355c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.583+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0128c0 con 0x7f356c160e30 2023-10-16T13:39:00.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.583+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c01e070 con 0x7f356c160e30 2023-10-16T13:39:00.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.583+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c012c40 con 0x7f356c160e30 2023-10-16T13:39:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.583+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c15bf50 con 0x7f356c160e30 2023-10-16T13:39:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.583+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c15c510 con 0x7f356c160e30 2023-10-16T13:39:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.584+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c067d20 con 0x7f356c160e30 2023-10-16T13:39:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.584+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f355c01a420 con 0x7f356c160e30 2023-10-16T13:39:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.585+0000 7f35627fc700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f355006af00 0x7f355006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.585+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f355c08a810 con 0x7f356c160e30 2023-10-16T13:39:00.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.585+0000 7f3571dfc700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f355006af00 0x7f355006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.585+0000 7f3571dfc700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f355006af00 0x7f355006d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35680099c0 tx=0x7f3568008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.589+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f355c0558b0 con 0x7f356c160e30 2023-10-16T13:39:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.790+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f356c0c6e90 con 0x7f356c160e30 2023-10-16T13:39:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.790+0000 7f35627fc700 1 -- 172.21.15.5:0/34362680 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f355c058ed0 con 0x7f356c160e30 2023-10-16T13:39:00.793 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f355006af00 msgr2=0x7f355006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f355006af00 0x7f355006d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35680099c0 tx=0x7f3568008040 comp rx=0 tx=0).stop 2023-10-16T13:39:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 msgr2=0x7f356c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 0x7f356c15ca30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c00 tx=0x7f355c004750 comp rx=0 tx=0).stop 2023-10-16T13:39:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 shutdown_connections 2023-10-16T13:39:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f356c161210 0x7f356c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f355006af00 0x7f355006d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f356c0d06d0 0x7f356c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 --2- 172.21.15.5:0/34362680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c160e30 0x7f356c15ca30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 >> 172.21.15.5:0/34362680 conn(0x7f356c09cb40 msgr2=0x7f356c0b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 shutdown_connections 2023-10-16T13:39:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.792+0000 7f3574060700 1 -- 172.21.15.5:0/34362680 wait complete. 2023-10-16T13:39:00.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:39:00.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.930+0000 7f975b6fa700 1 Processor -- start 2023-10-16T13:39:00.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.931+0000 7f975b6fa700 1 -- start start 2023-10-16T13:39:00.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.931+0000 7f975b6fa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f975415a850 0x7f97540cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f975b6fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f97540cd4b0 0x7f97540ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f975b6fa700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540ce3b0 con 0x7f97540b2940 2023-10-16T13:39:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f975b6fa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97540b2dc0 con 0x7f97540cd4b0 2023-10-16T13:39:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f975b6fa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97540b6290 con 0x7f975415a850 2023-10-16T13:39:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9758c95700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f97540b2940 0x7f97540ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53112/0 (socket says 172.21.15.5:53112) 2023-10-16T13:39:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9758c95700 1 -- 172.21.15.5:0/3591570771 learned_addr learned my addr 172.21.15.5:0/3591570771 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759c97700 1 --2- 172.21.15.5:0/3591570771 >> v2:172.21.15.112:3300/0 conn(0x7f97540cd4b0 0x7f97540ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759496700 1 --2- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f975415a850 0x7f97540cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9747fff700 1 -- 172.21.15.5:0/3591570771 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683536993 0 0) 0x7f97540ce3b0 con 0x7f97540b2940 2023-10-16T13:39:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9747fff700 1 -- 172.21.15.5:0/3591570771 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97400035b0 con 0x7f97540b2940 2023-10-16T13:39:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759c97700 1 -- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f975415a850 msgr2=0x7f97540cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759c97700 1 --2- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f975415a850 0x7f97540cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9747fff700 1 -- 172.21.15.5:0/3591570771 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177838537 0 0) 0x7f97400035b0 con 0x7f97540b2940 2023-10-16T13:39:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759c97700 1 -- 172.21.15.5:0/3591570771 >> v1:172.21.15.5:6789/0 conn(0x7f97540b2940 legacy=0x7f97540ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759c97700 1 -- 172.21.15.5:0/3591570771 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540cc220 con 0x7f97540cd4b0 2023-10-16T13:39:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.932+0000 7f9759c97700 1 --2- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97540ce840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f974c009d90 tx=0x7f974c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a1d1c25b1d253e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f9747fff700 1 -- 172.21.15.5:0/3591570771 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c00e070 con 0x7f97540cd4b0 2023-10-16T13:39:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f9747fff700 1 -- 172.21.15.5:0/3591570771 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c003a20 con 0x7f97540cd4b0 2023-10-16T13:39:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f9747fff700 1 -- 172.21.15.5:0/3591570771 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748001670 con 0x7f97540cd4b0 2023-10-16T13:39:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 -- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 msgr2=0x7f97540ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 --2- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97540ce840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f974c009d90 tx=0x7f974c00b330 comp rx=0 tx=0).stop 2023-10-16T13:39:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 -- 172.21.15.5:0/3591570771 shutdown_connections 2023-10-16T13:39:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 --2- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97540ce840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 --2- 172.21.15.5:0/3591570771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f975415a850 0x7f97540cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 -- 172.21.15.5:0/3591570771 >> 172.21.15.5:0/3591570771 conn(0x7f975406dac0 msgr2=0x7f975406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 -- 172.21.15.5:0/3591570771 shutdown_connections 2023-10-16T13:39:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.933+0000 7f975b6fa700 1 -- 172.21.15.5:0/3591570771 wait complete. 2023-10-16T13:39:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.934+0000 7f975b6fa700 1 Processor -- start 2023-10-16T13:39:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.934+0000 7f975b6fa700 1 -- start start 2023-10-16T13:39:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f975b6fa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97540b2940 0x7f975415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f975b6fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97541520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f975b6fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 0x7f9754158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f975b6fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754152b40 con 0x7f975415a850 2023-10-16T13:39:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f975b6fa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975415b770 con 0x7f97540cd4b0 2023-10-16T13:39:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f975b6fa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975415ba50 con 0x7f97540b2940 2023-10-16T13:39:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f9759c97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 0x7f9754158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f9759c97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 0x7f9754158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43116/0 (socket says 172.21.15.5:43116) 2023-10-16T13:39:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f9759c97700 1 -- 172.21.15.5:0/2735119079 learned_addr learned my addr 172.21.15.5:0/2735119079 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f9759496700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97540b2940 0x7f975415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.935+0000 7f9758c95700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97541520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9759c97700 1 -- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97540b2940 msgr2=0x7f975415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9759c97700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97540b2940 0x7f975415c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9759c97700 1 -- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 msgr2=0x7f97541520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9759c97700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97541520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9759c97700 1 -- 172.21.15.5:0/2735119079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c009a70 con 0x7f975415a850 2023-10-16T13:39:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9759c97700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 0x7f9754158900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f975406d290 tx=0x7f974c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0045f0 con 0x7f975415a850 2023-10-16T13:39:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c004750 con 0x7f975415a850 2023-10-16T13:39:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975415bd30 con 0x7f975415a850 2023-10-16T13:39:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c009450 con 0x7f975415a850 2023-10-16T13:39:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.936+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975415ca70 con 0x7f975415a850 2023-10-16T13:39:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.937+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754067d20 con 0x7f975415a850 2023-10-16T13:39:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.938+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f974c0124b0 con 0x7f975415a850 2023-10-16T13:39:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.938+0000 7f9745ffb700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f973806af00 0x7f973806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.938+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f974c08b710 con 0x7f975415a850 2023-10-16T13:39:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.938+0000 7f9759496700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f973806af00 0x7f973806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.939+0000 7f9759496700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f973806af00 0x7f973806d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97540ceb90 tx=0x7f9750008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:00.943+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f974c05a240 con 0x7f975415a850 2023-10-16T13:39:01.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.161+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97540cb820 con 0x7f975415a850 2023-10-16T13:39:01.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.161+0000 7f9745ffb700 1 -- 172.21.15.5:0/2735119079 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f974c059dd0 con 0x7f975415a850 2023-10-16T13:39:01.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.163+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f973806af00 msgr2=0x7f973806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.163+0000 7f975b6fa700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f973806af00 0x7f973806d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97540ceb90 tx=0x7f9750008040 comp rx=0 tx=0).stop 2023-10-16T13:39:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.163+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 msgr2=0x7f9754158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.163+0000 7f975b6fa700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 0x7f9754158900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f975406d290 tx=0x7f974c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 shutdown_connections 2023-10-16T13:39:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975415a850 0x7f9754158900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f973806af00 0x7f973806d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97540b2940 0x7f975415c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 --2- 172.21.15.5:0/2735119079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97540cd4b0 0x7f97541520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 >> 172.21.15.5:0/2735119079 conn(0x7f975406dac0 msgr2=0x7f97540b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 shutdown_connections 2023-10-16T13:39:01.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.164+0000 7f975b6fa700 1 -- 172.21.15.5:0/2735119079 wait complete. 2023-10-16T13:39:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:39:01.178 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:39:01.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:01.179 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-16T13:39:01.234 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:39:01.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:01.235 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:39:01.258 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:01.259 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:01.277 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:01.278 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:01.334 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:01.335 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:01.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.553+0000 7f6717576700 1 Processor -- start 2023-10-16T13:39:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.554+0000 7f6717576700 1 -- start start 2023-10-16T13:39:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.554+0000 7f6717576700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f671015ab10 0x7f671015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.554+0000 7f6717576700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67100b1f50 0x7f67100cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.554+0000 7f6717576700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671015e7a0 con 0x7f67100b2400 2023-10-16T13:39:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.554+0000 7f6717576700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671015f730 con 0x7f671015ab10 2023-10-16T13:39:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.554+0000 7f6717576700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100b29a0 con 0x7f67100b1f50 2023-10-16T13:39:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715312700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f671015ab10 0x7f671015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715b13700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67100b2400 0x7f67100cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53128/0 (socket says 172.21.15.5:53128) 2023-10-16T13:39:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715b13700 1 -- 172.21.15.5:0/2806769298 learned_addr learned my addr 172.21.15.5:0/2806769298 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6714b11700 1 --2- 172.21.15.5:0/2806769298 >> v2:172.21.15.112:3300/0 conn(0x7f67100b1f50 0x7f67100cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715312700 1 -- 172.21.15.5:0/2806769298 >> v2:172.21.15.112:3300/0 conn(0x7f67100b1f50 msgr2=0x7f67100cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715312700 1 --2- 172.21.15.5:0/2806769298 >> v2:172.21.15.112:3300/0 conn(0x7f67100b1f50 0x7f67100cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715312700 1 -- 172.21.15.5:0/2806769298 >> v1:172.21.15.5:6789/0 conn(0x7f67100b2400 legacy=0x7f67100cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6703fff700 1 -- 172.21.15.5:0/2806769298 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491633225 0 0) 0x7f671015e7a0 con 0x7f67100b2400 2023-10-16T13:39:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715312700 1 -- 172.21.15.5:0/2806769298 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100b2c80 con 0x7f671015ab10 2023-10-16T13:39:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6715312700 1 --2- 172.21.15.5:0/2806769298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671015f1f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f671006d470 tx=0x7f670c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bc25654d86cf66 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6703fff700 1 -- 172.21.15.5:0/2806769298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c004220 con 0x7f671015ab10 2023-10-16T13:39:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6703fff700 1 -- 172.21.15.5:0/2806769298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c004380 con 0x7f671015ab10 2023-10-16T13:39:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.555+0000 7f6703fff700 1 -- 172.21.15.5:0/2806769298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c010890 con 0x7f671015ab10 2023-10-16T13:39:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 -- 172.21.15.5:0/2806769298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 msgr2=0x7f671015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 --2- 172.21.15.5:0/2806769298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671015f1f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f671006d470 tx=0x7f670c009b80 comp rx=0 tx=0).stop 2023-10-16T13:39:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 -- 172.21.15.5:0/2806769298 shutdown_connections 2023-10-16T13:39:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 --2- 172.21.15.5:0/2806769298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671015f1f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 --2- 172.21.15.5:0/2806769298 >> v2:172.21.15.112:3300/0 conn(0x7f67100b1f50 0x7f67100cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 -- 172.21.15.5:0/2806769298 >> 172.21.15.5:0/2806769298 conn(0x7f671006dae0 msgr2=0x7f671006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 -- 172.21.15.5:0/2806769298 shutdown_connections 2023-10-16T13:39:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.556+0000 7f6717576700 1 -- 172.21.15.5:0/2806769298 wait complete. 2023-10-16T13:39:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.557+0000 7f6717576700 1 Processor -- start 2023-10-16T13:39:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.557+0000 7f6717576700 1 -- start start 2023-10-16T13:39:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6717576700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67100b1f50 0x7f671014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6717576700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67100b2400 0x7f67100c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6717576700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6717576700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671015de80 con 0x7f671015ab10 2023-10-16T13:39:01.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6717576700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671014d2a0 con 0x7f67100b2400 2023-10-16T13:39:01.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6717576700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671014d580 con 0x7f67100b1f50 2023-10-16T13:39:01.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671014ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43130/0 (socket says 172.21.15.5:43130) 2023-10-16T13:39:01.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 -- 172.21.15.5:0/3693663161 learned_addr learned my addr 172.21.15.5:0/3693663161 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:01.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715312700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67100b1f50 0x7f671014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6714b11700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67100b2400 0x7f67100c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 -- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67100b1f50 msgr2=0x7f671014c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67100b1f50 0x7f671014c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 -- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67100b2400 msgr2=0x7f67100c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67100b2400 0x7f67100c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715b13700 1 -- 172.21.15.5:0/3693663161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c0094a0 con 0x7f671015ab10 2023-10-16T13:39:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.558+0000 7f6715312700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67100b1f50 0x7f671014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.559+0000 7f6715b13700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671014ca50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f670800cb60 tx=0x7f670800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.559+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800aaa0 con 0x7f671015ab10 2023-10-16T13:39:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.559+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800ac00 con 0x7f671015ab10 2023-10-16T13:39:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.559+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671014d860 con 0x7f671015ab10 2023-10-16T13:39:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.559+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080070d0 con 0x7f671015ab10 2023-10-16T13:39:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.559+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671014cf90 con 0x7f671015ab10 2023-10-16T13:39:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.560+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100b6110 con 0x7f671015ab10 2023-10-16T13:39:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.560+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6708007230 con 0x7f671015ab10 2023-10-16T13:39:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.561+0000 7f6701ffb700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f66f406af00 0x7f66f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.561+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67080893d0 con 0x7f671015ab10 2023-10-16T13:39:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.561+0000 7f6715312700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f66f406af00 0x7f66f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.561+0000 7f6715312700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f66f406af00 0x7f66f406d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f670c0090b0 tx=0x7f670c014000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:01.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.566+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6708054480 con 0x7f671015ab10 2023-10-16T13:39:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.769+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6710067d20 con 0x7f671015ab10 2023-10-16T13:39:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.770+0000 7f6701ffb700 1 -- 172.21.15.5:0/3693663161 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f6708057aa0 con 0x7f671015ab10 2023-10-16T13:39:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:01.774 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f66f406af00 msgr2=0x7f66f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f66f406af00 0x7f66f406d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f670c0090b0 tx=0x7f670c014000 comp rx=0 tx=0).stop 2023-10-16T13:39:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 msgr2=0x7f671014ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671014ca50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f670800cb60 tx=0x7f670800ce70 comp rx=0 tx=0).stop 2023-10-16T13:39:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 shutdown_connections 2023-10-16T13:39:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f671015ab10 0x7f671014ca50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f66f406af00 0x7f66f406d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67100b1f50 0x7f671014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 --2- 172.21.15.5:0/3693663161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67100b2400 0x7f67100c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 >> 172.21.15.5:0/3693663161 conn(0x7f671006dae0 msgr2=0x7f67100c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 shutdown_connections 2023-10-16T13:39:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.773+0000 7f6717576700 1 -- 172.21.15.5:0/3693663161 wait complete. 2023-10-16T13:39:01.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:01.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.914+0000 7f6ea9632700 1 Processor -- start 2023-10-16T13:39:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.914+0000 7f6ea9632700 1 -- start start 2023-10-16T13:39:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea9632700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ea40cfe30 0x7f6ea40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea9632700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea415e7a0 con 0x7f6ea415f1f0 2023-10-16T13:39:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea9632700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea40b29a0 con 0x7f6ea415ab10 2023-10-16T13:39:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea9632700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea40b2c80 con 0x7f6ea40cfe30 2023-10-16T13:39:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea27fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ea415f1f0 0x7f6ea40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53140/0 (socket says 172.21.15.5:53140) 2023-10-16T13:39:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea27fc700 1 -- 172.21.15.5:0/4285518222 learned_addr learned my addr 172.21.15.5:0/4285518222 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.915+0000 7f6ea37fe700 1 --2- 172.21.15.5:0/4285518222 >> v2:172.21.15.112:3300/0 conn(0x7f6ea40cfe30 0x7f6ea40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea1ffb700 1 -- 172.21.15.5:0/4285518222 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286561908 0 0) 0x7f6ea415e7a0 con 0x7f6ea415f1f0 2023-10-16T13:39:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea1ffb700 1 -- 172.21.15.5:0/4285518222 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e8c0035b0 con 0x7f6ea415f1f0 2023-10-16T13:39:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea37fe700 1 -- 172.21.15.5:0/4285518222 >> v1:172.21.15.112:6789/0 conn(0x7f6ea415ab10 legacy=0x7f6ea40b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea37fe700 1 -- 172.21.15.5:0/4285518222 >> v1:172.21.15.5:6789/0 conn(0x7f6ea415f1f0 legacy=0x7f6ea40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea37fe700 1 -- 172.21.15.5:0/4285518222 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea415e9f0 con 0x7f6ea40cfe30 2023-10-16T13:39:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea37fe700 1 --2- 172.21.15.5:0/4285518222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea40cfe30 0x7f6ea40cbf40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009d90 tx=0x7f6e9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d50a09c837ebd879 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea1ffb700 1 -- 172.21.15.5:0/4285518222 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00e070 con 0x7f6ea40cfe30 2023-10-16T13:39:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea1ffb700 1 -- 172.21.15.5:0/4285518222 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00bb20 con 0x7f6ea40cfe30 2023-10-16T13:39:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.916+0000 7f6ea1ffb700 1 -- 172.21.15.5:0/4285518222 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00be90 con 0x7f6ea40cfe30 2023-10-16T13:39:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 -- 172.21.15.5:0/4285518222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea40cfe30 msgr2=0x7f6ea40cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 --2- 172.21.15.5:0/4285518222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea40cfe30 0x7f6ea40cbf40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009d90 tx=0x7f6e9c00b330 comp rx=0 tx=0).stop 2023-10-16T13:39:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 -- 172.21.15.5:0/4285518222 shutdown_connections 2023-10-16T13:39:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 --2- 172.21.15.5:0/4285518222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea40cfe30 0x7f6ea40cbf40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 -- 172.21.15.5:0/4285518222 >> 172.21.15.5:0/4285518222 conn(0x7f6ea406dae0 msgr2=0x7f6ea406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 -- 172.21.15.5:0/4285518222 shutdown_connections 2023-10-16T13:39:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.917+0000 7f6ea9632700 1 -- 172.21.15.5:0/4285518222 wait complete. 2023-10-16T13:39:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.918+0000 7f6ea9632700 1 Processor -- start 2023-10-16T13:39:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.918+0000 7f6ea9632700 1 -- start start 2023-10-16T13:39:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea9632700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea40cfe30 0x7f6ea4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea9632700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea415ab10 0x7f6ea40c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea9632700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 0x7f6ea41f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea9632700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea41497c0 con 0x7f6ea415f1f0 2023-10-16T13:39:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea9632700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea40c5ea0 con 0x7f6ea415ab10 2023-10-16T13:39:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea9632700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4149a60 con 0x7f6ea40cfe30 2023-10-16T13:39:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 0x7f6ea41f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 0x7f6ea41f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43142/0 (socket says 172.21.15.5:43142) 2023-10-16T13:39:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 -- 172.21.15.5:0/3522259667 learned_addr learned my addr 172.21.15.5:0/3522259667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:01.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea2ffd700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea40cfe30 0x7f6ea4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea27fc700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea415ab10 0x7f6ea40c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 -- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea40cfe30 msgr2=0x7f6ea4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea40cfe30 0x7f6ea4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 -- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea415ab10 msgr2=0x7f6ea40c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea415ab10 0x7f6ea40c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.919+0000 7f6ea37fe700 1 -- 172.21.15.5:0/3522259667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c009a70 con 0x7f6ea415f1f0 2023-10-16T13:39:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.920+0000 7f6ea37fe700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 0x7f6ea41f4d20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00b370 tx=0x7f6e9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.920+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c004800 con 0x7f6ea415f1f0 2023-10-16T13:39:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.920+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c020070 con 0x7f6ea415f1f0 2023-10-16T13:39:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.920+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea40c6100 con 0x7f6ea415f1f0 2023-10-16T13:39:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.920+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0276c0 con 0x7f6ea415f1f0 2023-10-16T13:39:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.920+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea40c66c0 con 0x7f6ea415f1f0 2023-10-16T13:39:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.921+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea4149c60 con 0x7f6ea415f1f0 2023-10-16T13:39:01.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.921+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e9c012430 con 0x7f6ea415f1f0 2023-10-16T13:39:01.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.922+0000 7f6e8b7fe700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6e9006af00 0x7f6e9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:01.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.922+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e9c022070 con 0x7f6ea415f1f0 2023-10-16T13:39:01.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.922+0000 7f6ea2ffd700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6e9006af00 0x7f6e9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:01.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.922+0000 7f6ea2ffd700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6e9006af00 0x7f6e9006d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e980018a0 tx=0x7f6e98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:01.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:01.927+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ea4149c60 con 0x7f6ea415f1f0 2023-10-16T13:39:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.127+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ea4067ae0 con 0x7f6ea415f1f0 2023-10-16T13:39:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.127+0000 7f6e8b7fe700 1 -- 172.21.15.5:0/3522259667 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e9c056710 con 0x7f6ea415f1f0 2023-10-16T13:39:02.130 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6e9006af00 msgr2=0x7f6e9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6e9006af00 0x7f6e9006d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e980018a0 tx=0x7f6e98009040 comp rx=0 tx=0).stop 2023-10-16T13:39:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 msgr2=0x7f6ea41f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 0x7f6ea41f4d20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00b370 tx=0x7f6e9c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 shutdown_connections 2023-10-16T13:39:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea415f1f0 0x7f6ea41f4d20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6e9006af00 0x7f6e9006d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea40cfe30 0x7f6ea4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 --2- 172.21.15.5:0/3522259667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea415ab10 0x7f6ea40c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 >> 172.21.15.5:0/3522259667 conn(0x7f6ea406dae0 msgr2=0x7f6ea406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 shutdown_connections 2023-10-16T13:39:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.129+0000 7f6ea9632700 1 -- 172.21.15.5:0/3522259667 wait complete. 2023-10-16T13:39:02.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.268+0000 7f57e0d1b700 1 Processor -- start 2023-10-16T13:39:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.268+0000 7f57e0d1b700 1 -- start start 2023-10-16T13:39:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57e0d1b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57dc15ab10 0x7f57dc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57e0d1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc0cfe30 0x7f57dc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57e0d1b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc15e7a0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57e0d1b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc15f730 con 0x7f57dc15ab10 2023-10-16T13:39:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57e0d1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0b29a0 con 0x7f57dc0cfe30 2023-10-16T13:39:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57da59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57dc15ab10 0x7f57dc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57da59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57dc15ab10 0x7f57dc15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43148/0 (socket says 172.21.15.5:43148) 2023-10-16T13:39:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57da59c700 1 -- 172.21.15.5:0/4189083386 learned_addr learned my addr 172.21.15.5:0/4189083386 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57d9d9b700 1 --1- 172.21.15.5:0/4189083386 >> v1:172.21.15.5:6789/0 conn(0x7f57dc0b1f50 0x7f57dc0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53152/0 (socket says 172.21.15.5:53152) 2023-10-16T13:39:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.269+0000 7f57dad9d700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc0cfe30 0x7f57dc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57da59c700 1 -- 172.21.15.5:0/4189083386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc0cfe30 msgr2=0x7f57dc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:02.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57da59c700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc0cfe30 0x7f57dc0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57da59c700 1 -- 172.21.15.5:0/4189083386 >> v1:172.21.15.5:6789/0 conn(0x7f57dc0b1f50 legacy=0x7f57dc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57da59c700 1 -- 172.21.15.5:0/4189083386 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0b2c80 con 0x7f57dc15ab10 2023-10-16T13:39:02.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57dad9d700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc0cfe30 0x7f57dc0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:02.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57d959a700 1 -- 172.21.15.5:0/4189083386 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966950830 0 0) 0x7f57dc15e7a0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57da59c700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc15ab10 0x7f57dc15f1f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f57d000bb90 tx=0x7f57d000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5f6e6eff1b8679 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57d959a700 1 -- 172.21.15.5:0/4189083386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000dd50 con 0x7f57dc15ab10 2023-10-16T13:39:02.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57d959a700 1 -- 172.21.15.5:0/4189083386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0010470 con 0x7f57dc15ab10 2023-10-16T13:39:02.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57d959a700 1 -- 172.21.15.5:0/4189083386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0010800 con 0x7f57dc15ab10 2023-10-16T13:39:02.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57e0d1b700 1 -- 172.21.15.5:0/4189083386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc15ab10 msgr2=0x7f57dc15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.270+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc15ab10 0x7f57dc15f1f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f57d000bb90 tx=0x7f57d000bea0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.271+0000 7f57e0d1b700 1 -- 172.21.15.5:0/4189083386 shutdown_connections 2023-10-16T13:39:02.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.271+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc0cfe30 0x7f57dc0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.271+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/4189083386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc15ab10 0x7f57dc15f1f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.271+0000 7f57e0d1b700 1 -- 172.21.15.5:0/4189083386 >> 172.21.15.5:0/4189083386 conn(0x7f57dc06dae0 msgr2=0x7f57dc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:02.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.271+0000 7f57e0d1b700 1 -- 172.21.15.5:0/4189083386 shutdown_connections 2023-10-16T13:39:02.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.271+0000 7f57e0d1b700 1 -- 172.21.15.5:0/4189083386 wait complete. 2023-10-16T13:39:02.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.272+0000 7f57e0d1b700 1 Processor -- start 2023-10-16T13:39:02.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.272+0000 7f57e0d1b700 1 -- start start 2023-10-16T13:39:02.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57e0d1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 0x7f57dc0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57e0d1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57dc0cfe30 0x7f57dc0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57e0d1b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc15ab10 0x7f57dc1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57e0d1b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c47f0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57e0d1b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c4f30 con 0x7f57dc0cfe30 2023-10-16T13:39:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57e0d1b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc1f6f00 con 0x7f57dc15ab10 2023-10-16T13:39:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 0x7f57dc0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 0x7f57dc0c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43154/0 (socket says 172.21.15.5:43154) 2023-10-16T13:39:02.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 -- 172.21.15.5:0/1053782238 learned_addr learned my addr 172.21.15.5:0/1053782238 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:02.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57d9d9b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57dc0cfe30 0x7f57dc0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57dad9d700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc15ab10 0x7f57dc1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 -- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc15ab10 msgr2=0x7f57dc1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc15ab10 0x7f57dc1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 -- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57dc0cfe30 msgr2=0x7f57dc0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57dc0cfe30 0x7f57dc0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 -- 172.21.15.5:0/1053782238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d000b7f0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57d9d9b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57dc0cfe30 0x7f57dc0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57da59c700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 0x7f57dc0c49f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f57d0000c00 tx=0x7f57d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.273+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d001d070 con 0x7f57dc0b1f50 2023-10-16T13:39:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.274+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0010e40 con 0x7f57dc0b1f50 2023-10-16T13:39:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.274+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc1f71e0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.274+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0004490 con 0x7f57dc0b1f50 2023-10-16T13:39:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.274+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc1f77a0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.275+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc1f7930 con 0x7f57dc0b1f50 2023-10-16T13:39:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.275+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f57d00036a0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.275+0000 7f57caffd700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57bc06af00 0x7f57bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.276+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57d008a9d0 con 0x7f57dc0b1f50 2023-10-16T13:39:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.276+0000 7f57d9d9b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57bc06af00 0x7f57bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.276+0000 7f57d9d9b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57bc06af00 0x7f57bc06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57cc007bf0 tx=0x7f57cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.280+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57d0055b10 con 0x7f57dc0b1f50 2023-10-16T13:39:02.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.481+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57dc0ad150 con 0x7f57dc0b1f50 2023-10-16T13:39:02.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.481+0000 7f57caffd700 1 -- 172.21.15.5:0/1053782238 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57d0059130 con 0x7f57dc0b1f50 2023-10-16T13:39:02.484 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57bc06af00 msgr2=0x7f57bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57bc06af00 0x7f57bc06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57cc007bf0 tx=0x7f57cc009040 comp rx=0 tx=0).stop 2023-10-16T13:39:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 msgr2=0x7f57dc0c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 0x7f57dc0c49f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f57d0000c00 tx=0x7f57d0004750 comp rx=0 tx=0).stop 2023-10-16T13:39:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 shutdown_connections 2023-10-16T13:39:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57bc06af00 0x7f57bc06d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57dc15ab10 0x7f57dc1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57dc0b1f50 0x7f57dc0c49f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 --2- 172.21.15.5:0/1053782238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57dc0cfe30 0x7f57dc0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 >> 172.21.15.5:0/1053782238 conn(0x7f57dc06dae0 msgr2=0x7f57dc0cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 shutdown_connections 2023-10-16T13:39:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.483+0000 7f57e0d1b700 1 -- 172.21.15.5:0/1053782238 wait complete. 2023-10-16T13:39:02.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.623+0000 7f3e00e12700 1 Processor -- start 2023-10-16T13:39:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.623+0000 7f3e00e12700 1 -- start start 2023-10-16T13:39:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3e00e12700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3dfc06a840 0x7f3dfc0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3e00e12700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06be50 0x7f3dfc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3e00e12700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc06adb0 con 0x7f3dfc15e030 2023-10-16T13:39:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3e00e12700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc0cbab0 con 0x7f3dfc06a840 2023-10-16T13:39:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3e00e12700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc06b090 con 0x7f3dfc06be50 2023-10-16T13:39:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3dfc06a840 0x7f3dfc0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3dfad9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06be50 0x7f3dfc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3dfc06a840 0x7f3dfc0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39058/0 (socket says 172.21.15.5:39058) 2023-10-16T13:39:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 -- 172.21.15.5:0/225498236 learned_addr learned my addr 172.21.15.5:0/225498236 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 -- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06be50 msgr2=0x7f3dfc0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 --2- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06be50 0x7f3dfc0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 -- 172.21.15.5:0/225498236 >> v1:172.21.15.112:6789/0 conn(0x7f3dfc15e030 legacy=0x7f3dfc0cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df9d9b700 1 -- 172.21.15.5:0/225498236 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc06b370 con 0x7f3dfc06a840 2023-10-16T13:39:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.624+0000 7f3df959a700 1 -- 172.21.15.5:0/225498236 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979658694 0 0) 0x7f3dfc06adb0 con 0x7f3dfc15e030 2023-10-16T13:39:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3df9d9b700 1 --2- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc06a840 0x7f3dfc0cdb70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3df00098f0 tx=0x7f3df0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3d0fe934cc2719 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3df959a700 1 -- 172.21.15.5:0/225498236 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0011830 con 0x7f3dfc06a840 2023-10-16T13:39:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3df959a700 1 -- 172.21.15.5:0/225498236 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0011990 con 0x7f3dfc06a840 2023-10-16T13:39:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3df959a700 1 -- 172.21.15.5:0/225498236 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0011d20 con 0x7f3dfc06a840 2023-10-16T13:39:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 -- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc06a840 msgr2=0x7f3dfc0cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 --2- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc06a840 0x7f3dfc0cdb70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3df00098f0 tx=0x7f3df0009c00 comp rx=0 tx=0).stop 2023-10-16T13:39:02.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 -- 172.21.15.5:0/225498236 shutdown_connections 2023-10-16T13:39:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 --2- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06be50 0x7f3dfc0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 --2- 172.21.15.5:0/225498236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc06a840 0x7f3dfc0cdb70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 -- 172.21.15.5:0/225498236 >> 172.21.15.5:0/225498236 conn(0x7f3dfc0cc6f0 msgr2=0x7f3dfc0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 -- 172.21.15.5:0/225498236 shutdown_connections 2023-10-16T13:39:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.625+0000 7f3e00e12700 1 -- 172.21.15.5:0/225498236 wait complete. 2023-10-16T13:39:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.627+0000 7f3e00e12700 1 Processor -- start 2023-10-16T13:39:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.627+0000 7f3e00e12700 1 -- start start 2023-10-16T13:39:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06a840 0x7f3dfc157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 0x7f3dfc0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc15e030 0x7f3dfc158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc158600 con 0x7f3dfc06be50 2023-10-16T13:39:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1579f0 con 0x7f3dfc15e030 2023-10-16T13:39:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc157cd0 con 0x7f3dfc06a840 2023-10-16T13:39:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 0x7f3dfc0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 0x7f3dfc0c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43170/0 (socket says 172.21.15.5:43170) 2023-10-16T13:39:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 -- 172.21.15.5:0/1575307481 learned_addr learned my addr 172.21.15.5:0/1575307481 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3dfa59c700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06a840 0x7f3dfc157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3dfad9d700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc15e030 0x7f3dfc158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 -- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06a840 msgr2=0x7f3dfc157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06a840 0x7f3dfc157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 -- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc15e030 msgr2=0x7f3dfc158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc15e030 0x7f3dfc158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 -- 172.21.15.5:0/1575307481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009550 con 0x7f3dfc06be50 2023-10-16T13:39:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3dfad9d700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc15e030 0x7f3dfc158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3df9d9b700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 0x7f3dfc0c8200 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009c40 tx=0x7f3df0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0004300 con 0x7f3dfc06be50 2023-10-16T13:39:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df001f070 con 0x7f3dfc06be50 2023-10-16T13:39:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.628+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc157fb0 con 0x7f3dfc06be50 2023-10-16T13:39:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.629+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00036a0 con 0x7f3dfc06be50 2023-10-16T13:39:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.629+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc0c75a0 con 0x7f3dfc06be50 2023-10-16T13:39:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.629+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc158770 con 0x7f3dfc06be50 2023-10-16T13:39:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.630+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3df0021030 con 0x7f3dfc06be50 2023-10-16T13:39:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.630+0000 7f3deaffd700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3ddc06af00 0x7f3ddc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.630+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3df008aa40 con 0x7f3dfc06be50 2023-10-16T13:39:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.631+0000 7f3dfa59c700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3ddc06af00 0x7f3ddc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.631+0000 7f3dfa59c700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3ddc06af00 0x7f3ddc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dec000f60 tx=0x7f3dec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.635+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3df008ce60 con 0x7f3dfc06be50 2023-10-16T13:39:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.838+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dfc067d20 con 0x7f3dfc06be50 2023-10-16T13:39:02.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.838+0000 7f3deaffd700 1 -- 172.21.15.5:0/1575307481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3df0015020 con 0x7f3dfc06be50 2023-10-16T13:39:02.841 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3ddc06af00 msgr2=0x7f3ddc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3ddc06af00 0x7f3ddc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dec000f60 tx=0x7f3dec009040 comp rx=0 tx=0).stop 2023-10-16T13:39:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 msgr2=0x7f3dfc0c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 0x7f3dfc0c8200 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009c40 tx=0x7f3df0004750 comp rx=0 tx=0).stop 2023-10-16T13:39:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 shutdown_connections 2023-10-16T13:39:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dfc15e030 0x7f3dfc158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3ddc06af00 0x7f3ddc06d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3dfc06a840 0x7f3dfc157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 --2- 172.21.15.5:0/1575307481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dfc06be50 0x7f3dfc0c8200 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 >> 172.21.15.5:0/1575307481 conn(0x7f3dfc0cc6f0 msgr2=0x7f3dfc15b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 shutdown_connections 2023-10-16T13:39:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.840+0000 7f3e00e12700 1 -- 172.21.15.5:0/1575307481 wait complete. 2023-10-16T13:39:02.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:39:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.979+0000 7f6733062700 1 Processor -- start 2023-10-16T13:39:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.979+0000 7f6733062700 1 -- start start 2023-10-16T13:39:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6733062700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f672c15dbc0 0x7f672c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6733062700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f672c0d3fc0 0x7f672c0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6733062700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c0d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6733062700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c15e4e0 con 0x7f672c15dbc0 2023-10-16T13:39:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6733062700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c0b7560 con 0x7f672c0d3fc0 2023-10-16T13:39:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6733062700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0b7840 con 0x7f672c0b7050 2023-10-16T13:39:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f672c15dbc0 0x7f672c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f672c15dbc0 0x7f672c15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43176/0 (socket says 172.21.15.5:43176) 2023-10-16T13:39:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 -- 172.21.15.5:0/3750997618 learned_addr learned my addr 172.21.15.5:0/3750997618 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f672bfff700 1 --2- 172.21.15.5:0/3750997618 >> v2:172.21.15.112:3300/0 conn(0x7f672c0d3fc0 0x7f672c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f67315ff700 1 --2- 172.21.15.5:0/3750997618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c0d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 -- 172.21.15.5:0/3750997618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 msgr2=0x7f672c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 --2- 172.21.15.5:0/3750997618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c0d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 -- 172.21.15.5:0/3750997618 >> v2:172.21.15.112:3300/0 conn(0x7f672c0d3fc0 msgr2=0x7f672c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 --2- 172.21.15.5:0/3750997618 >> v2:172.21.15.112:3300/0 conn(0x7f672c0d3fc0 0x7f672c0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 -- 172.21.15.5:0/3750997618 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0b7b20 con 0x7f672c15dbc0 2023-10-16T13:39:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.980+0000 7f6730dfe700 1 --2- 172.21.15.5:0/3750997618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c15dbc0 0x7f672c15dfa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f672c0d14e0 tx=0x7f6720009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f350bf38a756d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f672b7fe700 1 -- 172.21.15.5:0/3750997618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720005e30 con 0x7f672c15dbc0 2023-10-16T13:39:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f672b7fe700 1 -- 172.21.15.5:0/3750997618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720004030 con 0x7f672c15dbc0 2023-10-16T13:39:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f672b7fe700 1 -- 172.21.15.5:0/3750997618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67200043e0 con 0x7f672c15dbc0 2023-10-16T13:39:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 -- 172.21.15.5:0/3750997618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c15dbc0 msgr2=0x7f672c15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 --2- 172.21.15.5:0/3750997618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c15dbc0 0x7f672c15dfa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f672c0d14e0 tx=0x7f6720009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 -- 172.21.15.5:0/3750997618 shutdown_connections 2023-10-16T13:39:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 --2- 172.21.15.5:0/3750997618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c0d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 --2- 172.21.15.5:0/3750997618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c15dbc0 0x7f672c15dfa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 --2- 172.21.15.5:0/3750997618 >> v2:172.21.15.112:3300/0 conn(0x7f672c0d3fc0 0x7f672c0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 -- 172.21.15.5:0/3750997618 >> 172.21.15.5:0/3750997618 conn(0x7f672c09cb40 msgr2=0x7f672c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 -- 172.21.15.5:0/3750997618 shutdown_connections 2023-10-16T13:39:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.981+0000 7f6733062700 1 -- 172.21.15.5:0/3750997618 wait complete. 2023-10-16T13:39:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.983+0000 7f6733062700 1 Processor -- start 2023-10-16T13:39:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.983+0000 7f6733062700 1 -- start start 2023-10-16T13:39:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f6733062700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f6733062700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 0x7f672c1e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f6733062700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f672c15dbc0 0x7f672c0a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f6733062700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1e6270 con 0x7f672c0d3fc0 2023-10-16T13:39:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f6733062700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1e7d70 con 0x7f672c15dbc0 2023-10-16T13:39:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f6733062700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1e8050 con 0x7f672c0b7050 2023-10-16T13:39:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f672bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 0x7f672c1e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f672bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 0x7f672c1e72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43182/0 (socket says 172.21.15.5:43182) 2023-10-16T13:39:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.984+0000 7f672bfff700 1 -- 172.21.15.5:0/837590839 learned_addr learned my addr 172.21.15.5:0/837590839 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f6730dfe700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f67315ff700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f672c15dbc0 0x7f672c0a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f672bfff700 1 -- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 msgr2=0x7f672c15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f672bfff700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f672bfff700 1 -- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f672c15dbc0 msgr2=0x7f672c0a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f672bfff700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f672c15dbc0 0x7f672c0a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f672bfff700 1 -- 172.21.15.5:0/837590839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720009500 con 0x7f672c0d3fc0 2023-10-16T13:39:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f672bfff700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 0x7f672c1e72d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f671800e9b0 tx=0x7f671800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718009710 con 0x7f672c0d3fc0 2023-10-16T13:39:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671800c850 con 0x7f672c0d3fc0 2023-10-16T13:39:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c09d4b0 con 0x7f672c0d3fc0 2023-10-16T13:39:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800cbc0 con 0x7f672c0d3fc0 2023-10-16T13:39:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.985+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c09da70 con 0x7f672c0d3fc0 2023-10-16T13:39:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.986+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c04ebb0 con 0x7f672c0d3fc0 2023-10-16T13:39:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.986+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f671800cd20 con 0x7f672c0d3fc0 2023-10-16T13:39:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.987+0000 7f67297fa700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671006af00 0x7f671006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.987+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67180896a0 con 0x7f672c0d3fc0 2023-10-16T13:39:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.987+0000 7f6730dfe700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671006af00 0x7f671006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.988+0000 7f6730dfe700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671006af00 0x7f671006d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6720014040 tx=0x7f6720008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:02.992+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67180547e0 con 0x7f672c0d3fc0 2023-10-16T13:39:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.207+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f672c08d840 con 0x7f672c0d3fc0 2023-10-16T13:39:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.207+0000 7f67297fa700 1 -- 172.21.15.5:0/837590839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6718057e00 con 0x7f672c0d3fc0 2023-10-16T13:39:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671006af00 msgr2=0x7f671006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671006af00 0x7f671006d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6720014040 tx=0x7f6720008070 comp rx=0 tx=0).stop 2023-10-16T13:39:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 msgr2=0x7f672c1e72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 0x7f672c1e72d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f671800e9b0 tx=0x7f671800ed70 comp rx=0 tx=0).stop 2023-10-16T13:39:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 shutdown_connections 2023-10-16T13:39:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f672c15dbc0 0x7f672c0a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671006af00 0x7f671006d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f672c0b7050 0x7f672c15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 --2- 172.21.15.5:0/837590839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d3fc0 0x7f672c1e72d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.209+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 >> 172.21.15.5:0/837590839 conn(0x7f672c09cb40 msgr2=0x7f672c15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.210+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 shutdown_connections 2023-10-16T13:39:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.210+0000 7f6733062700 1 -- 172.21.15.5:0/837590839 wait complete. 2023-10-16T13:39:03.215 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:39:03.224 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-16T13:39:03.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:03.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-16T13:39:03.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:39:03.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:03.274 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T13:39:03.292 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:03.292 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:03.313 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:03.314 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:03.374 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:03.374 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:03.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.558+0000 7fde5137a700 1 Processor -- start 2023-10-16T13:39:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.558+0000 7fde5137a700 1 -- start start 2023-10-16T13:39:03.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde5137a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde5137a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde4c0cf6d0 0x7fde4c0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde5137a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde4c0d1bc0 0x7fde4c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde5137a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c0cfb50 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde5137a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c15ee90 con 0x7fde4c0d1bc0 2023-10-16T13:39:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde5137a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c158370 con 0x7fde4c15eab0 2023-10-16T13:39:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde4a7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde4c0cf6d0 0x7fde4c0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde4a7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde4c0cf6d0 0x7fde4c0d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43188/0 (socket says 172.21.15.5:43188) 2023-10-16T13:39:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.559+0000 7fde4a7fc700 1 -- 172.21.15.5:0/3293732427 learned_addr learned my addr 172.21.15.5:0/3293732427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4b7fe700 1 --2- 172.21.15.5:0/3293732427 >> v2:172.21.15.112:3300/0 conn(0x7fde4c0d1bc0 0x7fde4c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4affd700 1 --2- 172.21.15.5:0/3293732427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4a7fc700 1 -- 172.21.15.5:0/3293732427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 msgr2=0x7fde4c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4a7fc700 1 --2- 172.21.15.5:0/3293732427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4a7fc700 1 -- 172.21.15.5:0/3293732427 >> v2:172.21.15.112:3300/0 conn(0x7fde4c0d1bc0 msgr2=0x7fde4c161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4a7fc700 1 --2- 172.21.15.5:0/3293732427 >> v2:172.21.15.112:3300/0 conn(0x7fde4c0d1bc0 0x7fde4c161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4a7fc700 1 -- 172.21.15.5:0/3293732427 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0d23b0 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde4a7fc700 1 --2- 172.21.15.5:0/3293732427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0d1680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0cd190 tx=0x7fde3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fada12621d9bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde49ffb700 1 -- 172.21.15.5:0/3293732427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00b870 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde49ffb700 1 -- 172.21.15.5:0/3293732427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c00b9d0 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.560+0000 7fde49ffb700 1 -- 172.21.15.5:0/3293732427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00bd60 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 -- 172.21.15.5:0/3293732427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 msgr2=0x7fde4c0d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 --2- 172.21.15.5:0/3293732427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0d1680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0cd190 tx=0x7fde3c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 -- 172.21.15.5:0/3293732427 shutdown_connections 2023-10-16T13:39:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 --2- 172.21.15.5:0/3293732427 >> v2:172.21.15.112:3300/0 conn(0x7fde4c0d1bc0 0x7fde4c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 --2- 172.21.15.5:0/3293732427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 --2- 172.21.15.5:0/3293732427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0d1680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 -- 172.21.15.5:0/3293732427 >> 172.21.15.5:0/3293732427 conn(0x7fde4c0665a0 msgr2=0x7fde4c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 -- 172.21.15.5:0/3293732427 shutdown_connections 2023-10-16T13:39:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.561+0000 7fde5137a700 1 -- 172.21.15.5:0/3293732427 wait complete. 2023-10-16T13:39:03.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.562+0000 7fde5137a700 1 Processor -- start 2023-10-16T13:39:03.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.562+0000 7fde5137a700 1 -- start start 2023-10-16T13:39:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde5137a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde5137a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde4c0d1bc0 0x7fde4c0c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde5137a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde5137a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0b4b80 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde5137a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0b4d70 con 0x7fde4c0d1bc0 2023-10-16T13:39:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde5137a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0b5050 con 0x7fde4c15eab0 2023-10-16T13:39:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43194/0 (socket says 172.21.15.5:43194) 2023-10-16T13:39:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 -- 172.21.15.5:0/1466132574 learned_addr learned my addr 172.21.15.5:0/1466132574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4b7fe700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4a7fc700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde4c0d1bc0 0x7fde4c0c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 -- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 msgr2=0x7fde4c0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 -- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde4c0d1bc0 msgr2=0x7fde4c0c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde4c0d1bc0 0x7fde4c0c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 -- 172.21.15.5:0/1466132574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c009550 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4b7fe700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.563+0000 7fde4affd700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0c6df0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde4000e810 tx=0x7fde4000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.564+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40013610 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.564+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40013770 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.564+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c0b5330 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.564+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40013b20 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.564+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c0b58f0 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.565+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c067d20 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.565+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde40013c80 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.565+0000 7fde337fe700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde3806af00 0x7fde3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.566+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde400891b0 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.566+0000 7fde4a7fc700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde3806af00 0x7fde3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.566+0000 7fde4a7fc700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde3806af00 0x7fde3806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde3c014040 tx=0x7fde3c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.570+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde40054270 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.771+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde4c0c4e10 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.773+0000 7fde337fe700 1 -- 172.21.15.5:0/1466132574 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fde40057890 con 0x7fde4c0cf6d0 2023-10-16T13:39:03.775 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:03.776 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:03.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.774+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde3806af00 msgr2=0x7fde3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.774+0000 7fde5137a700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde3806af00 0x7fde3806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde3c014040 tx=0x7fde3c008030 comp rx=0 tx=0).stop 2023-10-16T13:39:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 msgr2=0x7fde4c0c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0c6df0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde4000e810 tx=0x7fde4000eb20 comp rx=0 tx=0).stop 2023-10-16T13:39:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 shutdown_connections 2023-10-16T13:39:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde3806af00 0x7fde3806d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde4c15eab0 0x7fde4c0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cf6d0 0x7fde4c0c6df0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 --2- 172.21.15.5:0/1466132574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde4c0d1bc0 0x7fde4c0c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 >> 172.21.15.5:0/1466132574 conn(0x7fde4c0665a0 msgr2=0x7fde4c0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 shutdown_connections 2023-10-16T13:39:03.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.775+0000 7fde5137a700 1 -- 172.21.15.5:0/1466132574 wait complete. 2023-10-16T13:39:03.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:03.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.916+0000 7fbd6e199700 1 Processor -- start 2023-10-16T13:39:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.916+0000 7fbd6e199700 1 -- start start 2023-10-16T13:39:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd6e199700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd6815ab10 0x7fbd6815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd6e199700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd680cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd6e199700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbd680b23d0 0x7fbd680cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd6e199700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6815e7a0 con 0x7fbd6815ab10 2023-10-16T13:39:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd6e199700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6815f730 con 0x7fbd680b23d0 2023-10-16T13:39:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd6e199700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680b29a0 con 0x7fbd680b1f50 2023-10-16T13:39:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd6815ab10 0x7fbd6815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd6815ab10 0x7fbd6815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43202/0 (socket says 172.21.15.5:43202) 2023-10-16T13:39:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 -- 172.21.15.5:0/218801706 learned_addr learned my addr 172.21.15.5:0/218801706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd67fff700 1 --2- 172.21.15.5:0/218801706 >> v2:172.21.15.112:3300/0 conn(0x7fbd680b23d0 0x7fbd680cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/218801706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd680cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 -- 172.21.15.5:0/218801706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 msgr2=0x7fbd680cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 --2- 172.21.15.5:0/218801706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd680cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 -- 172.21.15.5:0/218801706 >> v2:172.21.15.112:3300/0 conn(0x7fbd680b23d0 msgr2=0x7fbd680cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 --2- 172.21.15.5:0/218801706 >> v2:172.21.15.112:3300/0 conn(0x7fbd680b23d0 0x7fbd680cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.917+0000 7fbd677fe700 1 -- 172.21.15.5:0/218801706 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680b2c80 con 0x7fbd6815ab10 2023-10-16T13:39:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd67fff700 1 --2- 172.21.15.5:0/218801706 >> v2:172.21.15.112:3300/0 conn(0x7fbd680b23d0 0x7fbd680cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd677fe700 1 --2- 172.21.15.5:0/218801706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd6815f1f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd68072ef0 tx=0x7fbd58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f131309fe43697b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd667fc700 1 -- 172.21.15.5:0/218801706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800b870 con 0x7fbd6815ab10 2023-10-16T13:39:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd667fc700 1 -- 172.21.15.5:0/218801706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5800b9d0 con 0x7fbd6815ab10 2023-10-16T13:39:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd667fc700 1 -- 172.21.15.5:0/218801706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800bd60 con 0x7fbd6815ab10 2023-10-16T13:39:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 -- 172.21.15.5:0/218801706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 msgr2=0x7fbd6815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 --2- 172.21.15.5:0/218801706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd6815f1f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd68072ef0 tx=0x7fbd58009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 -- 172.21.15.5:0/218801706 shutdown_connections 2023-10-16T13:39:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 --2- 172.21.15.5:0/218801706 >> v2:172.21.15.112:3300/0 conn(0x7fbd680b23d0 0x7fbd680cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 --2- 172.21.15.5:0/218801706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd6815f1f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 --2- 172.21.15.5:0/218801706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd680cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 -- 172.21.15.5:0/218801706 >> 172.21.15.5:0/218801706 conn(0x7fbd6806dae0 msgr2=0x7fbd6806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.918+0000 7fbd6e199700 1 -- 172.21.15.5:0/218801706 shutdown_connections 2023-10-16T13:39:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.919+0000 7fbd6e199700 1 -- 172.21.15.5:0/218801706 wait complete. 2023-10-16T13:39:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.920+0000 7fbd6e199700 1 Processor -- start 2023-10-16T13:39:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.920+0000 7fbd6e199700 1 -- start start 2023-10-16T13:39:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd6814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd680b23d0 0x7fbd680c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd680b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6815aef0 con 0x7fbd6815ab10 2023-10-16T13:39:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680c9d50 con 0x7fbd680b23d0 2023-10-16T13:39:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680ca030 con 0x7fbd680b1f50 2023-10-16T13:39:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd680b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd680b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43212/0 (socket says 172.21.15.5:43212) 2023-10-16T13:39:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 -- 172.21.15.5:0/818524509 learned_addr learned my addr 172.21.15.5:0/818524509 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd677fe700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd6814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd66ffd700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd680b23d0 0x7fbd680c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 -- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 msgr2=0x7fbd6814cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd6814cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 -- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd680b23d0 msgr2=0x7fbd680c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd680b23d0 0x7fbd680c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 -- 172.21.15.5:0/818524509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009550 con 0x7fbd6815ab10 2023-10-16T13:39:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd67fff700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd680b0c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbd60007df0 tx=0x7fbd6000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000dd20 con 0x7fbd6815ab10 2023-10-16T13:39:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6000f040 con 0x7fbd6815ab10 2023-10-16T13:39:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60003c60 con 0x7fbd6815ab10 2023-10-16T13:39:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.921+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd680ca310 con 0x7fbd6815ab10 2023-10-16T13:39:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.922+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6814d430 con 0x7fbd6815ab10 2023-10-16T13:39:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.922+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6815b0a0 con 0x7fbd6815ab10 2023-10-16T13:39:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.923+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd60004030 con 0x7fbd6815ab10 2023-10-16T13:39:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.923+0000 7fbd5ffff700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd4806af00 0x7fbd4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.923+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd60089510 con 0x7fbd6815ab10 2023-10-16T13:39:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.923+0000 7fbd677fe700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd4806af00 0x7fbd4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.924+0000 7fbd677fe700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd4806af00 0x7fbd4806d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd58014040 tx=0x7fbd58008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:03.928+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd6815b0a0 con 0x7fbd6815ab10 2023-10-16T13:39:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.127+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd68067d20 con 0x7fbd6815ab10 2023-10-16T13:39:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.127+0000 7fbd5ffff700 1 -- 172.21.15.5:0/818524509 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd60087e60 con 0x7fbd6815ab10 2023-10-16T13:39:04.130 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd4806af00 msgr2=0x7fbd4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd4806af00 0x7fbd4806d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd58014040 tx=0x7fbd58008030 comp rx=0 tx=0).stop 2023-10-16T13:39:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 msgr2=0x7fbd680b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd680b0c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbd60007df0 tx=0x7fbd6000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 shutdown_connections 2023-10-16T13:39:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815ab10 0x7fbd680b0c60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd4806af00 0x7fbd4806d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd680b1f50 0x7fbd6814cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 --2- 172.21.15.5:0/818524509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd680b23d0 0x7fbd680c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.129+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 >> 172.21.15.5:0/818524509 conn(0x7fbd6806dae0 msgr2=0x7fbd6806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:04.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.130+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 shutdown_connections 2023-10-16T13:39:04.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.130+0000 7fbd6e199700 1 -- 172.21.15.5:0/818524509 wait complete. 2023-10-16T13:39:04.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.269+0000 7f74f9307700 1 Processor -- start 2023-10-16T13:39:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.269+0000 7f74f9307700 1 -- start start 2023-10-16T13:39:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f9307700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f9307700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74f40cede0 0x7f74f415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f9307700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f40cf260 con 0x7f74f406a840 2023-10-16T13:39:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f9307700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f41619a0 con 0x7f74f40cede0 2023-10-16T13:39:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f9307700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40b2d60 con 0x7f74f40cd950 2023-10-16T13:39:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f74f406a840 0x7f74f4161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53222/0 (socket says 172.21.15.5:53222) 2023-10-16T13:39:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.270+0000 7f74f37fe700 1 -- 172.21.15.5:0/3829528509 learned_addr learned my addr 172.21.15.5:0/3829528509 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f2ffd700 1 --2- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f27fc700 1 --2- 172.21.15.5:0/3829528509 >> v2:172.21.15.112:3300/0 conn(0x7f74f40cede0 0x7f74f415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f1ffb700 1 -- 172.21.15.5:0/3829528509 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593437362 0 0) 0x7f74f40cf260 con 0x7f74f406a840 2023-10-16T13:39:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f1ffb700 1 -- 172.21.15.5:0/3829528509 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74dc0035b0 con 0x7f74f406a840 2023-10-16T13:39:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f27fc700 1 -- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 msgr2=0x7f74f415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f27fc700 1 --2- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f1ffb700 1 -- 172.21.15.5:0/3829528509 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877710939 0 0) 0x7f74dc0035b0 con 0x7f74f406a840 2023-10-16T13:39:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f27fc700 1 -- 172.21.15.5:0/3829528509 >> v1:172.21.15.5:6789/0 conn(0x7f74f406a840 legacy=0x7f74f4161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f27fc700 1 -- 172.21.15.5:0/3829528509 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40cdd30 con 0x7f74f40cede0 2023-10-16T13:39:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f27fc700 1 --2- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f415f570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009820 tx=0x7f74e4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19647281bddc318 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f1ffb700 1 -- 172.21.15.5:0/3829528509 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0019f0 con 0x7f74f40cede0 2023-10-16T13:39:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f1ffb700 1 -- 172.21.15.5:0/3829528509 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4005c30 con 0x7f74f40cede0 2023-10-16T13:39:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.271+0000 7f74f1ffb700 1 -- 172.21.15.5:0/3829528509 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4004030 con 0x7f74f40cede0 2023-10-16T13:39:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 -- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 msgr2=0x7f74f415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 --2- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f415f570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009820 tx=0x7f74e4009b30 comp rx=0 tx=0).stop 2023-10-16T13:39:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 -- 172.21.15.5:0/3829528509 shutdown_connections 2023-10-16T13:39:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 --2- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 --2- 172.21.15.5:0/3829528509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f415f570 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 -- 172.21.15.5:0/3829528509 >> 172.21.15.5:0/3829528509 conn(0x7f74f406dae0 msgr2=0x7f74f406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 -- 172.21.15.5:0/3829528509 shutdown_connections 2023-10-16T13:39:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.272+0000 7f74f9307700 1 -- 172.21.15.5:0/3829528509 wait complete. 2023-10-16T13:39:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.273+0000 7f74f9307700 1 Processor -- start 2023-10-16T13:39:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.273+0000 7f74f9307700 1 -- start start 2023-10-16T13:39:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f9307700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 0x7f74f40b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f9307700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f40c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f9307700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f4152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f9307700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40b4130 con 0x7f74f406a840 2023-10-16T13:39:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f9307700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40b4790 con 0x7f74f40cede0 2023-10-16T13:39:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f9307700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40b35c0 con 0x7f74f40cd950 2023-10-16T13:39:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 0x7f74f40b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 0x7f74f40b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43220/0 (socket says 172.21.15.5:43220) 2023-10-16T13:39:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 -- 172.21.15.5:0/1211031248 learned_addr learned my addr 172.21.15.5:0/1211031248 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f27fc700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f40c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f37fe700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f4152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 -- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 msgr2=0x7f74f40c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f40c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 -- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 msgr2=0x7f74f4152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f4152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 -- 172.21.15.5:0/1211031248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009430 con 0x7f74f406a840 2023-10-16T13:39:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f37fe700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f4152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.274+0000 7f74f2ffd700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 0x7f74f40b3080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f74e800e9b0 tx=0x7f74e800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.275+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8009710 con 0x7f74f406a840 2023-10-16T13:39:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.275+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e800c850 con 0x7f74f406a840 2023-10-16T13:39:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.275+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f40b3890 con 0x7f74f406a840 2023-10-16T13:39:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.275+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800cbc0 con 0x7f74f406a840 2023-10-16T13:39:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.275+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f40b3e50 con 0x7f74f406a840 2023-10-16T13:39:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.276+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f40b44f0 con 0x7f74f406a840 2023-10-16T13:39:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.276+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74e800cd20 con 0x7f74f406a840 2023-10-16T13:39:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.277+0000 7f74db7fe700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f74e006af00 0x7f74e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.277+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74e8089620 con 0x7f74f406a840 2023-10-16T13:39:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.277+0000 7f74f27fc700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f74e006af00 0x7f74e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.277+0000 7f74f27fc700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f74e006af00 0x7f74e006d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74e4000c00 tx=0x7f74e4008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.281+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74f40b44f0 con 0x7f74f406a840 2023-10-16T13:39:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.481+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74f40b48d0 con 0x7f74f406a840 2023-10-16T13:39:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.482+0000 7f74db7fe700 1 -- 172.21.15.5:0/1211031248 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74f40b48d0 con 0x7f74f406a840 2023-10-16T13:39:04.485 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f74e006af00 msgr2=0x7f74e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f74e006af00 0x7f74e006d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74e4000c00 tx=0x7f74e4008070 comp rx=0 tx=0).stop 2023-10-16T13:39:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 msgr2=0x7f74f40b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 0x7f74f40b3080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f74e800e9b0 tx=0x7f74e800ecc0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 shutdown_connections 2023-10-16T13:39:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f40cede0 0x7f74f4152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f406a840 0x7f74f40b3080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f74e006af00 0x7f74e006d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 --2- 172.21.15.5:0/1211031248 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f40cd950 0x7f74f40c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 >> 172.21.15.5:0/1211031248 conn(0x7f74f406dae0 msgr2=0x7f74f4160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 shutdown_connections 2023-10-16T13:39:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.484+0000 7f74f9307700 1 -- 172.21.15.5:0/1211031248 wait complete. 2023-10-16T13:39:04.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:04.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.624+0000 7f0498bae700 1 Processor -- start 2023-10-16T13:39:04.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.624+0000 7f0498bae700 1 -- start start 2023-10-16T13:39:04.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0498bae700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f049415f1f0 0x7f04940cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0498bae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0498bae700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049415e7a0 con 0x7f049415ab10 2023-10-16T13:39:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0498bae700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04940d00d0 con 0x7f049415f1f0 2023-10-16T13:39:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0498bae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940b29a0 con 0x7f04940cfc60 2023-10-16T13:39:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0491d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f049415f1f0 0x7f04940cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f049259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f049415ab10 0x7f04940b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53232/0 (socket says 172.21.15.5:53232) 2023-10-16T13:39:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f049259c700 1 -- 172.21.15.5:0/1846907381 learned_addr learned my addr 172.21.15.5:0/1846907381 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0492d9d700 1 --2- 172.21.15.5:0/1846907381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0491d9b700 1 -- 172.21.15.5:0/1846907381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 msgr2=0x7f04940cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0491d9b700 1 --2- 172.21.15.5:0/1846907381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0491d9b700 1 -- 172.21.15.5:0/1846907381 >> v1:172.21.15.5:6789/0 conn(0x7f049415ab10 legacy=0x7f04940b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0491d9b700 1 -- 172.21.15.5:0/1846907381 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04940b2c80 con 0x7f049415f1f0 2023-10-16T13:39:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f049159a700 1 -- 172.21.15.5:0/1846907381 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271634655 0 0) 0x7f049415e7a0 con 0x7f049415ab10 2023-10-16T13:39:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f0491d9b700 1 --2- 172.21.15.5:0/1846907381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415f1f0 0x7f04940cf720 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0488009820 tx=0x7f0488009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6f923b84187e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f049159a700 1 -- 172.21.15.5:0/1846907381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488005e30 con 0x7f049415f1f0 2023-10-16T13:39:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.625+0000 7f049159a700 1 -- 172.21.15.5:0/1846907381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488006030 con 0x7f049415f1f0 2023-10-16T13:39:04.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f049159a700 1 -- 172.21.15.5:0/1846907381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880063c0 con 0x7f049415f1f0 2023-10-16T13:39:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 -- 172.21.15.5:0/1846907381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415f1f0 msgr2=0x7f04940cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 --2- 172.21.15.5:0/1846907381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415f1f0 0x7f04940cf720 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0488009820 tx=0x7f0488009b30 comp rx=0 tx=0).stop 2023-10-16T13:39:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 -- 172.21.15.5:0/1846907381 shutdown_connections 2023-10-16T13:39:04.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 --2- 172.21.15.5:0/1846907381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 --2- 172.21.15.5:0/1846907381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415f1f0 0x7f04940cf720 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 -- 172.21.15.5:0/1846907381 >> 172.21.15.5:0/1846907381 conn(0x7f049406dae0 msgr2=0x7f049406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 -- 172.21.15.5:0/1846907381 shutdown_connections 2023-10-16T13:39:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.626+0000 7f0498bae700 1 -- 172.21.15.5:0/1846907381 wait complete. 2023-10-16T13:39:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.627+0000 7f0498bae700 1 Processor -- start 2023-10-16T13:39:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 -- start start 2023-10-16T13:39:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 0x7f049413a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049415f1f0 0x7f04940c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940ca8c0 con 0x7f049415ab10 2023-10-16T13:39:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c9d40 con 0x7f049415f1f0 2023-10-16T13:39:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0498bae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940ca020 con 0x7f04940cfc60 2023-10-16T13:39:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0491d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 0x7f049413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0491d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 0x7f049413a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43236/0 (socket says 172.21.15.5:43236) 2023-10-16T13:39:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.628+0000 7f0491d9b700 1 -- 172.21.15.5:0/324824207 learned_addr learned my addr 172.21.15.5:0/324824207 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0492d9d700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049415f1f0 0x7f04940c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f049259c700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0491d9b700 1 -- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 msgr2=0x7f04940c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0491d9b700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0491d9b700 1 -- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049415f1f0 msgr2=0x7f04940c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0491d9b700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049415f1f0 0x7f04940c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0491d9b700 1 -- 172.21.15.5:0/324824207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488009430 con 0x7f049415ab10 2023-10-16T13:39:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f049259c700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0491d9b700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 0x7f049413a200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0488000c00 tx=0x7f0488004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880063a0 con 0x7f049415ab10 2023-10-16T13:39:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488020070 con 0x7f049415ab10 2023-10-16T13:39:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04940ca300 con 0x7f049415ab10 2023-10-16T13:39:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488006760 con 0x7f049415ab10 2023-10-16T13:39:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.629+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940c7ae0 con 0x7f049415ab10 2023-10-16T13:39:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.630+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04940c7c70 con 0x7f049415ab10 2023-10-16T13:39:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.631+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0488022030 con 0x7f049415ab10 2023-10-16T13:39:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.631+0000 7f0482ffd700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f047406af00 0x7f047406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.631+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f048808aab0 con 0x7f049415ab10 2023-10-16T13:39:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.631+0000 7f049259c700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f047406af00 0x7f047406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.632+0000 7f049259c700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f047406af00 0x7f047406d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0484000f60 tx=0x7f0484007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.636+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04940c7c70 con 0x7f049415ab10 2023-10-16T13:39:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.837+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f049415c100 con 0x7f049415ab10 2023-10-16T13:39:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.837+0000 7f0482ffd700 1 -- 172.21.15.5:0/324824207 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f049415c100 con 0x7f049415ab10 2023-10-16T13:39:04.840 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f047406af00 msgr2=0x7f047406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f047406af00 0x7f047406d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0484000f60 tx=0x7f0484007d30 comp rx=0 tx=0).stop 2023-10-16T13:39:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 msgr2=0x7f049413a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 0x7f049413a200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0488000c00 tx=0x7f0488004750 comp rx=0 tx=0).stop 2023-10-16T13:39:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 shutdown_connections 2023-10-16T13:39:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049415f1f0 0x7f04940c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f047406af00 0x7f047406d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04940cfc60 0x7f04940c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 --2- 172.21.15.5:0/324824207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049415ab10 0x7f049413a200 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 >> 172.21.15.5:0/324824207 conn(0x7f049406dae0 msgr2=0x7f04940cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 shutdown_connections 2023-10-16T13:39:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.839+0000 7f0498bae700 1 -- 172.21.15.5:0/324824207 wait complete. 2023-10-16T13:39:04.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:39:04.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.977+0000 7f9e3f3cd700 1 Processor -- start 2023-10-16T13:39:04.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.977+0000 7f9e3f3cd700 1 -- start start 2023-10-16T13:39:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3f3cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e380cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3f3cd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e38161670 0x7f9e3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3f3cd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e380ccd10 0x7f9e3806ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3f3cd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e38071ab0 con 0x7f9e380ccd10 2023-10-16T13:39:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3f3cd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e38161bc0 con 0x7f9e38161670 2023-10-16T13:39:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3f3cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38161ea0 con 0x7f9e380cc3f0 2023-10-16T13:39:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3d96a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e380ccd10 0x7f9e3806ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3d96a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e380ccd10 0x7f9e3806ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43246/0 (socket says 172.21.15.5:43246) 2023-10-16T13:39:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.978+0000 7f9e3d96a700 1 -- 172.21.15.5:0/3449725011 learned_addr learned my addr 172.21.15.5:0/3449725011 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d169700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e380cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3c968700 1 --2- 172.21.15.5:0/3449725011 >> v2:172.21.15.112:3300/0 conn(0x7f9e38161670 0x7f9e3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d96a700 1 -- 172.21.15.5:0/3449725011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 msgr2=0x7f9e380cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d96a700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e380cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d96a700 1 -- 172.21.15.5:0/3449725011 >> v2:172.21.15.112:3300/0 conn(0x7f9e38161670 msgr2=0x7f9e3806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d96a700 1 --2- 172.21.15.5:0/3449725011 >> v2:172.21.15.112:3300/0 conn(0x7f9e38161670 0x7f9e3806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d96a700 1 -- 172.21.15.5:0/3449725011 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38162180 con 0x7f9e380ccd10 2023-10-16T13:39:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3c968700 1 --2- 172.21.15.5:0/3449725011 >> v2:172.21.15.112:3300/0 conn(0x7f9e38161670 0x7f9e3806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d169700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e3d96a700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e3806ad80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9e3806eba0 tx=0x7f9e3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d275c7e91e2f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e2ffff700 1 -- 172.21.15.5:0/3449725011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000e070 con 0x7f9e380ccd10 2023-10-16T13:39:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e2ffff700 1 -- 172.21.15.5:0/3449725011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000b9c0 con 0x7f9e380ccd10 2023-10-16T13:39:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.979+0000 7f9e2ffff700 1 -- 172.21.15.5:0/3449725011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000bd70 con 0x7f9e380ccd10 2023-10-16T13:39:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/3449725011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 msgr2=0x7f9e3806ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e3806ad80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9e3806eba0 tx=0x7f9e3000b330 comp rx=0 tx=0).stop 2023-10-16T13:39:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/3449725011 shutdown_connections 2023-10-16T13:39:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e3806ad80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/3449725011 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/3449725011 >> v2:172.21.15.112:3300/0 conn(0x7f9e38161670 0x7f9e3806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/3449725011 >> 172.21.15.5:0/3449725011 conn(0x7f9e3806dac0 msgr2=0x7f9e3806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/3449725011 shutdown_connections 2023-10-16T13:39:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.980+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/3449725011 wait complete. 2023-10-16T13:39:04.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.981+0000 7f9e3f3cd700 1 Processor -- start 2023-10-16T13:39:04.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.981+0000 7f9e3f3cd700 1 -- start start 2023-10-16T13:39:04.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e38153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e380c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e38161670 0x7f9e380b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b4e80 con 0x7f9e380ccd10 2023-10-16T13:39:04.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38153ff0 con 0x7f9e38161670 2023-10-16T13:39:04.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c4b80 con 0x7f9e380cc3f0 2023-10-16T13:39:04.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e380c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e380c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43250/0 (socket says 172.21.15.5:43250) 2023-10-16T13:39:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 -- 172.21.15.5:0/1741751249 learned_addr learned my addr 172.21.15.5:0/1741751249 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3d169700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e38153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3d96a700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e38161670 0x7f9e380b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 -- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 msgr2=0x7f9e38153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e38153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 -- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e38161670 msgr2=0x7f9e380b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e38161670 0x7f9e380b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 -- 172.21.15.5:0/1741751249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30009b30 con 0x7f9e380ccd10 2023-10-16T13:39:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3c968700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e380c4640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400c740 tx=0x7f9e3400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34004220 con 0x7f9e380ccd10 2023-10-16T13:39:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34004380 con 0x7f9e380ccd10 2023-10-16T13:39:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380b5680 con 0x7f9e380ccd10 2023-10-16T13:39:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.982+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340036c0 con 0x7f9e380ccd10 2023-10-16T13:39:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.983+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e381f6d50 con 0x7f9e380ccd10 2023-10-16T13:39:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.983+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38067d20 con 0x7f9e380ccd10 2023-10-16T13:39:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.984+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e34003820 con 0x7f9e380ccd10 2023-10-16T13:39:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.984+0000 7f9e2dffb700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9e1c06af30 0x7f9e1c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.985+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e34089730 con 0x7f9e380ccd10 2023-10-16T13:39:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.985+0000 7f9e3d169700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9e1c06af30 0x7f9e1c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.985+0000 7f9e3d169700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9e1c06af30 0x7f9e1c06d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e380aea40 tx=0x7f9e28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:04.989+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e340547e0 con 0x7f9e380ccd10 2023-10-16T13:39:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.205+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9e380cf2c0 con 0x7f9e380ccd10 2023-10-16T13:39:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.206+0000 7f9e2dffb700 1 -- 172.21.15.5:0/1741751249 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9e34057e00 con 0x7f9e380ccd10 2023-10-16T13:39:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9e1c06af30 msgr2=0x7f9e1c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9e1c06af30 0x7f9e1c06d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e380aea40 tx=0x7f9e28008040 comp rx=0 tx=0).stop 2023-10-16T13:39:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 msgr2=0x7f9e380c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e380c4640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400c740 tx=0x7f9e3400ca50 comp rx=0 tx=0).stop 2023-10-16T13:39:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 shutdown_connections 2023-10-16T13:39:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e38161670 0x7f9e380b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9e1c06af30 0x7f9e1c06d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e380cc3f0 0x7f9e38153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 --2- 172.21.15.5:0/1741751249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e380ccd10 0x7f9e380c4640 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 >> 172.21.15.5:0/1741751249 conn(0x7f9e3806dac0 msgr2=0x7f9e380cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 shutdown_connections 2023-10-16T13:39:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.208+0000 7f9e3f3cd700 1 -- 172.21.15.5:0/1741751249 wait complete. 2023-10-16T13:39:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:39:05.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-16T13:39:05.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:05.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-16T13:39:05.265 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:39:05.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:05.266 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T13:39:05.325 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:39:05.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:05.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.448+0000 7ff8ca8f5700 1 Processor -- start 2023-10-16T13:39:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.448+0000 7ff8ca8f5700 1 -- start start 2023-10-16T13:39:05.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.448+0000 7ff8ca8f5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 0x7ff8c40d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8ca8f5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c40cf190 con 0x7ff8c40ce6e0 2023-10-16T13:39:05.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8ca8f5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c40cbd40 con 0x7ff8c40d0c70 2023-10-16T13:39:05.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8ca8f5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c415bb20 con 0x7ff8c415b740 2023-10-16T13:39:05.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c8e92700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff8c40ce6e0 0x7ff8c40cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53264/0 (socket says 172.21.15.5:53264) 2023-10-16T13:39:05.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c8e92700 1 -- 172.21.15.5:0/3093762094 learned_addr learned my addr 172.21.15.5:0/3093762094 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:05.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 0x7ff8c40d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264429537 0 0) 0x7ff8c40cf190 con 0x7ff8c40ce6e0 2023-10-16T13:39:05.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac0035b0 con 0x7ff8c40ce6e0 2023-10-16T13:39:05.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322054491 0 0) 0x7ff8c40cbd40 con 0x7ff8c40d0c70 2023-10-16T13:39:05.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c40cf190 con 0x7ff8c40d0c70 2023-10-16T13:39:05.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355426493 0 0) 0x7ff8ac0035b0 con 0x7ff8c40ce6e0 2023-10-16T13:39:05.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 msgr2=0x7ff8c40d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:05.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 0x7ff8c40d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 >> v1:172.21.15.112:6789/0 conn(0x7ff8c40d0c70 legacy=0x7ff8c40cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40cc020 con 0x7ff8c40ce6e0 2023-10-16T13:39:05.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7ff8bc0019f0 con 0x7ff8c40ce6e0 2023-10-16T13:39:05.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 >> v1:172.21.15.5:6789/0 conn(0x7ff8c40ce6e0 legacy=0x7ff8c40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8ac003bc0 0x7ff8ac003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8ac004850 0x7ff8ac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 0x7ff8ac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c415bb20 con 0x7ff8ac003bc0 2023-10-16T13:39:05.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac00bb20 con 0x7ff8ac004850 2023-10-16T13:39:05.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac00bce0 con 0x7ff8c415b740 2023-10-16T13:39:05.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.449+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8ac003bc0 0x7ff8ac003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c8e92700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 0x7ff8ac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c37fe700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8ac004850 0x7ff8ac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c3fff700 1 -- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 msgr2=0x7ff8ac005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8c415b740 0x7ff8ac005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c3fff700 1 -- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8ac004850 msgr2=0x7ff8ac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8ac004850 0x7ff8ac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c3fff700 1 -- 172.21.15.5:0/3093762094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0035b0 con 0x7ff8ac003bc0 2023-10-16T13:39:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8ac003bc0 0x7ff8ac003fc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009b60 tx=0x7ff8ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec1a2a31a3425f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400e6c0 con 0x7ff8ac003bc0 2023-10-16T13:39:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400e820 con 0x7ff8ac003bc0 2023-10-16T13:39:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.450+0000 7ff8c2ffd700 1 -- 172.21.15.5:0/3093762094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400eb90 con 0x7ff8ac003bc0 2023-10-16T13:39:05.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3093762094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8ac003bc0 msgr2=0x7ff8ac003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3093762094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8ac003bc0 0x7ff8ac003fc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009b60 tx=0x7ff8ac005880 comp rx=0 tx=0).stop 2023-10-16T13:39:05.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8c8e92700 1 -- 172.21.15.5:0/3093762094 reap_dead start 2023-10-16T13:39:05.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3093762094 shutdown_connections 2023-10-16T13:39:05.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3093762094 >> 172.21.15.5:0/3093762094 conn(0x7ff8c40665a0 msgr2=0x7ff8c4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:05.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3093762094 shutdown_connections 2023-10-16T13:39:05.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.451+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3093762094 wait complete. 2023-10-16T13:39:05.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.452+0000 7ff8ca8f5700 1 Processor -- start 2023-10-16T13:39:05.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.452+0000 7ff8ca8f5700 1 -- start start 2023-10-16T13:39:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8ca8f5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8ac003bc0 0x7ff8c40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8ca8f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 0x7ff8c40b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8ca8f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c40d1350 0x7ff8c40d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8ca8f5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c4152540 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8ca8f5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40d1d10 con 0x7ff8c40d1350 2023-10-16T13:39:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8ca8f5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40c8e80 con 0x7ff8ac003bc0 2023-10-16T13:39:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 0x7ff8c40b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 0x7ff8c40b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43270/0 (socket says 172.21.15.5:43270) 2023-10-16T13:39:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 -- 172.21.15.5:0/3939052742 learned_addr learned my addr 172.21.15.5:0/3939052742 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c8e92700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c40d1350 0x7ff8c40d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8ac003bc0 0x7ff8c40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 -- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8ac003bc0 msgr2=0x7ff8c40b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8ac003bc0 0x7ff8c40b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 -- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c40d1350 msgr2=0x7ff8c40d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c40d1350 0x7ff8c40d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 -- 172.21.15.5:0/3939052742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40b6c00 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c8e92700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c40d1350 0x7ff8c40d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8ac003bc0 0x7ff8c40b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.453+0000 7ff8c37fe700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 0x7ff8c40b6520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800f770 tx=0x7ff8b800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.454+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80052e0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.454+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8005460 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.454+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80038c0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.454+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c40c8830 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.454+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c4155e90 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.454+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c40c50f0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.455+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8b8003a20 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.455+0000 7ff8c0ff9700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff8b006af00 0x7ff8b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.456+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8b80894c0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.456+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff8b006af00 0x7ff8b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.456+0000 7ff8c3fff700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff8b006af00 0x7ff8b006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40090b0 tx=0x7ff8b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:05.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.460+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8c40c50f0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.702+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c40c50f0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.702+0000 7ff8c0ff9700 1 -- 172.21.15.5:0/3939052742 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff8c40c50f0 con 0x7ff8c40cb1f0 2023-10-16T13:39:05.705 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:05.705 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:39:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff8b006af00 msgr2=0x7ff8b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff8b006af00 0x7ff8b006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40090b0 tx=0x7ff8b4008030 comp rx=0 tx=0).stop 2023-10-16T13:39:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 msgr2=0x7ff8c40b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 0x7ff8c40b6520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800f770 tx=0x7ff8b800fb30 comp rx=0 tx=0).stop 2023-10-16T13:39:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 shutdown_connections 2023-10-16T13:39:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c40d1350 0x7ff8c40d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff8b006af00 0x7ff8b006d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8ac003bc0 0x7ff8c40b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 --2- 172.21.15.5:0/3939052742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c40cb1f0 0x7ff8c40b6520 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.704+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 >> 172.21.15.5:0/3939052742 conn(0x7ff8c40665a0 msgr2=0x7ff8c415a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.705+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 shutdown_connections 2023-10-16T13:39:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.705+0000 7ff8ca8f5700 1 -- 172.21.15.5:0/3939052742 wait complete. 2023-10-16T13:39:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:39:05.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.842+0000 7f50a537a700 1 Processor -- start 2023-10-16T13:39:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.842+0000 7f50a537a700 1 -- start start 2023-10-16T13:39:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f50a537a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50a015dbc0 0x7f50a015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f50a537a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00b7050 0x7f50a00d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f50a537a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a015e4e0 con 0x7f50a00d3fc0 2023-10-16T13:39:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f50a537a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00b7560 con 0x7f50a015dbc0 2023-10-16T13:39:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f50a537a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00b7840 con 0x7f50a00b7050 2023-10-16T13:39:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50a015dbc0 0x7f50a015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50a015dbc0 0x7f50a015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43276/0 (socket says 172.21.15.5:43276) 2023-10-16T13:39:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509effd700 1 -- 172.21.15.5:0/883606586 learned_addr learned my addr 172.21.15.5:0/883606586 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509f7fe700 1 --2- 172.21.15.5:0/883606586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00b7050 0x7f50a00d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509effd700 1 -- 172.21.15.5:0/883606586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00b7050 msgr2=0x7f50a00d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509effd700 1 --2- 172.21.15.5:0/883606586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00b7050 0x7f50a00d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.843+0000 7f509effd700 1 -- 172.21.15.5:0/883606586 >> v1:172.21.15.112:6789/0 conn(0x7f50a00d3fc0 legacy=0x7f50a00d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f509effd700 1 -- 172.21.15.5:0/883606586 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00b7b20 con 0x7f50a015dbc0 2023-10-16T13:39:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f509effd700 1 --2- 172.21.15.5:0/883606586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a015dfa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5094006fd0 tx=0x7f5094009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bece682cc8e4bb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f509dffb700 1 -- 172.21.15.5:0/883606586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094005e30 con 0x7f50a015dbc0 2023-10-16T13:39:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f509dffb700 1 -- 172.21.15.5:0/883606586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094004030 con 0x7f50a015dbc0 2023-10-16T13:39:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f509dffb700 1 -- 172.21.15.5:0/883606586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940043e0 con 0x7f50a015dbc0 2023-10-16T13:39:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 -- 172.21.15.5:0/883606586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 msgr2=0x7f50a015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 --2- 172.21.15.5:0/883606586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a015dfa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5094006fd0 tx=0x7f5094009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 -- 172.21.15.5:0/883606586 shutdown_connections 2023-10-16T13:39:05.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 --2- 172.21.15.5:0/883606586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00b7050 0x7f50a00d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 --2- 172.21.15.5:0/883606586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a015dfa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 -- 172.21.15.5:0/883606586 >> 172.21.15.5:0/883606586 conn(0x7f50a009cb40 msgr2=0x7f50a00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:05.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 -- 172.21.15.5:0/883606586 shutdown_connections 2023-10-16T13:39:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.844+0000 7f50a537a700 1 -- 172.21.15.5:0/883606586 wait complete. 2023-10-16T13:39:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.846+0000 7f50a537a700 1 Processor -- start 2023-10-16T13:39:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.846+0000 7f50a537a700 1 -- start start 2023-10-16T13:39:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.846+0000 7f50a537a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50a00b7050 0x7f50a0153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00d3fc0 0x7f50a01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0159250 con 0x7f50a015dbc0 2023-10-16T13:39:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0158dc0 con 0x7f50a00b7050 2023-10-16T13:39:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01581b0 con 0x7f50a00d3fc0 2023-10-16T13:39:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a00c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43284/0 (socket says 172.21.15.5:43284) 2023-10-16T13:39:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50a00b7050 0x7f50a0153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 -- 172.21.15.5:0/3381323396 learned_addr learned my addr 172.21.15.5:0/3381323396 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509e7fc700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00d3fc0 0x7f50a01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 -- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00d3fc0 msgr2=0x7f50a01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00d3fc0 0x7f50a01578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 -- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50a00b7050 msgr2=0x7f50a0153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50a00b7050 0x7f50a0153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 -- 172.21.15.5:0/3381323396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009500 con 0x7f50a015dbc0 2023-10-16T13:39:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f509f7fe700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a00c9270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5098007e40 tx=0x7f509800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800ed30 con 0x7f50a015dbc0 2023-10-16T13:39:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5098014420 con 0x7f50a015dbc0 2023-10-16T13:39:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a0158490 con 0x7f50a015dbc0 2023-10-16T13:39:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980147d0 con 0x7f50a015dbc0 2023-10-16T13:39:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.847+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a0158a50 con 0x7f50a015dbc0 2023-10-16T13:39:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.848+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a0158f50 con 0x7f50a015dbc0 2023-10-16T13:39:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.849+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5098014930 con 0x7f50a015dbc0 2023-10-16T13:39:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.849+0000 7f50877fe700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f508c06af00 0x7f508c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.849+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5098089c80 con 0x7f50a015dbc0 2023-10-16T13:39:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.850+0000 7f509effd700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f508c06af00 0x7f508c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.850+0000 7f509effd700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f508c06af00 0x7f508c06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5094000c00 tx=0x7f5094008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:05.854+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5098054d30 con 0x7f50a015dbc0 2023-10-16T13:39:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.057+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50a004ebb0 con 0x7f50a015dbc0 2023-10-16T13:39:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.058+0000 7f50877fe700 1 -- 172.21.15.5:0/3381323396 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f5098058350 con 0x7f50a015dbc0 2023-10-16T13:39:06.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:06.061 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:38:20.978222+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f508c06af00 msgr2=0x7f508c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f508c06af00 0x7f508c06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5094000c00 tx=0x7f5094008070 comp rx=0 tx=0).stop 2023-10-16T13:39:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 msgr2=0x7f50a00c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a00c9270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5098007e40 tx=0x7f509800e3c0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 shutdown_connections 2023-10-16T13:39:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50a015dbc0 0x7f50a00c9270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50a00b7050 0x7f50a0153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f508c06af00 0x7f508c06d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 --2- 172.21.15.5:0/3381323396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50a00d3fc0 0x7f50a01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 >> 172.21.15.5:0/3381323396 conn(0x7f50a009cb40 msgr2=0x7f50a0155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 shutdown_connections 2023-10-16T13:39:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.061+0000 7f50a537a700 1 -- 172.21.15.5:0/3381323396 wait complete. 2023-10-16T13:39:06.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:38:17.410345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:38:18.346697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:06.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:06.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.201+0000 7fe68014d700 1 Processor -- start 2023-10-16T13:39:06.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.201+0000 7fe68014d700 1 -- start start 2023-10-16T13:39:06.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe68014d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6780d0c70 0x7fe6780cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe68014d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780d23e0 con 0x7fe67815b740 2023-10-16T13:39:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe68014d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780cf190 con 0x7fe6780c5110 2023-10-16T13:39:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe68014d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67815bb20 con 0x7fe6780d0c70 2023-10-16T13:39:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67d6e8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6780d0c70 0x7fe6780cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67dee9700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe67815b740 0x7fe6780d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53292/0 (socket says 172.21.15.5:53292) 2023-10-16T13:39:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67dee9700 1 -- 172.21.15.5:0/2222395328 learned_addr learned my addr 172.21.15.5:0/2222395328 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67d6e8700 1 -- 172.21.15.5:0/2222395328 >> v1:172.21.15.112:6789/0 conn(0x7fe6780c5110 legacy=0x7fe6780cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67d6e8700 1 -- 172.21.15.5:0/2222395328 >> v1:172.21.15.5:6789/0 conn(0x7fe67815b740 legacy=0x7fe6780d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67d6e8700 1 -- 172.21.15.5:0/2222395328 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780cbd40 con 0x7fe6780d0c70 2023-10-16T13:39:06.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.202+0000 7fe67cee7700 1 -- 172.21.15.5:0/2222395328 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952705874 0 0) 0x7fe668001110 con 0x7fe67815b740 2023-10-16T13:39:06.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe67d6e8700 1 --2- 172.21.15.5:0/2222395328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe6780cdfd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe674009840 tx=0x7fe674009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d4474e97dc3186 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe67cee7700 1 -- 172.21.15.5:0/2222395328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674004230 con 0x7fe6780d0c70 2023-10-16T13:39:06.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe67cee7700 1 -- 172.21.15.5:0/2222395328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe674004390 con 0x7fe6780d0c70 2023-10-16T13:39:06.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe67cee7700 1 -- 172.21.15.5:0/2222395328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740036a0 con 0x7fe6780d0c70 2023-10-16T13:39:06.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe68014d700 1 -- 172.21.15.5:0/2222395328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 msgr2=0x7fe6780cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe68014d700 1 --2- 172.21.15.5:0/2222395328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe6780cdfd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe674009840 tx=0x7fe674009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:06.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe68014d700 1 -- 172.21.15.5:0/2222395328 shutdown_connections 2023-10-16T13:39:06.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe68014d700 1 --2- 172.21.15.5:0/2222395328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe6780cdfd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.203+0000 7fe68014d700 1 -- 172.21.15.5:0/2222395328 >> 172.21.15.5:0/2222395328 conn(0x7fe6780665a0 msgr2=0x7fe678066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:06.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.204+0000 7fe68014d700 1 -- 172.21.15.5:0/2222395328 shutdown_connections 2023-10-16T13:39:06.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.204+0000 7fe68014d700 1 -- 172.21.15.5:0/2222395328 wait complete. 2023-10-16T13:39:06.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.205+0000 7fe68014d700 1 Processor -- start 2023-10-16T13:39:06.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.205+0000 7fe68014d700 1 -- start start 2023-10-16T13:39:06.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.205+0000 7fe68014d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6780c5110 0x7fe6781f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.205+0000 7fe68014d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe678143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe68014d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe67815b740 0x7fe678143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe68014d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780b3f80 con 0x7fe6780d0c70 2023-10-16T13:39:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe68014d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c8a00 con 0x7fe6780c5110 2023-10-16T13:39:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe68014d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67806c860 con 0x7fe67815b740 2023-10-16T13:39:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe678143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe678143100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43296/0 (socket says 172.21.15.5:43296) 2023-10-16T13:39:06.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 -- 172.21.15.5:0/3272972781 learned_addr learned my addr 172.21.15.5:0/3272972781 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67dee9700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6780c5110 0x7fe6781f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67e6ea700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe67815b740 0x7fe678143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 -- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe67815b740 msgr2=0x7fe678143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe67815b740 0x7fe678143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 -- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6780c5110 msgr2=0x7fe6781f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6780c5110 0x7fe6781f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 -- 172.21.15.5:0/3272972781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740094a0 con 0x7fe6780d0c70 2023-10-16T13:39:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67dee9700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6780c5110 0x7fe6781f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe67d6e8700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe678143100 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6740090b0 tx=0x7fe674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674011830 con 0x7fe6780d0c70 2023-10-16T13:39:06.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67401e070 con 0x7fe6780d0c70 2023-10-16T13:39:06.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67806cb40 con 0x7fe6780d0c70 2023-10-16T13:39:06.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674011bb0 con 0x7fe6780d0c70 2023-10-16T13:39:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.206+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67806d100 con 0x7fe6780d0c70 2023-10-16T13:39:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.207+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6780b40f0 con 0x7fe6780d0c70 2023-10-16T13:39:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.208+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe674011d10 con 0x7fe6780d0c70 2023-10-16T13:39:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.208+0000 7fe66e7fc700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe65c06af00 0x7fe65c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.208+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe67408a8e0 con 0x7fe6780d0c70 2023-10-16T13:39:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.208+0000 7fe67dee9700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe65c06af00 0x7fe65c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.209+0000 7fe67dee9700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe65c06af00 0x7fe65c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe668000f60 tx=0x7fe668007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.213+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6780b40f0 con 0x7fe6780d0c70 2023-10-16T13:39:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.413+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6780b40c0 con 0x7fe6780d0c70 2023-10-16T13:39:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.414+0000 7fe66e7fc700 1 -- 172.21.15.5:0/3272972781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe674020020 con 0x7fe6780d0c70 2023-10-16T13:39:06.417 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe65c06af00 msgr2=0x7fe65c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe65c06af00 0x7fe65c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe668000f60 tx=0x7fe668007d30 comp rx=0 tx=0).stop 2023-10-16T13:39:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 msgr2=0x7fe678143100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe678143100 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6740090b0 tx=0x7fe674004750 comp rx=0 tx=0).stop 2023-10-16T13:39:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 shutdown_connections 2023-10-16T13:39:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe65c06af00 0x7fe65c06d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe67815b740 0x7fe678143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6780c5110 0x7fe6781f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 --2- 172.21.15.5:0/3272972781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6780d0c70 0x7fe678143100 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 >> 172.21.15.5:0/3272972781 conn(0x7fe6780665a0 msgr2=0x7fe6780cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 shutdown_connections 2023-10-16T13:39:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.416+0000 7fe68014d700 1 -- 172.21.15.5:0/3272972781 wait complete. 2023-10-16T13:39:06.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.556+0000 7f13d5111700 1 Processor -- start 2023-10-16T13:39:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.556+0000 7f13d5111700 1 -- start start 2023-10-16T13:39:06.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13d5111700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13d015b740 0x7f13d00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13d5111700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13d00d0c70 0x7f13d00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13d5111700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d00c5110 0x7f13d00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13d5111700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d015bb20 con 0x7f13d015b740 2023-10-16T13:39:06.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13d5111700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00cf190 con 0x7f13d00d0c70 2023-10-16T13:39:06.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13d5111700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00cbd40 con 0x7f13d00c5110 2023-10-16T13:39:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13d015b740 0x7f13d00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13d015b740 0x7f13d00d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43302/0 (socket says 172.21.15.5:43302) 2023-10-16T13:39:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 -- 172.21.15.5:0/3012831734 learned_addr learned my addr 172.21.15.5:0/3012831734 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13cf59e700 1 --2- 172.21.15.5:0/3012831734 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d00c5110 0x7f13d00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ce59c700 1 --2- 172.21.15.5:0/3012831734 >> v2:172.21.15.112:3300/0 conn(0x7f13d00d0c70 0x7f13d00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 -- 172.21.15.5:0/3012831734 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d00c5110 msgr2=0x7f13d00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 --2- 172.21.15.5:0/3012831734 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d00c5110 0x7f13d00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 -- 172.21.15.5:0/3012831734 >> v2:172.21.15.112:3300/0 conn(0x7f13d00d0c70 msgr2=0x7f13d00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 --2- 172.21.15.5:0/3012831734 >> v2:172.21.15.112:3300/0 conn(0x7f13d00d0c70 0x7f13d00cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.557+0000 7f13ced9d700 1 -- 172.21.15.5:0/3012831734 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00cc020 con 0x7f13d015b740 2023-10-16T13:39:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13ced9d700 1 --2- 172.21.15.5:0/3012831734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d015b740 0x7f13d00d1cd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13d00cec30 tx=0x7f13c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9d4335b2dc2bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13cdd9b700 1 -- 172.21.15.5:0/3012831734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400b870 con 0x7f13d015b740 2023-10-16T13:39:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13cdd9b700 1 -- 172.21.15.5:0/3012831734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400b9d0 con 0x7f13d015b740 2023-10-16T13:39:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13cdd9b700 1 -- 172.21.15.5:0/3012831734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400bd60 con 0x7f13d015b740 2023-10-16T13:39:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 -- 172.21.15.5:0/3012831734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d015b740 msgr2=0x7f13d00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 --2- 172.21.15.5:0/3012831734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d015b740 0x7f13d00d1cd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13d00cec30 tx=0x7f13c4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 -- 172.21.15.5:0/3012831734 shutdown_connections 2023-10-16T13:39:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 --2- 172.21.15.5:0/3012831734 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d00c5110 0x7f13d00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 --2- 172.21.15.5:0/3012831734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d015b740 0x7f13d00d1cd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 --2- 172.21.15.5:0/3012831734 >> v2:172.21.15.112:3300/0 conn(0x7f13d00d0c70 0x7f13d00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 -- 172.21.15.5:0/3012831734 >> 172.21.15.5:0/3012831734 conn(0x7f13d00665a0 msgr2=0x7f13d0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 -- 172.21.15.5:0/3012831734 shutdown_connections 2023-10-16T13:39:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.558+0000 7f13d5111700 1 -- 172.21.15.5:0/3012831734 wait complete. 2023-10-16T13:39:06.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.560+0000 7f13d5111700 1 Processor -- start 2023-10-16T13:39:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.560+0000 7f13d5111700 1 -- start start 2023-10-16T13:39:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13d5111700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d00c5110 0x7f13d00c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13d5111700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 0x7f13d014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13d5111700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d015b740 0x7f13d01f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13d5111700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00cffd0 con 0x7f13d00d0c70 2023-10-16T13:39:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13d5111700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00b5db0 con 0x7f13d00c5110 2023-10-16T13:39:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13d5111700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00b51a0 con 0x7f13d015b740 2023-10-16T13:39:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 0x7f13d014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 0x7f13d014fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43310/0 (socket says 172.21.15.5:43310) 2023-10-16T13:39:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 -- 172.21.15.5:0/1764532943 learned_addr learned my addr 172.21.15.5:0/1764532943 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ced9d700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d00c5110 0x7f13d00c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13cf59e700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d015b740 0x7f13d01f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 -- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d015b740 msgr2=0x7f13d01f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d015b740 0x7f13d01f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 -- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d00c5110 msgr2=0x7f13d00c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d00c5110 0x7f13d00c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 -- 172.21.15.5:0/1764532943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4009550 con 0x7f13d00d0c70 2023-10-16T13:39:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.561+0000 7f13ce59c700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 0x7f13d014fbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13c000e810 tx=0x7f13c000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.562+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000c070 con 0x7f13d00d0c70 2023-10-16T13:39:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.562+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c0013610 con 0x7f13d00d0c70 2023-10-16T13:39:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.562+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d00b5480 con 0x7f13d00d0c70 2023-10-16T13:39:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.562+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c00139c0 con 0x7f13d00d0c70 2023-10-16T13:39:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.562+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d00b5a40 con 0x7f13d00d0c70 2023-10-16T13:39:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.563+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d00b5f60 con 0x7f13d00d0c70 2023-10-16T13:39:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.563+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f13c0013b20 con 0x7f13d00d0c70 2023-10-16T13:39:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.563+0000 7f13b77fe700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f13bc06af00 0x7f13bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.564+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13c0089310 con 0x7f13d00d0c70 2023-10-16T13:39:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.564+0000 7f13ced9d700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f13bc06af00 0x7f13bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.564+0000 7f13ced9d700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f13bc06af00 0x7f13bc06d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13c4014040 tx=0x7f13c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.568+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13d00b5f60 con 0x7f13d00d0c70 2023-10-16T13:39:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.769+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13d00c6f00 con 0x7f13d00d0c70 2023-10-16T13:39:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.769+0000 7f13b77fe700 1 -- 172.21.15.5:0/1764532943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13c0057e60 con 0x7f13d00d0c70 2023-10-16T13:39:06.772 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f13bc06af00 msgr2=0x7f13bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f13bc06af00 0x7f13bc06d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13c4014040 tx=0x7f13c4008030 comp rx=0 tx=0).stop 2023-10-16T13:39:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 msgr2=0x7f13d014fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 0x7f13d014fbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13c000e810 tx=0x7f13c000eb20 comp rx=0 tx=0).stop 2023-10-16T13:39:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 shutdown_connections 2023-10-16T13:39:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f13bc06af00 0x7f13bc06d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13d015b740 0x7f13d01f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d00c5110 0x7f13d00c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 --2- 172.21.15.5:0/1764532943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d00d0c70 0x7f13d014fbd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 >> 172.21.15.5:0/1764532943 conn(0x7f13d00665a0 msgr2=0x7f13d00c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:06.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 shutdown_connections 2023-10-16T13:39:06.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.771+0000 7f13d5111700 1 -- 172.21.15.5:0/1764532943 wait complete. 2023-10-16T13:39:06.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.912+0000 7fb2b841f700 1 Processor -- start 2023-10-16T13:39:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.912+0000 7fb2b841f700 1 -- start start 2023-10-16T13:39:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b841f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2b015ab10 0x7fb2b015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b841f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 0x7fb2b00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b841f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b015e7a0 con 0x7fb2b00b1f50 2023-10-16T13:39:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b841f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b015f730 con 0x7fb2b015ab10 2023-10-16T13:39:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b841f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00b29a0 con 0x7fb2b00cfe30 2023-10-16T13:39:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b59ba700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2b00b1f50 0x7fb2b00cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53320/0 (socket says 172.21.15.5:53320) 2023-10-16T13:39:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b59ba700 1 -- 172.21.15.5:0/1563384619 learned_addr learned my addr 172.21.15.5:0/1563384619 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62682360 0 0) 0x7fb2b015e7a0 con 0x7fb2b00b1f50 2023-10-16T13:39:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 0x7fb2b00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b61bb700 1 --2- 172.21.15.5:0/1563384619 >> v2:172.21.15.112:3300/0 conn(0x7fb2b015ab10 0x7fb2b015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.913+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb29c0035b0 con 0x7fb2b00b1f50 2023-10-16T13:39:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104428610 0 0) 0x7fb29c0035b0 con 0x7fb2b00b1f50 2023-10-16T13:39:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 msgr2=0x7fb2b00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 0x7fb2b00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 >> v2:172.21.15.112:3300/0 conn(0x7fb2b015ab10 msgr2=0x7fb2b015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 --2- 172.21.15.5:0/1563384619 >> v2:172.21.15.112:3300/0 conn(0x7fb2b015ab10 0x7fb2b015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00b2c80 con 0x7fb2b00b1f50 2023-10-16T13:39:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fb2ac0017f0 con 0x7fb2b00b1f50 2023-10-16T13:39:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 >> v1:172.21.15.5:6789/0 conn(0x7fb2b00b1f50 legacy=0x7fb2b00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 0x7fb29c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c003f80 0x7fb29c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb29c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b015f730 con 0x7fb29c004d90 2023-10-16T13:39:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00b29a0 con 0x7fb29c003f80 2023-10-16T13:39:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c00ba10 con 0x7fb2b00cfe30 2023-10-16T13:39:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b61bb700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 0x7fb29c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb29c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b59ba700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c003f80 0x7fb29c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b69bc700 1 -- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 msgr2=0x7fb29c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00cfe30 0x7fb29c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b69bc700 1 -- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c003f80 msgr2=0x7fb29c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c003f80 0x7fb29c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.914+0000 7fb2b69bc700 1 -- 172.21.15.5:0/1563384619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0035b0 con 0x7fb29c004d90 2023-10-16T13:39:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb29c005210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00d0400 tx=0x7fb29c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabcdcbb9f8fd5ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800eb70 con 0x7fb29c004d90 2023-10-16T13:39:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800f040 con 0x7fb29c004d90 2023-10-16T13:39:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b51b9700 1 -- 172.21.15.5:0/1563384619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8014480 con 0x7fb29c004d90 2023-10-16T13:39:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b841f700 1 -- 172.21.15.5:0/1563384619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 msgr2=0x7fb29c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b841f700 1 --2- 172.21.15.5:0/1563384619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb29c005210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00d0400 tx=0x7fb29c005880 comp rx=0 tx=0).stop 2023-10-16T13:39:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b69bc700 1 -- 172.21.15.5:0/1563384619 reap_dead start 2023-10-16T13:39:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b841f700 1 -- 172.21.15.5:0/1563384619 shutdown_connections 2023-10-16T13:39:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b841f700 1 -- 172.21.15.5:0/1563384619 >> 172.21.15.5:0/1563384619 conn(0x7fb2b006dae0 msgr2=0x7fb2b006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b841f700 1 -- 172.21.15.5:0/1563384619 shutdown_connections 2023-10-16T13:39:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.915+0000 7fb2b841f700 1 -- 172.21.15.5:0/1563384619 wait complete. 2023-10-16T13:39:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 Processor -- start 2023-10-16T13:39:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 -- start start 2023-10-16T13:39:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb2b0149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2b00c4000 0x7fb2b00c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00c55a0 0x7fb2b00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c5180 con 0x7fb29c004d90 2023-10-16T13:39:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c67d0 con 0x7fb2b00c4000 2023-10-16T13:39:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b841f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c4500 con 0x7fb2b00c55a0 2023-10-16T13:39:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.917+0000 7fb2b61bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb2b0149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb2b0149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43326/0 (socket says 172.21.15.5:43326) 2023-10-16T13:39:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 -- 172.21.15.5:0/3194249434 learned_addr learned my addr 172.21.15.5:0/3194249434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b59ba700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2b00c4000 0x7fb2b00c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00c55a0 0x7fb2b00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 -- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00c55a0 msgr2=0x7fb2b00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00c55a0 0x7fb2b00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 -- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2b00c4000 msgr2=0x7fb2b00c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2b00c4000 0x7fb2b00c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 -- 172.21.15.5:0/3194249434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00c47e0 con 0x7fb29c004d90 2023-10-16T13:39:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b69bc700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00c55a0 0x7fb2b00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b61bb700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb2b0149b00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0011aa0 tx=0x7fb2a0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000f940 con 0x7fb29c004d90 2023-10-16T13:39:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a000faa0 con 0x7fb29c004d90 2023-10-16T13:39:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b00c4ac0 con 0x7fb29c004d90 2023-10-16T13:39:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000fe50 con 0x7fb29c004d90 2023-10-16T13:39:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.918+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b00c5e70 con 0x7fb29c004d90 2023-10-16T13:39:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.919+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b00c53f0 con 0x7fb29c004d90 2023-10-16T13:39:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.919+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb2a0014440 con 0x7fb29c004d90 2023-10-16T13:39:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.920+0000 7fb2a6ffd700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb29406af00 0x7fb29406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.920+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2a0089e00 con 0x7fb29c004d90 2023-10-16T13:39:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.920+0000 7fb2b59ba700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb29406af00 0x7fb29406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.921+0000 7fb2b59ba700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb29406af00 0x7fb29406d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00c7100 tx=0x7fb2ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:06.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:06.925+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2a0054f40 con 0x7fb29c004d90 2023-10-16T13:39:07.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.126+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2b0067d20 con 0x7fb29c004d90 2023-10-16T13:39:07.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.127+0000 7fb2a6ffd700 1 -- 172.21.15.5:0/3194249434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2a0058560 con 0x7fb29c004d90 2023-10-16T13:39:07.130 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:07.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb29406af00 msgr2=0x7fb29406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb29406af00 0x7fb29406d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00c7100 tx=0x7fb2ac009040 comp rx=0 tx=0).stop 2023-10-16T13:39:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 msgr2=0x7fb2b0149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb2b0149b00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0011aa0 tx=0x7fb2a0011db0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 shutdown_connections 2023-10-16T13:39:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb29406af00 0x7fb29406d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2b00c55a0 0x7fb2b00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb29c004d90 0x7fb2b0149b00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 --2- 172.21.15.5:0/3194249434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2b00c4000 0x7fb2b00c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 >> 172.21.15.5:0/3194249434 conn(0x7fb2b006dae0 msgr2=0x7fb2b0159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 shutdown_connections 2023-10-16T13:39:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.129+0000 7fb2b841f700 1 -- 172.21.15.5:0/3194249434 wait complete. 2023-10-16T13:39:07.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.266+0000 7f90c43a4700 1 Processor -- start 2023-10-16T13:39:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.266+0000 7f90c43a4700 1 -- start start 2023-10-16T13:39:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.267+0000 7f90c43a4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90bc157d40 0x7f90bc0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.267+0000 7f90c43a4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90bc06e2b0 0x7f90bc0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.267+0000 7f90c43a4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc158120 con 0x7f90bc06de50 2023-10-16T13:39:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.267+0000 7f90c43a4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc06a840 con 0x7f90bc157d40 2023-10-16T13:39:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.267+0000 7f90c43a4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc0caef0 con 0x7f90bc06e2b0 2023-10-16T13:39:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.267+0000 7f90c2140700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90bc157d40 0x7f90bc0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90bc157d40 0x7f90bc0cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43334/0 (socket says 172.21.15.5:43334) 2023-10-16T13:39:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 -- 172.21.15.5:0/2624490959 learned_addr learned my addr 172.21.15.5:0/2624490959 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2941700 1 --2- 172.21.15.5:0/2624490959 >> v2:172.21.15.112:3300/0 conn(0x7f90bc06e2b0 0x7f90bc0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 -- 172.21.15.5:0/2624490959 >> v2:172.21.15.112:3300/0 conn(0x7f90bc06e2b0 msgr2=0x7f90bc0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 --2- 172.21.15.5:0/2624490959 >> v2:172.21.15.112:3300/0 conn(0x7f90bc06e2b0 0x7f90bc0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 -- 172.21.15.5:0/2624490959 >> v1:172.21.15.112:6789/0 conn(0x7f90bc06de50 legacy=0x7f90bc15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 -- 172.21.15.5:0/2624490959 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc06e750 con 0x7f90bc157d40 2023-10-16T13:39:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c2140700 1 --2- 172.21.15.5:0/2624490959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc0cee90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0cd3c0 tx=0x7f90b800ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ff909e9ae29615 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c113e700 1 -- 172.21.15.5:0/2624490959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800cb70 con 0x7f90bc157d40 2023-10-16T13:39:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c113e700 1 -- 172.21.15.5:0/2624490959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800ccd0 con 0x7f90bc157d40 2023-10-16T13:39:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.268+0000 7f90c113e700 1 -- 172.21.15.5:0/2624490959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8018620 con 0x7f90bc157d40 2023-10-16T13:39:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 -- 172.21.15.5:0/2624490959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 msgr2=0x7f90bc0cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 --2- 172.21.15.5:0/2624490959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc0cee90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0cd3c0 tx=0x7f90b800ad70 comp rx=0 tx=0).stop 2023-10-16T13:39:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 -- 172.21.15.5:0/2624490959 shutdown_connections 2023-10-16T13:39:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 --2- 172.21.15.5:0/2624490959 >> v2:172.21.15.112:3300/0 conn(0x7f90bc06e2b0 0x7f90bc0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 --2- 172.21.15.5:0/2624490959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc0cee90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 -- 172.21.15.5:0/2624490959 >> 172.21.15.5:0/2624490959 conn(0x7f90bc0cc6f0 msgr2=0x7f90bc0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 -- 172.21.15.5:0/2624490959 shutdown_connections 2023-10-16T13:39:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.269+0000 7f90c43a4700 1 -- 172.21.15.5:0/2624490959 wait complete. 2023-10-16T13:39:07.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.270+0000 7f90c43a4700 1 Processor -- start 2023-10-16T13:39:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.270+0000 7f90c43a4700 1 -- start start 2023-10-16T13:39:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c43a4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90bc06de50 0x7f90bc0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c43a4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90bc06e2b0 0x7f90bc14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c43a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c43a4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0c9ad0 con 0x7f90bc157d40 2023-10-16T13:39:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c43a4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc155730 con 0x7f90bc06de50 2023-10-16T13:39:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c43a4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1559a0 con 0x7f90bc06e2b0 2023-10-16T13:39:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43342/0 (socket says 172.21.15.5:43342) 2023-10-16T13:39:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 -- 172.21.15.5:0/3544905922 learned_addr learned my addr 172.21.15.5:0/3544905922 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2140700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90bc06de50 0x7f90bc0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c193f700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90bc06e2b0 0x7f90bc14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 -- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90bc06e2b0 msgr2=0x7f90bc14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90bc06e2b0 0x7f90bc14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 -- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90bc06de50 msgr2=0x7f90bc0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90bc06de50 0x7f90bc0c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 -- 172.21.15.5:0/3544905922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b800a6f0 con 0x7f90bc157d40 2023-10-16T13:39:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.271+0000 7f90c2941700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc156760 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f90b4007e40 tx=0x7f90b400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.272+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400ed30 con 0x7f90bc157d40 2023-10-16T13:39:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.272+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4014420 con 0x7f90bc157d40 2023-10-16T13:39:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.272+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc155c80 con 0x7f90bc157d40 2023-10-16T13:39:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.272+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b40147d0 con 0x7f90bc157d40 2023-10-16T13:39:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.272+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc156240 con 0x7f90bc157d40 2023-10-16T13:39:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.273+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc156430 con 0x7f90bc157d40 2023-10-16T13:39:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.273+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90b4014930 con 0x7f90bc157d40 2023-10-16T13:39:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.273+0000 7f90aeffd700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f90a006af00 0x7f90a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.273+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90b4089c90 con 0x7f90bc157d40 2023-10-16T13:39:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.274+0000 7f90c2140700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f90a006af00 0x7f90a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.274+0000 7f90c2140700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f90a006af00 0x7f90a006d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f90b800afd0 tx=0x7f90b8012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.278+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90b4054d40 con 0x7f90bc157d40 2023-10-16T13:39:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.526+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90bc067d20 con 0x7f90bc157d40 2023-10-16T13:39:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.527+0000 7f90aeffd700 1 -- 172.21.15.5:0/3544905922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f90b4058360 con 0x7f90bc157d40 2023-10-16T13:39:07.530 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:07.530 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:39:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f90a006af00 msgr2=0x7f90a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f90a006af00 0x7f90a006d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f90b800afd0 tx=0x7f90b8012000 comp rx=0 tx=0).stop 2023-10-16T13:39:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 msgr2=0x7f90bc156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc156760 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f90b4007e40 tx=0x7f90b400e3c0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 shutdown_connections 2023-10-16T13:39:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc157d40 0x7f90bc156760 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90bc06de50 0x7f90bc0c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f90a006af00 0x7f90a006d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 --2- 172.21.15.5:0/3544905922 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90bc06e2b0 0x7f90bc14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 >> 172.21.15.5:0/3544905922 conn(0x7f90bc0cc6f0 msgr2=0x7f90bc151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 shutdown_connections 2023-10-16T13:39:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.529+0000 7f90c43a4700 1 -- 172.21.15.5:0/3544905922 wait complete. 2023-10-16T13:39:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:39:07.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:07.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.666+0000 7f352d35c700 1 Processor -- start 2023-10-16T13:39:07.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.666+0000 7f352d35c700 1 -- start start 2023-10-16T13:39:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f352d35c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35280cee40 0x7f352806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f352d35c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f352806ad80 0x7f3528161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f352d35c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3528161390 con 0x7f3528160fb0 2023-10-16T13:39:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f352d35c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35280cf2f0 con 0x7f35280cee40 2023-10-16T13:39:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f352d35c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352806b210 con 0x7f352806ad80 2023-10-16T13:39:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f35267fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35280cee40 0x7f352806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f3526ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3528160fb0 0x7f35280727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53350/0 (socket says 172.21.15.5:53350) 2023-10-16T13:39:07.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f3526ffd700 1 -- 172.21.15.5:0/3184482854 learned_addr learned my addr 172.21.15.5:0/3184482854 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:07.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.667+0000 7f35277fe700 1 --2- 172.21.15.5:0/3184482854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f352806ad80 0x7f3528161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f35267fc700 1 -- 172.21.15.5:0/3184482854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f352806ad80 msgr2=0x7f3528161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:07.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f35267fc700 1 --2- 172.21.15.5:0/3184482854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f352806ad80 0x7f3528161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f35267fc700 1 -- 172.21.15.5:0/3184482854 >> v1:172.21.15.5:6789/0 conn(0x7f3528160fb0 legacy=0x7f35280727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f3525ffb700 1 -- 172.21.15.5:0/3184482854 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586468633 0 0) 0x7f3528161390 con 0x7f3528160fb0 2023-10-16T13:39:07.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f35267fc700 1 -- 172.21.15.5:0/3184482854 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280b23f0 con 0x7f35280cee40 2023-10-16T13:39:07.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f35267fc700 1 --2- 172.21.15.5:0/3184482854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35280cee40 0x7f352806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3518009840 tx=0x7f3518009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81b2a531e86859f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:07.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f3525ffb700 1 -- 172.21.15.5:0/3184482854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518011830 con 0x7f35280cee40 2023-10-16T13:39:07.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f3525ffb700 1 -- 172.21.15.5:0/3184482854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518011990 con 0x7f35280cee40 2023-10-16T13:39:07.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f3525ffb700 1 -- 172.21.15.5:0/3184482854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518011d20 con 0x7f35280cee40 2023-10-16T13:39:07.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f352d35c700 1 -- 172.21.15.5:0/3184482854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35280cee40 msgr2=0x7f352806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f352d35c700 1 --2- 172.21.15.5:0/3184482854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35280cee40 0x7f352806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3518009840 tx=0x7f3518009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f352d35c700 1 -- 172.21.15.5:0/3184482854 shutdown_connections 2023-10-16T13:39:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f352d35c700 1 --2- 172.21.15.5:0/3184482854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f352806ad80 0x7f3528161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f352d35c700 1 --2- 172.21.15.5:0/3184482854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35280cee40 0x7f352806a840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.668+0000 7f352d35c700 1 -- 172.21.15.5:0/3184482854 >> 172.21.15.5:0/3184482854 conn(0x7f35280cd270 msgr2=0x7f35280cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.669+0000 7f352d35c700 1 -- 172.21.15.5:0/3184482854 shutdown_connections 2023-10-16T13:39:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.669+0000 7f352d35c700 1 -- 172.21.15.5:0/3184482854 wait complete. 2023-10-16T13:39:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.670+0000 7f352d35c700 1 Processor -- start 2023-10-16T13:39:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.670+0000 7f352d35c700 1 -- start start 2023-10-16T13:39:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 0x7f3528152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35280cee40 0x7f35280aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3528160fb0 0x7f35280b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b33f0 con 0x7f352806ad80 2023-10-16T13:39:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3528153260 con 0x7f35280cee40 2023-10-16T13:39:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b3690 con 0x7f3528160fb0 2023-10-16T13:39:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 0x7f3528152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 0x7f3528152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43352/0 (socket says 172.21.15.5:43352) 2023-10-16T13:39:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 -- 172.21.15.5:0/3694727697 learned_addr learned my addr 172.21.15.5:0/3694727697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f35277fe700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3528160fb0 0x7f35280b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f35267fc700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35280cee40 0x7f35280aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 -- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3528160fb0 msgr2=0x7f35280b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3528160fb0 0x7f35280b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 -- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35280cee40 msgr2=0x7f35280aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35280cee40 0x7f35280aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 -- 172.21.15.5:0/3694727697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180094a0 con 0x7f352806ad80 2023-10-16T13:39:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f35277fe700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3528160fb0 0x7f35280b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f35267fc700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35280cee40 0x7f35280aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f3526ffd700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 0x7f3528152d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f351c00c4a0 tx=0x7f351c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0074e0 con 0x7f352806ad80 2023-10-16T13:39:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c007640 con 0x7f352806ad80 2023-10-16T13:39:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.671+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35280b3970 con 0x7f352806ad80 2023-10-16T13:39:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.672+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c005a70 con 0x7f352806ad80 2023-10-16T13:39:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.672+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35280b3f30 con 0x7f352806ad80 2023-10-16T13:39:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.672+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3528067d20 con 0x7f352806ad80 2023-10-16T13:39:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.673+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f351c005bd0 con 0x7f352806ad80 2023-10-16T13:39:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.673+0000 7f350f7fe700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f351406af00 0x7f351406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.673+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f351c088a60 con 0x7f352806ad80 2023-10-16T13:39:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.673+0000 7f35267fc700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f351406af00 0x7f351406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.674+0000 7f35267fc700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f351406af00 0x7f351406d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35280b6490 tx=0x7f3518008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.678+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f351c053ba0 con 0x7f352806ad80 2023-10-16T13:39:07.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.884+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f352806cdd0 con 0x7f352806ad80 2023-10-16T13:39:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.885+0000 7f350f7fe700 1 -- 172.21.15.5:0/3694727697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f351c017020 con 0x7f352806ad80 2023-10-16T13:39:07.888 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:07.888 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:07.740888+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f351406af00 msgr2=0x7f351406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f351406af00 0x7f351406d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35280b6490 tx=0x7f3518008030 comp rx=0 tx=0).stop 2023-10-16T13:39:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 msgr2=0x7f3528152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 0x7f3528152d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f351c00c4a0 tx=0x7f351c00c860 comp rx=0 tx=0).stop 2023-10-16T13:39:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 shutdown_connections 2023-10-16T13:39:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f351406af00 0x7f351406d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3528160fb0 0x7f35280b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f352806ad80 0x7f3528152d20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 --2- 172.21.15.5:0/3694727697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35280cee40 0x7f35280aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 >> 172.21.15.5:0/3694727697 conn(0x7f35280cd270 msgr2=0x7f35280b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 shutdown_connections 2023-10-16T13:39:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:07.887+0000 7f352d35c700 1 -- 172.21.15.5:0/3694727697 wait complete. 2023-10-16T13:39:07.902 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:39:07.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.027+0000 7ff66c834700 1 Processor -- start 2023-10-16T13:39:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.027+0000 7ff66c834700 1 -- start start 2023-10-16T13:39:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66c834700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff66815f1f0 0x7ff6680cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66c834700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66815e7a0 con 0x7ff66815ab10 2023-10-16T13:39:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66c834700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680d0090 con 0x7ff6680cfc60 2023-10-16T13:39:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66c834700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680b29a0 con 0x7ff66815f1f0 2023-10-16T13:39:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff66815ab10 0x7ff6680b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53364/0 (socket says 172.21.15.5:53364) 2023-10-16T13:39:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66659c700 1 -- 172.21.15.5:0/2005689061 learned_addr learned my addr 172.21.15.5:0/2005689061 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff665d9b700 1 --2- 172.21.15.5:0/2005689061 >> v2:172.21.15.112:3300/0 conn(0x7ff66815f1f0 0x7ff6680cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66559a700 1 -- 172.21.15.5:0/2005689061 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706897025 0 0) 0x7ff66815e7a0 con 0x7ff66815ab10 2023-10-16T13:39:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.028+0000 7ff66559a700 1 -- 172.21.15.5:0/2005689061 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6500035b0 con 0x7ff66815ab10 2023-10-16T13:39:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff665d9b700 1 -- 172.21.15.5:0/2005689061 >> v1:172.21.15.112:6789/0 conn(0x7ff6680cfc60 legacy=0x7ff6680cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff66559a700 1 -- 172.21.15.5:0/2005689061 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254966279 0 0) 0x7ff6680d0090 con 0x7ff6680cfc60 2023-10-16T13:39:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff665d9b700 1 -- 172.21.15.5:0/2005689061 >> v1:172.21.15.5:6789/0 conn(0x7ff66815ab10 legacy=0x7ff6680b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff665d9b700 1 -- 172.21.15.5:0/2005689061 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680b2c80 con 0x7ff66815f1f0 2023-10-16T13:39:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff665d9b700 1 --2- 172.21.15.5:0/2005689061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815f1f0 0x7ff6680cf720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff658009820 tx=0x7ff658009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81c782941b7fcb72 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff66559a700 1 -- 172.21.15.5:0/2005689061 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c001670 con 0x7ff66815f1f0 2023-10-16T13:39:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff66559a700 1 -- 172.21.15.5:0/2005689061 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658005c30 con 0x7ff66815f1f0 2023-10-16T13:39:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff66559a700 1 -- 172.21.15.5:0/2005689061 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658006030 con 0x7ff66815f1f0 2023-10-16T13:39:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff66c834700 1 -- 172.21.15.5:0/2005689061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815f1f0 msgr2=0x7ff6680cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.029+0000 7ff66c834700 1 --2- 172.21.15.5:0/2005689061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815f1f0 0x7ff6680cf720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff658009820 tx=0x7ff658009b30 comp rx=0 tx=0).stop 2023-10-16T13:39:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.030+0000 7ff66c834700 1 -- 172.21.15.5:0/2005689061 shutdown_connections 2023-10-16T13:39:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.030+0000 7ff66c834700 1 --2- 172.21.15.5:0/2005689061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815f1f0 0x7ff6680cf720 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.030+0000 7ff66c834700 1 -- 172.21.15.5:0/2005689061 >> 172.21.15.5:0/2005689061 conn(0x7ff66806dae0 msgr2=0x7ff66806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.030+0000 7ff66c834700 1 -- 172.21.15.5:0/2005689061 shutdown_connections 2023-10-16T13:39:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.030+0000 7ff66c834700 1 -- 172.21.15.5:0/2005689061 wait complete. 2023-10-16T13:39:08.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.031+0000 7ff66c834700 1 Processor -- start 2023-10-16T13:39:08.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.031+0000 7ff66c834700 1 -- start start 2023-10-16T13:39:08.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66c834700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6680cfc60 0x7ff668143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66c834700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815ab10 0x7ff66806aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66c834700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 0x7ff668146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66c834700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66815dd30 con 0x7ff66815f1f0 2023-10-16T13:39:08.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66c834700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668144330 con 0x7ff66815ab10 2023-10-16T13:39:08.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66c834700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66815d0b0 con 0x7ff6680cfc60 2023-10-16T13:39:08.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 0x7ff668146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 0x7ff668146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43370/0 (socket says 172.21.15.5:43370) 2023-10-16T13:39:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 -- 172.21.15.5:0/3603555808 learned_addr learned my addr 172.21.15.5:0/3603555808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff665d9b700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815ab10 0x7ff66806aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff66659c700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6680cfc60 0x7ff668143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 -- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6680cfc60 msgr2=0x7ff668143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6680cfc60 0x7ff668143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 -- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815ab10 msgr2=0x7ff66806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815ab10 0x7ff66806aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 -- 172.21.15.5:0/3603555808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658009430 con 0x7ff66815f1f0 2023-10-16T13:39:08.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.032+0000 7ff666d9d700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 0x7ff668146c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff66000c760 tx=0x7ff66000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.033+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660003e30 con 0x7ff66815f1f0 2023-10-16T13:39:08.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.033+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff660005070 con 0x7ff66815f1f0 2023-10-16T13:39:08.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.033+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660005400 con 0x7ff66815f1f0 2023-10-16T13:39:08.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.033+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66815d390 con 0x7ff66815f1f0 2023-10-16T13:39:08.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.033+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66815d950 con 0x7ff66815f1f0 2023-10-16T13:39:08.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.034+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6680b5ba0 con 0x7ff66815f1f0 2023-10-16T13:39:08.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.034+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff660005560 con 0x7ff66815f1f0 2023-10-16T13:39:08.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.035+0000 7ff656ffd700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff64806af00 0x7ff64806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.035+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff6600891a0 con 0x7ff66815f1f0 2023-10-16T13:39:08.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.035+0000 7ff66659c700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff64806af00 0x7ff64806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.035+0000 7ff66659c700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff64806af00 0x7ff64806d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff65c001eb0 tx=0x7ff65c0018c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.039+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6600541c0 con 0x7ff66815f1f0 2023-10-16T13:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.283+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6680afc10 con 0x7ff66815f1f0 2023-10-16T13:39:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.284+0000 7ff656ffd700 1 -- 172.21.15.5:0/3603555808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff6600577e0 con 0x7ff66815f1f0 2023-10-16T13:39:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:08.287 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:39:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff64806af00 msgr2=0x7ff64806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff64806af00 0x7ff64806d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff65c001eb0 tx=0x7ff65c0018c0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 msgr2=0x7ff668146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 0x7ff668146c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff66000c760 tx=0x7ff66000ca70 comp rx=0 tx=0).stop 2023-10-16T13:39:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 shutdown_connections 2023-10-16T13:39:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff66815f1f0 0x7ff668146c90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff64806af00 0x7ff64806d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6680cfc60 0x7ff668143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 --2- 172.21.15.5:0/3603555808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff66815ab10 0x7ff66806aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 >> 172.21.15.5:0/3603555808 conn(0x7ff66806dae0 msgr2=0x7ff6680d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 shutdown_connections 2023-10-16T13:39:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.286+0000 7ff66c834700 1 -- 172.21.15.5:0/3603555808 wait complete. 2023-10-16T13:39:08.292 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:39:08.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:08.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.423+0000 7f883e3e7700 1 Processor -- start 2023-10-16T13:39:08.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.423+0000 7f883e3e7700 1 -- start start 2023-10-16T13:39:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883e3e7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f883815e2f0 0x7f88380cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883e3e7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f883806a840 0x7f883806ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883e3e7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883806b1a0 con 0x7f88380cd950 2023-10-16T13:39:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883e3e7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88381619a0 con 0x7f883806a840 2023-10-16T13:39:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883e3e7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88380b2d60 con 0x7f883815e2f0 2023-10-16T13:39:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883c984700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f883806a840 0x7f883806ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f8837fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88380cd950 0x7f883815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53378/0 (socket says 172.21.15.5:53378) 2023-10-16T13:39:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f8837fff700 1 -- 172.21.15.5:0/2422573892 learned_addr learned my addr 172.21.15.5:0/2422573892 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f88377fe700 1 --2- 172.21.15.5:0/2422573892 >> v2:172.21.15.112:3300/0 conn(0x7f883815e2f0 0x7f88380cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.424+0000 7f883c984700 1 -- 172.21.15.5:0/2422573892 >> v2:172.21.15.112:3300/0 conn(0x7f883815e2f0 msgr2=0x7f88380cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883c984700 1 --2- 172.21.15.5:0/2422573892 >> v2:172.21.15.112:3300/0 conn(0x7f883815e2f0 0x7f88380cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883c984700 1 -- 172.21.15.5:0/2422573892 >> v1:172.21.15.5:6789/0 conn(0x7f88380cd950 legacy=0x7f883815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883c984700 1 -- 172.21.15.5:0/2422573892 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380cdd30 con 0x7f883806a840 2023-10-16T13:39:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f8836ffd700 1 -- 172.21.15.5:0/2422573892 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540119666 0 0) 0x7f883806b1a0 con 0x7f88380cd950 2023-10-16T13:39:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f88377fe700 1 --2- 172.21.15.5:0/2422573892 >> v2:172.21.15.112:3300/0 conn(0x7f883815e2f0 0x7f88380cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883c984700 1 --2- 172.21.15.5:0/2422573892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883806ac60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f883806b690 tx=0x7f883000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3797d9e246649f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f8836ffd700 1 -- 172.21.15.5:0/2422573892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000e070 con 0x7f883806a840 2023-10-16T13:39:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f8836ffd700 1 -- 172.21.15.5:0/2422573892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000bbd0 con 0x7f883806a840 2023-10-16T13:39:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f8836ffd700 1 -- 172.21.15.5:0/2422573892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830012430 con 0x7f883806a840 2023-10-16T13:39:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 -- 172.21.15.5:0/2422573892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 msgr2=0x7f883806ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 --2- 172.21.15.5:0/2422573892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883806ac60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f883806b690 tx=0x7f883000b330 comp rx=0 tx=0).stop 2023-10-16T13:39:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 -- 172.21.15.5:0/2422573892 shutdown_connections 2023-10-16T13:39:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 --2- 172.21.15.5:0/2422573892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883806ac60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 --2- 172.21.15.5:0/2422573892 >> v2:172.21.15.112:3300/0 conn(0x7f883815e2f0 0x7f88380cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 -- 172.21.15.5:0/2422573892 >> 172.21.15.5:0/2422573892 conn(0x7f883806dae0 msgr2=0x7f883806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.425+0000 7f883e3e7700 1 -- 172.21.15.5:0/2422573892 shutdown_connections 2023-10-16T13:39:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.426+0000 7f883e3e7700 1 -- 172.21.15.5:0/2422573892 wait complete. 2023-10-16T13:39:08.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.427+0000 7f883e3e7700 1 Processor -- start 2023-10-16T13:39:08.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.427+0000 7f883e3e7700 1 -- start start 2023-10-16T13:39:08.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88380cd950 0x7f88380c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f883815e2f0 0x7f883806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381f7930 con 0x7f883806a840 2023-10-16T13:39:08.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883815bdc0 con 0x7f88380cd950 2023-10-16T13:39:08.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88381f6d20 con 0x7f883815e2f0 2023-10-16T13:39:08.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883815b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43380/0 (socket says 172.21.15.5:43380) 2023-10-16T13:39:08.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 -- 172.21.15.5:0/4067929065 learned_addr learned my addr 172.21.15.5:0/4067929065 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:08.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f88377fe700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88380cd950 0x7f88380c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883c984700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f883815e2f0 0x7f883806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 -- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f883815e2f0 msgr2=0x7f883806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f883815e2f0 0x7f883806dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 -- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88380cd950 msgr2=0x7f88380c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88380cd950 0x7f88380c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 -- 172.21.15.5:0/4067929065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009a70 con 0x7f883806a840 2023-10-16T13:39:08.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8837fff700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883815b880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f882800c750 tx=0x7f882800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828004c80 con 0x7f883806a840 2023-10-16T13:39:08.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828004e00 con 0x7f883806a840 2023-10-16T13:39:08.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828007310 con 0x7f883806a840 2023-10-16T13:39:08.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88381f7000 con 0x7f883806a840 2023-10-16T13:39:08.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.428+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88381f75c0 con 0x7f883806a840 2023-10-16T13:39:08.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.429+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8838067d20 con 0x7f883806a840 2023-10-16T13:39:08.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.430+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8828007470 con 0x7f883806a840 2023-10-16T13:39:08.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.430+0000 7f8834ff9700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f881806af00 0x7f881806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.430+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f88280893a0 con 0x7f883806a840 2023-10-16T13:39:08.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.430+0000 7f88377fe700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f881806af00 0x7f881806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.431+0000 7f88377fe700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f881806af00 0x7f881806d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f882000d8b0 tx=0x7f8820008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.435+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88280543d0 con 0x7f883806a840 2023-10-16T13:39:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.681+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88380b2630 con 0x7f883806a840 2023-10-16T13:39:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.681+0000 7f8834ff9700 1 -- 172.21.15.5:0/4067929065 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f88280579f0 con 0x7f883806a840 2023-10-16T13:39:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:08.685 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1618803571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1618803571},{"type":"v1","addr":"172.21.15.112:6837","nonce":1618803571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2315279246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2315279246},{"type":"v1","addr":"172.21.15.5:6833","nonce":2315279246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1513068556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1513068556},{"type":"v1","addr":"172.21.15.5:6835","nonce":1513068556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:38:19.370472+0000","modified":"2023-10-16T13:38:22.403648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/2030805663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2030805663},{"type":"v1","addr":"172.21.15.112:6835","nonce":2030805663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T13:39:08.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f881806af00 msgr2=0x7f881806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f881806af00 0x7f881806d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f882000d8b0 tx=0x7f8820008040 comp rx=0 tx=0).stop 2023-10-16T13:39:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 msgr2=0x7f883815b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883815b880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f882800c750 tx=0x7f882800cb10 comp rx=0 tx=0).stop 2023-10-16T13:39:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 shutdown_connections 2023-10-16T13:39:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f881806af00 0x7f881806d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f883815e2f0 0x7f883806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883806a840 0x7f883815b880 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 --2- 172.21.15.5:0/4067929065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88380cd950 0x7f88380c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 >> 172.21.15.5:0/4067929065 conn(0x7f883806dae0 msgr2=0x7f88380cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 shutdown_connections 2023-10-16T13:39:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.684+0000 7f883e3e7700 1 -- 172.21.15.5:0/4067929065 wait complete. 2023-10-16T13:39:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-10-16T13:39:08.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:08.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.823+0000 7fafb5567700 1 Processor -- start 2023-10-16T13:39:08.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.823+0000 7fafb5567700 1 -- start start 2023-10-16T13:39:08.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafb5567700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fafb00cee90 0x7fafb015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafb5567700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafb015e290 0x7fafb00cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafb5567700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb015e6e0 con 0x7fafb0157d40 2023-10-16T13:39:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafb5567700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb006e560 con 0x7fafb015e290 2023-10-16T13:39:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafb5567700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00cf2f0 con 0x7fafb00cee90 2023-10-16T13:39:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafaf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafb015e290 0x7fafb00cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafaf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafb015e290 0x7fafb00cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43392/0 (socket says 172.21.15.5:43392) 2023-10-16T13:39:08.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafaf7fe700 1 -- 172.21.15.5:0/1554224281 learned_addr learned my addr 172.21.15.5:0/1554224281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:08.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafaf7fe700 1 -- 172.21.15.5:0/1554224281 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cee90 msgr2=0x7fafb015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:08.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafae7fc700 1 --2- 172.21.15.5:0/1554224281 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cee90 0x7fafb015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafaf7fe700 1 --2- 172.21.15.5:0/1554224281 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cee90 0x7fafb015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.824+0000 7fafaf7fe700 1 -- 172.21.15.5:0/1554224281 >> v1:172.21.15.112:6789/0 conn(0x7fafb0157d40 legacy=0x7fafb006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:08.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafaf7fe700 1 -- 172.21.15.5:0/1554224281 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0158120 con 0x7fafb015e290 2023-10-16T13:39:08.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafaf7fe700 1 --2- 172.21.15.5:0/1554224281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb015e290 0x7fafb00cb420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fafb0072660 tx=0x7fafa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2eef43d602bb3b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafadffb700 1 -- 172.21.15.5:0/1554224281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa800e070 con 0x7fafb015e290 2023-10-16T13:39:08.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafadffb700 1 -- 172.21.15.5:0/1554224281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8003a20 con 0x7fafb015e290 2023-10-16T13:39:08.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafadffb700 1 -- 172.21.15.5:0/1554224281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8003dd0 con 0x7fafb015e290 2023-10-16T13:39:08.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 -- 172.21.15.5:0/1554224281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb015e290 msgr2=0x7fafb00cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 --2- 172.21.15.5:0/1554224281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb015e290 0x7fafb00cb420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fafb0072660 tx=0x7fafa800b330 comp rx=0 tx=0).stop 2023-10-16T13:39:08.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 -- 172.21.15.5:0/1554224281 shutdown_connections 2023-10-16T13:39:08.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 --2- 172.21.15.5:0/1554224281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb015e290 0x7fafb00cb420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 --2- 172.21.15.5:0/1554224281 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cee90 0x7fafb015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 -- 172.21.15.5:0/1554224281 >> 172.21.15.5:0/1554224281 conn(0x7fafb00cc6f0 msgr2=0x7fafb00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:08.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.825+0000 7fafb5567700 1 -- 172.21.15.5:0/1554224281 shutdown_connections 2023-10-16T13:39:08.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.826+0000 7fafb5567700 1 -- 172.21.15.5:0/1554224281 wait complete. 2023-10-16T13:39:08.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.827+0000 7fafb5567700 1 Processor -- start 2023-10-16T13:39:08.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.827+0000 7fafb5567700 1 -- start start 2023-10-16T13:39:08.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafb00cee90 0x7fafb014e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 0x7fafb0149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb015e290 0x7fafb00c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb014e920 con 0x7fafb0157d40 2023-10-16T13:39:08.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb014d340 con 0x7fafb015e290 2023-10-16T13:39:08.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb014d620 con 0x7fafb00cee90 2023-10-16T13:39:08.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 0x7fafb0149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 0x7fafb0149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43396/0 (socket says 172.21.15.5:43396) 2023-10-16T13:39:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 -- 172.21.15.5:0/208602742 learned_addr learned my addr 172.21.15.5:0/208602742 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafaeffd700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafb00cee90 0x7fafb014e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafaf7fe700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb015e290 0x7fafb00c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 -- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafb00cee90 msgr2=0x7fafb014e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafb00cee90 0x7fafb014e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 -- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb015e290 msgr2=0x7fafb00c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb015e290 0x7fafb00c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 -- 172.21.15.5:0/208602742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa8009b30 con 0x7fafb0157d40 2023-10-16T13:39:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafaeffd700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafb00cee90 0x7fafb014e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafaf7fe700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb015e290 0x7fafb00c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafae7fc700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 0x7fafb0149030 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c7f0 tx=0x7fafa000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011800 con 0x7fafb0157d40 2023-10-16T13:39:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0011960 con 0x7fafb0157d40 2023-10-16T13:39:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb014d900 con 0x7fafb0157d40 2023-10-16T13:39:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.828+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011cf0 con 0x7fafb0157d40 2023-10-16T13:39:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.829+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb014dec0 con 0x7fafb0157d40 2023-10-16T13:39:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.829+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb014e0e0 con 0x7fafb0157d40 2023-10-16T13:39:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.830+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fafa0018360 con 0x7fafb0157d40 2023-10-16T13:39:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.830+0000 7faf977fe700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf9c06af00 0x7faf9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.830+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fafa0089730 con 0x7fafb0157d40 2023-10-16T13:39:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.831+0000 7fafaeffd700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf9c06af00 0x7faf9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.831+0000 7fafaeffd700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf9c06af00 0x7faf9c06d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fafa40017d0 tx=0x7fafa4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:08.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:08.835+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafa00546d0 con 0x7fafb0157d40 2023-10-16T13:39:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.036+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb0067d20 con 0x7fafb0157d40 2023-10-16T13:39:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.037+0000 7faf977fe700 1 -- 172.21.15.5:0/208602742 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16682 (secure 0 0 0) 0x7fafa0057cf0 con 0x7fafb0157d40 2023-10-16T13:39:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:09.041 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:08.745139+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:38:17.410345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T13:38:18.346697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf9c06af00 msgr2=0x7faf9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf9c06af00 0x7faf9c06d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fafa40017d0 tx=0x7fafa4009040 comp rx=0 tx=0).stop 2023-10-16T13:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 msgr2=0x7fafb0149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 0x7fafb0149030 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c7f0 tx=0x7fafa000cbb0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 shutdown_connections 2023-10-16T13:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb015e290 0x7fafb00c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faf9c06af00 0x7faf9c06d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafb00cee90 0x7fafb014e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 --2- 172.21.15.5:0/208602742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb0157d40 0x7fafb0149030 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 >> 172.21.15.5:0/208602742 conn(0x7fafb00cc6f0 msgr2=0x7fafb006b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 shutdown_connections 2023-10-16T13:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.039+0000 7fafb5567700 1 -- 172.21.15.5:0/208602742 wait complete. 2023-10-16T13:39:09.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:39:09.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.178+0000 7f6d8c6ad700 1 Processor -- start 2023-10-16T13:39:09.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.178+0000 7f6d8c6ad700 1 -- start start 2023-10-16T13:39:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.179+0000 7f6d8c6ad700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d8406daa0 0x7f6d840cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.179+0000 7f6d8c6ad700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840cf1d0 con 0x7f6d8415a280 2023-10-16T13:39:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.179+0000 7f6d8c6ad700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840cafb0 con 0x7f6d840ce5f0 2023-10-16T13:39:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.179+0000 7f6d8c6ad700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d84072200 con 0x7f6d8406daa0 2023-10-16T13:39:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.179+0000 7f6d8a449700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d8415a280 0x7f6d8406d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53406/0 (socket says 172.21.15.5:53406) 2023-10-16T13:39:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d8a449700 1 -- 172.21.15.5:0/564016833 learned_addr learned my addr 172.21.15.5:0/564016833 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316265038 0 0) 0x7f6d840cf1d0 con 0x7f6d8415a280 2023-10-16T13:39:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89c48700 1 --2- 172.21.15.5:0/564016833 >> v2:172.21.15.112:3300/0 conn(0x7f6d8406daa0 0x7f6d840cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d700035b0 con 0x7f6d8415a280 2023-10-16T13:39:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2811994818 0 0) 0x7f6d700035b0 con 0x7f6d8415a280 2023-10-16T13:39:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 >> v2:172.21.15.112:3300/0 conn(0x7f6d8406daa0 msgr2=0x7f6d840cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 --2- 172.21.15.5:0/564016833 >> v2:172.21.15.112:3300/0 conn(0x7f6d8406daa0 0x7f6d840cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 >> v1:172.21.15.112:6789/0 conn(0x7f6d840ce5f0 legacy=0x7f6d840cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840cb290 con 0x7f6d8415a280 2023-10-16T13:39:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6d80001670 con 0x7f6d8415a280 2023-10-16T13:39:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 >> v1:172.21.15.5:6789/0 conn(0x7f6d8415a280 legacy=0x7f6d8406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d70003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d70004850 0x7f6d70004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d70005210 0x7f6d700059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84072200 con 0x7f6d70003a00 2023-10-16T13:39:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70006080 con 0x7f6d70004850 2023-10-16T13:39:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70006240 con 0x7f6d70005210 2023-10-16T13:39:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d8a449700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d70003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d89c48700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d70004850 0x7f6d70004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.180+0000 7f6d8ac4a700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d70005210 0x7f6d700059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8a449700 1 -- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d70005210 msgr2=0x7f6d700059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8a449700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d70005210 0x7f6d700059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8a449700 1 -- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d70004850 msgr2=0x7f6d70004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8a449700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d70004850 0x7f6d70004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8a449700 1 -- 172.21.15.5:0/564016833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d700035b0 con 0x7f6d70003a00 2023-10-16T13:39:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8ac4a700 1 -- 172.21.15.5:0/564016833 reap_dead start 2023-10-16T13:39:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8a449700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d70003e20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d80001050 tx=0x7f6d70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ffd84d5fa4e57d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000cd80 con 0x7f6d70003a00 2023-10-16T13:39:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80005960 con 0x7f6d70003a00 2023-10-16T13:39:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d89447700 1 -- 172.21.15.5:0/564016833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80005d10 con 0x7f6d70003a00 2023-10-16T13:39:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/564016833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 msgr2=0x7f6d70003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d70003e20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d80001050 tx=0x7f6d70005880 comp rx=0 tx=0).stop 2023-10-16T13:39:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/564016833 shutdown_connections 2023-10-16T13:39:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/564016833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d70003e20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.181+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/564016833 >> 172.21.15.5:0/564016833 conn(0x7f6d840cfc40 msgr2=0x7f6d840d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:09.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.182+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/564016833 shutdown_connections 2023-10-16T13:39:09.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.182+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/564016833 wait complete. 2023-10-16T13:39:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.183+0000 7f6d8c6ad700 1 Processor -- start 2023-10-16T13:39:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.183+0000 7f6d8c6ad700 1 -- start start 2023-10-16T13:39:09.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d84148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d8415af70 0x7f6d84158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d8415b3f0 0x7f6d84158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8415d890 con 0x7f6d70003a00 2023-10-16T13:39:09.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8415db70 con 0x7f6d8415af70 2023-10-16T13:39:09.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8415de50 con 0x7f6d8415b3f0 2023-10-16T13:39:09.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d84148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d84148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43414/0 (socket says 172.21.15.5:43414) 2023-10-16T13:39:09.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 -- 172.21.15.5:0/95263758 learned_addr learned my addr 172.21.15.5:0/95263758 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:09.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d89c48700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d8415af70 0x7f6d84158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8ac4a700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d8415b3f0 0x7f6d84158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 -- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d8415b3f0 msgr2=0x7f6d84158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d8415b3f0 0x7f6d84158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 -- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d8415af70 msgr2=0x7f6d84158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d8415af70 0x7f6d84158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 -- 172.21.15.5:0/95263758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8415e130 con 0x7f6d70003a00 2023-10-16T13:39:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8a449700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d84148060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6d70006050 tx=0x7f6d80000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80005ce0 con 0x7f6d70003a00 2023-10-16T13:39:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80005e60 con 0x7f6d70003a00 2023-10-16T13:39:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80007310 con 0x7f6d70003a00 2023-10-16T13:39:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8415e410 con 0x7f6d70003a00 2023-10-16T13:39:09.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.184+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d84155980 con 0x7f6d70003a00 2023-10-16T13:39:09.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.186+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d84067d20 con 0x7f6d70003a00 2023-10-16T13:39:09.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.186+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d80007470 con 0x7f6d70003a00 2023-10-16T13:39:09.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.187+0000 7f6d76ffd700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d6806af00 0x7f6d6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.187+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6d8008aa30 con 0x7f6d70003a00 2023-10-16T13:39:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.187+0000 7f6d89c48700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d6806af00 0x7f6d6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.188+0000 7f6d89c48700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d6806af00 0x7f6d6806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d840b1730 tx=0x7f6d78009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.192+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d80055c10 con 0x7f6d70003a00 2023-10-16T13:39:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.435+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6d840cb540 con 0x7f6d70003a00 2023-10-16T13:39:09.438 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:39:09.436+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:39:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.437+0000 7f6d76ffd700 1 -- 172.21.15.5:0/95263758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6d80017090 con 0x7f6d70003a00 2023-10-16T13:39:09.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d6806af00 msgr2=0x7f6d6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d6806af00 0x7f6d6806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d840b1730 tx=0x7f6d78009210 comp rx=0 tx=0).stop 2023-10-16T13:39:09.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 msgr2=0x7f6d84148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d84148060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6d70006050 tx=0x7f6d80000fe0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 shutdown_connections 2023-10-16T13:39:09.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d6806af00 0x7f6d6806d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d8415b3f0 0x7f6d84158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d70003a00 0x7f6d84148060 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6d70006050 tx=0x7f6d80000fe0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 --2- 172.21.15.5:0/95263758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d8415af70 0x7f6d84158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 >> 172.21.15.5:0/95263758 conn(0x7f6d840cfc40 msgr2=0x7f6d840c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:09.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 shutdown_connections 2023-10-16T13:39:09.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.440+0000 7f6d8c6ad700 1 -- 172.21.15.5:0/95263758 wait complete. 2023-10-16T13:39:09.447 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:39:09.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:39:09.484 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:39:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.581+0000 7f5b7f21a700 1 Processor -- start 2023-10-16T13:39:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 -- start start 2023-10-16T13:39:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b7815eab0 0x7f5b780cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b780cf6d0 0x7f5b780d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780d1bc0 0x7f5b78161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780cfb60 con 0x7f5b7815eab0 2023-10-16T13:39:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7815ee90 con 0x7f5b780cf6d0 2023-10-16T13:39:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7f21a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78158370 con 0x7f5b780d1bc0 2023-10-16T13:39:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7cfb6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b7815eab0 0x7f5b780cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.582+0000 7f5b7cfb6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b7815eab0 0x7f5b780cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43422/0 (socket says 172.21.15.5:43422) 2023-10-16T13:39:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 -- 172.21.15.5:0/515662379 learned_addr learned my addr 172.21.15.5:0/515662379 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b77fff700 1 --2- 172.21.15.5:0/515662379 >> v2:172.21.15.112:3300/0 conn(0x7f5b780cf6d0 0x7f5b780d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7d7b7700 1 --2- 172.21.15.5:0/515662379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780d1bc0 0x7f5b78161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 -- 172.21.15.5:0/515662379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780d1bc0 msgr2=0x7f5b78161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 --2- 172.21.15.5:0/515662379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780d1bc0 0x7f5b78161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 -- 172.21.15.5:0/515662379 >> v2:172.21.15.112:3300/0 conn(0x7f5b780cf6d0 msgr2=0x7f5b780d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 --2- 172.21.15.5:0/515662379 >> v2:172.21.15.112:3300/0 conn(0x7f5b780cf6d0 0x7f5b780d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 -- 172.21.15.5:0/515662379 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780d23b0 con 0x7f5b7815eab0 2023-10-16T13:39:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b7cfb6700 1 --2- 172.21.15.5:0/515662379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7815eab0 0x7f5b780cf190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5b7806da90 tx=0x7f5b6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba31eaf75dad5e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b777fe700 1 -- 172.21.15.5:0/515662379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00b870 con 0x7f5b7815eab0 2023-10-16T13:39:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b777fe700 1 -- 172.21.15.5:0/515662379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00b9d0 con 0x7f5b7815eab0 2023-10-16T13:39:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.583+0000 7f5b777fe700 1 -- 172.21.15.5:0/515662379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00bd60 con 0x7f5b7815eab0 2023-10-16T13:39:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 -- 172.21.15.5:0/515662379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7815eab0 msgr2=0x7f5b780cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/515662379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7815eab0 0x7f5b780cf190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5b7806da90 tx=0x7f5b6c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 -- 172.21.15.5:0/515662379 shutdown_connections 2023-10-16T13:39:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/515662379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780d1bc0 0x7f5b78161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/515662379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7815eab0 0x7f5b780cf190 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/515662379 >> v2:172.21.15.112:3300/0 conn(0x7f5b780cf6d0 0x7f5b780d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 -- 172.21.15.5:0/515662379 >> 172.21.15.5:0/515662379 conn(0x7f5b780665a0 msgr2=0x7f5b78066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 -- 172.21.15.5:0/515662379 shutdown_connections 2023-10-16T13:39:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.584+0000 7f5b7f21a700 1 -- 172.21.15.5:0/515662379 wait complete. 2023-10-16T13:39:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.585+0000 7f5b7f21a700 1 Processor -- start 2023-10-16T13:39:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.585+0000 7f5b7f21a700 1 -- start start 2023-10-16T13:39:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7f21a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780cf6d0 0x7f5b780cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7f21a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 0x7f5b780c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7f21a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7815eab0 0x7f5b780ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7f21a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c8690 con 0x7f5b780d1bc0 2023-10-16T13:39:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7f21a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b781f3bc0 con 0x7f5b7815eab0 2023-10-16T13:39:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7f21a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b781f3ea0 con 0x7f5b780cf6d0 2023-10-16T13:39:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 0x7f5b780c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 0x7f5b780c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43428/0 (socket says 172.21.15.5:43428) 2023-10-16T13:39:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 -- 172.21.15.5:0/1538658708 learned_addr learned my addr 172.21.15.5:0/1538658708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7cfb6700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780cf6d0 0x7f5b780cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b7d7b7700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7815eab0 0x7f5b780ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 -- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780cf6d0 msgr2=0x7f5b780cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780cf6d0 0x7f5b780cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 -- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7815eab0 msgr2=0x7f5b780ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7815eab0 0x7f5b780ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.586+0000 7f5b77fff700 1 -- 172.21.15.5:0/1538658708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c009550 con 0x7f5b780d1bc0 2023-10-16T13:39:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.587+0000 7f5b77fff700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 0x7f5b780c9e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400d800 tx=0x7f5b6400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.587+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640125f0 con 0x7f5b780d1bc0 2023-10-16T13:39:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.587+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b64012750 con 0x7f5b780d1bc0 2023-10-16T13:39:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.587+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b781f4180 con 0x7f5b780d1bc0 2023-10-16T13:39:09.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.587+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64012ae0 con 0x7f5b780d1bc0 2023-10-16T13:39:09.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.587+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780c5090 con 0x7f5b780d1bc0 2023-10-16T13:39:09.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.588+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b781f4370 con 0x7f5b780d1bc0 2023-10-16T13:39:09.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.588+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5b64012c40 con 0x7f5b780d1bc0 2023-10-16T13:39:09.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.589+0000 7f5b757fa700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5c06af00 0x7f5b5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:09.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.589+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f5b64089630 con 0x7f5b780d1bc0 2023-10-16T13:39:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.589+0000 7f5b7cfb6700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5c06af00 0x7f5b5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.589+0000 7f5b7cfb6700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5c06af00 0x7f5b5c06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c00 tx=0x7f5b6c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.593+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b781f4370 con 0x7f5b780d1bc0 2023-10-16T13:39:09.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:09.844+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5b781f4370 con 0x7f5b780d1bc0 2023-10-16T13:39:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.443+0000 7f5b757fa700 1 -- 172.21.15.5:0/1538658708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5b781f4370 con 0x7f5b780d1bc0 2023-10-16T13:39:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.445+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5c06af00 msgr2=0x7f5b5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.445+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5c06af00 0x7f5b5c06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c00 tx=0x7f5b6c008030 comp rx=0 tx=0).stop 2023-10-16T13:39:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.445+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 msgr2=0x7f5b780c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.445+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 0x7f5b780c9e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400d800 tx=0x7f5b6400db10 comp rx=0 tx=0).stop 2023-10-16T13:39:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 shutdown_connections 2023-10-16T13:39:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7815eab0 0x7f5b780ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5c06af00 0x7f5b5c06d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b780cf6d0 0x7f5b780cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 --2- 172.21.15.5:0/1538658708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b780d1bc0 0x7f5b780c9e10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 >> 172.21.15.5:0/1538658708 conn(0x7f5b780665a0 msgr2=0x7f5b780b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 shutdown_connections 2023-10-16T13:39:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.446+0000 7f5b7f21a700 1 -- 172.21.15.5:0/1538658708 wait complete. 2023-10-16T13:39:10.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:39:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.596+0000 7fc745aac700 1 Processor -- start 2023-10-16T13:39:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc745aac700 1 -- start start 2023-10-16T13:39:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc745aac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc740162070 0x7fc7400cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc745aac700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7400cd870 0x7fc7400caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc745aac700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400cee20 con 0x7fc74015d840 2023-10-16T13:39:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc745aac700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400cdd20 con 0x7fc7400cd870 2023-10-16T13:39:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc745aac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400b2ce0 con 0x7fc740162070 2023-10-16T13:39:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc73f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc74015d840 0x7fc7400cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53438/0 (socket says 172.21.15.5:53438) 2023-10-16T13:39:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.597+0000 7fc73f7fe700 1 -- 172.21.15.5:0/1445294610 learned_addr learned my addr 172.21.15.5:0/1445294610 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73effd700 1 --2- 172.21.15.5:0/1445294610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc740162070 0x7fc7400cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73ffff700 1 --2- 172.21.15.5:0/1445294610 >> v2:172.21.15.112:3300/0 conn(0x7fc7400cd870 0x7fc7400caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73e7fc700 1 -- 172.21.15.5:0/1445294610 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762503679 0 0) 0x7fc7400cee20 con 0x7fc74015d840 2023-10-16T13:39:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73e7fc700 1 -- 172.21.15.5:0/1445294610 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72c0035b0 con 0x7fc74015d840 2023-10-16T13:39:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73e7fc700 1 -- 172.21.15.5:0/1445294610 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915364458 0 0) 0x7fc72c0035b0 con 0x7fc74015d840 2023-10-16T13:39:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73effd700 1 -- 172.21.15.5:0/1445294610 >> v2:172.21.15.112:3300/0 conn(0x7fc7400cd870 msgr2=0x7fc7400caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73effd700 1 --2- 172.21.15.5:0/1445294610 >> v2:172.21.15.112:3300/0 conn(0x7fc7400cd870 0x7fc7400caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73effd700 1 -- 172.21.15.5:0/1445294610 >> v1:172.21.15.5:6789/0 conn(0x7fc74015d840 legacy=0x7fc7400cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73effd700 1 -- 172.21.15.5:0/1445294610 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400ceb40 con 0x7fc740162070 2023-10-16T13:39:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73effd700 1 --2- 172.21.15.5:0/1445294610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc740162070 0x7fc7400cd330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc728009840 tx=0x7fc728009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d246cbe602d10aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73e7fc700 1 -- 172.21.15.5:0/1445294610 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300019f0 con 0x7fc740162070 2023-10-16T13:39:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73e7fc700 1 -- 172.21.15.5:0/1445294610 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc728004030 con 0x7fc740162070 2023-10-16T13:39:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.598+0000 7fc73e7fc700 1 -- 172.21.15.5:0/1445294610 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280043c0 con 0x7fc740162070 2023-10-16T13:39:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 -- 172.21.15.5:0/1445294610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc740162070 msgr2=0x7fc7400cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 --2- 172.21.15.5:0/1445294610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc740162070 0x7fc7400cd330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc728009840 tx=0x7fc728009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 -- 172.21.15.5:0/1445294610 shutdown_connections 2023-10-16T13:39:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 --2- 172.21.15.5:0/1445294610 >> v2:172.21.15.112:3300/0 conn(0x7fc7400cd870 0x7fc7400caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 --2- 172.21.15.5:0/1445294610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc740162070 0x7fc7400cd330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 -- 172.21.15.5:0/1445294610 >> 172.21.15.5:0/1445294610 conn(0x7fc74006bd70 msgr2=0x7fc74006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 -- 172.21.15.5:0/1445294610 shutdown_connections 2023-10-16T13:39:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.599+0000 7fc745aac700 1 -- 172.21.15.5:0/1445294610 wait complete. 2023-10-16T13:39:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.600+0000 7fc745aac700 1 Processor -- start 2023-10-16T13:39:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.600+0000 7fc745aac700 1 -- start start 2023-10-16T13:39:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc745aac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7400cd870 0x7fc74014f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc745aac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 0x7fc7401568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc745aac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc740162070 0x7fc740156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc745aac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400b3570 con 0x7fc74015d840 2023-10-16T13:39:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc745aac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400b5e10 con 0x7fc740162070 2023-10-16T13:39:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc745aac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400ac8b0 con 0x7fc7400cd870 2023-10-16T13:39:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc73effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 0x7fc7401568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc73effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 0x7fc7401568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43442/0 (socket says 172.21.15.5:43442) 2023-10-16T13:39:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc73effd700 1 -- 172.21.15.5:0/2505163459 learned_addr learned my addr 172.21.15.5:0/2505163459 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc73f7fe700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7400cd870 0x7fc74014f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.601+0000 7fc73ffff700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc740162070 0x7fc740156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc73effd700 1 -- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7400cd870 msgr2=0x7fc74014f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc73effd700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7400cd870 0x7fc74014f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc73effd700 1 -- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc740162070 msgr2=0x7fc740156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc73effd700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc740162070 0x7fc740156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc73effd700 1 -- 172.21.15.5:0/2505163459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280094a0 con 0x7fc74015d840 2023-10-16T13:39:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc73effd700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 0x7fc7401568a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc728004000 tx=0x7fc728004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728003c00 con 0x7fc74015d840 2023-10-16T13:39:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72801f070 con 0x7fc74015d840 2023-10-16T13:39:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7400acb70 con 0x7fc74015d840 2023-10-16T13:39:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728011630 con 0x7fc74015d840 2023-10-16T13:39:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.602+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7400b2eb0 con 0x7fc74015d840 2023-10-16T13:39:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.603+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7400ad090 con 0x7fc74015d840 2023-10-16T13:39:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.603+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc728021030 con 0x7fc74015d840 2023-10-16T13:39:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.604+0000 7fc737fff700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc72006af00 0x7fc72006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.604+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fc72808aa50 con 0x7fc74015d840 2023-10-16T13:39:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.604+0000 7fc73f7fe700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc72006af00 0x7fc72006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.604+0000 7fc73f7fe700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc72006af00 0x7fc72006d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc730002230 tx=0x7fc730002060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.608+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7400ad090 con 0x7fc74015d840 2023-10-16T13:39:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:10.808+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7400b36b0 con 0x7fc74015d840 2023-10-16T13:39:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.760+0000 7fc737fff700 1 -- 172.21.15.5:0/2505163459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc7400b36b0 con 0x7fc74015d840 2023-10-16T13:39:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.763+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc72006af00 msgr2=0x7fc72006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.763+0000 7fc745aac700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc72006af00 0x7fc72006d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc730002230 tx=0x7fc730002060 comp rx=0 tx=0).stop 2023-10-16T13:39:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.763+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 msgr2=0x7fc7401568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.763+0000 7fc745aac700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 0x7fc7401568a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc728004000 tx=0x7fc728004750 comp rx=0 tx=0).stop 2023-10-16T13:39:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.764+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 shutdown_connections 2023-10-16T13:39:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.764+0000 7fc745aac700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc740162070 0x7fc740156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.764+0000 7fc745aac700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc72006af00 0x7fc72006d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.764+0000 7fc745aac700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7400cd870 0x7fc74014f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.764+0000 7fc745aac700 1 --2- 172.21.15.5:0/2505163459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74015d840 0x7fc7401568a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.764+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 >> 172.21.15.5:0/2505163459 conn(0x7fc74006bd70 msgr2=0x7fc74015be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.765+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 shutdown_connections 2023-10-16T13:39:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.765+0000 7fc745aac700 1 -- 172.21.15.5:0/2505163459 wait complete. 2023-10-16T13:39:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:39:11.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:39:11.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.912+0000 7f2986821700 1 Processor -- start 2023-10-16T13:39:11.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.912+0000 7f2986821700 1 -- start start 2023-10-16T13:39:11.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f2986821700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 0x7f29800d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f2986821700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800cbdb0 con 0x7f29800cdf10 2023-10-16T13:39:11.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f2986821700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800d0b40 con 0x7f29800cc240 2023-10-16T13:39:11.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f2986821700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800d0e20 con 0x7f29800b0730 2023-10-16T13:39:11.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f297ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29800cdf10 0x7f29800ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53452/0 (socket says 172.21.15.5:53452) 2023-10-16T13:39:11.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f297ffff700 1 -- 172.21.15.5:0/1264394552 learned_addr learned my addr 172.21.15.5:0/1264394552 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:11.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f297f7fe700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 0x7f29800d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838767464 0 0) 0x7f29800cbdb0 con 0x7f29800cdf10 2023-10-16T13:39:11.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.913+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c0035b0 con 0x7f29800cdf10 2023-10-16T13:39:11.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518197174 0 0) 0x7f296c0035b0 con 0x7f29800cdf10 2023-10-16T13:39:11.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 msgr2=0x7f29800d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:11.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 0x7f29800d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 >> v1:172.21.15.112:6789/0 conn(0x7f29800cc240 legacy=0x7f29800cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800d1100 con 0x7f29800cdf10 2023-10-16T13:39:11.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f29700017f0 con 0x7f29800cdf10 2023-10-16T13:39:11.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 >> v1:172.21.15.5:6789/0 conn(0x7f29800cdf10 legacy=0x7f29800ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 0x7f296c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f296c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f296c004d90 0x7f296c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800d0e20 con 0x7f296c003f70 2023-10-16T13:39:11.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00ba70 con 0x7f296c004d90 2023-10-16T13:39:11.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00bc30 con 0x7f29800b0730 2023-10-16T13:39:11.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f296c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297ffff700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 0x7f296c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f2984dbe700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f296c004d90 0x7f296c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 -- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 msgr2=0x7f296c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:11.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29800b0730 0x7f296c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 -- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f296c004d90 msgr2=0x7f296c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:11.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f296c004d90 0x7f296c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 -- 172.21.15.5:0/1264394552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c0035b0 con 0x7f296c003f70 2023-10-16T13:39:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297f7fe700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f296c004850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2968009b60 tx=0x7f296c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19fc89cfbdc0df4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.914+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800e6c0 con 0x7f296c003f70 2023-10-16T13:39:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800e820 con 0x7f296c003f70 2023-10-16T13:39:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f297effd700 1 -- 172.21.15.5:0/1264394552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800eb90 con 0x7f296c003f70 2023-10-16T13:39:11.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2986821700 1 -- 172.21.15.5:0/1264394552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 msgr2=0x7f296c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2986821700 1 --2- 172.21.15.5:0/1264394552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f296c004850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2968009b60 tx=0x7f296c005880 comp rx=0 tx=0).stop 2023-10-16T13:39:11.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2984dbe700 1 -- 172.21.15.5:0/1264394552 reap_dead start 2023-10-16T13:39:11.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2986821700 1 -- 172.21.15.5:0/1264394552 shutdown_connections 2023-10-16T13:39:11.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2986821700 1 -- 172.21.15.5:0/1264394552 >> 172.21.15.5:0/1264394552 conn(0x7f29800d1530 msgr2=0x7f29800d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:11.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2986821700 1 -- 172.21.15.5:0/1264394552 shutdown_connections 2023-10-16T13:39:11.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.915+0000 7f2986821700 1 -- 172.21.15.5:0/1264394552 wait complete. 2023-10-16T13:39:11.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.917+0000 7f2986821700 1 Processor -- start 2023-10-16T13:39:11.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.917+0000 7f2986821700 1 -- start start 2023-10-16T13:39:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2986821700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f298015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2986821700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2980160fe0 0x7f29800c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2986821700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29801e73e0 0x7f29801e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2986821700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29801e7da0 con 0x7f296c003f70 2023-10-16T13:39:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2986821700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800caab0 con 0x7f29801e73e0 2023-10-16T13:39:11.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2986821700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800c9ea0 con 0x7f2980160fe0 2023-10-16T13:39:11.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f298015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f298015b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43460/0 (socket says 172.21.15.5:43460) 2023-10-16T13:39:11.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 -- 172.21.15.5:0/2769290705 learned_addr learned my addr 172.21.15.5:0/2769290705 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:11.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2984dbe700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29801e73e0 0x7f29801e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297f7fe700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2980160fe0 0x7f29800c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 -- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2980160fe0 msgr2=0x7f29800c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2980160fe0 0x7f29800c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 -- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29801e73e0 msgr2=0x7f29801e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:11.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29801e73e0 0x7f29801e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:11.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 -- 172.21.15.5:0/2769290705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800ca180 con 0x7f296c003f70 2023-10-16T13:39:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f2984dbe700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29801e73e0 0x7f29801e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.918+0000 7f297ffff700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f298015b360 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f297000f8e0 tx=0x7f297000fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.919+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000fe80 con 0x7f296c003f70 2023-10-16T13:39:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.919+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29700072e0 con 0x7f296c003f70 2023-10-16T13:39:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.919+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29800ca460 con 0x7f296c003f70 2023-10-16T13:39:11.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.919+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970007690 con 0x7f296c003f70 2023-10-16T13:39:11.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.919+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800c9b90 con 0x7f296c003f70 2023-10-16T13:39:11.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.920+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2980067d20 con 0x7f296c003f70 2023-10-16T13:39:11.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.920+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2970005830 con 0x7f296c003f70 2023-10-16T13:39:11.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.921+0000 7f297cff9700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f296006af00 0x7f296006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.921+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f2970089530 con 0x7f296c003f70 2023-10-16T13:39:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.921+0000 7f297f7fe700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f296006af00 0x7f296006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.921+0000 7f297f7fe700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f296006af00 0x7f296006d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29680090b0 tx=0x7f2968008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:11.926+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29700546c0 con 0x7f296c003f70 2023-10-16T13:39:12.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.130+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f29800b2c30 con 0x7f296c003f70 2023-10-16T13:39:12.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.761+0000 7f297cff9700 1 -- 172.21.15.5:0/2769290705 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2970057ce0 con 0x7f296c003f70 2023-10-16T13:39:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f296006af00 msgr2=0x7f296006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f296006af00 0x7f296006d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29680090b0 tx=0x7f2968008030 comp rx=0 tx=0).stop 2023-10-16T13:39:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 msgr2=0x7f298015b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f298015b360 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f297000f8e0 tx=0x7f297000fca0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 shutdown_connections 2023-10-16T13:39:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29801e73e0 0x7f29801e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f296c003f70 0x7f298015b360 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f296006af00 0x7f296006d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 --2- 172.21.15.5:0/2769290705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2980160fe0 0x7f29800c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 >> 172.21.15.5:0/2769290705 conn(0x7f29800d1530 msgr2=0x7f2980159720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 shutdown_connections 2023-10-16T13:39:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.765+0000 7f2986821700 1 -- 172.21.15.5:0/2769290705 wait complete. 2023-10-16T13:39:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:39:12.786 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:39:12.786 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:39:12.786 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:39:12.787 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:12.787 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:39:12.787 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:39:12.788 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:39:12.788 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:12.788 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:39:12.788 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:39:12.789 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:39:12.789 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:12.789 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:39:12.790 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:39:12.790 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:39:12.790 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:12.796 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:39:12.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:39:12.797 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:39:12.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:39:12.799 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:39:12.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:39:12.800 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:39:12.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:39:12.839 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:39:12.839 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:12.840 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:39:12.840 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:12.842 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:39:12.843 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:12.843 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:39:12.844 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:12.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:39:12.924 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:39:12.924 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:39:12.925 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:39:12.925 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:39:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.974+0000 7f237c339700 1 Processor -- start 2023-10-16T13:39:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.974+0000 7f237c339700 1 -- start start 2023-10-16T13:39:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237c339700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740cd4b0 0x7f23740cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237c339700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23740b2940 0x7f23740ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237c339700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740ce3b0 con 0x7f237415a850 2023-10-16T13:39:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237c339700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23740b6290 con 0x7f23740b2940 2023-10-16T13:39:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237c339700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23740cc220 con 0x7f23740cd4b0 2023-10-16T13:39:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237a0d5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f237415a850 0x7f23740ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53496/0 (socket says 172.21.15.5:53496) 2023-10-16T13:39:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237a0d5700 1 -- 172.21.15.5:0/286265291 learned_addr learned my addr 172.21.15.5:0/286265291 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f237a8d6700 1 --2- 172.21.15.5:0/286265291 >> v2:172.21.15.112:3300/0 conn(0x7f23740b2940 0x7f23740ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f23798d4700 1 --2- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740cd4b0 0x7f23740cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f23790d3700 1 -- 172.21.15.5:0/286265291 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486039559 0 0) 0x7f23740ce3b0 con 0x7f237415a850 2023-10-16T13:39:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.975+0000 7f23790d3700 1 -- 172.21.15.5:0/286265291 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23600035b0 con 0x7f237415a850 2023-10-16T13:39:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237a8d6700 1 -- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740cd4b0 msgr2=0x7f23740cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237a8d6700 1 --2- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740cd4b0 0x7f23740cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237a8d6700 1 -- 172.21.15.5:0/286265291 >> v1:172.21.15.5:6789/0 conn(0x7f237415a850 legacy=0x7f23740ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237a8d6700 1 -- 172.21.15.5:0/286265291 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23740cc500 con 0x7f23740b2940 2023-10-16T13:39:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237a8d6700 1 --2- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23740b2940 0x7f23740ce840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f236c009d90 tx=0x7f236c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cee05b6c9bbc23b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f23790d3700 1 -- 172.21.15.5:0/286265291 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00e070 con 0x7f23740b2940 2023-10-16T13:39:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f23790d3700 1 -- 172.21.15.5:0/286265291 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00bb20 con 0x7f23740b2940 2023-10-16T13:39:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f23790d3700 1 -- 172.21.15.5:0/286265291 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c012430 con 0x7f23740b2940 2023-10-16T13:39:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237c339700 1 -- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23740b2940 msgr2=0x7f23740ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.976+0000 7f237c339700 1 --2- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23740b2940 0x7f23740ce840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f236c009d90 tx=0x7f236c00b330 comp rx=0 tx=0).stop 2023-10-16T13:39:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.977+0000 7f237c339700 1 -- 172.21.15.5:0/286265291 shutdown_connections 2023-10-16T13:39:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.977+0000 7f237c339700 1 --2- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23740b2940 0x7f23740ce840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.977+0000 7f237c339700 1 --2- 172.21.15.5:0/286265291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740cd4b0 0x7f23740cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.977+0000 7f237c339700 1 -- 172.21.15.5:0/286265291 >> 172.21.15.5:0/286265291 conn(0x7f237406dac0 msgr2=0x7f237406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.977+0000 7f237c339700 1 -- 172.21.15.5:0/286265291 shutdown_connections 2023-10-16T13:39:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.977+0000 7f237c339700 1 -- 172.21.15.5:0/286265291 wait complete. 2023-10-16T13:39:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.978+0000 7f237c339700 1 Processor -- start 2023-10-16T13:39:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.978+0000 7f237c339700 1 -- start start 2023-10-16T13:39:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740b2940 0x7f237415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 0x7f23741e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237415a850 0x7f237415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237415bb80 con 0x7f23740cd4b0 2023-10-16T13:39:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237415c9a0 con 0x7f237415a850 2023-10-16T13:39:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237415bd90 con 0x7f23740b2940 2023-10-16T13:39:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 0x7f23741e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 0x7f23741e5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43500/0 (socket says 172.21.15.5:43500) 2023-10-16T13:39:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 -- 172.21.15.5:0/3131365252 learned_addr learned my addr 172.21.15.5:0/3131365252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237a0d5700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740b2940 0x7f237415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237a8d6700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237415a850 0x7f237415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 -- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740b2940 msgr2=0x7f237415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740b2940 0x7f237415ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 -- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237415a850 msgr2=0x7f237415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237415a850 0x7f237415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 -- 172.21.15.5:0/3131365252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c009a70 con 0x7f23740cd4b0 2023-10-16T13:39:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f23798d4700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 0x7f23741e5430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f237000e870 tx=0x7f237000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370009590 con 0x7f23740cd4b0 2023-10-16T13:39:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370013680 con 0x7f23740cd4b0 2023-10-16T13:39:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237415c070 con 0x7f23740cd4b0 2023-10-16T13:39:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23700139f0 con 0x7f23740cd4b0 2023-10-16T13:39:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.979+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237415c630 con 0x7f23740cd4b0 2023-10-16T13:39:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.980+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2374067d20 con 0x7f23740cd4b0 2023-10-16T13:39:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.981+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2370013b50 con 0x7f23740cd4b0 2023-10-16T13:39:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.981+0000 7f236affd700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235806af00 0x7f235806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.981+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2370089530 con 0x7f23740cd4b0 2023-10-16T13:39:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.981+0000 7f237a0d5700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235806af00 0x7f235806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.982+0000 7f237a0d5700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235806af00 0x7f235806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:12.986+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2370054840 con 0x7f23740cd4b0 2023-10-16T13:39:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.200+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f237415cae0 con 0x7f23740cd4b0 2023-10-16T13:39:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.776+0000 7f236affd700 1 -- 172.21.15.5:0/3131365252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2370057e60 con 0x7f23740cd4b0 2023-10-16T13:39:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235806af00 msgr2=0x7f235806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235806af00 0x7f235806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364007dc0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 msgr2=0x7f23741e5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 0x7f23741e5430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f237000e870 tx=0x7f237000eb80 comp rx=0 tx=0).stop 2023-10-16T13:39:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 shutdown_connections 2023-10-16T13:39:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237415a850 0x7f237415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235806af00 0x7f235806d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23740b2940 0x7f237415ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 --2- 172.21.15.5:0/3131365252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23740cd4b0 0x7f23741e5430 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 >> 172.21.15.5:0/3131365252 conn(0x7f237406dac0 msgr2=0x7f2374159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.778+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 shutdown_connections 2023-10-16T13:39:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.779+0000 7f237c339700 1 -- 172.21.15.5:0/3131365252 wait complete. 2023-10-16T13:39:13.785 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:39:13.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:39:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.920+0000 7f76c494f700 1 Processor -- start 2023-10-16T13:39:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.920+0000 7f76c494f700 1 -- start start 2023-10-16T13:39:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.920+0000 7f76c494f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f76c015e2f0 0x7f76c00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.920+0000 7f76c494f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00b2d60 con 0x7f76c006a840 2023-10-16T13:39:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.920+0000 7f76c494f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00cdd30 con 0x7f76c00cd950 2023-10-16T13:39:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.920+0000 7f76c494f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c01619a0 con 0x7f76c015e2f0 2023-10-16T13:39:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f76c006a840 0x7f76c006ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53514/0 (socket says 172.21.15.5:53514) 2023-10-16T13:39:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bed9d700 1 -- 172.21.15.5:0/2763214967 learned_addr learned my addr 172.21.15.5:0/2763214967 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bdd9b700 1 --2- 172.21.15.5:0/2763214967 >> v2:172.21.15.112:3300/0 conn(0x7f76c015e2f0 0x7f76c00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383023591 0 0) 0x7f76c00b2d60 con 0x7f76c006a840 2023-10-16T13:39:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ac0035b0 con 0x7f76c006a840 2023-10-16T13:39:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819261580 0 0) 0x7f76c00cdd30 con 0x7f76c00cd950 2023-10-16T13:39:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c00b2d60 con 0x7f76c00cd950 2023-10-16T13:39:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2763214967 >> v1:172.21.15.112:6789/0 conn(0x7f76c00cd950 legacy=0x7f76c015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2763214967 >> v1:172.21.15.5:6789/0 conn(0x7f76c006a840 legacy=0x7f76c006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2763214967 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c015e920 con 0x7f76c015e2f0 2023-10-16T13:39:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bdd9b700 1 --2- 172.21.15.5:0/2763214967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c015e2f0 0x7f76c00cede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009820 tx=0x7f76a8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94199ff66c45c436 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8005e30 con 0x7f76c015e2f0 2023-10-16T13:39:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a8006030 con 0x7f76c015e2f0 2023-10-16T13:39:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.921+0000 7f76bd59a700 1 -- 172.21.15.5:0/2763214967 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80063c0 con 0x7f76c015e2f0 2023-10-16T13:39:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 -- 172.21.15.5:0/2763214967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c015e2f0 msgr2=0x7f76c00cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 --2- 172.21.15.5:0/2763214967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c015e2f0 0x7f76c00cede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009820 tx=0x7f76a8009b30 comp rx=0 tx=0).stop 2023-10-16T13:39:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 -- 172.21.15.5:0/2763214967 shutdown_connections 2023-10-16T13:39:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 --2- 172.21.15.5:0/2763214967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c015e2f0 0x7f76c00cede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 -- 172.21.15.5:0/2763214967 >> 172.21.15.5:0/2763214967 conn(0x7f76c006dae0 msgr2=0x7f76c006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 -- 172.21.15.5:0/2763214967 shutdown_connections 2023-10-16T13:39:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.922+0000 7f76c494f700 1 -- 172.21.15.5:0/2763214967 wait complete. 2023-10-16T13:39:13.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.923+0000 7f76c494f700 1 Processor -- start 2023-10-16T13:39:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.923+0000 7f76c494f700 1 -- start start 2023-10-16T13:39:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76c494f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c006a840 0x7f76c00c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76c494f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 0x7f76c00b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76c494f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76c015e2f0 0x7f76c00b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76c494f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00c9360 con 0x7f76c00cd950 2023-10-16T13:39:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76c494f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00c8790 con 0x7f76c006a840 2023-10-16T13:39:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76c494f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00c8a30 con 0x7f76c015e2f0 2023-10-16T13:39:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76bdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 0x7f76c00b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76bdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 0x7f76c00b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43514/0 (socket says 172.21.15.5:43514) 2023-10-16T13:39:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2746661371 learned_addr learned my addr 172.21.15.5:0/2746661371 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76bed9d700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76c015e2f0 0x7f76c00b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.924+0000 7f76be59c700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c006a840 0x7f76c00c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76c015e2f0 msgr2=0x7f76c00b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bdd9b700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76c015e2f0 0x7f76c00b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c006a840 msgr2=0x7f76c00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bdd9b700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c006a840 0x7f76c00c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bdd9b700 1 -- 172.21.15.5:0/2746661371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009430 con 0x7f76c00cd950 2023-10-16T13:39:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76be59c700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c006a840 0x7f76c00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bed9d700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76c015e2f0 0x7f76c00b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76bdd9b700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 0x7f76c00b00c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f76a8013040 tx=0x7f76a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8025430 con 0x7f76c00cd950 2023-10-16T13:39:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a8020070 con 0x7f76c00cd950 2023-10-16T13:39:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c00c8d10 con 0x7f76c00cd950 2023-10-16T13:39:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80257f0 con 0x7f76c00cd950 2023-10-16T13:39:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.925+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c01536e0 con 0x7f76c00cd950 2023-10-16T13:39:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.926+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c00c9510 con 0x7f76c00cd950 2023-10-16T13:39:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.926+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f76a8022030 con 0x7f76c00cd950 2023-10-16T13:39:13.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.927+0000 7f76b6ffd700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76a006af00 0x7f76a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:13.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.927+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76a808a710 con 0x7f76c00cd950 2023-10-16T13:39:13.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.927+0000 7f76be59c700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76a006af00 0x7f76a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:13.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.927+0000 7f76be59c700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76a006af00 0x7f76a006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76b0007fd0 tx=0x7f76b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:13.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:13.932+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76c00c9510 con 0x7f76c00cd950 2023-10-16T13:39:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.214+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f76c015eeb0 con 0x7f76c00cd950 2023-10-16T13:39:14.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.215+0000 7f76b6ffd700 1 -- 172.21.15.5:0/2746661371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f76a8055ba0 con 0x7f76c00cd950 2023-10-16T13:39:14.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:14.218 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:39:14.218 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:39:14.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.219 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:39:14.219 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:39:14.219 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:39:14.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:39:14.220 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.221 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:39:14.221 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:39:14.221 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:39:14.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:39:14.222 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.222 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.223 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:39:14.223 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:39:14.223 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:39:14.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:39:14.224 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.225 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:39:14.225 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:39:14.225 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:39:14.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:39:14.226 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.226 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.227 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:39:14.227 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:39:14.227 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.228 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.228 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:39:14.229 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:39:14.229 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.229 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.230 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.230 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:39:14.230 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:39:14.231 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.231 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:39:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:39:14.232 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:39:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:39:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.234 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:39:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:39:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:39:14.237 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:39:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:39:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:39:14.239 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:39:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:39:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:39:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:39:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:39:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:39:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:39:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:39:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:39:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:39:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:39:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:39:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:39:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:39:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:39:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:39:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:39:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:39:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:39:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:39:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:39:14.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:39:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:39:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.248 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:39:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:39:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:39:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:39:14.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:39:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.250 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2023-10-16T13:39:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC5PC1lRojyMBAAFBzSX0hIqf+FvxORtXEfRw==", 2023-10-16T13:39:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T13:39:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T13:39:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC5PC1lfJLyMBAAxwDzxc+v/mcV0w11nqSpAg==", 2023-10-16T13:39:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T13:39:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2023-10-16T13:39:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC5PC1l/pzyMBAAIJcWF64rbfnhdaQUuqUlsg==", 2023-10-16T13:39:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T13:39:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T13:39:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC5PC1l8aTyMBAA2329E9DfWK6MINcdqmP+CQ==", 2023-10-16T13:39:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T13:39:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T13:39:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC5PC1l/qzyMBAAh80QScpgx5zpY6IZL000gQ==", 2023-10-16T13:39:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T13:39:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T13:39:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC5PC1lO7XyMBAA/8ZF85lOm9Rrc1OwuDTcbA==", 2023-10-16T13:39:14.257 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T13:39:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:39:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:39:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:39:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:39:14.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:39:14.260 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:39:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:39:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:39:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:39:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:39:14.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:39:14.262 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:39:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76a006af00 msgr2=0x7f76a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76a006af00 0x7f76a006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76b0007fd0 tx=0x7f76b0009040 comp rx=0 tx=0).stop 2023-10-16T13:39:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 msgr2=0x7f76c00b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 0x7f76c00b00c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f76a8013040 tx=0x7f76a8004750 comp rx=0 tx=0).stop 2023-10-16T13:39:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 shutdown_connections 2023-10-16T13:39:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76a006af00 0x7f76a006d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76c015e2f0 0x7f76c00b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c006a840 0x7f76c00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 --2- 172.21.15.5:0/2746661371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c00cd950 0x7f76c00b00c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 >> 172.21.15.5:0/2746661371 conn(0x7f76c006dae0 msgr2=0x7f76c00b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 shutdown_connections 2023-10-16T13:39:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.217+0000 7f76c494f700 1 -- 172.21.15.5:0/2746661371 wait complete. 2023-10-16T13:39:14.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T13:39:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.390+0000 7f5ab8fcd700 1 Processor -- start 2023-10-16T13:39:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.390+0000 7f5ab8fcd700 1 -- start start 2023-10-16T13:39:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab8fcd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ab40cdb40 0x7f5ab40b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab8fcd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ab40b3010 0x7f5ab40cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab8fcd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab40ce100 con 0x7f5ab415ac90 2023-10-16T13:39:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab8fcd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab40ce3e0 con 0x7f5ab40cdb40 2023-10-16T13:39:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab8fcd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab40ce6c0 con 0x7f5ab40b3010 2023-10-16T13:39:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab1d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ab40cdb40 0x7f5ab40b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab1d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ab40cdb40 0x7f5ab40b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43522/0 (socket says 172.21.15.5:43522) 2023-10-16T13:39:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/905054833 learned_addr learned my addr 172.21.15.5:0/905054833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab2d9d700 1 --2- 172.21.15.5:0/905054833 >> v2:172.21.15.112:3300/0 conn(0x7f5ab40b3010 0x7f5ab40cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/905054833 >> v2:172.21.15.112:3300/0 conn(0x7f5ab40b3010 msgr2=0x7f5ab40cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab1d9b700 1 --2- 172.21.15.5:0/905054833 >> v2:172.21.15.112:3300/0 conn(0x7f5ab40b3010 0x7f5ab40cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.391+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/905054833 >> v1:172.21.15.112:6789/0 conn(0x7f5ab415ac90 legacy=0x7f5ab406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/905054833 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40ce9a0 con 0x7f5ab40cdb40 2023-10-16T13:39:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab1d9b700 1 --2- 172.21.15.5:0/905054833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab40b2ad0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40cd740 tx=0x7f5a9c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7750ca6ed4f313b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab159a700 1 -- 172.21.15.5:0/905054833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00dcf0 con 0x7f5ab40cdb40 2023-10-16T13:39:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab159a700 1 -- 172.21.15.5:0/905054833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00de50 con 0x7f5ab40cdb40 2023-10-16T13:39:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab159a700 1 -- 172.21.15.5:0/905054833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c004250 con 0x7f5ab40cdb40 2023-10-16T13:39:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/905054833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 msgr2=0x7f5ab40b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/905054833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab40b2ad0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40cd740 tx=0x7f5a9c00be70 comp rx=0 tx=0).stop 2023-10-16T13:39:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/905054833 shutdown_connections 2023-10-16T13:39:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/905054833 >> v2:172.21.15.112:3300/0 conn(0x7f5ab40b3010 0x7f5ab40cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.392+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/905054833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab40b2ad0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.393+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/905054833 >> 172.21.15.5:0/905054833 conn(0x7f5ab40cfc40 msgr2=0x7f5ab40d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.393+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/905054833 shutdown_connections 2023-10-16T13:39:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.393+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/905054833 wait complete. 2023-10-16T13:39:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.394+0000 7f5ab8fcd700 1 Processor -- start 2023-10-16T13:39:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.394+0000 7f5ab8fcd700 1 -- start start 2023-10-16T13:39:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab8fcd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab40b3010 0x7f5ab40c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab8fcd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab41ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab8fcd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ab415ac90 0x7f5ab4071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab8fcd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab414a9c0 con 0x7f5ab40cdb40 2023-10-16T13:39:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab8fcd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40c7250 con 0x7f5ab40b3010 2023-10-16T13:39:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab8fcd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40c7480 con 0x7f5ab415ac90 2023-10-16T13:39:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab41ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab41ee6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43528/0 (socket says 172.21.15.5:43528) 2023-10-16T13:39:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.395+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/2393719463 learned_addr learned my addr 172.21.15.5:0/2393719463 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab259c700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab40b3010 0x7f5ab40c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ab415ac90 msgr2=0x7f5ab4071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab2d9d700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ab415ac90 0x7f5ab4071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab1d9b700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ab415ac90 0x7f5ab4071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab40b3010 msgr2=0x7f5ab40c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab1d9b700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab40b3010 0x7f5ab40c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab1d9b700 1 -- 172.21.15.5:0/2393719463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c00b7f0 con 0x7f5ab40cdb40 2023-10-16T13:39:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab259c700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab40b3010 0x7f5ab40c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab1d9b700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab41ee6d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c000c00 tx=0x7f5a9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c020070 con 0x7f5ab40cdb40 2023-10-16T13:39:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c004030 con 0x7f5ab40cdb40 2023-10-16T13:39:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c010470 con 0x7f5ab40cdb40 2023-10-16T13:39:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab40c7760 con 0x7f5ab40cdb40 2023-10-16T13:39:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.396+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab40c7d20 con 0x7f5ab40cdb40 2023-10-16T13:39:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.397+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab4067d20 con 0x7f5ab40cdb40 2023-10-16T13:39:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.398+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a9c0193f0 con 0x7f5ab40cdb40 2023-10-16T13:39:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.398+0000 7f5aaaffd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a9406af00 0x7f5a9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.398+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5a9c08cc20 con 0x7f5ab40cdb40 2023-10-16T13:39:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.398+0000 7f5ab259c700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a9406af00 0x7f5a9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.399+0000 7f5ab259c700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a9406af00 0x7f5a9406d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006fd0 tx=0x7f5aa4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.403+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a9c058020 con 0x7f5ab40cdb40 2023-10-16T13:39:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.685+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5ab40ca200 con 0x7f5ab40cdb40 2023-10-16T13:39:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.687+0000 7f5aaaffd700 1 -- 172.21.15.5:0/2393719463 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5a9c05b640 con 0x7f5ab40cdb40 2023-10-16T13:39:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.689+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a9406af00 msgr2=0x7f5a9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.689+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a9406af00 0x7f5a9406d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006fd0 tx=0x7f5aa4008040 comp rx=0 tx=0).stop 2023-10-16T13:39:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.689+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 msgr2=0x7f5ab41ee6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab41ee6d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c000c00 tx=0x7f5a9c004750 comp rx=0 tx=0).stop 2023-10-16T13:39:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 shutdown_connections 2023-10-16T13:39:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5a9406af00 0x7f5a9406d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ab415ac90 0x7f5ab4071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab40b3010 0x7f5ab40c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 --2- 172.21.15.5:0/2393719463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab40cdb40 0x7f5ab41ee6d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 >> 172.21.15.5:0/2393719463 conn(0x7f5ab40cfc40 msgr2=0x7f5ab406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 shutdown_connections 2023-10-16T13:39:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.690+0000 7f5ab8fcd700 1 -- 172.21.15.5:0/2393719463 wait complete. 2023-10-16T13:39:14.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T13:39:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.831+0000 7f72356dd700 1 Processor -- start 2023-10-16T13:39:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.831+0000 7f72356dd700 1 -- start start 2023-10-16T13:39:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f72356dd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72300d3fc0 0x7f723015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f72356dd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723015e4e0 con 0x7f72300b7050 2023-10-16T13:39:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f72356dd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72300d28e0 con 0x7f723015dbc0 2023-10-16T13:39:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f72356dd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72300b7560 con 0x7f72300d3fc0 2023-10-16T13:39:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72300d3fc0 0x7f723015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72300b7050 0x7f72300d21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53544/0 (socket says 172.21.15.5:53544) 2023-10-16T13:39:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722f7fe700 1 -- 172.21.15.5:0/3587418668 learned_addr learned my addr 172.21.15.5:0/3587418668 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722e7fc700 1 -- 172.21.15.5:0/3587418668 >> v1:172.21.15.112:6789/0 conn(0x7f723015dbc0 legacy=0x7f72300d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722e7fc700 1 -- 172.21.15.5:0/3587418668 >> v1:172.21.15.5:6789/0 conn(0x7f72300b7050 legacy=0x7f72300d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722e7fc700 1 -- 172.21.15.5:0/3587418668 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72300b7840 con 0x7f72300d3fc0 2023-10-16T13:39:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.832+0000 7f722dffb700 1 -- 172.21.15.5:0/3587418668 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969371851 0 0) 0x7f723015e4e0 con 0x7f72300b7050 2023-10-16T13:39:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f722e7fc700 1 --2- 172.21.15.5:0/3587418668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300d3fc0 0x7f723015dfa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7220009840 tx=0x7f7220009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282f6c61622be534 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f722dffb700 1 -- 172.21.15.5:0/3587418668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220004230 con 0x7f72300d3fc0 2023-10-16T13:39:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f722dffb700 1 -- 172.21.15.5:0/3587418668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7220004390 con 0x7f72300d3fc0 2023-10-16T13:39:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f722dffb700 1 -- 172.21.15.5:0/3587418668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200036a0 con 0x7f72300d3fc0 2023-10-16T13:39:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 -- 172.21.15.5:0/3587418668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300d3fc0 msgr2=0x7f723015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 --2- 172.21.15.5:0/3587418668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300d3fc0 0x7f723015dfa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7220009840 tx=0x7f7220009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:14.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 -- 172.21.15.5:0/3587418668 shutdown_connections 2023-10-16T13:39:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 --2- 172.21.15.5:0/3587418668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300d3fc0 0x7f723015dfa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 -- 172.21.15.5:0/3587418668 >> 172.21.15.5:0/3587418668 conn(0x7f723009cb40 msgr2=0x7f72300d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 -- 172.21.15.5:0/3587418668 shutdown_connections 2023-10-16T13:39:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.833+0000 7f72356dd700 1 -- 172.21.15.5:0/3587418668 wait complete. 2023-10-16T13:39:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 Processor -- start 2023-10-16T13:39:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 -- start start 2023-10-16T13:39:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 0x7f723009f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72300d3fc0 0x7f723009f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f723015dbc0 0x7f72301f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300a0ca0 con 0x7f72300b7050 2023-10-16T13:39:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300a0810 con 0x7f72300d3fc0 2023-10-16T13:39:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f72356dd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723009fc00 con 0x7f723015dbc0 2023-10-16T13:39:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.835+0000 7f722effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 0x7f723009f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 0x7f723009f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43542/0 (socket says 172.21.15.5:43542) 2023-10-16T13:39:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 -- 172.21.15.5:0/940113286 learned_addr learned my addr 172.21.15.5:0/940113286 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722f7fe700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f723015dbc0 0x7f72301f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722e7fc700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72300d3fc0 0x7f723009f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 -- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f723015dbc0 msgr2=0x7f72301f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f723015dbc0 0x7f72301f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 -- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72300d3fc0 msgr2=0x7f723009f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72300d3fc0 0x7f723009f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 -- 172.21.15.5:0/940113286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200094a0 con 0x7f72300b7050 2023-10-16T13:39:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f722effd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 0x7f723009f0b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f721800b450 tx=0x7f721800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218004020 con 0x7f72300b7050 2023-10-16T13:39:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218004180 con 0x7f72300b7050 2023-10-16T13:39:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723009fee0 con 0x7f72300b7050 2023-10-16T13:39:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218004530 con 0x7f72300b7050 2023-10-16T13:39:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.836+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72300a04a0 con 0x7f72300b7050 2023-10-16T13:39:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.837+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723004ebb0 con 0x7f72300b7050 2023-10-16T13:39:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.838+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f72180036d0 con 0x7f72300b7050 2023-10-16T13:39:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.838+0000 7f72277fe700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f721006af00 0x7f721006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.838+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7218088a50 con 0x7f72300b7050 2023-10-16T13:39:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.838+0000 7f722e7fc700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f721006af00 0x7f721006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.839+0000 7f722e7fc700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f721006af00 0x7f721006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7220000c00 tx=0x7f722001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:14.843+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7218053ee0 con 0x7f72300b7050 2023-10-16T13:39:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.131+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f72300b91d0 con 0x7f72300b7050 2023-10-16T13:39:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.133+0000 7f72277fe700 1 -- 172.21.15.5:0/940113286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7218015070 con 0x7f72300b7050 2023-10-16T13:39:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f721006af00 msgr2=0x7f721006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f721006af00 0x7f721006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7220000c00 tx=0x7f722001c040 comp rx=0 tx=0).stop 2023-10-16T13:39:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 msgr2=0x7f723009f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 0x7f723009f0b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f721800b450 tx=0x7f721800b810 comp rx=0 tx=0).stop 2023-10-16T13:39:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 shutdown_connections 2023-10-16T13:39:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f721006af00 0x7f721006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f723015dbc0 0x7f72301f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72300b7050 0x7f723009f0b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 --2- 172.21.15.5:0/940113286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72300d3fc0 0x7f723009f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 >> 172.21.15.5:0/940113286 conn(0x7f723009cb40 msgr2=0x7f72300c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 shutdown_connections 2023-10-16T13:39:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.135+0000 7f72356dd700 1 -- 172.21.15.5:0/940113286 wait complete. 2023-10-16T13:39:15.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T13:39:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.273+0000 7fb378329700 1 Processor -- start 2023-10-16T13:39:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.273+0000 7fb378329700 1 -- start start 2023-10-16T13:39:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb378329700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb37015a850 0x7fb3700cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb378329700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700cd4b0 0x7fb3700ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb378329700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700ce3b0 con 0x7fb3700b2940 2023-10-16T13:39:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb378329700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700b2df0 con 0x7fb37015a850 2023-10-16T13:39:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb378329700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700b6290 con 0x7fb3700cd4b0 2023-10-16T13:39:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb3758c4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3700b2940 0x7fb3700ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53554/0 (socket says 172.21.15.5:53554) 2023-10-16T13:39:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb3758c4700 1 -- 172.21.15.5:0/3135988223 learned_addr learned my addr 172.21.15.5:0/3135988223 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb3768c6700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700cd4b0 0x7fb3700ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.274+0000 7fb3760c5700 1 --2- 172.21.15.5:0/3135988223 >> v2:172.21.15.112:3300/0 conn(0x7fb37015a850 0x7fb3700cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3750c3700 1 -- 172.21.15.5:0/3135988223 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754348725 0 0) 0x7fb3700ce3b0 con 0x7fb3700b2940 2023-10-16T13:39:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3750c3700 1 -- 172.21.15.5:0/3135988223 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb35c0035b0 con 0x7fb3700b2940 2023-10-16T13:39:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3760c5700 1 -- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700cd4b0 msgr2=0x7fb3700ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3760c5700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700cd4b0 0x7fb3700ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3760c5700 1 -- 172.21.15.5:0/3135988223 >> v1:172.21.15.5:6789/0 conn(0x7fb3700b2940 legacy=0x7fb3700ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3760c5700 1 -- 172.21.15.5:0/3135988223 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700cc220 con 0x7fb37015a850 2023-10-16T13:39:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3768c6700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700cd4b0 0x7fb3700ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3760c5700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37015a850 0x7fb3700cbc40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb360009840 tx=0x7fb360009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd81f8b2e9e4289 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3750c3700 1 -- 172.21.15.5:0/3135988223 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360011830 con 0x7fb37015a850 2023-10-16T13:39:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3750c3700 1 -- 172.21.15.5:0/3135988223 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360011990 con 0x7fb37015a850 2023-10-16T13:39:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.275+0000 7fb3750c3700 1 -- 172.21.15.5:0/3135988223 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360011d20 con 0x7fb37015a850 2023-10-16T13:39:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 -- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37015a850 msgr2=0x7fb3700cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37015a850 0x7fb3700cbc40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb360009840 tx=0x7fb360009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 -- 172.21.15.5:0/3135988223 shutdown_connections 2023-10-16T13:39:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700cd4b0 0x7fb3700ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 --2- 172.21.15.5:0/3135988223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37015a850 0x7fb3700cbc40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 -- 172.21.15.5:0/3135988223 >> 172.21.15.5:0/3135988223 conn(0x7fb37006dac0 msgr2=0x7fb37006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 -- 172.21.15.5:0/3135988223 shutdown_connections 2023-10-16T13:39:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.276+0000 7fb378329700 1 -- 172.21.15.5:0/3135988223 wait complete. 2023-10-16T13:39:15.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.277+0000 7fb378329700 1 Processor -- start 2023-10-16T13:39:15.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.277+0000 7fb378329700 1 -- start start 2023-10-16T13:39:15.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb378329700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700b2940 0x7fb3700c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb378329700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3700cd4b0 0x7fb3700c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb378329700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 0x7fb3700c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb378329700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700c8a70 con 0x7fb37015a850 2023-10-16T13:39:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb378329700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700c62a0 con 0x7fb3700cd4b0 2023-10-16T13:39:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb378329700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700c7df0 con 0x7fb3700b2940 2023-10-16T13:39:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 0x7fb3700c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 0x7fb3700c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43560/0 (socket says 172.21.15.5:43560) 2023-10-16T13:39:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 -- 172.21.15.5:0/286257676 learned_addr learned my addr 172.21.15.5:0/286257676 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3758c4700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3700cd4b0 0x7fb3700c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3760c5700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700b2940 0x7fb3700c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 -- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700b2940 msgr2=0x7fb3700c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700b2940 0x7fb3700c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 -- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3700cd4b0 msgr2=0x7fb3700c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3700cd4b0 0x7fb3700c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3768c6700 1 -- 172.21.15.5:0/286257676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb368009a70 con 0x7fb37015a850 2023-10-16T13:39:15.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.278+0000 7fb3758c4700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3700cd4b0 0x7fb3700c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:15.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.279+0000 7fb3768c6700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 0x7fb3700c95c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb36800efc0 tx=0x7fb36800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:15.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.279+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368009cd0 con 0x7fb37015a850 2023-10-16T13:39:15.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.279+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36800f040 con 0x7fb37015a850 2023-10-16T13:39:15.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.279+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3600094a0 con 0x7fb37015a850 2023-10-16T13:39:15.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.279+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36800cd60 con 0x7fb37015a850 2023-10-16T13:39:15.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.279+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3700c83b0 con 0x7fb37015a850 2023-10-16T13:39:15.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.280+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370067d20 con 0x7fb37015a850 2023-10-16T13:39:15.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.280+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb368014480 con 0x7fb37015a850 2023-10-16T13:39:15.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.281+0000 7fb366ffd700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35406af00 0x7fb35406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.281+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb368089970 con 0x7fb37015a850 2023-10-16T13:39:15.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.281+0000 7fb3760c5700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35406af00 0x7fb35406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.281+0000 7fb3760c5700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35406af00 0x7fb35406d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb360000c00 tx=0x7fb36001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:15.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.285+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb368054d70 con 0x7fb37015a850 2023-10-16T13:39:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.565+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb37006e9b0 con 0x7fb37015a850 2023-10-16T13:39:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.567+0000 7fb366ffd700 1 -- 172.21.15.5:0/286257676 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb368058390 con 0x7fb37015a850 2023-10-16T13:39:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35406af00 msgr2=0x7fb35406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35406af00 0x7fb35406d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb360000c00 tx=0x7fb36001c040 comp rx=0 tx=0).stop 2023-10-16T13:39:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 msgr2=0x7fb3700c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 0x7fb3700c95c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb36800efc0 tx=0x7fb36800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 shutdown_connections 2023-10-16T13:39:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37015a850 0x7fb3700c95c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35406af00 0x7fb35406d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3700b2940 0x7fb3700c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 --2- 172.21.15.5:0/286257676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3700cd4b0 0x7fb3700c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 >> 172.21.15.5:0/286257676 conn(0x7fb37006dac0 msgr2=0x7fb3700b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 shutdown_connections 2023-10-16T13:39:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.570+0000 7fb378329700 1 -- 172.21.15.5:0/286257676 wait complete. 2023-10-16T13:39:15.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T13:39:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.707+0000 7f78d033b700 1 Processor -- start 2023-10-16T13:39:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.707+0000 7f78d033b700 1 -- start start 2023-10-16T13:39:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78d033b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78c80cc3f0 0x7f78c80cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78d033b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c8071ab0 con 0x7f78c806af50 2023-10-16T13:39:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78d033b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c8161bc0 con 0x7f78c8161670 2023-10-16T13:39:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78d033b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c8161ea0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78ce0d7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78c80cc3f0 0x7f78c80cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78ce8d8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78c806af50 0x7f78c8071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53572/0 (socket says 172.21.15.5:53572) 2023-10-16T13:39:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.708+0000 7f78ce8d8700 1 -- 172.21.15.5:0/468248360 learned_addr learned my addr 172.21.15.5:0/468248360 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78ce0d7700 1 -- 172.21.15.5:0/468248360 >> v1:172.21.15.112:6789/0 conn(0x7f78c8161670 legacy=0x7f78c806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78ce0d7700 1 -- 172.21.15.5:0/468248360 >> v1:172.21.15.5:6789/0 conn(0x7f78c806af50 legacy=0x7f78c8071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78ce0d7700 1 -- 172.21.15.5:0/468248360 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8162180 con 0x7f78c80cc3f0 2023-10-16T13:39:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78ce0d7700 1 --2- 172.21.15.5:0/468248360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80cc7d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009840 tx=0x7f78c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496eb632613dd405 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78cd0d5700 1 -- 172.21.15.5:0/468248360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4011830 con 0x7f78c80cc3f0 2023-10-16T13:39:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78cd0d5700 1 -- 172.21.15.5:0/468248360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4011990 con 0x7f78c80cc3f0 2023-10-16T13:39:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.709+0000 7f78cd0d5700 1 -- 172.21.15.5:0/468248360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4011d20 con 0x7f78c80cc3f0 2023-10-16T13:39:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 -- 172.21.15.5:0/468248360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 msgr2=0x7f78c80cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 --2- 172.21.15.5:0/468248360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80cc7d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009840 tx=0x7f78c4009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 -- 172.21.15.5:0/468248360 shutdown_connections 2023-10-16T13:39:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 --2- 172.21.15.5:0/468248360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80cc7d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 -- 172.21.15.5:0/468248360 >> 172.21.15.5:0/468248360 conn(0x7f78c806dac0 msgr2=0x7f78c806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 -- 172.21.15.5:0/468248360 shutdown_connections 2023-10-16T13:39:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.710+0000 7f78d033b700 1 -- 172.21.15.5:0/468248360 wait complete. 2023-10-16T13:39:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.711+0000 7f78d033b700 1 Processor -- start 2023-10-16T13:39:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.711+0000 7f78d033b700 1 -- start start 2023-10-16T13:39:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c806af50 0x7f78c80b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c8161670 0x7f78c80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80b5fe0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8147270 con 0x7f78c806af50 2023-10-16T13:39:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8147510 con 0x7f78c8161670 2023-10-16T13:39:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43572/0 (socket says 172.21.15.5:43572) 2023-10-16T13:39:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 -- 172.21.15.5:0/2891847443 learned_addr learned my addr 172.21.15.5:0/2891847443 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78ce0d7700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c806af50 0x7f78c80b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78ce8d8700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c8161670 0x7f78c80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 -- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c8161670 msgr2=0x7f78c80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c8161670 0x7f78c80caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 -- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c806af50 msgr2=0x7f78c80b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c806af50 0x7f78c80b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 -- 172.21.15.5:0/2891847443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c40094a0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78ce8d8700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c8161670 0x7f78c80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78cd8d6700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80c3da0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c700 tx=0x7f78b800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80052d0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8005430 con 0x7f78c80cc3f0 2023-10-16T13:39:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003880 con 0x7f78c80cc3f0 2023-10-16T13:39:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.712+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c81477f0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.713+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c8147db0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.713+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c8067d20 con 0x7f78c80cc3f0 2023-10-16T13:39:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.714+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78b80039e0 con 0x7f78c80cc3f0 2023-10-16T13:39:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.714+0000 7f78beffd700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78ac06af00 0x7f78ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.714+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78b8088590 con 0x7f78c80cc3f0 2023-10-16T13:39:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.714+0000 7f78ce0d7700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78ac06af00 0x7f78ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.715+0000 7f78ce0d7700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78ac06af00 0x7f78ac06d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78c40090b0 tx=0x7f78c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:15.719+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78b8053ad0 con 0x7f78c80cc3f0 2023-10-16T13:39:16.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.003+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f78c80b6430 con 0x7f78c80cc3f0 2023-10-16T13:39:16.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.005+0000 7f78beffd700 1 -- 172.21.15.5:0/2891847443 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f78b80570f0 con 0x7f78c80cc3f0 2023-10-16T13:39:16.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78ac06af00 msgr2=0x7f78ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78ac06af00 0x7f78ac06d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78c40090b0 tx=0x7f78c4008030 comp rx=0 tx=0).stop 2023-10-16T13:39:16.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 msgr2=0x7f78c80c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80c3da0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c700 tx=0x7f78b800ca10 comp rx=0 tx=0).stop 2023-10-16T13:39:16.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 shutdown_connections 2023-10-16T13:39:16.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78ac06af00 0x7f78ac06d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78c8161670 0x7f78c80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78c806af50 0x7f78c80b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 --2- 172.21.15.5:0/2891847443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c80cc3f0 0x7f78c80c3da0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.007+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 >> 172.21.15.5:0/2891847443 conn(0x7f78c806dac0 msgr2=0x7f78c815f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.008+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 shutdown_connections 2023-10-16T13:39:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.008+0000 7f78d033b700 1 -- 172.21.15.5:0/2891847443 wait complete. 2023-10-16T13:39:16.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T13:39:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.146+0000 7fb489e42700 1 Processor -- start 2023-10-16T13:39:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.146+0000 7fb489e42700 1 -- start start 2023-10-16T13:39:16.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb489e42700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb48415a850 0x7fb4840cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb489e42700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4840b2940 0x7fb4840ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb489e42700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4840ce3b0 con 0x7fb4840cd2e0 2023-10-16T13:39:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb489e42700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4840b2dc0 con 0x7fb4840b2940 2023-10-16T13:39:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb489e42700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b6290 con 0x7fb48415a850 2023-10-16T13:39:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb482ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4840b2940 0x7fb4840ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb483fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4840cd2e0 0x7fb484071ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53586/0 (socket says 172.21.15.5:53586) 2023-10-16T13:39:16.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb483fff700 1 -- 172.21.15.5:0/1355431931 learned_addr learned my addr 172.21.15.5:0/1355431931 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:16.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.147+0000 7fb4837fe700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb48415a850 0x7fb4840cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb482ffd700 1 -- 172.21.15.5:0/1355431931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb48415a850 msgr2=0x7fb4840cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:16.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb482ffd700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb48415a850 0x7fb4840cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb482ffd700 1 -- 172.21.15.5:0/1355431931 >> v1:172.21.15.5:6789/0 conn(0x7fb4840cd2e0 legacy=0x7fb484071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb482ffd700 1 -- 172.21.15.5:0/1355431931 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840cc220 con 0x7fb4840b2940 2023-10-16T13:39:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb4827fc700 1 -- 172.21.15.5:0/1355431931 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924394832 0 0) 0x7fb4840ce3b0 con 0x7fb4840cd2e0 2023-10-16T13:39:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb4837fe700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb48415a850 0x7fb4840cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb482ffd700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4840b2940 0x7fb4840ccda0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb474009840 tx=0x7fb474009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca5e97dce722ce server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb4827fc700 1 -- 172.21.15.5:0/1355431931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011830 con 0x7fb4840b2940 2023-10-16T13:39:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb4827fc700 1 -- 172.21.15.5:0/1355431931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb474011990 con 0x7fb4840b2940 2023-10-16T13:39:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb4827fc700 1 -- 172.21.15.5:0/1355431931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011d20 con 0x7fb4840b2940 2023-10-16T13:39:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb489e42700 1 -- 172.21.15.5:0/1355431931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4840b2940 msgr2=0x7fb4840ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.148+0000 7fb489e42700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4840b2940 0x7fb4840ccda0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb474009840 tx=0x7fb474009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.149+0000 7fb489e42700 1 -- 172.21.15.5:0/1355431931 shutdown_connections 2023-10-16T13:39:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.149+0000 7fb489e42700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb48415a850 0x7fb4840cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.149+0000 7fb489e42700 1 --2- 172.21.15.5:0/1355431931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4840b2940 0x7fb4840ccda0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.149+0000 7fb489e42700 1 -- 172.21.15.5:0/1355431931 >> 172.21.15.5:0/1355431931 conn(0x7fb48406dac0 msgr2=0x7fb48406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.149+0000 7fb489e42700 1 -- 172.21.15.5:0/1355431931 shutdown_connections 2023-10-16T13:39:16.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.149+0000 7fb489e42700 1 -- 172.21.15.5:0/1355431931 wait complete. 2023-10-16T13:39:16.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.150+0000 7fb489e42700 1 Processor -- start 2023-10-16T13:39:16.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.150+0000 7fb489e42700 1 -- start start 2023-10-16T13:39:16.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4840b2940 0x7fb484158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4840cd2e0 0x7fb4840ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 0x7fb4840c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b08f0 con 0x7fb48415a850 2023-10-16T13:39:16.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b0b70 con 0x7fb4840b2940 2023-10-16T13:39:16.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b0e50 con 0x7fb4840cd2e0 2023-10-16T13:39:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 0x7fb4840c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 0x7fb4840c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43588/0 (socket says 172.21.15.5:43588) 2023-10-16T13:39:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 -- 172.21.15.5:0/1294097731 learned_addr learned my addr 172.21.15.5:0/1294097731 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb4837fe700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4840b2940 0x7fb484158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb482ffd700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4840cd2e0 0x7fb4840ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 -- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4840cd2e0 msgr2=0x7fb4840ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4840cd2e0 0x7fb4840ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 -- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4840b2940 msgr2=0x7fb484158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4840b2940 0x7fb484158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 -- 172.21.15.5:0/1294097731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740094a0 con 0x7fb48415a850 2023-10-16T13:39:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb483fff700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 0x7fb4840c5ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00cb60 tx=0x7fb47c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00ab50 con 0x7fb48415a850 2023-10-16T13:39:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00acb0 con 0x7fb48415a850 2023-10-16T13:39:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c007310 con 0x7fb48415a850 2023-10-16T13:39:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4840b1130 con 0x7fb48415a850 2023-10-16T13:39:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.151+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4840b16f0 con 0x7fb48415a850 2023-10-16T13:39:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.152+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4840b1910 con 0x7fb48415a850 2023-10-16T13:39:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.153+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb47c007470 con 0x7fb48415a850 2023-10-16T13:39:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.153+0000 7fb47bfff700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb46406af00 0x7fb46406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.153+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb47c088e30 con 0x7fb48415a850 2023-10-16T13:39:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.153+0000 7fb4837fe700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb46406af00 0x7fb46406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.154+0000 7fb4837fe700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb46406af00 0x7fb46406d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb46c006fd0 tx=0x7fb46c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.158+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb47c054230 con 0x7fb48415a850 2023-10-16T13:39:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.443+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb484067d20 con 0x7fb48415a850 2023-10-16T13:39:16.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.445+0000 7fb47bfff700 1 -- 172.21.15.5:0/1294097731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb47c018020 con 0x7fb48415a850 2023-10-16T13:39:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb46406af00 msgr2=0x7fb46406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb46406af00 0x7fb46406d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb46c006fd0 tx=0x7fb46c008040 comp rx=0 tx=0).stop 2023-10-16T13:39:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 msgr2=0x7fb4840c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 0x7fb4840c5ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00cb60 tx=0x7fb47c00cf20 comp rx=0 tx=0).stop 2023-10-16T13:39:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 shutdown_connections 2023-10-16T13:39:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb48415a850 0x7fb4840c5ff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4840b2940 0x7fb484158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb46406af00 0x7fb46406d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 --2- 172.21.15.5:0/1294097731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4840cd2e0 0x7fb4840ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.447+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 >> 172.21.15.5:0/1294097731 conn(0x7fb48406dac0 msgr2=0x7fb484159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.448+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 shutdown_connections 2023-10-16T13:39:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.448+0000 7fb489e42700 1 -- 172.21.15.5:0/1294097731 wait complete. 2023-10-16T13:39:16.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T13:39:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.585+0000 7f6ed5c91700 1 Processor -- start 2023-10-16T13:39:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.585+0000 7f6ed5c91700 1 -- start start 2023-10-16T13:39:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ed5c91700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 0x7f6ed00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ed5c91700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ed0161670 0x7f6ed006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ed5c91700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed0071ab0 con 0x7f6ed00ccd10 2023-10-16T13:39:16.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ed5c91700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed0161bc0 con 0x7f6ed0161670 2023-10-16T13:39:16.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ed5c91700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0161ea0 con 0x7f6ed00cc3f0 2023-10-16T13:39:16.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ecffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ed00ccd10 0x7f6ed0071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53600/0 (socket says 172.21.15.5:53600) 2023-10-16T13:39:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ecffff700 1 -- 172.21.15.5:0/1300015411 learned_addr learned my addr 172.21.15.5:0/1300015411 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6eceffd700 1 --2- 172.21.15.5:0/1300015411 >> v2:172.21.15.112:3300/0 conn(0x7f6ed0161670 0x7f6ed006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.586+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 0x7f6ed00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312576576 0 0) 0x7f6ed0071ab0 con 0x7f6ed00ccd10 2023-10-16T13:39:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc0035b0 con 0x7f6ed00ccd10 2023-10-16T13:39:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887672894 0 0) 0x7f6ebc0035b0 con 0x7f6ed00ccd10 2023-10-16T13:39:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 msgr2=0x7f6ed00cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 0x7f6ed00cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 >> v2:172.21.15.112:3300/0 conn(0x7f6ed0161670 msgr2=0x7f6ed006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 --2- 172.21.15.5:0/1300015411 >> v2:172.21.15.112:3300/0 conn(0x7f6ed0161670 0x7f6ed006a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0162180 con 0x7f6ed00ccd10 2023-10-16T13:39:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6ec80019f0 con 0x7f6ed00ccd10 2023-10-16T13:39:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 >> v1:172.21.15.5:6789/0 conn(0x7f6ed00ccd10 legacy=0x7f6ed0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 0x7f6ebc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ebc003f80 0x7f6ebc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc004d90 0x7f6ebc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0161bc0 con 0x7f6ebc003f80 2023-10-16T13:39:16.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0161ea0 con 0x7f6ebc004d90 2023-10-16T13:39:16.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc00ba10 con 0x7f6ed00cc3f0 2023-10-16T13:39:16.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6eceffd700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ebc003f80 0x7f6ebc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 0x7f6ebc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6ecffff700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc004d90 0x7f6ebc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6eceffd700 1 -- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 msgr2=0x7f6ebc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6eceffd700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ed00cc3f0 0x7f6ebc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6eceffd700 1 -- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc004d90 msgr2=0x7f6ebc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6eceffd700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc004d90 0x7f6ebc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.587+0000 7f6eceffd700 1 -- 172.21.15.5:0/1300015411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0035b0 con 0x7f6ebc003f80 2023-10-16T13:39:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6eceffd700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ebc003f80 0x7f6ebc004850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009b30 tx=0x7f6ebc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824f33da326fdc39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800e660 con 0x7f6ebc003f80 2023-10-16T13:39:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb800e7c0 con 0x7f6ebc003f80 2023-10-16T13:39:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ece7fc700 1 -- 172.21.15.5:0/1300015411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800eb30 con 0x7f6ebc003f80 2023-10-16T13:39:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ed5c91700 1 -- 172.21.15.5:0/1300015411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ebc003f80 msgr2=0x7f6ebc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/1300015411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ebc003f80 0x7f6ebc004850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009b30 tx=0x7f6ebc005880 comp rx=0 tx=0).stop 2023-10-16T13:39:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ecffff700 1 -- 172.21.15.5:0/1300015411 reap_dead start 2023-10-16T13:39:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ed5c91700 1 -- 172.21.15.5:0/1300015411 shutdown_connections 2023-10-16T13:39:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ed5c91700 1 -- 172.21.15.5:0/1300015411 >> 172.21.15.5:0/1300015411 conn(0x7f6ed006dac0 msgr2=0x7f6ed006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ed5c91700 1 -- 172.21.15.5:0/1300015411 shutdown_connections 2023-10-16T13:39:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.588+0000 7f6ed5c91700 1 -- 172.21.15.5:0/1300015411 wait complete. 2023-10-16T13:39:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.590+0000 7f6ed5c91700 1 Processor -- start 2023-10-16T13:39:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.590+0000 7f6ed5c91700 1 -- start start 2023-10-16T13:39:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.590+0000 7f6ed5c91700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ebc003f80 0x7f6ed00af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 0x7f6ed01452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ed00c6490 0x7f6ed0145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00b35b0 con 0x7f6ed00b30d0 2023-10-16T13:39:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c59b0 con 0x7f6ed00c6490 2023-10-16T13:39:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c5c90 con 0x7f6ebc003f80 2023-10-16T13:39:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 0x7f6ed01452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 0x7f6ed01452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43606/0 (socket says 172.21.15.5:43606) 2023-10-16T13:39:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 -- 172.21.15.5:0/4272039076 learned_addr learned my addr 172.21.15.5:0/4272039076 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ebc003f80 0x7f6ed00af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ecffff700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ed00c6490 0x7f6ed0145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 -- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ebc003f80 msgr2=0x7f6ed00af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ebc003f80 0x7f6ed00af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 -- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ed00c6490 msgr2=0x7f6ed0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ed00c6490 0x7f6ed0145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 -- 172.21.15.5:0/4272039076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00c5f70 con 0x7f6ed00b30d0 2023-10-16T13:39:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6eceffd700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 0x7f6ed01452e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0046f0 tx=0x7f6eb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8021070 con 0x7f6ed00b30d0 2023-10-16T13:39:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb80138d0 con 0x7f6ed00b30d0 2023-10-16T13:39:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed00b3890 con 0x7f6ed00b30d0 2023-10-16T13:39:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800e660 con 0x7f6ed00b30d0 2023-10-16T13:39:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.591+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed0145d60 con 0x7f6ed00b30d0 2023-10-16T13:39:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.592+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed00b2500 con 0x7f6ed00b30d0 2023-10-16T13:39:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.593+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6eb8025070 con 0x7f6ed00b30d0 2023-10-16T13:39:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.593+0000 7f6ec7fff700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6eb006af30 0x7f6eb006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.593+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6eb808a350 con 0x7f6ed00b30d0 2023-10-16T13:39:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.594+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6eb006af30 0x7f6eb006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.594+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6eb006af30 0x7f6eb006d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009b80 tx=0x7f6ec0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.598+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6eb8055900 con 0x7f6ed00b30d0 2023-10-16T13:39:16.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.882+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f6ed0067d20 con 0x7f6ed00b30d0 2023-10-16T13:39:16.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.884+0000 7f6ec7fff700 1 -- 172.21.15.5:0/4272039076 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6eb8058f20 con 0x7f6ed00b30d0 2023-10-16T13:39:16.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.886+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6eb006af30 msgr2=0x7f6eb006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.886+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6eb006af30 0x7f6eb006d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009b80 tx=0x7f6ec0009210 comp rx=0 tx=0).stop 2023-10-16T13:39:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 msgr2=0x7f6ed01452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 0x7f6ed01452e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0046f0 tx=0x7f6eb80047c0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 shutdown_connections 2023-10-16T13:39:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ed00c6490 0x7f6ed0145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6eb006af30 0x7f6eb006d3f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ebc003f80 0x7f6ed00af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 --2- 172.21.15.5:0/4272039076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed00b30d0 0x7f6ed01452e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 >> 172.21.15.5:0/4272039076 conn(0x7f6ed006dac0 msgr2=0x7f6ed006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 shutdown_connections 2023-10-16T13:39:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:16.887+0000 7f6ed5c91700 1 -- 172.21.15.5:0/4272039076 wait complete. 2023-10-16T13:39:16.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.024+0000 7f3fc039a700 1 Processor -- start 2023-10-16T13:39:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.024+0000 7f3fc039a700 1 -- start start 2023-10-16T13:39:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fc039a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3fb8160fb0 0x7f3fb80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fc039a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3fb80727b0 0x7f3fb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fc039a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fc039a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb806b210 con 0x7f3fb8160fb0 2023-10-16T13:39:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fc039a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb8161390 con 0x7f3fb80727b0 2023-10-16T13:39:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fc039a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80b23f0 con 0x7f3fb806ad80 2023-10-16T13:39:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.025+0000 7f3fbe136700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3fb8160fb0 0x7f3fb80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3fb8160fb0 0x7f3fb80cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43612/0 (socket says 172.21.15.5:43612) 2023-10-16T13:39:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 -- 172.21.15.5:0/1700277255 learned_addr learned my addr 172.21.15.5:0/1700277255 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbd935700 1 --2- 172.21.15.5:0/1700277255 >> v2:172.21.15.112:3300/0 conn(0x7f3fb80727b0 0x7f3fb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe937700 1 --2- 172.21.15.5:0/1700277255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 -- 172.21.15.5:0/1700277255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 msgr2=0x7f3fb806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 --2- 172.21.15.5:0/1700277255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb806f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 -- 172.21.15.5:0/1700277255 >> v2:172.21.15.112:3300/0 conn(0x7f3fb80727b0 msgr2=0x7f3fb806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 --2- 172.21.15.5:0/1700277255 >> v2:172.21.15.112:3300/0 conn(0x7f3fb80727b0 0x7f3fb806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 -- 172.21.15.5:0/1700277255 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80b26b0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbd935700 1 --2- 172.21.15.5:0/1700277255 >> v2:172.21.15.112:3300/0 conn(0x7f3fb80727b0 0x7f3fb806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbe136700 1 --2- 172.21.15.5:0/1700277255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb80cee40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d1740 tx=0x7f3fac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666f37a1059f28db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbd134700 1 -- 172.21.15.5:0/1700277255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac005e30 con 0x7f3fb8160fb0 2023-10-16T13:39:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbd134700 1 -- 172.21.15.5:0/1700277255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac004030 con 0x7f3fb8160fb0 2023-10-16T13:39:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.026+0000 7f3fbd134700 1 -- 172.21.15.5:0/1700277255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0043e0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 -- 172.21.15.5:0/1700277255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 msgr2=0x7f3fb80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 --2- 172.21.15.5:0/1700277255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb80cee40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d1740 tx=0x7f3fac009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 -- 172.21.15.5:0/1700277255 shutdown_connections 2023-10-16T13:39:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 --2- 172.21.15.5:0/1700277255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb806f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 --2- 172.21.15.5:0/1700277255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb80cee40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 --2- 172.21.15.5:0/1700277255 >> v2:172.21.15.112:3300/0 conn(0x7f3fb80727b0 0x7f3fb806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 -- 172.21.15.5:0/1700277255 >> 172.21.15.5:0/1700277255 conn(0x7f3fb80cd270 msgr2=0x7f3fb80cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 -- 172.21.15.5:0/1700277255 shutdown_connections 2023-10-16T13:39:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.027+0000 7f3fc039a700 1 -- 172.21.15.5:0/1700277255 wait complete. 2023-10-16T13:39:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.028+0000 7f3fc039a700 1 Processor -- start 2023-10-16T13:39:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.028+0000 7f3fc039a700 1 -- start start 2023-10-16T13:39:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fc039a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fc039a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fb80727b0 0x7f3fb80af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fc039a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb8152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fc039a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80ae400 con 0x7f3fb8160fb0 2023-10-16T13:39:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fc039a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb81522e0 con 0x7f3fb80727b0 2023-10-16T13:39:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fc039a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80adad0 con 0x7f3fb806ad80 2023-10-16T13:39:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb8152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb8152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43622/0 (socket says 172.21.15.5:43622) 2023-10-16T13:39:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 -- 172.21.15.5:0/3283735394 learned_addr learned my addr 172.21.15.5:0/3283735394 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbd935700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fb80727b0 0x7f3fb80af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe136700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 -- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 msgr2=0x7f3fb8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 -- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fb80727b0 msgr2=0x7f3fb80af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fb80727b0 0x7f3fb80af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 -- 172.21.15.5:0/3283735394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac009500 con 0x7f3fb8160fb0 2023-10-16T13:39:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.029+0000 7f3fbe937700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb8152810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000ccf0 tx=0x7f3fb000a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.030+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000ad60 con 0x7f3fb8160fb0 2023-10-16T13:39:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.030+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0003a20 con 0x7f3fb8160fb0 2023-10-16T13:39:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.030+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0003db0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.030+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb80addb0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.030+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb80afad0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.031+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb8067d20 con 0x7f3fb8160fb0 2023-10-16T13:39:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.032+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3fb0003f30 con 0x7f3fb8160fb0 2023-10-16T13:39:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.032+0000 7f3faaffd700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3f9c06af00 0x7f3f9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.032+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fb0012070 con 0x7f3fb8160fb0 2023-10-16T13:39:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.032+0000 7f3fbe136700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3f9c06af00 0x7f3f9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.033+0000 7f3fbe136700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3f9c06af00 0x7f3f9c06d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d1740 tx=0x7f3fac008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.036+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fb00551b0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.238+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fb80ae540 con 0x7f3fb8160fb0 2023-10-16T13:39:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.239+0000 7f3faaffd700 1 -- 172.21.15.5:0/3283735394 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12785 (secure 0 0 0) 0x7f3fb00587d0 con 0x7f3fb8160fb0 2023-10-16T13:39:17.242 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:17.242 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:13.785410+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3f9c06af00 msgr2=0x7f3f9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3f9c06af00 0x7f3f9c06d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d1740 tx=0x7f3fac008070 comp rx=0 tx=0).stop 2023-10-16T13:39:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 msgr2=0x7f3fb8152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb8152810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000ccf0 tx=0x7f3fb000a290 comp rx=0 tx=0).stop 2023-10-16T13:39:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 shutdown_connections 2023-10-16T13:39:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb8160fb0 0x7f3fb8152810 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3f9c06af00 0x7f3f9c06d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3fb806ad80 0x7f3fb8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 --2- 172.21.15.5:0/3283735394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fb80727b0 0x7f3fb80af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 >> 172.21.15.5:0/3283735394 conn(0x7f3fb80cd270 msgr2=0x7f3fb80ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 shutdown_connections 2023-10-16T13:39:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.241+0000 7f3fc039a700 1 -- 172.21.15.5:0/3283735394 wait complete. 2023-10-16T13:39:17.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:17.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 Processor -- start 2023-10-16T13:39:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 -- start start 2023-10-16T13:39:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70c15e2f0 0x7fd70c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd70c06a840 0x7fd70c06ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c06b1a0 con 0x7fd70c0cd950 2023-10-16T13:39:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c1619a0 con 0x7fd70c15e2f0 2023-10-16T13:39:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.382+0000 7fd711ecf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0b2d60 con 0x7fd70c06a840 2023-10-16T13:39:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70c15e2f0 0x7fd70c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd70c0cd950 0x7fd70c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53630/0 (socket says 172.21.15.5:53630) 2023-10-16T13:39:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70b7fe700 1 -- 172.21.15.5:0/631817074 learned_addr learned my addr 172.21.15.5:0/631817074 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70bfff700 1 --2- 172.21.15.5:0/631817074 >> v2:172.21.15.112:3300/0 conn(0x7fd70c06a840 0x7fd70c06ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70affd700 1 -- 172.21.15.5:0/631817074 >> v2:172.21.15.112:3300/0 conn(0x7fd70c06a840 msgr2=0x7fd70c06ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70affd700 1 --2- 172.21.15.5:0/631817074 >> v2:172.21.15.112:3300/0 conn(0x7fd70c06a840 0x7fd70c06ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70affd700 1 -- 172.21.15.5:0/631817074 >> v1:172.21.15.5:6789/0 conn(0x7fd70c0cd950 legacy=0x7fd70c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70affd700 1 -- 172.21.15.5:0/631817074 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0cdd30 con 0x7fd70c15e2f0 2023-10-16T13:39:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70a7fc700 1 -- 172.21.15.5:0/631817074 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527651366 0 0) 0x7fd70c06b1a0 con 0x7fd70c0cd950 2023-10-16T13:39:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70bfff700 1 --2- 172.21.15.5:0/631817074 >> v2:172.21.15.112:3300/0 conn(0x7fd70c06a840 0x7fd70c06ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70affd700 1 --2- 172.21.15.5:0/631817074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0cede0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0afed0 tx=0x7fd700009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2341f8ac7352ced4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70a7fc700 1 -- 172.21.15.5:0/631817074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700005e30 con 0x7fd70c15e2f0 2023-10-16T13:39:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70a7fc700 1 -- 172.21.15.5:0/631817074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700006030 con 0x7fd70c15e2f0 2023-10-16T13:39:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.383+0000 7fd70a7fc700 1 -- 172.21.15.5:0/631817074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000063c0 con 0x7fd70c15e2f0 2023-10-16T13:39:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 -- 172.21.15.5:0/631817074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c15e2f0 msgr2=0x7fd70c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 --2- 172.21.15.5:0/631817074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0cede0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0afed0 tx=0x7fd700009b00 comp rx=0 tx=0).stop 2023-10-16T13:39:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 -- 172.21.15.5:0/631817074 shutdown_connections 2023-10-16T13:39:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 --2- 172.21.15.5:0/631817074 >> v2:172.21.15.112:3300/0 conn(0x7fd70c06a840 0x7fd70c06ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 --2- 172.21.15.5:0/631817074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0cede0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 -- 172.21.15.5:0/631817074 >> 172.21.15.5:0/631817074 conn(0x7fd70c06dae0 msgr2=0x7fd70c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 -- 172.21.15.5:0/631817074 shutdown_connections 2023-10-16T13:39:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.384+0000 7fd711ecf700 1 -- 172.21.15.5:0/631817074 wait complete. 2023-10-16T13:39:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.385+0000 7fd711ecf700 1 Processor -- start 2023-10-16T13:39:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.385+0000 7fd711ecf700 1 -- start start 2023-10-16T13:39:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd711ecf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 0x7fd70c15be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd711ecf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd70c0cd950 0x7fd70c160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd711ecf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd711ecf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b6040 con 0x7fd70c06a840 2023-10-16T13:39:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd711ecf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c6dc0 con 0x7fd70c15e2f0 2023-10-16T13:39:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd711ecf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b5a80 con 0x7fd70c0cd950 2023-10-16T13:39:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 0x7fd70c15be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 0x7fd70c15be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43632/0 (socket says 172.21.15.5:43632) 2023-10-16T13:39:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 -- 172.21.15.5:0/4177336665 learned_addr learned my addr 172.21.15.5:0/4177336665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70affd700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd70c0cd950 0x7fd70c160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70bfff700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 -- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd70c0cd950 msgr2=0x7fd70c160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd70c0cd950 0x7fd70c160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 -- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd70c15e2f0 msgr2=0x7fd70c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70b7fe700 1 -- 172.21.15.5:0/4177336665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009430 con 0x7fd70c06a840 2023-10-16T13:39:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70affd700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd70c0cd950 0x7fd70c160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.386+0000 7fd70bfff700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.387+0000 7fd70b7fe700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 0x7fd70c15be10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0011e0 tx=0x7fd6fc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.387+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc004c80 con 0x7fd70c06a840 2023-10-16T13:39:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.387+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc004e00 con 0x7fd70c06a840 2023-10-16T13:39:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.387+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc007310 con 0x7fd70c06a840 2023-10-16T13:39:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.387+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0b5d60 con 0x7fd70c06a840 2023-10-16T13:39:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.387+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0c61b0 con 0x7fd70c06a840 2023-10-16T13:39:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.388+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c0c68b0 con 0x7fd70c06a840 2023-10-16T13:39:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.388+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd6fc007470 con 0x7fd70c06a840 2023-10-16T13:39:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.389+0000 7fd6f3fff700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6f806af00 0x7fd6f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.389+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6fc089160 con 0x7fd70c06a840 2023-10-16T13:39:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.389+0000 7fd70affd700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6f806af00 0x7fd6f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.389+0000 7fd70affd700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6f806af00 0x7fd6f806d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd700013040 tx=0x7fd700008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.394+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd70c0c68b0 con 0x7fd70c06a840 2023-10-16T13:39:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.594+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd70c0c68b0 con 0x7fd70c06a840 2023-10-16T13:39:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.595+0000 7fd6f3fff700 1 -- 172.21.15.5:0/4177336665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd70c0c68b0 con 0x7fd70c06a840 2023-10-16T13:39:17.598 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6f806af00 msgr2=0x7fd6f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6f806af00 0x7fd6f806d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd700013040 tx=0x7fd700008070 comp rx=0 tx=0).stop 2023-10-16T13:39:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 msgr2=0x7fd70c15be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 0x7fd70c15be10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0011e0 tx=0x7fd6fc00cae0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 shutdown_connections 2023-10-16T13:39:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd70c15e2f0 0x7fd70c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70c06a840 0x7fd70c15be10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6f806af00 0x7fd6f806d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 --2- 172.21.15.5:0/4177336665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd70c0cd950 0x7fd70c160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 >> 172.21.15.5:0/4177336665 conn(0x7fd70c06dae0 msgr2=0x7fd70c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 shutdown_connections 2023-10-16T13:39:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.597+0000 7fd711ecf700 1 -- 172.21.15.5:0/4177336665 wait complete. 2023-10-16T13:39:17.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:39:17.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.734+0000 7f6ff50be700 1 Processor -- start 2023-10-16T13:39:17.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.734+0000 7f6ff50be700 1 -- start start 2023-10-16T13:39:17.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6ff50be700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ff00cf8a0 0x7f6ff00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6ff50be700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff015ee90 con 0x7f6ff015eab0 2023-10-16T13:39:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6ff50be700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff0158370 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6ff50be700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff00d23b0 con 0x7f6ff00cf8a0 2023-10-16T13:39:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6feed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ff015eab0 0x7f6ff00cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53644/0 (socket says 172.21.15.5:53644) 2023-10-16T13:39:17.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6feed9d700 1 -- 172.21.15.5:0/33412130 learned_addr learned my addr 172.21.15.5:0/33412130 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:17.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fee59c700 1 --2- 172.21.15.5:0/33412130 >> v2:172.21.15.112:3300/0 conn(0x7f6ff00cf8a0 0x7f6ff00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162501341 0 0) 0x7f6ff015ee90 con 0x7f6ff015eab0 2023-10-16T13:39:17.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80035b0 con 0x7f6ff015eab0 2023-10-16T13:39:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310355956 0 0) 0x7f6ff0158370 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff015ee90 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fee59c700 1 -- 172.21.15.5:0/33412130 >> v1:172.21.15.112:6789/0 conn(0x7f6ff00d1bc0 legacy=0x7f6ff00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fee59c700 1 -- 172.21.15.5:0/33412130 >> v1:172.21.15.5:6789/0 conn(0x7f6ff015eab0 legacy=0x7f6ff00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fee59c700 1 -- 172.21.15.5:0/33412130 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00cda20 con 0x7f6ff00cf8a0 2023-10-16T13:39:17.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.735+0000 7f6fee59c700 1 --2- 172.21.15.5:0/33412130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff00d1680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009840 tx=0x7f6fe4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c7d8b6a9aa383d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011830 con 0x7f6ff00cf8a0 2023-10-16T13:39:17.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4011990 con 0x7f6ff00cf8a0 2023-10-16T13:39:17.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6fedd9b700 1 -- 172.21.15.5:0/33412130 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011d20 con 0x7f6ff00cf8a0 2023-10-16T13:39:17.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 -- 172.21.15.5:0/33412130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 msgr2=0x7f6ff00d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 --2- 172.21.15.5:0/33412130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff00d1680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009840 tx=0x7f6fe4009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:17.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 -- 172.21.15.5:0/33412130 shutdown_connections 2023-10-16T13:39:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 --2- 172.21.15.5:0/33412130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff00d1680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 -- 172.21.15.5:0/33412130 >> 172.21.15.5:0/33412130 conn(0x7f6ff00665a0 msgr2=0x7f6ff0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 -- 172.21.15.5:0/33412130 shutdown_connections 2023-10-16T13:39:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.736+0000 7f6ff50be700 1 -- 172.21.15.5:0/33412130 wait complete. 2023-10-16T13:39:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 Processor -- start 2023-10-16T13:39:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 -- start start 2023-10-16T13:39:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff0160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 0x7f6ff0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ff015eab0 0x7f6ff01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff015f5c0 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff015f8a0 con 0x7f6ff00cf8a0 2023-10-16T13:39:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.738+0000 7f6ff50be700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff015fb80 con 0x7f6ff015eab0 2023-10-16T13:39:17.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 0x7f6ff0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 0x7f6ff0156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43648/0 (socket says 172.21.15.5:43648) 2023-10-16T13:39:17.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 -- 172.21.15.5:0/3694188140 learned_addr learned my addr 172.21.15.5:0/3694188140 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:17.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6feed9d700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff0160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fef59e700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ff015eab0 0x7f6ff01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 -- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ff015eab0 msgr2=0x7f6ff01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ff015eab0 0x7f6ff01555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 -- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 msgr2=0x7f6ff0160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff0160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 -- 172.21.15.5:0/3694188140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40094a0 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fee59c700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 0x7f6ff0156760 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40090b0 tx=0x7f6fe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe401a860 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe401a9c0 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe401ad30 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff015fe60 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.739+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff0160f50 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.740+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00b3d70 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.741+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6fe4022070 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.741+0000 7f6fd77fe700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6fdc06af00 0x7f6fdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.741+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fe4089f40 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.741+0000 7f6feed9d700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6fdc06af00 0x7f6fdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.742+0000 7f6feed9d700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6fdc06af00 0x7f6fdc06d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0000f60 tx=0x7f6fe0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.746+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6fe4055480 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.950+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6ff01f3760 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.951+0000 7f6fd77fe700 1 -- 172.21.15.5:0/3694188140 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6fe4029090 con 0x7f6ff00d1bc0 2023-10-16T13:39:17.954 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:17.954 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:39:17.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:17.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:39:17.955 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:39:17.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:17.955 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:39:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6fdc06af00 msgr2=0x7f6fdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6fdc06af00 0x7f6fdc06d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0000f60 tx=0x7f6fe0009040 comp rx=0 tx=0).stop 2023-10-16T13:39:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 msgr2=0x7f6ff0156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 0x7f6ff0156760 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40090b0 tx=0x7f6fe4004750 comp rx=0 tx=0).stop 2023-10-16T13:39:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 shutdown_connections 2023-10-16T13:39:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6fdc06af00 0x7f6fdc06d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ff015eab0 0x7f6ff01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ff00cf8a0 0x7f6ff0160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 --2- 172.21.15.5:0/3694188140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1bc0 0x7f6ff0156760 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 >> 172.21.15.5:0/3694188140 conn(0x7f6ff00665a0 msgr2=0x7f6ff00cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 shutdown_connections 2023-10-16T13:39:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:17.953+0000 7f6ff50be700 1 -- 172.21.15.5:0/3694188140 wait complete. 2023-10-16T13:39:17.967 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:39:17.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:39:18.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.094+0000 7fc790894700 1 Processor -- start 2023-10-16T13:39:18.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.094+0000 7fc790894700 1 -- start start 2023-10-16T13:39:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.095+0000 7fc790894700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.095+0000 7fc790894700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc78c0727e0 0x7fc78c0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.095+0000 7fc790894700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0b2e40 con 0x7fc78c06da30 2023-10-16T13:39:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.095+0000 7fc790894700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c15e7c0 con 0x7fc78c0727e0 2023-10-16T13:39:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.095+0000 7fc790894700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0b2880 con 0x7fc78c151680 2023-10-16T13:39:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc789d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc78c0727e0 0x7fc78c0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78ad9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc78c06da30 0x7fc78c15acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:44638/0 (socket says 172.21.15.5:44638) 2023-10-16T13:39:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78ad9d700 1 -- 172.21.15.5:0/3814470950 learned_addr learned my addr 172.21.15.5:0/3814470950 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78959a700 1 -- 172.21.15.5:0/3814470950 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786788667 0 0) 0x7fc784001490 con 0x7fc78c06da30 2023-10-16T13:39:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78959a700 1 -- 172.21.15.5:0/3814470950 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7740035b0 con 0x7fc78c06da30 2023-10-16T13:39:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78a59c700 1 -- 172.21.15.5:0/3814470950 >> v2:172.21.15.112:3300/0 conn(0x7fc78c0727e0 msgr2=0x7fc78c0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78a59c700 1 --2- 172.21.15.5:0/3814470950 >> v2:172.21.15.112:3300/0 conn(0x7fc78c0727e0 0x7fc78c0b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78a59c700 1 -- 172.21.15.5:0/3814470950 >> v1:172.21.15.112:6789/0 conn(0x7fc78c06da30 legacy=0x7fc78c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78a59c700 1 -- 172.21.15.5:0/3814470950 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0b2b60 con 0x7fc78c151680 2023-10-16T13:39:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc789d9b700 1 --2- 172.21.15.5:0/3814470950 >> v2:172.21.15.112:3300/0 conn(0x7fc78c0727e0 0x7fc78c0b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78a59c700 1 --2- 172.21.15.5:0/3814470950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c15ec50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc780009840 tx=0x7fc780009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=512c3d5f1a32b452 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78959a700 1 -- 172.21.15.5:0/3814470950 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780011830 con 0x7fc78c151680 2023-10-16T13:39:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78959a700 1 -- 172.21.15.5:0/3814470950 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780011990 con 0x7fc78c151680 2023-10-16T13:39:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.096+0000 7fc78959a700 1 -- 172.21.15.5:0/3814470950 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780011d20 con 0x7fc78c151680 2023-10-16T13:39:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 -- 172.21.15.5:0/3814470950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 msgr2=0x7fc78c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 --2- 172.21.15.5:0/3814470950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c15ec50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc780009840 tx=0x7fc780009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 -- 172.21.15.5:0/3814470950 shutdown_connections 2023-10-16T13:39:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 --2- 172.21.15.5:0/3814470950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c15ec50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 --2- 172.21.15.5:0/3814470950 >> v2:172.21.15.112:3300/0 conn(0x7fc78c0727e0 0x7fc78c0b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 -- 172.21.15.5:0/3814470950 >> 172.21.15.5:0/3814470950 conn(0x7fc78c06bd70 msgr2=0x7fc78c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 -- 172.21.15.5:0/3814470950 shutdown_connections 2023-10-16T13:39:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.097+0000 7fc790894700 1 -- 172.21.15.5:0/3814470950 wait complete. 2023-10-16T13:39:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.098+0000 7fc790894700 1 Processor -- start 2023-10-16T13:39:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.098+0000 7fc790894700 1 -- start start 2023-10-16T13:39:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc790894700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc78c06da30 0x7fc78c0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc790894700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 0x7fc78c0adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc790894700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc790894700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cf480 con 0x7fc78c0727e0 2023-10-16T13:39:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc790894700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cf720 con 0x7fc78c06da30 2023-10-16T13:39:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc790894700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cfa00 con 0x7fc78c151680 2023-10-16T13:39:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc789d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 0x7fc78c0adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc789d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 0x7fc78c0adf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43662/0 (socket says 172.21.15.5:43662) 2023-10-16T13:39:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc789d9b700 1 -- 172.21.15.5:0/2876599246 learned_addr learned my addr 172.21.15.5:0/2876599246 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc78ad9d700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.099+0000 7fc78a59c700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc78c06da30 0x7fc78c0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc789d9b700 1 -- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 msgr2=0x7fc78c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc789d9b700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc789d9b700 1 -- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc78c06da30 msgr2=0x7fc78c0ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc789d9b700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc78c06da30 0x7fc78c0ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc789d9b700 1 -- 172.21.15.5:0/2876599246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0094a0 con 0x7fc78c0727e0 2023-10-16T13:39:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc789d9b700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 0x7fc78c0adf70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00ebe0 tx=0x7fc77c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00c850 con 0x7fc78c0727e0 2023-10-16T13:39:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00c9b0 con 0x7fc78c0727e0 2023-10-16T13:39:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00cd40 con 0x7fc78c0727e0 2023-10-16T13:39:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800094a0 con 0x7fc78c0727e0 2023-10-16T13:39:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.100+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c0cffc0 con 0x7fc78c0727e0 2023-10-16T13:39:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.101+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c072e10 con 0x7fc78c0727e0 2023-10-16T13:39:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.101+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc77c013470 con 0x7fc78c0727e0 2023-10-16T13:39:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.102+0000 7fc77affd700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc76c06af00 0x7fc76c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.102+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc77c089270 con 0x7fc78c0727e0 2023-10-16T13:39:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.102+0000 7fc78a59c700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc76c06af00 0x7fc76c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.102+0000 7fc78a59c700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc76c06af00 0x7fc76c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc780000c00 tx=0x7fc78001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.106+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc77c054700 con 0x7fc78c0727e0 2023-10-16T13:39:18.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.305+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc78c067d20 con 0x7fc78c0727e0 2023-10-16T13:39:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.887+0000 7fc77affd700 1 -- 172.21.15.5:0/2876599246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc77c00cea0 con 0x7fc78c0727e0 2023-10-16T13:39:18.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.890+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc76c06af00 msgr2=0x7fc76c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc76c06af00 0x7fc76c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc780000c00 tx=0x7fc78001c040 comp rx=0 tx=0).stop 2023-10-16T13:39:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 msgr2=0x7fc78c0adf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 0x7fc78c0adf70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00ebe0 tx=0x7fc77c00eef0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 shutdown_connections 2023-10-16T13:39:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc76c06af00 0x7fc76c06d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc78c151680 0x7fc78c0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc78c06da30 0x7fc78c0ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 --2- 172.21.15.5:0/2876599246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c0727e0 0x7fc78c0adf70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 >> 172.21.15.5:0/2876599246 conn(0x7fc78c06bd70 msgr2=0x7fc78c15be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:18.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 shutdown_connections 2023-10-16T13:39:18.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:18.891+0000 7fc790894700 1 -- 172.21.15.5:0/2876599246 wait complete. 2023-10-16T13:39:18.896 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:39:18.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:39:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.045+0000 7fe341881700 1 Processor -- start 2023-10-16T13:39:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe341881700 1 -- start start 2023-10-16T13:39:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe341881700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c0ce6b0 0x7fe33c0d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe341881700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe33c0d0650 0x7fe33c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe341881700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0cf8c0 con 0x7fe33c15dc90 2023-10-16T13:39:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe341881700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c0d0ae0 con 0x7fe33c0d0650 2023-10-16T13:39:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe341881700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0cecb0 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe33b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe33c0d0650 0x7fe33c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe33b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe33c0d0650 0x7fe33c0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43672/0 (socket says 172.21.15.5:43672) 2023-10-16T13:39:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe33affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe33c15dc90 0x7fe33c0d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53672/0 (socket says 172.21.15.5:53672) 2023-10-16T13:39:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.046+0000 7fe33b7fe700 1 -- 172.21.15.5:0/436901353 learned_addr learned my addr 172.21.15.5:0/436901353 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:19.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33a7fc700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c0ce6b0 0x7fe33c0d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33b7fe700 1 -- 172.21.15.5:0/436901353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c0ce6b0 msgr2=0x7fe33c0d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33b7fe700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c0ce6b0 0x7fe33c0d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33b7fe700 1 -- 172.21.15.5:0/436901353 >> v1:172.21.15.5:6789/0 conn(0x7fe33c15dc90 legacy=0x7fe33c0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe339ffb700 1 -- 172.21.15.5:0/436901353 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509471818 0 0) 0x7fe33c0cf8c0 con 0x7fe33c15dc90 2023-10-16T13:39:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33b7fe700 1 -- 172.21.15.5:0/436901353 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0cef90 con 0x7fe33c0d0650 2023-10-16T13:39:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33a7fc700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c0ce6b0 0x7fe33c0d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe33b7fe700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0d0650 0x7fe33c0b2d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe334009e50 tx=0x7fe33400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55ffbdd8ba3edc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe339ffb700 1 -- 172.21.15.5:0/436901353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400e070 con 0x7fe33c0d0650 2023-10-16T13:39:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe339ffb700 1 -- 172.21.15.5:0/436901353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400b9c0 con 0x7fe33c0d0650 2023-10-16T13:39:19.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.047+0000 7fe339ffb700 1 -- 172.21.15.5:0/436901353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400bd70 con 0x7fe33c0d0650 2023-10-16T13:39:19.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 -- 172.21.15.5:0/436901353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0d0650 msgr2=0x7fe33c0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:19.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0d0650 0x7fe33c0b2d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe334009e50 tx=0x7fe33400b330 comp rx=0 tx=0).stop 2023-10-16T13:39:19.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 -- 172.21.15.5:0/436901353 shutdown_connections 2023-10-16T13:39:19.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0d0650 0x7fe33c0b2d80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 --2- 172.21.15.5:0/436901353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c0ce6b0 0x7fe33c0d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 -- 172.21.15.5:0/436901353 >> 172.21.15.5:0/436901353 conn(0x7fe33c0d37e0 msgr2=0x7fe33c0d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:19.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 -- 172.21.15.5:0/436901353 shutdown_connections 2023-10-16T13:39:19.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.048+0000 7fe341881700 1 -- 172.21.15.5:0/436901353 wait complete. 2023-10-16T13:39:19.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.049+0000 7fe341881700 1 Processor -- start 2023-10-16T13:39:19.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.049+0000 7fe341881700 1 -- start start 2023-10-16T13:39:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe341881700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 0x7fe33c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe341881700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe33c0d0650 0x7fe33c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe341881700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c15dc90 0x7fe33c1f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe341881700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c15f8c0 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe341881700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1513b0 con 0x7fe33c0d0650 2023-10-16T13:39:19.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe341881700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1f6c30 con 0x7fe33c15dc90 2023-10-16T13:39:19.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 0x7fe33c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:19.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 0x7fe33c150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43674/0 (socket says 172.21.15.5:43674) 2023-10-16T13:39:19.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 -- 172.21.15.5:0/1767345417 learned_addr learned my addr 172.21.15.5:0/1767345417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:19.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33a7fc700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe33c0d0650 0x7fe33c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:19.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33b7fe700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c15dc90 0x7fe33c1f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:19.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 -- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c15dc90 msgr2=0x7fe33c1f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:19.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c15dc90 0x7fe33c1f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 -- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe33c0d0650 msgr2=0x7fe33c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe33c0d0650 0x7fe33c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 -- 172.21.15.5:0/1767345417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334009b30 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.050+0000 7fe33affd700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 0x7fe33c150e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c520 tx=0x7fe33000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.051+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3300074e0 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.051+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330007640 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.051+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c1f6f10 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.051+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330005a50 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.051+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c15f1d0 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.052+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c15fa00 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.052+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe330005bb0 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.053+0000 7fe323fff700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe32806af00 0x7fe32806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:19.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.053+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe330088950 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.053+0000 7fe33a7fc700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe32806af00 0x7fe32806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:19.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.053+0000 7fe33a7fc700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe32806af00 0x7fe32806d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0b4b20 tx=0x7fe32c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:19.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.058+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe33c15fa00 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.257+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe33c04ebb0 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.892+0000 7fe323fff700 1 -- 172.21.15.5:0/1767345417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe330017020 con 0x7fe33c0ce6b0 2023-10-16T13:39:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe32806af00 msgr2=0x7fe32806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe32806af00 0x7fe32806d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0b4b20 tx=0x7fe32c008040 comp rx=0 tx=0).stop 2023-10-16T13:39:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 msgr2=0x7fe33c150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 0x7fe33c150e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c520 tx=0x7fe33000c8e0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 shutdown_connections 2023-10-16T13:39:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe32806af00 0x7fe32806d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe33c15dc90 0x7fe33c1f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe33c0ce6b0 0x7fe33c150e70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 --2- 172.21.15.5:0/1767345417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe33c0d0650 0x7fe33c0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.895+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 >> 172.21.15.5:0/1767345417 conn(0x7fe33c0d37e0 msgr2=0x7fe33c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.896+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 shutdown_connections 2023-10-16T13:39:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:19.896+0000 7fe341881700 1 -- 172.21.15.5:0/1767345417 wait complete. 2023-10-16T13:39:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:39:19.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:39:20.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.052+0000 7fc3fc9cc700 1 Processor -- start 2023-10-16T13:39:20.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.052+0000 7fc3fc9cc700 1 -- start start 2023-10-16T13:39:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3fc9cc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f815ab10 0x7fc3f815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3fc9cc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc3f80b1f50 0x7fc3f80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3fc9cc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3f80b23d0 0x7fc3f80cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3fc9cc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f815e7a0 con 0x7fc3f80b23d0 2023-10-16T13:39:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3fc9cc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f815f730 con 0x7fc3f80b1f50 2023-10-16T13:39:20.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3fc9cc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80b29a0 con 0x7fc3f815ab10 2023-10-16T13:39:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3f6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3f80b23d0 0x7fc3f80cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3f6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3f80b23d0 0x7fc3f80cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43686/0 (socket says 172.21.15.5:43686) 2023-10-16T13:39:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3f6d9d700 1 -- 172.21.15.5:0/1379475357 learned_addr learned my addr 172.21.15.5:0/1379475357 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3f659c700 1 --2- 172.21.15.5:0/1379475357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f815ab10 0x7fc3f815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.053+0000 7fc3f5d9b700 1 --2- 172.21.15.5:0/1379475357 >> v2:172.21.15.112:3300/0 conn(0x7fc3f80b1f50 0x7fc3f80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f6d9d700 1 -- 172.21.15.5:0/1379475357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f815ab10 msgr2=0x7fc3f815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:20.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f6d9d700 1 --2- 172.21.15.5:0/1379475357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f815ab10 0x7fc3f815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f6d9d700 1 -- 172.21.15.5:0/1379475357 >> v2:172.21.15.112:3300/0 conn(0x7fc3f80b1f50 msgr2=0x7fc3f80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:20.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f6d9d700 1 --2- 172.21.15.5:0/1379475357 >> v2:172.21.15.112:3300/0 conn(0x7fc3f80b1f50 0x7fc3f80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f6d9d700 1 -- 172.21.15.5:0/1379475357 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80b2c80 con 0x7fc3f80b23d0 2023-10-16T13:39:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f6d9d700 1 --2- 172.21.15.5:0/1379475357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b23d0 0x7fc3f80cfc60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80d1560 tx=0x7fc3f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba501500d610e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f559a700 1 -- 172.21.15.5:0/1379475357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000e070 con 0x7fc3f80b23d0 2023-10-16T13:39:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f559a700 1 -- 172.21.15.5:0/1379475357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f000b910 con 0x7fc3f80b23d0 2023-10-16T13:39:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3f559a700 1 -- 172.21.15.5:0/1379475357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000bcc0 con 0x7fc3f80b23d0 2023-10-16T13:39:20.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/1379475357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b23d0 msgr2=0x7fc3f80cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.054+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/1379475357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b23d0 0x7fc3f80cfc60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80d1560 tx=0x7fc3f000b330 comp rx=0 tx=0).stop 2023-10-16T13:39:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/1379475357 shutdown_connections 2023-10-16T13:39:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/1379475357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b23d0 0x7fc3f80cfc60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/1379475357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f815ab10 0x7fc3f815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/1379475357 >> v2:172.21.15.112:3300/0 conn(0x7fc3f80b1f50 0x7fc3f80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/1379475357 >> 172.21.15.5:0/1379475357 conn(0x7fc3f806dae0 msgr2=0x7fc3f806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/1379475357 shutdown_connections 2023-10-16T13:39:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.055+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/1379475357 wait complete. 2023-10-16T13:39:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.056+0000 7fc3fc9cc700 1 Processor -- start 2023-10-16T13:39:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.056+0000 7fc3fc9cc700 1 -- start start 2023-10-16T13:39:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3fc9cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 0x7fc3f80ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3fc9cc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f80b23d0 0x7fc3f80cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3fc9cc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f815ab10 0x7fc3f81f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3fc9cc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80aef10 con 0x7fc3f80b1f50 2023-10-16T13:39:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3fc9cc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80cd570 con 0x7fc3f815ab10 2023-10-16T13:39:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3fc9cc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f81f7bd0 con 0x7fc3f80b23d0 2023-10-16T13:39:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 0x7fc3f80ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 0x7fc3f80ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43688/0 (socket says 172.21.15.5:43688) 2023-10-16T13:39:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 -- 172.21.15.5:0/16361628 learned_addr learned my addr 172.21.15.5:0/16361628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f6d9d700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f815ab10 0x7fc3f81f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f5d9b700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f80b23d0 0x7fc3f80cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 -- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f80b23d0 msgr2=0x7fc3f80cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f80b23d0 0x7fc3f80cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 -- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f815ab10 msgr2=0x7fc3f81f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f815ab10 0x7fc3f81f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 -- 172.21.15.5:0/16361628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0009b30 con 0x7fc3f80b1f50 2023-10-16T13:39:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.057+0000 7fc3f659c700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 0x7fc3f80ae2c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00e870 tx=0x7fc3ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.058+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec009590 con 0x7fc3f80b1f50 2023-10-16T13:39:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.058+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec013680 con 0x7fc3f80b1f50 2023-10-16T13:39:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.058+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f81f6c40 con 0x7fc3f80b1f50 2023-10-16T13:39:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.058+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0139f0 con 0x7fc3f80b1f50 2023-10-16T13:39:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.058+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f81f6e90 con 0x7fc3f80b1f50 2023-10-16T13:39:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.059+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f81f74e0 con 0x7fc3f80b1f50 2023-10-16T13:39:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.059+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3ec013b50 con 0x7fc3f80b1f50 2023-10-16T13:39:20.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.060+0000 7fc3e6ffd700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3d806af00 0x7fc3d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:20.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.060+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc3ec089320 con 0x7fc3f80b1f50 2023-10-16T13:39:20.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.060+0000 7fc3f5d9b700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3d806af00 0x7fc3d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:20.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.060+0000 7fc3f5d9b700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3d806af00 0x7fc3d806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80b5f00 tx=0x7fc3e80091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:20.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.065+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3ec054420 con 0x7fc3f80b1f50 2023-10-16T13:39:20.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.311+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc3f8067d20 con 0x7fc3f80b1f50 2023-10-16T13:39:20.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.920+0000 7fc3e6ffd700 1 -- 172.21.15.5:0/16361628 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc3ec057a40 con 0x7fc3f80b1f50 2023-10-16T13:39:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3d806af00 msgr2=0x7fc3d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3d806af00 0x7fc3d806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80b5f00 tx=0x7fc3e80091c0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 msgr2=0x7fc3f80ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:20.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 0x7fc3f80ae2c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00e870 tx=0x7fc3ec00eb80 comp rx=0 tx=0).stop 2023-10-16T13:39:20.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 shutdown_connections 2023-10-16T13:39:20.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f815ab10 0x7fc3f81f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f80b1f50 0x7fc3f80ae2c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3d806af00 0x7fc3d806d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 --2- 172.21.15.5:0/16361628 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3f80b23d0 0x7fc3f80cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:20.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.931+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 >> 172.21.15.5:0/16361628 conn(0x7fc3f806dae0 msgr2=0x7fc3f806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:20.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.932+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 shutdown_connections 2023-10-16T13:39:20.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:20.932+0000 7fc3fc9cc700 1 -- 172.21.15.5:0/16361628 wait complete. 2023-10-16T13:39:20.937 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 4 and data pool 5 2023-10-16T13:39:20.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.074+0000 7fa3761ec700 1 Processor -- start 2023-10-16T13:39:21.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.074+0000 7fa3761ec700 1 -- start start 2023-10-16T13:39:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.075+0000 7fa3761ec700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa37015eab0 0x7fa3700cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.075+0000 7fa3761ec700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37015ee90 con 0x7fa3700d1d90 2023-10-16T13:39:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.075+0000 7fa3761ec700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa370158370 con 0x7fa3700cf6d0 2023-10-16T13:39:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.075+0000 7fa3761ec700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700cfb50 con 0x7fa37015eab0 2023-10-16T13:39:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.075+0000 7fa36ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa3700d1d90 0x7fa3700cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53716/0 (socket says 172.21.15.5:53716) 2023-10-16T13:39:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.075+0000 7fa36ffff700 1 -- 172.21.15.5:0/1802796123 learned_addr learned my addr 172.21.15.5:0/1802796123 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36f7fe700 1 --2- 172.21.15.5:0/1802796123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa37015eab0 0x7fa3700cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458770662 0 0) 0x7fa37015ee90 con 0x7fa3700d1d90 2023-10-16T13:39:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3580035b0 con 0x7fa3700d1d90 2023-10-16T13:39:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180456879 0 0) 0x7fa370158370 con 0x7fa3700cf6d0 2023-10-16T13:39:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa37015ee90 con 0x7fa3700cf6d0 2023-10-16T13:39:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36f7fe700 1 -- 172.21.15.5:0/1802796123 >> v1:172.21.15.112:6789/0 conn(0x7fa3700cf6d0 legacy=0x7fa3700d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36f7fe700 1 -- 172.21.15.5:0/1802796123 >> v1:172.21.15.5:6789/0 conn(0x7fa3700d1d90 legacy=0x7fa3700cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36f7fe700 1 -- 172.21.15.5:0/1802796123 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700d23b0 con 0x7fa37015eab0 2023-10-16T13:39:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36f7fe700 1 --2- 172.21.15.5:0/1802796123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa37015eab0 0x7fa3700cf190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa360009870 tx=0x7fa360009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c67e257bf07210 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011830 con 0x7fa37015eab0 2023-10-16T13:39:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360011990 con 0x7fa37015eab0 2023-10-16T13:39:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.076+0000 7fa36e7fc700 1 -- 172.21.15.5:0/1802796123 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011d20 con 0x7fa37015eab0 2023-10-16T13:39:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 -- 172.21.15.5:0/1802796123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa37015eab0 msgr2=0x7fa3700cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1802796123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa37015eab0 0x7fa3700cf190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa360009870 tx=0x7fa360009b80 comp rx=0 tx=0).stop 2023-10-16T13:39:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 -- 172.21.15.5:0/1802796123 shutdown_connections 2023-10-16T13:39:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1802796123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa37015eab0 0x7fa3700cf190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 -- 172.21.15.5:0/1802796123 >> 172.21.15.5:0/1802796123 conn(0x7fa3700665a0 msgr2=0x7fa370066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 -- 172.21.15.5:0/1802796123 shutdown_connections 2023-10-16T13:39:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.077+0000 7fa3761ec700 1 -- 172.21.15.5:0/1802796123 wait complete. 2023-10-16T13:39:21.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.078+0000 7fa3761ec700 1 Processor -- start 2023-10-16T13:39:21.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.078+0000 7fa3761ec700 1 -- start start 2023-10-16T13:39:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa3761ec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3700cf6d0 0x7fa3700c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa3761ec700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3700d1d90 0x7fa3701474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa3761ec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 0x7fa370146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa3761ec700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370146380 con 0x7fa37015eab0 2023-10-16T13:39:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa3761ec700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370145770 con 0x7fa3700cf6d0 2023-10-16T13:39:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa3761ec700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa370145a50 con 0x7fa3700d1d90 2023-10-16T13:39:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa36ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 0x7fa370146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa36ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 0x7fa370146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43716/0 (socket says 172.21.15.5:43716) 2023-10-16T13:39:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa36ffff700 1 -- 172.21.15.5:0/1702733869 learned_addr learned my addr 172.21.15.5:0/1702733869 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa36f7fe700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3700cf6d0 0x7fa3700c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.079+0000 7fa36effd700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3700d1d90 0x7fa3701474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa36ffff700 1 -- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3700d1d90 msgr2=0x7fa3701474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa36ffff700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3700d1d90 0x7fa3701474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa36ffff700 1 -- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3700cf6d0 msgr2=0x7fa3700c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa36ffff700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3700cf6d0 0x7fa3700c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa36ffff700 1 -- 172.21.15.5:0/1702733869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600094a0 con 0x7fa37015eab0 2023-10-16T13:39:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa36ffff700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 0x7fa370146810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa36800cba0 tx=0x7fa36800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800ab20 con 0x7fa37015eab0 2023-10-16T13:39:21.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36800ac80 con 0x7fa37015eab0 2023-10-16T13:39:21.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa370145d30 con 0x7fa37015eab0 2023-10-16T13:39:21.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368012400 con 0x7fa37015eab0 2023-10-16T13:39:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.080+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3700c80a0 con 0x7fa37015eab0 2023-10-16T13:39:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.081+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3701464c0 con 0x7fa37015eab0 2023-10-16T13:39:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.081+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa36801b3b0 con 0x7fa37015eab0 2023-10-16T13:39:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.082+0000 7fa357fff700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa35c06af00 0x7fa35c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.082+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa368089420 con 0x7fa37015eab0 2023-10-16T13:39:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.082+0000 7fa36f7fe700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa35c06af00 0x7fa35c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.082+0000 7fa36f7fe700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa35c06af00 0x7fa35c06d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3600097c0 tx=0x7fa36001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.087+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa368057f50 con 0x7fa37015eab0 2023-10-16T13:39:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.289+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3700b7540 con 0x7fa37015eab0 2023-10-16T13:39:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.290+0000 7fa357fff700 1 -- 172.21.15.5:0/1702733869 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16510 (secure 0 0 0) 0x7fa368057ae0 con 0x7fa37015eab0 2023-10-16T13:39:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:21.293 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:20.312474+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa35c06af00 msgr2=0x7fa35c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa35c06af00 0x7fa35c06d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3600097c0 tx=0x7fa36001c040 comp rx=0 tx=0).stop 2023-10-16T13:39:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 msgr2=0x7fa370146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 0x7fa370146810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa36800cba0 tx=0x7fa36800cf60 comp rx=0 tx=0).stop 2023-10-16T13:39:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 shutdown_connections 2023-10-16T13:39:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37015eab0 0x7fa370146810 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3700cf6d0 0x7fa3700c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa35c06af00 0x7fa35c06d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 --2- 172.21.15.5:0/1702733869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3700d1d90 0x7fa3701474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 >> 172.21.15.5:0/1702733869 conn(0x7fa3700665a0 msgr2=0x7fa3700b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 shutdown_connections 2023-10-16T13:39:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.292+0000 7fa3761ec700 1 -- 172.21.15.5:0/1702733869 wait complete. 2023-10-16T13:39:21.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.430+0000 7f7851433700 1 Processor -- start 2023-10-16T13:39:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.430+0000 7f7851433700 1 -- start start 2023-10-16T13:39:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7851433700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f784c0b2c60 0x7f784c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7851433700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 0x7f784c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7851433700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0d0d00 con 0x7f784c0b2880 2023-10-16T13:39:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7851433700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c0ce7a0 con 0x7f784c0b2c60 2023-10-16T13:39:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7851433700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c06cd70 con 0x7f784c0ce3a0 2023-10-16T13:39:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f784affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f784c0b2880 0x7f784c06c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53724/0 (socket says 172.21.15.5:53724) 2023-10-16T13:39:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f784affd700 1 -- 172.21.15.5:0/787614262 learned_addr learned my addr 172.21.15.5:0/787614262 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198354041 0 0) 0x7f784c0d0d00 con 0x7f784c0b2880 2023-10-16T13:39:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78340035b0 con 0x7f784c0b2880 2023-10-16T13:39:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f784a7fc700 1 --2- 172.21.15.5:0/787614262 >> v2:172.21.15.112:3300/0 conn(0x7f784c0b2c60 0x7f784c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f784b7fe700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 0x7f784c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851850769 0 0) 0x7f78340035b0 con 0x7f784c0b2880 2023-10-16T13:39:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 msgr2=0x7f784c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 0x7f784c15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 >> v2:172.21.15.112:3300/0 conn(0x7f784c0b2c60 msgr2=0x7f784c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 --2- 172.21.15.5:0/787614262 >> v2:172.21.15.112:3300/0 conn(0x7f784c0b2c60 0x7f784c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0d2450 con 0x7f784c0b2880 2023-10-16T13:39:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f783c0017f0 con 0x7f784c0b2880 2023-10-16T13:39:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 >> v1:172.21.15.5:6789/0 conn(0x7f784c0b2880 legacy=0x7f784c06c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.431+0000 7f7849ffb700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f7834003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7834004850 0x7f7834004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 0x7f7834005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0ce7a0 con 0x7f7834003a00 2023-10-16T13:39:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c06cd70 con 0x7f7834004850 2023-10-16T13:39:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783400ba40 con 0x7f784c0ce3a0 2023-10-16T13:39:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f7834003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784a7fc700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7834004850 0x7f7834004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784b7fe700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 0x7f7834005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 -- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 msgr2=0x7f7834005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c0ce3a0 0x7f7834005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 -- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7834004850 msgr2=0x7f7834004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7834004850 0x7f7834004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 -- 172.21.15.5:0/787614262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340035b0 con 0x7f7834003a00 2023-10-16T13:39:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f784affd700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f7834003e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c240 tx=0x7f7834005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f35b635a1c5c648 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c00cde0 con 0x7f7834003a00 2023-10-16T13:39:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c007bd0 con 0x7f7834003a00 2023-10-16T13:39:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.432+0000 7f7849ffb700 1 -- 172.21.15.5:0/787614262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c007310 con 0x7f7834003a00 2023-10-16T13:39:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f7851433700 1 -- 172.21.15.5:0/787614262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 msgr2=0x7f7834003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f7851433700 1 --2- 172.21.15.5:0/787614262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f7834003e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c240 tx=0x7f7834005880 comp rx=0 tx=0).stop 2023-10-16T13:39:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f784b7fe700 1 -- 172.21.15.5:0/787614262 reap_dead start 2023-10-16T13:39:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f7851433700 1 -- 172.21.15.5:0/787614262 shutdown_connections 2023-10-16T13:39:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f7851433700 1 -- 172.21.15.5:0/787614262 >> 172.21.15.5:0/787614262 conn(0x7f784c0d15e0 msgr2=0x7f784c0d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f7851433700 1 -- 172.21.15.5:0/787614262 shutdown_connections 2023-10-16T13:39:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.433+0000 7f7851433700 1 -- 172.21.15.5:0/787614262 wait complete. 2023-10-16T13:39:21.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.434+0000 7f7851433700 1 Processor -- start 2023-10-16T13:39:21.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.434+0000 7f7851433700 1 -- start start 2023-10-16T13:39:21.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f7851433700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f784c146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f7851433700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c15a300 0x7f784c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f7851433700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784c15a780 0x7f784c0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f7851433700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1f2d10 con 0x7f7834003a00 2023-10-16T13:39:21.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f7851433700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c147fb0 con 0x7f784c15a780 2023-10-16T13:39:21.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f7851433700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c148290 con 0x7f784c15a300 2023-10-16T13:39:21.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f784c146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f784c146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43732/0 (socket says 172.21.15.5:43732) 2023-10-16T13:39:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 -- 172.21.15.5:0/914584738 learned_addr learned my addr 172.21.15.5:0/914584738 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784a7fc700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c15a300 0x7f784c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784b7fe700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784c15a780 0x7f784c0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 -- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c15a300 msgr2=0x7f784c0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c15a300 0x7f784c0b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 -- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784c15a780 msgr2=0x7f784c0b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784c15a780 0x7f784c0b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784affd700 1 -- 172.21.15.5:0/914584738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c148570 con 0x7f7834003a00 2023-10-16T13:39:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.435+0000 7f784b7fe700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784c15a780 0x7f784c0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.436+0000 7f784affd700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f784c146960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7834004760 tx=0x7f783c001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.436+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c005e80 con 0x7f7834003a00 2023-10-16T13:39:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.436+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c0070d0 con 0x7f7834003a00 2023-10-16T13:39:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.436+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c148850 con 0x7f7834003a00 2023-10-16T13:39:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.436+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c007480 con 0x7f7834003a00 2023-10-16T13:39:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.436+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c146ea0 con 0x7f7834003a00 2023-10-16T13:39:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.437+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c04ebb0 con 0x7f7834003a00 2023-10-16T13:39:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.437+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f783c019030 con 0x7f7834003a00 2023-10-16T13:39:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.438+0000 7f78337fe700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783806af00 0x7f783806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.438+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f783c08a8f0 con 0x7f7834003a00 2023-10-16T13:39:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.438+0000 7f784a7fc700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783806af00 0x7f783806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.439+0000 7f784a7fc700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783806af00 0x7f783806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f784c160ef0 tx=0x7f7840008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.442+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f783c055a30 con 0x7f7834003a00 2023-10-16T13:39:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.649+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f784c074670 con 0x7f7834003a00 2023-10-16T13:39:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.650+0000 7f78337fe700 1 -- 172.21.15.5:0/914584738 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16510 (secure 0 0 0) 0x7f783c059050 con 0x7f7834003a00 2023-10-16T13:39:21.653 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:21.653 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:20.312474+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783806af00 msgr2=0x7f783806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783806af00 0x7f783806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f784c160ef0 tx=0x7f7840008040 comp rx=0 tx=0).stop 2023-10-16T13:39:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 msgr2=0x7f784c146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f784c146960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7834004760 tx=0x7f783c001160 comp rx=0 tx=0).stop 2023-10-16T13:39:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 shutdown_connections 2023-10-16T13:39:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f784c15a780 0x7f784c0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834003a00 0x7f784c146960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f783806af00 0x7f783806d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 --2- 172.21.15.5:0/914584738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f784c15a300 0x7f784c0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 >> 172.21.15.5:0/914584738 conn(0x7f784c0d15e0 msgr2=0x7f784c155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 shutdown_connections 2023-10-16T13:39:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.652+0000 7f7851433700 1 -- 172.21.15.5:0/914584738 wait complete. 2023-10-16T13:39:21.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:39:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.793+0000 7fb9350da700 1 Processor -- start 2023-10-16T13:39:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.793+0000 7fb9350da700 1 -- start start 2023-10-16T13:39:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb9350da700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb93015f130 0x7fb9300cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb9350da700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300b3530 con 0x7fb93006af50 2023-10-16T13:39:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb9350da700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300cd180 con 0x7fb9300b28b0 2023-10-16T13:39:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb9350da700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300cde00 con 0x7fb93015f130 2023-10-16T13:39:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb93015f130 0x7fb9300cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92f59e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb93006af50 0x7fb9300b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53748/0 (socket says 172.21.15.5:53748) 2023-10-16T13:39:21.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92f59e700 1 -- 172.21.15.5:0/2141269911 learned_addr learned my addr 172.21.15.5:0/2141269911 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:21.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92ed9d700 1 -- 172.21.15.5:0/2141269911 >> v1:172.21.15.112:6789/0 conn(0x7fb9300b28b0 legacy=0x7fb93006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:21.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92ed9d700 1 -- 172.21.15.5:0/2141269911 >> v1:172.21.15.5:6789/0 conn(0x7fb93006af50 legacy=0x7fb9300b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92ed9d700 1 -- 172.21.15.5:0/2141269911 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300cd460 con 0x7fb93015f130 2023-10-16T13:39:21.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92ed9d700 1 --2- 172.21.15.5:0/2141269911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93015f130 0x7fb9300cede0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb920009840 tx=0x7fb920009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1f7056e196610b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92dd9b700 1 -- 172.21.15.5:0/2141269911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920004230 con 0x7fb93015f130 2023-10-16T13:39:21.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92dd9b700 1 -- 172.21.15.5:0/2141269911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920004390 con 0x7fb93015f130 2023-10-16T13:39:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.794+0000 7fb92dd9b700 1 -- 172.21.15.5:0/2141269911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200036a0 con 0x7fb93015f130 2023-10-16T13:39:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 -- 172.21.15.5:0/2141269911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93015f130 msgr2=0x7fb9300cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 --2- 172.21.15.5:0/2141269911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93015f130 0x7fb9300cede0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb920009840 tx=0x7fb920009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 -- 172.21.15.5:0/2141269911 shutdown_connections 2023-10-16T13:39:21.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 --2- 172.21.15.5:0/2141269911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93015f130 0x7fb9300cede0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 -- 172.21.15.5:0/2141269911 >> 172.21.15.5:0/2141269911 conn(0x7fb93006dae0 msgr2=0x7fb93006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:21.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 -- 172.21.15.5:0/2141269911 shutdown_connections 2023-10-16T13:39:21.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.795+0000 7fb9350da700 1 -- 172.21.15.5:0/2141269911 wait complete. 2023-10-16T13:39:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.796+0000 7fb9350da700 1 Processor -- start 2023-10-16T13:39:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 -- start start 2023-10-16T13:39:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 0x7fb9300c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9300b28b0 0x7fb9300b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb93015f130 0x7fb9300b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300c6040 con 0x7fb93006af50 2023-10-16T13:39:21.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300c83d0 con 0x7fb93015f130 2023-10-16T13:39:21.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb9350da700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300c5710 con 0x7fb9300b28b0 2023-10-16T13:39:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb92ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 0x7fb9300c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb92ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 0x7fb9300c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43746/0 (socket says 172.21.15.5:43746) 2023-10-16T13:39:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.797+0000 7fb92ed9d700 1 -- 172.21.15.5:0/1018021475 learned_addr learned my addr 172.21.15.5:0/1018021475 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92f59e700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb93015f130 0x7fb9300b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92ed9d700 1 -- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9300b28b0 msgr2=0x7fb9300b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92e59c700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9300b28b0 0x7fb9300b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92ed9d700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9300b28b0 0x7fb9300b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92ed9d700 1 -- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb93015f130 msgr2=0x7fb9300b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:21.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92ed9d700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb93015f130 0x7fb9300b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:21.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92ed9d700 1 -- 172.21.15.5:0/1018021475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200094a0 con 0x7fb93006af50 2023-10-16T13:39:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb92ed9d700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 0x7fb9300c7e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9300b6640 tx=0x7fb920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920011630 con 0x7fb93006af50 2023-10-16T13:39:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92001e070 con 0x7fb93006af50 2023-10-16T13:39:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9300c59f0 con 0x7fb93006af50 2023-10-16T13:39:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200119f0 con 0x7fb93006af50 2023-10-16T13:39:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.798+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300ca3c0 con 0x7fb93006af50 2023-10-16T13:39:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.799+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930067d20 con 0x7fb93006af50 2023-10-16T13:39:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.800+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb920011b50 con 0x7fb93006af50 2023-10-16T13:39:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.800+0000 7fb9177fe700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb91c06af00 0x7fb91c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.800+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb92008a8f0 con 0x7fb93006af50 2023-10-16T13:39:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.800+0000 7fb92e59c700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb91c06af00 0x7fb91c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:21.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.801+0000 7fb92e59c700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb91c06af00 0x7fb91c06d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9301551c0 tx=0x7fb924009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:21.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:21.805+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb920055a30 con 0x7fb93006af50 2023-10-16T13:39:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.056+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb93015e750 con 0x7fb93006af50 2023-10-16T13:39:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.919+0000 7fb9177fe700 1 -- 172.21.15.5:0/1018021475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb920020020 con 0x7fb93006af50 2023-10-16T13:39:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb91c06af00 msgr2=0x7fb91c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb91c06af00 0x7fb91c06d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9301551c0 tx=0x7fb924009040 comp rx=0 tx=0).stop 2023-10-16T13:39:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 msgr2=0x7fb9300c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 0x7fb9300c7e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9300b6640 tx=0x7fb920004750 comp rx=0 tx=0).stop 2023-10-16T13:39:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 shutdown_connections 2023-10-16T13:39:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb93015f130 0x7fb9300b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb93006af50 0x7fb9300c7e90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb91c06af00 0x7fb91c06d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 --2- 172.21.15.5:0/1018021475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9300b28b0 0x7fb9300b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 >> 172.21.15.5:0/1018021475 conn(0x7fb93006dae0 msgr2=0x7fb9300b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 shutdown_connections 2023-10-16T13:39:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:22.922+0000 7fb9350da700 1 -- 172.21.15.5:0/1018021475 wait complete. 2023-10-16T13:39:22.940 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:39:22.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:39:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.073+0000 7f245dabc700 1 Processor -- start 2023-10-16T13:39:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.073+0000 7f245dabc700 1 -- start start 2023-10-16T13:39:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f245dabc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24580ce280 0x7f24581669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f245dabc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245815bf30 con 0x7f245815bb50 2023-10-16T13:39:23.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f245dabc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245806d500 con 0x7f245806ef20 2023-10-16T13:39:23.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f245dabc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580b2d70 con 0x7f24580ce280 2023-10-16T13:39:23.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f2457fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24580ce280 0x7f24581669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:23.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f24577fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f245815bb50 0x7f245806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53758/0 (socket says 172.21.15.5:53758) 2023-10-16T13:39:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f2457fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24580ce280 0x7f24581669f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43758/0 (socket says 172.21.15.5:43758) 2023-10-16T13:39:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f24577fe700 1 -- 172.21.15.5:0/3540878046 learned_addr learned my addr 172.21.15.5:0/3540878046 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f2457fff700 1 -- 172.21.15.5:0/3540878046 >> v1:172.21.15.112:6789/0 conn(0x7f245806ef20 legacy=0x7f24580cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f2457fff700 1 -- 172.21.15.5:0/3540878046 >> v1:172.21.15.5:6789/0 conn(0x7f245815bb50 legacy=0x7f245806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f24567fc700 1 -- 172.21.15.5:0/3540878046 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248517691 0 0) 0x7f245815bf30 con 0x7f245815bb50 2023-10-16T13:39:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f2457fff700 1 -- 172.21.15.5:0/3540878046 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245806d7e0 con 0x7f24580ce280 2023-10-16T13:39:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.074+0000 7f2457fff700 1 --2- 172.21.15.5:0/3540878046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581669f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2450009d90 tx=0x7f245000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff22b33e81de484 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f24567fc700 1 -- 172.21.15.5:0/3540878046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000e070 con 0x7f24580ce280 2023-10-16T13:39:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f24567fc700 1 -- 172.21.15.5:0/3540878046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245000bb90 con 0x7f24580ce280 2023-10-16T13:39:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f24567fc700 1 -- 172.21.15.5:0/3540878046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450003a20 con 0x7f24580ce280 2023-10-16T13:39:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 -- 172.21.15.5:0/3540878046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 msgr2=0x7f24581669f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 --2- 172.21.15.5:0/3540878046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581669f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2450009d90 tx=0x7f245000b330 comp rx=0 tx=0).stop 2023-10-16T13:39:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 -- 172.21.15.5:0/3540878046 shutdown_connections 2023-10-16T13:39:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 --2- 172.21.15.5:0/3540878046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581669f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 -- 172.21.15.5:0/3540878046 >> 172.21.15.5:0/3540878046 conn(0x7f24580cc6f0 msgr2=0x7f24580ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 -- 172.21.15.5:0/3540878046 shutdown_connections 2023-10-16T13:39:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.075+0000 7f245dabc700 1 -- 172.21.15.5:0/3540878046 wait complete. 2023-10-16T13:39:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.076+0000 7f245dabc700 1 Processor -- start 2023-10-16T13:39:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 -- start start 2023-10-16T13:39:23.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245806ef20 0x7f245814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:23.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:23.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f245815bb50 0x7f24581e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245815a2e0 con 0x7f24580ce280 2023-10-16T13:39:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581e52f0 con 0x7f245806ef20 2023-10-16T13:39:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.077+0000 7f245dabc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24581e55d0 con 0x7f245815bb50 2023-10-16T13:39:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43762/0 (socket says 172.21.15.5:43762) 2023-10-16T13:39:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 -- 172.21.15.5:0/3150508531 learned_addr learned my addr 172.21.15.5:0/3150508531 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f24577fe700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245806ef20 0x7f245814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2457fff700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f245815bb50 0x7f24581e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 -- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f245815bb50 msgr2=0x7f24581e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f245815bb50 0x7f24581e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 -- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245806ef20 msgr2=0x7f245814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:23.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245806ef20 0x7f245814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 -- 172.21.15.5:0/3150508531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450009a70 con 0x7f24580ce280 2023-10-16T13:39:23.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f24577fe700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245806ef20 0x7f245814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:23.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2457fff700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f245815bb50 0x7f24581e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:23.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f2456ffd700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581e70c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f244800c4d0 tx=0x7f244800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448011790 con 0x7f24580ce280 2023-10-16T13:39:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480118f0 con 0x7f24580ce280 2023-10-16T13:39:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24581e58b0 con 0x7f24580ce280 2023-10-16T13:39:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448011ca0 con 0x7f24580ce280 2023-10-16T13:39:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.078+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24581e5e70 con 0x7f24580ce280 2023-10-16T13:39:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.079+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458067d20 con 0x7f24580ce280 2023-10-16T13:39:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.080+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f244801c460 con 0x7f24580ce280 2023-10-16T13:39:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.080+0000 7f244ffff700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f243806af00 0x7f243806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.080+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24480894b0 con 0x7f24580ce280 2023-10-16T13:39:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.080+0000 7f24577fe700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f243806af00 0x7f243806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.081+0000 7f24577fe700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f243806af00 0x7f243806d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2440000f60 tx=0x7f2440007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.085+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2448054560 con 0x7f24580ce280 2023-10-16T13:39:23.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.331+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f245815ebb0 con 0x7f24580ce280 2023-10-16T13:39:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.923+0000 7f244ffff700 1 -- 172.21.15.5:0/3150508531 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2448057b80 con 0x7f24580ce280 2023-10-16T13:39:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f243806af00 msgr2=0x7f243806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f243806af00 0x7f243806d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2440000f60 tx=0x7f2440007d30 comp rx=0 tx=0).stop 2023-10-16T13:39:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 msgr2=0x7f24581e70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581e70c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f244800c4d0 tx=0x7f244800c890 comp rx=0 tx=0).stop 2023-10-16T13:39:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 shutdown_connections 2023-10-16T13:39:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f243806af00 0x7f243806d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f245815bb50 0x7f24581e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245806ef20 0x7f245814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 --2- 172.21.15.5:0/3150508531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24580ce280 0x7f24581e70c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 >> 172.21.15.5:0/3150508531 conn(0x7f24580cc6f0 msgr2=0x7f24580ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 shutdown_connections 2023-10-16T13:39:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:23.926+0000 7f245dabc700 1 -- 172.21.15.5:0/3150508531 wait complete. 2023-10-16T13:39:23.944 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:39:23.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.074+0000 7f16c585a700 1 Processor -- start 2023-10-16T13:39:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.074+0000 7f16c585a700 1 -- start start 2023-10-16T13:39:24.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16c585a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16c00d3fc0 0x7f16c015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16c585a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16c00b7050 0x7f16c00d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16c585a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c015e4e0 con 0x7f16c015dbc0 2023-10-16T13:39:24.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16c585a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00b7560 con 0x7f16c00d3fc0 2023-10-16T13:39:24.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16c585a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00b7840 con 0x7f16c00b7050 2023-10-16T13:39:24.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16c00d3fc0 0x7f16c015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16c00d3fc0 0x7f16c015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43770/0 (socket says 172.21.15.5:43770) 2023-10-16T13:39:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 -- 172.21.15.5:0/3238302322 learned_addr learned my addr 172.21.15.5:0/3238302322 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16bf7fe700 1 --2- 172.21.15.5:0/3238302322 >> v2:172.21.15.112:3300/0 conn(0x7f16c00b7050 0x7f16c00d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 -- 172.21.15.5:0/3238302322 >> v2:172.21.15.112:3300/0 conn(0x7f16c00b7050 msgr2=0x7f16c00d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 --2- 172.21.15.5:0/3238302322 >> v2:172.21.15.112:3300/0 conn(0x7f16c00b7050 0x7f16c00d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 -- 172.21.15.5:0/3238302322 >> v1:172.21.15.112:6789/0 conn(0x7f16c015dbc0 legacy=0x7f16c00d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.075+0000 7f16be7fc700 1 -- 172.21.15.5:0/3238302322 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00b7b20 con 0x7f16c00d3fc0 2023-10-16T13:39:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16be7fc700 1 --2- 172.21.15.5:0/3238302322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c00d3fc0 0x7f16c015dfa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16c00cdea0 tx=0x7f16b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fd725462c6beb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16bdffb700 1 -- 172.21.15.5:0/3238302322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0004230 con 0x7f16c00d3fc0 2023-10-16T13:39:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16bdffb700 1 -- 172.21.15.5:0/3238302322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b0004390 con 0x7f16c00d3fc0 2023-10-16T13:39:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16bdffb700 1 -- 172.21.15.5:0/3238302322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00036a0 con 0x7f16c00d3fc0 2023-10-16T13:39:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 -- 172.21.15.5:0/3238302322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c00d3fc0 msgr2=0x7f16c015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 --2- 172.21.15.5:0/3238302322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c00d3fc0 0x7f16c015dfa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16c00cdea0 tx=0x7f16b0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 -- 172.21.15.5:0/3238302322 shutdown_connections 2023-10-16T13:39:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 --2- 172.21.15.5:0/3238302322 >> v2:172.21.15.112:3300/0 conn(0x7f16c00b7050 0x7f16c00d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 --2- 172.21.15.5:0/3238302322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c00d3fc0 0x7f16c015dfa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 -- 172.21.15.5:0/3238302322 >> 172.21.15.5:0/3238302322 conn(0x7f16c009cb40 msgr2=0x7f16c00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:24.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 -- 172.21.15.5:0/3238302322 shutdown_connections 2023-10-16T13:39:24.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.076+0000 7f16c585a700 1 -- 172.21.15.5:0/3238302322 wait complete. 2023-10-16T13:39:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 Processor -- start 2023-10-16T13:39:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 -- start start 2023-10-16T13:39:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c00b7050 0x7f16c015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16c00d3fc0 0x7f16c00a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 0x7f16c015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01e8290 con 0x7f16c015dbc0 2023-10-16T13:39:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00a0bd0 con 0x7f16c00b7050 2023-10-16T13:39:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.078+0000 7f16c585a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01e7a60 con 0x7f16c00d3fc0 2023-10-16T13:39:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 0x7f16c015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 0x7f16c015b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43776/0 (socket says 172.21.15.5:43776) 2023-10-16T13:39:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 -- 172.21.15.5:0/146191438 learned_addr learned my addr 172.21.15.5:0/146191438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16beffd700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c00b7050 0x7f16c015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16be7fc700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16c00d3fc0 0x7f16c00a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 -- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16c00d3fc0 msgr2=0x7f16c00a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16c00d3fc0 0x7f16c00a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 -- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c00b7050 msgr2=0x7f16c015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c00b7050 0x7f16c015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 -- 172.21.15.5:0/146191438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0009550 con 0x7f16c015dbc0 2023-10-16T13:39:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16be7fc700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16c00d3fc0 0x7f16c00a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16bf7fe700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 0x7f16c015b840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16b800cda0 tx=0x7f16b800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8003a20 con 0x7f16c015dbc0 2023-10-16T13:39:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8003b80 con 0x7f16c015dbc0 2023-10-16T13:39:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c01e7cd0 con 0x7f16c015dbc0 2023-10-16T13:39:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8004020 con 0x7f16c015dbc0 2023-10-16T13:39:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.079+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01e3520 con 0x7f16c015dbc0 2023-10-16T13:39:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.080+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c01e3380 con 0x7f16c015dbc0 2023-10-16T13:39:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.081+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16b8004180 con 0x7f16c015dbc0 2023-10-16T13:39:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.081+0000 7f16b7fff700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f16a006af00 0x7f16a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.081+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b8012070 con 0x7f16c015dbc0 2023-10-16T13:39:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.081+0000 7f16beffd700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f16a006af00 0x7f16a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.082+0000 7f16beffd700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f16a006af00 0x7f16a006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16c00cd200 tx=0x7f16a80090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.086+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16c01e3380 con 0x7f16c015dbc0 2023-10-16T13:39:24.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.332+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16c01e3380 con 0x7f16c015dbc0 2023-10-16T13:39:24.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.332+0000 7f16b7fff700 1 -- 172.21.15.5:0/146191438 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f16c01e3380 con 0x7f16c015dbc0 2023-10-16T13:39:24.335 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:24.336 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1052521879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1052521879},{"type":"v1","addr":"172.21.15.112:6837","nonce":1052521879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:20.312787+0000","modified":"2023-10-16T13:39:23.333172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6834/3128747669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3128747669},{"type":"v1","addr":"172.21.15.5:6834","nonce":3128747669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:39:24.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.334+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f16a006af00 msgr2=0x7f16a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.334+0000 7f16c585a700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f16a006af00 0x7f16a006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16c00cd200 tx=0x7f16a80090e0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.334+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 msgr2=0x7f16c015b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.334+0000 7f16c585a700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 0x7f16c015b840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16b800cda0 tx=0x7f16b800a570 comp rx=0 tx=0).stop 2023-10-16T13:39:24.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.334+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 shutdown_connections 2023-10-16T13:39:24.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.334+0000 7f16c585a700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c015dbc0 0x7f16c015b840 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.335+0000 7f16c585a700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16c00b7050 0x7f16c015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.335+0000 7f16c585a700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f16a006af00 0x7f16a006d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.335+0000 7f16c585a700 1 --2- 172.21.15.5:0/146191438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16c00d3fc0 0x7f16c00a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.335+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 >> 172.21.15.5:0/146191438 conn(0x7f16c009cb40 msgr2=0x7f16c006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.335+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 shutdown_connections 2023-10-16T13:39:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.335+0000 7f16c585a700 1 -- 172.21.15.5:0/146191438 wait complete. 2023-10-16T13:39:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-10-16T13:39:24.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.472+0000 7fad95e35700 1 Processor -- start 2023-10-16T13:39:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.472+0000 7fad95e35700 1 -- start start 2023-10-16T13:39:24.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad95e35700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad900cee40 0x7fad9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad95e35700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fad9006ad80 0x7fad90161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad95e35700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad90161390 con 0x7fad90160fb0 2023-10-16T13:39:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad95e35700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9006b210 con 0x7fad9006ad80 2023-10-16T13:39:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad95e35700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad900cf2c0 con 0x7fad900cee40 2023-10-16T13:39:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad8ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fad9006ad80 0x7fad90161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad8effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad900cee40 0x7fad9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad8f7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fad90160fb0 0x7fad900727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:44762/0 (socket says 172.21.15.5:44762) 2023-10-16T13:39:24.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.473+0000 7fad8f7fe700 1 -- 172.21.15.5:0/2476851764 learned_addr learned my addr 172.21.15.5:0/2476851764 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:24.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8ffff700 1 -- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad900cee40 msgr2=0x7fad9006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:24.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8ffff700 1 --2- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad900cee40 0x7fad9006a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8ffff700 1 -- 172.21.15.5:0/2476851764 >> v1:172.21.15.112:6789/0 conn(0x7fad90160fb0 legacy=0x7fad900727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8ffff700 1 -- 172.21.15.5:0/2476851764 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900b23f0 con 0x7fad9006ad80 2023-10-16T13:39:24.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8ffff700 1 --2- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad9006ad80 0x7fad90161600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad88009d90 tx=0x7fad8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34a4caa20b543220 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8e7fc700 1 -- 172.21.15.5:0/2476851764 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8800e070 con 0x7fad9006ad80 2023-10-16T13:39:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8e7fc700 1 -- 172.21.15.5:0/2476851764 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8800bb20 con 0x7fad9006ad80 2023-10-16T13:39:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.474+0000 7fad8e7fc700 1 -- 172.21.15.5:0/2476851764 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88012430 con 0x7fad9006ad80 2023-10-16T13:39:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 -- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad9006ad80 msgr2=0x7fad90161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 --2- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad9006ad80 0x7fad90161600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad88009d90 tx=0x7fad8800b330 comp rx=0 tx=0).stop 2023-10-16T13:39:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 -- 172.21.15.5:0/2476851764 shutdown_connections 2023-10-16T13:39:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 --2- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad9006ad80 0x7fad90161600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 --2- 172.21.15.5:0/2476851764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad900cee40 0x7fad9006a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 -- 172.21.15.5:0/2476851764 >> 172.21.15.5:0/2476851764 conn(0x7fad900cd270 msgr2=0x7fad900cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 -- 172.21.15.5:0/2476851764 shutdown_connections 2023-10-16T13:39:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.475+0000 7fad95e35700 1 -- 172.21.15.5:0/2476851764 wait complete. 2023-10-16T13:39:24.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.476+0000 7fad95e35700 1 Processor -- start 2023-10-16T13:39:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.476+0000 7fad95e35700 1 -- start start 2023-10-16T13:39:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad95e35700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 0x7fad900ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad95e35700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900cee40 0x7fad900c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad95e35700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad90160fb0 0x7fad900c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad95e35700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad900addf0 con 0x7fad9006ad80 2023-10-16T13:39:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad95e35700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad900ae210 con 0x7fad900cee40 2023-10-16T13:39:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad95e35700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad900ad170 con 0x7fad90160fb0 2023-10-16T13:39:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 0x7fad900ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 0x7fad900ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43788/0 (socket says 172.21.15.5:43788) 2023-10-16T13:39:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 -- 172.21.15.5:0/1262896257 learned_addr learned my addr 172.21.15.5:0/1262896257 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8effd700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900cee40 0x7fad900c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8ffff700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad90160fb0 0x7fad900c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 -- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad90160fb0 msgr2=0x7fad900c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad90160fb0 0x7fad900c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 -- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900cee40 msgr2=0x7fad900c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900cee40 0x7fad900c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.477+0000 7fad8f7fe700 1 -- 172.21.15.5:0/1262896257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009a70 con 0x7fad9006ad80 2023-10-16T13:39:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.478+0000 7fad8f7fe700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 0x7fad900ac8b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c500 tx=0x7fad7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.478+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78005dc0 con 0x7fad9006ad80 2023-10-16T13:39:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.478+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780070d0 con 0x7fad9006ad80 2023-10-16T13:39:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.478+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad900ad450 con 0x7fad9006ad80 2023-10-16T13:39:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.478+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78007460 con 0x7fad9006ad80 2023-10-16T13:39:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.478+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad900ada10 con 0x7fad9006ad80 2023-10-16T13:39:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.479+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad90067d20 con 0x7fad9006ad80 2023-10-16T13:39:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.479+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad780075c0 con 0x7fad9006ad80 2023-10-16T13:39:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.480+0000 7fad87fff700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7006af00 0x7fad7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.480+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad78088b20 con 0x7fad9006ad80 2023-10-16T13:39:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.480+0000 7fad8effd700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7006af00 0x7fad7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.480+0000 7fad8effd700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7006af00 0x7fad7006d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad90153b80 tx=0x7fad80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.485+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad78053b50 con 0x7fad9006ad80 2023-10-16T13:39:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.685+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad900b6770 con 0x7fad9006ad80 2023-10-16T13:39:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.686+0000 7fad87fff700 1 -- 172.21.15.5:0/1262896257 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16497 (secure 0 0 0) 0x7fad78057170 con 0x7fad9006ad80 2023-10-16T13:39:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:24.689 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:21.894981+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7006af00 msgr2=0x7fad7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7006af00 0x7fad7006d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad90153b80 tx=0x7fad80008040 comp rx=0 tx=0).stop 2023-10-16T13:39:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 msgr2=0x7fad900ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 0x7fad900ac8b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c500 tx=0x7fad7800c8c0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 shutdown_connections 2023-10-16T13:39:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7006af00 0x7fad7006d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad90160fb0 0x7fad900c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9006ad80 0x7fad900ac8b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 --2- 172.21.15.5:0/1262896257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad900cee40 0x7fad900c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 >> 172.21.15.5:0/1262896257 conn(0x7fad900cd270 msgr2=0x7fad9006f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:24.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 shutdown_connections 2023-10-16T13:39:24.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.688+0000 7fad95e35700 1 -- 172.21.15.5:0/1262896257 wait complete. 2023-10-16T13:39:24.703 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:39:24.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:39:24.785 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-10-16T13:39:24.782+0000 7f934e5fa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:39:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.826+0000 7f6dab98d700 1 Processor -- start 2023-10-16T13:39:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6dab98d700 1 -- start start 2023-10-16T13:39:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6dab98d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da415d840 0x7f6da4162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6dab98d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6da40cda40 0x7f6da40ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6dab98d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40cee20 con 0x7f6da40cdfd0 2023-10-16T13:39:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6dab98d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40b2ce0 con 0x7f6da40cda40 2023-10-16T13:39:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6dab98d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40ceb40 con 0x7f6da415d840 2023-10-16T13:39:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.827+0000 7f6da9f2a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6da40cda40 0x7f6da40ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6da40cda40 0x7f6da40ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43800/0 (socket says 172.21.15.5:43800) 2023-10-16T13:39:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 -- 172.21.15.5:0/3417219849 learned_addr learned my addr 172.21.15.5:0/3417219849 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9729700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da415d840 0x7f6da4162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 -- 172.21.15.5:0/3417219849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da415d840 msgr2=0x7f6da4162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da415d840 0x7f6da4162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 -- 172.21.15.5:0/3417219849 >> v1:172.21.15.112:6789/0 conn(0x7f6da40cdfd0 legacy=0x7f6da40cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 -- 172.21.15.5:0/3417219849 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4161590 con 0x7f6da40cda40 2023-10-16T13:39:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9729700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da415d840 0x7f6da4162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6da9f2a700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40ce450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009e50 tx=0x7f6d9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb4147a70894f24 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6d97fff700 1 -- 172.21.15.5:0/3417219849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00e070 con 0x7f6da40cda40 2023-10-16T13:39:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6d97fff700 1 -- 172.21.15.5:0/3417219849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00b9c0 con 0x7f6da40cda40 2023-10-16T13:39:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.828+0000 7f6d97fff700 1 -- 172.21.15.5:0/3417219849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00bd70 con 0x7f6da40cda40 2023-10-16T13:39:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 -- 172.21.15.5:0/3417219849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 msgr2=0x7f6da40ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40ce450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009e50 tx=0x7f6d9c00b330 comp rx=0 tx=0).stop 2023-10-16T13:39:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 -- 172.21.15.5:0/3417219849 shutdown_connections 2023-10-16T13:39:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40ce450 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 --2- 172.21.15.5:0/3417219849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da415d840 0x7f6da4162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 -- 172.21.15.5:0/3417219849 >> 172.21.15.5:0/3417219849 conn(0x7f6da406bd70 msgr2=0x7f6da406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 -- 172.21.15.5:0/3417219849 shutdown_connections 2023-10-16T13:39:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.829+0000 7f6dab98d700 1 -- 172.21.15.5:0/3417219849 wait complete. 2023-10-16T13:39:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.830+0000 7f6dab98d700 1 Processor -- start 2023-10-16T13:39:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.830+0000 7f6dab98d700 1 -- start start 2023-10-16T13:39:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6dab98d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6dab98d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da40cdfd0 0x7f6da41f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6dab98d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6da415d840 0x7f6da40aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6dab98d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da415e740 con 0x7f6da40cda40 2023-10-16T13:39:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6dab98d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41f2e70 con 0x7f6da415d840 2023-10-16T13:39:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6dab98d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c61a0 con 0x7f6da40cdfd0 2023-10-16T13:39:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43802/0 (socket says 172.21.15.5:43802) 2023-10-16T13:39:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 -- 172.21.15.5:0/1081681397 learned_addr learned my addr 172.21.15.5:0/1081681397 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9f2a700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6da415d840 0x7f6da40aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da8f28700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da40cdfd0 0x7f6da41f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 -- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da40cdfd0 msgr2=0x7f6da41f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da40cdfd0 0x7f6da41f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 -- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6da415d840 msgr2=0x7f6da40aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6da415d840 0x7f6da40aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da9729700 1 -- 172.21.15.5:0/1081681397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009b30 con 0x7f6da40cda40 2023-10-16T13:39:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.831+0000 7f6da8f28700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da40cdfd0 0x7f6da41f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.832+0000 7f6da9729700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40c58a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c7f0 tx=0x7f6da000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.832+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011800 con 0x7f6da40cda40 2023-10-16T13:39:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.832+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0011960 con 0x7f6da40cda40 2023-10-16T13:39:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.832+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da40af490 con 0x7f6da40cda40 2023-10-16T13:39:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.832+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011cf0 con 0x7f6da40cda40 2023-10-16T13:39:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.832+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da415e0f0 con 0x7f6da40cda40 2023-10-16T13:39:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.833+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4067d20 con 0x7f6da40cda40 2023-10-16T13:39:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.833+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6da0018360 con 0x7f6da40cda40 2023-10-16T13:39:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.834+0000 7f6d95ffb700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d8806af00 0x7f6d8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.834+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6da0089560 con 0x7f6da40cda40 2023-10-16T13:39:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.834+0000 7f6da8f28700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d8806af00 0x7f6d8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.834+0000 7f6da8f28700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d8806af00 0x7f6d8806d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c3bb0 tx=0x7f6d98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:24.838+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6da0054620 con 0x7f6da40cda40 2023-10-16T13:39:25.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.035+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6da4161b50 con 0x7f6d8806af00 2023-10-16T13:39:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.044+0000 7f6d95ffb700 1 -- 172.21.15.5:0/1081681397 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274817 (secure 0 0 0) 0x7f6d98001470 con 0x7f6d8806af00 2023-10-16T13:39:25.049 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d8806af00 msgr2=0x7f6d8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d8806af00 0x7f6d8806d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c3bb0 tx=0x7f6d98009040 comp rx=0 tx=0).stop 2023-10-16T13:39:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 msgr2=0x7f6da40c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40c58a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c7f0 tx=0x7f6da000cb00 comp rx=0 tx=0).stop 2023-10-16T13:39:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 shutdown_connections 2023-10-16T13:39:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6da415d840 0x7f6da40aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40cda40 0x7f6da40c58a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6d8806af00 0x7f6d8806d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 --2- 172.21.15.5:0/1081681397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6da40cdfd0 0x7f6da41f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 >> 172.21.15.5:0/1081681397 conn(0x7f6da406bd70 msgr2=0x7f6da40cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 shutdown_connections 2023-10-16T13:39:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.047+0000 7f6dab98d700 1 -- 172.21.15.5:0/1081681397 wait complete. 2023-10-16T13:39:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:39:25.061 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-16T13:39:23.472079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219900,"kb_used_data":3680,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754820,"statfs":{"total":773094113280,"available":772868935680,"internally_reserved":0,"allocated":3768320,"data_stored":2152850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.582418"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-16T13:39:15.020493+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:39:15.020493+0000","last_peered":"2023-10-16T13:39:15.020493+0000","last_clean":"2023-10-16T13:39:15.020493+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:39:15.020493+0000","last_undegraded":"2023-10-16T13:39:15.020493+0000","last_fullsized":"2023-10-16T13:39:15.020493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":712137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63300000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.52600000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.621},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.745},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.32100000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.41499999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.48699999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":711118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.308}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42099999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63100000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.81000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":120750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.317}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.379}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.316}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.37}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40699999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.629}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53400000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.51500000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:39:25.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:39:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.224+0000 7fe43266d700 1 Processor -- start 2023-10-16T13:39:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.224+0000 7fe43266d700 1 -- start start 2023-10-16T13:39:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe43266d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe42c15e2f0 0x7fe42c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe43266d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0b2d60 con 0x7fe42c06a840 2023-10-16T13:39:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe43266d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0cdd30 con 0x7fe42c0cd950 2023-10-16T13:39:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe43266d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c1619a0 con 0x7fe42c15e2f0 2023-10-16T13:39:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe430c0a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe42c06a840 0x7fe42c06ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53818/0 (socket says 172.21.15.5:53818) 2023-10-16T13:39:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe430c0a700 1 -- 172.21.15.5:0/2040923301 learned_addr learned my addr 172.21.15.5:0/2040923301 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/2040923301 >> v2:172.21.15.112:3300/0 conn(0x7fe42c15e2f0 0x7fe42c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863373226 0 0) 0x7fe42c0b2d60 con 0x7fe42c06a840 2023-10-16T13:39:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4140035b0 con 0x7fe42c06a840 2023-10-16T13:39:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707632805 0 0) 0x7fe4140035b0 con 0x7fe42c06a840 2023-10-16T13:39:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 >> v2:172.21.15.112:3300/0 conn(0x7fe42c15e2f0 msgr2=0x7fe42c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 --2- 172.21.15.5:0/2040923301 >> v2:172.21.15.112:3300/0 conn(0x7fe42c15e2f0 0x7fe42c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 >> v1:172.21.15.112:6789/0 conn(0x7fe42c0cd950 legacy=0x7fe42c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c15e920 con 0x7fe42c06a840 2023-10-16T13:39:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fe4240019f0 con 0x7fe42c06a840 2023-10-16T13:39:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 >> v1:172.21.15.5:6789/0 conn(0x7fe42c06a840 legacy=0x7fe42c06ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe414003a00 0x7fe414003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe414004850 0x7fe414004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414005210 0x7fe41400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c1619a0 con 0x7fe414004850 2023-10-16T13:39:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41400c0b0 con 0x7fe414005210 2023-10-16T13:39:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.225+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41400c270 con 0x7fe414003a00 2023-10-16T13:39:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe414004850 0x7fe414004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe430c0a700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414005210 0x7fe41400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42bfff700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe414003a00 0x7fe414003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 -- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe414003a00 msgr2=0x7fe414003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe414003a00 0x7fe414003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 -- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414005210 msgr2=0x7fe41400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414005210 0x7fe41400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 -- 172.21.15.5:0/2040923301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140035b0 con 0x7fe414004850 2023-10-16T13:39:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe430c0a700 1 -- 172.21.15.5:0/2040923301 reap_dead start 2023-10-16T13:39:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe414004850 0x7fe414004cd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe420009b40 tx=0x7fe414005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40df3ca6fcc820a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420005a20 con 0x7fe414004850 2023-10-16T13:39:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420005b80 con 0x7fe414004850 2023-10-16T13:39:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.226+0000 7fe42affd700 1 -- 172.21.15.5:0/2040923301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42000e640 con 0x7fe414004850 2023-10-16T13:39:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 -- 172.21.15.5:0/2040923301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe414004850 msgr2=0x7fe414004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe414004850 0x7fe414004cd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe420009b40 tx=0x7fe414005880 comp rx=0 tx=0).stop 2023-10-16T13:39:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 -- 172.21.15.5:0/2040923301 shutdown_connections 2023-10-16T13:39:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 --2- 172.21.15.5:0/2040923301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe414004850 0x7fe414004cd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 -- 172.21.15.5:0/2040923301 >> 172.21.15.5:0/2040923301 conn(0x7fe42c06dae0 msgr2=0x7fe42c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 -- 172.21.15.5:0/2040923301 shutdown_connections 2023-10-16T13:39:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.227+0000 7fe43266d700 1 -- 172.21.15.5:0/2040923301 wait complete. 2023-10-16T13:39:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.228+0000 7fe43266d700 1 Processor -- start 2023-10-16T13:39:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.228+0000 7fe43266d700 1 -- start start 2023-10-16T13:39:25.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe43266d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414004850 0x7fe42c152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe43266d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe42c0af130 0x7fe42c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe43266d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 0x7fe42c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe43266d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0add70 con 0x7fe42c0c9770 2023-10-16T13:39:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe43266d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0ca130 con 0x7fe414004850 2023-10-16T13:39:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe43266d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c1f7cd0 con 0x7fe42c0af130 2023-10-16T13:39:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 0x7fe42c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 0x7fe42c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43824/0 (socket says 172.21.15.5:43824) 2023-10-16T13:39:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 -- 172.21.15.5:0/1823173398 learned_addr learned my addr 172.21.15.5:0/1823173398 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe42c0af130 0x7fe42c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe42bfff700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414004850 0x7fe42c152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 -- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe42c0af130 msgr2=0x7fe42c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe42c0af130 0x7fe42c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 -- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414004850 msgr2=0x7fe42c152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414004850 0x7fe42c152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 -- 172.21.15.5:0/1823173398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c152850 con 0x7fe42c0c9770 2023-10-16T13:39:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe42bfff700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414004850 0x7fe42c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe42b7fe700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe42c0af130 0x7fe42c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.229+0000 7fe430c0a700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 0x7fe42c0c9bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe42c06ebc0 tx=0x7fe42400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.230+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400ada0 con 0x7fe42c0c9770 2023-10-16T13:39:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.230+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4240133f0 con 0x7fe42c0c9770 2023-10-16T13:39:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.230+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c1f7150 con 0x7fe42c0c9770 2023-10-16T13:39:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.230+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424013760 con 0x7fe42c0c9770 2023-10-16T13:39:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.230+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c1f7710 con 0x7fe42c0c9770 2023-10-16T13:39:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.231+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0b2630 con 0x7fe42c0c9770 2023-10-16T13:39:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.231+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4240138c0 con 0x7fe42c0c9770 2023-10-16T13:39:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.232+0000 7fe428ff9700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe41806af00 0x7fe41806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.232+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe42408a150 con 0x7fe42c0c9770 2023-10-16T13:39:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.232+0000 7fe42bfff700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe41806af00 0x7fe41806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.232+0000 7fe42bfff700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe41806af00 0x7fe41806d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe42c050550 tx=0x7fe41c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.236+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe424055290 con 0x7fe42c0c9770 2023-10-16T13:39:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.431+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe42c15eee0 con 0x7fe41806af00 2023-10-16T13:39:25.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.439+0000 7fe428ff9700 1 -- 172.21.15.5:0/1823173398 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274817 (secure 0 0 0) 0x7fe41c001370 con 0x7fe41806af00 2023-10-16T13:39:25.445 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.442+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe41806af00 msgr2=0x7fe41806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.442+0000 7fe43266d700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe41806af00 0x7fe41806d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe42c050550 tx=0x7fe41c009040 comp rx=0 tx=0).stop 2023-10-16T13:39:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 msgr2=0x7fe42c0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 0x7fe42c0c9bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe42c06ebc0 tx=0x7fe42400a5f0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 shutdown_connections 2023-10-16T13:39:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0c9770 0x7fe42c0c9bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe414004850 0x7fe42c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe41806af00 0x7fe41806d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 --2- 172.21.15.5:0/1823173398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe42c0af130 0x7fe42c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 >> 172.21.15.5:0/1823173398 conn(0x7fe42c06dae0 msgr2=0x7fe42c15d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 shutdown_connections 2023-10-16T13:39:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.443+0000 7fe43266d700 1 -- 172.21.15.5:0/1823173398 wait complete. 2023-10-16T13:39:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:39:25.457 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-16T13:39:23.472079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219900,"kb_used_data":3680,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754820,"statfs":{"total":773094113280,"available":772868935680,"internally_reserved":0,"allocated":3768320,"data_stored":2152850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.582418"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:19.888646+0000","last_change":"2023-10-16T13:39:19.888646+0000","last_active":"2023-10-16T13:39:19.888646+0000","last_peered":"2023-10-16T13:39:19.888646+0000","last_clean":"2023-10-16T13:39:19.888646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:19.888646+0000","last_undegraded":"2023-10-16T13:39:19.888646+0000","last_fullsized":"2023-10-16T13:39:19.888646+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:39:18.886801+0000","last_change":"2023-10-16T13:39:18.886801+0000","last_active":"2023-10-16T13:39:18.886801+0000","last_peered":"2023-10-16T13:39:18.886801+0000","last_clean":"2023-10-16T13:39:18.886801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:39:18.886801+0000","last_undegraded":"2023-10-16T13:39:18.886801+0000","last_fullsized":"2023-10-16T13:39:18.886801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-16T13:39:15.020493+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:39:15.020493+0000","last_peered":"2023-10-16T13:39:15.020493+0000","last_clean":"2023-10-16T13:39:15.020493+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:39:15.020493+0000","last_undegraded":"2023-10-16T13:39:15.020493+0000","last_fullsized":"2023-10-16T13:39:15.020493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":712137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63300000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.52600000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.621},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.745},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.32100000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.41499999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.48699999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":711118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.308}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42099999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63100000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.81000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":120750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.317}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.379}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.316}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.37}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40699999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.629}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53400000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.51500000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:39:25.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:39:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.620+0000 7efef43ee700 1 Processor -- start 2023-10-16T13:39:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.620+0000 7efef43ee700 1 -- start start 2023-10-16T13:39:25.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef43ee700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efeec0cf8a0 0x7efeec0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef43ee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 0x7efeec0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef43ee700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec15ee90 con 0x7efeec15eab0 2023-10-16T13:39:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef43ee700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec158370 con 0x7efeec0cf8a0 2023-10-16T13:39:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef43ee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0d23b0 con 0x7efeec0d1bc0 2023-10-16T13:39:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef218a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efeec15eab0 0x7efeec0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53834/0 (socket says 172.21.15.5:53834) 2023-10-16T13:39:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef218a700 1 -- 172.21.15.5:0/2276888586 learned_addr learned my addr 172.21.15.5:0/2276888586 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef298b700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 0x7efeec0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1989700 1 --2- 172.21.15.5:0/2276888586 >> v2:172.21.15.112:3300/0 conn(0x7efeec0cf8a0 0x7efeec0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5383979 0 0) 0x7efeec15ee90 con 0x7efeec15eab0 2023-10-16T13:39:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed80035b0 con 0x7efeec15eab0 2023-10-16T13:39:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2781292180 0 0) 0x7efed80035b0 con 0x7efeec15eab0 2023-10-16T13:39:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 msgr2=0x7efeec0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 0x7efeec0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 >> v2:172.21.15.112:3300/0 conn(0x7efeec0cf8a0 msgr2=0x7efeec0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 --2- 172.21.15.5:0/2276888586 >> v2:172.21.15.112:3300/0 conn(0x7efeec0cf8a0 0x7efeec0d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0cda20 con 0x7efeec15eab0 2023-10-16T13:39:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7efee8001670 con 0x7efeec15eab0 2023-10-16T13:39:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 >> v1:172.21.15.5:6789/0 conn(0x7efeec15eab0 legacy=0x7efeec0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efed8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 0x7efed8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed8004d90 0x7efed8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec158370 con 0x7efed8003a00 2023-10-16T13:39:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0d23b0 con 0x7efed8004d90 2023-10-16T13:39:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.621+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed800ba10 con 0x7efeec0d1bc0 2023-10-16T13:39:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efed8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef298b700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed8004d90 0x7efed8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef1989700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 0x7efed8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 -- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 msgr2=0x7efed8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec0d1bc0 0x7efed8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 -- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed8004d90 msgr2=0x7efed8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed8004d90 0x7efed8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 -- 172.21.15.5:0/2276888586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80035b0 con 0x7efed8003a00 2023-10-16T13:39:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef218a700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efed8003e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efee800c2f0 tx=0x7efed8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321dfc0e54a6fe66 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee800ce30 con 0x7efed8003a00 2023-10-16T13:39:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee8005960 con 0x7efed8003a00 2023-10-16T13:39:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.622+0000 7efef1188700 1 -- 172.21.15.5:0/2276888586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee8005d10 con 0x7efed8003a00 2023-10-16T13:39:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef43ee700 1 -- 172.21.15.5:0/2276888586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 msgr2=0x7efed8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef43ee700 1 --2- 172.21.15.5:0/2276888586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efed8003e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efee800c2f0 tx=0x7efed8005880 comp rx=0 tx=0).stop 2023-10-16T13:39:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef298b700 1 -- 172.21.15.5:0/2276888586 reap_dead start 2023-10-16T13:39:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef43ee700 1 -- 172.21.15.5:0/2276888586 shutdown_connections 2023-10-16T13:39:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef43ee700 1 -- 172.21.15.5:0/2276888586 >> 172.21.15.5:0/2276888586 conn(0x7efeec0665a0 msgr2=0x7efeec066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef43ee700 1 -- 172.21.15.5:0/2276888586 shutdown_connections 2023-10-16T13:39:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.623+0000 7efef43ee700 1 -- 172.21.15.5:0/2276888586 wait complete. 2023-10-16T13:39:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.624+0000 7efef43ee700 1 Processor -- start 2023-10-16T13:39:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.624+0000 7efef43ee700 1 -- start start 2023-10-16T13:39:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efeec1f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec1f6e40 0x7efeec0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeec0c5630 0x7efeec160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec1f72c0 con 0x7efed8003a00 2023-10-16T13:39:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0c5ac0 con 0x7efeec0c5630 2023-10-16T13:39:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0cc680 con 0x7efeec1f6e40 2023-10-16T13:39:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efeec1f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efeec1f6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43842/0 (socket says 172.21.15.5:43842) 2023-10-16T13:39:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 -- 172.21.15.5:0/676597106 learned_addr learned my addr 172.21.15.5:0/676597106 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef1989700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec1f6e40 0x7efeec0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef298b700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeec0c5630 0x7efeec160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 -- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec1f6e40 msgr2=0x7efeec0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec1f6e40 0x7efeec0c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 -- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeec0c5630 msgr2=0x7efeec160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeec0c5630 0x7efeec160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 -- 172.21.15.5:0/676597106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0c5cd0 con 0x7efed8003a00 2023-10-16T13:39:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef298b700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeec0c5630 0x7efeec160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef1989700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec1f6e40 0x7efeec0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef218a700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efeec1f6900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efee8001930 tx=0x7efeec15df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee800cea0 con 0x7efed8003a00 2023-10-16T13:39:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee8004a80 con 0x7efed8003a00 2023-10-16T13:39:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec0c5fb0 con 0x7efed8003a00 2023-10-16T13:39:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.625+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee8004e10 con 0x7efed8003a00 2023-10-16T13:39:25.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.626+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec0c6570 con 0x7efed8003a00 2023-10-16T13:39:25.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.627+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec1f7220 con 0x7efed8003a00 2023-10-16T13:39:25.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.627+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efee80070d0 con 0x7efed8003a00 2023-10-16T13:39:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.627+0000 7efee2ffd700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efed006af00 0x7efed006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.627+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee808ac50 con 0x7efed8003a00 2023-10-16T13:39:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.628+0000 7efef1989700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efed006af00 0x7efed006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.628+0000 7efef1989700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efed006af00 0x7efed006d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efedc009b80 tx=0x7efedc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:25.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.632+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efee8090020 con 0x7efed8003a00 2023-10-16T13:39:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.827+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeec0cdfe0 con 0x7efed006af00 2023-10-16T13:39:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.835+0000 7efee2ffd700 1 -- 172.21.15.5:0/676597106 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289551 (secure 0 0 0) 0x7efedc009810 con 0x7efed006af00 2023-10-16T13:39:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efed006af00 msgr2=0x7efed006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efed006af00 0x7efed006d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efedc009b80 tx=0x7efedc008040 comp rx=0 tx=0).stop 2023-10-16T13:39:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 msgr2=0x7efeec1f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efeec1f6900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efee8001930 tx=0x7efeec15df20 comp rx=0 tx=0).stop 2023-10-16T13:39:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 shutdown_connections 2023-10-16T13:39:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeec0c5630 0x7efeec160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efed8003a00 0x7efeec1f6900 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efed006af00 0x7efed006d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 --2- 172.21.15.5:0/676597106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efeec1f6e40 0x7efeec0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 >> 172.21.15.5:0/676597106 conn(0x7efeec0665a0 msgr2=0x7efeec0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 shutdown_connections 2023-10-16T13:39:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:25.838+0000 7efef43ee700 1 -- 172.21.15.5:0/676597106 wait complete. 2023-10-16T13:39:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:39:25.853 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-16T13:39:25.472603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4128,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4227072,"data_stored":2358942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001604"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321973+0000","last_change":"2023-10-16T13:39:20.917920+0000","last_active":"2023-10-16T13:39:22.321973+0000","last_peered":"2023-10-16T13:39:22.321973+0000","last_clean":"2023-10-16T13:39:22.321973+0000","last_became_active":"2023-10-16T13:39:20.917664+0000","last_became_peered":"2023-10-16T13:39:20.917664+0000","last_unstale":"2023-10-16T13:39:22.321973+0000","last_undegraded":"2023-10-16T13:39:22.321973+0000","last_fullsized":"2023-10-16T13:39:22.321973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:57.327298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322800+0000","last_change":"2023-10-16T13:39:20.921778+0000","last_active":"2023-10-16T13:39:22.322800+0000","last_peered":"2023-10-16T13:39:22.322800+0000","last_clean":"2023-10-16T13:39:22.322800+0000","last_became_active":"2023-10-16T13:39:20.921486+0000","last_became_peered":"2023-10-16T13:39:20.921486+0000","last_unstale":"2023-10-16T13:39:22.322800+0000","last_undegraded":"2023-10-16T13:39:22.322800+0000","last_fullsized":"2023-10-16T13:39:22.322800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:46.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907764+0000","last_change":"2023-10-16T13:39:20.916833+0000","last_active":"2023-10-16T13:39:21.907764+0000","last_peered":"2023-10-16T13:39:21.907764+0000","last_clean":"2023-10-16T13:39:21.907764+0000","last_became_active":"2023-10-16T13:39:20.916446+0000","last_became_peered":"2023-10-16T13:39:20.916446+0000","last_unstale":"2023-10-16T13:39:21.907764+0000","last_undegraded":"2023-10-16T13:39:21.907764+0000","last_fullsized":"2023-10-16T13:39:21.907764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904774+0000","last_change":"2023-10-16T13:39:20.916712+0000","last_active":"2023-10-16T13:39:21.904774+0000","last_peered":"2023-10-16T13:39:21.904774+0000","last_clean":"2023-10-16T13:39:21.904774+0000","last_became_active":"2023-10-16T13:39:20.916402+0000","last_became_peered":"2023-10-16T13:39:20.916402+0000","last_unstale":"2023-10-16T13:39:21.904774+0000","last_undegraded":"2023-10-16T13:39:21.904774+0000","last_fullsized":"2023-10-16T13:39:21.904774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:22.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321718+0000","last_change":"2023-10-16T13:39:20.908249+0000","last_active":"2023-10-16T13:39:22.321718+0000","last_peered":"2023-10-16T13:39:22.321718+0000","last_clean":"2023-10-16T13:39:22.321718+0000","last_became_active":"2023-10-16T13:39:20.907713+0000","last_became_peered":"2023-10-16T13:39:20.907713+0000","last_unstale":"2023-10-16T13:39:22.321718+0000","last_undegraded":"2023-10-16T13:39:22.321718+0000","last_fullsized":"2023-10-16T13:39:22.321718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:35.718910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322492+0000","last_change":"2023-10-16T13:39:20.916044+0000","last_active":"2023-10-16T13:39:22.322492+0000","last_peered":"2023-10-16T13:39:22.322492+0000","last_clean":"2023-10-16T13:39:22.322492+0000","last_became_active":"2023-10-16T13:39:20.915691+0000","last_became_peered":"2023-10-16T13:39:20.915691+0000","last_unstale":"2023-10-16T13:39:22.322492+0000","last_undegraded":"2023-10-16T13:39:22.322492+0000","last_fullsized":"2023-10-16T13:39:22.322492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321737+0000","last_change":"2023-10-16T13:39:20.913478+0000","last_active":"2023-10-16T13:39:22.321737+0000","last_peered":"2023-10-16T13:39:22.321737+0000","last_clean":"2023-10-16T13:39:22.321737+0000","last_became_active":"2023-10-16T13:39:20.913217+0000","last_became_peered":"2023-10-16T13:39:20.913217+0000","last_unstale":"2023-10-16T13:39:22.321737+0000","last_undegraded":"2023-10-16T13:39:22.321737+0000","last_fullsized":"2023-10-16T13:39:22.321737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321635+0000","last_change":"2023-10-16T13:39:20.911699+0000","last_active":"2023-10-16T13:39:22.321635+0000","last_peered":"2023-10-16T13:39:22.321635+0000","last_clean":"2023-10-16T13:39:22.321635+0000","last_became_active":"2023-10-16T13:39:20.911073+0000","last_became_peered":"2023-10-16T13:39:20.911073+0000","last_unstale":"2023-10-16T13:39:22.321635+0000","last_undegraded":"2023-10-16T13:39:22.321635+0000","last_fullsized":"2023-10-16T13:39:22.321635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908390+0000","last_change":"2023-10-16T13:39:20.916353+0000","last_active":"2023-10-16T13:39:21.908390+0000","last_peered":"2023-10-16T13:39:21.908390+0000","last_clean":"2023-10-16T13:39:21.908390+0000","last_became_active":"2023-10-16T13:39:20.916059+0000","last_became_peered":"2023-10-16T13:39:20.916059+0000","last_unstale":"2023-10-16T13:39:21.908390+0000","last_undegraded":"2023-10-16T13:39:21.908390+0000","last_fullsized":"2023-10-16T13:39:21.908390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904850+0000","last_change":"2023-10-16T13:39:20.907199+0000","last_active":"2023-10-16T13:39:21.904850+0000","last_peered":"2023-10-16T13:39:21.904850+0000","last_clean":"2023-10-16T13:39:21.904850+0000","last_became_active":"2023-10-16T13:39:20.906893+0000","last_became_peered":"2023-10-16T13:39:20.906893+0000","last_unstale":"2023-10-16T13:39:21.904850+0000","last_undegraded":"2023-10-16T13:39:21.904850+0000","last_fullsized":"2023-10-16T13:39:21.904850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322409+0000","last_change":"2023-10-16T13:39:20.912098+0000","last_active":"2023-10-16T13:39:22.322409+0000","last_peered":"2023-10-16T13:39:22.322409+0000","last_clean":"2023-10-16T13:39:22.322409+0000","last_became_active":"2023-10-16T13:39:20.911773+0000","last_became_peered":"2023-10-16T13:39:20.911773+0000","last_unstale":"2023-10-16T13:39:22.322409+0000","last_undegraded":"2023-10-16T13:39:22.322409+0000","last_fullsized":"2023-10-16T13:39:22.322409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907639+0000","last_change":"2023-10-16T13:39:20.917806+0000","last_active":"2023-10-16T13:39:21.907639+0000","last_peered":"2023-10-16T13:39:21.907639+0000","last_clean":"2023-10-16T13:39:21.907639+0000","last_became_active":"2023-10-16T13:39:20.916708+0000","last_became_peered":"2023-10-16T13:39:20.916708+0000","last_unstale":"2023-10-16T13:39:21.907639+0000","last_undegraded":"2023-10-16T13:39:21.907639+0000","last_fullsized":"2023-10-16T13:39:21.907639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321983+0000","last_change":"2023-10-16T13:39:20.907695+0000","last_active":"2023-10-16T13:39:22.321983+0000","last_peered":"2023-10-16T13:39:22.321983+0000","last_clean":"2023-10-16T13:39:22.321983+0000","last_became_active":"2023-10-16T13:39:20.907292+0000","last_became_peered":"2023-10-16T13:39:20.907292+0000","last_unstale":"2023-10-16T13:39:22.321983+0000","last_undegraded":"2023-10-16T13:39:22.321983+0000","last_fullsized":"2023-10-16T13:39:22.321983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:25.691612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322608+0000","last_change":"2023-10-16T13:39:20.911433+0000","last_active":"2023-10-16T13:39:22.322608+0000","last_peered":"2023-10-16T13:39:22.322608+0000","last_clean":"2023-10-16T13:39:22.322608+0000","last_became_active":"2023-10-16T13:39:20.908506+0000","last_became_peered":"2023-10-16T13:39:20.908506+0000","last_unstale":"2023-10-16T13:39:22.322608+0000","last_undegraded":"2023-10-16T13:39:22.322608+0000","last_fullsized":"2023-10-16T13:39:22.322608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907530+0000","last_change":"2023-10-16T13:39:20.912733+0000","last_active":"2023-10-16T13:39:21.907530+0000","last_peered":"2023-10-16T13:39:21.907530+0000","last_clean":"2023-10-16T13:39:21.907530+0000","last_became_active":"2023-10-16T13:39:20.912435+0000","last_became_peered":"2023-10-16T13:39:20.912435+0000","last_unstale":"2023-10-16T13:39:21.907530+0000","last_undegraded":"2023-10-16T13:39:21.907530+0000","last_fullsized":"2023-10-16T13:39:21.907530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322076+0000","last_change":"2023-10-16T13:39:20.911890+0000","last_active":"2023-10-16T13:39:22.322076+0000","last_peered":"2023-10-16T13:39:22.322076+0000","last_clean":"2023-10-16T13:39:22.322076+0000","last_became_active":"2023-10-16T13:39:20.911408+0000","last_became_peered":"2023-10-16T13:39:20.911408+0000","last_unstale":"2023-10-16T13:39:22.322076+0000","last_undegraded":"2023-10-16T13:39:22.322076+0000","last_fullsized":"2023-10-16T13:39:22.322076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322461+0000","last_change":"2023-10-16T13:39:20.911690+0000","last_active":"2023-10-16T13:39:22.322461+0000","last_peered":"2023-10-16T13:39:22.322461+0000","last_clean":"2023-10-16T13:39:22.322461+0000","last_became_active":"2023-10-16T13:39:20.911273+0000","last_became_peered":"2023-10-16T13:39:20.911273+0000","last_unstale":"2023-10-16T13:39:22.322461+0000","last_undegraded":"2023-10-16T13:39:22.322461+0000","last_fullsized":"2023-10-16T13:39:22.322461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:33.274046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322764+0000","last_change":"2023-10-16T13:39:20.908210+0000","last_active":"2023-10-16T13:39:22.322764+0000","last_peered":"2023-10-16T13:39:22.322764+0000","last_clean":"2023-10-16T13:39:22.322764+0000","last_became_active":"2023-10-16T13:39:20.907809+0000","last_became_peered":"2023-10-16T13:39:20.907809+0000","last_unstale":"2023-10-16T13:39:22.322764+0000","last_undegraded":"2023-10-16T13:39:22.322764+0000","last_fullsized":"2023-10-16T13:39:22.322764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:33.274046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322607+0000","last_change":"2023-10-16T13:39:20.909508+0000","last_active":"2023-10-16T13:39:22.322607+0000","last_peered":"2023-10-16T13:39:22.322607+0000","last_clean":"2023-10-16T13:39:22.322607+0000","last_became_active":"2023-10-16T13:39:20.909057+0000","last_became_peered":"2023-10-16T13:39:20.909057+0000","last_unstale":"2023-10-16T13:39:22.322607+0000","last_undegraded":"2023-10-16T13:39:22.322607+0000","last_fullsized":"2023-10-16T13:39:22.322607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322105+0000","last_change":"2023-10-16T13:39:20.915174+0000","last_active":"2023-10-16T13:39:22.322105+0000","last_peered":"2023-10-16T13:39:22.322105+0000","last_clean":"2023-10-16T13:39:22.322105+0000","last_became_active":"2023-10-16T13:39:20.914871+0000","last_became_peered":"2023-10-16T13:39:20.914871+0000","last_unstale":"2023-10-16T13:39:22.322105+0000","last_undegraded":"2023-10-16T13:39:22.322105+0000","last_fullsized":"2023-10-16T13:39:22.322105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:17.687258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907683+0000","last_change":"2023-10-16T13:39:20.919458+0000","last_active":"2023-10-16T13:39:21.907683+0000","last_peered":"2023-10-16T13:39:21.907683+0000","last_clean":"2023-10-16T13:39:21.907683+0000","last_became_active":"2023-10-16T13:39:20.919200+0000","last_became_peered":"2023-10-16T13:39:20.919200+0000","last_unstale":"2023-10-16T13:39:21.907683+0000","last_undegraded":"2023-10-16T13:39:21.907683+0000","last_fullsized":"2023-10-16T13:39:21.907683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:55.268898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908551+0000","last_change":"2023-10-16T13:39:20.920940+0000","last_active":"2023-10-16T13:39:21.908551+0000","last_peered":"2023-10-16T13:39:21.908551+0000","last_clean":"2023-10-16T13:39:21.908551+0000","last_became_active":"2023-10-16T13:39:20.920666+0000","last_became_peered":"2023-10-16T13:39:20.920666+0000","last_unstale":"2023-10-16T13:39:21.908551+0000","last_undegraded":"2023-10-16T13:39:21.908551+0000","last_fullsized":"2023-10-16T13:39:21.908551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321941+0000","last_change":"2023-10-16T13:39:20.919286+0000","last_active":"2023-10-16T13:39:22.321941+0000","last_peered":"2023-10-16T13:39:22.321941+0000","last_clean":"2023-10-16T13:39:22.321941+0000","last_became_active":"2023-10-16T13:39:20.919011+0000","last_became_peered":"2023-10-16T13:39:20.919011+0000","last_unstale":"2023-10-16T13:39:22.321941+0000","last_undegraded":"2023-10-16T13:39:22.321941+0000","last_fullsized":"2023-10-16T13:39:22.321941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:51.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908318+0000","last_change":"2023-10-16T13:39:20.912715+0000","last_active":"2023-10-16T13:39:21.908318+0000","last_peered":"2023-10-16T13:39:21.908318+0000","last_clean":"2023-10-16T13:39:21.908318+0000","last_became_active":"2023-10-16T13:39:20.912415+0000","last_became_peered":"2023-10-16T13:39:20.912415+0000","last_unstale":"2023-10-16T13:39:21.908318+0000","last_undegraded":"2023-10-16T13:39:21.908318+0000","last_fullsized":"2023-10-16T13:39:21.908318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904931+0000","last_change":"2023-10-16T13:39:20.914168+0000","last_active":"2023-10-16T13:39:21.904931+0000","last_peered":"2023-10-16T13:39:21.904931+0000","last_clean":"2023-10-16T13:39:21.904931+0000","last_became_active":"2023-10-16T13:39:20.913858+0000","last_became_peered":"2023-10-16T13:39:20.913858+0000","last_unstale":"2023-10-16T13:39:21.904931+0000","last_undegraded":"2023-10-16T13:39:21.904931+0000","last_fullsized":"2023-10-16T13:39:21.904931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322849+0000","last_change":"2023-10-16T13:39:20.911171+0000","last_active":"2023-10-16T13:39:22.322849+0000","last_peered":"2023-10-16T13:39:22.322849+0000","last_clean":"2023-10-16T13:39:22.322849+0000","last_became_active":"2023-10-16T13:39:20.910845+0000","last_became_peered":"2023-10-16T13:39:20.910845+0000","last_unstale":"2023-10-16T13:39:22.322849+0000","last_undegraded":"2023-10-16T13:39:22.322849+0000","last_fullsized":"2023-10-16T13:39:22.322849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:49.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905139+0000","last_change":"2023-10-16T13:39:20.914590+0000","last_active":"2023-10-16T13:39:21.905139+0000","last_peered":"2023-10-16T13:39:21.905139+0000","last_clean":"2023-10-16T13:39:21.905139+0000","last_became_active":"2023-10-16T13:39:20.913686+0000","last_became_peered":"2023-10-16T13:39:20.913686+0000","last_unstale":"2023-10-16T13:39:21.905139+0000","last_undegraded":"2023-10-16T13:39:21.905139+0000","last_fullsized":"2023-10-16T13:39:21.905139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907802+0000","last_change":"2023-10-16T13:39:20.921650+0000","last_active":"2023-10-16T13:39:21.907802+0000","last_peered":"2023-10-16T13:39:21.907802+0000","last_clean":"2023-10-16T13:39:21.907802+0000","last_became_active":"2023-10-16T13:39:20.921396+0000","last_became_peered":"2023-10-16T13:39:20.921396+0000","last_unstale":"2023-10-16T13:39:21.907802+0000","last_undegraded":"2023-10-16T13:39:21.907802+0000","last_fullsized":"2023-10-16T13:39:21.907802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907822+0000","last_change":"2023-10-16T13:39:20.917637+0000","last_active":"2023-10-16T13:39:21.907822+0000","last_peered":"2023-10-16T13:39:21.907822+0000","last_clean":"2023-10-16T13:39:21.907822+0000","last_became_active":"2023-10-16T13:39:20.917363+0000","last_became_peered":"2023-10-16T13:39:20.917363+0000","last_unstale":"2023-10-16T13:39:21.907822+0000","last_undegraded":"2023-10-16T13:39:21.907822+0000","last_fullsized":"2023-10-16T13:39:21.907822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:23.719551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322050+0000","last_change":"2023-10-16T13:39:20.911850+0000","last_active":"2023-10-16T13:39:22.322050+0000","last_peered":"2023-10-16T13:39:22.322050+0000","last_clean":"2023-10-16T13:39:22.322050+0000","last_became_active":"2023-10-16T13:39:20.911461+0000","last_became_peered":"2023-10-16T13:39:20.911461+0000","last_unstale":"2023-10-16T13:39:22.322050+0000","last_undegraded":"2023-10-16T13:39:22.322050+0000","last_fullsized":"2023-10-16T13:39:22.322050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321747+0000","last_change":"2023-10-16T13:39:20.910894+0000","last_active":"2023-10-16T13:39:22.321747+0000","last_peered":"2023-10-16T13:39:22.321747+0000","last_clean":"2023-10-16T13:39:22.321747+0000","last_became_active":"2023-10-16T13:39:20.910625+0000","last_became_peered":"2023-10-16T13:39:20.910625+0000","last_unstale":"2023-10-16T13:39:22.321747+0000","last_undegraded":"2023-10-16T13:39:22.321747+0000","last_fullsized":"2023-10-16T13:39:22.321747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:31.113460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322406+0000","last_change":"2023-10-16T13:39:20.917952+0000","last_active":"2023-10-16T13:39:22.322406+0000","last_peered":"2023-10-16T13:39:22.322406+0000","last_clean":"2023-10-16T13:39:22.322406+0000","last_became_active":"2023-10-16T13:39:20.917672+0000","last_became_peered":"2023-10-16T13:39:20.917672+0000","last_unstale":"2023-10-16T13:39:22.322406+0000","last_undegraded":"2023-10-16T13:39:22.322406+0000","last_fullsized":"2023-10-16T13:39:22.322406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321764+0000","last_change":"2023-10-16T13:39:20.922400+0000","last_active":"2023-10-16T13:39:22.321764+0000","last_peered":"2023-10-16T13:39:22.321764+0000","last_clean":"2023-10-16T13:39:22.321764+0000","last_became_active":"2023-10-16T13:39:20.921792+0000","last_became_peered":"2023-10-16T13:39:20.921792+0000","last_unstale":"2023-10-16T13:39:22.321764+0000","last_undegraded":"2023-10-16T13:39:22.321764+0000","last_fullsized":"2023-10-16T13:39:22.321764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:57.327298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322196+0000","last_change":"2023-10-16T13:39:19.913389+0000","last_active":"2023-10-16T13:39:22.322196+0000","last_peered":"2023-10-16T13:39:22.322196+0000","last_clean":"2023-10-16T13:39:22.322196+0000","last_became_active":"2023-10-16T13:39:19.913122+0000","last_became_peered":"2023-10-16T13:39:19.913122+0000","last_unstale":"2023-10-16T13:39:22.322196+0000","last_undegraded":"2023-10-16T13:39:22.322196+0000","last_fullsized":"2023-10-16T13:39:22.322196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322098+0000","last_change":"2023-10-16T13:39:20.917450+0000","last_active":"2023-10-16T13:39:22.322098+0000","last_peered":"2023-10-16T13:39:22.322098+0000","last_clean":"2023-10-16T13:39:22.322098+0000","last_became_active":"2023-10-16T13:39:20.917157+0000","last_became_peered":"2023-10-16T13:39:20.917157+0000","last_unstale":"2023-10-16T13:39:22.322098+0000","last_undegraded":"2023-10-16T13:39:22.322098+0000","last_fullsized":"2023-10-16T13:39:22.322098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:20.057433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322006+0000","last_change":"2023-10-16T13:39:19.914389+0000","last_active":"2023-10-16T13:39:22.322006+0000","last_peered":"2023-10-16T13:39:22.322006+0000","last_clean":"2023-10-16T13:39:22.322006+0000","last_became_active":"2023-10-16T13:39:19.914126+0000","last_became_peered":"2023-10-16T13:39:19.914126+0000","last_unstale":"2023-10-16T13:39:22.322006+0000","last_undegraded":"2023-10-16T13:39:22.322006+0000","last_fullsized":"2023-10-16T13:39:22.322006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:30.111615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908163+0000","last_change":"2023-10-16T13:39:20.917550+0000","last_active":"2023-10-16T13:39:21.908163+0000","last_peered":"2023-10-16T13:39:21.908163+0000","last_clean":"2023-10-16T13:39:21.908163+0000","last_became_active":"2023-10-16T13:39:20.917261+0000","last_became_peered":"2023-10-16T13:39:20.917261+0000","last_unstale":"2023-10-16T13:39:21.908163+0000","last_undegraded":"2023-10-16T13:39:21.908163+0000","last_fullsized":"2023-10-16T13:39:21.908163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:54.865090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322570+0000","last_change":"2023-10-16T13:39:19.907530+0000","last_active":"2023-10-16T13:39:22.322570+0000","last_peered":"2023-10-16T13:39:22.322570+0000","last_clean":"2023-10-16T13:39:22.322570+0000","last_became_active":"2023-10-16T13:39:19.907179+0000","last_became_peered":"2023-10-16T13:39:19.907179+0000","last_unstale":"2023-10-16T13:39:22.322570+0000","last_undegraded":"2023-10-16T13:39:22.322570+0000","last_fullsized":"2023-10-16T13:39:22.322570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:21.592605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905114+0000","last_change":"2023-10-16T13:39:20.914196+0000","last_active":"2023-10-16T13:39:21.905114+0000","last_peered":"2023-10-16T13:39:21.905114+0000","last_clean":"2023-10-16T13:39:21.905114+0000","last_became_active":"2023-10-16T13:39:20.913327+0000","last_became_peered":"2023-10-16T13:39:20.913327+0000","last_unstale":"2023-10-16T13:39:21.905114+0000","last_undegraded":"2023-10-16T13:39:21.905114+0000","last_fullsized":"2023-10-16T13:39:21.905114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322176+0000","last_change":"2023-10-16T13:39:19.912833+0000","last_active":"2023-10-16T13:39:22.322176+0000","last_peered":"2023-10-16T13:39:22.322176+0000","last_clean":"2023-10-16T13:39:22.322176+0000","last_became_active":"2023-10-16T13:39:19.912335+0000","last_became_peered":"2023-10-16T13:39:19.912335+0000","last_unstale":"2023-10-16T13:39:22.322176+0000","last_undegraded":"2023-10-16T13:39:22.322176+0000","last_fullsized":"2023-10-16T13:39:22.322176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:29.357845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322346+0000","last_change":"2023-10-16T13:39:20.920905+0000","last_active":"2023-10-16T13:39:22.322346+0000","last_peered":"2023-10-16T13:39:22.322346+0000","last_clean":"2023-10-16T13:39:22.322346+0000","last_became_active":"2023-10-16T13:39:20.920590+0000","last_became_peered":"2023-10-16T13:39:20.920590+0000","last_unstale":"2023-10-16T13:39:22.322346+0000","last_undegraded":"2023-10-16T13:39:22.322346+0000","last_fullsized":"2023-10-16T13:39:22.322346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907989+0000","last_change":"2023-10-16T13:39:19.911910+0000","last_active":"2023-10-16T13:39:21.907989+0000","last_peered":"2023-10-16T13:39:21.907989+0000","last_clean":"2023-10-16T13:39:21.907989+0000","last_became_active":"2023-10-16T13:39:19.911583+0000","last_became_peered":"2023-10-16T13:39:19.911583+0000","last_unstale":"2023-10-16T13:39:21.907989+0000","last_undegraded":"2023-10-16T13:39:21.907989+0000","last_fullsized":"2023-10-16T13:39:21.907989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:19.055588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907876+0000","last_change":"2023-10-16T13:39:20.915190+0000","last_active":"2023-10-16T13:39:21.907876+0000","last_peered":"2023-10-16T13:39:21.907876+0000","last_clean":"2023-10-16T13:39:21.907876+0000","last_became_active":"2023-10-16T13:39:20.914925+0000","last_became_peered":"2023-10-16T13:39:20.914925+0000","last_unstale":"2023-10-16T13:39:21.907876+0000","last_undegraded":"2023-10-16T13:39:21.907876+0000","last_fullsized":"2023-10-16T13:39:21.907876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908562+0000","last_change":"2023-10-16T13:39:19.911559+0000","last_active":"2023-10-16T13:39:21.908562+0000","last_peered":"2023-10-16T13:39:21.908562+0000","last_clean":"2023-10-16T13:39:21.908562+0000","last_became_active":"2023-10-16T13:39:19.911241+0000","last_became_peered":"2023-10-16T13:39:19.911241+0000","last_unstale":"2023-10-16T13:39:21.908562+0000","last_undegraded":"2023-10-16T13:39:21.908562+0000","last_fullsized":"2023-10-16T13:39:21.908562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:30.111615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907623+0000","last_change":"2023-10-16T13:39:20.912896+0000","last_active":"2023-10-16T13:39:21.907623+0000","last_peered":"2023-10-16T13:39:21.907623+0000","last_clean":"2023-10-16T13:39:21.907623+0000","last_became_active":"2023-10-16T13:39:20.912615+0000","last_became_peered":"2023-10-16T13:39:20.912615+0000","last_unstale":"2023-10-16T13:39:21.907623+0000","last_undegraded":"2023-10-16T13:39:21.907623+0000","last_fullsized":"2023-10-16T13:39:21.907623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:53.306545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322286+0000","last_change":"2023-10-16T13:39:19.912803+0000","last_active":"2023-10-16T13:39:22.322286+0000","last_peered":"2023-10-16T13:39:22.322286+0000","last_clean":"2023-10-16T13:39:22.322286+0000","last_became_active":"2023-10-16T13:39:19.912421+0000","last_became_peered":"2023-10-16T13:39:19.912421+0000","last_unstale":"2023-10-16T13:39:22.322286+0000","last_undegraded":"2023-10-16T13:39:22.322286+0000","last_fullsized":"2023-10-16T13:39:22.322286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904560+0000","last_change":"2023-10-16T13:39:20.914138+0000","last_active":"2023-10-16T13:39:21.904560+0000","last_peered":"2023-10-16T13:39:21.904560+0000","last_clean":"2023-10-16T13:39:21.904560+0000","last_became_active":"2023-10-16T13:39:20.913876+0000","last_became_peered":"2023-10-16T13:39:20.913876+0000","last_unstale":"2023-10-16T13:39:21.904560+0000","last_undegraded":"2023-10-16T13:39:21.904560+0000","last_fullsized":"2023-10-16T13:39:21.904560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:23.719551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907447+0000","last_change":"2023-10-16T13:39:19.910502+0000","last_active":"2023-10-16T13:39:21.907447+0000","last_peered":"2023-10-16T13:39:21.907447+0000","last_clean":"2023-10-16T13:39:21.907447+0000","last_became_active":"2023-10-16T13:39:19.910217+0000","last_became_peered":"2023-10-16T13:39:19.910217+0000","last_unstale":"2023-10-16T13:39:21.907447+0000","last_undegraded":"2023-10-16T13:39:21.907447+0000","last_fullsized":"2023-10-16T13:39:21.907447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:56.325453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908310+0000","last_change":"2023-10-16T13:39:20.913603+0000","last_active":"2023-10-16T13:39:21.908310+0000","last_peered":"2023-10-16T13:39:21.908310+0000","last_clean":"2023-10-16T13:39:21.908310+0000","last_became_active":"2023-10-16T13:39:20.913251+0000","last_became_peered":"2023-10-16T13:39:20.913251+0000","last_unstale":"2023-10-16T13:39:21.908310+0000","last_undegraded":"2023-10-16T13:39:21.908310+0000","last_fullsized":"2023-10-16T13:39:21.908310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322768+0000","last_change":"2023-10-16T13:39:19.915218+0000","last_active":"2023-10-16T13:39:22.322768+0000","last_peered":"2023-10-16T13:39:22.322768+0000","last_clean":"2023-10-16T13:39:22.322768+0000","last_became_active":"2023-10-16T13:39:19.913215+0000","last_became_peered":"2023-10-16T13:39:19.913215+0000","last_unstale":"2023-10-16T13:39:22.322768+0000","last_undegraded":"2023-10-16T13:39:22.322768+0000","last_fullsized":"2023-10-16T13:39:22.322768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:54.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322802+0000","last_change":"2023-10-16T13:39:20.908775+0000","last_active":"2023-10-16T13:39:22.322802+0000","last_peered":"2023-10-16T13:39:22.322802+0000","last_clean":"2023-10-16T13:39:22.322802+0000","last_became_active":"2023-10-16T13:39:20.908468+0000","last_became_peered":"2023-10-16T13:39:20.908468+0000","last_unstale":"2023-10-16T13:39:22.322802+0000","last_undegraded":"2023-10-16T13:39:22.322802+0000","last_fullsized":"2023-10-16T13:39:22.322802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:00.699575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321864+0000","last_change":"2023-10-16T13:39:19.911047+0000","last_active":"2023-10-16T13:39:22.321864+0000","last_peered":"2023-10-16T13:39:22.321864+0000","last_clean":"2023-10-16T13:39:22.321864+0000","last_became_active":"2023-10-16T13:39:19.910721+0000","last_became_peered":"2023-10-16T13:39:19.910721+0000","last_unstale":"2023-10-16T13:39:22.321864+0000","last_undegraded":"2023-10-16T13:39:22.321864+0000","last_fullsized":"2023-10-16T13:39:22.321864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322678+0000","last_change":"2023-10-16T13:39:20.912846+0000","last_active":"2023-10-16T13:39:22.322678+0000","last_peered":"2023-10-16T13:39:22.322678+0000","last_clean":"2023-10-16T13:39:22.322678+0000","last_became_active":"2023-10-16T13:39:20.912556+0000","last_became_peered":"2023-10-16T13:39:20.912556+0000","last_unstale":"2023-10-16T13:39:22.322678+0000","last_undegraded":"2023-10-16T13:39:22.322678+0000","last_fullsized":"2023-10-16T13:39:22.322678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908002+0000","last_change":"2023-10-16T13:39:19.913341+0000","last_active":"2023-10-16T13:39:21.908002+0000","last_peered":"2023-10-16T13:39:21.908002+0000","last_clean":"2023-10-16T13:39:21.908002+0000","last_became_active":"2023-10-16T13:39:19.913078+0000","last_became_peered":"2023-10-16T13:39:19.913078+0000","last_unstale":"2023-10-16T13:39:21.908002+0000","last_undegraded":"2023-10-16T13:39:21.908002+0000","last_fullsized":"2023-10-16T13:39:21.908002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:53.863245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907898+0000","last_change":"2023-10-16T13:39:20.913115+0000","last_active":"2023-10-16T13:39:21.907898+0000","last_peered":"2023-10-16T13:39:21.907898+0000","last_clean":"2023-10-16T13:39:21.907898+0000","last_became_active":"2023-10-16T13:39:20.912566+0000","last_became_peered":"2023-10-16T13:39:20.912566+0000","last_unstale":"2023-10-16T13:39:21.907898+0000","last_undegraded":"2023-10-16T13:39:21.907898+0000","last_fullsized":"2023-10-16T13:39:21.907898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322651+0000","last_change":"2023-10-16T13:39:19.920111+0000","last_active":"2023-10-16T13:39:22.322651+0000","last_peered":"2023-10-16T13:39:22.322651+0000","last_clean":"2023-10-16T13:39:22.322651+0000","last_became_active":"2023-10-16T13:39:19.919659+0000","last_became_peered":"2023-10-16T13:39:19.919659+0000","last_unstale":"2023-10-16T13:39:22.322651+0000","last_undegraded":"2023-10-16T13:39:22.322651+0000","last_fullsized":"2023-10-16T13:39:22.322651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:35.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904618+0000","last_change":"2023-10-16T13:39:20.914690+0000","last_active":"2023-10-16T13:39:21.904618+0000","last_peered":"2023-10-16T13:39:21.904618+0000","last_clean":"2023-10-16T13:39:21.904618+0000","last_became_active":"2023-10-16T13:39:20.914434+0000","last_became_peered":"2023-10-16T13:39:20.914434+0000","last_unstale":"2023-10-16T13:39:21.904618+0000","last_undegraded":"2023-10-16T13:39:21.904618+0000","last_fullsized":"2023-10-16T13:39:21.904618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:54.865090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908088+0000","last_change":"2023-10-16T13:39:19.913702+0000","last_active":"2023-10-16T13:39:21.908088+0000","last_peered":"2023-10-16T13:39:21.908088+0000","last_clean":"2023-10-16T13:39:21.908088+0000","last_became_active":"2023-10-16T13:39:19.913451+0000","last_became_peered":"2023-10-16T13:39:19.913451+0000","last_unstale":"2023-10-16T13:39:21.908088+0000","last_undegraded":"2023-10-16T13:39:21.908088+0000","last_fullsized":"2023-10-16T13:39:21.908088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:50.118463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322654+0000","last_change":"2023-10-16T13:39:20.917747+0000","last_active":"2023-10-16T13:39:22.322654+0000","last_peered":"2023-10-16T13:39:22.322654+0000","last_clean":"2023-10-16T13:39:22.322654+0000","last_became_active":"2023-10-16T13:39:20.917442+0000","last_became_peered":"2023-10-16T13:39:20.917442+0000","last_unstale":"2023-10-16T13:39:22.322654+0000","last_undegraded":"2023-10-16T13:39:22.322654+0000","last_fullsized":"2023-10-16T13:39:22.322654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904603+0000","last_change":"2023-10-16T13:39:19.902332+0000","last_active":"2023-10-16T13:39:21.904603+0000","last_peered":"2023-10-16T13:39:21.904603+0000","last_clean":"2023-10-16T13:39:21.904603+0000","last_became_active":"2023-10-16T13:39:19.902050+0000","last_became_peered":"2023-10-16T13:39:19.902050+0000","last_unstale":"2023-10-16T13:39:21.904603+0000","last_undegraded":"2023-10-16T13:39:21.904603+0000","last_fullsized":"2023-10-16T13:39:21.904603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:19.055588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322337+0000","last_change":"2023-10-16T13:39:20.917922+0000","last_active":"2023-10-16T13:39:22.322337+0000","last_peered":"2023-10-16T13:39:22.322337+0000","last_clean":"2023-10-16T13:39:22.322337+0000","last_became_active":"2023-10-16T13:39:20.917301+0000","last_became_peered":"2023-10-16T13:39:20.917301+0000","last_unstale":"2023-10-16T13:39:22.322337+0000","last_undegraded":"2023-10-16T13:39:22.322337+0000","last_fullsized":"2023-10-16T13:39:22.322337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322289+0000","last_change":"2023-10-16T13:39:19.915793+0000","last_active":"2023-10-16T13:39:22.322289+0000","last_peered":"2023-10-16T13:39:22.322289+0000","last_clean":"2023-10-16T13:39:22.322289+0000","last_became_active":"2023-10-16T13:39:19.913189+0000","last_became_peered":"2023-10-16T13:39:19.913189+0000","last_unstale":"2023-10-16T13:39:22.322289+0000","last_undegraded":"2023-10-16T13:39:22.322289+0000","last_fullsized":"2023-10-16T13:39:22.322289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321637+0000","last_change":"2023-10-16T13:39:20.913612+0000","last_active":"2023-10-16T13:39:22.321637+0000","last_peered":"2023-10-16T13:39:22.321637+0000","last_clean":"2023-10-16T13:39:22.321637+0000","last_became_active":"2023-10-16T13:39:20.913115+0000","last_became_peered":"2023-10-16T13:39:20.913115+0000","last_unstale":"2023-10-16T13:39:22.321637+0000","last_undegraded":"2023-10-16T13:39:22.321637+0000","last_fullsized":"2023-10-16T13:39:22.321637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:50.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321448+0000","last_change":"2023-10-16T13:39:19.919530+0000","last_active":"2023-10-16T13:39:22.321448+0000","last_peered":"2023-10-16T13:39:22.321448+0000","last_clean":"2023-10-16T13:39:22.321448+0000","last_became_active":"2023-10-16T13:39:19.919283+0000","last_became_peered":"2023-10-16T13:39:19.919283+0000","last_unstale":"2023-10-16T13:39:22.321448+0000","last_undegraded":"2023-10-16T13:39:22.321448+0000","last_fullsized":"2023-10-16T13:39:22.321448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908166+0000","last_change":"2023-10-16T13:39:20.919355+0000","last_active":"2023-10-16T13:39:21.908166+0000","last_peered":"2023-10-16T13:39:21.908166+0000","last_clean":"2023-10-16T13:39:21.908166+0000","last_became_active":"2023-10-16T13:39:20.919085+0000","last_became_peered":"2023-10-16T13:39:20.919085+0000","last_unstale":"2023-10-16T13:39:21.908166+0000","last_undegraded":"2023-10-16T13:39:21.908166+0000","last_fullsized":"2023-10-16T13:39:21.908166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:22.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905047+0000","last_change":"2023-10-16T13:39:19.918132+0000","last_active":"2023-10-16T13:39:21.905047+0000","last_peered":"2023-10-16T13:39:21.905047+0000","last_clean":"2023-10-16T13:39:21.905047+0000","last_became_active":"2023-10-16T13:39:19.917873+0000","last_became_peered":"2023-10-16T13:39:19.917873+0000","last_unstale":"2023-10-16T13:39:21.905047+0000","last_undegraded":"2023-10-16T13:39:21.905047+0000","last_fullsized":"2023-10-16T13:39:21.905047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:57.316921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908168+0000","last_change":"2023-10-16T13:39:20.916435+0000","last_active":"2023-10-16T13:39:21.908168+0000","last_peered":"2023-10-16T13:39:21.908168+0000","last_clean":"2023-10-16T13:39:21.908168+0000","last_became_active":"2023-10-16T13:39:20.916130+0000","last_became_peered":"2023-10-16T13:39:20.916130+0000","last_unstale":"2023-10-16T13:39:21.908168+0000","last_undegraded":"2023-10-16T13:39:21.908168+0000","last_fullsized":"2023-10-16T13:39:21.908168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908260+0000","last_change":"2023-10-16T13:39:19.910540+0000","last_active":"2023-10-16T13:39:21.908260+0000","last_peered":"2023-10-16T13:39:21.908260+0000","last_clean":"2023-10-16T13:39:21.908260+0000","last_became_active":"2023-10-16T13:39:19.910286+0000","last_became_peered":"2023-10-16T13:39:19.910286+0000","last_unstale":"2023-10-16T13:39:21.908260+0000","last_undegraded":"2023-10-16T13:39:21.908260+0000","last_fullsized":"2023-10-16T13:39:21.908260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904912+0000","last_change":"2023-10-16T13:39:20.917001+0000","last_active":"2023-10-16T13:39:21.904912+0000","last_peered":"2023-10-16T13:39:21.904912+0000","last_clean":"2023-10-16T13:39:21.904912+0000","last_became_active":"2023-10-16T13:39:20.916713+0000","last_became_peered":"2023-10-16T13:39:20.916713+0000","last_unstale":"2023-10-16T13:39:21.904912+0000","last_undegraded":"2023-10-16T13:39:21.904912+0000","last_fullsized":"2023-10-16T13:39:21.904912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907935+0000","last_change":"2023-10-16T13:39:19.913336+0000","last_active":"2023-10-16T13:39:21.907935+0000","last_peered":"2023-10-16T13:39:21.907935+0000","last_clean":"2023-10-16T13:39:21.907935+0000","last_became_active":"2023-10-16T13:39:19.912317+0000","last_became_peered":"2023-10-16T13:39:19.912317+0000","last_unstale":"2023-10-16T13:39:21.907935+0000","last_undegraded":"2023-10-16T13:39:21.907935+0000","last_fullsized":"2023-10-16T13:39:21.907935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322170+0000","last_change":"2023-10-16T13:39:20.914524+0000","last_active":"2023-10-16T13:39:22.322170+0000","last_peered":"2023-10-16T13:39:22.322170+0000","last_clean":"2023-10-16T13:39:22.322170+0000","last_became_active":"2023-10-16T13:39:20.913796+0000","last_became_peered":"2023-10-16T13:39:20.913796+0000","last_unstale":"2023-10-16T13:39:22.322170+0000","last_undegraded":"2023-10-16T13:39:22.322170+0000","last_fullsized":"2023-10-16T13:39:22.322170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:50.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908250+0000","last_change":"2023-10-16T13:39:19.911516+0000","last_active":"2023-10-16T13:39:21.908250+0000","last_peered":"2023-10-16T13:39:21.908250+0000","last_clean":"2023-10-16T13:39:21.908250+0000","last_became_active":"2023-10-16T13:39:19.911218+0000","last_became_peered":"2023-10-16T13:39:19.911218+0000","last_unstale":"2023-10-16T13:39:21.908250+0000","last_undegraded":"2023-10-16T13:39:21.908250+0000","last_fullsized":"2023-10-16T13:39:21.908250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:27.653967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322114+0000","last_change":"2023-10-16T13:39:20.921060+0000","last_active":"2023-10-16T13:39:22.322114+0000","last_peered":"2023-10-16T13:39:22.322114+0000","last_clean":"2023-10-16T13:39:22.322114+0000","last_became_active":"2023-10-16T13:39:20.920780+0000","last_became_peered":"2023-10-16T13:39:20.920780+0000","last_unstale":"2023-10-16T13:39:22.322114+0000","last_undegraded":"2023-10-16T13:39:22.322114+0000","last_fullsized":"2023-10-16T13:39:22.322114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:36:54.514746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321723+0000","last_change":"2023-10-16T13:39:19.913392+0000","last_active":"2023-10-16T13:39:22.321723+0000","last_peered":"2023-10-16T13:39:22.321723+0000","last_clean":"2023-10-16T13:39:22.321723+0000","last_became_active":"2023-10-16T13:39:19.913123+0000","last_became_peered":"2023-10-16T13:39:19.913123+0000","last_unstale":"2023-10-16T13:39:22.321723+0000","last_undegraded":"2023-10-16T13:39:22.321723+0000","last_fullsized":"2023-10-16T13:39:22.321723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321832+0000","last_change":"2023-10-16T13:39:20.919546+0000","last_active":"2023-10-16T13:39:22.321832+0000","last_peered":"2023-10-16T13:39:22.321832+0000","last_clean":"2023-10-16T13:39:22.321832+0000","last_became_active":"2023-10-16T13:39:20.919294+0000","last_became_peered":"2023-10-16T13:39:20.919294+0000","last_unstale":"2023-10-16T13:39:22.321832+0000","last_undegraded":"2023-10-16T13:39:22.321832+0000","last_fullsized":"2023-10-16T13:39:22.321832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:19.610289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321727+0000","last_change":"2023-10-16T13:39:19.903187+0000","last_active":"2023-10-16T13:39:22.321727+0000","last_peered":"2023-10-16T13:39:22.321727+0000","last_clean":"2023-10-16T13:39:22.321727+0000","last_became_active":"2023-10-16T13:39:19.902860+0000","last_became_peered":"2023-10-16T13:39:19.902860+0000","last_unstale":"2023-10-16T13:39:22.321727+0000","last_undegraded":"2023-10-16T13:39:22.321727+0000","last_fullsized":"2023-10-16T13:39:22.321727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321706+0000","last_change":"2023-10-16T13:39:20.915946+0000","last_active":"2023-10-16T13:39:22.321706+0000","last_peered":"2023-10-16T13:39:22.321706+0000","last_clean":"2023-10-16T13:39:22.321706+0000","last_became_active":"2023-10-16T13:39:20.915670+0000","last_became_peered":"2023-10-16T13:39:20.915670+0000","last_unstale":"2023-10-16T13:39:22.321706+0000","last_undegraded":"2023-10-16T13:39:22.321706+0000","last_fullsized":"2023-10-16T13:39:22.321706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:29.927125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907965+0000","last_change":"2023-10-16T13:39:19.906563+0000","last_active":"2023-10-16T13:39:21.907965+0000","last_peered":"2023-10-16T13:39:21.907965+0000","last_clean":"2023-10-16T13:39:21.907965+0000","last_became_active":"2023-10-16T13:39:19.906291+0000","last_became_peered":"2023-10-16T13:39:19.906291+0000","last_unstale":"2023-10-16T13:39:21.907965+0000","last_undegraded":"2023-10-16T13:39:21.907965+0000","last_fullsized":"2023-10-16T13:39:21.907965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321969+0000","last_change":"2023-10-16T13:39:20.912234+0000","last_active":"2023-10-16T13:39:22.321969+0000","last_peered":"2023-10-16T13:39:22.321969+0000","last_clean":"2023-10-16T13:39:22.321969+0000","last_became_active":"2023-10-16T13:39:20.911937+0000","last_became_peered":"2023-10-16T13:39:20.911937+0000","last_unstale":"2023-10-16T13:39:22.321969+0000","last_undegraded":"2023-10-16T13:39:22.321969+0000","last_fullsized":"2023-10-16T13:39:22.321969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907256+0000","last_change":"2023-10-16T13:39:19.909910+0000","last_active":"2023-10-16T13:39:21.907256+0000","last_peered":"2023-10-16T13:39:21.907256+0000","last_clean":"2023-10-16T13:39:21.907256+0000","last_became_active":"2023-10-16T13:39:19.909600+0000","last_became_peered":"2023-10-16T13:39:19.909600+0000","last_unstale":"2023-10-16T13:39:21.907256+0000","last_undegraded":"2023-10-16T13:39:21.907256+0000","last_fullsized":"2023-10-16T13:39:21.907256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:22.717706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322110+0000","last_change":"2023-10-16T13:39:20.915302+0000","last_active":"2023-10-16T13:39:22.322110+0000","last_peered":"2023-10-16T13:39:22.322110+0000","last_clean":"2023-10-16T13:39:22.322110+0000","last_became_active":"2023-10-16T13:39:20.914945+0000","last_became_peered":"2023-10-16T13:39:20.914945+0000","last_unstale":"2023-10-16T13:39:22.322110+0000","last_undegraded":"2023-10-16T13:39:22.322110+0000","last_fullsized":"2023-10-16T13:39:22.322110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:33.880146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905094+0000","last_change":"2023-10-16T13:39:19.910212+0000","last_active":"2023-10-16T13:39:21.905094+0000","last_peered":"2023-10-16T13:39:21.905094+0000","last_clean":"2023-10-16T13:39:21.905094+0000","last_became_active":"2023-10-16T13:39:19.909900+0000","last_became_peered":"2023-10-16T13:39:19.909900+0000","last_unstale":"2023-10-16T13:39:21.905094+0000","last_undegraded":"2023-10-16T13:39:21.905094+0000","last_fullsized":"2023-10-16T13:39:21.905094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:54.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908168+0000","last_change":"2023-10-16T13:39:20.914323+0000","last_active":"2023-10-16T13:39:21.908168+0000","last_peered":"2023-10-16T13:39:21.908168+0000","last_clean":"2023-10-16T13:39:21.908168+0000","last_became_active":"2023-10-16T13:39:20.914006+0000","last_became_peered":"2023-10-16T13:39:20.914006+0000","last_unstale":"2023-10-16T13:39:21.908168+0000","last_undegraded":"2023-10-16T13:39:21.908168+0000","last_fullsized":"2023-10-16T13:39:21.908168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.928351+0000","last_change":"2023-10-16T13:39:19.911913+0000","last_active":"2023-10-16T13:39:22.928351+0000","last_peered":"2023-10-16T13:39:22.928351+0000","last_clean":"2023-10-16T13:39:22.928351+0000","last_became_active":"2023-10-16T13:39:19.911658+0000","last_became_peered":"2023-10-16T13:39:19.911658+0000","last_unstale":"2023-10-16T13:39:22.928351+0000","last_undegraded":"2023-10-16T13:39:22.928351+0000","last_fullsized":"2023-10-16T13:39:22.928351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322172+0000","last_change":"2023-10-16T13:39:20.917946+0000","last_active":"2023-10-16T13:39:22.322172+0000","last_peered":"2023-10-16T13:39:22.322172+0000","last_clean":"2023-10-16T13:39:22.322172+0000","last_became_active":"2023-10-16T13:39:20.917648+0000","last_became_peered":"2023-10-16T13:39:20.917648+0000","last_unstale":"2023-10-16T13:39:22.322172+0000","last_undegraded":"2023-10-16T13:39:22.322172+0000","last_fullsized":"2023-10-16T13:39:22.322172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:58.318766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904870+0000","last_change":"2023-10-16T13:39:19.918894+0000","last_active":"2023-10-16T13:39:21.904870+0000","last_peered":"2023-10-16T13:39:21.904870+0000","last_clean":"2023-10-16T13:39:21.904870+0000","last_became_active":"2023-10-16T13:39:19.918458+0000","last_became_peered":"2023-10-16T13:39:19.918458+0000","last_unstale":"2023-10-16T13:39:21.904870+0000","last_undegraded":"2023-10-16T13:39:21.904870+0000","last_fullsized":"2023-10-16T13:39:21.904870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:50.118463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321952+0000","last_change":"2023-10-16T13:39:20.915690+0000","last_active":"2023-10-16T13:39:22.321952+0000","last_peered":"2023-10-16T13:39:22.321952+0000","last_clean":"2023-10-16T13:39:22.321952+0000","last_became_active":"2023-10-16T13:39:20.915346+0000","last_became_peered":"2023-10-16T13:39:20.915346+0000","last_unstale":"2023-10-16T13:39:22.321952+0000","last_undegraded":"2023-10-16T13:39:22.321952+0000","last_fullsized":"2023-10-16T13:39:22.321952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:28.655812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321621+0000","last_change":"2023-10-16T13:39:19.917669+0000","last_active":"2023-10-16T13:39:22.321621+0000","last_peered":"2023-10-16T13:39:22.321621+0000","last_clean":"2023-10-16T13:39:22.321621+0000","last_became_active":"2023-10-16T13:39:19.917437+0000","last_became_peered":"2023-10-16T13:39:19.917437+0000","last_unstale":"2023-10-16T13:39:22.321621+0000","last_undegraded":"2023-10-16T13:39:22.321621+0000","last_fullsized":"2023-10-16T13:39:22.321621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321883+0000","last_change":"2023-10-16T13:39:20.919727+0000","last_active":"2023-10-16T13:39:22.321883+0000","last_peered":"2023-10-16T13:39:22.321883+0000","last_clean":"2023-10-16T13:39:22.321883+0000","last_became_active":"2023-10-16T13:39:20.918649+0000","last_became_peered":"2023-10-16T13:39:20.918649+0000","last_unstale":"2023-10-16T13:39:22.321883+0000","last_undegraded":"2023-10-16T13:39:22.321883+0000","last_fullsized":"2023-10-16T13:39:22.321883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:20.057433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904681+0000","last_change":"2023-10-16T13:39:19.909981+0000","last_active":"2023-10-16T13:39:21.904681+0000","last_peered":"2023-10-16T13:39:21.904681+0000","last_clean":"2023-10-16T13:39:21.904681+0000","last_became_active":"2023-10-16T13:39:19.909686+0000","last_became_peered":"2023-10-16T13:39:19.909686+0000","last_unstale":"2023-10-16T13:39:21.904681+0000","last_undegraded":"2023-10-16T13:39:21.904681+0000","last_fullsized":"2023-10-16T13:39:21.904681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:52.304700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321354+0000","last_change":"2023-10-16T13:39:20.908279+0000","last_active":"2023-10-16T13:39:22.321354+0000","last_peered":"2023-10-16T13:39:22.321354+0000","last_clean":"2023-10-16T13:39:22.321354+0000","last_became_active":"2023-10-16T13:39:20.907944+0000","last_became_peered":"2023-10-16T13:39:20.907944+0000","last_unstale":"2023-10-16T13:39:22.321354+0000","last_undegraded":"2023-10-16T13:39:22.321354+0000","last_fullsized":"2023-10-16T13:39:22.321354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908323+0000","last_change":"2023-10-16T13:39:19.911350+0000","last_active":"2023-10-16T13:39:21.908323+0000","last_peered":"2023-10-16T13:39:21.908323+0000","last_clean":"2023-10-16T13:39:21.908323+0000","last_became_active":"2023-10-16T13:39:19.911066+0000","last_became_peered":"2023-10-16T13:39:19.911066+0000","last_unstale":"2023-10-16T13:39:21.908323+0000","last_undegraded":"2023-10-16T13:39:21.908323+0000","last_fullsized":"2023-10-16T13:39:21.908323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907463+0000","last_change":"2023-10-16T13:39:20.920262+0000","last_active":"2023-10-16T13:39:21.907463+0000","last_peered":"2023-10-16T13:39:21.907463+0000","last_clean":"2023-10-16T13:39:21.907463+0000","last_became_active":"2023-10-16T13:39:20.919964+0000","last_became_peered":"2023-10-16T13:39:20.919964+0000","last_unstale":"2023-10-16T13:39:21.907463+0000","last_undegraded":"2023-10-16T13:39:21.907463+0000","last_fullsized":"2023-10-16T13:39:21.907463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:58.318766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321606+0000","last_change":"2023-10-16T13:39:19.912283+0000","last_active":"2023-10-16T13:39:22.321606+0000","last_peered":"2023-10-16T13:39:22.321606+0000","last_clean":"2023-10-16T13:39:22.321606+0000","last_became_active":"2023-10-16T13:39:19.912033+0000","last_became_peered":"2023-10-16T13:39:19.912033+0000","last_unstale":"2023-10-16T13:39:22.321606+0000","last_undegraded":"2023-10-16T13:39:22.321606+0000","last_fullsized":"2023-10-16T13:39:22.321606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:27.653967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322399+0000","last_change":"2023-10-16T13:39:20.912138+0000","last_active":"2023-10-16T13:39:22.322399+0000","last_peered":"2023-10-16T13:39:22.322399+0000","last_clean":"2023-10-16T13:39:22.322399+0000","last_became_active":"2023-10-16T13:39:20.911059+0000","last_became_peered":"2023-10-16T13:39:20.911059+0000","last_unstale":"2023-10-16T13:39:22.322399+0000","last_undegraded":"2023-10-16T13:39:22.322399+0000","last_fullsized":"2023-10-16T13:39:22.322399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321822+0000","last_change":"2023-10-16T13:39:19.911727+0000","last_active":"2023-10-16T13:39:22.321822+0000","last_peered":"2023-10-16T13:39:22.321822+0000","last_clean":"2023-10-16T13:39:22.321822+0000","last_became_active":"2023-10-16T13:39:19.908368+0000","last_became_peered":"2023-10-16T13:39:19.908368+0000","last_unstale":"2023-10-16T13:39:22.321822+0000","last_undegraded":"2023-10-16T13:39:22.321822+0000","last_fullsized":"2023-10-16T13:39:22.321822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:29.357845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T13:39:20.903645+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:39:20.903645+0000","last_peered":"2023-10-16T13:39:20.903645+0000","last_clean":"2023-10-16T13:39:20.903645+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:39:20.903645+0000","last_undegraded":"2023-10-16T13:39:20.903645+0000","last_fullsized":"2023-10-16T13:39:20.903645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.64300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.504},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.625},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.62}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.5},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":736277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":145979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.23999999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.377},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.29499999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.251},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.746}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.626}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76400000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.84099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57699999999999996}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:39:25.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T13:39:26.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.015+0000 7f93dcce7700 1 Processor -- start 2023-10-16T13:39:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.015+0000 7f93dcce7700 1 -- start start 2023-10-16T13:39:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93dcce7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93d815b790 0x7f93d80d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93dcce7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93d80cc390 0x7f93d80cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93dcce7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d815f450 con 0x7f93d80b7140 2023-10-16T13:39:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93dcce7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d80d11c0 con 0x7f93d815b790 2023-10-16T13:39:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93dcce7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d815f6a0 con 0x7f93d80cc390 2023-10-16T13:39:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93d815b790 0x7f93d80d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d5d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f93d80b7140 0x7f93d80cbc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53854/0 (socket says 172.21.15.5:53854) 2023-10-16T13:39:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d5d9b700 1 -- 172.21.15.5:0/2478768143 learned_addr learned my addr 172.21.15.5:0/2478768143 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d6d9d700 1 --2- 172.21.15.5:0/2478768143 >> v2:172.21.15.112:3300/0 conn(0x7f93d80cc390 0x7f93d80cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d659c700 1 -- 172.21.15.5:0/2478768143 >> v2:172.21.15.112:3300/0 conn(0x7f93d80cc390 msgr2=0x7f93d80cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d659c700 1 --2- 172.21.15.5:0/2478768143 >> v2:172.21.15.112:3300/0 conn(0x7f93d80cc390 0x7f93d80cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d659c700 1 -- 172.21.15.5:0/2478768143 >> v1:172.21.15.5:6789/0 conn(0x7f93d80b7140 legacy=0x7f93d80cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d659c700 1 -- 172.21.15.5:0/2478768143 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d815f980 con 0x7f93d815b790 2023-10-16T13:39:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.016+0000 7f93d659c700 1 --2- 172.21.15.5:0/2478768143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80d0c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93d80cedc0 tx=0x7f93c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5d039dffbe9f1f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93d559a700 1 -- 172.21.15.5:0/2478768143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8011830 con 0x7f93d815b790 2023-10-16T13:39:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93d559a700 1 -- 172.21.15.5:0/2478768143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8011990 con 0x7f93d815b790 2023-10-16T13:39:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93d559a700 1 -- 172.21.15.5:0/2478768143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8011d20 con 0x7f93d815b790 2023-10-16T13:39:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 -- 172.21.15.5:0/2478768143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 msgr2=0x7f93d80d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 --2- 172.21.15.5:0/2478768143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80d0c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93d80cedc0 tx=0x7f93c8009b20 comp rx=0 tx=0).stop 2023-10-16T13:39:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 -- 172.21.15.5:0/2478768143 shutdown_connections 2023-10-16T13:39:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 --2- 172.21.15.5:0/2478768143 >> v2:172.21.15.112:3300/0 conn(0x7f93d80cc390 0x7f93d80cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 --2- 172.21.15.5:0/2478768143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80d0c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 -- 172.21.15.5:0/2478768143 >> 172.21.15.5:0/2478768143 conn(0x7f93d80665a0 msgr2=0x7f93d8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 -- 172.21.15.5:0/2478768143 shutdown_connections 2023-10-16T13:39:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.017+0000 7f93dcce7700 1 -- 172.21.15.5:0/2478768143 wait complete. 2023-10-16T13:39:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 Processor -- start 2023-10-16T13:39:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 -- start start 2023-10-16T13:39:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93d80b7140 0x7f93d80c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93d80cc390 0x7f93d81f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81f73f0 con 0x7f93d815b790 2023-10-16T13:39:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81f76d0 con 0x7f93d80b7140 2023-10-16T13:39:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.019+0000 7f93dcce7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81f79b0 con 0x7f93d80cc390 2023-10-16T13:39:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43860/0 (socket says 172.21.15.5:43860) 2023-10-16T13:39:26.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 -- 172.21.15.5:0/4364041 learned_addr learned my addr 172.21.15.5:0/4364041 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:26.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d659c700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93d80b7140 0x7f93d80c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d5d9b700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93d80cc390 0x7f93d81f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 -- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93d80cc390 msgr2=0x7f93d81f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93d80cc390 0x7f93d81f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 -- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93d80b7140 msgr2=0x7f93d80c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93d80b7140 0x7f93d80c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 -- 172.21.15.5:0/4364041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80094a0 con 0x7f93d815b790 2023-10-16T13:39:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93d6d9d700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80b6230 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007e40 tx=0x7f93d000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000ed30 con 0x7f93d815b790 2023-10-16T13:39:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0014420 con 0x7f93d815b790 2023-10-16T13:39:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d81f7c90 con 0x7f93d815b790 2023-10-16T13:39:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00147d0 con 0x7f93d815b790 2023-10-16T13:39:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.020+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d80c7e60 con 0x7f93d815b790 2023-10-16T13:39:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.021+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d80c8020 con 0x7f93d815b790 2023-10-16T13:39:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.022+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f93d0014930 con 0x7f93d815b790 2023-10-16T13:39:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.022+0000 7f93c6ffd700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93b806af00 0x7f93b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.022+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93d0089c80 con 0x7f93d815b790 2023-10-16T13:39:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.023+0000 7f93d659c700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93b806af00 0x7f93b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.023+0000 7f93d659c700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93b806af00 0x7f93b806d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93c80090b0 tx=0x7f93c801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.027+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93d0054d30 con 0x7f93d815b790 2023-10-16T13:39:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.313+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f93d81f81b0 con 0x7f93d815b790 2023-10-16T13:39:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.313+0000 7f93c6ffd700 1 -- 172.21.15.5:0/4364041 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1559 (secure 0 0 0) 0x7f93d81f81b0 con 0x7f93d815b790 2023-10-16T13:39:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:26.316 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":84,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1697463492,"num_in_osds":8,"osd_in_since":1697463484,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":225611776,"bytes_avail":772868501504,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5079}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-16T13:39:15.470304+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-16T13:39:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.315+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93b806af00 msgr2=0x7f93b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.315+0000 7f93dcce7700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93b806af00 0x7f93b806d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93c80090b0 tx=0x7f93c801c040 comp rx=0 tx=0).stop 2023-10-16T13:39:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.315+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 msgr2=0x7f93d80b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.315+0000 7f93dcce7700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80b6230 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007e40 tx=0x7f93d000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.315+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 shutdown_connections 2023-10-16T13:39:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.315+0000 7f93dcce7700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93d815b790 0x7f93d80b6230 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.316+0000 7f93dcce7700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93d80b7140 0x7f93d80c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.316+0000 7f93dcce7700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f93b806af00 0x7f93b806d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.316+0000 7f93dcce7700 1 --2- 172.21.15.5:0/4364041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93d80cc390 0x7f93d81f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.316+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 >> 172.21.15.5:0/4364041 conn(0x7f93d80665a0 msgr2=0x7f93d80b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.316+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 shutdown_connections 2023-10-16T13:39:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.316+0000 7f93dcce7700 1 -- 172.21.15.5:0/4364041 wait complete. 2023-10-16T13:39:26.330 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T13:39:26.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:39:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.453+0000 7f4d56863700 1 Processor -- start 2023-10-16T13:39:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.454+0000 7f4d56863700 1 -- start start 2023-10-16T13:39:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.454+0000 7f4d56863700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d500cd950 0x7f4d5015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.454+0000 7f4d56863700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d500cf290 con 0x7f4d500cede0 2023-10-16T13:39:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.454+0000 7f4d56863700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d500b2d60 con 0x7f4d5006a840 2023-10-16T13:39:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.454+0000 7f4d56863700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d501619a0 con 0x7f4d500cd950 2023-10-16T13:39:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d500cd950 0x7f4d5015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4d500cede0 0x7f4d5015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53870/0 (socket says 172.21.15.5:53870) 2023-10-16T13:39:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4f7fe700 1 -- 172.21.15.5:0/2643890030 learned_addr learned my addr 172.21.15.5:0/2643890030 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4ffff700 1 -- 172.21.15.5:0/2643890030 >> v1:172.21.15.112:6789/0 conn(0x7f4d5006a840 legacy=0x7f4d50161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4ffff700 1 -- 172.21.15.5:0/2643890030 >> v1:172.21.15.5:6789/0 conn(0x7f4d500cede0 legacy=0x7f4d5015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4ffff700 1 -- 172.21.15.5:0/2643890030 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500cdd30 con 0x7f4d500cd950 2023-10-16T13:39:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4ffff700 1 --2- 172.21.15.5:0/2643890030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d500cd950 0x7f4d5015e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009840 tx=0x7f4d40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8da319f168d806 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4effd700 1 -- 172.21.15.5:0/2643890030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004230 con 0x7f4d500cd950 2023-10-16T13:39:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4effd700 1 -- 172.21.15.5:0/2643890030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40004390 con 0x7f4d500cd950 2023-10-16T13:39:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.455+0000 7f4d4effd700 1 -- 172.21.15.5:0/2643890030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400036a0 con 0x7f4d500cd950 2023-10-16T13:39:26.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 -- 172.21.15.5:0/2643890030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d500cd950 msgr2=0x7f4d5015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 --2- 172.21.15.5:0/2643890030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d500cd950 0x7f4d5015e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009840 tx=0x7f4d40009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 -- 172.21.15.5:0/2643890030 shutdown_connections 2023-10-16T13:39:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 --2- 172.21.15.5:0/2643890030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d500cd950 0x7f4d5015e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 -- 172.21.15.5:0/2643890030 >> 172.21.15.5:0/2643890030 conn(0x7f4d5006dae0 msgr2=0x7f4d5006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 -- 172.21.15.5:0/2643890030 shutdown_connections 2023-10-16T13:39:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.456+0000 7f4d56863700 1 -- 172.21.15.5:0/2643890030 wait complete. 2023-10-16T13:39:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.457+0000 7f4d56863700 1 Processor -- start 2023-10-16T13:39:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.457+0000 7f4d56863700 1 -- start start 2023-10-16T13:39:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d56863700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 0x7f4d50153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d56863700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d500cd950 0x7f4d500c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d56863700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d500cede0 0x7f4d500c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d56863700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500c8850 con 0x7f4d5006a840 2023-10-16T13:39:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d56863700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50153a90 con 0x7f4d500cede0 2023-10-16T13:39:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d56863700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500c69b0 con 0x7f4d500cd950 2023-10-16T13:39:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 0x7f4d50153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 0x7f4d50153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43870/0 (socket says 172.21.15.5:43870) 2023-10-16T13:39:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 -- 172.21.15.5:0/1406016653 learned_addr learned my addr 172.21.15.5:0/1406016653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d54e00700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d500cede0 0x7f4d500c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4f7fe700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d500cd950 0x7f4d500c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 -- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d500cd950 msgr2=0x7f4d500c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d500cd950 0x7f4d500c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 -- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d500cede0 msgr2=0x7f4d500c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d500cede0 0x7f4d500c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.458+0000 7f4d4ffff700 1 -- 172.21.15.5:0/1406016653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400094a0 con 0x7f4d5006a840 2023-10-16T13:39:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.459+0000 7f4d4ffff700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 0x7f4d50153550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4d500cf420 tx=0x7f4d40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.459+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011830 con 0x7f4d5006a840 2023-10-16T13:39:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.459+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4001f070 con 0x7f4d5006a840 2023-10-16T13:39:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.459+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d500c7f80 con 0x7f4d5006a840 2023-10-16T13:39:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.459+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011bd0 con 0x7f4d5006a840 2023-10-16T13:39:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.459+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d500c8200 con 0x7f4d5006a840 2023-10-16T13:39:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.460+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d500c8a00 con 0x7f4d5006a840 2023-10-16T13:39:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.460+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d40011d30 con 0x7f4d5006a840 2023-10-16T13:39:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.461+0000 7f4d4cff9700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d3006af00 0x7f4d3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.461+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d40021070 con 0x7f4d5006a840 2023-10-16T13:39:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.461+0000 7f4d4f7fe700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d3006af00 0x7f4d3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.462+0000 7f4d4f7fe700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d3006af00 0x7f4d3006d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d38007fd0 tx=0x7f4d38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.466+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d500c8a00 con 0x7f4d5006a840 2023-10-16T13:39:26.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.661+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d5015ec00 con 0x7f4d3006af00 2023-10-16T13:39:26.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.670+0000 7f4d4cff9700 1 -- 172.21.15.5:0/1406016653 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289551 (secure 0 0 0) 0x7f4d380070d0 con 0x7f4d3006af00 2023-10-16T13:39:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:26.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d3006af00 msgr2=0x7f4d3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d3006af00 0x7f4d3006d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d38007fd0 tx=0x7f4d38009040 comp rx=0 tx=0).stop 2023-10-16T13:39:26.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 msgr2=0x7f4d50153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:26.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 0x7f4d50153550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4d500cf420 tx=0x7f4d40004750 comp rx=0 tx=0).stop 2023-10-16T13:39:26.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 shutdown_connections 2023-10-16T13:39:26.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d500cede0 0x7f4d500c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5006a840 0x7f4d50153550 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d3006af00 0x7f4d3006d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 --2- 172.21.15.5:0/1406016653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d500cd950 0x7f4d500c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:26.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 >> 172.21.15.5:0/1406016653 conn(0x7f4d5006dae0 msgr2=0x7f4d500b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:26.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 shutdown_connections 2023-10-16T13:39:26.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:26.673+0000 7f4d56863700 1 -- 172.21.15.5:0/1406016653 wait complete. 2023-10-16T13:39:26.680 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:39:26.688 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-16T13:39:25.472603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4128,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4227072,"data_stored":2358942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001604"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321973+0000","last_change":"2023-10-16T13:39:20.917920+0000","last_active":"2023-10-16T13:39:22.321973+0000","last_peered":"2023-10-16T13:39:22.321973+0000","last_clean":"2023-10-16T13:39:22.321973+0000","last_became_active":"2023-10-16T13:39:20.917664+0000","last_became_peered":"2023-10-16T13:39:20.917664+0000","last_unstale":"2023-10-16T13:39:22.321973+0000","last_undegraded":"2023-10-16T13:39:22.321973+0000","last_fullsized":"2023-10-16T13:39:22.321973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:57.327298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322800+0000","last_change":"2023-10-16T13:39:20.921778+0000","last_active":"2023-10-16T13:39:22.322800+0000","last_peered":"2023-10-16T13:39:22.322800+0000","last_clean":"2023-10-16T13:39:22.322800+0000","last_became_active":"2023-10-16T13:39:20.921486+0000","last_became_peered":"2023-10-16T13:39:20.921486+0000","last_unstale":"2023-10-16T13:39:22.322800+0000","last_undegraded":"2023-10-16T13:39:22.322800+0000","last_fullsized":"2023-10-16T13:39:22.322800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:46.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907764+0000","last_change":"2023-10-16T13:39:20.916833+0000","last_active":"2023-10-16T13:39:21.907764+0000","last_peered":"2023-10-16T13:39:21.907764+0000","last_clean":"2023-10-16T13:39:21.907764+0000","last_became_active":"2023-10-16T13:39:20.916446+0000","last_became_peered":"2023-10-16T13:39:20.916446+0000","last_unstale":"2023-10-16T13:39:21.907764+0000","last_undegraded":"2023-10-16T13:39:21.907764+0000","last_fullsized":"2023-10-16T13:39:21.907764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904774+0000","last_change":"2023-10-16T13:39:20.916712+0000","last_active":"2023-10-16T13:39:21.904774+0000","last_peered":"2023-10-16T13:39:21.904774+0000","last_clean":"2023-10-16T13:39:21.904774+0000","last_became_active":"2023-10-16T13:39:20.916402+0000","last_became_peered":"2023-10-16T13:39:20.916402+0000","last_unstale":"2023-10-16T13:39:21.904774+0000","last_undegraded":"2023-10-16T13:39:21.904774+0000","last_fullsized":"2023-10-16T13:39:21.904774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:22.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321718+0000","last_change":"2023-10-16T13:39:20.908249+0000","last_active":"2023-10-16T13:39:22.321718+0000","last_peered":"2023-10-16T13:39:22.321718+0000","last_clean":"2023-10-16T13:39:22.321718+0000","last_became_active":"2023-10-16T13:39:20.907713+0000","last_became_peered":"2023-10-16T13:39:20.907713+0000","last_unstale":"2023-10-16T13:39:22.321718+0000","last_undegraded":"2023-10-16T13:39:22.321718+0000","last_fullsized":"2023-10-16T13:39:22.321718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:35.718910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322492+0000","last_change":"2023-10-16T13:39:20.916044+0000","last_active":"2023-10-16T13:39:22.322492+0000","last_peered":"2023-10-16T13:39:22.322492+0000","last_clean":"2023-10-16T13:39:22.322492+0000","last_became_active":"2023-10-16T13:39:20.915691+0000","last_became_peered":"2023-10-16T13:39:20.915691+0000","last_unstale":"2023-10-16T13:39:22.322492+0000","last_undegraded":"2023-10-16T13:39:22.322492+0000","last_fullsized":"2023-10-16T13:39:22.322492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321737+0000","last_change":"2023-10-16T13:39:20.913478+0000","last_active":"2023-10-16T13:39:22.321737+0000","last_peered":"2023-10-16T13:39:22.321737+0000","last_clean":"2023-10-16T13:39:22.321737+0000","last_became_active":"2023-10-16T13:39:20.913217+0000","last_became_peered":"2023-10-16T13:39:20.913217+0000","last_unstale":"2023-10-16T13:39:22.321737+0000","last_undegraded":"2023-10-16T13:39:22.321737+0000","last_fullsized":"2023-10-16T13:39:22.321737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321635+0000","last_change":"2023-10-16T13:39:20.911699+0000","last_active":"2023-10-16T13:39:22.321635+0000","last_peered":"2023-10-16T13:39:22.321635+0000","last_clean":"2023-10-16T13:39:22.321635+0000","last_became_active":"2023-10-16T13:39:20.911073+0000","last_became_peered":"2023-10-16T13:39:20.911073+0000","last_unstale":"2023-10-16T13:39:22.321635+0000","last_undegraded":"2023-10-16T13:39:22.321635+0000","last_fullsized":"2023-10-16T13:39:22.321635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908390+0000","last_change":"2023-10-16T13:39:20.916353+0000","last_active":"2023-10-16T13:39:21.908390+0000","last_peered":"2023-10-16T13:39:21.908390+0000","last_clean":"2023-10-16T13:39:21.908390+0000","last_became_active":"2023-10-16T13:39:20.916059+0000","last_became_peered":"2023-10-16T13:39:20.916059+0000","last_unstale":"2023-10-16T13:39:21.908390+0000","last_undegraded":"2023-10-16T13:39:21.908390+0000","last_fullsized":"2023-10-16T13:39:21.908390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904850+0000","last_change":"2023-10-16T13:39:20.907199+0000","last_active":"2023-10-16T13:39:21.904850+0000","last_peered":"2023-10-16T13:39:21.904850+0000","last_clean":"2023-10-16T13:39:21.904850+0000","last_became_active":"2023-10-16T13:39:20.906893+0000","last_became_peered":"2023-10-16T13:39:20.906893+0000","last_unstale":"2023-10-16T13:39:21.904850+0000","last_undegraded":"2023-10-16T13:39:21.904850+0000","last_fullsized":"2023-10-16T13:39:21.904850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322409+0000","last_change":"2023-10-16T13:39:20.912098+0000","last_active":"2023-10-16T13:39:22.322409+0000","last_peered":"2023-10-16T13:39:22.322409+0000","last_clean":"2023-10-16T13:39:22.322409+0000","last_became_active":"2023-10-16T13:39:20.911773+0000","last_became_peered":"2023-10-16T13:39:20.911773+0000","last_unstale":"2023-10-16T13:39:22.322409+0000","last_undegraded":"2023-10-16T13:39:22.322409+0000","last_fullsized":"2023-10-16T13:39:22.322409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907639+0000","last_change":"2023-10-16T13:39:20.917806+0000","last_active":"2023-10-16T13:39:21.907639+0000","last_peered":"2023-10-16T13:39:21.907639+0000","last_clean":"2023-10-16T13:39:21.907639+0000","last_became_active":"2023-10-16T13:39:20.916708+0000","last_became_peered":"2023-10-16T13:39:20.916708+0000","last_unstale":"2023-10-16T13:39:21.907639+0000","last_undegraded":"2023-10-16T13:39:21.907639+0000","last_fullsized":"2023-10-16T13:39:21.907639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321983+0000","last_change":"2023-10-16T13:39:20.907695+0000","last_active":"2023-10-16T13:39:22.321983+0000","last_peered":"2023-10-16T13:39:22.321983+0000","last_clean":"2023-10-16T13:39:22.321983+0000","last_became_active":"2023-10-16T13:39:20.907292+0000","last_became_peered":"2023-10-16T13:39:20.907292+0000","last_unstale":"2023-10-16T13:39:22.321983+0000","last_undegraded":"2023-10-16T13:39:22.321983+0000","last_fullsized":"2023-10-16T13:39:22.321983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:25.691612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322608+0000","last_change":"2023-10-16T13:39:20.911433+0000","last_active":"2023-10-16T13:39:22.322608+0000","last_peered":"2023-10-16T13:39:22.322608+0000","last_clean":"2023-10-16T13:39:22.322608+0000","last_became_active":"2023-10-16T13:39:20.908506+0000","last_became_peered":"2023-10-16T13:39:20.908506+0000","last_unstale":"2023-10-16T13:39:22.322608+0000","last_undegraded":"2023-10-16T13:39:22.322608+0000","last_fullsized":"2023-10-16T13:39:22.322608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907530+0000","last_change":"2023-10-16T13:39:20.912733+0000","last_active":"2023-10-16T13:39:21.907530+0000","last_peered":"2023-10-16T13:39:21.907530+0000","last_clean":"2023-10-16T13:39:21.907530+0000","last_became_active":"2023-10-16T13:39:20.912435+0000","last_became_peered":"2023-10-16T13:39:20.912435+0000","last_unstale":"2023-10-16T13:39:21.907530+0000","last_undegraded":"2023-10-16T13:39:21.907530+0000","last_fullsized":"2023-10-16T13:39:21.907530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322076+0000","last_change":"2023-10-16T13:39:20.911890+0000","last_active":"2023-10-16T13:39:22.322076+0000","last_peered":"2023-10-16T13:39:22.322076+0000","last_clean":"2023-10-16T13:39:22.322076+0000","last_became_active":"2023-10-16T13:39:20.911408+0000","last_became_peered":"2023-10-16T13:39:20.911408+0000","last_unstale":"2023-10-16T13:39:22.322076+0000","last_undegraded":"2023-10-16T13:39:22.322076+0000","last_fullsized":"2023-10-16T13:39:22.322076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322461+0000","last_change":"2023-10-16T13:39:20.911690+0000","last_active":"2023-10-16T13:39:22.322461+0000","last_peered":"2023-10-16T13:39:22.322461+0000","last_clean":"2023-10-16T13:39:22.322461+0000","last_became_active":"2023-10-16T13:39:20.911273+0000","last_became_peered":"2023-10-16T13:39:20.911273+0000","last_unstale":"2023-10-16T13:39:22.322461+0000","last_undegraded":"2023-10-16T13:39:22.322461+0000","last_fullsized":"2023-10-16T13:39:22.322461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:33.274046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322764+0000","last_change":"2023-10-16T13:39:20.908210+0000","last_active":"2023-10-16T13:39:22.322764+0000","last_peered":"2023-10-16T13:39:22.322764+0000","last_clean":"2023-10-16T13:39:22.322764+0000","last_became_active":"2023-10-16T13:39:20.907809+0000","last_became_peered":"2023-10-16T13:39:20.907809+0000","last_unstale":"2023-10-16T13:39:22.322764+0000","last_undegraded":"2023-10-16T13:39:22.322764+0000","last_fullsized":"2023-10-16T13:39:22.322764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:33.274046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322607+0000","last_change":"2023-10-16T13:39:20.909508+0000","last_active":"2023-10-16T13:39:22.322607+0000","last_peered":"2023-10-16T13:39:22.322607+0000","last_clean":"2023-10-16T13:39:22.322607+0000","last_became_active":"2023-10-16T13:39:20.909057+0000","last_became_peered":"2023-10-16T13:39:20.909057+0000","last_unstale":"2023-10-16T13:39:22.322607+0000","last_undegraded":"2023-10-16T13:39:22.322607+0000","last_fullsized":"2023-10-16T13:39:22.322607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322105+0000","last_change":"2023-10-16T13:39:20.915174+0000","last_active":"2023-10-16T13:39:22.322105+0000","last_peered":"2023-10-16T13:39:22.322105+0000","last_clean":"2023-10-16T13:39:22.322105+0000","last_became_active":"2023-10-16T13:39:20.914871+0000","last_became_peered":"2023-10-16T13:39:20.914871+0000","last_unstale":"2023-10-16T13:39:22.322105+0000","last_undegraded":"2023-10-16T13:39:22.322105+0000","last_fullsized":"2023-10-16T13:39:22.322105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:17.687258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907683+0000","last_change":"2023-10-16T13:39:20.919458+0000","last_active":"2023-10-16T13:39:21.907683+0000","last_peered":"2023-10-16T13:39:21.907683+0000","last_clean":"2023-10-16T13:39:21.907683+0000","last_became_active":"2023-10-16T13:39:20.919200+0000","last_became_peered":"2023-10-16T13:39:20.919200+0000","last_unstale":"2023-10-16T13:39:21.907683+0000","last_undegraded":"2023-10-16T13:39:21.907683+0000","last_fullsized":"2023-10-16T13:39:21.907683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:55.268898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908551+0000","last_change":"2023-10-16T13:39:20.920940+0000","last_active":"2023-10-16T13:39:21.908551+0000","last_peered":"2023-10-16T13:39:21.908551+0000","last_clean":"2023-10-16T13:39:21.908551+0000","last_became_active":"2023-10-16T13:39:20.920666+0000","last_became_peered":"2023-10-16T13:39:20.920666+0000","last_unstale":"2023-10-16T13:39:21.908551+0000","last_undegraded":"2023-10-16T13:39:21.908551+0000","last_fullsized":"2023-10-16T13:39:21.908551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321941+0000","last_change":"2023-10-16T13:39:20.919286+0000","last_active":"2023-10-16T13:39:22.321941+0000","last_peered":"2023-10-16T13:39:22.321941+0000","last_clean":"2023-10-16T13:39:22.321941+0000","last_became_active":"2023-10-16T13:39:20.919011+0000","last_became_peered":"2023-10-16T13:39:20.919011+0000","last_unstale":"2023-10-16T13:39:22.321941+0000","last_undegraded":"2023-10-16T13:39:22.321941+0000","last_fullsized":"2023-10-16T13:39:22.321941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:51.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908318+0000","last_change":"2023-10-16T13:39:20.912715+0000","last_active":"2023-10-16T13:39:21.908318+0000","last_peered":"2023-10-16T13:39:21.908318+0000","last_clean":"2023-10-16T13:39:21.908318+0000","last_became_active":"2023-10-16T13:39:20.912415+0000","last_became_peered":"2023-10-16T13:39:20.912415+0000","last_unstale":"2023-10-16T13:39:21.908318+0000","last_undegraded":"2023-10-16T13:39:21.908318+0000","last_fullsized":"2023-10-16T13:39:21.908318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904931+0000","last_change":"2023-10-16T13:39:20.914168+0000","last_active":"2023-10-16T13:39:21.904931+0000","last_peered":"2023-10-16T13:39:21.904931+0000","last_clean":"2023-10-16T13:39:21.904931+0000","last_became_active":"2023-10-16T13:39:20.913858+0000","last_became_peered":"2023-10-16T13:39:20.913858+0000","last_unstale":"2023-10-16T13:39:21.904931+0000","last_undegraded":"2023-10-16T13:39:21.904931+0000","last_fullsized":"2023-10-16T13:39:21.904931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322849+0000","last_change":"2023-10-16T13:39:20.911171+0000","last_active":"2023-10-16T13:39:22.322849+0000","last_peered":"2023-10-16T13:39:22.322849+0000","last_clean":"2023-10-16T13:39:22.322849+0000","last_became_active":"2023-10-16T13:39:20.910845+0000","last_became_peered":"2023-10-16T13:39:20.910845+0000","last_unstale":"2023-10-16T13:39:22.322849+0000","last_undegraded":"2023-10-16T13:39:22.322849+0000","last_fullsized":"2023-10-16T13:39:22.322849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:49.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905139+0000","last_change":"2023-10-16T13:39:20.914590+0000","last_active":"2023-10-16T13:39:21.905139+0000","last_peered":"2023-10-16T13:39:21.905139+0000","last_clean":"2023-10-16T13:39:21.905139+0000","last_became_active":"2023-10-16T13:39:20.913686+0000","last_became_peered":"2023-10-16T13:39:20.913686+0000","last_unstale":"2023-10-16T13:39:21.905139+0000","last_undegraded":"2023-10-16T13:39:21.905139+0000","last_fullsized":"2023-10-16T13:39:21.905139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907802+0000","last_change":"2023-10-16T13:39:20.921650+0000","last_active":"2023-10-16T13:39:21.907802+0000","last_peered":"2023-10-16T13:39:21.907802+0000","last_clean":"2023-10-16T13:39:21.907802+0000","last_became_active":"2023-10-16T13:39:20.921396+0000","last_became_peered":"2023-10-16T13:39:20.921396+0000","last_unstale":"2023-10-16T13:39:21.907802+0000","last_undegraded":"2023-10-16T13:39:21.907802+0000","last_fullsized":"2023-10-16T13:39:21.907802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907822+0000","last_change":"2023-10-16T13:39:20.917637+0000","last_active":"2023-10-16T13:39:21.907822+0000","last_peered":"2023-10-16T13:39:21.907822+0000","last_clean":"2023-10-16T13:39:21.907822+0000","last_became_active":"2023-10-16T13:39:20.917363+0000","last_became_peered":"2023-10-16T13:39:20.917363+0000","last_unstale":"2023-10-16T13:39:21.907822+0000","last_undegraded":"2023-10-16T13:39:21.907822+0000","last_fullsized":"2023-10-16T13:39:21.907822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:23.719551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322050+0000","last_change":"2023-10-16T13:39:20.911850+0000","last_active":"2023-10-16T13:39:22.322050+0000","last_peered":"2023-10-16T13:39:22.322050+0000","last_clean":"2023-10-16T13:39:22.322050+0000","last_became_active":"2023-10-16T13:39:20.911461+0000","last_became_peered":"2023-10-16T13:39:20.911461+0000","last_unstale":"2023-10-16T13:39:22.322050+0000","last_undegraded":"2023-10-16T13:39:22.322050+0000","last_fullsized":"2023-10-16T13:39:22.322050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321747+0000","last_change":"2023-10-16T13:39:20.910894+0000","last_active":"2023-10-16T13:39:22.321747+0000","last_peered":"2023-10-16T13:39:22.321747+0000","last_clean":"2023-10-16T13:39:22.321747+0000","last_became_active":"2023-10-16T13:39:20.910625+0000","last_became_peered":"2023-10-16T13:39:20.910625+0000","last_unstale":"2023-10-16T13:39:22.321747+0000","last_undegraded":"2023-10-16T13:39:22.321747+0000","last_fullsized":"2023-10-16T13:39:22.321747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:31.113460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322406+0000","last_change":"2023-10-16T13:39:20.917952+0000","last_active":"2023-10-16T13:39:22.322406+0000","last_peered":"2023-10-16T13:39:22.322406+0000","last_clean":"2023-10-16T13:39:22.322406+0000","last_became_active":"2023-10-16T13:39:20.917672+0000","last_became_peered":"2023-10-16T13:39:20.917672+0000","last_unstale":"2023-10-16T13:39:22.322406+0000","last_undegraded":"2023-10-16T13:39:22.322406+0000","last_fullsized":"2023-10-16T13:39:22.322406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321764+0000","last_change":"2023-10-16T13:39:20.922400+0000","last_active":"2023-10-16T13:39:22.321764+0000","last_peered":"2023-10-16T13:39:22.321764+0000","last_clean":"2023-10-16T13:39:22.321764+0000","last_became_active":"2023-10-16T13:39:20.921792+0000","last_became_peered":"2023-10-16T13:39:20.921792+0000","last_unstale":"2023-10-16T13:39:22.321764+0000","last_undegraded":"2023-10-16T13:39:22.321764+0000","last_fullsized":"2023-10-16T13:39:22.321764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:57.327298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322196+0000","last_change":"2023-10-16T13:39:19.913389+0000","last_active":"2023-10-16T13:39:22.322196+0000","last_peered":"2023-10-16T13:39:22.322196+0000","last_clean":"2023-10-16T13:39:22.322196+0000","last_became_active":"2023-10-16T13:39:19.913122+0000","last_became_peered":"2023-10-16T13:39:19.913122+0000","last_unstale":"2023-10-16T13:39:22.322196+0000","last_undegraded":"2023-10-16T13:39:22.322196+0000","last_fullsized":"2023-10-16T13:39:22.322196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322098+0000","last_change":"2023-10-16T13:39:20.917450+0000","last_active":"2023-10-16T13:39:22.322098+0000","last_peered":"2023-10-16T13:39:22.322098+0000","last_clean":"2023-10-16T13:39:22.322098+0000","last_became_active":"2023-10-16T13:39:20.917157+0000","last_became_peered":"2023-10-16T13:39:20.917157+0000","last_unstale":"2023-10-16T13:39:22.322098+0000","last_undegraded":"2023-10-16T13:39:22.322098+0000","last_fullsized":"2023-10-16T13:39:22.322098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:20.057433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322006+0000","last_change":"2023-10-16T13:39:19.914389+0000","last_active":"2023-10-16T13:39:22.322006+0000","last_peered":"2023-10-16T13:39:22.322006+0000","last_clean":"2023-10-16T13:39:22.322006+0000","last_became_active":"2023-10-16T13:39:19.914126+0000","last_became_peered":"2023-10-16T13:39:19.914126+0000","last_unstale":"2023-10-16T13:39:22.322006+0000","last_undegraded":"2023-10-16T13:39:22.322006+0000","last_fullsized":"2023-10-16T13:39:22.322006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:30.111615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908163+0000","last_change":"2023-10-16T13:39:20.917550+0000","last_active":"2023-10-16T13:39:21.908163+0000","last_peered":"2023-10-16T13:39:21.908163+0000","last_clean":"2023-10-16T13:39:21.908163+0000","last_became_active":"2023-10-16T13:39:20.917261+0000","last_became_peered":"2023-10-16T13:39:20.917261+0000","last_unstale":"2023-10-16T13:39:21.908163+0000","last_undegraded":"2023-10-16T13:39:21.908163+0000","last_fullsized":"2023-10-16T13:39:21.908163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:54.865090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322570+0000","last_change":"2023-10-16T13:39:19.907530+0000","last_active":"2023-10-16T13:39:22.322570+0000","last_peered":"2023-10-16T13:39:22.322570+0000","last_clean":"2023-10-16T13:39:22.322570+0000","last_became_active":"2023-10-16T13:39:19.907179+0000","last_became_peered":"2023-10-16T13:39:19.907179+0000","last_unstale":"2023-10-16T13:39:22.322570+0000","last_undegraded":"2023-10-16T13:39:22.322570+0000","last_fullsized":"2023-10-16T13:39:22.322570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:21.592605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905114+0000","last_change":"2023-10-16T13:39:20.914196+0000","last_active":"2023-10-16T13:39:21.905114+0000","last_peered":"2023-10-16T13:39:21.905114+0000","last_clean":"2023-10-16T13:39:21.905114+0000","last_became_active":"2023-10-16T13:39:20.913327+0000","last_became_peered":"2023-10-16T13:39:20.913327+0000","last_unstale":"2023-10-16T13:39:21.905114+0000","last_undegraded":"2023-10-16T13:39:21.905114+0000","last_fullsized":"2023-10-16T13:39:21.905114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322176+0000","last_change":"2023-10-16T13:39:19.912833+0000","last_active":"2023-10-16T13:39:22.322176+0000","last_peered":"2023-10-16T13:39:22.322176+0000","last_clean":"2023-10-16T13:39:22.322176+0000","last_became_active":"2023-10-16T13:39:19.912335+0000","last_became_peered":"2023-10-16T13:39:19.912335+0000","last_unstale":"2023-10-16T13:39:22.322176+0000","last_undegraded":"2023-10-16T13:39:22.322176+0000","last_fullsized":"2023-10-16T13:39:22.322176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:29.357845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322346+0000","last_change":"2023-10-16T13:39:20.920905+0000","last_active":"2023-10-16T13:39:22.322346+0000","last_peered":"2023-10-16T13:39:22.322346+0000","last_clean":"2023-10-16T13:39:22.322346+0000","last_became_active":"2023-10-16T13:39:20.920590+0000","last_became_peered":"2023-10-16T13:39:20.920590+0000","last_unstale":"2023-10-16T13:39:22.322346+0000","last_undegraded":"2023-10-16T13:39:22.322346+0000","last_fullsized":"2023-10-16T13:39:22.322346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907989+0000","last_change":"2023-10-16T13:39:19.911910+0000","last_active":"2023-10-16T13:39:21.907989+0000","last_peered":"2023-10-16T13:39:21.907989+0000","last_clean":"2023-10-16T13:39:21.907989+0000","last_became_active":"2023-10-16T13:39:19.911583+0000","last_became_peered":"2023-10-16T13:39:19.911583+0000","last_unstale":"2023-10-16T13:39:21.907989+0000","last_undegraded":"2023-10-16T13:39:21.907989+0000","last_fullsized":"2023-10-16T13:39:21.907989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:19.055588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907876+0000","last_change":"2023-10-16T13:39:20.915190+0000","last_active":"2023-10-16T13:39:21.907876+0000","last_peered":"2023-10-16T13:39:21.907876+0000","last_clean":"2023-10-16T13:39:21.907876+0000","last_became_active":"2023-10-16T13:39:20.914925+0000","last_became_peered":"2023-10-16T13:39:20.914925+0000","last_unstale":"2023-10-16T13:39:21.907876+0000","last_undegraded":"2023-10-16T13:39:21.907876+0000","last_fullsized":"2023-10-16T13:39:21.907876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908562+0000","last_change":"2023-10-16T13:39:19.911559+0000","last_active":"2023-10-16T13:39:21.908562+0000","last_peered":"2023-10-16T13:39:21.908562+0000","last_clean":"2023-10-16T13:39:21.908562+0000","last_became_active":"2023-10-16T13:39:19.911241+0000","last_became_peered":"2023-10-16T13:39:19.911241+0000","last_unstale":"2023-10-16T13:39:21.908562+0000","last_undegraded":"2023-10-16T13:39:21.908562+0000","last_fullsized":"2023-10-16T13:39:21.908562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:30.111615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907623+0000","last_change":"2023-10-16T13:39:20.912896+0000","last_active":"2023-10-16T13:39:21.907623+0000","last_peered":"2023-10-16T13:39:21.907623+0000","last_clean":"2023-10-16T13:39:21.907623+0000","last_became_active":"2023-10-16T13:39:20.912615+0000","last_became_peered":"2023-10-16T13:39:20.912615+0000","last_unstale":"2023-10-16T13:39:21.907623+0000","last_undegraded":"2023-10-16T13:39:21.907623+0000","last_fullsized":"2023-10-16T13:39:21.907623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:53.306545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322286+0000","last_change":"2023-10-16T13:39:19.912803+0000","last_active":"2023-10-16T13:39:22.322286+0000","last_peered":"2023-10-16T13:39:22.322286+0000","last_clean":"2023-10-16T13:39:22.322286+0000","last_became_active":"2023-10-16T13:39:19.912421+0000","last_became_peered":"2023-10-16T13:39:19.912421+0000","last_unstale":"2023-10-16T13:39:22.322286+0000","last_undegraded":"2023-10-16T13:39:22.322286+0000","last_fullsized":"2023-10-16T13:39:22.322286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904560+0000","last_change":"2023-10-16T13:39:20.914138+0000","last_active":"2023-10-16T13:39:21.904560+0000","last_peered":"2023-10-16T13:39:21.904560+0000","last_clean":"2023-10-16T13:39:21.904560+0000","last_became_active":"2023-10-16T13:39:20.913876+0000","last_became_peered":"2023-10-16T13:39:20.913876+0000","last_unstale":"2023-10-16T13:39:21.904560+0000","last_undegraded":"2023-10-16T13:39:21.904560+0000","last_fullsized":"2023-10-16T13:39:21.904560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:23.719551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907447+0000","last_change":"2023-10-16T13:39:19.910502+0000","last_active":"2023-10-16T13:39:21.907447+0000","last_peered":"2023-10-16T13:39:21.907447+0000","last_clean":"2023-10-16T13:39:21.907447+0000","last_became_active":"2023-10-16T13:39:19.910217+0000","last_became_peered":"2023-10-16T13:39:19.910217+0000","last_unstale":"2023-10-16T13:39:21.907447+0000","last_undegraded":"2023-10-16T13:39:21.907447+0000","last_fullsized":"2023-10-16T13:39:21.907447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:56.325453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908310+0000","last_change":"2023-10-16T13:39:20.913603+0000","last_active":"2023-10-16T13:39:21.908310+0000","last_peered":"2023-10-16T13:39:21.908310+0000","last_clean":"2023-10-16T13:39:21.908310+0000","last_became_active":"2023-10-16T13:39:20.913251+0000","last_became_peered":"2023-10-16T13:39:20.913251+0000","last_unstale":"2023-10-16T13:39:21.908310+0000","last_undegraded":"2023-10-16T13:39:21.908310+0000","last_fullsized":"2023-10-16T13:39:21.908310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322768+0000","last_change":"2023-10-16T13:39:19.915218+0000","last_active":"2023-10-16T13:39:22.322768+0000","last_peered":"2023-10-16T13:39:22.322768+0000","last_clean":"2023-10-16T13:39:22.322768+0000","last_became_active":"2023-10-16T13:39:19.913215+0000","last_became_peered":"2023-10-16T13:39:19.913215+0000","last_unstale":"2023-10-16T13:39:22.322768+0000","last_undegraded":"2023-10-16T13:39:22.322768+0000","last_fullsized":"2023-10-16T13:39:22.322768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:54.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322802+0000","last_change":"2023-10-16T13:39:20.908775+0000","last_active":"2023-10-16T13:39:22.322802+0000","last_peered":"2023-10-16T13:39:22.322802+0000","last_clean":"2023-10-16T13:39:22.322802+0000","last_became_active":"2023-10-16T13:39:20.908468+0000","last_became_peered":"2023-10-16T13:39:20.908468+0000","last_unstale":"2023-10-16T13:39:22.322802+0000","last_undegraded":"2023-10-16T13:39:22.322802+0000","last_fullsized":"2023-10-16T13:39:22.322802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:00.699575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321864+0000","last_change":"2023-10-16T13:39:19.911047+0000","last_active":"2023-10-16T13:39:22.321864+0000","last_peered":"2023-10-16T13:39:22.321864+0000","last_clean":"2023-10-16T13:39:22.321864+0000","last_became_active":"2023-10-16T13:39:19.910721+0000","last_became_peered":"2023-10-16T13:39:19.910721+0000","last_unstale":"2023-10-16T13:39:22.321864+0000","last_undegraded":"2023-10-16T13:39:22.321864+0000","last_fullsized":"2023-10-16T13:39:22.321864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322678+0000","last_change":"2023-10-16T13:39:20.912846+0000","last_active":"2023-10-16T13:39:22.322678+0000","last_peered":"2023-10-16T13:39:22.322678+0000","last_clean":"2023-10-16T13:39:22.322678+0000","last_became_active":"2023-10-16T13:39:20.912556+0000","last_became_peered":"2023-10-16T13:39:20.912556+0000","last_unstale":"2023-10-16T13:39:22.322678+0000","last_undegraded":"2023-10-16T13:39:22.322678+0000","last_fullsized":"2023-10-16T13:39:22.322678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908002+0000","last_change":"2023-10-16T13:39:19.913341+0000","last_active":"2023-10-16T13:39:21.908002+0000","last_peered":"2023-10-16T13:39:21.908002+0000","last_clean":"2023-10-16T13:39:21.908002+0000","last_became_active":"2023-10-16T13:39:19.913078+0000","last_became_peered":"2023-10-16T13:39:19.913078+0000","last_unstale":"2023-10-16T13:39:21.908002+0000","last_undegraded":"2023-10-16T13:39:21.908002+0000","last_fullsized":"2023-10-16T13:39:21.908002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:53.863245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907898+0000","last_change":"2023-10-16T13:39:20.913115+0000","last_active":"2023-10-16T13:39:21.907898+0000","last_peered":"2023-10-16T13:39:21.907898+0000","last_clean":"2023-10-16T13:39:21.907898+0000","last_became_active":"2023-10-16T13:39:20.912566+0000","last_became_peered":"2023-10-16T13:39:20.912566+0000","last_unstale":"2023-10-16T13:39:21.907898+0000","last_undegraded":"2023-10-16T13:39:21.907898+0000","last_fullsized":"2023-10-16T13:39:21.907898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322651+0000","last_change":"2023-10-16T13:39:19.920111+0000","last_active":"2023-10-16T13:39:22.322651+0000","last_peered":"2023-10-16T13:39:22.322651+0000","last_clean":"2023-10-16T13:39:22.322651+0000","last_became_active":"2023-10-16T13:39:19.919659+0000","last_became_peered":"2023-10-16T13:39:19.919659+0000","last_unstale":"2023-10-16T13:39:22.322651+0000","last_undegraded":"2023-10-16T13:39:22.322651+0000","last_fullsized":"2023-10-16T13:39:22.322651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:35.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904618+0000","last_change":"2023-10-16T13:39:20.914690+0000","last_active":"2023-10-16T13:39:21.904618+0000","last_peered":"2023-10-16T13:39:21.904618+0000","last_clean":"2023-10-16T13:39:21.904618+0000","last_became_active":"2023-10-16T13:39:20.914434+0000","last_became_peered":"2023-10-16T13:39:20.914434+0000","last_unstale":"2023-10-16T13:39:21.904618+0000","last_undegraded":"2023-10-16T13:39:21.904618+0000","last_fullsized":"2023-10-16T13:39:21.904618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:54.865090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908088+0000","last_change":"2023-10-16T13:39:19.913702+0000","last_active":"2023-10-16T13:39:21.908088+0000","last_peered":"2023-10-16T13:39:21.908088+0000","last_clean":"2023-10-16T13:39:21.908088+0000","last_became_active":"2023-10-16T13:39:19.913451+0000","last_became_peered":"2023-10-16T13:39:19.913451+0000","last_unstale":"2023-10-16T13:39:21.908088+0000","last_undegraded":"2023-10-16T13:39:21.908088+0000","last_fullsized":"2023-10-16T13:39:21.908088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:50.118463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322654+0000","last_change":"2023-10-16T13:39:20.917747+0000","last_active":"2023-10-16T13:39:22.322654+0000","last_peered":"2023-10-16T13:39:22.322654+0000","last_clean":"2023-10-16T13:39:22.322654+0000","last_became_active":"2023-10-16T13:39:20.917442+0000","last_became_peered":"2023-10-16T13:39:20.917442+0000","last_unstale":"2023-10-16T13:39:22.322654+0000","last_undegraded":"2023-10-16T13:39:22.322654+0000","last_fullsized":"2023-10-16T13:39:22.322654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904603+0000","last_change":"2023-10-16T13:39:19.902332+0000","last_active":"2023-10-16T13:39:21.904603+0000","last_peered":"2023-10-16T13:39:21.904603+0000","last_clean":"2023-10-16T13:39:21.904603+0000","last_became_active":"2023-10-16T13:39:19.902050+0000","last_became_peered":"2023-10-16T13:39:19.902050+0000","last_unstale":"2023-10-16T13:39:21.904603+0000","last_undegraded":"2023-10-16T13:39:21.904603+0000","last_fullsized":"2023-10-16T13:39:21.904603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:19.055588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322337+0000","last_change":"2023-10-16T13:39:20.917922+0000","last_active":"2023-10-16T13:39:22.322337+0000","last_peered":"2023-10-16T13:39:22.322337+0000","last_clean":"2023-10-16T13:39:22.322337+0000","last_became_active":"2023-10-16T13:39:20.917301+0000","last_became_peered":"2023-10-16T13:39:20.917301+0000","last_unstale":"2023-10-16T13:39:22.322337+0000","last_undegraded":"2023-10-16T13:39:22.322337+0000","last_fullsized":"2023-10-16T13:39:22.322337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322289+0000","last_change":"2023-10-16T13:39:19.915793+0000","last_active":"2023-10-16T13:39:22.322289+0000","last_peered":"2023-10-16T13:39:22.322289+0000","last_clean":"2023-10-16T13:39:22.322289+0000","last_became_active":"2023-10-16T13:39:19.913189+0000","last_became_peered":"2023-10-16T13:39:19.913189+0000","last_unstale":"2023-10-16T13:39:22.322289+0000","last_undegraded":"2023-10-16T13:39:22.322289+0000","last_fullsized":"2023-10-16T13:39:22.322289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321637+0000","last_change":"2023-10-16T13:39:20.913612+0000","last_active":"2023-10-16T13:39:22.321637+0000","last_peered":"2023-10-16T13:39:22.321637+0000","last_clean":"2023-10-16T13:39:22.321637+0000","last_became_active":"2023-10-16T13:39:20.913115+0000","last_became_peered":"2023-10-16T13:39:20.913115+0000","last_unstale":"2023-10-16T13:39:22.321637+0000","last_undegraded":"2023-10-16T13:39:22.321637+0000","last_fullsized":"2023-10-16T13:39:22.321637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:50.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321448+0000","last_change":"2023-10-16T13:39:19.919530+0000","last_active":"2023-10-16T13:39:22.321448+0000","last_peered":"2023-10-16T13:39:22.321448+0000","last_clean":"2023-10-16T13:39:22.321448+0000","last_became_active":"2023-10-16T13:39:19.919283+0000","last_became_peered":"2023-10-16T13:39:19.919283+0000","last_unstale":"2023-10-16T13:39:22.321448+0000","last_undegraded":"2023-10-16T13:39:22.321448+0000","last_fullsized":"2023-10-16T13:39:22.321448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908166+0000","last_change":"2023-10-16T13:39:20.919355+0000","last_active":"2023-10-16T13:39:21.908166+0000","last_peered":"2023-10-16T13:39:21.908166+0000","last_clean":"2023-10-16T13:39:21.908166+0000","last_became_active":"2023-10-16T13:39:20.919085+0000","last_became_peered":"2023-10-16T13:39:20.919085+0000","last_unstale":"2023-10-16T13:39:21.908166+0000","last_undegraded":"2023-10-16T13:39:21.908166+0000","last_fullsized":"2023-10-16T13:39:21.908166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:22.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905047+0000","last_change":"2023-10-16T13:39:19.918132+0000","last_active":"2023-10-16T13:39:21.905047+0000","last_peered":"2023-10-16T13:39:21.905047+0000","last_clean":"2023-10-16T13:39:21.905047+0000","last_became_active":"2023-10-16T13:39:19.917873+0000","last_became_peered":"2023-10-16T13:39:19.917873+0000","last_unstale":"2023-10-16T13:39:21.905047+0000","last_undegraded":"2023-10-16T13:39:21.905047+0000","last_fullsized":"2023-10-16T13:39:21.905047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:57.316921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908168+0000","last_change":"2023-10-16T13:39:20.916435+0000","last_active":"2023-10-16T13:39:21.908168+0000","last_peered":"2023-10-16T13:39:21.908168+0000","last_clean":"2023-10-16T13:39:21.908168+0000","last_became_active":"2023-10-16T13:39:20.916130+0000","last_became_peered":"2023-10-16T13:39:20.916130+0000","last_unstale":"2023-10-16T13:39:21.908168+0000","last_undegraded":"2023-10-16T13:39:21.908168+0000","last_fullsized":"2023-10-16T13:39:21.908168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908260+0000","last_change":"2023-10-16T13:39:19.910540+0000","last_active":"2023-10-16T13:39:21.908260+0000","last_peered":"2023-10-16T13:39:21.908260+0000","last_clean":"2023-10-16T13:39:21.908260+0000","last_became_active":"2023-10-16T13:39:19.910286+0000","last_became_peered":"2023-10-16T13:39:19.910286+0000","last_unstale":"2023-10-16T13:39:21.908260+0000","last_undegraded":"2023-10-16T13:39:21.908260+0000","last_fullsized":"2023-10-16T13:39:21.908260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904912+0000","last_change":"2023-10-16T13:39:20.917001+0000","last_active":"2023-10-16T13:39:21.904912+0000","last_peered":"2023-10-16T13:39:21.904912+0000","last_clean":"2023-10-16T13:39:21.904912+0000","last_became_active":"2023-10-16T13:39:20.916713+0000","last_became_peered":"2023-10-16T13:39:20.916713+0000","last_unstale":"2023-10-16T13:39:21.904912+0000","last_undegraded":"2023-10-16T13:39:21.904912+0000","last_fullsized":"2023-10-16T13:39:21.904912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907935+0000","last_change":"2023-10-16T13:39:19.913336+0000","last_active":"2023-10-16T13:39:21.907935+0000","last_peered":"2023-10-16T13:39:21.907935+0000","last_clean":"2023-10-16T13:39:21.907935+0000","last_became_active":"2023-10-16T13:39:19.912317+0000","last_became_peered":"2023-10-16T13:39:19.912317+0000","last_unstale":"2023-10-16T13:39:21.907935+0000","last_undegraded":"2023-10-16T13:39:21.907935+0000","last_fullsized":"2023-10-16T13:39:21.907935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322170+0000","last_change":"2023-10-16T13:39:20.914524+0000","last_active":"2023-10-16T13:39:22.322170+0000","last_peered":"2023-10-16T13:39:22.322170+0000","last_clean":"2023-10-16T13:39:22.322170+0000","last_became_active":"2023-10-16T13:39:20.913796+0000","last_became_peered":"2023-10-16T13:39:20.913796+0000","last_unstale":"2023-10-16T13:39:22.322170+0000","last_undegraded":"2023-10-16T13:39:22.322170+0000","last_fullsized":"2023-10-16T13:39:22.322170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:50.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908250+0000","last_change":"2023-10-16T13:39:19.911516+0000","last_active":"2023-10-16T13:39:21.908250+0000","last_peered":"2023-10-16T13:39:21.908250+0000","last_clean":"2023-10-16T13:39:21.908250+0000","last_became_active":"2023-10-16T13:39:19.911218+0000","last_became_peered":"2023-10-16T13:39:19.911218+0000","last_unstale":"2023-10-16T13:39:21.908250+0000","last_undegraded":"2023-10-16T13:39:21.908250+0000","last_fullsized":"2023-10-16T13:39:21.908250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:27.653967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322114+0000","last_change":"2023-10-16T13:39:20.921060+0000","last_active":"2023-10-16T13:39:22.322114+0000","last_peered":"2023-10-16T13:39:22.322114+0000","last_clean":"2023-10-16T13:39:22.322114+0000","last_became_active":"2023-10-16T13:39:20.920780+0000","last_became_peered":"2023-10-16T13:39:20.920780+0000","last_unstale":"2023-10-16T13:39:22.322114+0000","last_undegraded":"2023-10-16T13:39:22.322114+0000","last_fullsized":"2023-10-16T13:39:22.322114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:36:54.514746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321723+0000","last_change":"2023-10-16T13:39:19.913392+0000","last_active":"2023-10-16T13:39:22.321723+0000","last_peered":"2023-10-16T13:39:22.321723+0000","last_clean":"2023-10-16T13:39:22.321723+0000","last_became_active":"2023-10-16T13:39:19.913123+0000","last_became_peered":"2023-10-16T13:39:19.913123+0000","last_unstale":"2023-10-16T13:39:22.321723+0000","last_undegraded":"2023-10-16T13:39:22.321723+0000","last_fullsized":"2023-10-16T13:39:22.321723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321832+0000","last_change":"2023-10-16T13:39:20.919546+0000","last_active":"2023-10-16T13:39:22.321832+0000","last_peered":"2023-10-16T13:39:22.321832+0000","last_clean":"2023-10-16T13:39:22.321832+0000","last_became_active":"2023-10-16T13:39:20.919294+0000","last_became_peered":"2023-10-16T13:39:20.919294+0000","last_unstale":"2023-10-16T13:39:22.321832+0000","last_undegraded":"2023-10-16T13:39:22.321832+0000","last_fullsized":"2023-10-16T13:39:22.321832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:19.610289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321727+0000","last_change":"2023-10-16T13:39:19.903187+0000","last_active":"2023-10-16T13:39:22.321727+0000","last_peered":"2023-10-16T13:39:22.321727+0000","last_clean":"2023-10-16T13:39:22.321727+0000","last_became_active":"2023-10-16T13:39:19.902860+0000","last_became_peered":"2023-10-16T13:39:19.902860+0000","last_unstale":"2023-10-16T13:39:22.321727+0000","last_undegraded":"2023-10-16T13:39:22.321727+0000","last_fullsized":"2023-10-16T13:39:22.321727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321706+0000","last_change":"2023-10-16T13:39:20.915946+0000","last_active":"2023-10-16T13:39:22.321706+0000","last_peered":"2023-10-16T13:39:22.321706+0000","last_clean":"2023-10-16T13:39:22.321706+0000","last_became_active":"2023-10-16T13:39:20.915670+0000","last_became_peered":"2023-10-16T13:39:20.915670+0000","last_unstale":"2023-10-16T13:39:22.321706+0000","last_undegraded":"2023-10-16T13:39:22.321706+0000","last_fullsized":"2023-10-16T13:39:22.321706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:29.927125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907965+0000","last_change":"2023-10-16T13:39:19.906563+0000","last_active":"2023-10-16T13:39:21.907965+0000","last_peered":"2023-10-16T13:39:21.907965+0000","last_clean":"2023-10-16T13:39:21.907965+0000","last_became_active":"2023-10-16T13:39:19.906291+0000","last_became_peered":"2023-10-16T13:39:19.906291+0000","last_unstale":"2023-10-16T13:39:21.907965+0000","last_undegraded":"2023-10-16T13:39:21.907965+0000","last_fullsized":"2023-10-16T13:39:21.907965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321969+0000","last_change":"2023-10-16T13:39:20.912234+0000","last_active":"2023-10-16T13:39:22.321969+0000","last_peered":"2023-10-16T13:39:22.321969+0000","last_clean":"2023-10-16T13:39:22.321969+0000","last_became_active":"2023-10-16T13:39:20.911937+0000","last_became_peered":"2023-10-16T13:39:20.911937+0000","last_unstale":"2023-10-16T13:39:22.321969+0000","last_undegraded":"2023-10-16T13:39:22.321969+0000","last_fullsized":"2023-10-16T13:39:22.321969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907256+0000","last_change":"2023-10-16T13:39:19.909910+0000","last_active":"2023-10-16T13:39:21.907256+0000","last_peered":"2023-10-16T13:39:21.907256+0000","last_clean":"2023-10-16T13:39:21.907256+0000","last_became_active":"2023-10-16T13:39:19.909600+0000","last_became_peered":"2023-10-16T13:39:19.909600+0000","last_unstale":"2023-10-16T13:39:21.907256+0000","last_undegraded":"2023-10-16T13:39:21.907256+0000","last_fullsized":"2023-10-16T13:39:21.907256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:22.717706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322110+0000","last_change":"2023-10-16T13:39:20.915302+0000","last_active":"2023-10-16T13:39:22.322110+0000","last_peered":"2023-10-16T13:39:22.322110+0000","last_clean":"2023-10-16T13:39:22.322110+0000","last_became_active":"2023-10-16T13:39:20.914945+0000","last_became_peered":"2023-10-16T13:39:20.914945+0000","last_unstale":"2023-10-16T13:39:22.322110+0000","last_undegraded":"2023-10-16T13:39:22.322110+0000","last_fullsized":"2023-10-16T13:39:22.322110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:33.880146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905094+0000","last_change":"2023-10-16T13:39:19.910212+0000","last_active":"2023-10-16T13:39:21.905094+0000","last_peered":"2023-10-16T13:39:21.905094+0000","last_clean":"2023-10-16T13:39:21.905094+0000","last_became_active":"2023-10-16T13:39:19.909900+0000","last_became_peered":"2023-10-16T13:39:19.909900+0000","last_unstale":"2023-10-16T13:39:21.905094+0000","last_undegraded":"2023-10-16T13:39:21.905094+0000","last_fullsized":"2023-10-16T13:39:21.905094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:54.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908168+0000","last_change":"2023-10-16T13:39:20.914323+0000","last_active":"2023-10-16T13:39:21.908168+0000","last_peered":"2023-10-16T13:39:21.908168+0000","last_clean":"2023-10-16T13:39:21.908168+0000","last_became_active":"2023-10-16T13:39:20.914006+0000","last_became_peered":"2023-10-16T13:39:20.914006+0000","last_unstale":"2023-10-16T13:39:21.908168+0000","last_undegraded":"2023-10-16T13:39:21.908168+0000","last_fullsized":"2023-10-16T13:39:21.908168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.928351+0000","last_change":"2023-10-16T13:39:19.911913+0000","last_active":"2023-10-16T13:39:22.928351+0000","last_peered":"2023-10-16T13:39:22.928351+0000","last_clean":"2023-10-16T13:39:22.928351+0000","last_became_active":"2023-10-16T13:39:19.911658+0000","last_became_peered":"2023-10-16T13:39:19.911658+0000","last_unstale":"2023-10-16T13:39:22.928351+0000","last_undegraded":"2023-10-16T13:39:22.928351+0000","last_fullsized":"2023-10-16T13:39:22.928351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322172+0000","last_change":"2023-10-16T13:39:20.917946+0000","last_active":"2023-10-16T13:39:22.322172+0000","last_peered":"2023-10-16T13:39:22.322172+0000","last_clean":"2023-10-16T13:39:22.322172+0000","last_became_active":"2023-10-16T13:39:20.917648+0000","last_became_peered":"2023-10-16T13:39:20.917648+0000","last_unstale":"2023-10-16T13:39:22.322172+0000","last_undegraded":"2023-10-16T13:39:22.322172+0000","last_fullsized":"2023-10-16T13:39:22.322172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:58.318766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904870+0000","last_change":"2023-10-16T13:39:19.918894+0000","last_active":"2023-10-16T13:39:21.904870+0000","last_peered":"2023-10-16T13:39:21.904870+0000","last_clean":"2023-10-16T13:39:21.904870+0000","last_became_active":"2023-10-16T13:39:19.918458+0000","last_became_peered":"2023-10-16T13:39:19.918458+0000","last_unstale":"2023-10-16T13:39:21.904870+0000","last_undegraded":"2023-10-16T13:39:21.904870+0000","last_fullsized":"2023-10-16T13:39:21.904870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:50.118463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321952+0000","last_change":"2023-10-16T13:39:20.915690+0000","last_active":"2023-10-16T13:39:22.321952+0000","last_peered":"2023-10-16T13:39:22.321952+0000","last_clean":"2023-10-16T13:39:22.321952+0000","last_became_active":"2023-10-16T13:39:20.915346+0000","last_became_peered":"2023-10-16T13:39:20.915346+0000","last_unstale":"2023-10-16T13:39:22.321952+0000","last_undegraded":"2023-10-16T13:39:22.321952+0000","last_fullsized":"2023-10-16T13:39:22.321952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:28.655812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321621+0000","last_change":"2023-10-16T13:39:19.917669+0000","last_active":"2023-10-16T13:39:22.321621+0000","last_peered":"2023-10-16T13:39:22.321621+0000","last_clean":"2023-10-16T13:39:22.321621+0000","last_became_active":"2023-10-16T13:39:19.917437+0000","last_became_peered":"2023-10-16T13:39:19.917437+0000","last_unstale":"2023-10-16T13:39:22.321621+0000","last_undegraded":"2023-10-16T13:39:22.321621+0000","last_fullsized":"2023-10-16T13:39:22.321621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321883+0000","last_change":"2023-10-16T13:39:20.919727+0000","last_active":"2023-10-16T13:39:22.321883+0000","last_peered":"2023-10-16T13:39:22.321883+0000","last_clean":"2023-10-16T13:39:22.321883+0000","last_became_active":"2023-10-16T13:39:20.918649+0000","last_became_peered":"2023-10-16T13:39:20.918649+0000","last_unstale":"2023-10-16T13:39:22.321883+0000","last_undegraded":"2023-10-16T13:39:22.321883+0000","last_fullsized":"2023-10-16T13:39:22.321883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:20.057433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904681+0000","last_change":"2023-10-16T13:39:19.909981+0000","last_active":"2023-10-16T13:39:21.904681+0000","last_peered":"2023-10-16T13:39:21.904681+0000","last_clean":"2023-10-16T13:39:21.904681+0000","last_became_active":"2023-10-16T13:39:19.909686+0000","last_became_peered":"2023-10-16T13:39:19.909686+0000","last_unstale":"2023-10-16T13:39:21.904681+0000","last_undegraded":"2023-10-16T13:39:21.904681+0000","last_fullsized":"2023-10-16T13:39:21.904681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:52.304700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321354+0000","last_change":"2023-10-16T13:39:20.908279+0000","last_active":"2023-10-16T13:39:22.321354+0000","last_peered":"2023-10-16T13:39:22.321354+0000","last_clean":"2023-10-16T13:39:22.321354+0000","last_became_active":"2023-10-16T13:39:20.907944+0000","last_became_peered":"2023-10-16T13:39:20.907944+0000","last_unstale":"2023-10-16T13:39:22.321354+0000","last_undegraded":"2023-10-16T13:39:22.321354+0000","last_fullsized":"2023-10-16T13:39:22.321354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908323+0000","last_change":"2023-10-16T13:39:19.911350+0000","last_active":"2023-10-16T13:39:21.908323+0000","last_peered":"2023-10-16T13:39:21.908323+0000","last_clean":"2023-10-16T13:39:21.908323+0000","last_became_active":"2023-10-16T13:39:19.911066+0000","last_became_peered":"2023-10-16T13:39:19.911066+0000","last_unstale":"2023-10-16T13:39:21.908323+0000","last_undegraded":"2023-10-16T13:39:21.908323+0000","last_fullsized":"2023-10-16T13:39:21.908323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907463+0000","last_change":"2023-10-16T13:39:20.920262+0000","last_active":"2023-10-16T13:39:21.907463+0000","last_peered":"2023-10-16T13:39:21.907463+0000","last_clean":"2023-10-16T13:39:21.907463+0000","last_became_active":"2023-10-16T13:39:20.919964+0000","last_became_peered":"2023-10-16T13:39:20.919964+0000","last_unstale":"2023-10-16T13:39:21.907463+0000","last_undegraded":"2023-10-16T13:39:21.907463+0000","last_fullsized":"2023-10-16T13:39:21.907463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:58.318766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321606+0000","last_change":"2023-10-16T13:39:19.912283+0000","last_active":"2023-10-16T13:39:22.321606+0000","last_peered":"2023-10-16T13:39:22.321606+0000","last_clean":"2023-10-16T13:39:22.321606+0000","last_became_active":"2023-10-16T13:39:19.912033+0000","last_became_peered":"2023-10-16T13:39:19.912033+0000","last_unstale":"2023-10-16T13:39:22.321606+0000","last_undegraded":"2023-10-16T13:39:22.321606+0000","last_fullsized":"2023-10-16T13:39:22.321606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:27.653967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322399+0000","last_change":"2023-10-16T13:39:20.912138+0000","last_active":"2023-10-16T13:39:22.322399+0000","last_peered":"2023-10-16T13:39:22.322399+0000","last_clean":"2023-10-16T13:39:22.322399+0000","last_became_active":"2023-10-16T13:39:20.911059+0000","last_became_peered":"2023-10-16T13:39:20.911059+0000","last_unstale":"2023-10-16T13:39:22.322399+0000","last_undegraded":"2023-10-16T13:39:22.322399+0000","last_fullsized":"2023-10-16T13:39:22.322399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321822+0000","last_change":"2023-10-16T13:39:19.911727+0000","last_active":"2023-10-16T13:39:22.321822+0000","last_peered":"2023-10-16T13:39:22.321822+0000","last_clean":"2023-10-16T13:39:22.321822+0000","last_became_active":"2023-10-16T13:39:19.908368+0000","last_became_peered":"2023-10-16T13:39:19.908368+0000","last_unstale":"2023-10-16T13:39:22.321822+0000","last_undegraded":"2023-10-16T13:39:22.321822+0000","last_fullsized":"2023-10-16T13:39:22.321822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:29.357845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T13:39:20.903645+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:39:20.903645+0000","last_peered":"2023-10-16T13:39:20.903645+0000","last_clean":"2023-10-16T13:39:20.903645+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:39:20.903645+0000","last_undegraded":"2023-10-16T13:39:20.903645+0000","last_fullsized":"2023-10-16T13:39:20.903645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.64300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.504},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.625},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.62}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.5},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":736277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":145979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.23999999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.377},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.29499999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.251},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.746}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.626}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76400000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.84099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57699999999999996}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:39:27.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:39:27.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:39:29.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:39:29.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.831+0000 7f12e6039700 1 Processor -- start 2023-10-16T13:39:29.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.832+0000 7f12e6039700 1 -- start start 2023-10-16T13:39:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12e6039700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12e015ab10 0x7f12e015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12e6039700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 0x7f12e00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12e6039700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e015e7a0 con 0x7f12e00b1f50 2023-10-16T13:39:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12e6039700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e015f730 con 0x7f12e015ab10 2023-10-16T13:39:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12e6039700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b29a0 con 0x7f12e00cfe30 2023-10-16T13:39:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12deffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12e00b1f50 0x7f12e00cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53884/0 (socket says 172.21.15.5:53884) 2023-10-16T13:39:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12deffd700 1 -- 172.21.15.5:0/3785698797 learned_addr learned my addr 172.21.15.5:0/3785698797 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633275110 0 0) 0x7f12e015e7a0 con 0x7f12e00b1f50 2023-10-16T13:39:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c80035b0 con 0x7f12e00b1f50 2023-10-16T13:39:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12df7fe700 1 --2- 172.21.15.5:0/3785698797 >> v2:172.21.15.112:3300/0 conn(0x7f12e015ab10 0x7f12e015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12dffff700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 0x7f12e00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708139118 0 0) 0x7f12c80035b0 con 0x7f12e00b1f50 2023-10-16T13:39:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 msgr2=0x7f12e00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:29.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 0x7f12e00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:29.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 >> v2:172.21.15.112:3300/0 conn(0x7f12e015ab10 msgr2=0x7f12e015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:29.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 --2- 172.21.15.5:0/3785698797 >> v2:172.21.15.112:3300/0 conn(0x7f12e015ab10 0x7f12e015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:29.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00b2c80 con 0x7f12e00b1f50 2023-10-16T13:39:29.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f12d40017f0 con 0x7f12e00b1f50 2023-10-16T13:39:29.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.833+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 >> v1:172.21.15.5:6789/0 conn(0x7f12e00b1f50 legacy=0x7f12e00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:29.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c8003a00 0x7f12c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8004850 0x7f12c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 0x7f12c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e015f730 con 0x7f12c8003a00 2023-10-16T13:39:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b29a0 con 0x7f12c8004850 2023-10-16T13:39:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c800dc20 con 0x7f12e00cfe30 2023-10-16T13:39:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c8003a00 0x7f12c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12deffd700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8004850 0x7f12c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12dffff700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 0x7f12c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 -- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 msgr2=0x7f12c8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00cfe30 0x7f12c8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 -- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8004850 msgr2=0x7f12c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8004850 0x7f12c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:29.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 -- 172.21.15.5:0/3785698797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80035b0 con 0x7f12c8003a00 2023-10-16T13:39:29.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12df7fe700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c8003a00 0x7f12c8003e20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009b60 tx=0x7f12c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7236a700fb4386b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:29.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000e6c0 con 0x7f12c8003a00 2023-10-16T13:39:29.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d000e820 con 0x7f12c8003a00 2023-10-16T13:39:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.834+0000 7f12de7fc700 1 -- 172.21.15.5:0/3785698797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000eb90 con 0x7f12c8003a00 2023-10-16T13:39:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12e6039700 1 -- 172.21.15.5:0/3785698797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c8003a00 msgr2=0x7f12c8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12e6039700 1 --2- 172.21.15.5:0/3785698797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c8003a00 0x7f12c8003e20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009b60 tx=0x7f12c8005880 comp rx=0 tx=0).stop 2023-10-16T13:39:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12dffff700 1 -- 172.21.15.5:0/3785698797 reap_dead start 2023-10-16T13:39:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12e6039700 1 -- 172.21.15.5:0/3785698797 shutdown_connections 2023-10-16T13:39:29.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12e6039700 1 -- 172.21.15.5:0/3785698797 >> 172.21.15.5:0/3785698797 conn(0x7f12e006dae0 msgr2=0x7f12e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:29.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12e6039700 1 -- 172.21.15.5:0/3785698797 shutdown_connections 2023-10-16T13:39:29.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.835+0000 7f12e6039700 1 -- 172.21.15.5:0/3785698797 wait complete. 2023-10-16T13:39:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.837+0000 7f12e6039700 1 Processor -- start 2023-10-16T13:39:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.837+0000 7f12e6039700 1 -- start start 2023-10-16T13:39:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12e6039700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8003a00 0x7f12e0158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12e6039700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00c5010 0x7f12e00c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12e6039700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 0x7f12e015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12e6039700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c4bf0 con 0x7f12e015aef0 2023-10-16T13:39:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12e6039700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e01ef630 con 0x7f12c8003a00 2023-10-16T13:39:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12e6039700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e015ba60 con 0x7f12e00c5010 2023-10-16T13:39:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 0x7f12e015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 0x7f12e015b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43894/0 (socket says 172.21.15.5:43894) 2023-10-16T13:39:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 -- 172.21.15.5:0/372096268 learned_addr learned my addr 172.21.15.5:0/372096268 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12deffd700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00c5010 0x7f12e00c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12df7fe700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8003a00 0x7f12e0158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 -- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00c5010 msgr2=0x7f12e00c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00c5010 0x7f12e00c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 -- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8003a00 msgr2=0x7f12e0158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8003a00 0x7f12e0158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 -- 172.21.15.5:0/372096268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e015bd40 con 0x7f12e015aef0 2023-10-16T13:39:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.838+0000 7f12dffff700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 0x7f12e015b3a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f12e00aff00 tx=0x7f12d80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.839+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d801b040 con 0x7f12e015aef0 2023-10-16T13:39:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.839+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d8003c40 con 0x7f12e015aef0 2023-10-16T13:39:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.839+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00c4530 con 0x7f12e015aef0 2023-10-16T13:39:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.839+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8019ec0 con 0x7f12e015aef0 2023-10-16T13:39:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.839+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e0158d50 con 0x7f12e015aef0 2023-10-16T13:39:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.840+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e00c4d30 con 0x7f12e015aef0 2023-10-16T13:39:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.841+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f12d8004030 con 0x7f12e015aef0 2023-10-16T13:39:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.841+0000 7f12c7fff700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af00 0x7f12cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.842+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12d8092b00 con 0x7f12e015aef0 2023-10-16T13:39:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.842+0000 7f12df7fe700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af00 0x7f12cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.842+0000 7f12df7fe700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af00 0x7f12cc06d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f12d00090b0 tx=0x7f12d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:29.846+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12d805dd20 con 0x7f12e015aef0 2023-10-16T13:39:30.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.043+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12e015ecd0 con 0x7f12cc06af00 2023-10-16T13:39:30.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.051+0000 7f12c7fff700 1 -- 172.21.15.5:0/372096268 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289360 (secure 0 0 0) 0x7f12d0022040 con 0x7f12cc06af00 2023-10-16T13:39:30.057 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af00 msgr2=0x7f12cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af00 0x7f12cc06d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f12d00090b0 tx=0x7f12d0008030 comp rx=0 tx=0).stop 2023-10-16T13:39:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 msgr2=0x7f12e015b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 0x7f12e015b3a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f12e00aff00 tx=0x7f12d80196a0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 shutdown_connections 2023-10-16T13:39:30.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e015aef0 0x7f12e015b3a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c8003a00 0x7f12e0158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af00 0x7f12cc06d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.054+0000 7f12e6039700 1 --2- 172.21.15.5:0/372096268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12e00c5010 0x7f12e00c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.055+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 >> 172.21.15.5:0/372096268 conn(0x7f12e006dae0 msgr2=0x7f12e00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.055+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 shutdown_connections 2023-10-16T13:39:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.055+0000 7f12e6039700 1 -- 172.21.15.5:0/372096268 wait complete. 2023-10-16T13:39:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:39:30.069 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-16T13:39:29.473540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4128,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4227072,"data_stored":2358942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.572910"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321973+0000","last_change":"2023-10-16T13:39:20.917920+0000","last_active":"2023-10-16T13:39:22.321973+0000","last_peered":"2023-10-16T13:39:22.321973+0000","last_clean":"2023-10-16T13:39:22.321973+0000","last_became_active":"2023-10-16T13:39:20.917664+0000","last_became_peered":"2023-10-16T13:39:20.917664+0000","last_unstale":"2023-10-16T13:39:22.321973+0000","last_undegraded":"2023-10-16T13:39:22.321973+0000","last_fullsized":"2023-10-16T13:39:22.321973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:57.327298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322800+0000","last_change":"2023-10-16T13:39:20.921778+0000","last_active":"2023-10-16T13:39:22.322800+0000","last_peered":"2023-10-16T13:39:22.322800+0000","last_clean":"2023-10-16T13:39:22.322800+0000","last_became_active":"2023-10-16T13:39:20.921486+0000","last_became_peered":"2023-10-16T13:39:20.921486+0000","last_unstale":"2023-10-16T13:39:22.322800+0000","last_undegraded":"2023-10-16T13:39:22.322800+0000","last_fullsized":"2023-10-16T13:39:22.322800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:46.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907764+0000","last_change":"2023-10-16T13:39:20.916833+0000","last_active":"2023-10-16T13:39:21.907764+0000","last_peered":"2023-10-16T13:39:21.907764+0000","last_clean":"2023-10-16T13:39:21.907764+0000","last_became_active":"2023-10-16T13:39:20.916446+0000","last_became_peered":"2023-10-16T13:39:20.916446+0000","last_unstale":"2023-10-16T13:39:21.907764+0000","last_undegraded":"2023-10-16T13:39:21.907764+0000","last_fullsized":"2023-10-16T13:39:21.907764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904774+0000","last_change":"2023-10-16T13:39:20.916712+0000","last_active":"2023-10-16T13:39:21.904774+0000","last_peered":"2023-10-16T13:39:21.904774+0000","last_clean":"2023-10-16T13:39:21.904774+0000","last_became_active":"2023-10-16T13:39:20.916402+0000","last_became_peered":"2023-10-16T13:39:20.916402+0000","last_unstale":"2023-10-16T13:39:21.904774+0000","last_undegraded":"2023-10-16T13:39:21.904774+0000","last_fullsized":"2023-10-16T13:39:21.904774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:22.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321718+0000","last_change":"2023-10-16T13:39:20.908249+0000","last_active":"2023-10-16T13:39:22.321718+0000","last_peered":"2023-10-16T13:39:22.321718+0000","last_clean":"2023-10-16T13:39:22.321718+0000","last_became_active":"2023-10-16T13:39:20.907713+0000","last_became_peered":"2023-10-16T13:39:20.907713+0000","last_unstale":"2023-10-16T13:39:22.321718+0000","last_undegraded":"2023-10-16T13:39:22.321718+0000","last_fullsized":"2023-10-16T13:39:22.321718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:35.718910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322492+0000","last_change":"2023-10-16T13:39:20.916044+0000","last_active":"2023-10-16T13:39:22.322492+0000","last_peered":"2023-10-16T13:39:22.322492+0000","last_clean":"2023-10-16T13:39:22.322492+0000","last_became_active":"2023-10-16T13:39:20.915691+0000","last_became_peered":"2023-10-16T13:39:20.915691+0000","last_unstale":"2023-10-16T13:39:22.322492+0000","last_undegraded":"2023-10-16T13:39:22.322492+0000","last_fullsized":"2023-10-16T13:39:22.322492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321737+0000","last_change":"2023-10-16T13:39:20.913478+0000","last_active":"2023-10-16T13:39:22.321737+0000","last_peered":"2023-10-16T13:39:22.321737+0000","last_clean":"2023-10-16T13:39:22.321737+0000","last_became_active":"2023-10-16T13:39:20.913217+0000","last_became_peered":"2023-10-16T13:39:20.913217+0000","last_unstale":"2023-10-16T13:39:22.321737+0000","last_undegraded":"2023-10-16T13:39:22.321737+0000","last_fullsized":"2023-10-16T13:39:22.321737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321635+0000","last_change":"2023-10-16T13:39:20.911699+0000","last_active":"2023-10-16T13:39:22.321635+0000","last_peered":"2023-10-16T13:39:22.321635+0000","last_clean":"2023-10-16T13:39:22.321635+0000","last_became_active":"2023-10-16T13:39:20.911073+0000","last_became_peered":"2023-10-16T13:39:20.911073+0000","last_unstale":"2023-10-16T13:39:22.321635+0000","last_undegraded":"2023-10-16T13:39:22.321635+0000","last_fullsized":"2023-10-16T13:39:22.321635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908390+0000","last_change":"2023-10-16T13:39:20.916353+0000","last_active":"2023-10-16T13:39:21.908390+0000","last_peered":"2023-10-16T13:39:21.908390+0000","last_clean":"2023-10-16T13:39:21.908390+0000","last_became_active":"2023-10-16T13:39:20.916059+0000","last_became_peered":"2023-10-16T13:39:20.916059+0000","last_unstale":"2023-10-16T13:39:21.908390+0000","last_undegraded":"2023-10-16T13:39:21.908390+0000","last_fullsized":"2023-10-16T13:39:21.908390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904850+0000","last_change":"2023-10-16T13:39:20.907199+0000","last_active":"2023-10-16T13:39:21.904850+0000","last_peered":"2023-10-16T13:39:21.904850+0000","last_clean":"2023-10-16T13:39:21.904850+0000","last_became_active":"2023-10-16T13:39:20.906893+0000","last_became_peered":"2023-10-16T13:39:20.906893+0000","last_unstale":"2023-10-16T13:39:21.904850+0000","last_undegraded":"2023-10-16T13:39:21.904850+0000","last_fullsized":"2023-10-16T13:39:21.904850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322409+0000","last_change":"2023-10-16T13:39:20.912098+0000","last_active":"2023-10-16T13:39:22.322409+0000","last_peered":"2023-10-16T13:39:22.322409+0000","last_clean":"2023-10-16T13:39:22.322409+0000","last_became_active":"2023-10-16T13:39:20.911773+0000","last_became_peered":"2023-10-16T13:39:20.911773+0000","last_unstale":"2023-10-16T13:39:22.322409+0000","last_undegraded":"2023-10-16T13:39:22.322409+0000","last_fullsized":"2023-10-16T13:39:22.322409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907639+0000","last_change":"2023-10-16T13:39:20.917806+0000","last_active":"2023-10-16T13:39:21.907639+0000","last_peered":"2023-10-16T13:39:21.907639+0000","last_clean":"2023-10-16T13:39:21.907639+0000","last_became_active":"2023-10-16T13:39:20.916708+0000","last_became_peered":"2023-10-16T13:39:20.916708+0000","last_unstale":"2023-10-16T13:39:21.907639+0000","last_undegraded":"2023-10-16T13:39:21.907639+0000","last_fullsized":"2023-10-16T13:39:21.907639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321983+0000","last_change":"2023-10-16T13:39:20.907695+0000","last_active":"2023-10-16T13:39:22.321983+0000","last_peered":"2023-10-16T13:39:22.321983+0000","last_clean":"2023-10-16T13:39:22.321983+0000","last_became_active":"2023-10-16T13:39:20.907292+0000","last_became_peered":"2023-10-16T13:39:20.907292+0000","last_unstale":"2023-10-16T13:39:22.321983+0000","last_undegraded":"2023-10-16T13:39:22.321983+0000","last_fullsized":"2023-10-16T13:39:22.321983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:25.691612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322608+0000","last_change":"2023-10-16T13:39:20.911433+0000","last_active":"2023-10-16T13:39:22.322608+0000","last_peered":"2023-10-16T13:39:22.322608+0000","last_clean":"2023-10-16T13:39:22.322608+0000","last_became_active":"2023-10-16T13:39:20.908506+0000","last_became_peered":"2023-10-16T13:39:20.908506+0000","last_unstale":"2023-10-16T13:39:22.322608+0000","last_undegraded":"2023-10-16T13:39:22.322608+0000","last_fullsized":"2023-10-16T13:39:22.322608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907530+0000","last_change":"2023-10-16T13:39:20.912733+0000","last_active":"2023-10-16T13:39:21.907530+0000","last_peered":"2023-10-16T13:39:21.907530+0000","last_clean":"2023-10-16T13:39:21.907530+0000","last_became_active":"2023-10-16T13:39:20.912435+0000","last_became_peered":"2023-10-16T13:39:20.912435+0000","last_unstale":"2023-10-16T13:39:21.907530+0000","last_undegraded":"2023-10-16T13:39:21.907530+0000","last_fullsized":"2023-10-16T13:39:21.907530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:21.231153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322076+0000","last_change":"2023-10-16T13:39:20.911890+0000","last_active":"2023-10-16T13:39:22.322076+0000","last_peered":"2023-10-16T13:39:22.322076+0000","last_clean":"2023-10-16T13:39:22.322076+0000","last_became_active":"2023-10-16T13:39:20.911408+0000","last_became_peered":"2023-10-16T13:39:20.911408+0000","last_unstale":"2023-10-16T13:39:22.322076+0000","last_undegraded":"2023-10-16T13:39:22.322076+0000","last_fullsized":"2023-10-16T13:39:22.322076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322461+0000","last_change":"2023-10-16T13:39:20.911690+0000","last_active":"2023-10-16T13:39:22.322461+0000","last_peered":"2023-10-16T13:39:22.322461+0000","last_clean":"2023-10-16T13:39:22.322461+0000","last_became_active":"2023-10-16T13:39:20.911273+0000","last_became_peered":"2023-10-16T13:39:20.911273+0000","last_unstale":"2023-10-16T13:39:22.322461+0000","last_undegraded":"2023-10-16T13:39:22.322461+0000","last_fullsized":"2023-10-16T13:39:22.322461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:33.274046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322764+0000","last_change":"2023-10-16T13:39:20.908210+0000","last_active":"2023-10-16T13:39:22.322764+0000","last_peered":"2023-10-16T13:39:22.322764+0000","last_clean":"2023-10-16T13:39:22.322764+0000","last_became_active":"2023-10-16T13:39:20.907809+0000","last_became_peered":"2023-10-16T13:39:20.907809+0000","last_unstale":"2023-10-16T13:39:22.322764+0000","last_undegraded":"2023-10-16T13:39:22.322764+0000","last_fullsized":"2023-10-16T13:39:22.322764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:33.274046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322607+0000","last_change":"2023-10-16T13:39:20.909508+0000","last_active":"2023-10-16T13:39:22.322607+0000","last_peered":"2023-10-16T13:39:22.322607+0000","last_clean":"2023-10-16T13:39:22.322607+0000","last_became_active":"2023-10-16T13:39:20.909057+0000","last_became_peered":"2023-10-16T13:39:20.909057+0000","last_unstale":"2023-10-16T13:39:22.322607+0000","last_undegraded":"2023-10-16T13:39:22.322607+0000","last_fullsized":"2023-10-16T13:39:22.322607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322105+0000","last_change":"2023-10-16T13:39:20.915174+0000","last_active":"2023-10-16T13:39:22.322105+0000","last_peered":"2023-10-16T13:39:22.322105+0000","last_clean":"2023-10-16T13:39:22.322105+0000","last_became_active":"2023-10-16T13:39:20.914871+0000","last_became_peered":"2023-10-16T13:39:20.914871+0000","last_unstale":"2023-10-16T13:39:22.322105+0000","last_undegraded":"2023-10-16T13:39:22.322105+0000","last_fullsized":"2023-10-16T13:39:22.322105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:17.687258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907683+0000","last_change":"2023-10-16T13:39:20.919458+0000","last_active":"2023-10-16T13:39:21.907683+0000","last_peered":"2023-10-16T13:39:21.907683+0000","last_clean":"2023-10-16T13:39:21.907683+0000","last_became_active":"2023-10-16T13:39:20.919200+0000","last_became_peered":"2023-10-16T13:39:20.919200+0000","last_unstale":"2023-10-16T13:39:21.907683+0000","last_undegraded":"2023-10-16T13:39:21.907683+0000","last_fullsized":"2023-10-16T13:39:21.907683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:55.268898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908551+0000","last_change":"2023-10-16T13:39:20.920940+0000","last_active":"2023-10-16T13:39:21.908551+0000","last_peered":"2023-10-16T13:39:21.908551+0000","last_clean":"2023-10-16T13:39:21.908551+0000","last_became_active":"2023-10-16T13:39:20.920666+0000","last_became_peered":"2023-10-16T13:39:20.920666+0000","last_unstale":"2023-10-16T13:39:21.908551+0000","last_undegraded":"2023-10-16T13:39:21.908551+0000","last_fullsized":"2023-10-16T13:39:21.908551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321941+0000","last_change":"2023-10-16T13:39:20.919286+0000","last_active":"2023-10-16T13:39:22.321941+0000","last_peered":"2023-10-16T13:39:22.321941+0000","last_clean":"2023-10-16T13:39:22.321941+0000","last_became_active":"2023-10-16T13:39:20.919011+0000","last_became_peered":"2023-10-16T13:39:20.919011+0000","last_unstale":"2023-10-16T13:39:22.321941+0000","last_undegraded":"2023-10-16T13:39:22.321941+0000","last_fullsized":"2023-10-16T13:39:22.321941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:51.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908318+0000","last_change":"2023-10-16T13:39:20.912715+0000","last_active":"2023-10-16T13:39:21.908318+0000","last_peered":"2023-10-16T13:39:21.908318+0000","last_clean":"2023-10-16T13:39:21.908318+0000","last_became_active":"2023-10-16T13:39:20.912415+0000","last_became_peered":"2023-10-16T13:39:20.912415+0000","last_unstale":"2023-10-16T13:39:21.908318+0000","last_undegraded":"2023-10-16T13:39:21.908318+0000","last_fullsized":"2023-10-16T13:39:21.908318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904931+0000","last_change":"2023-10-16T13:39:20.914168+0000","last_active":"2023-10-16T13:39:21.904931+0000","last_peered":"2023-10-16T13:39:21.904931+0000","last_clean":"2023-10-16T13:39:21.904931+0000","last_became_active":"2023-10-16T13:39:20.913858+0000","last_became_peered":"2023-10-16T13:39:20.913858+0000","last_unstale":"2023-10-16T13:39:21.904931+0000","last_undegraded":"2023-10-16T13:39:21.904931+0000","last_fullsized":"2023-10-16T13:39:21.904931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322849+0000","last_change":"2023-10-16T13:39:20.911171+0000","last_active":"2023-10-16T13:39:22.322849+0000","last_peered":"2023-10-16T13:39:22.322849+0000","last_clean":"2023-10-16T13:39:22.322849+0000","last_became_active":"2023-10-16T13:39:20.910845+0000","last_became_peered":"2023-10-16T13:39:20.910845+0000","last_unstale":"2023-10-16T13:39:22.322849+0000","last_undegraded":"2023-10-16T13:39:22.322849+0000","last_fullsized":"2023-10-16T13:39:22.322849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:49.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905139+0000","last_change":"2023-10-16T13:39:20.914590+0000","last_active":"2023-10-16T13:39:21.905139+0000","last_peered":"2023-10-16T13:39:21.905139+0000","last_clean":"2023-10-16T13:39:21.905139+0000","last_became_active":"2023-10-16T13:39:20.913686+0000","last_became_peered":"2023-10-16T13:39:20.913686+0000","last_unstale":"2023-10-16T13:39:21.905139+0000","last_undegraded":"2023-10-16T13:39:21.905139+0000","last_fullsized":"2023-10-16T13:39:21.905139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907802+0000","last_change":"2023-10-16T13:39:20.921650+0000","last_active":"2023-10-16T13:39:21.907802+0000","last_peered":"2023-10-16T13:39:21.907802+0000","last_clean":"2023-10-16T13:39:21.907802+0000","last_became_active":"2023-10-16T13:39:20.921396+0000","last_became_peered":"2023-10-16T13:39:20.921396+0000","last_unstale":"2023-10-16T13:39:21.907802+0000","last_undegraded":"2023-10-16T13:39:21.907802+0000","last_fullsized":"2023-10-16T13:39:21.907802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907822+0000","last_change":"2023-10-16T13:39:20.917637+0000","last_active":"2023-10-16T13:39:21.907822+0000","last_peered":"2023-10-16T13:39:21.907822+0000","last_clean":"2023-10-16T13:39:21.907822+0000","last_became_active":"2023-10-16T13:39:20.917363+0000","last_became_peered":"2023-10-16T13:39:20.917363+0000","last_unstale":"2023-10-16T13:39:21.907822+0000","last_undegraded":"2023-10-16T13:39:21.907822+0000","last_fullsized":"2023-10-16T13:39:21.907822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:23.719551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322050+0000","last_change":"2023-10-16T13:39:20.911850+0000","last_active":"2023-10-16T13:39:22.322050+0000","last_peered":"2023-10-16T13:39:22.322050+0000","last_clean":"2023-10-16T13:39:22.322050+0000","last_became_active":"2023-10-16T13:39:20.911461+0000","last_became_peered":"2023-10-16T13:39:20.911461+0000","last_unstale":"2023-10-16T13:39:22.322050+0000","last_undegraded":"2023-10-16T13:39:22.322050+0000","last_fullsized":"2023-10-16T13:39:22.322050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321747+0000","last_change":"2023-10-16T13:39:20.910894+0000","last_active":"2023-10-16T13:39:22.321747+0000","last_peered":"2023-10-16T13:39:22.321747+0000","last_clean":"2023-10-16T13:39:22.321747+0000","last_became_active":"2023-10-16T13:39:20.910625+0000","last_became_peered":"2023-10-16T13:39:20.910625+0000","last_unstale":"2023-10-16T13:39:22.321747+0000","last_undegraded":"2023-10-16T13:39:22.321747+0000","last_fullsized":"2023-10-16T13:39:22.321747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:31.113460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322406+0000","last_change":"2023-10-16T13:39:20.917952+0000","last_active":"2023-10-16T13:39:22.322406+0000","last_peered":"2023-10-16T13:39:22.322406+0000","last_clean":"2023-10-16T13:39:22.322406+0000","last_became_active":"2023-10-16T13:39:20.917672+0000","last_became_peered":"2023-10-16T13:39:20.917672+0000","last_unstale":"2023-10-16T13:39:22.322406+0000","last_undegraded":"2023-10-16T13:39:22.322406+0000","last_fullsized":"2023-10-16T13:39:22.322406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321764+0000","last_change":"2023-10-16T13:39:20.922400+0000","last_active":"2023-10-16T13:39:22.321764+0000","last_peered":"2023-10-16T13:39:22.321764+0000","last_clean":"2023-10-16T13:39:22.321764+0000","last_became_active":"2023-10-16T13:39:20.921792+0000","last_became_peered":"2023-10-16T13:39:20.921792+0000","last_unstale":"2023-10-16T13:39:22.321764+0000","last_undegraded":"2023-10-16T13:39:22.321764+0000","last_fullsized":"2023-10-16T13:39:22.321764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:57.327298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322196+0000","last_change":"2023-10-16T13:39:19.913389+0000","last_active":"2023-10-16T13:39:22.322196+0000","last_peered":"2023-10-16T13:39:22.322196+0000","last_clean":"2023-10-16T13:39:22.322196+0000","last_became_active":"2023-10-16T13:39:19.913122+0000","last_became_peered":"2023-10-16T13:39:19.913122+0000","last_unstale":"2023-10-16T13:39:22.322196+0000","last_undegraded":"2023-10-16T13:39:22.322196+0000","last_fullsized":"2023-10-16T13:39:22.322196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322098+0000","last_change":"2023-10-16T13:39:20.917450+0000","last_active":"2023-10-16T13:39:22.322098+0000","last_peered":"2023-10-16T13:39:22.322098+0000","last_clean":"2023-10-16T13:39:22.322098+0000","last_became_active":"2023-10-16T13:39:20.917157+0000","last_became_peered":"2023-10-16T13:39:20.917157+0000","last_unstale":"2023-10-16T13:39:22.322098+0000","last_undegraded":"2023-10-16T13:39:22.322098+0000","last_fullsized":"2023-10-16T13:39:22.322098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:20.057433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322006+0000","last_change":"2023-10-16T13:39:19.914389+0000","last_active":"2023-10-16T13:39:22.322006+0000","last_peered":"2023-10-16T13:39:22.322006+0000","last_clean":"2023-10-16T13:39:22.322006+0000","last_became_active":"2023-10-16T13:39:19.914126+0000","last_became_peered":"2023-10-16T13:39:19.914126+0000","last_unstale":"2023-10-16T13:39:22.322006+0000","last_undegraded":"2023-10-16T13:39:22.322006+0000","last_fullsized":"2023-10-16T13:39:22.322006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:30.111615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908163+0000","last_change":"2023-10-16T13:39:20.917550+0000","last_active":"2023-10-16T13:39:21.908163+0000","last_peered":"2023-10-16T13:39:21.908163+0000","last_clean":"2023-10-16T13:39:21.908163+0000","last_became_active":"2023-10-16T13:39:20.917261+0000","last_became_peered":"2023-10-16T13:39:20.917261+0000","last_unstale":"2023-10-16T13:39:21.908163+0000","last_undegraded":"2023-10-16T13:39:21.908163+0000","last_fullsized":"2023-10-16T13:39:21.908163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:54.865090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322570+0000","last_change":"2023-10-16T13:39:19.907530+0000","last_active":"2023-10-16T13:39:22.322570+0000","last_peered":"2023-10-16T13:39:22.322570+0000","last_clean":"2023-10-16T13:39:22.322570+0000","last_became_active":"2023-10-16T13:39:19.907179+0000","last_became_peered":"2023-10-16T13:39:19.907179+0000","last_unstale":"2023-10-16T13:39:22.322570+0000","last_undegraded":"2023-10-16T13:39:22.322570+0000","last_fullsized":"2023-10-16T13:39:22.322570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:21.592605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905114+0000","last_change":"2023-10-16T13:39:20.914196+0000","last_active":"2023-10-16T13:39:21.905114+0000","last_peered":"2023-10-16T13:39:21.905114+0000","last_clean":"2023-10-16T13:39:21.905114+0000","last_became_active":"2023-10-16T13:39:20.913327+0000","last_became_peered":"2023-10-16T13:39:20.913327+0000","last_unstale":"2023-10-16T13:39:21.905114+0000","last_undegraded":"2023-10-16T13:39:21.905114+0000","last_fullsized":"2023-10-16T13:39:21.905114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:49.345373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322176+0000","last_change":"2023-10-16T13:39:19.912833+0000","last_active":"2023-10-16T13:39:22.322176+0000","last_peered":"2023-10-16T13:39:22.322176+0000","last_clean":"2023-10-16T13:39:22.322176+0000","last_became_active":"2023-10-16T13:39:19.912335+0000","last_became_peered":"2023-10-16T13:39:19.912335+0000","last_unstale":"2023-10-16T13:39:22.322176+0000","last_undegraded":"2023-10-16T13:39:22.322176+0000","last_fullsized":"2023-10-16T13:39:22.322176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:29.357845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322346+0000","last_change":"2023-10-16T13:39:20.920905+0000","last_active":"2023-10-16T13:39:22.322346+0000","last_peered":"2023-10-16T13:39:22.322346+0000","last_clean":"2023-10-16T13:39:22.322346+0000","last_became_active":"2023-10-16T13:39:20.920590+0000","last_became_peered":"2023-10-16T13:39:20.920590+0000","last_unstale":"2023-10-16T13:39:22.322346+0000","last_undegraded":"2023-10-16T13:39:22.322346+0000","last_fullsized":"2023-10-16T13:39:22.322346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907989+0000","last_change":"2023-10-16T13:39:19.911910+0000","last_active":"2023-10-16T13:39:21.907989+0000","last_peered":"2023-10-16T13:39:21.907989+0000","last_clean":"2023-10-16T13:39:21.907989+0000","last_became_active":"2023-10-16T13:39:19.911583+0000","last_became_peered":"2023-10-16T13:39:19.911583+0000","last_unstale":"2023-10-16T13:39:21.907989+0000","last_undegraded":"2023-10-16T13:39:21.907989+0000","last_fullsized":"2023-10-16T13:39:21.907989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:19.055588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907876+0000","last_change":"2023-10-16T13:39:20.915190+0000","last_active":"2023-10-16T13:39:21.907876+0000","last_peered":"2023-10-16T13:39:21.907876+0000","last_clean":"2023-10-16T13:39:21.907876+0000","last_became_active":"2023-10-16T13:39:20.914925+0000","last_became_peered":"2023-10-16T13:39:20.914925+0000","last_unstale":"2023-10-16T13:39:21.907876+0000","last_undegraded":"2023-10-16T13:39:21.907876+0000","last_fullsized":"2023-10-16T13:39:21.907876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908562+0000","last_change":"2023-10-16T13:39:19.911559+0000","last_active":"2023-10-16T13:39:21.908562+0000","last_peered":"2023-10-16T13:39:21.908562+0000","last_clean":"2023-10-16T13:39:21.908562+0000","last_became_active":"2023-10-16T13:39:19.911241+0000","last_became_peered":"2023-10-16T13:39:19.911241+0000","last_unstale":"2023-10-16T13:39:21.908562+0000","last_undegraded":"2023-10-16T13:39:21.908562+0000","last_fullsized":"2023-10-16T13:39:21.908562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:30.111615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907623+0000","last_change":"2023-10-16T13:39:20.912896+0000","last_active":"2023-10-16T13:39:21.907623+0000","last_peered":"2023-10-16T13:39:21.907623+0000","last_clean":"2023-10-16T13:39:21.907623+0000","last_became_active":"2023-10-16T13:39:20.912615+0000","last_became_peered":"2023-10-16T13:39:20.912615+0000","last_unstale":"2023-10-16T13:39:21.907623+0000","last_undegraded":"2023-10-16T13:39:21.907623+0000","last_fullsized":"2023-10-16T13:39:21.907623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:53.306545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322286+0000","last_change":"2023-10-16T13:39:19.912803+0000","last_active":"2023-10-16T13:39:22.322286+0000","last_peered":"2023-10-16T13:39:22.322286+0000","last_clean":"2023-10-16T13:39:22.322286+0000","last_became_active":"2023-10-16T13:39:19.912421+0000","last_became_peered":"2023-10-16T13:39:19.912421+0000","last_unstale":"2023-10-16T13:39:22.322286+0000","last_undegraded":"2023-10-16T13:39:22.322286+0000","last_fullsized":"2023-10-16T13:39:22.322286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904560+0000","last_change":"2023-10-16T13:39:20.914138+0000","last_active":"2023-10-16T13:39:21.904560+0000","last_peered":"2023-10-16T13:39:21.904560+0000","last_clean":"2023-10-16T13:39:21.904560+0000","last_became_active":"2023-10-16T13:39:20.913876+0000","last_became_peered":"2023-10-16T13:39:20.913876+0000","last_unstale":"2023-10-16T13:39:21.904560+0000","last_undegraded":"2023-10-16T13:39:21.904560+0000","last_fullsized":"2023-10-16T13:39:21.904560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:23.719551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907447+0000","last_change":"2023-10-16T13:39:19.910502+0000","last_active":"2023-10-16T13:39:21.907447+0000","last_peered":"2023-10-16T13:39:21.907447+0000","last_clean":"2023-10-16T13:39:21.907447+0000","last_became_active":"2023-10-16T13:39:19.910217+0000","last_became_peered":"2023-10-16T13:39:19.910217+0000","last_unstale":"2023-10-16T13:39:21.907447+0000","last_undegraded":"2023-10-16T13:39:21.907447+0000","last_fullsized":"2023-10-16T13:39:21.907447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:56.325453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908310+0000","last_change":"2023-10-16T13:39:20.913603+0000","last_active":"2023-10-16T13:39:21.908310+0000","last_peered":"2023-10-16T13:39:21.908310+0000","last_clean":"2023-10-16T13:39:21.908310+0000","last_became_active":"2023-10-16T13:39:20.913251+0000","last_became_peered":"2023-10-16T13:39:20.913251+0000","last_unstale":"2023-10-16T13:39:21.908310+0000","last_undegraded":"2023-10-16T13:39:21.908310+0000","last_fullsized":"2023-10-16T13:39:21.908310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322768+0000","last_change":"2023-10-16T13:39:19.915218+0000","last_active":"2023-10-16T13:39:22.322768+0000","last_peered":"2023-10-16T13:39:22.322768+0000","last_clean":"2023-10-16T13:39:22.322768+0000","last_became_active":"2023-10-16T13:39:19.913215+0000","last_became_peered":"2023-10-16T13:39:19.913215+0000","last_unstale":"2023-10-16T13:39:22.322768+0000","last_undegraded":"2023-10-16T13:39:22.322768+0000","last_fullsized":"2023-10-16T13:39:22.322768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:54.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322802+0000","last_change":"2023-10-16T13:39:20.908775+0000","last_active":"2023-10-16T13:39:22.322802+0000","last_peered":"2023-10-16T13:39:22.322802+0000","last_clean":"2023-10-16T13:39:22.322802+0000","last_became_active":"2023-10-16T13:39:20.908468+0000","last_became_peered":"2023-10-16T13:39:20.908468+0000","last_unstale":"2023-10-16T13:39:22.322802+0000","last_undegraded":"2023-10-16T13:39:22.322802+0000","last_fullsized":"2023-10-16T13:39:22.322802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:00.699575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321864+0000","last_change":"2023-10-16T13:39:19.911047+0000","last_active":"2023-10-16T13:39:22.321864+0000","last_peered":"2023-10-16T13:39:22.321864+0000","last_clean":"2023-10-16T13:39:22.321864+0000","last_became_active":"2023-10-16T13:39:19.910721+0000","last_became_peered":"2023-10-16T13:39:19.910721+0000","last_unstale":"2023-10-16T13:39:22.321864+0000","last_undegraded":"2023-10-16T13:39:22.321864+0000","last_fullsized":"2023-10-16T13:39:22.321864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322678+0000","last_change":"2023-10-16T13:39:20.912846+0000","last_active":"2023-10-16T13:39:22.322678+0000","last_peered":"2023-10-16T13:39:22.322678+0000","last_clean":"2023-10-16T13:39:22.322678+0000","last_became_active":"2023-10-16T13:39:20.912556+0000","last_became_peered":"2023-10-16T13:39:20.912556+0000","last_unstale":"2023-10-16T13:39:22.322678+0000","last_undegraded":"2023-10-16T13:39:22.322678+0000","last_fullsized":"2023-10-16T13:39:22.322678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:50.661096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908002+0000","last_change":"2023-10-16T13:39:19.913341+0000","last_active":"2023-10-16T13:39:21.908002+0000","last_peered":"2023-10-16T13:39:21.908002+0000","last_clean":"2023-10-16T13:39:21.908002+0000","last_became_active":"2023-10-16T13:39:19.913078+0000","last_became_peered":"2023-10-16T13:39:19.913078+0000","last_unstale":"2023-10-16T13:39:21.908002+0000","last_undegraded":"2023-10-16T13:39:21.908002+0000","last_fullsized":"2023-10-16T13:39:21.908002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:53.863245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907898+0000","last_change":"2023-10-16T13:39:20.913115+0000","last_active":"2023-10-16T13:39:21.907898+0000","last_peered":"2023-10-16T13:39:21.907898+0000","last_clean":"2023-10-16T13:39:21.907898+0000","last_became_active":"2023-10-16T13:39:20.912566+0000","last_became_peered":"2023-10-16T13:39:20.912566+0000","last_unstale":"2023-10-16T13:39:21.907898+0000","last_undegraded":"2023-10-16T13:39:21.907898+0000","last_fullsized":"2023-10-16T13:39:21.907898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322651+0000","last_change":"2023-10-16T13:39:19.920111+0000","last_active":"2023-10-16T13:39:22.322651+0000","last_peered":"2023-10-16T13:39:22.322651+0000","last_clean":"2023-10-16T13:39:22.322651+0000","last_became_active":"2023-10-16T13:39:19.919659+0000","last_became_peered":"2023-10-16T13:39:19.919659+0000","last_unstale":"2023-10-16T13:39:22.322651+0000","last_undegraded":"2023-10-16T13:39:22.322651+0000","last_fullsized":"2023-10-16T13:39:22.322651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:35.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904618+0000","last_change":"2023-10-16T13:39:20.914690+0000","last_active":"2023-10-16T13:39:21.904618+0000","last_peered":"2023-10-16T13:39:21.904618+0000","last_clean":"2023-10-16T13:39:21.904618+0000","last_became_active":"2023-10-16T13:39:20.914434+0000","last_became_peered":"2023-10-16T13:39:20.914434+0000","last_unstale":"2023-10-16T13:39:21.904618+0000","last_undegraded":"2023-10-16T13:39:21.904618+0000","last_fullsized":"2023-10-16T13:39:21.904618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:54.865090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908088+0000","last_change":"2023-10-16T13:39:19.913702+0000","last_active":"2023-10-16T13:39:21.908088+0000","last_peered":"2023-10-16T13:39:21.908088+0000","last_clean":"2023-10-16T13:39:21.908088+0000","last_became_active":"2023-10-16T13:39:19.913451+0000","last_became_peered":"2023-10-16T13:39:19.913451+0000","last_unstale":"2023-10-16T13:39:21.908088+0000","last_undegraded":"2023-10-16T13:39:21.908088+0000","last_fullsized":"2023-10-16T13:39:21.908088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:50.118463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322654+0000","last_change":"2023-10-16T13:39:20.917747+0000","last_active":"2023-10-16T13:39:22.322654+0000","last_peered":"2023-10-16T13:39:22.322654+0000","last_clean":"2023-10-16T13:39:22.322654+0000","last_became_active":"2023-10-16T13:39:20.917442+0000","last_became_peered":"2023-10-16T13:39:20.917442+0000","last_unstale":"2023-10-16T13:39:22.322654+0000","last_undegraded":"2023-10-16T13:39:22.322654+0000","last_fullsized":"2023-10-16T13:39:22.322654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904603+0000","last_change":"2023-10-16T13:39:19.902332+0000","last_active":"2023-10-16T13:39:21.904603+0000","last_peered":"2023-10-16T13:39:21.904603+0000","last_clean":"2023-10-16T13:39:21.904603+0000","last_became_active":"2023-10-16T13:39:19.902050+0000","last_became_peered":"2023-10-16T13:39:19.902050+0000","last_unstale":"2023-10-16T13:39:21.904603+0000","last_undegraded":"2023-10-16T13:39:21.904603+0000","last_fullsized":"2023-10-16T13:39:21.904603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:19.055588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322337+0000","last_change":"2023-10-16T13:39:20.917922+0000","last_active":"2023-10-16T13:39:22.322337+0000","last_peered":"2023-10-16T13:39:22.322337+0000","last_clean":"2023-10-16T13:39:22.322337+0000","last_became_active":"2023-10-16T13:39:20.917301+0000","last_became_peered":"2023-10-16T13:39:20.917301+0000","last_unstale":"2023-10-16T13:39:22.322337+0000","last_undegraded":"2023-10-16T13:39:22.322337+0000","last_fullsized":"2023-10-16T13:39:22.322337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:16:37.071264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322289+0000","last_change":"2023-10-16T13:39:19.915793+0000","last_active":"2023-10-16T13:39:22.322289+0000","last_peered":"2023-10-16T13:39:22.322289+0000","last_clean":"2023-10-16T13:39:22.322289+0000","last_became_active":"2023-10-16T13:39:19.913189+0000","last_became_peered":"2023-10-16T13:39:19.913189+0000","last_unstale":"2023-10-16T13:39:22.322289+0000","last_undegraded":"2023-10-16T13:39:22.322289+0000","last_fullsized":"2023-10-16T13:39:22.322289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321637+0000","last_change":"2023-10-16T13:39:20.913612+0000","last_active":"2023-10-16T13:39:22.321637+0000","last_peered":"2023-10-16T13:39:22.321637+0000","last_clean":"2023-10-16T13:39:22.321637+0000","last_became_active":"2023-10-16T13:39:20.913115+0000","last_became_peered":"2023-10-16T13:39:20.913115+0000","last_unstale":"2023-10-16T13:39:22.321637+0000","last_undegraded":"2023-10-16T13:39:22.321637+0000","last_fullsized":"2023-10-16T13:39:22.321637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:50.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321448+0000","last_change":"2023-10-16T13:39:19.919530+0000","last_active":"2023-10-16T13:39:22.321448+0000","last_peered":"2023-10-16T13:39:22.321448+0000","last_clean":"2023-10-16T13:39:22.321448+0000","last_became_active":"2023-10-16T13:39:19.919283+0000","last_became_peered":"2023-10-16T13:39:19.919283+0000","last_unstale":"2023-10-16T13:39:22.321448+0000","last_undegraded":"2023-10-16T13:39:22.321448+0000","last_fullsized":"2023-10-16T13:39:22.321448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908166+0000","last_change":"2023-10-16T13:39:20.919355+0000","last_active":"2023-10-16T13:39:21.908166+0000","last_peered":"2023-10-16T13:39:21.908166+0000","last_clean":"2023-10-16T13:39:21.908166+0000","last_became_active":"2023-10-16T13:39:20.919085+0000","last_became_peered":"2023-10-16T13:39:20.919085+0000","last_unstale":"2023-10-16T13:39:21.908166+0000","last_undegraded":"2023-10-16T13:39:21.908166+0000","last_fullsized":"2023-10-16T13:39:21.908166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:04:22.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905047+0000","last_change":"2023-10-16T13:39:19.918132+0000","last_active":"2023-10-16T13:39:21.905047+0000","last_peered":"2023-10-16T13:39:21.905047+0000","last_clean":"2023-10-16T13:39:21.905047+0000","last_became_active":"2023-10-16T13:39:19.917873+0000","last_became_peered":"2023-10-16T13:39:19.917873+0000","last_unstale":"2023-10-16T13:39:21.905047+0000","last_undegraded":"2023-10-16T13:39:21.905047+0000","last_fullsized":"2023-10-16T13:39:21.905047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:57.316921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908168+0000","last_change":"2023-10-16T13:39:20.916435+0000","last_active":"2023-10-16T13:39:21.908168+0000","last_peered":"2023-10-16T13:39:21.908168+0000","last_clean":"2023-10-16T13:39:21.908168+0000","last_became_active":"2023-10-16T13:39:20.916130+0000","last_became_peered":"2023-10-16T13:39:20.916130+0000","last_unstale":"2023-10-16T13:39:21.908168+0000","last_undegraded":"2023-10-16T13:39:21.908168+0000","last_fullsized":"2023-10-16T13:39:21.908168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:08.002225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908260+0000","last_change":"2023-10-16T13:39:19.910540+0000","last_active":"2023-10-16T13:39:21.908260+0000","last_peered":"2023-10-16T13:39:21.908260+0000","last_clean":"2023-10-16T13:39:21.908260+0000","last_became_active":"2023-10-16T13:39:19.910286+0000","last_became_peered":"2023-10-16T13:39:19.910286+0000","last_unstale":"2023-10-16T13:39:21.908260+0000","last_undegraded":"2023-10-16T13:39:21.908260+0000","last_fullsized":"2023-10-16T13:39:21.908260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904912+0000","last_change":"2023-10-16T13:39:20.917001+0000","last_active":"2023-10-16T13:39:21.904912+0000","last_peered":"2023-10-16T13:39:21.904912+0000","last_clean":"2023-10-16T13:39:21.904912+0000","last_became_active":"2023-10-16T13:39:20.916713+0000","last_became_peered":"2023-10-16T13:39:20.916713+0000","last_unstale":"2023-10-16T13:39:21.904912+0000","last_undegraded":"2023-10-16T13:39:21.904912+0000","last_fullsized":"2023-10-16T13:39:21.904912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:33.513310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907935+0000","last_change":"2023-10-16T13:39:19.913336+0000","last_active":"2023-10-16T13:39:21.907935+0000","last_peered":"2023-10-16T13:39:21.907935+0000","last_clean":"2023-10-16T13:39:21.907935+0000","last_became_active":"2023-10-16T13:39:19.912317+0000","last_became_peered":"2023-10-16T13:39:19.912317+0000","last_unstale":"2023-10-16T13:39:21.907935+0000","last_undegraded":"2023-10-16T13:39:21.907935+0000","last_fullsized":"2023-10-16T13:39:21.907935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322170+0000","last_change":"2023-10-16T13:39:20.914524+0000","last_active":"2023-10-16T13:39:22.322170+0000","last_peered":"2023-10-16T13:39:22.322170+0000","last_clean":"2023-10-16T13:39:22.322170+0000","last_became_active":"2023-10-16T13:39:20.913796+0000","last_became_peered":"2023-10-16T13:39:20.913796+0000","last_unstale":"2023-10-16T13:39:22.322170+0000","last_undegraded":"2023-10-16T13:39:22.322170+0000","last_fullsized":"2023-10-16T13:39:22.322170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:50.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908250+0000","last_change":"2023-10-16T13:39:19.911516+0000","last_active":"2023-10-16T13:39:21.908250+0000","last_peered":"2023-10-16T13:39:21.908250+0000","last_clean":"2023-10-16T13:39:21.908250+0000","last_became_active":"2023-10-16T13:39:19.911218+0000","last_became_peered":"2023-10-16T13:39:19.911218+0000","last_unstale":"2023-10-16T13:39:21.908250+0000","last_undegraded":"2023-10-16T13:39:21.908250+0000","last_fullsized":"2023-10-16T13:39:21.908250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:27.653967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322114+0000","last_change":"2023-10-16T13:39:20.921060+0000","last_active":"2023-10-16T13:39:22.322114+0000","last_peered":"2023-10-16T13:39:22.322114+0000","last_clean":"2023-10-16T13:39:22.322114+0000","last_became_active":"2023-10-16T13:39:20.920780+0000","last_became_peered":"2023-10-16T13:39:20.920780+0000","last_unstale":"2023-10-16T13:39:22.322114+0000","last_undegraded":"2023-10-16T13:39:22.322114+0000","last_fullsized":"2023-10-16T13:39:22.322114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:36:54.514746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321723+0000","last_change":"2023-10-16T13:39:19.913392+0000","last_active":"2023-10-16T13:39:22.321723+0000","last_peered":"2023-10-16T13:39:22.321723+0000","last_clean":"2023-10-16T13:39:22.321723+0000","last_became_active":"2023-10-16T13:39:19.913123+0000","last_became_peered":"2023-10-16T13:39:19.913123+0000","last_unstale":"2023-10-16T13:39:22.321723+0000","last_undegraded":"2023-10-16T13:39:22.321723+0000","last_fullsized":"2023-10-16T13:39:22.321723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:32.878301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321832+0000","last_change":"2023-10-16T13:39:20.919546+0000","last_active":"2023-10-16T13:39:22.321832+0000","last_peered":"2023-10-16T13:39:22.321832+0000","last_clean":"2023-10-16T13:39:22.321832+0000","last_became_active":"2023-10-16T13:39:20.919294+0000","last_became_peered":"2023-10-16T13:39:20.919294+0000","last_unstale":"2023-10-16T13:39:22.321832+0000","last_undegraded":"2023-10-16T13:39:22.321832+0000","last_fullsized":"2023-10-16T13:39:22.321832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:54:19.610289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321727+0000","last_change":"2023-10-16T13:39:19.903187+0000","last_active":"2023-10-16T13:39:22.321727+0000","last_peered":"2023-10-16T13:39:22.321727+0000","last_clean":"2023-10-16T13:39:22.321727+0000","last_became_active":"2023-10-16T13:39:19.902860+0000","last_became_peered":"2023-10-16T13:39:19.902860+0000","last_unstale":"2023-10-16T13:39:22.321727+0000","last_undegraded":"2023-10-16T13:39:22.321727+0000","last_fullsized":"2023-10-16T13:39:22.321727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321706+0000","last_change":"2023-10-16T13:39:20.915946+0000","last_active":"2023-10-16T13:39:22.321706+0000","last_peered":"2023-10-16T13:39:22.321706+0000","last_clean":"2023-10-16T13:39:22.321706+0000","last_became_active":"2023-10-16T13:39:20.915670+0000","last_became_peered":"2023-10-16T13:39:20.915670+0000","last_unstale":"2023-10-16T13:39:22.321706+0000","last_undegraded":"2023-10-16T13:39:22.321706+0000","last_fullsized":"2023-10-16T13:39:22.321706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:29.927125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907965+0000","last_change":"2023-10-16T13:39:19.906563+0000","last_active":"2023-10-16T13:39:21.907965+0000","last_peered":"2023-10-16T13:39:21.907965+0000","last_clean":"2023-10-16T13:39:21.907965+0000","last_became_active":"2023-10-16T13:39:19.906291+0000","last_became_peered":"2023-10-16T13:39:19.906291+0000","last_unstale":"2023-10-16T13:39:21.907965+0000","last_undegraded":"2023-10-16T13:39:21.907965+0000","last_fullsized":"2023-10-16T13:39:21.907965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321969+0000","last_change":"2023-10-16T13:39:20.912234+0000","last_active":"2023-10-16T13:39:22.321969+0000","last_peered":"2023-10-16T13:39:22.321969+0000","last_clean":"2023-10-16T13:39:22.321969+0000","last_became_active":"2023-10-16T13:39:20.911937+0000","last_became_peered":"2023-10-16T13:39:20.911937+0000","last_unstale":"2023-10-16T13:39:22.321969+0000","last_undegraded":"2023-10-16T13:39:22.321969+0000","last_fullsized":"2023-10-16T13:39:22.321969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:47:36.974091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907256+0000","last_change":"2023-10-16T13:39:19.909910+0000","last_active":"2023-10-16T13:39:21.907256+0000","last_peered":"2023-10-16T13:39:21.907256+0000","last_clean":"2023-10-16T13:39:21.907256+0000","last_became_active":"2023-10-16T13:39:19.909600+0000","last_became_peered":"2023-10-16T13:39:19.909600+0000","last_unstale":"2023-10-16T13:39:21.907256+0000","last_undegraded":"2023-10-16T13:39:21.907256+0000","last_fullsized":"2023-10-16T13:39:21.907256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:22.717706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322110+0000","last_change":"2023-10-16T13:39:20.915302+0000","last_active":"2023-10-16T13:39:22.322110+0000","last_peered":"2023-10-16T13:39:22.322110+0000","last_clean":"2023-10-16T13:39:22.322110+0000","last_became_active":"2023-10-16T13:39:20.914945+0000","last_became_peered":"2023-10-16T13:39:20.914945+0000","last_unstale":"2023-10-16T13:39:22.322110+0000","last_undegraded":"2023-10-16T13:39:22.322110+0000","last_fullsized":"2023-10-16T13:39:22.322110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:33.880146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.905094+0000","last_change":"2023-10-16T13:39:19.910212+0000","last_active":"2023-10-16T13:39:21.905094+0000","last_peered":"2023-10-16T13:39:21.905094+0000","last_clean":"2023-10-16T13:39:21.905094+0000","last_became_active":"2023-10-16T13:39:19.909900+0000","last_became_peered":"2023-10-16T13:39:19.909900+0000","last_unstale":"2023-10-16T13:39:21.905094+0000","last_undegraded":"2023-10-16T13:39:21.905094+0000","last_fullsized":"2023-10-16T13:39:21.905094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:54.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908168+0000","last_change":"2023-10-16T13:39:20.914323+0000","last_active":"2023-10-16T13:39:21.908168+0000","last_peered":"2023-10-16T13:39:21.908168+0000","last_clean":"2023-10-16T13:39:21.908168+0000","last_became_active":"2023-10-16T13:39:20.914006+0000","last_became_peered":"2023-10-16T13:39:20.914006+0000","last_unstale":"2023-10-16T13:39:21.908168+0000","last_undegraded":"2023-10-16T13:39:21.908168+0000","last_fullsized":"2023-10-16T13:39:21.908168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:24.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.928351+0000","last_change":"2023-10-16T13:39:19.911913+0000","last_active":"2023-10-16T13:39:22.928351+0000","last_peered":"2023-10-16T13:39:22.928351+0000","last_clean":"2023-10-16T13:39:22.928351+0000","last_became_active":"2023-10-16T13:39:19.911658+0000","last_became_peered":"2023-10-16T13:39:19.911658+0000","last_unstale":"2023-10-16T13:39:22.928351+0000","last_undegraded":"2023-10-16T13:39:22.928351+0000","last_fullsized":"2023-10-16T13:39:22.928351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:51:49.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322172+0000","last_change":"2023-10-16T13:39:20.917946+0000","last_active":"2023-10-16T13:39:22.322172+0000","last_peered":"2023-10-16T13:39:22.322172+0000","last_clean":"2023-10-16T13:39:22.322172+0000","last_became_active":"2023-10-16T13:39:20.917648+0000","last_became_peered":"2023-10-16T13:39:20.917648+0000","last_unstale":"2023-10-16T13:39:22.322172+0000","last_undegraded":"2023-10-16T13:39:22.322172+0000","last_fullsized":"2023-10-16T13:39:22.322172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:58.318766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904870+0000","last_change":"2023-10-16T13:39:19.918894+0000","last_active":"2023-10-16T13:39:21.904870+0000","last_peered":"2023-10-16T13:39:21.904870+0000","last_clean":"2023-10-16T13:39:21.904870+0000","last_became_active":"2023-10-16T13:39:19.918458+0000","last_became_peered":"2023-10-16T13:39:19.918458+0000","last_unstale":"2023-10-16T13:39:21.904870+0000","last_undegraded":"2023-10-16T13:39:21.904870+0000","last_fullsized":"2023-10-16T13:39:21.904870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:49:50.118463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321952+0000","last_change":"2023-10-16T13:39:20.915690+0000","last_active":"2023-10-16T13:39:22.321952+0000","last_peered":"2023-10-16T13:39:22.321952+0000","last_clean":"2023-10-16T13:39:22.321952+0000","last_became_active":"2023-10-16T13:39:20.915346+0000","last_became_peered":"2023-10-16T13:39:20.915346+0000","last_unstale":"2023-10-16T13:39:22.321952+0000","last_undegraded":"2023-10-16T13:39:22.321952+0000","last_fullsized":"2023-10-16T13:39:22.321952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:28.655812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321621+0000","last_change":"2023-10-16T13:39:19.917669+0000","last_active":"2023-10-16T13:39:22.321621+0000","last_peered":"2023-10-16T13:39:22.321621+0000","last_clean":"2023-10-16T13:39:22.321621+0000","last_became_active":"2023-10-16T13:39:19.917437+0000","last_became_peered":"2023-10-16T13:39:19.917437+0000","last_unstale":"2023-10-16T13:39:22.321621+0000","last_undegraded":"2023-10-16T13:39:22.321621+0000","last_fullsized":"2023-10-16T13:39:22.321621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:24.689767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321883+0000","last_change":"2023-10-16T13:39:20.919727+0000","last_active":"2023-10-16T13:39:22.321883+0000","last_peered":"2023-10-16T13:39:22.321883+0000","last_clean":"2023-10-16T13:39:22.321883+0000","last_became_active":"2023-10-16T13:39:20.918649+0000","last_became_peered":"2023-10-16T13:39:20.918649+0000","last_unstale":"2023-10-16T13:39:22.321883+0000","last_undegraded":"2023-10-16T13:39:22.321883+0000","last_fullsized":"2023-10-16T13:39:22.321883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:18:20.057433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.904681+0000","last_change":"2023-10-16T13:39:19.909981+0000","last_active":"2023-10-16T13:39:21.904681+0000","last_peered":"2023-10-16T13:39:21.904681+0000","last_clean":"2023-10-16T13:39:21.904681+0000","last_became_active":"2023-10-16T13:39:19.909686+0000","last_became_peered":"2023-10-16T13:39:19.909686+0000","last_unstale":"2023-10-16T13:39:21.904681+0000","last_undegraded":"2023-10-16T13:39:21.904681+0000","last_fullsized":"2023-10-16T13:39:21.904681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:52.304700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321354+0000","last_change":"2023-10-16T13:39:20.908279+0000","last_active":"2023-10-16T13:39:22.321354+0000","last_peered":"2023-10-16T13:39:22.321354+0000","last_clean":"2023-10-16T13:39:22.321354+0000","last_became_active":"2023-10-16T13:39:20.907944+0000","last_became_peered":"2023-10-16T13:39:20.907944+0000","last_unstale":"2023-10-16T13:39:22.321354+0000","last_undegraded":"2023-10-16T13:39:22.321354+0000","last_fullsized":"2023-10-16T13:39:22.321354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:54:36.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.908323+0000","last_change":"2023-10-16T13:39:19.911350+0000","last_active":"2023-10-16T13:39:21.908323+0000","last_peered":"2023-10-16T13:39:21.908323+0000","last_clean":"2023-10-16T13:39:21.908323+0000","last_became_active":"2023-10-16T13:39:19.911066+0000","last_became_peered":"2023-10-16T13:39:19.911066+0000","last_unstale":"2023-10-16T13:39:21.908323+0000","last_undegraded":"2023-10-16T13:39:21.908323+0000","last_fullsized":"2023-10-16T13:39:21.908323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:16.685413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:21.907463+0000","last_change":"2023-10-16T13:39:20.920262+0000","last_active":"2023-10-16T13:39:21.907463+0000","last_peered":"2023-10-16T13:39:21.907463+0000","last_clean":"2023-10-16T13:39:21.907463+0000","last_became_active":"2023-10-16T13:39:20.919964+0000","last_became_peered":"2023-10-16T13:39:20.919964+0000","last_unstale":"2023-10-16T13:39:21.907463+0000","last_undegraded":"2023-10-16T13:39:21.907463+0000","last_fullsized":"2023-10-16T13:39:21.907463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:58.318766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321606+0000","last_change":"2023-10-16T13:39:19.912283+0000","last_active":"2023-10-16T13:39:22.321606+0000","last_peered":"2023-10-16T13:39:22.321606+0000","last_clean":"2023-10-16T13:39:22.321606+0000","last_became_active":"2023-10-16T13:39:19.912033+0000","last_became_peered":"2023-10-16T13:39:19.912033+0000","last_unstale":"2023-10-16T13:39:22.321606+0000","last_undegraded":"2023-10-16T13:39:22.321606+0000","last_fullsized":"2023-10-16T13:39:22.321606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:27.653967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.322399+0000","last_change":"2023-10-16T13:39:20.912138+0000","last_active":"2023-10-16T13:39:22.322399+0000","last_peered":"2023-10-16T13:39:22.322399+0000","last_clean":"2023-10-16T13:39:22.322399+0000","last_became_active":"2023-10-16T13:39:20.911059+0000","last_became_peered":"2023-10-16T13:39:20.911059+0000","last_unstale":"2023-10-16T13:39:22.322399+0000","last_undegraded":"2023-10-16T13:39:22.322399+0000","last_fullsized":"2023-10-16T13:39:22.322399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:19.888646+0000","last_clean_scrub_stamp":"2023-10-16T13:39:19.888646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:35.976513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T13:39:22.321822+0000","last_change":"2023-10-16T13:39:19.911727+0000","last_active":"2023-10-16T13:39:22.321822+0000","last_peered":"2023-10-16T13:39:22.321822+0000","last_clean":"2023-10-16T13:39:22.321822+0000","last_became_active":"2023-10-16T13:39:19.908368+0000","last_became_peered":"2023-10-16T13:39:19.908368+0000","last_unstale":"2023-10-16T13:39:22.321822+0000","last_undegraded":"2023-10-16T13:39:22.321822+0000","last_fullsized":"2023-10-16T13:39:22.321822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:39:18.886801+0000","last_clean_scrub_stamp":"2023-10-16T13:39:18.886801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:29.357845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T13:39:20.903645+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:39:20.903645+0000","last_peered":"2023-10-16T13:39:20.903645+0000","last_clean":"2023-10-16T13:39:20.903645+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:39:20.903645+0000","last_undegraded":"2023-10-16T13:39:20.903645+0000","last_fullsized":"2023-10-16T13:39:20.903645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.433}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.625}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51300000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.376},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.436},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.375},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.433}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.88800000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":736277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.309},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.37}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.752}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":145979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.436}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.62}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.85099999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.36599999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.309},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.73199999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.65500000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64000000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.66800000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.435},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.496}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47199999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.85099999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:39:30.076 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:39:30.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:39:30.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.239+0000 7f35c757f700 1 Processor -- start 2023-10-16T13:39:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.239+0000 7f35c757f700 1 -- start start 2023-10-16T13:39:30.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c757f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35c015a730 0x7f35c00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c757f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c015e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c757f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35c015e860 0x7f35c00cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c757f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00b1fc0 con 0x7f35c015e860 2023-10-16T13:39:30.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c757f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00b6400 con 0x7f35c015a730 2023-10-16T13:39:30.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c757f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00ce450 con 0x7f35c00cecf0 2023-10-16T13:39:30.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35c015e860 0x7f35c00cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35c015e860 0x7f35c00cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43902/0 (socket says 172.21.15.5:43902) 2023-10-16T13:39:30.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3506715921 learned_addr learned my addr 172.21.15.5:0/3506715921 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c4b1a700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c531b700 1 --2- 172.21.15.5:0/3506715921 >> v2:172.21.15.112:3300/0 conn(0x7f35c015a730 0x7f35c00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3506715921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 msgr2=0x7f35c015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3506715921 >> v2:172.21.15.112:3300/0 conn(0x7f35c015a730 msgr2=0x7f35c00b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 --2- 172.21.15.5:0/3506715921 >> v2:172.21.15.112:3300/0 conn(0x7f35c015a730 0x7f35c00b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3506715921 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00ce730 con 0x7f35c015e860 2023-10-16T13:39:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.240+0000 7f35c4b1a700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c5b1c700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c015e860 0x7f35c00cce90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b2fe0 tx=0x7f35b800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3d64c09e4ea4e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35b7fff700 1 -- 172.21.15.5:0/3506715921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8010070 con 0x7f35c015e860 2023-10-16T13:39:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35b7fff700 1 -- 172.21.15.5:0/3506715921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800dce0 con 0x7f35c015e860 2023-10-16T13:39:30.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35b7fff700 1 -- 172.21.15.5:0/3506715921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800b310 con 0x7f35c015e860 2023-10-16T13:39:30.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 -- 172.21.15.5:0/3506715921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c015e860 msgr2=0x7f35c00cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c015e860 0x7f35c00cce90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b2fe0 tx=0x7f35b800d430 comp rx=0 tx=0).stop 2023-10-16T13:39:30.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 -- 172.21.15.5:0/3506715921 shutdown_connections 2023-10-16T13:39:30.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 --2- 172.21.15.5:0/3506715921 >> v2:172.21.15.112:3300/0 conn(0x7f35c015a730 0x7f35c00b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c015e860 0x7f35c00cce90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 --2- 172.21.15.5:0/3506715921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 -- 172.21.15.5:0/3506715921 >> 172.21.15.5:0/3506715921 conn(0x7f35c006dac0 msgr2=0x7f35c006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:30.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 -- 172.21.15.5:0/3506715921 shutdown_connections 2023-10-16T13:39:30.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.241+0000 7f35c757f700 1 -- 172.21.15.5:0/3506715921 wait complete. 2023-10-16T13:39:30.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 Processor -- start 2023-10-16T13:39:30.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 -- start start 2023-10-16T13:39:30.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c01507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c015a730 0x7f35c00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 0x7f35c01f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c6ea0 con 0x7f35c01f6fd0 2023-10-16T13:39:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c6640 con 0x7f35c015a730 2023-10-16T13:39:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.243+0000 7f35c757f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c68e0 con 0x7f35c00cecf0 2023-10-16T13:39:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 0x7f35c01f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 0x7f35c01f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43908/0 (socket says 172.21.15.5:43908) 2023-10-16T13:39:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3817376531 learned_addr learned my addr 172.21.15.5:0/3817376531 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c531b700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c01507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c4b1a700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c015a730 0x7f35c00c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 msgr2=0x7f35c01507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c01507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c015a730 msgr2=0x7f35c00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c015a730 0x7f35c00c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 -- 172.21.15.5:0/3817376531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b800bd40 con 0x7f35c01f6fd0 2023-10-16T13:39:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c5b1c700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 0x7f35c01f2800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f35b8014000 tx=0x7f35b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009a10 con 0x7f35c01f6fd0 2023-10-16T13:39:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8009b90 con 0x7f35c01f6fd0 2023-10-16T13:39:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c015ac90 con 0x7f35c01f6fd0 2023-10-16T13:39:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.244+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800bbc0 con 0x7f35c01f6fd0 2023-10-16T13:39:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.245+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c01f67d0 con 0x7f35c01f6fd0 2023-10-16T13:39:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.245+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0067d20 con 0x7f35c01f6fd0 2023-10-16T13:39:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.247+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f35b8004040 con 0x7f35c01f6fd0 2023-10-16T13:39:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.247+0000 7f35b5ffb700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f35a406af00 0x7f35a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.247+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35b808b140 con 0x7f35c01f6fd0 2023-10-16T13:39:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.247+0000 7f35c531b700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f35a406af00 0x7f35a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.248+0000 7f35c531b700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f35a406af00 0x7f35a406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009b60 tx=0x7f35bc009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.251+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35b8056360 con 0x7f35c01f6fd0 2023-10-16T13:39:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.534+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f35c00cfa30 con 0x7f35c01f6fd0 2023-10-16T13:39:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.536+0000 7f35b5ffb700 1 -- 172.21.15.5:0/3817376531 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f35b8059980 con 0x7f35c01f6fd0 2023-10-16T13:39:30.539 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:39:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:39:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:39:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:39:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:39:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f35a406af00 msgr2=0x7f35a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f35a406af00 0x7f35a406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009b60 tx=0x7f35bc009210 comp rx=0 tx=0).stop 2023-10-16T13:39:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 msgr2=0x7f35c01f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 0x7f35c01f2800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f35b8014000 tx=0x7f35b8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 shutdown_connections 2023-10-16T13:39:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c01f6fd0 0x7f35c01f2800 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f35a406af00 0x7f35a406d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35c00cecf0 0x7f35c01507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 --2- 172.21.15.5:0/3817376531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c015a730 0x7f35c00c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 >> 172.21.15.5:0/3817376531 conn(0x7f35c006dac0 msgr2=0x7f35c0158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 shutdown_connections 2023-10-16T13:39:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.539+0000 7f35c757f700 1 -- 172.21.15.5:0/3817376531 wait complete. 2023-10-16T13:39:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:39:30.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.676+0000 7fdce8b88700 1 Processor -- start 2023-10-16T13:39:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.676+0000 7fdce8b88700 1 -- start start 2023-10-16T13:39:30.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce8b88700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdce415f130 0x7fdce40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce8b88700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce406af50 0x7fdce40b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce8b88700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40b3530 con 0x7fdce40b28b0 2023-10-16T13:39:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce8b88700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40cde00 con 0x7fdce415f130 2023-10-16T13:39:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce8b88700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40cd180 con 0x7fdce406af50 2023-10-16T13:39:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdce415f130 0x7fdce40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce1d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdce40b28b0 0x7fdce406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53916/0 (socket says 172.21.15.5:53916) 2023-10-16T13:39:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce1d9b700 1 -- 172.21.15.5:0/545813572 learned_addr learned my addr 172.21.15.5:0/545813572 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce2d9d700 1 --2- 172.21.15.5:0/545813572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce406af50 0x7fdce40b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce159a700 1 -- 172.21.15.5:0/545813572 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400417965 0 0) 0x7fdce40b3530 con 0x7fdce40b28b0 2023-10-16T13:39:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce159a700 1 -- 172.21.15.5:0/545813572 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc0035b0 con 0x7fdce40b28b0 2023-10-16T13:39:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce259c700 1 -- 172.21.15.5:0/545813572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce406af50 msgr2=0x7fdce40b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce259c700 1 --2- 172.21.15.5:0/545813572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce406af50 0x7fdce40b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce259c700 1 -- 172.21.15.5:0/545813572 >> v1:172.21.15.5:6789/0 conn(0x7fdce40b28b0 legacy=0x7fdce406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.677+0000 7fdce259c700 1 -- 172.21.15.5:0/545813572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40cd460 con 0x7fdce415f130 2023-10-16T13:39:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce259c700 1 --2- 172.21.15.5:0/545813572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce415f130 0x7fdce40cede0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009840 tx=0x7fdcd8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2aaa407774ebd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce159a700 1 -- 172.21.15.5:0/545813572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011830 con 0x7fdce415f130 2023-10-16T13:39:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce159a700 1 -- 172.21.15.5:0/545813572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8011990 con 0x7fdce415f130 2023-10-16T13:39:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce159a700 1 -- 172.21.15.5:0/545813572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011d20 con 0x7fdce415f130 2023-10-16T13:39:30.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 -- 172.21.15.5:0/545813572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce415f130 msgr2=0x7fdce40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 --2- 172.21.15.5:0/545813572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce415f130 0x7fdce40cede0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009840 tx=0x7fdcd8009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:30.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 -- 172.21.15.5:0/545813572 shutdown_connections 2023-10-16T13:39:30.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 --2- 172.21.15.5:0/545813572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce406af50 0x7fdce40b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 --2- 172.21.15.5:0/545813572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce415f130 0x7fdce40cede0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 -- 172.21.15.5:0/545813572 >> 172.21.15.5:0/545813572 conn(0x7fdce406dae0 msgr2=0x7fdce406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:30.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 -- 172.21.15.5:0/545813572 shutdown_connections 2023-10-16T13:39:30.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.678+0000 7fdce8b88700 1 -- 172.21.15.5:0/545813572 wait complete. 2023-10-16T13:39:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 Processor -- start 2023-10-16T13:39:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 -- start start 2023-10-16T13:39:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 0x7fdce40c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce40b28b0 0x7fdce415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce415f130 0x7fdce40b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce414e1f0 con 0x7fdce406af50 2023-10-16T13:39:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.680+0000 7fdce8b88700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce415d170 con 0x7fdce40b28b0 2023-10-16T13:39:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce8b88700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40c4000 con 0x7fdce415f130 2023-10-16T13:39:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 0x7fdce40c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 0x7fdce40c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43918/0 (socket says 172.21.15.5:43918) 2023-10-16T13:39:30.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 -- 172.21.15.5:0/850081483 learned_addr learned my addr 172.21.15.5:0/850081483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce2d9d700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce415f130 0x7fdce40b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce1d9b700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce40b28b0 0x7fdce415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 -- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce415f130 msgr2=0x7fdce40b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce415f130 0x7fdce40b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 -- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce40b28b0 msgr2=0x7fdce415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce40b28b0 0x7fdce415cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 -- 172.21.15.5:0/850081483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80094a0 con 0x7fdce406af50 2023-10-16T13:39:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce1d9b700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce40b28b0 0x7fdce415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce259c700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 0x7fdce40c6aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80090b0 tx=0x7fdcd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80036a0 con 0x7fdce406af50 2023-10-16T13:39:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd801f070 con 0x7fdce406af50 2023-10-16T13:39:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce414e6e0 con 0x7fdce406af50 2023-10-16T13:39:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8003a60 con 0x7fdce406af50 2023-10-16T13:39:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.681+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce414eca0 con 0x7fdce406af50 2023-10-16T13:39:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.682+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4067d20 con 0x7fdce406af50 2023-10-16T13:39:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.683+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdcd8003bc0 con 0x7fdce406af50 2023-10-16T13:39:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.683+0000 7fdcd2ffd700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc406af00 0x7fdcc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.683+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcd8021070 con 0x7fdce406af50 2023-10-16T13:39:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.683+0000 7fdce1d9b700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc406af00 0x7fdcc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.684+0000 7fdce1d9b700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc406af00 0x7fdcc406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdce40c3a20 tx=0x7fdcd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.688+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcd8055ee0 con 0x7fdce406af50 2023-10-16T13:39:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.934+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdce40d0980 con 0x7fdce406af50 2023-10-16T13:39:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.934+0000 7fdcd2ffd700 1 -- 172.21.15.5:0/850081483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fdcd8015020 con 0x7fdce406af50 2023-10-16T13:39:30.937 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:30.937 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1052521879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1052521879},{"type":"v1","addr":"172.21.15.112:6837","nonce":1052521879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:20.312787+0000","modified":"2023-10-16T13:39:23.333172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6834/3128747669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3128747669},{"type":"v1","addr":"172.21.15.5:6834","nonce":3128747669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:39:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc406af00 msgr2=0x7fdcc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc406af00 0x7fdcc406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdce40c3a20 tx=0x7fdcd4009040 comp rx=0 tx=0).stop 2023-10-16T13:39:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 msgr2=0x7fdce40c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 0x7fdce40c6aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80090b0 tx=0x7fdcd8004750 comp rx=0 tx=0).stop 2023-10-16T13:39:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 shutdown_connections 2023-10-16T13:39:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc406af00 0x7fdcc406d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce415f130 0x7fdce40b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce406af50 0x7fdce40c6aa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 --2- 172.21.15.5:0/850081483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce40b28b0 0x7fdce415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 >> 172.21.15.5:0/850081483 conn(0x7fdce406dae0 msgr2=0x7fdce415e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 shutdown_connections 2023-10-16T13:39:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:30.936+0000 7fdce8b88700 1 -- 172.21.15.5:0/850081483 wait complete. 2023-10-16T13:39:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-10-16T13:39:31.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:39:20.312787+0000', 'modified': '2023-10-16T13:39:23.333172+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5079}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5079': {'gid': 5079, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6834/3128747669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3128747669}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 3128747669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:39:31.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:39:31.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T13:39:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.484+0000 7f9fb3c43700 1 Processor -- start 2023-10-16T13:39:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.484+0000 7f9fb3c43700 1 -- start start 2023-10-16T13:39:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb3c43700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9fac0cc3f0 0x7f9fac0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb3c43700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 0x7f9fac071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb3c43700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac071ab0 con 0x7f9fac161670 2023-10-16T13:39:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb3c43700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac161bc0 con 0x7f9fac0cc3f0 2023-10-16T13:39:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb3c43700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac161ea0 con 0x7f9fac06af50 2023-10-16T13:39:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb11de700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9fac161670 0x7f9fac06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53930/0 (socket says 172.21.15.5:53930) 2023-10-16T13:39:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb11de700 1 -- 172.21.15.5:0/851427631 learned_addr learned my addr 172.21.15.5:0/851427631 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 0x7f9fac071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb19df700 1 --2- 172.21.15.5:0/851427631 >> v2:172.21.15.112:3300/0 conn(0x7f9fac0cc3f0 0x7f9fac0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.485+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226994222 0 0) 0x7f9fac071ab0 con 0x7f9fac161670 2023-10-16T13:39:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f980035b0 con 0x7f9fac161670 2023-10-16T13:39:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57158616 0 0) 0x7f9f980035b0 con 0x7f9fac161670 2023-10-16T13:39:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 msgr2=0x7f9fac071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 0x7f9fac071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 >> v2:172.21.15.112:3300/0 conn(0x7f9fac0cc3f0 msgr2=0x7f9fac0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 --2- 172.21.15.5:0/851427631 >> v2:172.21.15.112:3300/0 conn(0x7f9fac0cc3f0 0x7f9fac0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac162180 con 0x7f9fac161670 2023-10-16T13:39:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f9fa8001670 con 0x7f9fac161670 2023-10-16T13:39:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 >> v1:172.21.15.5:6789/0 conn(0x7f9fac161670 legacy=0x7f9fac06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f98003a00 0x7f9f98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f98004850 0x7f9f98004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 0x7f9f98005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac161bc0 con 0x7f9f98004850 2023-10-16T13:39:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac161ea0 con 0x7f9f98003a00 2023-10-16T13:39:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9800ba10 con 0x7f9fac06af50 2023-10-16T13:39:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f98004850 0x7f9f98004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb19df700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f98003a00 0x7f9f98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 0x7f9f98005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 -- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 msgr2=0x7f9f98005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fac06af50 0x7f9f98005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 -- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f98003a00 msgr2=0x7f9f98003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f98003a00 0x7f9f98003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 -- 172.21.15.5:0/851427631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980035b0 con 0x7f9f98004850 2023-10-16T13:39:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb19df700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f98003a00 0x7f9f98003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb11de700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f98004850 0x7f9f98004cd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800c3a0 tx=0x7f9f98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36de5c54a586eb27 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.486+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8007c60 con 0x7f9f98004850 2023-10-16T13:39:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa8005960 con 0x7f9f98004850 2023-10-16T13:39:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb09dd700 1 -- 172.21.15.5:0/851427631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800cea0 con 0x7f9f98004850 2023-10-16T13:39:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb3c43700 1 -- 172.21.15.5:0/851427631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f98004850 msgr2=0x7f9f98004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/851427631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f98004850 0x7f9f98004cd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800c3a0 tx=0x7f9f98005880 comp rx=0 tx=0).stop 2023-10-16T13:39:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb21e0700 1 -- 172.21.15.5:0/851427631 reap_dead start 2023-10-16T13:39:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb3c43700 1 -- 172.21.15.5:0/851427631 shutdown_connections 2023-10-16T13:39:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb3c43700 1 -- 172.21.15.5:0/851427631 >> 172.21.15.5:0/851427631 conn(0x7f9fac06dac0 msgr2=0x7f9fac06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb3c43700 1 -- 172.21.15.5:0/851427631 shutdown_connections 2023-10-16T13:39:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.487+0000 7f9fb3c43700 1 -- 172.21.15.5:0/851427631 wait complete. 2023-10-16T13:39:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.488+0000 7f9fb3c43700 1 Processor -- start 2023-10-16T13:39:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.488+0000 7f9fb3c43700 1 -- start start 2023-10-16T13:39:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb3c43700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f98004850 0x7f9fac1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb3c43700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 0x7f9fac0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb3c43700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fac0c6590 0x7f9fac0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb3c43700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f3000 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb3c43700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f40d0 con 0x7f9fac0c6590 2023-10-16T13:39:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb3c43700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0b5fe0 con 0x7f9f98004850 2023-10-16T13:39:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb11de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 0x7f9fac0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb11de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 0x7f9fac0c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43938/0 (socket says 172.21.15.5:43938) 2023-10-16T13:39:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb11de700 1 -- 172.21.15.5:0/4013720709 learned_addr learned my addr 172.21.15.5:0/4013720709 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fac0c6590 0x7f9fac0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.489+0000 7f9fb19df700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f98004850 0x7f9fac1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb11de700 1 -- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f98004850 msgr2=0x7f9fac1f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb11de700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f98004850 0x7f9fac1f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb11de700 1 -- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fac0c6590 msgr2=0x7f9fac0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb11de700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fac0c6590 0x7f9fac0ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb11de700 1 -- 172.21.15.5:0/4013720709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0b4f40 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb19df700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f98004850 0x7f9fac1f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fac0c6590 0x7f9fac0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb11de700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 0x7f9fac0c6050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9f980047b0 tx=0x7f9fa8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fa27fc700 1 -- 172.21.15.5:0/4013720709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8004870 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fa27fc700 1 -- 172.21.15.5:0/4013720709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80049f0 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac0b5220 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fa27fc700 1 -- 172.21.15.5:0/4013720709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8004da0 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.490+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac0b57e0 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.492+0000 7f9fa27fc700 1 -- 172.21.15.5:0/4013720709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9fa80070d0 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.492+0000 7f9fa27fc700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f9006af00 0x7f9f9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.492+0000 7f9fa27fc700 1 -- 172.21.15.5:0/4013720709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa808aa30 con 0x7f9fac0b4aa0 2023-10-16T13:39:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.493+0000 7f9fb19df700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f9006af00 0x7f9f9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.493+0000 7f9fb19df700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f9006af00 0x7f9f9006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0aeaa0 tx=0x7f9f9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.494+0000 7f9fbfe2db80 1 Processor -- start 2023-10-16T13:39:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.494+0000 7f9fbfe2db80 1 -- start start 2023-10-16T13:39:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd3aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd3afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd0e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbc84c20 con 0x5557fbd38630 2023-10-16T13:39:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbc69c10 con 0x5557fbd33220 2023-10-16T13:39:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557fbc67530 con 0x5557fbd0e010 2023-10-16T13:39:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd3afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd3afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43946/0 (socket says 172.21.15.5:43946) 2023-10-16T13:39:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 -- 172.21.15.5:0/3215542843 learned_addr learned my addr 172.21.15.5:0/3215542843 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb19df700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd3aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd0e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 -- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 msgr2=0x5557fbd0e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd0e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 -- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 msgr2=0x5557fbd3aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd3aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb11de700 1 -- 172.21.15.5:0/3215542843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557fbc203a0 con 0x5557fbd38630 2023-10-16T13:39:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb19df700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd3aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.495+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd0e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fb11de700 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd3afb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8061600 tx=0x7f9fa8059190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0d98eca531e92d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9f8f7fe700 1 -- 172.21.15.5:0/3215542843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8059830 con 0x5557fbd38630 2023-10-16T13:39:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9f8f7fe700 1 -- 172.21.15.5:0/3215542843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa805d980 con 0x5557fbd38630 2023-10-16T13:39:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9f8f7fe700 1 -- 172.21.15.5:0/3215542843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8061b30 con 0x5557fbd38630 2023-10-16T13:39:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3215542843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 msgr2=0x5557fbd3afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd3afb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8061600 tx=0x7f9fa8059190 comp rx=0 tx=0).stop 2023-10-16T13:39:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3215542843 shutdown_connections 2023-10-16T13:39:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd0e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd3aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3215542843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd3afb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3215542843 >> 172.21.15.5:0/3215542843 conn(0x5557fbc3dd80 msgr2=0x5557fbd58ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3215542843 shutdown_connections 2023-10-16T13:39:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.496+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3215542843 wait complete. 2023-10-16T13:39:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.497+0000 7f9fbfe2db80 1 -- start start 2023-10-16T13:39:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.497+0000 7f9fbfe2db80 1 Processor -- start 2023-10-16T13:39:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 0x5557fbd65c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd38630 0x5557fbd66140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbc62e20 con 0x5557fbd33220 2023-10-16T13:39:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbbff6c0 con 0x5557fbd38630 2023-10-16T13:39:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557fbbff360 con 0x5557fbd0e010 2023-10-16T13:39:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fbfe2db80 10 client.0 _ll_register_callbacks cb 0x5557fba5c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:39:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 0x5557fbd65c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 0x5557fbd65c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43952/0 (socket says 172.21.15.5:43952) 2023-10-16T13:39:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 -- 172.21.15.5:0/3495482526 learned_addr learned my addr 172.21.15.5:0/3495482526 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd38630 0x5557fbd66140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb19df700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 -- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 msgr2=0x5557fbd654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 -- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd38630 msgr2=0x5557fbd66140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd38630 0x5557fbd66140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb11de700 1 -- 172.21.15.5:0/3495482526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac0b57e0 con 0x5557fbd33220 2023-10-16T13:39:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd38630 0x5557fbd66140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.498+0000 7f9fb19df700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fb11de700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 0x5557fbd65c00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800c990 tx=0x7f9fa80018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514ca68939619897 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9f8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:39:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9f8cff9700 1 -- 172.21.15.5:0/3495482526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8061b30 con 0x5557fbd33220 2023-10-16T13:39:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9f8cff9700 1 -- 172.21.15.5:0/3495482526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa8057bd0 con 0x5557fbd33220 2023-10-16T13:39:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557fbd035b0 con 0x5557fbd33220 2023-10-16T13:39:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9f8cff9700 1 -- 172.21.15.5:0/3495482526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fa80781f0 con 0x5557fbd33220 2023-10-16T13:39:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 10 client.5292 fetch_fsmap learned FSMap version 16 2023-10-16T13:39:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5557fba8dd90 con 0x5557fbd33220 2023-10-16T13:39:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9f8cff9700 1 -- 172.21.15.5:0/3495482526 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557fbd035b0 con 0x5557fbd33220 2023-10-16T13:39:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9f8cff9700 1 -- 172.21.15.5:0/3495482526 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9fa8059a90 con 0x5557fbd33220 2023-10-16T13:39:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 10 client.5292 fetch_fsmap finished waiting for FSMap version 16 2023-10-16T13:39:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 10 client.5292 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:39:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 20 client.5292 populate_metadata read hostname 'smithi005' 2023-10-16T13:39:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbd39aa0 0x5557fbd39e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 4 client.5292 mds_command: new command op to 5079 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:39:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 --> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557fbc5be00 con 0x5557fbd39aa0 2023-10-16T13:39:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.499+0000 7f9fb19df700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbd39aa0 0x5557fbd39e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9f8cff9700 10 client.5292 ms_handle_connect on v2:172.21.15.5:6832/3128747669 2023-10-16T13:39:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fb19df700 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbd39aa0 0x5557fbd39e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b700db7858407a server_cookie=bf27dc5f274d6360 in_seq=0 out_seq=0 2023-10-16T13:39:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9f8cff9700 1 -- 172.21.15.5:0/3495482526 <== mds.0 v2:172.21.15.5:6832/3128747669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557fbc5be00 con 0x5557fbd39aa0 2023-10-16T13:39:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9f8cff9700 10 client.5292 handle_command_reply: tid=0 2023-10-16T13:39:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 client.5292 shutdown 2023-10-16T13:39:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 msgr2=0x5557fbd65c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 0x5557fbd65c00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800c990 tx=0x7f9fa80018d0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 shutdown_connections 2023-10-16T13:39:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbd39aa0 0x5557fbd39e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd38630 0x5557fbd66140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd0e010 0x5557fbd654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9f8cff9700 0 client.5292 ms_handle_reset on v2:172.21.15.5:6832/3128747669 2023-10-16T13:39:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/3495482526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd33220 0x5557fbd65c00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 >> 172.21.15.5:0/3495482526 conn(0x5557fbc3dd80 msgr2=0x5557fbd4f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.500+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 shutdown_connections 2023-10-16T13:39:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.501+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/3495482526 wait complete. 2023-10-16T13:39:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.501+0000 7f9fbfe2db80 20 client.5292 trim_cache size 0 max 16384 2023-10-16T13:39:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 Processor -- start 2023-10-16T13:39:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 -- start start 2023-10-16T13:39:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd0e010 0x5557fbd39e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd33220 0x5557fbd3a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd38a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbae38d0 con 0x5557fbd38630 2023-10-16T13:39:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbced4c0 con 0x5557fbd0e010 2023-10-16T13:39:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557fbd07200 con 0x5557fbd33220 2023-10-16T13:39:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fb21e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd38a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fb21e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd38a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43962/0 (socket says 172.21.15.5:43962) 2023-10-16T13:39:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.519+0000 7f9fb21e0700 1 -- 172.21.15.5:0/4238445681 learned_addr learned my addr 172.21.15.5:0/4238445681 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb11de700 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd33220 0x5557fbd3a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb19df700 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd0e010 0x5557fbd39e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb21e0700 1 -- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd33220 msgr2=0x5557fbd3a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd33220 0x5557fbd3a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb21e0700 1 -- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd0e010 msgr2=0x5557fbd39e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd0e010 0x5557fbd39e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb21e0700 1 -- 172.21.15.5:0/4238445681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557fbd0cf20 con 0x5557fbd38630 2023-10-16T13:39:31.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb19df700 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd0e010 0x5557fbd39e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:31.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd38a50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009fd0 tx=0x7f9fa4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e35b4bad725820 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9f8ffff700 1 -- 172.21.15.5:0/4238445681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400e040 con 0x5557fbd38630 2023-10-16T13:39:31.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9f8ffff700 1 -- 172.21.15.5:0/4238445681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa40046c0 con 0x5557fbd38630 2023-10-16T13:39:31.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.520+0000 7f9f8ffff700 1 -- 172.21.15.5:0/4238445681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4017470 con 0x5557fbd38630 2023-10-16T13:39:31.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/4238445681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 msgr2=0x5557fbd38a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd38a50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009fd0 tx=0x7f9fa4009750 comp rx=0 tx=0).stop 2023-10-16T13:39:31.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/4238445681 shutdown_connections 2023-10-16T13:39:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd38630 0x5557fbd38a50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd0e010 0x5557fbd39e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/4238445681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd33220 0x5557fbd3a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/4238445681 >> 172.21.15.5:0/4238445681 conn(0x5557fbc3dd80 msgr2=0x5557fbd773a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/4238445681 shutdown_connections 2023-10-16T13:39:31.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/4238445681 wait complete. 2023-10-16T13:39:31.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.521+0000 7f9fbfe2db80 1 -- start start 2023-10-16T13:39:31.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.522+0000 7f9fbfe2db80 1 Processor -- start 2023-10-16T13:39:31.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 0x5557fbdbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd39e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd38630 0x5557fbd3a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbd67350 con 0x5557fbd0e010 2023-10-16T13:39:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fbdbfff0 con 0x5557fbd33220 2023-10-16T13:39:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557fbd345a0 con 0x5557fbd38630 2023-10-16T13:39:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fbfe2db80 10 client.0 _ll_register_callbacks cb 0x7f9fa80596c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:39:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 0x5557fbdbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 0x5557fbdbc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43964/0 (socket says 172.21.15.5:43964) 2023-10-16T13:39:31.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 -- 172.21.15.5:0/662427562 learned_addr learned my addr 172.21.15.5:0/662427562 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:31.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 -- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd38630 msgr2=0x5557fbd3a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb11de700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd39e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb21e0700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd38630 0x5557fbd3a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd38630 0x5557fbd3a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 -- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 msgr2=0x5557fbd39e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd39e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.523+0000 7f9fb19df700 1 -- 172.21.15.5:0/662427562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa4009db0 con 0x5557fbd0e010 2023-10-16T13:39:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fb19df700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 0x5557fbdbc0d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x5557fbd56020 tx=0x7f9f9c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce20c04458095bd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9f8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:39:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9f8cff9700 1 -- 172.21.15.5:0/662427562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c023d90 con 0x5557fbd0e010 2023-10-16T13:39:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9f8cff9700 1 -- 172.21.15.5:0/662427562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f9c0291b0 con 0x5557fbd0e010 2023-10-16T13:39:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fa805d980 con 0x5557fbd0e010 2023-10-16T13:39:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9f8cff9700 1 -- 172.21.15.5:0/662427562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f9c029370 con 0x5557fbd0e010 2023-10-16T13:39:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 10 client.5298 fetch_fsmap learned FSMap version 16 2023-10-16T13:39:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5557fba76c10 con 0x5557fbd0e010 2023-10-16T13:39:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9f8cff9700 1 -- 172.21.15.5:0/662427562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa805d980 con 0x5557fbd0e010 2023-10-16T13:39:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9f8cff9700 1 -- 172.21.15.5:0/662427562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9f9c004030 con 0x5557fbd0e010 2023-10-16T13:39:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 10 client.5298 fetch_fsmap finished waiting for FSMap version 16 2023-10-16T13:39:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 10 client.5298 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:39:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 20 client.5298 populate_metadata read hostname 'smithi005' 2023-10-16T13:39:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbdbcc90 0x5557fbdbd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 4 client.5298 mds_command: new command op to 5079 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:39:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 --> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557fbc5bb20 con 0x5557fbdbcc90 2023-10-16T13:39:31.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.524+0000 7f9fb11de700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbdbcc90 0x5557fbdbd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fb11de700 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbdbcc90 0x5557fbdbd070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a9b615d13e4865 server_cookie=3c6d5cc06e14126d in_seq=0 out_seq=0 2023-10-16T13:39:31.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9f8cff9700 10 client.5298 ms_handle_connect on v2:172.21.15.5:6832/3128747669 2023-10-16T13:39:31.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9f8cff9700 1 -- 172.21.15.5:0/662427562 <== mds.0 v2:172.21.15.5:6832/3128747669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5557fbc5bb20 con 0x5557fbdbcc90 2023-10-16T13:39:31.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9f8cff9700 10 client.5298 handle_command_reply: tid=0 2023-10-16T13:39:31.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 client.5298 shutdown 2023-10-16T13:39:31.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 msgr2=0x5557fbdbc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 0x5557fbdbc0d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x5557fbd56020 tx=0x7f9f9c0047c0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 shutdown_connections 2023-10-16T13:39:31.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:6832/3128747669,v1:172.21.15.5:6834/3128747669] conn(0x5557fbdbcc90 0x5557fbdbd070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5557fbd38630 0x5557fbd3a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557fbd0e010 0x5557fbdbc0d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9f8cff9700 0 client.5298 ms_handle_reset on v2:172.21.15.5:6832/3128747669 2023-10-16T13:39:31.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 --2- 172.21.15.5:0/662427562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557fbd33220 0x5557fbd39e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 >> 172.21.15.5:0/662427562 conn(0x5557fbc3dd80 msgr2=0x5557fbd11b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 shutdown_connections 2023-10-16T13:39:31.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 1 -- 172.21.15.5:0/662427562 wait complete. 2023-10-16T13:39:31.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.525+0000 7f9fbfe2db80 20 client.5298 trim_cache size 0 max 16384 2023-10-16T13:39:31.559 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:39:31.559 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:39:31.559 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:39:31.559 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5079, 2023-10-16T13:39:31.559 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:39:31.560 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:39:31.560 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:39:31.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.607833008, 2023-10-16T13:39:31.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 16, 2023-10-16T13:39:31.560 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 33, 2023-10-16T13:39:31.561 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 33, 2023-10-16T13:39:31.561 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 18.601800556000001 2023-10-16T13:39:31.561 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:39:31.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f9006af00 msgr2=0x7f9f9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f9006af00 0x7f9f9006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0aeaa0 tx=0x7f9f9c008040 comp rx=0 tx=0).stop 2023-10-16T13:39:31.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 msgr2=0x7f9fac0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 0x7f9fac0c6050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9f980047b0 tx=0x7f9fa8000fe0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 shutdown_connections 2023-10-16T13:39:31.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fac0c6590 0x7f9fac0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f9006af00 0x7f9f9006d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f98004850 0x7f9fac1f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 --2- 172.21.15.5:0/4013720709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac0b4aa0 0x7f9fac0c6050 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 >> 172.21.15.5:0/4013720709 conn(0x7f9fac06dac0 msgr2=0x7f9fac06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 shutdown_connections 2023-10-16T13:39:31.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.526+0000 7f9fb3c43700 1 -- 172.21.15.5:0/4013720709 wait complete. 2023-10-16T13:39:31.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:39:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.689+0000 7fb7823ac700 1 Processor -- start 2023-10-16T13:39:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.689+0000 7fb7823ac700 1 -- start start 2023-10-16T13:39:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.690+0000 7fb7823ac700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb77c15ab10 0x7fb77c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.690+0000 7fb7823ac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.690+0000 7fb7823ac700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c15e7a0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.690+0000 7fb7823ac700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c15f730 con 0x7fb77c15ab10 2023-10-16T13:39:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.690+0000 7fb7823ac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b29a0 con 0x7fb77c0cfe30 2023-10-16T13:39:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb780949700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb77c15ab10 0x7fb77c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb77c0b1f50 0x7fb77c0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:44952/0 (socket says 172.21.15.5:44952) 2023-10-16T13:39:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77b7fe700 1 -- 172.21.15.5:0/2759787575 learned_addr learned my addr 172.21.15.5:0/2759787575 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77affd700 1 -- 172.21.15.5:0/2759787575 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581248168 0 0) 0x7fb77c15e7a0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77affd700 1 -- 172.21.15.5:0/2759787575 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7640057c0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb780949700 1 -- 172.21.15.5:0/2759787575 >> v2:172.21.15.112:3300/0 conn(0x7fb77c15ab10 msgr2=0x7fb77c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb780949700 1 --2- 172.21.15.5:0/2759787575 >> v2:172.21.15.112:3300/0 conn(0x7fb77c15ab10 0x7fb77c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb780949700 1 -- 172.21.15.5:0/2759787575 >> v1:172.21.15.112:6789/0 conn(0x7fb77c0b1f50 legacy=0x7fb77c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb780949700 1 -- 172.21.15.5:0/2759787575 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0b2c80 con 0x7fb77c0cfe30 2023-10-16T13:39:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77bfff700 1 --2- 172.21.15.5:0/2759787575 >> v2:172.21.15.112:3300/0 conn(0x7fb77c15ab10 0x7fb77c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb780949700 1 --2- 172.21.15.5:0/2759787575 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0cbf40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94159973dbc71af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77affd700 1 -- 172.21.15.5:0/2759787575 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400e070 con 0x7fb77c0cfe30 2023-10-16T13:39:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77affd700 1 -- 172.21.15.5:0/2759787575 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400bb20 con 0x7fb77c0cfe30 2023-10-16T13:39:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.691+0000 7fb77affd700 1 -- 172.21.15.5:0/2759787575 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400be90 con 0x7fb77c0cfe30 2023-10-16T13:39:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 -- 172.21.15.5:0/2759787575 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 msgr2=0x7fb77c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 --2- 172.21.15.5:0/2759787575 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0cbf40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77400b330 comp rx=0 tx=0).stop 2023-10-16T13:39:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 -- 172.21.15.5:0/2759787575 shutdown_connections 2023-10-16T13:39:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 --2- 172.21.15.5:0/2759787575 >> v2:172.21.15.112:3300/0 conn(0x7fb77c15ab10 0x7fb77c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 --2- 172.21.15.5:0/2759787575 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0cbf40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 -- 172.21.15.5:0/2759787575 >> 172.21.15.5:0/2759787575 conn(0x7fb77c06dae0 msgr2=0x7fb77c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 -- 172.21.15.5:0/2759787575 shutdown_connections 2023-10-16T13:39:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.692+0000 7fb7823ac700 1 -- 172.21.15.5:0/2759787575 wait complete. 2023-10-16T13:39:31.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.693+0000 7fb7823ac700 1 Processor -- start 2023-10-16T13:39:31.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.693+0000 7fb7823ac700 1 -- start start 2023-10-16T13:39:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb7823ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 0x7fb77c1f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb7823ac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb7823ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15ab10 0x7fb77c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb7823ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1f7840 con 0x7fb77c0b1f50 2023-10-16T13:39:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb7823ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0c7740 con 0x7fb77c15ab10 2023-10-16T13:39:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb7823ac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0c7a20 con 0x7fb77c0cfe30 2023-10-16T13:39:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 0x7fb77c1f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 0x7fb77c1f7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43978/0 (socket says 172.21.15.5:43978) 2023-10-16T13:39:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb77bfff700 1 -- 172.21.15.5:0/3971786892 learned_addr learned my addr 172.21.15.5:0/3971786892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb77b7fe700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.694+0000 7fb780949700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15ab10 0x7fb77c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77bfff700 1 -- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 msgr2=0x7fb77c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77bfff700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77bfff700 1 -- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15ab10 msgr2=0x7fb77c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77bfff700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15ab10 0x7fb77c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77bfff700 1 -- 172.21.15.5:0/3971786892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0094a0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77b7fe700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb780949700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15ab10 0x7fb77c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb77bfff700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 0x7fb77c1f7300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00ebe0 tx=0x7fb76c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00c910 con 0x7fb77c0b1f50 2023-10-16T13:39:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00ca70 con 0x7fb77c0b1f50 2023-10-16T13:39:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774009a70 con 0x7fb77c0b1f50 2023-10-16T13:39:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00cde0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.695+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c0c7fe0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.696+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c067d20 con 0x7fb77c0b1f50 2023-10-16T13:39:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.696+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb76c013470 con 0x7fb77c0b1f50 2023-10-16T13:39:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.697+0000 7fb778ff9700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb76806af00 0x7fb76806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.697+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb76c0896f0 con 0x7fb77c0b1f50 2023-10-16T13:39:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.697+0000 7fb77b7fe700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb76806af00 0x7fb76806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.698+0000 7fb77b7fe700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb76806af00 0x7fb76806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb770007fd0 tx=0x7fb770009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.702+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb76c054830 con 0x7fb77c0b1f50 2023-10-16T13:39:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.946+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb77c0afc10 con 0x7fb77c0b1f50 2023-10-16T13:39:31.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.946+0000 7fb778ff9700 1 -- 172.21.15.5:0/3971786892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb76c057e50 con 0x7fb77c0b1f50 2023-10-16T13:39:31.949 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:39:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb76806af00 msgr2=0x7fb76806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb76806af00 0x7fb76806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb770007fd0 tx=0x7fb770009040 comp rx=0 tx=0).stop 2023-10-16T13:39:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 msgr2=0x7fb77c1f7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 0x7fb77c1f7300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00ebe0 tx=0x7fb76c009ec0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 shutdown_connections 2023-10-16T13:39:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15ab10 0x7fb77c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77c0b1f50 0x7fb77c1f7300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb76806af00 0x7fb76806d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 --2- 172.21.15.5:0/3971786892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb77c0cfe30 0x7fb77c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 >> 172.21.15.5:0/3971786892 conn(0x7fb77c06dae0 msgr2=0x7fb77c159910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 shutdown_connections 2023-10-16T13:39:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:31.948+0000 7fb7823ac700 1 -- 172.21.15.5:0/3971786892 wait complete. 2023-10-16T13:39:31.963 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:39:31.963 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:39:31.963 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:39:31.964 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:39:31.964 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:39:31.964 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:39:31.965 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:39:31.965 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:39:31.965 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:39:31.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:31.966 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:39:31.984 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:39:31.984 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:39:31.984 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:39:31.984 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.985 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:39:31.985 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.985 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:39:31.985 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:31.985 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:39:31.986 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:31.986 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:39:31.986 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:31.986 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:39:31.987 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42330sec preferred_lft 42330sec 2023-10-16T13:39:31.987 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:39:31.987 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.987 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:39:31.987 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:31.987 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:39:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:39:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:39:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.989 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:39:31.989 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:39:31.989 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:39:31.989 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.989 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:39:31.989 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:39:31.990 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:39:31.990 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:31.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:31.991 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:39:32.050 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:39:32.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.052 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:39:32.110 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:39:32.111 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:39:32.111 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:39:32.111 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:39:32.112 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:39:32.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.112 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:39:32.113 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:39:32.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:39:32.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:39:32.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:39:32.115 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:39:32.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.219 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:39:32.236 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:39:32.236 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:39:32.237 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:39:32.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:39:32.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:39:32.305 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:39:32.361 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:39:32.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:39:32.362 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:39:32.418 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:39:32.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:32.505 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:32.505 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:39:32.534 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:32.535 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:39:32.535 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:39:32.535 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:39:32.535 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:39:32.536 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:39:32.536 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:39:32.536 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:39:32.608 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:32.609 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:39:32.609 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:39:32.609 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:39:32.609 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:39:32.609 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:39:32.610 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:39:32.610 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:39:32.610 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:39:32.610 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:39:32.610 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:39:32.612 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:39:32.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:39:32.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:32.641 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:39:32.723 INFO:teuthology.orchestra.run.smithi005.stdout:client5173 2023-10-16T13:39:32.723 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:32.724 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:32.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:39:32.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 Processor -- start 2023-10-16T13:39:32.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 -- start start 2023-10-16T13:39:32.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d8415dbc0 0x7f3d8415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:32.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d840b7050 0x7f3d840d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:32.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8415e4e0 con 0x7f3d840d3fc0 2023-10-16T13:39:32.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840b7560 con 0x7f3d8415dbc0 2023-10-16T13:39:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.945+0000 7f3d8929b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840b7840 con 0x7f3d840b7050 2023-10-16T13:39:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d82ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d8415dbc0 0x7f3d8415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d827fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3d840d3fc0 0x7f3d840d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53994/0 (socket says 172.21.15.5:53994) 2023-10-16T13:39:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d827fc700 1 -- 172.21.15.5:0/3196664181 learned_addr learned my addr 172.21.15.5:0/3196664181 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:32.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d837fe700 1 --2- 172.21.15.5:0/3196664181 >> v2:172.21.15.112:3300/0 conn(0x7f3d840b7050 0x7f3d840d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:32.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d82ffd700 1 -- 172.21.15.5:0/3196664181 >> v2:172.21.15.112:3300/0 conn(0x7f3d840b7050 msgr2=0x7f3d840d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:32.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d82ffd700 1 --2- 172.21.15.5:0/3196664181 >> v2:172.21.15.112:3300/0 conn(0x7f3d840b7050 0x7f3d840d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:32.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d82ffd700 1 -- 172.21.15.5:0/3196664181 >> v1:172.21.15.5:6789/0 conn(0x7f3d840d3fc0 legacy=0x7f3d840d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d82ffd700 1 -- 172.21.15.5:0/3196664181 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840b7b20 con 0x7f3d8415dbc0 2023-10-16T13:39:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d81ffb700 1 -- 172.21.15.5:0/3196664181 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041623331 0 0) 0x7f3d8415e4e0 con 0x7f3d840d3fc0 2023-10-16T13:39:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d82ffd700 1 --2- 172.21.15.5:0/3196664181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8415dbc0 0x7f3d8415dfa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3d840cdea0 tx=0x7f3d6c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70094410208397ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d81ffb700 1 -- 172.21.15.5:0/3196664181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c005e30 con 0x7f3d8415dbc0 2023-10-16T13:39:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d81ffb700 1 -- 172.21.15.5:0/3196664181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c006030 con 0x7f3d8415dbc0 2023-10-16T13:39:32.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.946+0000 7f3d81ffb700 1 -- 172.21.15.5:0/3196664181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0063c0 con 0x7f3d8415dbc0 2023-10-16T13:39:32.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 -- 172.21.15.5:0/3196664181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8415dbc0 msgr2=0x7f3d8415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:32.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 --2- 172.21.15.5:0/3196664181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8415dbc0 0x7f3d8415dfa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3d840cdea0 tx=0x7f3d6c009b00 comp rx=0 tx=0).stop 2023-10-16T13:39:32.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 -- 172.21.15.5:0/3196664181 shutdown_connections 2023-10-16T13:39:32.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 --2- 172.21.15.5:0/3196664181 >> v2:172.21.15.112:3300/0 conn(0x7f3d840b7050 0x7f3d840d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:32.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 --2- 172.21.15.5:0/3196664181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8415dbc0 0x7f3d8415dfa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:32.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 -- 172.21.15.5:0/3196664181 >> 172.21.15.5:0/3196664181 conn(0x7f3d8409cb40 msgr2=0x7f3d840d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:32.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 -- 172.21.15.5:0/3196664181 shutdown_connections 2023-10-16T13:39:32.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.947+0000 7f3d8929b700 1 -- 172.21.15.5:0/3196664181 wait complete. 2023-10-16T13:39:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.948+0000 7f3d8929b700 1 Processor -- start 2023-10-16T13:39:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.948+0000 7f3d8929b700 1 -- start start 2023-10-16T13:39:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d8929b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d840b7050 0x7f3d840cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d8929b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 0x7f3d841e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d8929b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8415dbc0 0x7f3d8409d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d8929b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d841e3ac0 con 0x7f3d840d3fc0 2023-10-16T13:39:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d8929b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8409f980 con 0x7f3d8415dbc0 2023-10-16T13:39:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d8929b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8409fc60 con 0x7f3d840b7050 2023-10-16T13:39:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 0x7f3d841e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 0x7f3d841e30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43998/0 (socket says 172.21.15.5:43998) 2023-10-16T13:39:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 -- 172.21.15.5:0/1885004866 learned_addr learned my addr 172.21.15.5:0/1885004866 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d837fe700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8415dbc0 0x7f3d8409d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d82ffd700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d840b7050 0x7f3d840cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 -- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d840b7050 msgr2=0x7f3d840cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d840b7050 0x7f3d840cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 -- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8415dbc0 msgr2=0x7f3d8409d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8415dbc0 0x7f3d8409d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 -- 172.21.15.5:0/1885004866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c009430 con 0x7f3d840d3fc0 2023-10-16T13:39:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d837fe700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8415dbc0 0x7f3d8409d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d827fc700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 0x7f3d841e30e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3d740011e0 tx=0x7f3d7400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74004c80 con 0x7f3d840d3fc0 2023-10-16T13:39:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.949+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74004e00 con 0x7f3d840d3fc0 2023-10-16T13:39:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.950+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8409ff40 con 0x7f3d840d3fc0 2023-10-16T13:39:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.950+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74007310 con 0x7f3d840d3fc0 2023-10-16T13:39:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.950+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d841e3620 con 0x7f3d840d3fc0 2023-10-16T13:39:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.951+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8404ebb0 con 0x7f3d840d3fc0 2023-10-16T13:39:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.951+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d74007470 con 0x7f3d840d3fc0 2023-10-16T13:39:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.951+0000 7f3d7b7fe700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3d6406af00 0x7f3d6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.952+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d740893f0 con 0x7f3d840d3fc0 2023-10-16T13:39:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.952+0000 7f3d82ffd700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3d6406af00 0x7f3d6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.952+0000 7f3d82ffd700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3d6406af00 0x7f3d6406d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000c00 tx=0x7f3d6c008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:32.956+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d740544a0 con 0x7f3d840d3fc0 2023-10-16T13:39:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.205+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d840d1040 con 0x7f3d840d3fc0 2023-10-16T13:39:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.206+0000 7f3d7b7fe700 1 -- 172.21.15.5:0/1885004866 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d74057ac0 con 0x7f3d840d3fc0 2023-10-16T13:39:33.209 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:39:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3d6406af00 msgr2=0x7f3d6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3d6406af00 0x7f3d6406d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000c00 tx=0x7f3d6c008070 comp rx=0 tx=0).stop 2023-10-16T13:39:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 msgr2=0x7f3d841e30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 0x7f3d841e30e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3d740011e0 tx=0x7f3d7400cae0 comp rx=0 tx=0).stop 2023-10-16T13:39:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 shutdown_connections 2023-10-16T13:39:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8415dbc0 0x7f3d8409d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3d6406af00 0x7f3d6406d3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3d840b7050 0x7f3d840cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 --2- 172.21.15.5:0/1885004866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d840d3fc0 0x7f3d841e30e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 >> 172.21.15.5:0/1885004866 conn(0x7f3d8409cb40 msgr2=0x7f3d840d1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 shutdown_connections 2023-10-16T13:39:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:33.208+0000 7f3d8929b700 1 -- 172.21.15.5:0/1885004866 wait complete. 2023-10-16T13:39:33.222 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:39:33.223 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:39:33.223 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:39:33.223 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:39:33.224 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:39:33.224 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:39:33.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:39:33.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:39:33.225 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:39:33.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.226 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:39:33.248 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:39:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:39:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:39:33.248 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:39:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.249 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:39:33.249 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:33.249 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:39:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:33.250 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:39:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:33.250 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:39:33.250 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:39:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42345sec preferred_lft 42345sec 2023-10-16T13:39:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:39:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.251 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:39:33.251 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:39:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:39:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:39:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.252 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:39:33.252 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:39:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:39:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.253 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:39:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:39:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:39:33.253 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:39:33.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.254 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:39:33.318 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:39:33.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.320 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:39:33.381 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:39:33.381 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:39:33.381 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:39:33.382 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:39:33.382 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:39:33.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.383 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:39:33.384 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:39:33.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:39:33.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:39:33.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:39:33.385 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:39:33.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.497 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:39:33.514 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:39:33.515 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:39:33.515 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:39:33.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:39:33.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:39:33.583 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:39:33.639 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:39:33.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:39:33.640 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:39:33.695 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:39:33.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.696 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:33.781 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:33.781 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:39:33.808 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:39:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:39:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:39:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:39:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:39:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:39:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:39:33.836 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:39:33.836 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:39:33.836 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:39:33.836 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:39:33.837 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:39:33.837 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:39:33.837 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:39:33.837 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:39:33.838 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:39:33.838 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:39:33.838 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:39:33.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:39:33.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.840 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:39:33.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:33.875 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:39:33.946 INFO:teuthology.orchestra.run.smithi112.stdout:client4877 2023-10-16T13:39:33.946 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:33.947 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:34.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:39:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.144+0000 7f0738081700 1 Processor -- start 2023-10-16T13:39:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.144+0000 7f0738081700 1 -- start start 2023-10-16T13:39:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.145+0000 7f0738081700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f073015d840 0x7f0730162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.145+0000 7f0738081700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300cee20 con 0x7f07300cdfd0 2023-10-16T13:39:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.145+0000 7f0738081700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300b2ce0 con 0x7f07300cda40 2023-10-16T13:39:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.145+0000 7f0738081700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300ceb40 con 0x7f073015d840 2023-10-16T13:39:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.145+0000 7f073561c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f07300cdfd0 0x7f07300cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2023-10-16T13:39:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.145+0000 7f073561c700 1 -- 172.21.15.5:0/2709643341 learned_addr learned my addr 172.21.15.5:0/2709643341 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0735e1d700 1 --2- 172.21.15.5:0/2709643341 >> v2:172.21.15.112:3300/0 conn(0x7f073015d840 0x7f0730162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691015882 0 0) 0x7f07300cee20 con 0x7f07300cdfd0 2023-10-16T13:39:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c0035b0 con 0x7f07300cdfd0 2023-10-16T13:39:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980019091 0 0) 0x7f07300b2ce0 con 0x7f07300cda40 2023-10-16T13:39:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07300cee20 con 0x7f07300cda40 2023-10-16T13:39:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220189807 0 0) 0x7f071c0035b0 con 0x7f07300cdfd0 2023-10-16T13:39:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0735e1d700 1 -- 172.21.15.5:0/2709643341 >> v1:172.21.15.112:6789/0 conn(0x7f07300cda40 legacy=0x7f07300caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0735e1d700 1 -- 172.21.15.5:0/2709643341 >> v1:172.21.15.5:6789/0 conn(0x7f07300cdfd0 legacy=0x7f07300cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0735e1d700 1 -- 172.21.15.5:0/2709643341 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0730161590 con 0x7f073015d840 2023-10-16T13:39:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0735e1d700 1 --2- 172.21.15.5:0/2709643341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073015d840 0x7f0730162070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0720009840 tx=0x7f0720009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92fcac824953078a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c001670 con 0x7f073015d840 2023-10-16T13:39:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720004030 con 0x7f073015d840 2023-10-16T13:39:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.146+0000 7f0734e1b700 1 -- 172.21.15.5:0/2709643341 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200043c0 con 0x7f073015d840 2023-10-16T13:39:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 -- 172.21.15.5:0/2709643341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073015d840 msgr2=0x7f0730162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 --2- 172.21.15.5:0/2709643341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073015d840 0x7f0730162070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0720009840 tx=0x7f0720009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 -- 172.21.15.5:0/2709643341 shutdown_connections 2023-10-16T13:39:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 --2- 172.21.15.5:0/2709643341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073015d840 0x7f0730162070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 -- 172.21.15.5:0/2709643341 >> 172.21.15.5:0/2709643341 conn(0x7f073006bd70 msgr2=0x7f073006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 -- 172.21.15.5:0/2709643341 shutdown_connections 2023-10-16T13:39:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.147+0000 7f0738081700 1 -- 172.21.15.5:0/2709643341 wait complete. 2023-10-16T13:39:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.149+0000 7f0738081700 1 Processor -- start 2023-10-16T13:39:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.149+0000 7f0738081700 1 -- start start 2023-10-16T13:39:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0738081700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 0x7f073015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0738081700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07300cdfd0 0x7f07301f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0738081700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 0x7f07300aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0738081700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073015bd10 con 0x7f073015d840 2023-10-16T13:39:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0738081700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073015dff0 con 0x7f07300cda40 2023-10-16T13:39:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0738081700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07301f3680 con 0x7f07300cdfd0 2023-10-16T13:39:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f073661e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 0x7f07300aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 0x7f073015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 0x7f073015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:39906/0 (socket says 172.21.15.5:39906) 2023-10-16T13:39:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f073661e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 0x7f07300aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44014/0 (socket says 172.21.15.5:44014) 2023-10-16T13:39:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 -- 172.21.15.5:0/1358443629 learned_addr learned my addr 172.21.15.5:0/1358443629 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f073561c700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07300cdfd0 0x7f07301f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 -- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07300cdfd0 msgr2=0x7f07301f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07300cdfd0 0x7f07301f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 -- 172.21.15.5:0/1358443629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 msgr2=0x7f07300aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 0x7f07300aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 -- 172.21.15.5:0/1358443629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200094a0 con 0x7f07300cda40 2023-10-16T13:39:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f073661e700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 0x7f07300aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.150+0000 7f0735e1d700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 0x7f073015b7d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07200090b0 tx=0x7f0720004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.151+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720003c10 con 0x7f07300cda40 2023-10-16T13:39:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.151+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072001f070 con 0x7f07300cda40 2023-10-16T13:39:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.151+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07300c4260 con 0x7f07300cda40 2023-10-16T13:39:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.151+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720011630 con 0x7f07300cda40 2023-10-16T13:39:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.151+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07300c4820 con 0x7f07300cda40 2023-10-16T13:39:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.152+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0730067d20 con 0x7f07300cda40 2023-10-16T13:39:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.152+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0720021030 con 0x7f07300cda40 2023-10-16T13:39:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.152+0000 7f07267fc700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f071406af00 0x7f071406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.153+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f072008a7c0 con 0x7f07300cda40 2023-10-16T13:39:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.153+0000 7f073561c700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f071406af00 0x7f071406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.153+0000 7f073561c700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f071406af00 0x7f071406d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07300b64f0 tx=0x7f072c000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.158+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0720055a20 con 0x7f07300cda40 2023-10-16T13:39:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.405+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07300b20c0 con 0x7f07300cda40 2023-10-16T13:39:34.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.623+0000 7f07267fc700 1 -- 172.21.15.5:0/1358443629 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0720059040 con 0x7f07300cda40 2023-10-16T13:39:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f071406af00 msgr2=0x7f071406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f071406af00 0x7f071406d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07300b64f0 tx=0x7f072c000ed0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 msgr2=0x7f073015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 0x7f073015b7d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07200090b0 tx=0x7f0720004750 comp rx=0 tx=0).stop 2023-10-16T13:39:34.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 shutdown_connections 2023-10-16T13:39:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073015d840 0x7f07300aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07300cda40 0x7f073015b7d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f071406af00 0x7f071406d3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 --2- 172.21.15.5:0/1358443629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07300cdfd0 0x7f07301f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 >> 172.21.15.5:0/1358443629 conn(0x7f073006bd70 msgr2=0x7f07300b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 shutdown_connections 2023-10-16T13:39:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.625+0000 7f0738081700 1 -- 172.21.15.5:0/1358443629 wait complete. 2023-10-16T13:39:34.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:39:34.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.765+0000 7f892e2f6700 1 Processor -- start 2023-10-16T13:39:34.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.765+0000 7f892e2f6700 1 -- start start 2023-10-16T13:39:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.765+0000 7f892e2f6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f892815a850 0x7f89280cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f892e2f6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280ce3b0 con 0x7f89280b2940 2023-10-16T13:39:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f892e2f6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280b2df0 con 0x7f89280cd4b0 2023-10-16T13:39:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f892e2f6700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280b6290 con 0x7f892815a850 2023-10-16T13:39:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f89277fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89280b2940 0x7f89280ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54024/0 (socket says 172.21.15.5:54024) 2023-10-16T13:39:34.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f89277fe700 1 -- 172.21.15.5:0/2550881712 learned_addr learned my addr 172.21.15.5:0/2550881712 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:34.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8927fff700 1 --2- 172.21.15.5:0/2550881712 >> v2:172.21.15.112:3300/0 conn(0x7f892815a850 0x7f89280cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77487248 0 0) 0x7f89280ce3b0 con 0x7f89280b2940 2023-10-16T13:39:34.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89100035b0 con 0x7f89280b2940 2023-10-16T13:39:34.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805564445 0 0) 0x7f89280b2df0 con 0x7f89280cd4b0 2023-10-16T13:39:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89280ce3b0 con 0x7f89280cd4b0 2023-10-16T13:39:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1080945109 0 0) 0x7f89100035b0 con 0x7f89280b2940 2023-10-16T13:39:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 >> v2:172.21.15.112:3300/0 conn(0x7f892815a850 msgr2=0x7f89280cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 --2- 172.21.15.5:0/2550881712 >> v2:172.21.15.112:3300/0 conn(0x7f892815a850 0x7f89280cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 >> v1:172.21.15.112:6789/0 conn(0x7f89280cd4b0 legacy=0x7f89280ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280cc220 con 0x7f89280b2940 2023-10-16T13:39:34.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f891c001670 con 0x7f89280b2940 2023-10-16T13:39:34.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 >> v1:172.21.15.5:6789/0 conn(0x7f89280b2940 legacy=0x7f89280ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8910003b90 0x7f8910003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910004850 0x7f8910004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8910005210 0x7f891000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280b6290 con 0x7f8910003b90 2023-10-16T13:39:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891000c090 con 0x7f8910004850 2023-10-16T13:39:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891000c250 con 0x7f8910005210 2023-10-16T13:39:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.766+0000 7f8927fff700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8910003b90 0x7f8910003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f89277fe700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910004850 0x7f8910004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f892c893700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8910005210 0x7f891000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8927fff700 1 -- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8910005210 msgr2=0x7f891000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8927fff700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8910005210 0x7f891000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8927fff700 1 -- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910004850 msgr2=0x7f8910004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8927fff700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910004850 0x7f8910004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f892c893700 1 -- 172.21.15.5:0/2550881712 reap_dead start 2023-10-16T13:39:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8927fff700 1 -- 172.21.15.5:0/2550881712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89100035b0 con 0x7f8910003b90 2023-10-16T13:39:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8927fff700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8910003b90 0x7f8910003f90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8918009b60 tx=0x7f8910005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bbe6cbef6c7982 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891800e6c0 con 0x7f8910003b90 2023-10-16T13:39:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891800e820 con 0x7f8910003b90 2023-10-16T13:39:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f8926ffd700 1 -- 172.21.15.5:0/2550881712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891800ebb0 con 0x7f8910003b90 2023-10-16T13:39:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f892e2f6700 1 -- 172.21.15.5:0/2550881712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8910003b90 msgr2=0x7f8910003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.767+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8910003b90 0x7f8910003f90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8918009b60 tx=0x7f8910005880 comp rx=0 tx=0).stop 2023-10-16T13:39:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.768+0000 7f892e2f6700 1 -- 172.21.15.5:0/2550881712 shutdown_connections 2023-10-16T13:39:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.768+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2550881712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8910003b90 0x7f8910003f90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.768+0000 7f892e2f6700 1 -- 172.21.15.5:0/2550881712 >> 172.21.15.5:0/2550881712 conn(0x7f892806dac0 msgr2=0x7f892806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.768+0000 7f892e2f6700 1 -- 172.21.15.5:0/2550881712 shutdown_connections 2023-10-16T13:39:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.768+0000 7f892e2f6700 1 -- 172.21.15.5:0/2550881712 wait complete. 2023-10-16T13:39:34.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.769+0000 7f892e2f6700 1 Processor -- start 2023-10-16T13:39:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.769+0000 7f892e2f6700 1 -- start start 2023-10-16T13:39:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892e2f6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910003b90 0x7f89280c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892e2f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 0x7f89281e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892e2f6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89280c5e30 0x7f89280c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892e2f6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89281f4160 con 0x7f89281e4690 2023-10-16T13:39:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892e2f6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892815ba00 con 0x7f8910003b90 2023-10-16T13:39:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892e2f6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89281e5050 con 0x7f89280c5e30 2023-10-16T13:39:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 0x7f89281e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 0x7f89281e4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44032/0 (socket says 172.21.15.5:44032) 2023-10-16T13:39:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 -- 172.21.15.5:0/2837093777 learned_addr learned my addr 172.21.15.5:0/2837093777 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f8927fff700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910003b90 0x7f89280c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f892c893700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89280c5e30 0x7f89280c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 -- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89280c5e30 msgr2=0x7f89280c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89280c5e30 0x7f89280c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 -- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910003b90 msgr2=0x7f89280c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910003b90 0x7f89280c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 -- 172.21.15.5:0/2837093777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280b53a0 con 0x7f89281e4690 2023-10-16T13:39:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f8927fff700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910003b90 0x7f89280c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f89277fe700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 0x7f89281e4b10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f891c00e780 tx=0x7f891c00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c012590 con 0x7f89281e4690 2023-10-16T13:39:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.770+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c0126f0 con 0x7f89281e4690 2023-10-16T13:39:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.771+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89281f34e0 con 0x7f89281e4690 2023-10-16T13:39:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.771+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c012aa0 con 0x7f89281e4690 2023-10-16T13:39:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.771+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89281f3aa0 con 0x7f89281e4690 2023-10-16T13:39:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.771+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8928067d20 con 0x7f89281e4690 2023-10-16T13:39:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.772+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f891c012c00 con 0x7f89281e4690 2023-10-16T13:39:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.772+0000 7f8924ff9700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f891406af00 0x7f891406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.772+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f891c0893e0 con 0x7f89281e4690 2023-10-16T13:39:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.773+0000 7f8927fff700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f891406af00 0x7f891406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.773+0000 7f8927fff700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f891406af00 0x7f891406d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89180090b0 tx=0x7f8918008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:34.777+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f891c0544a0 con 0x7f89281e4690 2023-10-16T13:39:35.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.005+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f89280cc7e0 con 0x7f891406af00 2023-10-16T13:39:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.007+0000 7f8924ff9700 1 -- 172.21.15.5:0/2837093777 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f891800eb50 con 0x7f891406af00 2023-10-16T13:39:35.010 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:39:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:39:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:35.011 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:39:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f891406af00 msgr2=0x7f891406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f891406af00 0x7f891406d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89180090b0 tx=0x7f8918008030 comp rx=0 tx=0).stop 2023-10-16T13:39:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 msgr2=0x7f89281e4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 0x7f89281e4b10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f891c00e780 tx=0x7f891c00eb40 comp rx=0 tx=0).stop 2023-10-16T13:39:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 shutdown_connections 2023-10-16T13:39:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f891406af00 0x7f891406d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89280c5e30 0x7f89280c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8910003b90 0x7f89280c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 --2- 172.21.15.5:0/2837093777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89281e4690 0x7f89281e4b10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 >> 172.21.15.5:0/2837093777 conn(0x7f892806dac0 msgr2=0x7f89280b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 shutdown_connections 2023-10-16T13:39:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.009+0000 7f892e2f6700 1 -- 172.21.15.5:0/2837093777 wait complete. 2023-10-16T13:39:35.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:39:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.149+0000 7ff4d46b5700 1 Processor -- start 2023-10-16T13:39:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.149+0000 7ff4d46b5700 1 -- start start 2023-10-16T13:39:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d46b5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4cc15f1f0 0x7ff4cc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d46b5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff4cc0cfc60 0x7ff4cc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d46b5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc15e7a0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d46b5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc0d0090 con 0x7ff4cc15f1f0 2023-10-16T13:39:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d46b5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc0b29a0 con 0x7ff4cc0cfc60 2023-10-16T13:39:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d1c50700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4cc15f1f0 0x7ff4cc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d1c50700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4cc15f1f0 0x7ff4cc0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44040/0 (socket says 172.21.15.5:44040) 2023-10-16T13:39:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.150+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1172323143 learned_addr learned my addr 172.21.15.5:0/1172323143 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d2c52700 1 --2- 172.21.15.5:0/1172323143 >> v2:172.21.15.112:3300/0 conn(0x7ff4cc0cfc60 0x7ff4cc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1172323143 >> v2:172.21.15.112:3300/0 conn(0x7ff4cc0cfc60 msgr2=0x7ff4cc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d1c50700 1 --2- 172.21.15.5:0/1172323143 >> v2:172.21.15.112:3300/0 conn(0x7ff4cc0cfc60 0x7ff4cc0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1172323143 >> v1:172.21.15.112:6789/0 conn(0x7ff4cc15ab10 legacy=0x7ff4cc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1172323143 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc0b2c80 con 0x7ff4cc15f1f0 2023-10-16T13:39:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d1c50700 1 --2- 172.21.15.5:0/1172323143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc0cf720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0d03e0 tx=0x7ff4c800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c1d83099be4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d144f700 1 -- 172.21.15.5:0/1172323143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8005e30 con 0x7ff4cc15f1f0 2023-10-16T13:39:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d144f700 1 -- 172.21.15.5:0/1172323143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c800d8b0 con 0x7ff4cc15f1f0 2023-10-16T13:39:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.151+0000 7ff4d144f700 1 -- 172.21.15.5:0/1172323143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800dc40 con 0x7ff4cc15f1f0 2023-10-16T13:39:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1172323143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15f1f0 msgr2=0x7ff4cc0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1172323143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc0cf720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0d03e0 tx=0x7ff4c800be70 comp rx=0 tx=0).stop 2023-10-16T13:39:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1172323143 shutdown_connections 2023-10-16T13:39:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1172323143 >> v2:172.21.15.112:3300/0 conn(0x7ff4cc0cfc60 0x7ff4cc0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1172323143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc0cf720 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1172323143 >> 172.21.15.5:0/1172323143 conn(0x7ff4cc06dae0 msgr2=0x7ff4cc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1172323143 shutdown_connections 2023-10-16T13:39:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.152+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1172323143 wait complete. 2023-10-16T13:39:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.153+0000 7ff4d46b5700 1 Processor -- start 2023-10-16T13:39:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.153+0000 7ff4d46b5700 1 -- start start 2023-10-16T13:39:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4cc0cfc60 0x7ff4cc15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 0x7ff4cc14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc155ca0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc15d050 con 0x7ff4cc15f1f0 2023-10-16T13:39:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc14cf90 con 0x7ff4cc0cfc60 2023-10-16T13:39:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 0x7ff4cc14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 0x7ff4cc14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44046/0 (socket says 172.21.15.5:44046) 2023-10-16T13:39:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1823491033 learned_addr learned my addr 172.21.15.5:0/1823491033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d2451700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4cc0cfc60 0x7ff4cc15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d2c52700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4cc0cfc60 msgr2=0x7ff4cc15cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4cc0cfc60 0x7ff4cc15cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4cc15f1f0 msgr2=0x7ff4cc15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 -- 172.21.15.5:0/1823491033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c800b7a0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d1c50700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 0x7ff4cc14ca50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800beb0 tx=0x7ff4c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:35.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8021070 con 0x7ff4cc15ab10 2023-10-16T13:39:35.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c801c110 con 0x7ff4cc15ab10 2023-10-16T13:39:35.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc154ef0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8004270 con 0x7ff4cc15ab10 2023-10-16T13:39:35.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.154+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc1555e0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.155+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc067d20 con 0x7ff4cc15ab10 2023-10-16T13:39:35.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.156+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4c80043d0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.156+0000 7ff4c2ffd700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff4b006af00 0x7ff4b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.157+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4c808cee0 con 0x7ff4cc15ab10 2023-10-16T13:39:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.157+0000 7ff4d2451700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff4b006af00 0x7ff4b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.157+0000 7ff4d2451700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff4b006af00 0x7ff4b006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009870 tx=0x7ff4bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.161+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4c8058020 con 0x7ff4cc15ab10 2023-10-16T13:39:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.361+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff4cc0afc10 con 0x7ff4cc15ab10 2023-10-16T13:39:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.361+0000 7ff4c2ffd700 1 -- 172.21.15.5:0/1823491033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4c805b640 con 0x7ff4cc15ab10 2023-10-16T13:39:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff4b006af00 msgr2=0x7ff4b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff4b006af00 0x7ff4b006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009870 tx=0x7ff4bc008040 comp rx=0 tx=0).stop 2023-10-16T13:39:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 msgr2=0x7ff4cc14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 0x7ff4cc14ca50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800beb0 tx=0x7ff4c8004750 comp rx=0 tx=0).stop 2023-10-16T13:39:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 shutdown_connections 2023-10-16T13:39:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4cc15f1f0 0x7ff4cc15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff4b006af00 0x7ff4b006d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4cc0cfc60 0x7ff4cc15cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 --2- 172.21.15.5:0/1823491033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15ab10 0x7ff4cc14ca50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 >> 172.21.15.5:0/1823491033 conn(0x7ff4cc06dae0 msgr2=0x7ff4cc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 shutdown_connections 2023-10-16T13:39:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.363+0000 7ff4d46b5700 1 -- 172.21.15.5:0/1823491033 wait complete. 2023-10-16T13:39:35.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000104260 2023-10-16T13:39:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.503+0000 7f331e5af700 1 Processor -- start 2023-10-16T13:39:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.503+0000 7f331e5af700 1 -- start start 2023-10-16T13:39:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331e5af700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f33180cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331e5af700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33180cfc60 0x7f33180cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331e5af700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331815e7a0 con 0x7f331815ab10 2023-10-16T13:39:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331e5af700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180d00d0 con 0x7f33180cfc60 2023-10-16T13:39:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331e5af700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180b29a0 con 0x7f331815f1f0 2023-10-16T13:39:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33180cfc60 0x7f33180cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33180cfc60 0x7f33180cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44056/0 (socket says 172.21.15.5:44056) 2023-10-16T13:39:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 -- 172.21.15.5:0/1015812682 learned_addr learned my addr 172.21.15.5:0/1015812682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f33177fe700 1 --2- 172.21.15.5:0/1015812682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f33180cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 -- 172.21.15.5:0/1015812682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 msgr2=0x7f33180cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 --2- 172.21.15.5:0/1015812682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f33180cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 -- 172.21.15.5:0/1015812682 >> v1:172.21.15.112:6789/0 conn(0x7f331815ab10 legacy=0x7f33180b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 -- 172.21.15.5:0/1015812682 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180b2c80 con 0x7f33180cfc60 2023-10-16T13:39:35.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f331cb4c700 1 --2- 172.21.15.5:0/1015812682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cfc60 0x7f33180cbf40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f331000d150 tx=0x7f331000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fafcb005db2b445 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f3316ffd700 1 -- 172.21.15.5:0/1015812682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310010070 con 0x7f33180cfc60 2023-10-16T13:39:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f3316ffd700 1 -- 172.21.15.5:0/1015812682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331000ddc0 con 0x7f33180cfc60 2023-10-16T13:39:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.504+0000 7f3316ffd700 1 -- 172.21.15.5:0/1015812682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331000b310 con 0x7f33180cfc60 2023-10-16T13:39:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 -- 172.21.15.5:0/1015812682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cfc60 msgr2=0x7f33180cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 --2- 172.21.15.5:0/1015812682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cfc60 0x7f33180cbf40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f331000d150 tx=0x7f331000d460 comp rx=0 tx=0).stop 2023-10-16T13:39:35.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 -- 172.21.15.5:0/1015812682 shutdown_connections 2023-10-16T13:39:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 --2- 172.21.15.5:0/1015812682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33180cfc60 0x7f33180cbf40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 --2- 172.21.15.5:0/1015812682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f33180cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 -- 172.21.15.5:0/1015812682 >> 172.21.15.5:0/1015812682 conn(0x7f331806dae0 msgr2=0x7f331806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 -- 172.21.15.5:0/1015812682 shutdown_connections 2023-10-16T13:39:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.505+0000 7f331e5af700 1 -- 172.21.15.5:0/1015812682 wait complete. 2023-10-16T13:39:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.506+0000 7f331e5af700 1 Processor -- start 2023-10-16T13:39:35.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.506+0000 7f331e5af700 1 -- start start 2023-10-16T13:39:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331e5af700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33180cfc60 0x7f33181efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331e5af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 0x7f331815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331e5af700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f3318152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331e5af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180c4760 con 0x7f331815ab10 2023-10-16T13:39:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331e5af700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331815b430 con 0x7f33180cfc60 2023-10-16T13:39:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331e5af700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331815b6d0 con 0x7f331815f1f0 2023-10-16T13:39:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f33177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 0x7f331815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f33177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 0x7f331815aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44058/0 (socket says 172.21.15.5:44058) 2023-10-16T13:39:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f33177fe700 1 -- 172.21.15.5:0/631223445 learned_addr learned my addr 172.21.15.5:0/631223445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f3317fff700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33180cfc60 0x7f33181efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.507+0000 7f331cb4c700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f3318152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f33177fe700 1 -- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 msgr2=0x7f3318152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f33177fe700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f3318152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f33177fe700 1 -- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33180cfc60 msgr2=0x7f33181efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f33177fe700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33180cfc60 0x7f33181efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f33177fe700 1 -- 172.21.15.5:0/631223445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331000bd40 con 0x7f331815ab10 2023-10-16T13:39:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f33177fe700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 0x7f331815aef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f330c00e760 tx=0x7f330c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00c070 con 0x7f331815ab10 2023-10-16T13:39:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c005a20 con 0x7f331815ab10 2023-10-16T13:39:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331815b9b0 con 0x7f331815ab10 2023-10-16T13:39:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c005db0 con 0x7f331815ab10 2023-10-16T13:39:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.508+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33180c49b0 con 0x7f331815ab10 2023-10-16T13:39:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.509+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33180c4bd0 con 0x7f331815ab10 2023-10-16T13:39:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.509+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f330c005f10 con 0x7f331815ab10 2023-10-16T13:39:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.510+0000 7f3314ff9700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f330406af00 0x7f330406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.510+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f330c088ea0 con 0x7f331815ab10 2023-10-16T13:39:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.510+0000 7f3317fff700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f330406af00 0x7f330406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.510+0000 7f3317fff700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f330406af00 0x7f330406d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3308007fd0 tx=0x7f3308009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.515+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f330c053fe0 con 0x7f331815ab10 2023-10-16T13:39:35.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:35.745+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000104260", "target": ["mon-mgr", ""]}) v1 -- 0x7f331815ecd0 con 0x7f330406af00 2023-10-16T13:39:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.659+0000 7f3314ff9700 1 -- 172.21.15.5:0/631223445 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f3308001560 con 0x7f330406af00 2023-10-16T13:39:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.663+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f330406af00 msgr2=0x7f330406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.663+0000 7f331e5af700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f330406af00 0x7f330406d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3308007fd0 tx=0x7f3308009040 comp rx=0 tx=0).stop 2023-10-16T13:39:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.663+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 msgr2=0x7f331815aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.663+0000 7f331e5af700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 0x7f331815aef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f330c00e760 tx=0x7f330c00ea70 comp rx=0 tx=0).stop 2023-10-16T13:39:38.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 shutdown_connections 2023-10-16T13:39:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f330406af00 0x7f330406d3c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331815f1f0 0x7f3318152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33180cfc60 0x7f33181efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 --2- 172.21.15.5:0/631223445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f331815ab10 0x7f331815aef0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 >> 172.21.15.5:0/631223445 conn(0x7f331806dae0 msgr2=0x7f33180aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.664+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 shutdown_connections 2023-10-16T13:39:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.665+0000 7f331e5af700 1 -- 172.21.15.5:0/631223445 wait complete. 2023-10-16T13:39:38.674 INFO:teuthology.orchestra.run.smithi005.stderr:Volume created successfully (no MDS daemons created) 2023-10-16T13:39:38.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:39:38.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.815+0000 7f8923c23700 1 Processor -- start 2023-10-16T13:39:38.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.815+0000 7f8923c23700 1 -- start start 2023-10-16T13:39:38.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f8923c23700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bbc0 0x7f891c0d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f8923c23700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f891c0ce4c0 0x7f891c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f8923c23700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c0cce60 con 0x7f891c15bfa0 2023-10-16T13:39:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f8923c23700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c0cd4e0 con 0x7f891c0ce4c0 2023-10-16T13:39:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f8923c23700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0b2ba0 con 0x7f891c15bbc0 2023-10-16T13:39:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f89221c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f891c0ce4c0 0x7f891c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f89221c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f891c0ce4c0 0x7f891c0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44068/0 (socket says 172.21.15.5:44068) 2023-10-16T13:39:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f89221c0700 1 -- 172.21.15.5:0/1371564502 learned_addr learned my addr 172.21.15.5:0/1371564502 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.816+0000 7f89219bf700 1 --2- 172.21.15.5:0/1371564502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bbc0 0x7f891c0d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89221c0700 1 -- 172.21.15.5:0/1371564502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bbc0 msgr2=0x7f891c0d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89221c0700 1 --2- 172.21.15.5:0/1371564502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bbc0 0x7f891c0d20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89221c0700 1 -- 172.21.15.5:0/1371564502 >> v1:172.21.15.112:6789/0 conn(0x7f891c15bfa0 legacy=0x7f891c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89221c0700 1 -- 172.21.15.5:0/1371564502 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0cd100 con 0x7f891c0ce4c0 2023-10-16T13:39:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89221c0700 1 --2- 172.21.15.5:0/1371564502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b0d40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8914009e50 tx=0x7f891400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14717f83fd42c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89209bd700 1 -- 172.21.15.5:0/1371564502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891400e070 con 0x7f891c0ce4c0 2023-10-16T13:39:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89209bd700 1 -- 172.21.15.5:0/1371564502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914003a20 con 0x7f891c0ce4c0 2023-10-16T13:39:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f89209bd700 1 -- 172.21.15.5:0/1371564502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914003dd0 con 0x7f891c0ce4c0 2023-10-16T13:39:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f8923c23700 1 -- 172.21.15.5:0/1371564502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 msgr2=0x7f891c0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f8923c23700 1 --2- 172.21.15.5:0/1371564502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b0d40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8914009e50 tx=0x7f891400b330 comp rx=0 tx=0).stop 2023-10-16T13:39:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f8923c23700 1 -- 172.21.15.5:0/1371564502 shutdown_connections 2023-10-16T13:39:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f8923c23700 1 --2- 172.21.15.5:0/1371564502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b0d40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f8923c23700 1 --2- 172.21.15.5:0/1371564502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bbc0 0x7f891c0d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.817+0000 7f8923c23700 1 -- 172.21.15.5:0/1371564502 >> 172.21.15.5:0/1371564502 conn(0x7f891c0d15f0 msgr2=0x7f891c0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.818+0000 7f8923c23700 1 -- 172.21.15.5:0/1371564502 shutdown_connections 2023-10-16T13:39:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.818+0000 7f8923c23700 1 -- 172.21.15.5:0/1371564502 wait complete. 2023-10-16T13:39:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 Processor -- start 2023-10-16T13:39:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 -- start start 2023-10-16T13:39:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f891c15bbc0 0x7f891c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bfa0 0x7f891c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c155a80 con 0x7f891c0ce4c0 2023-10-16T13:39:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c154bf0 con 0x7f891c15bbc0 2023-10-16T13:39:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.819+0000 7f8923c23700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c154e00 con 0x7f891c15bfa0 2023-10-16T13:39:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44070/0 (socket says 172.21.15.5:44070) 2023-10-16T13:39:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 -- 172.21.15.5:0/1283343048 learned_addr learned my addr 172.21.15.5:0/1283343048 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89211be700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f891c15bbc0 0x7f891c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89221c0700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bfa0 0x7f891c155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 -- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bfa0 msgr2=0x7f891c155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bfa0 0x7f891c155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 -- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f891c15bbc0 msgr2=0x7f891c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f891c15bbc0 0x7f891c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 -- 172.21.15.5:0/1283343048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8914009b30 con 0x7f891c0ce4c0 2023-10-16T13:39:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89221c0700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bfa0 0x7f891c155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89219bf700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b5c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c7f0 tx=0x7f890c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c004220 con 0x7f891c0ce4c0 2023-10-16T13:39:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c004380 con 0x7f891c0ce4c0 2023-10-16T13:39:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c1550e0 con 0x7f891c0ce4c0 2023-10-16T13:39:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0036a0 con 0x7f891c0ce4c0 2023-10-16T13:39:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.820+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c1556a0 con 0x7f891c0ce4c0 2023-10-16T13:39:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.821+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c06dfb0 con 0x7f891c0ce4c0 2023-10-16T13:39:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.822+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f890c003800 con 0x7f891c0ce4c0 2023-10-16T13:39:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.822+0000 7f89127fc700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f890006af00 0x7f890006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.822+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6607+0+0 (secure 0 0 0) 0x7f890c089940 con 0x7f891c0ce4c0 2023-10-16T13:39:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.823+0000 7f89211be700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f890006af00 0x7f890006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.823+0000 7f89211be700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f890006af00 0x7f890006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f891c1e62b0 tx=0x7f89180090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:38.827+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f890c054700 con 0x7f891c0ce4c0 2023-10-16T13:39:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.058+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f891c0b2e80 con 0x7f890006af00 2023-10-16T13:39:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.060+0000 7f89127fc700 1 -- 172.21.15.5:0/1283343048 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f8918009e00 con 0x7f890006af00 2023-10-16T13:39:39.063 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:39:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:39:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:39:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:39:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volume_0000000000104260" 2023-10-16T13:39:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:39:39.064 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:39:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f890006af00 msgr2=0x7f890006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f890006af00 0x7f890006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f891c1e62b0 tx=0x7f89180090e0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 msgr2=0x7f891c0b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b5c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c7f0 tx=0x7f890c00cb00 comp rx=0 tx=0).stop 2023-10-16T13:39:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 shutdown_connections 2023-10-16T13:39:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f890006af00 0x7f890006d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f891c15bfa0 0x7f891c155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0ce4c0 0x7f891c0b5c50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 --2- 172.21.15.5:0/1283343048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f891c15bbc0 0x7f891c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.062+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 >> 172.21.15.5:0/1283343048 conn(0x7f891c0d15f0 msgr2=0x7f891c0cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.063+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 shutdown_connections 2023-10-16T13:39:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.063+0000 7f8923c23700 1 -- 172.21.15.5:0/1283343048 wait complete. 2023-10-16T13:39:39.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-10-16T13:39:39.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.202+0000 7f1dbc697700 1 Processor -- start 2023-10-16T13:39:39.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.202+0000 7f1dbc697700 1 -- start start 2023-10-16T13:39:39.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbc697700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1db40b54f0 0x7f1db415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbc697700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40b5c70 con 0x7f1db406eb30 2023-10-16T13:39:39.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbc697700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40b5990 con 0x7f1db406e750 2023-10-16T13:39:39.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbc697700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db415b2b0 con 0x7f1db40b54f0 2023-10-16T13:39:39.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbac34700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1db40b54f0 0x7f1db415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1db9c32700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1db406eb30 0x7f1db415e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54082/0 (socket says 172.21.15.5:54082) 2023-10-16T13:39:39.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1db9c32700 1 -- 172.21.15.5:0/3500589370 learned_addr learned my addr 172.21.15.5:0/3500589370 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:39.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbac34700 1 -- 172.21.15.5:0/3500589370 >> v1:172.21.15.112:6789/0 conn(0x7f1db406e750 legacy=0x7f1db40ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:39.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbac34700 1 -- 172.21.15.5:0/3500589370 >> v1:172.21.15.5:6789/0 conn(0x7f1db406eb30 legacy=0x7f1db415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbac34700 1 -- 172.21.15.5:0/3500589370 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db415b590 con 0x7f1db40b54f0 2023-10-16T13:39:39.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1db9431700 1 -- 172.21.15.5:0/3500589370 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156207050 0 0) 0x7f1db40b5c70 con 0x7f1db406eb30 2023-10-16T13:39:39.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.203+0000 7f1dbac34700 1 --2- 172.21.15.5:0/3500589370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db415ee10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00bfd0 tx=0x7f1dac00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fefea7c4058425f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1db9431700 1 -- 172.21.15.5:0/3500589370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac010070 con 0x7f1db40b54f0 2023-10-16T13:39:39.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1db9431700 1 -- 172.21.15.5:0/3500589370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00b2e0 con 0x7f1db40b54f0 2023-10-16T13:39:39.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1db9431700 1 -- 172.21.15.5:0/3500589370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00dca0 con 0x7f1db40b54f0 2023-10-16T13:39:39.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 -- 172.21.15.5:0/3500589370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 msgr2=0x7f1db415ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 --2- 172.21.15.5:0/3500589370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db415ee10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00bfd0 tx=0x7f1dac00d330 comp rx=0 tx=0).stop 2023-10-16T13:39:39.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 -- 172.21.15.5:0/3500589370 shutdown_connections 2023-10-16T13:39:39.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 --2- 172.21.15.5:0/3500589370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db415ee10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 -- 172.21.15.5:0/3500589370 >> 172.21.15.5:0/3500589370 conn(0x7f1db40cc6f0 msgr2=0x7f1db40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:39.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 -- 172.21.15.5:0/3500589370 shutdown_connections 2023-10-16T13:39:39.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.204+0000 7f1dbc697700 1 -- 172.21.15.5:0/3500589370 wait complete. 2023-10-16T13:39:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.205+0000 7f1dbc697700 1 Processor -- start 2023-10-16T13:39:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 -- start start 2023-10-16T13:39:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1db406e750 0x7f1db40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1db406eb30 0x7f1db415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db4156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db415db90 con 0x7f1db40b54f0 2023-10-16T13:39:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c94d0 con 0x7f1db406e750 2023-10-16T13:39:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbc697700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c97b0 con 0x7f1db406eb30 2023-10-16T13:39:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbac34700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db4156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbac34700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db4156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44088/0 (socket says 172.21.15.5:44088) 2023-10-16T13:39:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.206+0000 7f1dbac34700 1 -- 172.21.15.5:0/2749096343 learned_addr learned my addr 172.21.15.5:0/2749096343 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1db9c32700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1db406eb30 0x7f1db415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dba433700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1db406e750 0x7f1db40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbac34700 1 -- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1db406eb30 msgr2=0x7f1db415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbac34700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1db406eb30 0x7f1db415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbac34700 1 -- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1db406e750 msgr2=0x7f1db40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbac34700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1db406e750 0x7f1db40c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbac34700 1 -- 172.21.15.5:0/2749096343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac00bc80 con 0x7f1db40b54f0 2023-10-16T13:39:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dba433700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1db406e750 0x7f1db40c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1db9c32700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1db406eb30 0x7f1db415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbac34700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db4156300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1dac017040 tx=0x7f1dac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0042c0 con 0x7f1db40b54f0 2023-10-16T13:39:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac004420 con 0x7f1db40b54f0 2023-10-16T13:39:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db40c9a90 con 0x7f1db40b54f0 2023-10-16T13:39:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac004790 con 0x7f1db40b54f0 2023-10-16T13:39:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.207+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db4156840 con 0x7f1db40b54f0 2023-10-16T13:39:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.208+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db41569d0 con 0x7f1db40b54f0 2023-10-16T13:39:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.208+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1dac01b070 con 0x7f1db40b54f0 2023-10-16T13:39:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.209+0000 7f1daaffd700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d9806af00 0x7f1d9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.209+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6607+0+0 (secure 0 0 0) 0x7f1dac08cb70 con 0x7f1db40b54f0 2023-10-16T13:39:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.209+0000 7f1dba433700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d9806af00 0x7f1d9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.210+0000 7f1dba433700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d9806af00 0x7f1d9806d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1da4003f40 tx=0x7f1da4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.214+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1db41569d0 con 0x7f1db40b54f0 2023-10-16T13:39:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.414+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f1db41569d0 con 0x7f1db40b54f0 2023-10-16T13:39:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.415+0000 7f1daaffd700 1 -- 172.21.15.5:0/2749096343 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+9197 (secure 0 0 0) 0x7f1db41569d0 con 0x7f1db40b54f0 2023-10-16T13:39:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d9806af00 msgr2=0x7f1d9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d9806af00 0x7f1d9806d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1da4003f40 tx=0x7f1da4009040 comp rx=0 tx=0).stop 2023-10-16T13:39:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 msgr2=0x7f1db4156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db4156300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1dac017040 tx=0x7f1dac004ad0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 shutdown_connections 2023-10-16T13:39:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db40b54f0 0x7f1db4156300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1db406e750 0x7f1db40c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d9806af00 0x7f1d9806d3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 --2- 172.21.15.5:0/2749096343 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1db406eb30 0x7f1db415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 >> 172.21.15.5:0/2749096343 conn(0x7f1db40cc6f0 msgr2=0x7f1db406b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 shutdown_connections 2023-10-16T13:39:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.418+0000 7f1dbc697700 1 -- 172.21.15.5:0/2749096343 wait complete. 2023-10-16T13:39:39.432 INFO:teuthology.orchestra.run.smithi005.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000104260.meta","create_time":"2023-10-16T13:39:35.777948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000104260"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000104260.data","create_time":"2023-10-16T13:39:36.675137+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000104260"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}] 2023-10-16T13:39:39.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000104260 --format=json 2023-10-16T13:39:39.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.557+0000 7f98d3e60700 1 Processor -- start 2023-10-16T13:39:39.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.557+0000 7f98d3e60700 1 -- start start 2023-10-16T13:39:39.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d3e60700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15ddc0 0x7f98cc161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d3e60700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc0ce350 con 0x7f98cc161d40 2023-10-16T13:39:39.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d3e60700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc162630 con 0x7f98cc15d9e0 2023-10-16T13:39:39.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d3e60700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1621c0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d23fd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f98cc161d40 0x7f98cc167b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54100/0 (socket says 172.21.15.5:54100) 2023-10-16T13:39:39.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d23fd700 1 -- 172.21.15.5:0/318361404 learned_addr learned my addr 172.21.15.5:0/318361404 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:39.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d13fb700 1 --2- 172.21.15.5:0/318361404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15ddc0 0x7f98cc161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626720800 0 0) 0x7f98cc0ce350 con 0x7f98cc161d40 2023-10-16T13:39:39.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b80035b0 con 0x7f98cc161d40 2023-10-16T13:39:39.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511824908 0 0) 0x7f98cc162630 con 0x7f98cc15d9e0 2023-10-16T13:39:39.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc0ce350 con 0x7f98cc15d9e0 2023-10-16T13:39:39.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d13fb700 1 -- 172.21.15.5:0/318361404 >> v1:172.21.15.112:6789/0 conn(0x7f98cc15d9e0 legacy=0x7f98cc0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1491059590 0 0) 0x7f98b80035b0 con 0x7f98cc161d40 2023-10-16T13:39:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d13fb700 1 -- 172.21.15.5:0/318361404 >> v1:172.21.15.5:6789/0 conn(0x7f98cc161d40 legacy=0x7f98cc167b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.558+0000 7f98d13fb700 1 -- 172.21.15.5:0/318361404 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0ce5f0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d13fb700 1 --2- 172.21.15.5:0/318361404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15ddc0 0x7f98cc161800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009870 tx=0x7f98bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60574fd10716b07b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c40019f0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc004030 con 0x7f98cc15ddc0 2023-10-16T13:39:39.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d0bfa700 1 -- 172.21.15.5:0/318361404 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0043a0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d3e60700 1 -- 172.21.15.5:0/318361404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15ddc0 msgr2=0x7f98cc161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d3e60700 1 --2- 172.21.15.5:0/318361404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15ddc0 0x7f98cc161800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009870 tx=0x7f98bc009b80 comp rx=0 tx=0).stop 2023-10-16T13:39:39.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.559+0000 7f98d3e60700 1 -- 172.21.15.5:0/318361404 shutdown_connections 2023-10-16T13:39:39.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.560+0000 7f98d3e60700 1 --2- 172.21.15.5:0/318361404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15ddc0 0x7f98cc161800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.560+0000 7f98d3e60700 1 -- 172.21.15.5:0/318361404 >> 172.21.15.5:0/318361404 conn(0x7f98cc09cb40 msgr2=0x7f98cc0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:39.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.560+0000 7f98d3e60700 1 -- 172.21.15.5:0/318361404 shutdown_connections 2023-10-16T13:39:39.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.560+0000 7f98d3e60700 1 -- 172.21.15.5:0/318361404 wait complete. 2023-10-16T13:39:39.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.561+0000 7f98d3e60700 1 Processor -- start 2023-10-16T13:39:39.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.561+0000 7f98d3e60700 1 -- start start 2023-10-16T13:39:39.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15d9e0 0x7f98cc0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 0x7f98cc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc161d40 0x7f98cc1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15fde0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15f1d0 con 0x7f98cc161d40 2023-10-16T13:39:39.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15f4b0 con 0x7f98cc15d9e0 2023-10-16T13:39:39.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 0x7f98cc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 0x7f98cc0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44100/0 (socket says 172.21.15.5:44100) 2023-10-16T13:39:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 -- 172.21.15.5:0/3099753588 learned_addr learned my addr 172.21.15.5:0/3099753588 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d23fd700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc161d40 0x7f98cc1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d1bfc700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15d9e0 0x7f98cc0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 -- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15d9e0 msgr2=0x7f98cc0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15d9e0 0x7f98cc0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 -- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc161d40 msgr2=0x7f98cc1f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc161d40 0x7f98cc1f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 -- 172.21.15.5:0/3099753588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0094a0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d13fb700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 0x7f98cc0c9900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0090b0 tx=0x7f98bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc003c60 con 0x7f98cc15ddc0 2023-10-16T13:39:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc01f070 con 0x7f98cc15ddc0 2023-10-16T13:39:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc15f790 con 0x7f98cc15ddc0 2023-10-16T13:39:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.562+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc011630 con 0x7f98cc15ddc0 2023-10-16T13:39:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.563+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc15ee30 con 0x7f98cc15ddc0 2023-10-16T13:39:39.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.564+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc067d20 con 0x7f98cc15ddc0 2023-10-16T13:39:39.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.564+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f98bc011790 con 0x7f98cc15ddc0 2023-10-16T13:39:39.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.564+0000 7f98c27fc700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f98b006af00 0x7f98b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.564+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6607+0+0 (secure 0 0 0) 0x7f98bc021070 con 0x7f98cc15ddc0 2023-10-16T13:39:39.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.564+0000 7f98d1bfc700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f98b006af00 0x7f98b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.565+0000 7f98d1bfc700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f98b006af00 0x7f98b006d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98c8001830 tx=0x7f98c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.569+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98bc055e70 con 0x7f98cc15ddc0 2023-10-16T13:39:39.785 INFO:tasks.ceph.mds.d.smithi112.stderr:2023-10-16T13:39:39.783+0000 7fc001c96700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:39:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.822+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000104260", "format": "json"} v 0) v1 -- 0x7f98cc08d8d0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.822+0000 7f98c27fc700 1 -- 172.21.15.5:0/3099753588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000104260", "format": "json"}]=0 v20) v1 ==== 110+0+2027 (secure 0 0 0) 0x7f98bc02b0b0 con 0x7f98cc15ddc0 2023-10-16T13:39:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:39.825 INFO:teuthology.orchestra.run.smithi005.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:37.647853+0000","modified":"2023-10-16T13:39:38.677259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5014},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5014":{"gid":5014,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.112:6837/1052521879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1052521879},{"type":"v1","addr":"172.21.15.112:6837","nonce":1052521879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000104260","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":3} 2023-10-16T13:39:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f98b006af00 msgr2=0x7f98b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f98b006af00 0x7f98b006d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98c8001830 tx=0x7f98c8009040 comp rx=0 tx=0).stop 2023-10-16T13:39:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 msgr2=0x7f98cc0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 0x7f98cc0c9900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0090b0 tx=0x7f98bc004750 comp rx=0 tx=0).stop 2023-10-16T13:39:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 shutdown_connections 2023-10-16T13:39:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc161d40 0x7f98cc1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f98b006af00 0x7f98b006d3c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98cc15d9e0 0x7f98cc0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 --2- 172.21.15.5:0/3099753588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98cc15ddc0 0x7f98cc0c9900 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 >> 172.21.15.5:0/3099753588 conn(0x7f98cc09cb40 msgr2=0x7f98cc0b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 shutdown_connections 2023-10-16T13:39:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.824+0000 7f98d3e60700 1 -- 172.21.15.5:0/3099753588 wait complete. 2023-10-16T13:39:39.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000104260 --yes-i-really-mean-it 2023-10-16T13:39:39.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.965+0000 7f1ae6425700 1 Processor -- start 2023-10-16T13:39:39.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.965+0000 7f1ae6425700 1 -- start start 2023-10-16T13:39:39.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae6425700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ae006af50 0x7f1ae00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae6425700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00b2d60 con 0x7f1ae00cd950 2023-10-16T13:39:39.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae6425700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00cdd30 con 0x7f1ae015e2f0 2023-10-16T13:39:39.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae6425700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae01619a0 con 0x7f1ae006af50 2023-10-16T13:39:39.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae49c2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ae006af50 0x7f1ae00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1adffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ae00cd950 0x7f1ae015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54110/0 (socket says 172.21.15.5:54110) 2023-10-16T13:39:39.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1adffff700 1 -- 172.21.15.5:0/3573537834 learned_addr learned my addr 172.21.15.5:0/3573537834 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:39.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae49c2700 1 -- 172.21.15.5:0/3573537834 >> v1:172.21.15.112:6789/0 conn(0x7f1ae015e2f0 legacy=0x7f1ae006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae49c2700 1 -- 172.21.15.5:0/3573537834 >> v1:172.21.15.5:6789/0 conn(0x7f1ae00cd950 legacy=0x7f1ae015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae49c2700 1 -- 172.21.15.5:0/3573537834 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae015e920 con 0x7f1ae006af50 2023-10-16T13:39:39.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1adeffd700 1 -- 172.21.15.5:0/3573537834 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814846380 0 0) 0x7f1ae00b2d60 con 0x7f1ae00cd950 2023-10-16T13:39:39.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1ae49c2700 1 --2- 172.21.15.5:0/3573537834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae00cede0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009d90 tx=0x7f1ad800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71de283c18d01263 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.966+0000 7f1adeffd700 1 -- 172.21.15.5:0/3573537834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800e070 con 0x7f1ae006af50 2023-10-16T13:39:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1adeffd700 1 -- 172.21.15.5:0/3573537834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800bbd0 con 0x7f1ae006af50 2023-10-16T13:39:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1adeffd700 1 -- 172.21.15.5:0/3573537834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8012430 con 0x7f1ae006af50 2023-10-16T13:39:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 -- 172.21.15.5:0/3573537834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 msgr2=0x7f1ae00cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 --2- 172.21.15.5:0/3573537834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae00cede0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009d90 tx=0x7f1ad800b330 comp rx=0 tx=0).stop 2023-10-16T13:39:39.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 -- 172.21.15.5:0/3573537834 shutdown_connections 2023-10-16T13:39:39.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 --2- 172.21.15.5:0/3573537834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae00cede0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 -- 172.21.15.5:0/3573537834 >> 172.21.15.5:0/3573537834 conn(0x7f1ae006dae0 msgr2=0x7f1ae006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:39.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 -- 172.21.15.5:0/3573537834 shutdown_connections 2023-10-16T13:39:39.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.967+0000 7f1ae6425700 1 -- 172.21.15.5:0/3573537834 wait complete. 2023-10-16T13:39:39.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.969+0000 7f1ae6425700 1 Processor -- start 2023-10-16T13:39:39.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.969+0000 7f1ae6425700 1 -- start start 2023-10-16T13:39:39.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae6425700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae6425700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ae00cd950 0x7f1ae0160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae6425700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ae015e2f0 0x7f1ae01607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae6425700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0156890 con 0x7f1ae006af50 2023-10-16T13:39:39.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae6425700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00b4470 con 0x7f1ae00cd950 2023-10-16T13:39:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae6425700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00b4750 con 0x7f1ae015e2f0 2023-10-16T13:39:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae0156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44112/0 (socket says 172.21.15.5:44112) 2023-10-16T13:39:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 -- 172.21.15.5:0/2462033982 learned_addr learned my addr 172.21.15.5:0/2462033982 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae49c2700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ae015e2f0 0x7f1ae01607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adf7fe700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ae00cd950 0x7f1ae0160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 -- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ae015e2f0 msgr2=0x7f1ae01607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ae015e2f0 0x7f1ae01607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 -- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ae00cd950 msgr2=0x7f1ae0160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ae00cd950 0x7f1ae0160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 -- 172.21.15.5:0/2462033982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8009a70 con 0x7f1ae006af50 2023-10-16T13:39:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adf7fe700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ae00cd950 0x7f1ae0160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1ae49c2700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ae015e2f0 0x7f1ae01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.970+0000 7f1adffff700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae0156350 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c520 tx=0x7f1ad400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.971+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4004c80 con 0x7f1ae006af50 2023-10-16T13:39:39.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.971+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4004e00 con 0x7f1ae006af50 2023-10-16T13:39:39.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.971+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00b4a30 con 0x7f1ae006af50 2023-10-16T13:39:39.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.971+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4007310 con 0x7f1ae006af50 2023-10-16T13:39:39.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.971+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae00b4ff0 con 0x7f1ae006af50 2023-10-16T13:39:39.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.972+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae0067d20 con 0x7f1ae006af50 2023-10-16T13:39:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.972+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ad4007470 con 0x7f1ae006af50 2023-10-16T13:39:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.972+0000 7f1adcff9700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1acc06af00 0x7f1acc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.973+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6607+0+0 (secure 0 0 0) 0x7f1ad40896a0 con 0x7f1ae006af50 2023-10-16T13:39:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.973+0000 7f1adf7fe700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1acc06af00 0x7f1acc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.973+0000 7f1adf7fe700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1acc06af00 0x7f1acc06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00c8990 tx=0x7f1ad0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:39.977+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ad40543d0 con 0x7f1ae006af50 2023-10-16T13:39:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:40.211+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000104260", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae015eee0 con 0x7f1acc06af00 2023-10-16T13:39:40.218 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:39:40.216+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:39:40.224 INFO:tasks.ceph.mds.d.smithi112.stderr: -13> 2023-10-16T13:39:39.783+0000 7fc001c96700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:39:40.250 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:39:43.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.230+0000 7f1adcff9700 1 -- 172.21.15.5:0/2462033982 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f1ad0001420 con 0x7f1acc06af00 2023-10-16T13:39:43.233 INFO:teuthology.orchestra.run.smithi005.stdout:metadata pool: cephfs.volume_0000000000104260.meta data pool: ['cephfs.volume_0000000000104260.data'] removed 2023-10-16T13:39:43.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1acc06af00 msgr2=0x7f1acc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1acc06af00 0x7f1acc06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00c8990 tx=0x7f1ad0009040 comp rx=0 tx=0).stop 2023-10-16T13:39:43.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 msgr2=0x7f1ae0156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae0156350 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c520 tx=0x7f1ad400c8e0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 shutdown_connections 2023-10-16T13:39:43.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1acc06af00 0x7f1acc06d3c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ae015e2f0 0x7f1ae01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae006af50 0x7f1ae0156350 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 --2- 172.21.15.5:0/2462033982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ae00cd950 0x7f1ae0160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.233+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 >> 172.21.15.5:0/2462033982 conn(0x7f1ae006dae0 msgr2=0x7f1ae01e85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:43.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.234+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 shutdown_connections 2023-10-16T13:39:43.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.234+0000 7f1ae6425700 1 -- 172.21.15.5:0/2462033982 wait complete. 2023-10-16T13:39:43.251 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:39:43.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:39:43.297 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:39:43.340 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:39:43.341 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:43.341 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:43.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:43.361 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:43.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:43.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.592+0000 7f5986d6b700 1 Processor -- start 2023-10-16T13:39:43.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.592+0000 7f5986d6b700 1 -- start start 2023-10-16T13:39:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5986d6b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f598015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5986d6b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598015e7a0 con 0x7f59800cfe30 2023-10-16T13:39:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5986d6b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598015f730 con 0x7f59800b1f50 2023-10-16T13:39:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5986d6b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800b29a0 con 0x7f598015ab10 2023-10-16T13:39:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5985308700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59800cfe30 0x7f59800cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54128/0 (socket says 172.21.15.5:54128) 2023-10-16T13:39:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5985308700 1 -- 172.21.15.5:0/1469987987 learned_addr learned my addr 172.21.15.5:0/1469987987 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52416023 0 0) 0x7f598015e7a0 con 0x7f59800cfe30 2023-10-16T13:39:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f5984b07700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f598015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.593+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59700057c0 con 0x7f59800cfe30 2023-10-16T13:39:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913677865 0 0) 0x7f59700057c0 con 0x7f59800cfe30 2023-10-16T13:39:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 msgr2=0x7f598015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f598015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 >> v1:172.21.15.112:6789/0 conn(0x7f59800b1f50 legacy=0x7f59800cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800b2c80 con 0x7f59800cfe30 2023-10-16T13:39:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f59780019f0 con 0x7f59800cfe30 2023-10-16T13:39:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 >> v1:172.21.15.5:6789/0 conn(0x7f59800cfe30 legacy=0x7f59800cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5970005c40 0x7f5970006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f5970006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5970006fa0 0x7f5970007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800b29a0 con 0x7f5970005c40 2023-10-16T13:39:43.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597000dc20 con 0x7f5970006fa0 2023-10-16T13:39:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597000dde0 con 0x7f598015ab10 2023-10-16T13:39:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5970005c40 0x7f5970006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5985308700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5970006fa0 0x7f5970007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597ffff700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f5970006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 -- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 msgr2=0x7f5970006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f5970006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 -- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5970006fa0 msgr2=0x7f5970007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5970006fa0 0x7f5970007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 -- 172.21.15.5:0/1469987987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59700057c0 con 0x7f5970005c40 2023-10-16T13:39:43.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597ffff700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f598015ab10 0x7f5970006a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f5984b07700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5970005c40 0x7f5970006020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5974009b40 tx=0x7f5970007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2eba75b2ec5ac34 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.594+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400e6c0 con 0x7f5970005c40 2023-10-16T13:39:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400e820 con 0x7f5970005c40 2023-10-16T13:39:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f597f7fe700 1 -- 172.21.15.5:0/1469987987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400ebd0 con 0x7f5970005c40 2023-10-16T13:39:43.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5986d6b700 1 -- 172.21.15.5:0/1469987987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5970005c40 msgr2=0x7f5970006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5986d6b700 1 --2- 172.21.15.5:0/1469987987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5970005c40 0x7f5970006020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5974009b40 tx=0x7f5970007a90 comp rx=0 tx=0).stop 2023-10-16T13:39:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5985308700 1 -- 172.21.15.5:0/1469987987 reap_dead start 2023-10-16T13:39:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5986d6b700 1 -- 172.21.15.5:0/1469987987 shutdown_connections 2023-10-16T13:39:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5986d6b700 1 -- 172.21.15.5:0/1469987987 >> 172.21.15.5:0/1469987987 conn(0x7f598006dae0 msgr2=0x7f598006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5986d6b700 1 -- 172.21.15.5:0/1469987987 shutdown_connections 2023-10-16T13:39:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.595+0000 7f5986d6b700 1 -- 172.21.15.5:0/1469987987 wait complete. 2023-10-16T13:39:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.596+0000 7f5986d6b700 1 Processor -- start 2023-10-16T13:39:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.596+0000 7f5986d6b700 1 -- start start 2023-10-16T13:39:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5986d6b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5970005c40 0x7f59801f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5986d6b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f4990 0x7f59800aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5986d6b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 0x7f59800b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5986d6b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800ad7f0 con 0x7f59800b02f0 2023-10-16T13:39:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5986d6b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800b0cb0 con 0x7f59801f4990 2023-10-16T13:39:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5986d6b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59801f6b90 con 0x7f5970005c40 2023-10-16T13:39:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5985308700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 0x7f59800b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5985308700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 0x7f59800b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44134/0 (socket says 172.21.15.5:44134) 2023-10-16T13:39:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.597+0000 7f5985308700 1 -- 172.21.15.5:0/2716060042 learned_addr learned my addr 172.21.15.5:0/2716060042 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5984b07700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5970005c40 0x7f59801f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f597ffff700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f4990 0x7f59800aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5985308700 1 -- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5970005c40 msgr2=0x7f59801f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5985308700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5970005c40 0x7f59801f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5985308700 1 -- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f4990 msgr2=0x7f59800aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5985308700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f4990 0x7f59800aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5985308700 1 -- 172.21.15.5:0/2716060042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800acc70 con 0x7f59800b02f0 2023-10-16T13:39:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5985308700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 0x7f59800b0770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5978002230 tx=0x7f597800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800ae10 con 0x7f59800b02f0 2023-10-16T13:39:43.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780133f0 con 0x7f59800b02f0 2023-10-16T13:39:43.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59800acf50 con 0x7f59800b02f0 2023-10-16T13:39:43.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59780137a0 con 0x7f59800b02f0 2023-10-16T13:39:43.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.598+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59800ad510 con 0x7f59800b02f0 2023-10-16T13:39:43.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.599+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59800aea50 con 0x7f59800b02f0 2023-10-16T13:39:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.599+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5978013900 con 0x7f59800b02f0 2023-10-16T13:39:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.600+0000 7f597d7fa700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f596406af00 0x7f596406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.600+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f597808a220 con 0x7f59800b02f0 2023-10-16T13:39:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.600+0000 7f5984b07700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f596406af00 0x7f596406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.601+0000 7f5984b07700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f596406af00 0x7f596406d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f59740090b0 tx=0x7f597401e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.605+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5978055300 con 0x7f59800b02f0 2023-10-16T13:39:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.808+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f598015dd00 con 0x7f59800b02f0 2023-10-16T13:39:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.809+0000 7f597d7fa700 1 -- 172.21.15.5:0/2716060042 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16628 (secure 0 0 0) 0x7f5978058920 con 0x7f59800b02f0 2023-10-16T13:39:43.812 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:43.812 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:43.224207+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1052521879":"2023-10-17T13:39:40.217218+0000","172.21.15.112:6835/1052521879":"2023-10-17T13:39:40.217218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f596406af00 msgr2=0x7f596406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f596406af00 0x7f596406d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f59740090b0 tx=0x7f597401e040 comp rx=0 tx=0).stop 2023-10-16T13:39:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 msgr2=0x7f59800b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 0x7f59800b0770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5978002230 tx=0x7f597800a640 comp rx=0 tx=0).stop 2023-10-16T13:39:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 shutdown_connections 2023-10-16T13:39:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59800b02f0 0x7f59800b0770 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f596406af00 0x7f596406d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5970005c40 0x7f59801f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 --2- 172.21.15.5:0/2716060042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59801f4990 0x7f59800aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 >> 172.21.15.5:0/2716060042 conn(0x7f598006dae0 msgr2=0x7f59800727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 shutdown_connections 2023-10-16T13:39:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.812+0000 7f5986d6b700 1 -- 172.21.15.5:0/2716060042 wait complete. 2023-10-16T13:39:43.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:39:18.336237+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:39:19.288524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:43.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.954+0000 7fc32d682700 1 Processor -- start 2023-10-16T13:39:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.954+0000 7fc32d682700 1 -- start start 2023-10-16T13:39:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc32d682700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc32815dbc0 0x7fc32815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc32d682700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc3280d3fc0 0x7fc3280d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc32d682700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280b7050 0x7fc3280d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc32d682700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32815e4e0 con 0x7fc32815dbc0 2023-10-16T13:39:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc32d682700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280b7560 con 0x7fc3280d3fc0 2023-10-16T13:39:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc32d682700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b7840 con 0x7fc3280b7050 2023-10-16T13:39:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc32815dbc0 0x7fc32815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc32815dbc0 0x7fc32815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44138/0 (socket says 172.21.15.5:44138) 2023-10-16T13:39:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 -- 172.21.15.5:0/3535460507 learned_addr learned my addr 172.21.15.5:0/3535460507 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc3267fc700 1 --2- 172.21.15.5:0/3535460507 >> v2:172.21.15.112:3300/0 conn(0x7fc3280d3fc0 0x7fc3280d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc3277fe700 1 --2- 172.21.15.5:0/3535460507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280b7050 0x7fc3280d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 -- 172.21.15.5:0/3535460507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280b7050 msgr2=0x7fc3280d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 --2- 172.21.15.5:0/3535460507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280b7050 0x7fc3280d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 -- 172.21.15.5:0/3535460507 >> v2:172.21.15.112:3300/0 conn(0x7fc3280d3fc0 msgr2=0x7fc3280d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 --2- 172.21.15.5:0/3535460507 >> v2:172.21.15.112:3300/0 conn(0x7fc3280d3fc0 0x7fc3280d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 -- 172.21.15.5:0/3535460507 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280b7b20 con 0x7fc32815dbc0 2023-10-16T13:39:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc326ffd700 1 --2- 172.21.15.5:0/3535460507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc32815dbc0 0x7fc32815dfa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc3280d14e0 tx=0x7fc318009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6c570ee5e13c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc325ffb700 1 -- 172.21.15.5:0/3535460507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318005e30 con 0x7fc32815dbc0 2023-10-16T13:39:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.955+0000 7fc325ffb700 1 -- 172.21.15.5:0/3535460507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318004030 con 0x7fc32815dbc0 2023-10-16T13:39:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc325ffb700 1 -- 172.21.15.5:0/3535460507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180043e0 con 0x7fc32815dbc0 2023-10-16T13:39:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 -- 172.21.15.5:0/3535460507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc32815dbc0 msgr2=0x7fc32815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 --2- 172.21.15.5:0/3535460507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc32815dbc0 0x7fc32815dfa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc3280d14e0 tx=0x7fc318009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 -- 172.21.15.5:0/3535460507 shutdown_connections 2023-10-16T13:39:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 --2- 172.21.15.5:0/3535460507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280b7050 0x7fc3280d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 --2- 172.21.15.5:0/3535460507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc32815dbc0 0x7fc32815dfa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 --2- 172.21.15.5:0/3535460507 >> v2:172.21.15.112:3300/0 conn(0x7fc3280d3fc0 0x7fc3280d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 -- 172.21.15.5:0/3535460507 >> 172.21.15.5:0/3535460507 conn(0x7fc32809cb40 msgr2=0x7fc3280d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 -- 172.21.15.5:0/3535460507 shutdown_connections 2023-10-16T13:39:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.956+0000 7fc32d682700 1 -- 172.21.15.5:0/3535460507 wait complete. 2023-10-16T13:39:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.957+0000 7fc32d682700 1 Processor -- start 2023-10-16T13:39:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 -- start start 2023-10-16T13:39:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 0x7fc32815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280d3fc0 0x7fc3281e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc32815dbc0 0x7fc32806c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32815b400 con 0x7fc3280b7050 2023-10-16T13:39:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281e8090 con 0x7fc32815dbc0 2023-10-16T13:39:43.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc32d682700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281e7480 con 0x7fc3280d3fc0 2023-10-16T13:39:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc326ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 0x7fc32815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc326ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 0x7fc32815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44144/0 (socket says 172.21.15.5:44144) 2023-10-16T13:39:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc326ffd700 1 -- 172.21.15.5:0/4173628686 learned_addr learned my addr 172.21.15.5:0/4173628686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.958+0000 7fc3267fc700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280d3fc0 0x7fc3281e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc3277fe700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc32815dbc0 0x7fc32806c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc326ffd700 1 -- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280d3fc0 msgr2=0x7fc3281e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc326ffd700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280d3fc0 0x7fc3281e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc326ffd700 1 -- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc32815dbc0 msgr2=0x7fc32806c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc326ffd700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc32815dbc0 0x7fc32806c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc326ffd700 1 -- 172.21.15.5:0/4173628686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009500 con 0x7fc3280b7050 2023-10-16T13:39:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc326ffd700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 0x7fc32815aec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc32806b4b0 tx=0x7fc318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318003bb0 con 0x7fc3280b7050 2023-10-16T13:39:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318003d10 con 0x7fc3280b7050 2023-10-16T13:39:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801c660 con 0x7fc3280b7050 2023-10-16T13:39:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3281e7760 con 0x7fc3280b7050 2023-10-16T13:39:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.959+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281e7d20 con 0x7fc3280b7050 2023-10-16T13:39:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.960+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3280b5a00 con 0x7fc3280b7050 2023-10-16T13:39:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.960+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc31801c7c0 con 0x7fc3280b7050 2023-10-16T13:39:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.961+0000 7fc30f7fe700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc31406af00 0x7fc31406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.961+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc31808a3a0 con 0x7fc3280b7050 2023-10-16T13:39:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.961+0000 7fc3267fc700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc31406af00 0x7fc31406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.962+0000 7fc3267fc700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc31406af00 0x7fc31406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc3280a15e0 tx=0x7fc31c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:43.966+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc318055480 con 0x7fc3280b7050 2023-10-16T13:39:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.166+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc32804ebb0 con 0x7fc3280b7050 2023-10-16T13:39:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.166+0000 7fc30f7fe700 1 -- 172.21.15.5:0/4173628686 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc318058aa0 con 0x7fc3280b7050 2023-10-16T13:39:44.169 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc31406af00 msgr2=0x7fc31406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc31406af00 0x7fc31406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc3280a15e0 tx=0x7fc31c009210 comp rx=0 tx=0).stop 2023-10-16T13:39:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 msgr2=0x7fc32815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 0x7fc32815aec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc32806b4b0 tx=0x7fc318004750 comp rx=0 tx=0).stop 2023-10-16T13:39:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 shutdown_connections 2023-10-16T13:39:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc32815dbc0 0x7fc32806c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3280b7050 0x7fc32815aec0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc31406af00 0x7fc31406d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 --2- 172.21.15.5:0/4173628686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3280d3fc0 0x7fc3281e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 >> 172.21.15.5:0/4173628686 conn(0x7fc32809cb40 msgr2=0x7fc3280b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 shutdown_connections 2023-10-16T13:39:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.168+0000 7fc32d682700 1 -- 172.21.15.5:0/4173628686 wait complete. 2023-10-16T13:39:44.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.312+0000 7f0fc3b13700 1 Processor -- start 2023-10-16T13:39:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.312+0000 7f0fc3b13700 1 -- start start 2023-10-16T13:39:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc3b13700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0fbc0ae6c0 0x7f0fbc0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc3b13700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0b29d0 con 0x7f0fbc0b3f70 2023-10-16T13:39:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc3b13700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0b2cb0 con 0x7f0fbc0aeaa0 2023-10-16T13:39:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc3b13700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0b2f90 con 0x7f0fbc0ae6c0 2023-10-16T13:39:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc20b0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fbc0b3f70 0x7f0fbc15e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54158/0 (socket says 172.21.15.5:54158) 2023-10-16T13:39:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc20b0700 1 -- 172.21.15.5:0/3023484657 learned_addr learned my addr 172.21.15.5:0/3023484657 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.313+0000 7f0fc18af700 1 --2- 172.21.15.5:0/3023484657 >> v2:172.21.15.112:3300/0 conn(0x7f0fbc0ae6c0 0x7f0fbc0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc08ad700 1 -- 172.21.15.5:0/3023484657 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193481540 0 0) 0x7f0fbc0b29d0 con 0x7f0fbc0b3f70 2023-10-16T13:39:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc08ad700 1 -- 172.21.15.5:0/3023484657 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa80035b0 con 0x7f0fbc0b3f70 2023-10-16T13:39:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc18af700 1 -- 172.21.15.5:0/3023484657 >> v1:172.21.15.112:6789/0 conn(0x7f0fbc0aeaa0 legacy=0x7f0fbc0cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc08ad700 1 -- 172.21.15.5:0/3023484657 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083406260 0 0) 0x7f0fa80035b0 con 0x7f0fbc0b3f70 2023-10-16T13:39:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc18af700 1 -- 172.21.15.5:0/3023484657 >> v1:172.21.15.5:6789/0 conn(0x7f0fbc0b3f70 legacy=0x7f0fbc15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc18af700 1 -- 172.21.15.5:0/3023484657 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0b3270 con 0x7f0fbc0ae6c0 2023-10-16T13:39:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc18af700 1 --2- 172.21.15.5:0/3023484657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc0cda10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009840 tx=0x7f0fac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92282dec4f1fad54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc08ad700 1 -- 172.21.15.5:0/3023484657 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40019f0 con 0x7f0fbc0ae6c0 2023-10-16T13:39:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc08ad700 1 -- 172.21.15.5:0/3023484657 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac004030 con 0x7f0fbc0ae6c0 2023-10-16T13:39:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.314+0000 7f0fc08ad700 1 -- 172.21.15.5:0/3023484657 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0043c0 con 0x7f0fbc0ae6c0 2023-10-16T13:39:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 -- 172.21.15.5:0/3023484657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 msgr2=0x7f0fbc0cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/3023484657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc0cda10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009840 tx=0x7f0fac009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 -- 172.21.15.5:0/3023484657 shutdown_connections 2023-10-16T13:39:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/3023484657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc0cda10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 -- 172.21.15.5:0/3023484657 >> 172.21.15.5:0/3023484657 conn(0x7f0fbc06ac60 msgr2=0x7f0fbc06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 -- 172.21.15.5:0/3023484657 shutdown_connections 2023-10-16T13:39:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.315+0000 7f0fc3b13700 1 -- 172.21.15.5:0/3023484657 wait complete. 2023-10-16T13:39:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.316+0000 7f0fc3b13700 1 Processor -- start 2023-10-16T13:39:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.316+0000 7f0fc3b13700 1 -- start start 2023-10-16T13:39:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc3b13700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc3b13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 0x7f0fbc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc3b13700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0fbc15d580 0x7f0fbc1f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc3b13700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc15da00 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc3b13700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c5040 con 0x7f0fbc0ae6c0 2023-10-16T13:39:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc3b13700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c2fe0 con 0x7f0fbc15d580 2023-10-16T13:39:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 0x7f0fbc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 0x7f0fbc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44158/0 (socket says 172.21.15.5:44158) 2023-10-16T13:39:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 -- 172.21.15.5:0/2394416929 learned_addr learned my addr 172.21.15.5:0/2394416929 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc18af700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc20b0700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0fbc15d580 0x7f0fbc1f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 -- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0fbc15d580 msgr2=0x7f0fbc1f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0fbc15d580 0x7f0fbc1f00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 -- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 msgr2=0x7f0fbc14cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc14cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 -- 172.21.15.5:0/2394416929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0094a0 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.317+0000 7f0fc10ae700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 0x7f0fbc15d040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c750 tx=0x7f0fb800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.318+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80054e0 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.318+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8003680 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.318+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc0c32c0 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.318+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8003a30 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.318+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0c4c60 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.319+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc0c4e20 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.319+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0fb8003b90 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.320+0000 7f0fb27fc700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0fa006af00 0x7f0fa006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.320+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0fb8088e70 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.320+0000 7f0fc18af700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0fa006af00 0x7f0fa006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.321+0000 7f0fc18af700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0fa006af00 0x7f0fa006d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009b90 tx=0x7f0fac008000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.324+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fb8054030 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.525+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0fbc04ebb0 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.526+0000 7f0fb27fc700 1 -- 172.21.15.5:0/2394416929 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0fb8017020 con 0x7f0fbc0ccd70 2023-10-16T13:39:44.529 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0fa006af00 msgr2=0x7f0fa006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0fa006af00 0x7f0fa006d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009b90 tx=0x7f0fac008000 comp rx=0 tx=0).stop 2023-10-16T13:39:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 msgr2=0x7f0fbc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 0x7f0fbc15d040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c750 tx=0x7f0fb800ca60 comp rx=0 tx=0).stop 2023-10-16T13:39:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 shutdown_connections 2023-10-16T13:39:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0fa006af00 0x7f0fa006d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0fbc15d580 0x7f0fbc1f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fbc0ae6c0 0x7f0fbc14cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 --2- 172.21.15.5:0/2394416929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fbc0ccd70 0x7f0fbc15d040 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 >> 172.21.15.5:0/2394416929 conn(0x7f0fbc06ac60 msgr2=0x7f0fbc0af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 shutdown_connections 2023-10-16T13:39:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.528+0000 7f0fc3b13700 1 -- 172.21.15.5:0/2394416929 wait complete. 2023-10-16T13:39:44.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.669+0000 7ffb54a85700 1 Processor -- start 2023-10-16T13:39:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.669+0000 7ffb54a85700 1 -- start start 2023-10-16T13:39:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb54a85700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 0x7ffb5015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb54a85700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb500b1f50 0x7ffb500cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb54a85700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5015e7a0 con 0x7ffb500b23d0 2023-10-16T13:39:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb54a85700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5015f730 con 0x7ffb500b1f50 2023-10-16T13:39:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb54a85700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b29a0 con 0x7ffb5015ab10 2023-10-16T13:39:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb4ed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb500b23d0 0x7ffb500cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54172/0 (socket says 172.21.15.5:54172) 2023-10-16T13:39:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb4ed9d700 1 -- 172.21.15.5:0/2301842622 learned_addr learned my addr 172.21.15.5:0/2301842622 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb4e59c700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 0x7ffb5015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb4dd9b700 1 --2- 172.21.15.5:0/2301842622 >> v2:172.21.15.112:3300/0 conn(0x7ffb500b1f50 0x7ffb500cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933758632 0 0) 0x7ffb5015e7a0 con 0x7ffb500b23d0 2023-10-16T13:39:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.670+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb380035b0 con 0x7ffb500b23d0 2023-10-16T13:39:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1896498251 0 0) 0x7ffb380035b0 con 0x7ffb500b23d0 2023-10-16T13:39:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 msgr2=0x7ffb5015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 0x7ffb5015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 >> v2:172.21.15.112:3300/0 conn(0x7ffb500b1f50 msgr2=0x7ffb500cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 --2- 172.21.15.5:0/2301842622 >> v2:172.21.15.112:3300/0 conn(0x7ffb500b1f50 0x7ffb500cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500b2c80 con 0x7ffb500b23d0 2023-10-16T13:39:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7ffb480019f0 con 0x7ffb500b23d0 2023-10-16T13:39:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 >> v1:172.21.15.5:6789/0 conn(0x7ffb500b23d0 legacy=0x7ffb500cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 0x7ffb38003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38003f80 0x7ffb38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38004d90 0x7ffb38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5015f730 con 0x7ffb38003f80 2023-10-16T13:39:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b29a0 con 0x7ffb38004d90 2023-10-16T13:39:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3800ba10 con 0x7ffb5015ab10 2023-10-16T13:39:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38003f80 0x7ffb38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4e59c700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 0x7ffb38003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4ed9d700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38004d90 0x7ffb38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 -- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 msgr2=0x7ffb38003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb5015ab10 0x7ffb38003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 -- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38004d90 msgr2=0x7ffb38005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38004d90 0x7ffb38005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 -- 172.21.15.5:0/2301842622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380035b0 con 0x7ffb38003f80 2023-10-16T13:39:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4ed9d700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38004d90 0x7ffb38005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4dd9b700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38003f80 0x7ffb38004850 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000bde0 tx=0x7ffb38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22f4b7e95514836 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40010d50 con 0x7ffb38003f80 2023-10-16T13:39:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40010eb0 con 0x7ffb38003f80 2023-10-16T13:39:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.671+0000 7ffb4d59a700 1 -- 172.21.15.5:0/2301842622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40005c20 con 0x7ffb38003f80 2023-10-16T13:39:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb54a85700 1 -- 172.21.15.5:0/2301842622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38003f80 msgr2=0x7ffb38004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb54a85700 1 --2- 172.21.15.5:0/2301842622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38003f80 0x7ffb38004850 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000bde0 tx=0x7ffb38005880 comp rx=0 tx=0).stop 2023-10-16T13:39:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb4ed9d700 1 -- 172.21.15.5:0/2301842622 reap_dead start 2023-10-16T13:39:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb54a85700 1 -- 172.21.15.5:0/2301842622 shutdown_connections 2023-10-16T13:39:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb54a85700 1 -- 172.21.15.5:0/2301842622 >> 172.21.15.5:0/2301842622 conn(0x7ffb5006dae0 msgr2=0x7ffb5006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb54a85700 1 -- 172.21.15.5:0/2301842622 shutdown_connections 2023-10-16T13:39:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.672+0000 7ffb54a85700 1 -- 172.21.15.5:0/2301842622 wait complete. 2023-10-16T13:39:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.673+0000 7ffb54a85700 1 Processor -- start 2023-10-16T13:39:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.673+0000 7ffb54a85700 1 -- start start 2023-10-16T13:39:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb54a85700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38003f80 0x7ffb500c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb54a85700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb500c93d0 0x7ffb501579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb54a85700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 0x7ffb500cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb54a85700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500d00e0 con 0x7ffb500cf720 2023-10-16T13:39:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb54a85700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500c4000 con 0x7ffb38003f80 2023-10-16T13:39:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb54a85700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500c4250 con 0x7ffb500c93d0 2023-10-16T13:39:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb4ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 0x7ffb500cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb4ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 0x7ffb500cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44180/0 (socket says 172.21.15.5:44180) 2023-10-16T13:39:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb4ed9d700 1 -- 172.21.15.5:0/1036197066 learned_addr learned my addr 172.21.15.5:0/1036197066 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb4dd9b700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb500c93d0 0x7ffb501579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.674+0000 7ffb4e59c700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38003f80 0x7ffb500c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb4ed9d700 1 -- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb500c93d0 msgr2=0x7ffb501579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb4ed9d700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb500c93d0 0x7ffb501579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb4ed9d700 1 -- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38003f80 msgr2=0x7ffb500c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb4ed9d700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38003f80 0x7ffb500c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb4ed9d700 1 -- 172.21.15.5:0/1036197066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500c4530 con 0x7ffb500cf720 2023-10-16T13:39:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb4ed9d700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 0x7ffb500cfba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffb48001330 tx=0x7ffb4800e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480019d0 con 0x7ffb500cf720 2023-10-16T13:39:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4800ede0 con 0x7ffb500cf720 2023-10-16T13:39:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48013660 con 0x7ffb500cf720 2023-10-16T13:39:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb500c4810 con 0x7ffb500cf720 2023-10-16T13:39:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.675+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb501f03d0 con 0x7ffb500cf720 2023-10-16T13:39:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.676+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb500c4d30 con 0x7ffb500cf720 2023-10-16T13:39:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.677+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb480137c0 con 0x7ffb500cf720 2023-10-16T13:39:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.677+0000 7ffb3effd700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb3006af30 0x7ffb3006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.677+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ffb48089af0 con 0x7ffb500cf720 2023-10-16T13:39:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.677+0000 7ffb4e59c700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb3006af30 0x7ffb3006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.678+0000 7ffb4e59c700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb3006af30 0x7ffb3006d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009b80 tx=0x7ffb44009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.682+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb500c4d30 con 0x7ffb500cf720 2023-10-16T13:39:44.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.882+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb500c4d30 con 0x7ffb500cf720 2023-10-16T13:39:44.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.883+0000 7ffb3effd700 1 -- 172.21.15.5:0/1036197066 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb500c4d30 con 0x7ffb500cf720 2023-10-16T13:39:44.886 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb3006af30 msgr2=0x7ffb3006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb3006af30 0x7ffb3006d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009b80 tx=0x7ffb44009210 comp rx=0 tx=0).stop 2023-10-16T13:39:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 msgr2=0x7ffb500cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 0x7ffb500cfba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffb48001330 tx=0x7ffb4800e670 comp rx=0 tx=0).stop 2023-10-16T13:39:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 shutdown_connections 2023-10-16T13:39:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cf720 0x7ffb500cfba0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb38003f80 0x7ffb500c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb3006af30 0x7ffb3006d3f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 --2- 172.21.15.5:0/1036197066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb500c93d0 0x7ffb501579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 >> 172.21.15.5:0/1036197066 conn(0x7ffb5006dae0 msgr2=0x7ffb500cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 shutdown_connections 2023-10-16T13:39:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:44.885+0000 7ffb54a85700 1 -- 172.21.15.5:0/1036197066 wait complete. 2023-10-16T13:39:44.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:39:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.024+0000 7f0a778b4700 1 Processor -- start 2023-10-16T13:39:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.025+0000 7f0a778b4700 1 -- start start 2023-10-16T13:39:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.025+0000 7f0a778b4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.025+0000 7f0a778b4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 0x7f0a700cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.025+0000 7f0a778b4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a700cef60 con 0x7f0a7015a280 2023-10-16T13:39:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.025+0000 7f0a778b4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a70072200 con 0x7f0a700ce5f0 2023-10-16T13:39:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.025+0000 7f0a778b4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700cf1d0 con 0x7f0a7006daa0 2023-10-16T13:39:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a75e51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 0x7f0a700cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a75650700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0a7015a280 0x7f0a7006d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45164/0 (socket says 172.21.15.5:45164) 2023-10-16T13:39:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:42090/0 (socket says 172.21.15.5:42090) 2023-10-16T13:39:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a75e51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 0x7f0a700cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:40082/0 (socket says 172.21.15.5:40082) 2023-10-16T13:39:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a75650700 1 -- 172.21.15.5:0/2323812360 learned_addr learned my addr 172.21.15.5:0/2323812360 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 -- 172.21.15.5:0/2323812360 >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 msgr2=0x7f0a700cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 --2- 172.21.15.5:0/2323812360 >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 0x7f0a700cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 -- 172.21.15.5:0/2323812360 >> v1:172.21.15.112:6789/0 conn(0x7f0a7015a280 legacy=0x7f0a7006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 -- 172.21.15.5:0/2323812360 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700cafb0 con 0x7f0a7006daa0 2023-10-16T13:39:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a75e51700 1 --2- 172.21.15.5:0/2323812360 >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 0x7f0a700cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.026+0000 7f0a74e4f700 1 --2- 172.21.15.5:0/2323812360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700cbd70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009840 tx=0x7f0a6c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c10dda3264abfef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a63fff700 1 -- 172.21.15.5:0/2323812360 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011830 con 0x7f0a7006daa0 2023-10-16T13:39:45.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a63fff700 1 -- 172.21.15.5:0/2323812360 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c011990 con 0x7f0a7006daa0 2023-10-16T13:39:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a63fff700 1 -- 172.21.15.5:0/2323812360 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011d20 con 0x7f0a7006daa0 2023-10-16T13:39:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 -- 172.21.15.5:0/2323812360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 msgr2=0x7f0a700cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 --2- 172.21.15.5:0/2323812360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700cbd70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009840 tx=0x7f0a6c009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 -- 172.21.15.5:0/2323812360 shutdown_connections 2023-10-16T13:39:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 --2- 172.21.15.5:0/2323812360 >> v2:172.21.15.112:3300/0 conn(0x7f0a700ce5f0 0x7f0a700cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 --2- 172.21.15.5:0/2323812360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700cbd70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 -- 172.21.15.5:0/2323812360 >> 172.21.15.5:0/2323812360 conn(0x7f0a700cfc40 msgr2=0x7f0a700d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 -- 172.21.15.5:0/2323812360 shutdown_connections 2023-10-16T13:39:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.027+0000 7f0a778b4700 1 -- 172.21.15.5:0/2323812360 wait complete. 2023-10-16T13:39:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.028+0000 7f0a778b4700 1 Processor -- start 2023-10-16T13:39:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 -- start start 2023-10-16T13:39:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a700ce5f0 0x7f0a70156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 0x7f0a70151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70156e30 con 0x7f0a7015a280 2023-10-16T13:39:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70156b50 con 0x7f0a700ce5f0 2023-10-16T13:39:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a778b4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70154500 con 0x7f0a7006daa0 2023-10-16T13:39:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a75e51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 0x7f0a70151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a75e51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 0x7f0a70151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44194/0 (socket says 172.21.15.5:44194) 2023-10-16T13:39:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.029+0000 7f0a75e51700 1 -- 172.21.15.5:0/902213795 learned_addr learned my addr 172.21.15.5:0/902213795 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a74e4f700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a700ce5f0 0x7f0a70156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75650700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75e51700 1 -- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 msgr2=0x7f0a700c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75e51700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75e51700 1 -- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a700ce5f0 msgr2=0x7f0a70156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75e51700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a700ce5f0 0x7f0a70156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75e51700 1 -- 172.21.15.5:0/902213795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6800bc80 con 0x7f0a7015a280 2023-10-16T13:39:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75650700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a75e51700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 0x7f0a70151560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e160 tx=0x7f0a6800e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68019070 con 0x7f0a7015a280 2023-10-16T13:39:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68011040 con 0x7f0a7015a280 2023-10-16T13:39:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c0094a0 con 0x7f0a7015a280 2023-10-16T13:39:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68010050 con 0x7f0a7015a280 2023-10-16T13:39:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.030+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a70154ac0 con 0x7f0a7015a280 2023-10-16T13:39:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.031+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a70067d20 con 0x7f0a7015a280 2023-10-16T13:39:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.032+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a6800eb20 con 0x7f0a7015a280 2023-10-16T13:39:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.032+0000 7f0a61ffb700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a5406af00 0x7f0a5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.032+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0a6808b560 con 0x7f0a7015a280 2023-10-16T13:39:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.032+0000 7f0a75650700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a5406af00 0x7f0a5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.033+0000 7f0a75650700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a5406af00 0x7f0a5406d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007fd0 tx=0x7f0a64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.037+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a680565b0 con 0x7f0a7015a280 2023-10-16T13:39:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.253+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0a7006d530 con 0x7f0a7015a280 2023-10-16T13:39:45.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.253+0000 7f0a61ffb700 1 -- 172.21.15.5:0/902213795 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) v1 ==== 80+0+124 (secure 0 0 0) 0x7f0a68059bd0 con 0x7f0a7015a280 2023-10-16T13:39:45.257 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6837/1052521879 2023-10-17T13:39:40.217218+0000 2023-10-16T13:39:45.257 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6835/1052521879 2023-10-17T13:39:40.217218+0000 2023-10-16T13:39:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a5406af00 msgr2=0x7f0a5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a5406af00 0x7f0a5406d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007fd0 tx=0x7f0a64009040 comp rx=0 tx=0).stop 2023-10-16T13:39:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 msgr2=0x7f0a70151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 0x7f0a70151560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e160 tx=0x7f0a6800e470 comp rx=0 tx=0).stop 2023-10-16T13:39:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 shutdown_connections 2023-10-16T13:39:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015a280 0x7f0a70151560 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a5406af00 0x7f0a5406d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a7006daa0 0x7f0a700c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 --2- 172.21.15.5:0/902213795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a700ce5f0 0x7f0a70156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 >> 172.21.15.5:0/902213795 conn(0x7f0a700cfc40 msgr2=0x7f0a700c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 shutdown_connections 2023-10-16T13:39:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.256+0000 7f0a778b4700 1 -- 172.21.15.5:0/902213795 wait complete. 2023-10-16T13:39:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2023-10-16T13:39:45.271 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:39:45.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:45.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:39:45.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:39:45.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:45.319 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:39:45.336 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:45.337 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:45.358 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:45.359 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:45.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.542+0000 7f1140f54700 1 Processor -- start 2023-10-16T13:39:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.542+0000 7f1140f54700 1 -- start start 2023-10-16T13:39:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1140f54700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f113c0cd950 0x7f113c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1140f54700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f113c06a840 0x7f113c06ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1140f54700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c0cf290 con 0x7f113c0cede0 2023-10-16T13:39:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1140f54700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c1619a0 con 0x7f113c06a840 2023-10-16T13:39:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1140f54700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c06b1b0 con 0x7f113c0cd950 2023-10-16T13:39:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f113c06a840 0x7f113c06ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1139d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f113c0cede0 0x7f113c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54204/0 (socket says 172.21.15.5:54204) 2023-10-16T13:39:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f1139d9b700 1 -- 172.21.15.5:0/1706566960 learned_addr learned my addr 172.21.15.5:0/1706566960 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113a59c700 1 --2- 172.21.15.5:0/1706566960 >> v2:172.21.15.112:3300/0 conn(0x7f113c0cd950 0x7f113c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113959a700 1 -- 172.21.15.5:0/1706566960 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052714364 0 0) 0x7f113c0cf290 con 0x7f113c0cede0 2023-10-16T13:39:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113959a700 1 -- 172.21.15.5:0/1706566960 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11280035b0 con 0x7f113c0cede0 2023-10-16T13:39:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113ad9d700 1 -- 172.21.15.5:0/1706566960 >> v2:172.21.15.112:3300/0 conn(0x7f113c0cd950 msgr2=0x7f113c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113ad9d700 1 --2- 172.21.15.5:0/1706566960 >> v2:172.21.15.112:3300/0 conn(0x7f113c0cd950 0x7f113c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113ad9d700 1 -- 172.21.15.5:0/1706566960 >> v1:172.21.15.5:6789/0 conn(0x7f113c0cede0 legacy=0x7f113c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.543+0000 7f113ad9d700 1 -- 172.21.15.5:0/1706566960 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0b2d60 con 0x7f113c06a840 2023-10-16T13:39:45.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f113ad9d700 1 --2- 172.21.15.5:0/1706566960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c06a840 0x7f113c06ac70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f113c0d0430 tx=0x7f113400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4d1c7bb9e0cf39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f113959a700 1 -- 172.21.15.5:0/1706566960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400e070 con 0x7f113c06a840 2023-10-16T13:39:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f113959a700 1 -- 172.21.15.5:0/1706566960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113400bb20 con 0x7f113c06a840 2023-10-16T13:39:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f113959a700 1 -- 172.21.15.5:0/1706566960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134012430 con 0x7f113c06a840 2023-10-16T13:39:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 -- 172.21.15.5:0/1706566960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c06a840 msgr2=0x7f113c06ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 --2- 172.21.15.5:0/1706566960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c06a840 0x7f113c06ac70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f113c0d0430 tx=0x7f113400b330 comp rx=0 tx=0).stop 2023-10-16T13:39:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 -- 172.21.15.5:0/1706566960 shutdown_connections 2023-10-16T13:39:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 --2- 172.21.15.5:0/1706566960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c06a840 0x7f113c06ac70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 --2- 172.21.15.5:0/1706566960 >> v2:172.21.15.112:3300/0 conn(0x7f113c0cd950 0x7f113c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 -- 172.21.15.5:0/1706566960 >> 172.21.15.5:0/1706566960 conn(0x7f113c06dae0 msgr2=0x7f113c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.544+0000 7f1140f54700 1 -- 172.21.15.5:0/1706566960 shutdown_connections 2023-10-16T13:39:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.545+0000 7f1140f54700 1 -- 172.21.15.5:0/1706566960 wait complete. 2023-10-16T13:39:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.546+0000 7f1140f54700 1 Processor -- start 2023-10-16T13:39:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.546+0000 7f1140f54700 1 -- start start 2023-10-16T13:39:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f113c06a840 0x7f113c0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 0x7f113c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f113c0cede0 0x7f113c0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0b39f0 con 0x7f113c0cd950 2023-10-16T13:39:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0b3cd0 con 0x7f113c0cede0 2023-10-16T13:39:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0b3fb0 con 0x7f113c06a840 2023-10-16T13:39:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 0x7f113c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 0x7f113c0b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44206/0 (socket says 172.21.15.5:44206) 2023-10-16T13:39:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 -- 172.21.15.5:0/744188649 learned_addr learned my addr 172.21.15.5:0/744188649 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f113a59c700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f113c06a840 0x7f113c0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 -- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f113c06a840 msgr2=0x7f113c0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f113ad9d700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f113c0cede0 0x7f113c0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f113c06a840 0x7f113c0b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 -- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f113c0cede0 msgr2=0x7f113c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f113c0cede0 0x7f113c0b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 -- 172.21.15.5:0/744188649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134009a70 con 0x7f113c0cd950 2023-10-16T13:39:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1139d9b700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 0x7f113c0b0b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f112c00c4d0 tx=0x7f112c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0074e0 con 0x7f113c0cd950 2023-10-16T13:39:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c007640 con 0x7f113c0cd950 2023-10-16T13:39:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c0b4290 con 0x7f113c0cd950 2023-10-16T13:39:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c005a70 con 0x7f113c0cd950 2023-10-16T13:39:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.547+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c0b1070 con 0x7f113c0cd950 2023-10-16T13:39:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.548+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0b47b0 con 0x7f113c0cd950 2023-10-16T13:39:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.549+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f112c005bd0 con 0x7f113c0cd950 2023-10-16T13:39:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.549+0000 7f1132ffd700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f111c06af00 0x7f111c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.549+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f112c088a80 con 0x7f113c0cd950 2023-10-16T13:39:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.549+0000 7f113a59c700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f111c06af00 0x7f111c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.550+0000 7f113a59c700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f111c06af00 0x7f111c06d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1124009950 tx=0x7f1124008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.554+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f113c0b47b0 con 0x7f113c0cd950 2023-10-16T13:39:45.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.754+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113c0b47b0 con 0x7f113c0cd950 2023-10-16T13:39:45.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.755+0000 7f1132ffd700 1 -- 172.21.15.5:0/744188649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16628 (secure 0 0 0) 0x7f113c0b47b0 con 0x7f113c0cd950 2023-10-16T13:39:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:45.758 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:43.224207+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1052521879":"2023-10-17T13:39:40.217218+0000","172.21.15.112:6835/1052521879":"2023-10-17T13:39:40.217218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:45.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f111c06af00 msgr2=0x7f111c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f111c06af00 0x7f111c06d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1124009950 tx=0x7f1124008040 comp rx=0 tx=0).stop 2023-10-16T13:39:45.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 msgr2=0x7f113c0b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 0x7f113c0b0b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f112c00c4d0 tx=0x7f112c00c890 comp rx=0 tx=0).stop 2023-10-16T13:39:45.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 shutdown_connections 2023-10-16T13:39:45.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f113c0cede0 0x7f113c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f111c06af00 0x7f111c06d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f113c06a840 0x7f113c0b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 --2- 172.21.15.5:0/744188649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0cd950 0x7f113c0b0b30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.757+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 >> 172.21.15.5:0/744188649 conn(0x7f113c06dae0 msgr2=0x7f113c15c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.758+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 shutdown_connections 2023-10-16T13:39:45.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.758+0000 7f1140f54700 1 -- 172.21.15.5:0/744188649 wait complete. 2023-10-16T13:39:45.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:39:18.336237+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:39:19.288524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:45.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:45.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.899+0000 7f487d965700 1 Processor -- start 2023-10-16T13:39:45.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.899+0000 7f487d965700 1 -- start start 2023-10-16T13:39:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f487d965700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48780b2880 0x7f487806c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f487d965700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48780d0d00 con 0x7f48780b2c60 2023-10-16T13:39:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f487d965700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48780d2450 con 0x7f48780ce570 2023-10-16T13:39:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f487d965700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48780cfc60 con 0x7f48780b2880 2023-10-16T13:39:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f48767fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f48780b2c60 0x7f48780cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54218/0 (socket says 172.21.15.5:54218) 2023-10-16T13:39:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f48767fc700 1 -- 172.21.15.5:0/1642467000 learned_addr learned my addr 172.21.15.5:0/1642467000 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414548605 0 0) 0x7f48780d0d00 con 0x7f48780b2c60 2023-10-16T13:39:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f4876ffd700 1 --2- 172.21.15.5:0/1642467000 >> v2:172.21.15.112:3300/0 conn(0x7f48780b2880 0x7f487806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48600035b0 con 0x7f48780b2c60 2023-10-16T13:39:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3741385772 0 0) 0x7f48600035b0 con 0x7f48780b2c60 2023-10-16T13:39:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 >> v2:172.21.15.112:3300/0 conn(0x7f48780b2880 msgr2=0x7f487806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.900+0000 7f4875ffb700 1 --2- 172.21.15.5:0/1642467000 >> v2:172.21.15.112:3300/0 conn(0x7f48780b2880 0x7f487806c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 >> v1:172.21.15.112:6789/0 conn(0x7f48780ce570 legacy=0x7f487815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48780cff40 con 0x7f48780b2c60 2023-10-16T13:39:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f4868001670 con 0x7f48780b2c60 2023-10-16T13:39:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 >> v1:172.21.15.5:6789/0 conn(0x7f48780b2c60 legacy=0x7f48780cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f4860003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4860004850 0x7f4860004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4860005210 0x7f486000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780cfc60 con 0x7f4860003a00 2023-10-16T13:39:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486000c0c0 con 0x7f4860005210 2023-10-16T13:39:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486000c280 con 0x7f4860004850 2023-10-16T13:39:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f4860003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f48767fc700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4860004850 0x7f4860004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f48777fe700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4860005210 0x7f486000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 -- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4860004850 msgr2=0x7f4860004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4860004850 0x7f4860004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 -- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4860005210 msgr2=0x7f486000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4860005210 0x7f486000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 -- 172.21.15.5:0/1642467000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600035b0 con 0x7f4860003a00 2023-10-16T13:39:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f48777fe700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4860005210 0x7f486000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f48777fe700 1 -- 172.21.15.5:0/1642467000 reap_dead start 2023-10-16T13:39:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4876ffd700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f4860003e20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f486c009b40 tx=0x7f4860005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de09c1552cc41776 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c005a20 con 0x7f4860003a00 2023-10-16T13:39:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c005b80 con 0x7f4860003a00 2023-10-16T13:39:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.901+0000 7f4875ffb700 1 -- 172.21.15.5:0/1642467000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c00e6c0 con 0x7f4860003a00 2023-10-16T13:39:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 -- 172.21.15.5:0/1642467000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 msgr2=0x7f4860003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f4860003e20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f486c009b40 tx=0x7f4860005880 comp rx=0 tx=0).stop 2023-10-16T13:39:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 -- 172.21.15.5:0/1642467000 shutdown_connections 2023-10-16T13:39:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 --2- 172.21.15.5:0/1642467000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f4860003e20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 -- 172.21.15.5:0/1642467000 >> 172.21.15.5:0/1642467000 conn(0x7f48780d15e0 msgr2=0x7f48780d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 -- 172.21.15.5:0/1642467000 shutdown_connections 2023-10-16T13:39:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.902+0000 7f487d965700 1 -- 172.21.15.5:0/1642467000 wait complete. 2023-10-16T13:39:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.903+0000 7f487d965700 1 Processor -- start 2023-10-16T13:39:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.903+0000 7f487d965700 1 -- start start 2023-10-16T13:39:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f487d965700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f48781d8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f487d965700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780c5b00 0x7f48781f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f487d965700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48780b4e10 0x7f48780b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f487d965700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780b57d0 con 0x7f4860003a00 2023-10-16T13:39:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f487d965700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48781f43d0 con 0x7f48780c5b00 2023-10-16T13:39:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f487d965700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48780c6120 con 0x7f48780b4e10 2023-10-16T13:39:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f48781d8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f48781d8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44226/0 (socket says 172.21.15.5:44226) 2023-10-16T13:39:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 -- 172.21.15.5:0/2997092193 learned_addr learned my addr 172.21.15.5:0/2997092193 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f48777fe700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48780b4e10 0x7f48780b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f48767fc700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780c5b00 0x7f48781f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 -- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48780b4e10 msgr2=0x7f48780b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48780b4e10 0x7f48780b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 -- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780c5b00 msgr2=0x7f48781f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780c5b00 0x7f48781f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.904+0000 7f4876ffd700 1 -- 172.21.15.5:0/2997092193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48780c6400 con 0x7f4860003a00 2023-10-16T13:39:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.905+0000 7f4876ffd700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f48781d8b40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f486c000c00 tx=0x7f486c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.905+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c021070 con 0x7f4860003a00 2023-10-16T13:39:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.905+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c004240 con 0x7f4860003a00 2023-10-16T13:39:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.905+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0045d0 con 0x7f4860003a00 2023-10-16T13:39:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.905+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48780c66e0 con 0x7f4860003a00 2023-10-16T13:39:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.905+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48781e6e30 con 0x7f4860003a00 2023-10-16T13:39:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.906+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48781e6ff0 con 0x7f4860003a00 2023-10-16T13:39:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.906+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f486c0036a0 con 0x7f4860003a00 2023-10-16T13:39:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.907+0000 7f485ffff700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f486406af00 0x7f486406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.907+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f486c08a900 con 0x7f4860003a00 2023-10-16T13:39:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.907+0000 7f48767fc700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f486406af00 0x7f486406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.907+0000 7f48767fc700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f486406af00 0x7f486406d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4868001eb0 tx=0x7f4868009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:45.911+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f486c0559e0 con 0x7f4860003a00 2023-10-16T13:39:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.110+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48780c5ee0 con 0x7f4860003a00 2023-10-16T13:39:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.110+0000 7f485ffff700 1 -- 172.21.15.5:0/2997092193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48780c5ee0 con 0x7f4860003a00 2023-10-16T13:39:46.113 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f486406af00 msgr2=0x7f486406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f486406af00 0x7f486406d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4868001eb0 tx=0x7f4868009040 comp rx=0 tx=0).stop 2023-10-16T13:39:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 msgr2=0x7f48781d8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f48781d8b40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f486c000c00 tx=0x7f486c0047c0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 shutdown_connections 2023-10-16T13:39:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f486406af00 0x7f486406d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48780b4e10 0x7f48780b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4860003a00 0x7f48781d8b40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 --2- 172.21.15.5:0/2997092193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780c5b00 0x7f48781f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 >> 172.21.15.5:0/2997092193 conn(0x7f48780d15e0 msgr2=0x7f487806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:46.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 shutdown_connections 2023-10-16T13:39:46.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.112+0000 7f487d965700 1 -- 172.21.15.5:0/2997092193 wait complete. 2023-10-16T13:39:46.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.254+0000 7f68f0980700 1 Processor -- start 2023-10-16T13:39:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.254+0000 7f68f0980700 1 -- start start 2023-10-16T13:39:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68f0980700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68ec15e2f0 0x7f68ec0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68f0980700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec06a840 0x7f68ec06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68f0980700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec0b2d60 con 0x7f68ec0cd950 2023-10-16T13:39:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68f0980700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec1619a0 con 0x7f68ec15e2f0 2023-10-16T13:39:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68f0980700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec06b1f0 con 0x7f68ec06a840 2023-10-16T13:39:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68e9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68ec15e2f0 0x7f68ec0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68ea59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68ec0cd950 0x7f68ec15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54236/0 (socket says 172.21.15.5:54236) 2023-10-16T13:39:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68ea59c700 1 -- 172.21.15.5:0/3919253614 learned_addr learned my addr 172.21.15.5:0/3919253614 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68ead9d700 1 --2- 172.21.15.5:0/3919253614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec06a840 0x7f68ec06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68e9d9b700 1 -- 172.21.15.5:0/3919253614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec06a840 msgr2=0x7f68ec06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68e9d9b700 1 --2- 172.21.15.5:0/3919253614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec06a840 0x7f68ec06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68e9d9b700 1 -- 172.21.15.5:0/3919253614 >> v1:172.21.15.5:6789/0 conn(0x7f68ec0cd950 legacy=0x7f68ec15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68e9d9b700 1 -- 172.21.15.5:0/3919253614 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0cdd30 con 0x7f68ec15e2f0 2023-10-16T13:39:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.255+0000 7f68e959a700 1 -- 172.21.15.5:0/3919253614 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398596073 0 0) 0x7f68ec0b2d60 con 0x7f68ec0cd950 2023-10-16T13:39:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68e9d9b700 1 --2- 172.21.15.5:0/3919253614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec15e2f0 0x7f68ec0cede0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f68ec161ae0 tx=0x7f68dc009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b9d8a2f994be6c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68e959a700 1 -- 172.21.15.5:0/3919253614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc015070 con 0x7f68ec15e2f0 2023-10-16T13:39:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68e959a700 1 -- 172.21.15.5:0/3919253614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc005c30 con 0x7f68ec15e2f0 2023-10-16T13:39:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68e959a700 1 -- 172.21.15.5:0/3919253614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc004020 con 0x7f68ec15e2f0 2023-10-16T13:39:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68f0980700 1 -- 172.21.15.5:0/3919253614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec15e2f0 msgr2=0x7f68ec0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68f0980700 1 --2- 172.21.15.5:0/3919253614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec15e2f0 0x7f68ec0cede0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f68ec161ae0 tx=0x7f68dc009b00 comp rx=0 tx=0).stop 2023-10-16T13:39:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68f0980700 1 -- 172.21.15.5:0/3919253614 shutdown_connections 2023-10-16T13:39:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68f0980700 1 --2- 172.21.15.5:0/3919253614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec06a840 0x7f68ec06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.256+0000 7f68f0980700 1 --2- 172.21.15.5:0/3919253614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec15e2f0 0x7f68ec0cede0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.257+0000 7f68f0980700 1 -- 172.21.15.5:0/3919253614 >> 172.21.15.5:0/3919253614 conn(0x7f68ec06dae0 msgr2=0x7f68ec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.257+0000 7f68f0980700 1 -- 172.21.15.5:0/3919253614 shutdown_connections 2023-10-16T13:39:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.257+0000 7f68f0980700 1 -- 172.21.15.5:0/3919253614 wait complete. 2023-10-16T13:39:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.258+0000 7f68f0980700 1 Processor -- start 2023-10-16T13:39:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.258+0000 7f68f0980700 1 -- start start 2023-10-16T13:39:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68f0980700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 0x7f68ec0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68f0980700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68ec0cd950 0x7f68ec151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68f0980700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec15e2f0 0x7f68ec0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68f0980700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0c5490 con 0x7f68ec06a840 2023-10-16T13:39:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68f0980700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0b55d0 con 0x7f68ec0cd950 2023-10-16T13:39:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68f0980700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0b5870 con 0x7f68ec15e2f0 2023-10-16T13:39:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 0x7f68ec0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 0x7f68ec0b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44238/0 (socket says 172.21.15.5:44238) 2023-10-16T13:39:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 -- 172.21.15.5:0/2695593155 learned_addr learned my addr 172.21.15.5:0/2695593155 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ead9d700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec15e2f0 0x7f68ec0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68e9d9b700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68ec0cd950 0x7f68ec151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 -- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec15e2f0 msgr2=0x7f68ec0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec15e2f0 0x7f68ec0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 -- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68ec0cd950 msgr2=0x7f68ec151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68ec0cd950 0x7f68ec151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 -- 172.21.15.5:0/2695593155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc009430 con 0x7f68ec06a840 2023-10-16T13:39:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68e9d9b700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68ec0cd950 0x7f68ec151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ead9d700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec15e2f0 0x7f68ec0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68ea59c700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 0x7f68ec0b5090 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68e00011e0 tx=0x7f68e000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0004c80 con 0x7f68ec06a840 2023-10-16T13:39:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.259+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0004e00 con 0x7f68ec06a840 2023-10-16T13:39:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.260+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec0b5b50 con 0x7f68ec06a840 2023-10-16T13:39:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.260+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0007310 con 0x7f68ec06a840 2023-10-16T13:39:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.260+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec0c56e0 con 0x7f68ec06a840 2023-10-16T13:39:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.260+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec067d20 con 0x7f68ec06a840 2023-10-16T13:39:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.261+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f68e0007470 con 0x7f68ec06a840 2023-10-16T13:39:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.261+0000 7f68daffd700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68cc06af00 0x7f68cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.261+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f68e0089470 con 0x7f68ec06a840 2023-10-16T13:39:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.262+0000 7f68e9d9b700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68cc06af00 0x7f68cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.262+0000 7f68e9d9b700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68cc06af00 0x7f68cc06d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f68dc013040 tx=0x7f68dc008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.266+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68e00544c0 con 0x7f68ec06a840 2023-10-16T13:39:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.463+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68ec0b2630 con 0x7f68ec06a840 2023-10-16T13:39:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.463+0000 7f68daffd700 1 -- 172.21.15.5:0/2695593155 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68e0057ae0 con 0x7f68ec06a840 2023-10-16T13:39:46.466 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68cc06af00 msgr2=0x7f68cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68cc06af00 0x7f68cc06d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f68dc013040 tx=0x7f68dc008070 comp rx=0 tx=0).stop 2023-10-16T13:39:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 msgr2=0x7f68ec0b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 0x7f68ec0b5090 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68e00011e0 tx=0x7f68e000cae0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 shutdown_connections 2023-10-16T13:39:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68cc06af00 0x7f68cc06d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68ec15e2f0 0x7f68ec0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec06a840 0x7f68ec0b5090 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 --2- 172.21.15.5:0/2695593155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68ec0cd950 0x7f68ec151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 >> 172.21.15.5:0/2695593155 conn(0x7f68ec06dae0 msgr2=0x7f68ec15d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 shutdown_connections 2023-10-16T13:39:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.465+0000 7f68f0980700 1 -- 172.21.15.5:0/2695593155 wait complete. 2023-10-16T13:39:46.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.605+0000 7f1547756700 1 Processor -- start 2023-10-16T13:39:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.606+0000 7f1547756700 1 -- start start 2023-10-16T13:39:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.606+0000 7f1547756700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f154015ab10 0x7f154015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.606+0000 7f1547756700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15400cfe30 0x7f15400cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.606+0000 7f1547756700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154015e7a0 con 0x7f15400b1f50 2023-10-16T13:39:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.606+0000 7f1547756700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154015f730 con 0x7f15400cfe30 2023-10-16T13:39:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.606+0000 7f1547756700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400b29a0 con 0x7f154015ab10 2023-10-16T13:39:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15400cfe30 0x7f15400cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15400cfe30 0x7f15400cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44250/0 (socket says 172.21.15.5:44250) 2023-10-16T13:39:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 -- 172.21.15.5:0/2142494919 learned_addr learned my addr 172.21.15.5:0/2142494919 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f15454f2700 1 --2- 172.21.15.5:0/2142494919 >> v2:172.21.15.112:3300/0 conn(0x7f154015ab10 0x7f154015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 -- 172.21.15.5:0/2142494919 >> v2:172.21.15.112:3300/0 conn(0x7f154015ab10 msgr2=0x7f154015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 --2- 172.21.15.5:0/2142494919 >> v2:172.21.15.112:3300/0 conn(0x7f154015ab10 0x7f154015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 -- 172.21.15.5:0/2142494919 >> v1:172.21.15.112:6789/0 conn(0x7f15400b1f50 legacy=0x7f15400cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 -- 172.21.15.5:0/2142494919 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400b2c80 con 0x7f15400cfe30 2023-10-16T13:39:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1545cf3700 1 --2- 172.21.15.5:0/2142494919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15400cfe30 0x7f15400cbf40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f15400d0430 tx=0x7f153800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03a79a85d2c2cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1537fff700 1 -- 172.21.15.5:0/2142494919 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538010070 con 0x7f15400cfe30 2023-10-16T13:39:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1537fff700 1 -- 172.21.15.5:0/2142494919 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800dd50 con 0x7f15400cfe30 2023-10-16T13:39:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.607+0000 7f1537fff700 1 -- 172.21.15.5:0/2142494919 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800b310 con 0x7f15400cfe30 2023-10-16T13:39:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 -- 172.21.15.5:0/2142494919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15400cfe30 msgr2=0x7f15400cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 --2- 172.21.15.5:0/2142494919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15400cfe30 0x7f15400cbf40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f15400d0430 tx=0x7f153800d430 comp rx=0 tx=0).stop 2023-10-16T13:39:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 -- 172.21.15.5:0/2142494919 shutdown_connections 2023-10-16T13:39:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 --2- 172.21.15.5:0/2142494919 >> v2:172.21.15.112:3300/0 conn(0x7f154015ab10 0x7f154015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 --2- 172.21.15.5:0/2142494919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15400cfe30 0x7f15400cbf40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 -- 172.21.15.5:0/2142494919 >> 172.21.15.5:0/2142494919 conn(0x7f154006dae0 msgr2=0x7f154006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:46.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 -- 172.21.15.5:0/2142494919 shutdown_connections 2023-10-16T13:39:46.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.608+0000 7f1547756700 1 -- 172.21.15.5:0/2142494919 wait complete. 2023-10-16T13:39:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.609+0000 7f1547756700 1 Processor -- start 2023-10-16T13:39:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.609+0000 7f1547756700 1 -- start start 2023-10-16T13:39:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1547756700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15400b1f50 0x7f15400aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1547756700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15400cfe30 0x7f154014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1547756700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 0x7f15400c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1547756700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15400af390 con 0x7f154015ab10 2023-10-16T13:39:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1547756700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15400c4d40 con 0x7f15400b1f50 2023-10-16T13:39:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1547756700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15400ae370 con 0x7f15400cfe30 2023-10-16T13:39:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 0x7f15400c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 0x7f15400c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44256/0 (socket says 172.21.15.5:44256) 2023-10-16T13:39:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 -- 172.21.15.5:0/2286442361 learned_addr learned my addr 172.21.15.5:0/2286442361 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:46.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1544cf1700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15400cfe30 0x7f154014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f15454f2700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15400b1f50 0x7f15400aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 -- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15400cfe30 msgr2=0x7f154014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15400cfe30 0x7f154014f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 -- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15400b1f50 msgr2=0x7f15400aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15400b1f50 0x7f15400aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 -- 172.21.15.5:0/2286442361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153800bd40 con 0x7f154015ab10 2023-10-16T13:39:46.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.610+0000 7f1545cf3700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 0x7f15400c6610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1538017040 tx=0x7f1538004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.611+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800b760 con 0x7f154015ab10 2023-10-16T13:39:46.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.611+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538009800 con 0x7f154015ab10 2023-10-16T13:39:46.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.611+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15400ae650 con 0x7f154015ab10 2023-10-16T13:39:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.611+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538009bb0 con 0x7f154015ab10 2023-10-16T13:39:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.611+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154014fe30 con 0x7f154015ab10 2023-10-16T13:39:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.612+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15400aeb70 con 0x7f154015ab10 2023-10-16T13:39:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.612+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f153801b070 con 0x7f154015ab10 2023-10-16T13:39:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.613+0000 7f1535ffb700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f152406af00 0x7f152406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.613+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f153808a4d0 con 0x7f154015ab10 2023-10-16T13:39:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.613+0000 7f15454f2700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f152406af00 0x7f152406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.613+0000 7f15454f2700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f152406af00 0x7f152406d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f153c006b20 tx=0x7f153c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.618+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15400aeb70 con 0x7f154015ab10 2023-10-16T13:39:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.821+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15400aeb70 con 0x7f154015ab10 2023-10-16T13:39:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.821+0000 7f1535ffb700 1 -- 172.21.15.5:0/2286442361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15400aeb70 con 0x7f154015ab10 2023-10-16T13:39:46.824 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f152406af00 msgr2=0x7f152406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f152406af00 0x7f152406d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f153c006b20 tx=0x7f153c008040 comp rx=0 tx=0).stop 2023-10-16T13:39:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 msgr2=0x7f15400c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 0x7f15400c6610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1538017040 tx=0x7f1538004ad0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 shutdown_connections 2023-10-16T13:39:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154015ab10 0x7f15400c6610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15400b1f50 0x7f15400aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f152406af00 0x7f152406d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 --2- 172.21.15.5:0/2286442361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15400cfe30 0x7f154014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 >> 172.21.15.5:0/2286442361 conn(0x7f154006dae0 msgr2=0x7f15400b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 shutdown_connections 2023-10-16T13:39:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.823+0000 7f1547756700 1 -- 172.21.15.5:0/2286442361 wait complete. 2023-10-16T13:39:46.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:39:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.962+0000 7f4a294bf700 1 Processor -- start 2023-10-16T13:39:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.962+0000 7f4a294bf700 1 -- start start 2023-10-16T13:39:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a294bf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 0x7f4a240b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a294bf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a294bf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240ce100 con 0x7f4a2415ac90 2023-10-16T13:39:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a294bf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a240ce3e0 con 0x7f4a240cdb40 2023-10-16T13:39:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a294bf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240ce6c0 con 0x7f4a240b3010 2023-10-16T13:39:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a227fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 0x7f4a240b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a22ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4a2415ac90 0x7f4a2406bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45240/0 (socket says 172.21.15.5:45240) 2023-10-16T13:39:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a227fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 0x7f4a240b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:40158/0 (socket says 172.21.15.5:40158) 2023-10-16T13:39:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a22ffd700 1 -- 172.21.15.5:0/536871541 learned_addr learned my addr 172.21.15.5:0/536871541 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.963+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:42168/0 (socket says 172.21.15.5:42168) 2023-10-16T13:39:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a237fe700 1 -- 172.21.15.5:0/536871541 >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 msgr2=0x7f4a240b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a237fe700 1 --2- 172.21.15.5:0/536871541 >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 0x7f4a240b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a237fe700 1 -- 172.21.15.5:0/536871541 >> v1:172.21.15.112:6789/0 conn(0x7f4a2415ac90 legacy=0x7f4a2406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a237fe700 1 -- 172.21.15.5:0/536871541 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240ce9a0 con 0x7f4a240b3010 2023-10-16T13:39:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a21ffb700 1 -- 172.21.15.5:0/536871541 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680207537 0 0) 0x7f4a240ce100 con 0x7f4a2415ac90 2023-10-16T13:39:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a227fc700 1 --2- 172.21.15.5:0/536871541 >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 0x7f4a240b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a237fe700 1 --2- 172.21.15.5:0/536871541 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240cf1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009d90 tx=0x7f4a1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2898fd5585dca828 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a21ffb700 1 -- 172.21.15.5:0/536871541 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00e070 con 0x7f4a240b3010 2023-10-16T13:39:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a21ffb700 1 -- 172.21.15.5:0/536871541 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00bb20 con 0x7f4a240b3010 2023-10-16T13:39:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.964+0000 7f4a21ffb700 1 -- 172.21.15.5:0/536871541 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c012430 con 0x7f4a240b3010 2023-10-16T13:39:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 -- 172.21.15.5:0/536871541 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 msgr2=0x7f4a240cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 --2- 172.21.15.5:0/536871541 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240cf1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009d90 tx=0x7f4a1c00b330 comp rx=0 tx=0).stop 2023-10-16T13:39:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 -- 172.21.15.5:0/536871541 shutdown_connections 2023-10-16T13:39:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 --2- 172.21.15.5:0/536871541 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240cf1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 --2- 172.21.15.5:0/536871541 >> v2:172.21.15.112:3300/0 conn(0x7f4a240cdb40 0x7f4a240b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 -- 172.21.15.5:0/536871541 >> 172.21.15.5:0/536871541 conn(0x7f4a240cfc40 msgr2=0x7f4a240d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 -- 172.21.15.5:0/536871541 shutdown_connections 2023-10-16T13:39:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.965+0000 7f4a294bf700 1 -- 172.21.15.5:0/536871541 wait complete. 2023-10-16T13:39:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.966+0000 7f4a294bf700 1 Processor -- start 2023-10-16T13:39:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.966+0000 7f4a294bf700 1 -- start start 2023-10-16T13:39:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a294bf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a294bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 0x7f4a2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a294bf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a2415ac90 0x7f4a2406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a294bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240b5450 con 0x7f4a240cdb40 2023-10-16T13:39:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a294bf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240ad360 con 0x7f4a2415ac90 2023-10-16T13:39:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a294bf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240ad640 con 0x7f4a240b3010 2023-10-16T13:39:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a227fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 0x7f4a2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a227fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 0x7f4a2406d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44268/0 (socket says 172.21.15.5:44268) 2023-10-16T13:39:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a227fc700 1 -- 172.21.15.5:0/4062566193 learned_addr learned my addr 172.21.15.5:0/4062566193 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a22ffd700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a237fe700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a2415ac90 0x7f4a2406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a227fc700 1 -- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 msgr2=0x7f4a240b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.967+0000 7f4a227fc700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a227fc700 1 -- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a2415ac90 msgr2=0x7f4a2406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a227fc700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a2415ac90 0x7f4a2406d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a227fc700 1 -- 172.21.15.5:0/4062566193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140094a0 con 0x7f4a240cdb40 2023-10-16T13:39:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a227fc700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 0x7f4a2406d390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400ebe0 tx=0x7f4a1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400c850 con 0x7f4a240cdb40 2023-10-16T13:39:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400c9b0 con 0x7f4a240cdb40 2023-10-16T13:39:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c009a70 con 0x7f4a240cdb40 2023-10-16T13:39:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400cd40 con 0x7f4a240cdb40 2023-10-16T13:39:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.968+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a240adc00 con 0x7f4a240cdb40 2023-10-16T13:39:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.969+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a240ae250 con 0x7f4a240cdb40 2023-10-16T13:39:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.969+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a14013470 con 0x7f4a240cdb40 2023-10-16T13:39:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.970+0000 7f4a0b7fe700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a1006af00 0x7f4a1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.970+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a14089720 con 0x7f4a240cdb40 2023-10-16T13:39:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.970+0000 7f4a22ffd700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a1006af00 0x7f4a1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.971+0000 7f4a22ffd700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a1006af00 0x7f4a1006d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a18007fd0 tx=0x7f4a18007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:46.975+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a14054770 con 0x7f4a240cdb40 2023-10-16T13:39:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.194+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a24067d20 con 0x7f4a240cdb40 2023-10-16T13:39:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.194+0000 7f4a0b7fe700 1 -- 172.21.15.5:0/4062566193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) v1 ==== 80+0+124 (secure 0 0 0) 0x7f4a1400cea0 con 0x7f4a240cdb40 2023-10-16T13:39:47.197 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6837/1052521879 2023-10-17T13:39:40.217218+0000 2023-10-16T13:39:47.197 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6835/1052521879 2023-10-17T13:39:40.217218+0000 2023-10-16T13:39:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.196+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a1006af00 msgr2=0x7f4a1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.196+0000 7f4a294bf700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a1006af00 0x7f4a1006d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a18007fd0 tx=0x7f4a18007de0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 msgr2=0x7f4a2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 0x7f4a2406d390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400ebe0 tx=0x7f4a1400eef0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 shutdown_connections 2023-10-16T13:39:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a2415ac90 0x7f4a2406d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4a1006af00 0x7f4a1006d3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a240b3010 0x7f4a240b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 --2- 172.21.15.5:0/4062566193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240cdb40 0x7f4a2406d390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 >> 172.21.15.5:0/4062566193 conn(0x7f4a240cfc40 msgr2=0x7f4a240cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 shutdown_connections 2023-10-16T13:39:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.197+0000 7f4a294bf700 1 -- 172.21.15.5:0/4062566193 wait complete. 2023-10-16T13:39:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2023-10-16T13:39:47.211 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:39:47.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:47.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:39:47.258 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:39:47.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:39:47.259 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:39:47.277 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:47.278 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:47.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:39:47.296 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:47.296 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:47.337 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:39:47.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.459+0000 7f9a325ed700 1 Processor -- start 2023-10-16T13:39:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.459+0000 7f9a325ed700 1 -- start start 2023-10-16T13:39:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a325ed700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a325ed700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a2c0b54f0 0x7f9a2c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a325ed700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0b5c70 con 0x7f9a2c06e750 2023-10-16T13:39:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a325ed700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0b5990 con 0x7f9a2c0b54f0 2023-10-16T13:39:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a325ed700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c15b2b0 con 0x7f9a2c06eb30 2023-10-16T13:39:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a2b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a30b8a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a2c0b54f0 0x7f9a2c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a2bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9a2c06e750 0x7f9a2c0ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2023-10-16T13:39:47.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.460+0000 7f9a2bfff700 1 -- 172.21.15.5:0/802678302 learned_addr learned my addr 172.21.15.5:0/802678302 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:47.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a30b8a700 1 -- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 msgr2=0x7f9a2c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a30b8a700 1 --2- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c15e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a30b8a700 1 -- 172.21.15.5:0/802678302 >> v1:172.21.15.112:6789/0 conn(0x7f9a2c06e750 legacy=0x7f9a2c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a30b8a700 1 -- 172.21.15.5:0/802678302 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c15b590 con 0x7f9a2c0b54f0 2023-10-16T13:39:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a2affd700 1 -- 172.21.15.5:0/802678302 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840382387 0 0) 0x7f9a2c0b5c70 con 0x7f9a2c06e750 2023-10-16T13:39:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a2b7fe700 1 --2- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a30b8a700 1 --2- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c15ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009d90 tx=0x7f9a2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e744da6395abca9f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a2affd700 1 -- 172.21.15.5:0/802678302 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400e070 con 0x7f9a2c0b54f0 2023-10-16T13:39:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a2affd700 1 -- 172.21.15.5:0/802678302 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400bb20 con 0x7f9a2c0b54f0 2023-10-16T13:39:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a2affd700 1 -- 172.21.15.5:0/802678302 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24012430 con 0x7f9a2c0b54f0 2023-10-16T13:39:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a325ed700 1 -- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c0b54f0 msgr2=0x7f9a2c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.461+0000 7f9a325ed700 1 --2- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c15ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009d90 tx=0x7f9a2400b330 comp rx=0 tx=0).stop 2023-10-16T13:39:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.462+0000 7f9a325ed700 1 -- 172.21.15.5:0/802678302 shutdown_connections 2023-10-16T13:39:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.462+0000 7f9a325ed700 1 --2- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c15ec40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.462+0000 7f9a325ed700 1 --2- 172.21.15.5:0/802678302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.462+0000 7f9a325ed700 1 -- 172.21.15.5:0/802678302 >> 172.21.15.5:0/802678302 conn(0x7f9a2c0cc6f0 msgr2=0x7f9a2c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.462+0000 7f9a325ed700 1 -- 172.21.15.5:0/802678302 shutdown_connections 2023-10-16T13:39:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.462+0000 7f9a325ed700 1 -- 172.21.15.5:0/802678302 wait complete. 2023-10-16T13:39:47.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.463+0000 7f9a325ed700 1 Processor -- start 2023-10-16T13:39:47.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.463+0000 7f9a325ed700 1 -- start start 2023-10-16T13:39:47.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a325ed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 0x7f9a2c0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a325ed700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a325ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a325ed700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c06ae90 con 0x7f9a2c0b54f0 2023-10-16T13:39:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a325ed700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1550a0 con 0x7f9a2c06e750 2023-10-16T13:39:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a325ed700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c15f1e0 con 0x7f9a2c06eb30 2023-10-16T13:39:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a30b8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 0x7f9a2c0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 0x7f9a2c0a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:40176/0 (socket says 172.21.15.5:40176) 2023-10-16T13:39:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c06b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:42186/0 (socket says 172.21.15.5:42186) 2023-10-16T13:39:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a30b8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44284/0 (socket says 172.21.15.5:44284) 2023-10-16T13:39:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 -- 172.21.15.5:0/1005108794 learned_addr learned my addr 172.21.15.5:0/1005108794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 -- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 msgr2=0x7f9a2c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c06b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 -- 172.21.15.5:0/1005108794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 msgr2=0x7f9a2c154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 -- 172.21.15.5:0/1005108794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0094a0 con 0x7f9a2c06e750 2023-10-16T13:39:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a30b8a700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.464+0000 7f9a2bfff700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 0x7f9a2c0a88d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a200011e0 tx=0x7f9a2000ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.465+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20004c80 con 0x7f9a2c06e750 2023-10-16T13:39:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.465+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20004e00 con 0x7f9a2c06e750 2023-10-16T13:39:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.465+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a24009a70 con 0x7f9a2c06e750 2023-10-16T13:39:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.465+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20007310 con 0x7f9a2c06e750 2023-10-16T13:39:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.465+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c06a840 con 0x7f9a2c06e750 2023-10-16T13:39:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.466+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c06b170 con 0x7f9a2c06e750 2023-10-16T13:39:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.466+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a20007470 con 0x7f9a2c06e750 2023-10-16T13:39:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.467+0000 7f9a28ff9700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9a1806af00 0x7f9a1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.467+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9a200892e0 con 0x7f9a2c06e750 2023-10-16T13:39:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.467+0000 7f9a2b7fe700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9a1806af00 0x7f9a1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.467+0000 7f9a2b7fe700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9a1806af00 0x7f9a1806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0c6040 tx=0x7f9a1c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:47.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.472+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a20054330 con 0x7f9a2c06e750 2023-10-16T13:39:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.718+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a2c067d20 con 0x7f9a2c06e750 2023-10-16T13:39:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.719+0000 7f9a28ff9700 1 -- 172.21.15.5:0/1005108794 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f9a20057950 con 0x7f9a2c06e750 2023-10-16T13:39:47.722 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:47.722 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1675250334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1675250334},{"type":"v1","addr":"172.21.15.112:6837","nonce":1675250334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:20.312787+0000","modified":"2023-10-16T13:39:23.333172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6834/3128747669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3128747669},{"type":"v1","addr":"172.21.15.5:6834","nonce":3128747669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:39:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9a1806af00 msgr2=0x7f9a1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9a1806af00 0x7f9a1806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0c6040 tx=0x7f9a1c009210 comp rx=0 tx=0).stop 2023-10-16T13:39:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 msgr2=0x7f9a2c0a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 0x7f9a2c0a88d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a200011e0 tx=0x7f9a2000ca30 comp rx=0 tx=0).stop 2023-10-16T13:39:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 shutdown_connections 2023-10-16T13:39:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0b54f0 0x7f9a2c154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2c06e750 0x7f9a2c0a88d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9a1806af00 0x7f9a1806d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 --2- 172.21.15.5:0/1005108794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2c06eb30 0x7f9a2c06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 >> 172.21.15.5:0/1005108794 conn(0x7f9a2c0cc6f0 msgr2=0x7f9a2c159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 shutdown_connections 2023-10-16T13:39:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.721+0000 7f9a325ed700 1 -- 172.21.15.5:0/1005108794 wait complete. 2023-10-16T13:39:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2023-10-16T13:39:47.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.859+0000 7fc09ea6f700 1 Processor -- start 2023-10-16T13:39:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.859+0000 7fc09ea6f700 1 -- start start 2023-10-16T13:39:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09ea6f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc09815e2f0 0x7fc0980cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09ea6f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc09806a840 0x7fc09806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09ea6f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0980b2d60 con 0x7fc0980cd950 2023-10-16T13:39:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09ea6f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0981619a0 con 0x7fc09806a840 2023-10-16T13:39:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09ea6f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09806b1f0 con 0x7fc09815e2f0 2023-10-16T13:39:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09c80b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0980cd950 0x7fc09815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54292/0 (socket says 172.21.15.5:54292) 2023-10-16T13:39:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09c80b700 1 -- 172.21.15.5:0/1078511875 learned_addr learned my addr 172.21.15.5:0/1078511875 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:47.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc09d00c700 1 --2- 172.21.15.5:0/1078511875 >> v2:172.21.15.5:3300/0 conn(0x7fc09806a840 0x7fc09806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.860+0000 7fc097fff700 1 --2- 172.21.15.5:0/1078511875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc09815e2f0 0x7fc0980cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc0977fe700 1 -- 172.21.15.5:0/1078511875 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512766089 0 0) 0x7fc0980b2d60 con 0x7fc0980cd950 2023-10-16T13:39:47.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc0977fe700 1 -- 172.21.15.5:0/1078511875 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0880035b0 con 0x7fc0980cd950 2023-10-16T13:39:47.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc09d00c700 1 -- 172.21.15.5:0/1078511875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc09815e2f0 msgr2=0x7fc0980cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:47.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc09d00c700 1 --2- 172.21.15.5:0/1078511875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc09815e2f0 0x7fc0980cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc09d00c700 1 -- 172.21.15.5:0/1078511875 >> v1:172.21.15.5:6789/0 conn(0x7fc0980cd950 legacy=0x7fc09815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc09d00c700 1 -- 172.21.15.5:0/1078511875 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980cdd30 con 0x7fc09806a840 2023-10-16T13:39:47.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc09d00c700 1 --2- 172.21.15.5:0/1078511875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09806acb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc090009d90 tx=0x7fc09000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33c72843e15acd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:47.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc0977fe700 1 -- 172.21.15.5:0/1078511875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000e070 con 0x7fc09806a840 2023-10-16T13:39:47.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc0977fe700 1 -- 172.21.15.5:0/1078511875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000bb20 con 0x7fc09806a840 2023-10-16T13:39:47.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.861+0000 7fc0977fe700 1 -- 172.21.15.5:0/1078511875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090012430 con 0x7fc09806a840 2023-10-16T13:39:47.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1078511875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 msgr2=0x7fc09806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1078511875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09806acb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc090009d90 tx=0x7fc09000b330 comp rx=0 tx=0).stop 2023-10-16T13:39:47.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1078511875 shutdown_connections 2023-10-16T13:39:47.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1078511875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09806acb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1078511875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc09815e2f0 0x7fc0980cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1078511875 >> 172.21.15.5:0/1078511875 conn(0x7fc09806dae0 msgr2=0x7fc09806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:47.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1078511875 shutdown_connections 2023-10-16T13:39:47.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.862+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1078511875 wait complete. 2023-10-16T13:39:47.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.863+0000 7fc09ea6f700 1 Processor -- start 2023-10-16T13:39:47.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.863+0000 7fc09ea6f700 1 -- start start 2023-10-16T13:39:47.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09ea6f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09ea6f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0980cd950 0x7fc098159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09ea6f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc09815e2f0 0x7fc0980c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09ea6f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815c580 con 0x7fc09806a840 2023-10-16T13:39:47.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09ea6f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980b5530 con 0x7fc09815e2f0 2023-10-16T13:39:47.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09ea6f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980c96e0 con 0x7fc0980cd950 2023-10-16T13:39:47.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09815c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44294/0 (socket says 172.21.15.5:44294) 2023-10-16T13:39:47.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 -- 172.21.15.5:0/1152063978 learned_addr learned my addr 172.21.15.5:0/1152063978 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:47.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc097fff700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0980cd950 0x7fc098159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 -- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0980cd950 msgr2=0x7fc098159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0980cd950 0x7fc098159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09d00c700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc09815e2f0 0x7fc0980c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 -- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc09815e2f0 msgr2=0x7fc0980c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:47.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc09815e2f0 0x7fc0980c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 -- 172.21.15.5:0/1152063978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009a70 con 0x7fc09806a840 2023-10-16T13:39:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09d00c700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc09815e2f0 0x7fc0980c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.864+0000 7fc09c80b700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09815c040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c700 tx=0x7fc08c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.865+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c005d70 con 0x7fc09806a840 2023-10-16T13:39:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.865+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c0070d0 con 0x7fc09806a840 2023-10-16T13:39:47.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.865+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0980c99c0 con 0x7fc09806a840 2023-10-16T13:39:47.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.865+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c007460 con 0x7fc09806a840 2023-10-16T13:39:47.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.865+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0980c9f80 con 0x7fc09806a840 2023-10-16T13:39:47.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.866+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc098067d20 con 0x7fc09806a840 2023-10-16T13:39:47.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.866+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc08c0075c0 con 0x7fc09806a840 2023-10-16T13:39:47.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.867+0000 7fc0957fa700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc07c06af00 0x7fc07c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.867+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc08c088c60 con 0x7fc09806a840 2023-10-16T13:39:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.867+0000 7fc097fff700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc07c06af00 0x7fc07c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.867+0000 7fc097fff700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc07c06af00 0x7fc07c06d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0980cc330 tx=0x7fc084008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:47.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:47.871+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc08c053c20 con 0x7fc09806a840 2023-10-16T13:39:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.076+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0980b2630 con 0x7fc09806a840 2023-10-16T13:39:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.077+0000 7fc0957fa700 1 -- 172.21.15.5:0/1152063978 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16628 (secure 0 0 0) 0x7fc08c057240 con 0x7fc09806a840 2023-10-16T13:39:48.080 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:48.081 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:43.224207+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1052521879":"2023-10-17T13:39:40.217218+0000","172.21.15.112:6835/1052521879":"2023-10-17T13:39:40.217218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc07c06af00 msgr2=0x7fc07c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc07c06af00 0x7fc07c06d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0980cc330 tx=0x7fc084008040 comp rx=0 tx=0).stop 2023-10-16T13:39:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 msgr2=0x7fc09815c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09815c040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c700 tx=0x7fc08c00cac0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 shutdown_connections 2023-10-16T13:39:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc09815e2f0 0x7fc0980c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc09806a840 0x7fc09815c040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc07c06af00 0x7fc07c06d3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 --2- 172.21.15.5:0/1152063978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0980cd950 0x7fc098159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 >> 172.21.15.5:0/1152063978 conn(0x7fc09806dae0 msgr2=0x7fc098160700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 shutdown_connections 2023-10-16T13:39:48.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.080+0000 7fc09ea6f700 1 -- 172.21.15.5:0/1152063978 wait complete. 2023-10-16T13:39:48.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:39:18.336237+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:39:19.288524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:48.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:48.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.220+0000 7fa689e5b700 1 Processor -- start 2023-10-16T13:39:48.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.220+0000 7fa689e5b700 1 -- start start 2023-10-16T13:39:48.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa689e5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684160e30 0x7fa6840d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa689e5b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa6840d08a0 0x7fa6840ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa689e5b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6840b6610 con 0x7fa684161210 2023-10-16T13:39:48.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa689e5b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840d1da0 con 0x7fa6840d08a0 2023-10-16T13:39:48.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa689e5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840d2080 con 0x7fa684160e30 2023-10-16T13:39:48.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa682ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa684161210 0x7fa6840d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54306/0 (socket says 172.21.15.5:54306) 2023-10-16T13:39:48.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa682ffd700 1 -- 172.21.15.5:0/3573987182 learned_addr learned my addr 172.21.15.5:0/3573987182 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:48.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6837fe700 1 --2- 172.21.15.5:0/3573987182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684160e30 0x7fa6840d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa683fff700 1 --2- 172.21.15.5:0/3573987182 >> v2:172.21.15.112:3300/0 conn(0x7fa6840d08a0 0x7fa6840ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6827fc700 1 -- 172.21.15.5:0/3573987182 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245699344 0 0) 0x7fa6840b6610 con 0x7fa684161210 2023-10-16T13:39:48.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6827fc700 1 -- 172.21.15.5:0/3573987182 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c0035b0 con 0x7fa684161210 2023-10-16T13:39:48.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6837fe700 1 -- 172.21.15.5:0/3573987182 >> v2:172.21.15.112:3300/0 conn(0x7fa6840d08a0 msgr2=0x7fa6840ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:48.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6837fe700 1 --2- 172.21.15.5:0/3573987182 >> v2:172.21.15.112:3300/0 conn(0x7fa6840d08a0 0x7fa6840ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6827fc700 1 -- 172.21.15.5:0/3573987182 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005307997 0 0) 0x7fa66c0035b0 con 0x7fa684161210 2023-10-16T13:39:48.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6837fe700 1 -- 172.21.15.5:0/3573987182 >> v1:172.21.15.5:6789/0 conn(0x7fa684161210 legacy=0x7fa6840d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.221+0000 7fa6837fe700 1 -- 172.21.15.5:0/3573987182 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840d2360 con 0x7fa684160e30 2023-10-16T13:39:48.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa6837fe700 1 --2- 172.21.15.5:0/3573987182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684160e30 0x7fa6840d4200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa674009820 tx=0x7fa674009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae09151cf497286 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa6827fc700 1 -- 172.21.15.5:0/3573987182 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678001670 con 0x7fa684160e30 2023-10-16T13:39:48.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa6827fc700 1 -- 172.21.15.5:0/3573987182 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674005c30 con 0x7fa684160e30 2023-10-16T13:39:48.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa6827fc700 1 -- 172.21.15.5:0/3573987182 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674004030 con 0x7fa684160e30 2023-10-16T13:39:48.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa689e5b700 1 -- 172.21.15.5:0/3573987182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684160e30 msgr2=0x7fa6840d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa689e5b700 1 --2- 172.21.15.5:0/3573987182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684160e30 0x7fa6840d4200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa674009820 tx=0x7fa674009b30 comp rx=0 tx=0).stop 2023-10-16T13:39:48.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa689e5b700 1 -- 172.21.15.5:0/3573987182 shutdown_connections 2023-10-16T13:39:48.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa689e5b700 1 --2- 172.21.15.5:0/3573987182 >> v2:172.21.15.112:3300/0 conn(0x7fa6840d08a0 0x7fa6840ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa689e5b700 1 --2- 172.21.15.5:0/3573987182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684160e30 0x7fa6840d4200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.222+0000 7fa689e5b700 1 -- 172.21.15.5:0/3573987182 >> 172.21.15.5:0/3573987182 conn(0x7fa68409cb40 msgr2=0x7fa6840d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:48.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.223+0000 7fa689e5b700 1 -- 172.21.15.5:0/3573987182 shutdown_connections 2023-10-16T13:39:48.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.223+0000 7fa689e5b700 1 -- 172.21.15.5:0/3573987182 wait complete. 2023-10-16T13:39:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.224+0000 7fa689e5b700 1 Processor -- start 2023-10-16T13:39:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.224+0000 7fa689e5b700 1 -- start start 2023-10-16T13:39:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 0x7fa6840b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa684160e30 0x7fa6840a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684161210 0x7fa6841548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c80f0 con 0x7fa6840d08a0 2023-10-16T13:39:48.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c7570 con 0x7fa684160e30 2023-10-16T13:39:48.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c7850 con 0x7fa684161210 2023-10-16T13:39:48.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 0x7fa6840b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 0x7fa6840b8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44308/0 (socket says 172.21.15.5:44308) 2023-10-16T13:39:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 -- 172.21.15.5:0/1952519819 learned_addr learned my addr 172.21.15.5:0/1952519819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa683fff700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684161210 0x7fa6841548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa682ffd700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa684160e30 0x7fa6840a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 -- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684161210 msgr2=0x7fa6841548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684161210 0x7fa6841548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 -- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa684160e30 msgr2=0x7fa6840a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa684160e30 0x7fa6840a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 -- 172.21.15.5:0/1952519819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009430 con 0x7fa6840d08a0 2023-10-16T13:39:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa682ffd700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa684160e30 0x7fa6840a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa6837fe700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 0x7fa6840b8170 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa674000c00 tx=0x7fa674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674003bb0 con 0x7fa6840d08a0 2023-10-16T13:39:48.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674003d30 con 0x7fa6840d08a0 2023-10-16T13:39:48.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674003ea0 con 0x7fa6840d08a0 2023-10-16T13:39:48.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.225+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6840c7b30 con 0x7fa6840d08a0 2023-10-16T13:39:48.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.226+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6840b86b0 con 0x7fa6840d08a0 2023-10-16T13:39:48.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.227+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68409d790 con 0x7fa6840d08a0 2023-10-16T13:39:48.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.227+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa674018030 con 0x7fa6840d08a0 2023-10-16T13:39:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.227+0000 7fa66bfff700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa67006af00 0x7fa67006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.227+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa67408a670 con 0x7fa6840d08a0 2023-10-16T13:39:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.228+0000 7fa682ffd700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa67006af00 0x7fa67006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.228+0000 7fa682ffd700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa67006af00 0x7fa67006d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa678001eb0 tx=0x7fa678001c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.232+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa68409d790 con 0x7fa6840d08a0 2023-10-16T13:39:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.432+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa68409d790 con 0x7fa6840d08a0 2023-10-16T13:39:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.432+0000 7fa66bfff700 1 -- 172.21.15.5:0/1952519819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa68409d790 con 0x7fa6840d08a0 2023-10-16T13:39:48.435 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa67006af00 msgr2=0x7fa67006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa67006af00 0x7fa67006d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa678001eb0 tx=0x7fa678001c60 comp rx=0 tx=0).stop 2023-10-16T13:39:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 msgr2=0x7fa6840b8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 0x7fa6840b8170 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa674000c00 tx=0x7fa674004750 comp rx=0 tx=0).stop 2023-10-16T13:39:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 shutdown_connections 2023-10-16T13:39:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa67006af00 0x7fa67006d3c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa684161210 0x7fa6841548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6840d08a0 0x7fa6840b8170 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 --2- 172.21.15.5:0/1952519819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa684160e30 0x7fa6840a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 >> 172.21.15.5:0/1952519819 conn(0x7fa68409cb40 msgr2=0x7fa68415fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 shutdown_connections 2023-10-16T13:39:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.434+0000 7fa689e5b700 1 -- 172.21.15.5:0/1952519819 wait complete. 2023-10-16T13:39:48.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:39:48.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.575+0000 7f0a1a0a2700 1 Processor -- start 2023-10-16T13:39:48.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.575+0000 7f0a1a0a2700 1 -- start start 2023-10-16T13:39:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a1a0a2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a1a0a2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a140b3530 con 0x7f0a140b28b0 2023-10-16T13:39:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a1a0a2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a140cd180 con 0x7f0a1406af50 2023-10-16T13:39:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a1a0a2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140cde00 con 0x7f0a1415f130 2023-10-16T13:39:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a12ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a140b28b0 0x7f0a1406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54320/0 (socket says 172.21.15.5:54320) 2023-10-16T13:39:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a12ffd700 1 -- 172.21.15.5:0/242040809 learned_addr learned my addr 172.21.15.5:0/242040809 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a137fe700 1 --2- 172.21.15.5:0/242040809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513481379 0 0) 0x7f0a140b3530 con 0x7f0a140b28b0 2023-10-16T13:39:48.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09fc0035b0 con 0x7f0a140b28b0 2023-10-16T13:39:48.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980772141 0 0) 0x7f0a140cd180 con 0x7f0a1406af50 2023-10-16T13:39:48.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a140b3530 con 0x7f0a1406af50 2023-10-16T13:39:48.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921520459 0 0) 0x7f09fc0035b0 con 0x7f0a140b28b0 2023-10-16T13:39:48.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a137fe700 1 -- 172.21.15.5:0/242040809 >> v1:172.21.15.112:6789/0 conn(0x7f0a1406af50 legacy=0x7f0a140b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a137fe700 1 -- 172.21.15.5:0/242040809 >> v1:172.21.15.5:6789/0 conn(0x7f0a140b28b0 legacy=0x7f0a1406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.576+0000 7f0a137fe700 1 -- 172.21.15.5:0/242040809 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140cd460 con 0x7f0a1415f130 2023-10-16T13:39:48.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a137fe700 1 --2- 172.21.15.5:0/242040809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140cede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009870 tx=0x7f0a04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0263799d9b4d52 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080017f0 con 0x7f0a1415f130 2023-10-16T13:39:48.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04004030 con 0x7f0a1415f130 2023-10-16T13:39:48.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a127fc700 1 -- 172.21.15.5:0/242040809 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a040043a0 con 0x7f0a1415f130 2023-10-16T13:39:48.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/242040809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 msgr2=0x7f0a140cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/242040809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140cede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009870 tx=0x7f0a04009b80 comp rx=0 tx=0).stop 2023-10-16T13:39:48.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/242040809 shutdown_connections 2023-10-16T13:39:48.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/242040809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140cede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/242040809 >> 172.21.15.5:0/242040809 conn(0x7f0a1406dae0 msgr2=0x7f0a1406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:48.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/242040809 shutdown_connections 2023-10-16T13:39:48.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.577+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/242040809 wait complete. 2023-10-16T13:39:48.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.578+0000 7f0a1a0a2700 1 Processor -- start 2023-10-16T13:39:48.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 -- start start 2023-10-16T13:39:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 0x7f0a140c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a140b28b0 0x7f0a14156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140c6720 con 0x7f0a1406af50 2023-10-16T13:39:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140c40a0 con 0x7f0a140b28b0 2023-10-16T13:39:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a1a0a2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a14157550 con 0x7f0a1415f130 2023-10-16T13:39:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.579+0000 7f0a137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 0x7f0a140c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 0x7f0a140c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44320/0 (socket says 172.21.15.5:44320) 2023-10-16T13:39:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 -- 172.21.15.5:0/4107574180 learned_addr learned my addr 172.21.15.5:0/4107574180 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a13fff700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a12ffd700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a140b28b0 0x7f0a14156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 -- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 msgr2=0x7f0a140b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 -- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a140b28b0 msgr2=0x7f0a14156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a140b28b0 0x7f0a14156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 -- 172.21.15.5:0/4107574180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a040094a0 con 0x7f0a1406af50 2023-10-16T13:39:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a137fe700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 0x7f0a140c61e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0a040090b0 tx=0x7f0a04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04003ad0 con 0x7f0a1406af50 2023-10-16T13:39:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0401f070 con 0x7f0a1406af50 2023-10-16T13:39:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a14157830 con 0x7f0a1406af50 2023-10-16T13:39:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04003e90 con 0x7f0a1406af50 2023-10-16T13:39:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.580+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a140c6b70 con 0x7f0a1406af50 2023-10-16T13:39:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.581+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a140c4270 con 0x7f0a1406af50 2023-10-16T13:39:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.582+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a04021030 con 0x7f0a1406af50 2023-10-16T13:39:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.582+0000 7f09fbfff700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a0006af00 0x7f0a0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.582+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0a0408a890 con 0x7f0a1406af50 2023-10-16T13:39:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.582+0000 7f0a12ffd700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a0006af00 0x7f0a0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.583+0000 7f0a12ffd700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a0006af00 0x7f0a0006d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a140b31a0 tx=0x7f0a08001d80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.587+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a140c4270 con 0x7f0a1406af50 2023-10-16T13:39:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.786+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a140c4270 con 0x7f0a1406af50 2023-10-16T13:39:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.786+0000 7f09fbfff700 1 -- 172.21.15.5:0/4107574180 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a140c4270 con 0x7f0a1406af50 2023-10-16T13:39:48.789 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:39:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a0006af00 msgr2=0x7f0a0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a0006af00 0x7f0a0006d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a140b31a0 tx=0x7f0a08001d80 comp rx=0 tx=0).stop 2023-10-16T13:39:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 msgr2=0x7f0a140c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 0x7f0a140c61e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0a040090b0 tx=0x7f0a04004750 comp rx=0 tx=0).stop 2023-10-16T13:39:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 shutdown_connections 2023-10-16T13:39:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a0006af00 0x7f0a0006d3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a1415f130 0x7f0a140b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1406af50 0x7f0a140c61e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 --2- 172.21.15.5:0/4107574180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a140b28b0 0x7f0a14156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.788+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 >> 172.21.15.5:0/4107574180 conn(0x7f0a1406dae0 msgr2=0x7f0a140b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.789+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 shutdown_connections 2023-10-16T13:39:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.789+0000 7f0a1a0a2700 1 -- 172.21.15.5:0/4107574180 wait complete. 2023-10-16T13:39:48.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:39:48.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.928+0000 7f261889b700 1 Processor -- start 2023-10-16T13:39:48.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.928+0000 7f261889b700 1 -- start start 2023-10-16T13:39:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261889b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f261415b740 0x7f26140d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261889b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140d0c70 0x7f26140cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261889b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26140c5110 0x7f26140ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261889b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261415bb20 con 0x7f261415b740 2023-10-16T13:39:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261889b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140cf190 con 0x7f26140c5110 2023-10-16T13:39:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261889b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140cbd40 con 0x7f26140d0c70 2023-10-16T13:39:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f261415b740 0x7f26140d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f261415b740 0x7f26140d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44328/0 (socket says 172.21.15.5:44328) 2023-10-16T13:39:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 -- 172.21.15.5:0/1132487471 learned_addr learned my addr 172.21.15.5:0/1132487471 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f2611d9b700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140d0c70 0x7f26140cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f2612d9d700 1 --2- 172.21.15.5:0/1132487471 >> v2:172.21.15.112:3300/0 conn(0x7f26140c5110 0x7f26140ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 -- 172.21.15.5:0/1132487471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140d0c70 msgr2=0x7f26140cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140d0c70 0x7f26140cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 -- 172.21.15.5:0/1132487471 >> v2:172.21.15.112:3300/0 conn(0x7f26140c5110 msgr2=0x7f26140ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.929+0000 7f261259c700 1 --2- 172.21.15.5:0/1132487471 >> v2:172.21.15.112:3300/0 conn(0x7f26140c5110 0x7f26140ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261259c700 1 -- 172.21.15.5:0/1132487471 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140cc020 con 0x7f261415b740 2023-10-16T13:39:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f2611d9b700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140d0c70 0x7f26140cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f2612d9d700 1 --2- 172.21.15.5:0/1132487471 >> v2:172.21.15.112:3300/0 conn(0x7f26140c5110 0x7f26140ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261259c700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261415b740 0x7f26140d1cd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f26140b3f60 tx=0x7f2604009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f69f3196c42844 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261159a700 1 -- 172.21.15.5:0/1132487471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400b870 con 0x7f261415b740 2023-10-16T13:39:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261159a700 1 -- 172.21.15.5:0/1132487471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260400b9d0 con 0x7f261415b740 2023-10-16T13:39:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261159a700 1 -- 172.21.15.5:0/1132487471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400bd60 con 0x7f261415b740 2023-10-16T13:39:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 -- 172.21.15.5:0/1132487471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261415b740 msgr2=0x7f26140d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261415b740 0x7f26140d1cd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f26140b3f60 tx=0x7f2604009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 -- 172.21.15.5:0/1132487471 shutdown_connections 2023-10-16T13:39:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 --2- 172.21.15.5:0/1132487471 >> v2:172.21.15.112:3300/0 conn(0x7f26140c5110 0x7f26140ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261415b740 0x7f26140d1cd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 --2- 172.21.15.5:0/1132487471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140d0c70 0x7f26140cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 -- 172.21.15.5:0/1132487471 >> 172.21.15.5:0/1132487471 conn(0x7f26140665a0 msgr2=0x7f2614066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.930+0000 7f261889b700 1 -- 172.21.15.5:0/1132487471 shutdown_connections 2023-10-16T13:39:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.931+0000 7f261889b700 1 -- 172.21.15.5:0/1132487471 wait complete. 2023-10-16T13:39:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.932+0000 7f261889b700 1 Processor -- start 2023-10-16T13:39:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.932+0000 7f261889b700 1 -- start start 2023-10-16T13:39:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140c5110 0x7f2614156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 0x7f26140caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261415b740 0x7f26140b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c8690 con 0x7f26140d0c70 2023-10-16T13:39:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26140b4ff0 con 0x7f261415b740 2023-10-16T13:39:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c8950 con 0x7f26140c5110 2023-10-16T13:39:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 0x7f26140caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 0x7f26140caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44336/0 (socket says 172.21.15.5:44336) 2023-10-16T13:39:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 -- 172.21.15.5:0/1253967594 learned_addr learned my addr 172.21.15.5:0/1253967594 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261259c700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140c5110 0x7f2614156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2612d9d700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261415b740 0x7f26140b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 -- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140c5110 msgr2=0x7f2614156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140c5110 0x7f2614156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 -- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261415b740 msgr2=0x7f26140b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261415b740 0x7f26140b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 -- 172.21.15.5:0/1253967594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009550 con 0x7f26140d0c70 2023-10-16T13:39:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f2611d9b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 0x7f26140caed0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e810 tx=0x7f25fc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00c070 con 0x7f26140d0c70 2023-10-16T13:39:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc004230 con 0x7f26140d0c70 2023-10-16T13:39:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26140c8c30 con 0x7f26140d0c70 2023-10-16T13:39:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.933+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0036a0 con 0x7f26140d0c70 2023-10-16T13:39:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.934+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26140cb410 con 0x7f26140d0c70 2023-10-16T13:39:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.934+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26140c9150 con 0x7f26140d0c70 2023-10-16T13:39:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.935+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25fc003800 con 0x7f26140d0c70 2023-10-16T13:39:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.936+0000 7f260affd700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406af00 0x7f25f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.936+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f25fc0893e0 con 0x7f26140d0c70 2023-10-16T13:39:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.936+0000 7f261259c700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406af00 0x7f25f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.936+0000 7f261259c700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406af00 0x7f25f406d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2604014040 tx=0x7f2604008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:48.940+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26140c9150 con 0x7f26140d0c70 2023-10-16T13:39:49.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.141+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26140c9150 con 0x7f26140d0c70 2023-10-16T13:39:49.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.141+0000 7f260affd700 1 -- 172.21.15.5:0/1253967594 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26140c9150 con 0x7f26140d0c70 2023-10-16T13:39:49.145 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:39:49.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406af00 msgr2=0x7f25f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406af00 0x7f25f406d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2604014040 tx=0x7f2604008030 comp rx=0 tx=0).stop 2023-10-16T13:39:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 msgr2=0x7f26140caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 0x7f26140caed0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e810 tx=0x7f25fc00eb20 comp rx=0 tx=0).stop 2023-10-16T13:39:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 shutdown_connections 2023-10-16T13:39:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261415b740 0x7f26140b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406af00 0x7f25f406d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140c5110 0x7f2614156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.143+0000 7f261889b700 1 --2- 172.21.15.5:0/1253967594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140d0c70 0x7f26140caed0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.144+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 >> 172.21.15.5:0/1253967594 conn(0x7f26140665a0 msgr2=0x7f261415ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.144+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 shutdown_connections 2023-10-16T13:39:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.144+0000 7f261889b700 1 -- 172.21.15.5:0/1253967594 wait complete. 2023-10-16T13:39:49.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.281+0000 7fad559ee700 1 Processor -- start 2023-10-16T13:39:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.281+0000 7fad559ee700 1 -- start start 2023-10-16T13:39:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad559ee700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad5015f1f0 0x7fad500cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad559ee700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5015e7a0 con 0x7fad5015ab10 2023-10-16T13:39:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad559ee700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad500d0090 con 0x7fad500cfc60 2023-10-16T13:39:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad559ee700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad500b29a0 con 0x7fad5015f1f0 2023-10-16T13:39:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad4e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad5015f1f0 0x7fad500cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad4effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fad5015ab10 0x7fad500b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54346/0 (socket says 172.21.15.5:54346) 2023-10-16T13:39:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.282+0000 7fad4effd700 1 -- 172.21.15.5:0/2038610420 learned_addr learned my addr 172.21.15.5:0/2038610420 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4dffb700 1 -- 172.21.15.5:0/2038610420 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136077668 0 0) 0x7fad5015e7a0 con 0x7fad5015ab10 2023-10-16T13:39:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4dffb700 1 -- 172.21.15.5:0/2038610420 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad380035b0 con 0x7fad5015ab10 2023-10-16T13:39:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4e7fc700 1 -- 172.21.15.5:0/2038610420 >> v1:172.21.15.112:6789/0 conn(0x7fad500cfc60 legacy=0x7fad500cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4e7fc700 1 -- 172.21.15.5:0/2038610420 >> v1:172.21.15.5:6789/0 conn(0x7fad5015ab10 legacy=0x7fad500b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4e7fc700 1 -- 172.21.15.5:0/2038610420 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500b2c80 con 0x7fad5015f1f0 2023-10-16T13:39:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4e7fc700 1 --2- 172.21.15.5:0/2038610420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad5015f1f0 0x7fad500cf720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad4000bac0 tx=0x7fad4000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817df5c2632da072 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4dffb700 1 -- 172.21.15.5:0/2038610420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40005e30 con 0x7fad5015f1f0 2023-10-16T13:39:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4dffb700 1 -- 172.21.15.5:0/2038610420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad40004030 con 0x7fad5015f1f0 2023-10-16T13:39:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.283+0000 7fad4dffb700 1 -- 172.21.15.5:0/2038610420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400043c0 con 0x7fad5015f1f0 2023-10-16T13:39:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 -- 172.21.15.5:0/2038610420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad5015f1f0 msgr2=0x7fad500cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 --2- 172.21.15.5:0/2038610420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad5015f1f0 0x7fad500cf720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad4000bac0 tx=0x7fad4000bdd0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 -- 172.21.15.5:0/2038610420 shutdown_connections 2023-10-16T13:39:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 --2- 172.21.15.5:0/2038610420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad5015f1f0 0x7fad500cf720 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 -- 172.21.15.5:0/2038610420 >> 172.21.15.5:0/2038610420 conn(0x7fad5006dae0 msgr2=0x7fad5006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 -- 172.21.15.5:0/2038610420 shutdown_connections 2023-10-16T13:39:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.284+0000 7fad559ee700 1 -- 172.21.15.5:0/2038610420 wait complete. 2023-10-16T13:39:49.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.285+0000 7fad559ee700 1 Processor -- start 2023-10-16T13:39:49.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.285+0000 7fad559ee700 1 -- start start 2023-10-16T13:39:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad559ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 0x7fad50154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad559ee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad5015ab10 0x7fad50159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad559ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad5015f1f0 0x7fad500ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad559ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50158f00 con 0x7fad500cfc60 2023-10-16T13:39:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad559ee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50158380 con 0x7fad5015f1f0 2023-10-16T13:39:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad559ee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad50158660 con 0x7fad5015ab10 2023-10-16T13:39:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 0x7fad50154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 0x7fad50154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44348/0 (socket says 172.21.15.5:44348) 2023-10-16T13:39:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 -- 172.21.15.5:0/53172332 learned_addr learned my addr 172.21.15.5:0/53172332 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4e7fc700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad5015ab10 0x7fad50159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 -- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad5015ab10 msgr2=0x7fad50159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad5015ab10 0x7fad50159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 -- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad5015f1f0 msgr2=0x7fad500ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4f7fe700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad5015f1f0 0x7fad500ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad5015f1f0 0x7fad500ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 -- 172.21.15.5:0/53172332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4000b6d0 con 0x7fad500cfc60 2023-10-16T13:39:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.286+0000 7fad4effd700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 0x7fad50154e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c420 tx=0x7fad4400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.287+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44005d70 con 0x7fad500cfc60 2023-10-16T13:39:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.287+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad440070d0 con 0x7fad500cfc60 2023-10-16T13:39:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.287+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44007440 con 0x7fad500cfc60 2023-10-16T13:39:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.287+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad50158940 con 0x7fad500cfc60 2023-10-16T13:39:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.287+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad501553d0 con 0x7fad500cfc60 2023-10-16T13:39:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.288+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500afc10 con 0x7fad500cfc60 2023-10-16T13:39:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.288+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad440075a0 con 0x7fad500cfc60 2023-10-16T13:39:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.288+0000 7fad37fff700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad3c06af00 0x7fad3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.289+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fad44088980 con 0x7fad500cfc60 2023-10-16T13:39:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.289+0000 7fad4e7fc700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad3c06af00 0x7fad3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.289+0000 7fad4e7fc700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad3c06af00 0x7fad3c06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad500b2720 tx=0x7fad40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.293+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad44053a80 con 0x7fad500cfc60 2023-10-16T13:39:49.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.538+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad5006abc0 con 0x7fad500cfc60 2023-10-16T13:39:49.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.539+0000 7fad37fff700 1 -- 172.21.15.5:0/53172332 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fad44017020 con 0x7fad500cfc60 2023-10-16T13:39:49.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:49.542 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1675250334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1675250334},{"type":"v1","addr":"172.21.15.112:6837","nonce":1675250334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:20.312787+0000","modified":"2023-10-16T13:39:23.333172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6834/3128747669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3128747669},{"type":"v1","addr":"172.21.15.5:6834","nonce":3128747669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:39:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad3c06af00 msgr2=0x7fad3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad3c06af00 0x7fad3c06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad500b2720 tx=0x7fad40009040 comp rx=0 tx=0).stop 2023-10-16T13:39:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 msgr2=0x7fad50154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 0x7fad50154e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c420 tx=0x7fad4400c7e0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 shutdown_connections 2023-10-16T13:39:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad5015f1f0 0x7fad500ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad500cfc60 0x7fad50154e90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad3c06af00 0x7fad3c06d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 --2- 172.21.15.5:0/53172332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad5015ab10 0x7fad50159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 >> 172.21.15.5:0/53172332 conn(0x7fad5006dae0 msgr2=0x7fad500cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 shutdown_connections 2023-10-16T13:39:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.541+0000 7fad559ee700 1 -- 172.21.15.5:0/53172332 wait complete. 2023-10-16T13:39:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2023-10-16T13:39:49.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.678+0000 7f2d3bcee700 1 Processor -- start 2023-10-16T13:39:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.678+0000 7f2d3bcee700 1 -- start start 2023-10-16T13:39:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d3bcee700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d3406eb30 0x7f2d3415e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d3bcee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d340b54f0 0x7f2d3415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d3bcee700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340b5c70 con 0x7f2d3406e750 2023-10-16T13:39:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d3bcee700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340b5990 con 0x7f2d3406eb30 2023-10-16T13:39:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d3bcee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3415b2b0 con 0x7f2d340b54f0 2023-10-16T13:39:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d39a8a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d3406e750 0x7f2d340ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54360/0 (socket says 172.21.15.5:54360) 2023-10-16T13:39:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d39a8a700 1 -- 172.21.15.5:0/3765912911 learned_addr learned my addr 172.21.15.5:0/3765912911 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d39289700 1 --2- 172.21.15.5:0/3765912911 >> v2:172.21.15.112:3300/0 conn(0x7f2d3406eb30 0x7f2d3415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d3a28b700 1 --2- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d340b54f0 0x7f2d3415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d38a88700 1 -- 172.21.15.5:0/3765912911 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983267892 0 0) 0x7f2d340b5c70 con 0x7f2d3406e750 2023-10-16T13:39:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.679+0000 7f2d38a88700 1 -- 172.21.15.5:0/3765912911 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d200035b0 con 0x7f2d3406e750 2023-10-16T13:39:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d38a88700 1 -- 172.21.15.5:0/3765912911 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3436772501 0 0) 0x7f2d200035b0 con 0x7f2d3406e750 2023-10-16T13:39:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d39289700 1 -- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d340b54f0 msgr2=0x7f2d3415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d39289700 1 --2- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d340b54f0 0x7f2d3415ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d39289700 1 -- 172.21.15.5:0/3765912911 >> v1:172.21.15.5:6789/0 conn(0x7f2d3406e750 legacy=0x7f2d340ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d39289700 1 -- 172.21.15.5:0/3765912911 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3415b590 con 0x7f2d3406eb30 2023-10-16T13:39:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d39289700 1 --2- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3406eb30 0x7f2d3415e700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ccc0e717e6102f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d38a88700 1 -- 172.21.15.5:0/3765912911 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24001670 con 0x7f2d3406eb30 2023-10-16T13:39:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d38a88700 1 -- 172.21.15.5:0/3765912911 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30004030 con 0x7f2d3406eb30 2023-10-16T13:39:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.680+0000 7f2d38a88700 1 -- 172.21.15.5:0/3765912911 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d300043a0 con 0x7f2d3406eb30 2023-10-16T13:39:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 -- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3406eb30 msgr2=0x7f2d3415e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3406eb30 0x7f2d3415e700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30009b80 comp rx=0 tx=0).stop 2023-10-16T13:39:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 -- 172.21.15.5:0/3765912911 shutdown_connections 2023-10-16T13:39:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d340b54f0 0x7f2d3415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/3765912911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d3406eb30 0x7f2d3415e700 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 -- 172.21.15.5:0/3765912911 >> 172.21.15.5:0/3765912911 conn(0x7f2d340cc6f0 msgr2=0x7f2d340ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 -- 172.21.15.5:0/3765912911 shutdown_connections 2023-10-16T13:39:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.681+0000 7f2d3bcee700 1 -- 172.21.15.5:0/3765912911 wait complete. 2023-10-16T13:39:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.682+0000 7f2d3bcee700 1 Processor -- start 2023-10-16T13:39:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.682+0000 7f2d3bcee700 1 -- start start 2023-10-16T13:39:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3bcee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 0x7f2d34156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3bcee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d3406eb30 0x7f2d340c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3bcee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d340b54f0 0x7f2d340ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3bcee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3406acd0 con 0x7f2d3406e750 2023-10-16T13:39:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3bcee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c6d40 con 0x7f2d340b54f0 2023-10-16T13:39:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3bcee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c7020 con 0x7f2d3406eb30 2023-10-16T13:39:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 0x7f2d34156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 0x7f2d34156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44362/0 (socket says 172.21.15.5:44362) 2023-10-16T13:39:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 -- 172.21.15.5:0/1149082955 learned_addr learned my addr 172.21.15.5:0/1149082955 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39289700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d3406eb30 0x7f2d340c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 -- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d3406eb30 msgr2=0x7f2d340c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3a28b700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d340b54f0 0x7f2d340ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d3406eb30 0x7f2d340c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 -- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d340b54f0 msgr2=0x7f2d340ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d340b54f0 0x7f2d340ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d39a8a700 1 -- 172.21.15.5:0/1149082955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300094a0 con 0x7f2d3406e750 2023-10-16T13:39:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.683+0000 7f2d3a28b700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d340b54f0 0x7f2d340ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.684+0000 7f2d39a8a700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 0x7f2d34156400 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c750 tx=0x7f2d2400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.684+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24004c80 con 0x7f2d3406e750 2023-10-16T13:39:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.684+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24004de0 con 0x7f2d3406e750 2023-10-16T13:39:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.684+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d340c7300 con 0x7f2d3406e750 2023-10-16T13:39:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.684+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24007310 con 0x7f2d3406e750 2023-10-16T13:39:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.684+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d34156940 con 0x7f2d3406e750 2023-10-16T13:39:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.685+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d340c7820 con 0x7f2d3406e750 2023-10-16T13:39:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.685+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d24007470 con 0x7f2d3406e750 2023-10-16T13:39:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.686+0000 7f2d2a7fc700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d1806af00 0x7f2d1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.686+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2d24088a80 con 0x7f2d3406e750 2023-10-16T13:39:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.686+0000 7f2d39289700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d1806af00 0x7f2d1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.686+0000 7f2d39289700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d1806af00 0x7f2d1806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.691+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d340c7820 con 0x7f2d3406e750 2023-10-16T13:39:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.892+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d340cbb00 con 0x7f2d3406e750 2023-10-16T13:39:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.894+0000 7f2d2a7fc700 1 -- 172.21.15.5:0/1149082955 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16628 (secure 0 0 0) 0x7f2d24018020 con 0x7f2d3406e750 2023-10-16T13:39:49.896 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:49.897 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:43.224207+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1052521879":"2023-10-17T13:39:40.217218+0000","172.21.15.112:6835/1052521879":"2023-10-17T13:39:40.217218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d1806af00 msgr2=0x7f2d1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d1806af00 0x7f2d1806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30008030 comp rx=0 tx=0).stop 2023-10-16T13:39:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 msgr2=0x7f2d34156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 0x7f2d34156400 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c750 tx=0x7f2d2400cb10 comp rx=0 tx=0).stop 2023-10-16T13:39:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 shutdown_connections 2023-10-16T13:39:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d340b54f0 0x7f2d340ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d3406e750 0x7f2d34156400 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d1806af00 0x7f2d1806d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 --2- 172.21.15.5:0/1149082955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d3406eb30 0x7f2d340c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 >> 172.21.15.5:0/1149082955 conn(0x7f2d340cc6f0 msgr2=0x7f2d340b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 shutdown_connections 2023-10-16T13:39:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:49.896+0000 7f2d3bcee700 1 -- 172.21.15.5:0/1149082955 wait complete. 2023-10-16T13:39:49.911 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:39:49.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.034+0000 7f0247519700 1 Processor -- start 2023-10-16T13:39:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.034+0000 7f0247519700 1 -- start start 2023-10-16T13:39:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0247519700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f024015f1f0 0x7f02400cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0247519700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024015e7a0 con 0x7f024015ab10 2023-10-16T13:39:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0247519700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02400d0090 con 0x7f02400cfc60 2023-10-16T13:39:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0247519700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02400b29a0 con 0x7f024015f1f0 2023-10-16T13:39:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f02452b5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f024015ab10 0x7f02400b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54374/0 (socket says 172.21.15.5:54374) 2023-10-16T13:39:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f02452b5700 1 -- 172.21.15.5:0/2659564454 learned_addr learned my addr 172.21.15.5:0/2659564454 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0244ab4700 1 --2- 172.21.15.5:0/2659564454 >> v2:172.21.15.112:3300/0 conn(0x7f024015f1f0 0x7f02400cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244723747 0 0) 0x7f024015e7a0 con 0x7f024015ab10 2023-10-16T13:39:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c0035b0 con 0x7f024015ab10 2023-10-16T13:39:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909039765 0 0) 0x7f02400d0090 con 0x7f02400cfc60 2023-10-16T13:39:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f024015e7a0 con 0x7f02400cfc60 2023-10-16T13:39:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 429588871 0 0) 0x7f022c0035b0 con 0x7f024015ab10 2023-10-16T13:39:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0244ab4700 1 -- 172.21.15.5:0/2659564454 >> v1:172.21.15.112:6789/0 conn(0x7f02400cfc60 legacy=0x7f02400cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0244ab4700 1 -- 172.21.15.5:0/2659564454 >> v1:172.21.15.5:6789/0 conn(0x7f024015ab10 legacy=0x7f02400b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0244ab4700 1 -- 172.21.15.5:0/2659564454 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400b2c80 con 0x7f024015f1f0 2023-10-16T13:39:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.035+0000 7f0244ab4700 1 --2- 172.21.15.5:0/2659564454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f024015f1f0 0x7f02400cf720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0230009820 tx=0x7f0230009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=357cb15f44cfde45 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c001670 con 0x7f024015f1f0 2023-10-16T13:39:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230005c30 con 0x7f024015f1f0 2023-10-16T13:39:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0237fff700 1 -- 172.21.15.5:0/2659564454 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230004030 con 0x7f024015f1f0 2023-10-16T13:39:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 -- 172.21.15.5:0/2659564454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f024015f1f0 msgr2=0x7f02400cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 --2- 172.21.15.5:0/2659564454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f024015f1f0 0x7f02400cf720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0230009820 tx=0x7f0230009b30 comp rx=0 tx=0).stop 2023-10-16T13:39:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 -- 172.21.15.5:0/2659564454 shutdown_connections 2023-10-16T13:39:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 --2- 172.21.15.5:0/2659564454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f024015f1f0 0x7f02400cf720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 -- 172.21.15.5:0/2659564454 >> 172.21.15.5:0/2659564454 conn(0x7f024006dae0 msgr2=0x7f024006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 -- 172.21.15.5:0/2659564454 shutdown_connections 2023-10-16T13:39:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.036+0000 7f0247519700 1 -- 172.21.15.5:0/2659564454 wait complete. 2023-10-16T13:39:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 Processor -- start 2023-10-16T13:39:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 -- start start 2023-10-16T13:39:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02400cfc60 0x7f024014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 0x7f02400c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f024015f1f0 0x7f024015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400c97d0 con 0x7f024015ab10 2023-10-16T13:39:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02401f0e80 con 0x7f02400cfc60 2023-10-16T13:39:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0247519700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400c94a0 con 0x7f024015f1f0 2023-10-16T13:39:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0244ab4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 0x7f02400c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0244ab4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 0x7f02400c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44378/0 (socket says 172.21.15.5:44378) 2023-10-16T13:39:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.038+0000 7f0244ab4700 1 -- 172.21.15.5:0/4072298287 learned_addr learned my addr 172.21.15.5:0/4072298287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0244ab4700 1 -- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f024015f1f0 msgr2=0x7f024015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0244ab4700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f024015f1f0 0x7f024015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0244ab4700 1 -- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02400cfc60 msgr2=0x7f024014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f02452b5700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02400cfc60 0x7f024014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0244ab4700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02400cfc60 0x7f024014e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0244ab4700 1 -- 172.21.15.5:0/4072298287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009430 con 0x7f024015ab10 2023-10-16T13:39:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0244ab4700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 0x7f02400c8a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f024006d4f0 tx=0x7f0230004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230003bb0 con 0x7f024015ab10 2023-10-16T13:39:50.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230003d10 con 0x7f024015ab10 2023-10-16T13:39:50.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02401f1120 con 0x7f024015ab10 2023-10-16T13:39:50.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023001d650 con 0x7f024015ab10 2023-10-16T13:39:50.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.039+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02400c8fb0 con 0x7f024015ab10 2023-10-16T13:39:50.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.040+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02400c9940 con 0x7f024015ab10 2023-10-16T13:39:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.041+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f023001d7b0 con 0x7f024015ab10 2023-10-16T13:39:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.041+0000 7f0235ffb700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f022406af00 0x7f022406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.041+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f023008a950 con 0x7f024015ab10 2023-10-16T13:39:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.041+0000 7f02452b5700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f022406af00 0x7f022406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.042+0000 7f02452b5700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f022406af00 0x7f022406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f023c0017a0 tx=0x7f023c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.046+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0230055a30 con 0x7f024015ab10 2023-10-16T13:39:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.290+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02400afc10 con 0x7f024015ab10 2023-10-16T13:39:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.291+0000 7f0235ffb700 1 -- 172.21.15.5:0/4072298287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f0230016020 con 0x7f024015ab10 2023-10-16T13:39:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:50.294 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1675250334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1675250334},{"type":"v1","addr":"172.21.15.112:6837","nonce":1675250334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:20.312787+0000","modified":"2023-10-16T13:39:23.333172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6834/3128747669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3128747669},{"type":"v1","addr":"172.21.15.5:6834","nonce":3128747669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:39:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f022406af00 msgr2=0x7f022406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f022406af00 0x7f022406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f023c0017a0 tx=0x7f023c009040 comp rx=0 tx=0).stop 2023-10-16T13:39:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 msgr2=0x7f02400c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 0x7f02400c8a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f024006d4f0 tx=0x7f0230004750 comp rx=0 tx=0).stop 2023-10-16T13:39:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 shutdown_connections 2023-10-16T13:39:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f022406af00 0x7f022406d3c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f024015f1f0 0x7f024015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02400cfc60 0x7f024014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 --2- 172.21.15.5:0/4072298287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f024015ab10 0x7f02400c8a70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 >> 172.21.15.5:0/4072298287 conn(0x7f024006dae0 msgr2=0x7f02400d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 shutdown_connections 2023-10-16T13:39:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.293+0000 7f0247519700 1 -- 172.21.15.5:0/4072298287 wait complete. 2023-10-16T13:39:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2023-10-16T13:39:50.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:50.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.429+0000 7fe0a5895700 1 Processor -- start 2023-10-16T13:39:50.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.429+0000 7fe0a5895700 1 -- start start 2023-10-16T13:39:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe0a5895700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0a00cd950 0x7fe0a015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe0a5895700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0a00cede0 0x7fe0a015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe0a5895700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a006a840 0x7fe0a006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe0a5895700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a01619a0 con 0x7fe0a00cede0 2023-10-16T13:39:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe0a5895700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006b1f0 con 0x7fe0a00cd950 2023-10-16T13:39:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe0a5895700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00cf290 con 0x7fe0a006a840 2023-10-16T13:39:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe09e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0a00cede0 0x7fe0a015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe09e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0a00cede0 0x7fe0a015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44384/0 (socket says 172.21.15.5:44384) 2023-10-16T13:39:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.430+0000 7fe09e7fc700 1 -- 172.21.15.5:0/3798674435 learned_addr learned my addr 172.21.15.5:0/3798674435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09f7fe700 1 --2- 172.21.15.5:0/3798674435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a006a840 0x7fe0a006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09effd700 1 --2- 172.21.15.5:0/3798674435 >> v2:172.21.15.112:3300/0 conn(0x7fe0a00cd950 0x7fe0a015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09e7fc700 1 -- 172.21.15.5:0/3798674435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a006a840 msgr2=0x7fe0a006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09e7fc700 1 --2- 172.21.15.5:0/3798674435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a006a840 0x7fe0a006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09e7fc700 1 -- 172.21.15.5:0/3798674435 >> v2:172.21.15.112:3300/0 conn(0x7fe0a00cd950 msgr2=0x7fe0a015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09e7fc700 1 --2- 172.21.15.5:0/3798674435 >> v2:172.21.15.112:3300/0 conn(0x7fe0a00cd950 0x7fe0a015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09e7fc700 1 -- 172.21.15.5:0/3798674435 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00b2d60 con 0x7fe0a00cede0 2023-10-16T13:39:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09effd700 1 --2- 172.21.15.5:0/3798674435 >> v2:172.21.15.112:3300/0 conn(0x7fe0a00cd950 0x7fe0a015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09e7fc700 1 --2- 172.21.15.5:0/3798674435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a00cede0 0x7fe0a015f570 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00d0430 tx=0x7fe090009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805ea9008bda6add server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09dffb700 1 -- 172.21.15.5:0/3798674435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090005e30 con 0x7fe0a00cede0 2023-10-16T13:39:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09dffb700 1 -- 172.21.15.5:0/3798674435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090004030 con 0x7fe0a00cede0 2023-10-16T13:39:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe09dffb700 1 -- 172.21.15.5:0/3798674435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900043e0 con 0x7fe0a00cede0 2023-10-16T13:39:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe0a5895700 1 -- 172.21.15.5:0/3798674435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a00cede0 msgr2=0x7fe0a015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe0a5895700 1 --2- 172.21.15.5:0/3798674435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a00cede0 0x7fe0a015f570 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00d0430 tx=0x7fe090009bd0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe0a5895700 1 -- 172.21.15.5:0/3798674435 shutdown_connections 2023-10-16T13:39:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe0a5895700 1 --2- 172.21.15.5:0/3798674435 >> v2:172.21.15.112:3300/0 conn(0x7fe0a00cd950 0x7fe0a015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe0a5895700 1 --2- 172.21.15.5:0/3798674435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a006a840 0x7fe0a006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.431+0000 7fe0a5895700 1 --2- 172.21.15.5:0/3798674435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a00cede0 0x7fe0a015f570 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.432+0000 7fe0a5895700 1 -- 172.21.15.5:0/3798674435 >> 172.21.15.5:0/3798674435 conn(0x7fe0a006dae0 msgr2=0x7fe0a006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.432+0000 7fe0a5895700 1 -- 172.21.15.5:0/3798674435 shutdown_connections 2023-10-16T13:39:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.432+0000 7fe0a5895700 1 -- 172.21.15.5:0/3798674435 wait complete. 2023-10-16T13:39:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.433+0000 7fe0a5895700 1 Processor -- start 2023-10-16T13:39:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.433+0000 7fe0a5895700 1 -- start start 2023-10-16T13:39:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 0x7fe0a00af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a00cd950 0x7fe0a015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a00cede0 0x7fe0a00b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00cbb10 con 0x7fe0a006a840 2023-10-16T13:39:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015ca70 con 0x7fe0a00cede0 2023-10-16T13:39:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00b4630 con 0x7fe0a00cd950 2023-10-16T13:39:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 0x7fe0a00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 0x7fe0a00af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44390/0 (socket says 172.21.15.5:44390) 2023-10-16T13:39:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 -- 172.21.15.5:0/2373817348 learned_addr learned my addr 172.21.15.5:0/2373817348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09e7fc700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a00cd950 0x7fe0a015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09f7fe700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a00cede0 0x7fe0a00b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 -- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a00cd950 msgr2=0x7fe0a015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a00cd950 0x7fe0a015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 -- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a00cede0 msgr2=0x7fe0a00b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a00cede0 0x7fe0a00b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 -- 172.21.15.5:0/2373817348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090009500 con 0x7fe0a006a840 2023-10-16T13:39:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09f7fe700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a00cede0 0x7fe0a00b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe09effd700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 0x7fe0a00af580 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c750 tx=0x7fe09400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094011800 con 0x7fe0a006a840 2023-10-16T13:39:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094011960 con 0x7fe0a006a840 2023-10-16T13:39:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00cbd00 con 0x7fe0a006a840 2023-10-16T13:39:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094011cd0 con 0x7fe0a006a840 2023-10-16T13:39:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.434+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a00cc2c0 con 0x7fe0a006a840 2023-10-16T13:39:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.435+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0067d20 con 0x7fe0a006a840 2023-10-16T13:39:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.436+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe094021350 con 0x7fe0a006a840 2023-10-16T13:39:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.436+0000 7fe087fff700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe08c06af00 0x7fe08c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.436+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe094089540 con 0x7fe0a006a840 2023-10-16T13:39:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.437+0000 7fe09e7fc700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe08c06af00 0x7fe08c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.437+0000 7fe09e7fc700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe08c06af00 0x7fe08c06d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00d0430 tx=0x7fe090008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.441+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe094054620 con 0x7fe0a006a840 2023-10-16T13:39:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.687+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0a00b2100 con 0x7fe0a006a840 2023-10-16T13:39:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.688+0000 7fe087fff700 1 -- 172.21.15.5:0/2373817348 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fe09405e020 con 0x7fe0a006a840 2023-10-16T13:39:50.691 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:50.691 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1675250334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1675250334},{"type":"v1","addr":"172.21.15.112:6837","nonce":1675250334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:39:20.312787+0000","modified":"2023-10-16T13:39:23.333172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6834/3128747669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3128747669},{"type":"v1","addr":"172.21.15.5:6834","nonce":3128747669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:39:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe08c06af00 msgr2=0x7fe08c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe08c06af00 0x7fe08c06d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00d0430 tx=0x7fe090008070 comp rx=0 tx=0).stop 2023-10-16T13:39:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 msgr2=0x7fe0a00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 0x7fe0a00af580 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c750 tx=0x7fe09400cb10 comp rx=0 tx=0).stop 2023-10-16T13:39:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 shutdown_connections 2023-10-16T13:39:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a00cede0 0x7fe0a00b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0a006a840 0x7fe0a00af580 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe08c06af00 0x7fe08c06d3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 --2- 172.21.15.5:0/2373817348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe0a00cd950 0x7fe0a015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 >> 172.21.15.5:0/2373817348 conn(0x7fe0a006dae0 msgr2=0x7fe0a00c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 shutdown_connections 2023-10-16T13:39:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.690+0000 7fe0a5895700 1 -- 172.21.15.5:0/2373817348 wait complete. 2023-10-16T13:39:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2023-10-16T13:39:50.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.827+0000 7f20f51cb700 1 Processor -- start 2023-10-16T13:39:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.827+0000 7f20f51cb700 1 -- start start 2023-10-16T13:39:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.828+0000 7f20f51cb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20f015dbf0 0x7f20f00d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.828+0000 7f20f51cb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f0070bc0 con 0x7f20f015dfd0 2023-10-16T13:39:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.828+0000 7f20f51cb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f006f710 con 0x7f20f0070770 2023-10-16T13:39:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.828+0000 7f20f51cb700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f006f9b0 con 0x7f20f015dbf0 2023-10-16T13:39:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.828+0000 7f20ee59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20f015dfd0 0x7f20f00b07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54402/0 (socket says 172.21.15.5:54402) 2023-10-16T13:39:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.828+0000 7f20ee59c700 1 -- 172.21.15.5:0/1025761751 learned_addr learned my addr 172.21.15.5:0/1025761751 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20eed9d700 1 --2- 172.21.15.5:0/1025761751 >> v2:172.21.15.112:3300/0 conn(0x7f20f015dbf0 0x7f20f00d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418139792 0 0) 0x7f20f0070bc0 con 0x7f20f015dfd0 2023-10-16T13:39:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20dc0035b0 con 0x7f20f015dfd0 2023-10-16T13:39:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658260650 0 0) 0x7f20f006f710 con 0x7f20f0070770 2023-10-16T13:39:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f0070bc0 con 0x7f20f0070770 2023-10-16T13:39:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766323932 0 0) 0x7f20dc0035b0 con 0x7f20f015dfd0 2023-10-16T13:39:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 >> v2:172.21.15.112:3300/0 conn(0x7f20f015dbf0 msgr2=0x7f20f00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 --2- 172.21.15.5:0/1025761751 >> v2:172.21.15.112:3300/0 conn(0x7f20f015dbf0 0x7f20f00d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 >> v1:172.21.15.112:6789/0 conn(0x7f20f0070770 legacy=0x7f20f00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f006fc90 con 0x7f20f015dfd0 2023-10-16T13:39:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f20d8001670 con 0x7f20f015dfd0 2023-10-16T13:39:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20eed9d700 1 --2- 172.21.15.5:0/1025761751 >> v2:172.21.15.112:3300/0 conn(0x7f20f015dbf0 0x7f20f00d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 >> v1:172.21.15.5:6789/0 conn(0x7f20f015dfd0 legacy=0x7f20f00b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc003b90 0x7f20dc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc005210 0x7f20dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f006f9b0 con 0x7f20dc004850 2023-10-16T13:39:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc00c000 con 0x7f20dc005210 2023-10-16T13:39:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc00c1c0 con 0x7f20dc003b90 2023-10-16T13:39:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20ee59c700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20eed9d700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc003b90 0x7f20dc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.829+0000 7f20ef59e700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc005210 0x7f20dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ee59c700 1 -- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc003b90 msgr2=0x7f20dc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ee59c700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc003b90 0x7f20dc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ee59c700 1 -- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc005210 msgr2=0x7f20dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ee59c700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc005210 0x7f20dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ee59c700 1 -- 172.21.15.5:0/1025761751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0035b0 con 0x7f20dc004850 2023-10-16T13:39:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ef59e700 1 -- 172.21.15.5:0/1025761751 reap_dead start 2023-10-16T13:39:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20ee59c700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20dc004cd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f20d8001eb0 tx=0x7f20dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dabd41f6138c5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800cd20 con 0x7f20dc004850 2023-10-16T13:39:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8005960 con 0x7f20dc004850 2023-10-16T13:39:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20edd9b700 1 -- 172.21.15.5:0/1025761751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800cea0 con 0x7f20dc004850 2023-10-16T13:39:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 -- 172.21.15.5:0/1025761751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 msgr2=0x7f20dc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20dc004cd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f20d8001eb0 tx=0x7f20dc005880 comp rx=0 tx=0).stop 2023-10-16T13:39:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 -- 172.21.15.5:0/1025761751 shutdown_connections 2023-10-16T13:39:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 --2- 172.21.15.5:0/1025761751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20dc004cd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 -- 172.21.15.5:0/1025761751 >> 172.21.15.5:0/1025761751 conn(0x7f20f00d1620 msgr2=0x7f20f00d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 -- 172.21.15.5:0/1025761751 shutdown_connections 2023-10-16T13:39:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.830+0000 7f20f51cb700 1 -- 172.21.15.5:0/1025761751 wait complete. 2023-10-16T13:39:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.832+0000 7f20f51cb700 1 Processor -- start 2023-10-16T13:39:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.832+0000 7f20f51cb700 1 -- start start 2023-10-16T13:39:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20f01f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20f0154430 0x7f20f01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01548b0 0x7f20f00c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0153fa0 con 0x7f20dc004850 2023-10-16T13:39:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f01536b0 con 0x7f20f01548b0 2023-10-16T13:39:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0155e40 con 0x7f20f0154430 2023-10-16T13:39:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20f01f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20f01f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44408/0 (socket says 172.21.15.5:44408) 2023-10-16T13:39:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 -- 172.21.15.5:0/3969593036 learned_addr learned my addr 172.21.15.5:0/3969593036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20ef59e700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01548b0 0x7f20f00c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20ee59c700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20f0154430 0x7f20f01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 -- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20f0154430 msgr2=0x7f20f01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20f0154430 0x7f20f01553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 -- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01548b0 msgr2=0x7f20f00c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01548b0 0x7f20f00c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 -- 172.21.15.5:0/3969593036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0153950 con 0x7f20dc004850 2023-10-16T13:39:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20ef59e700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01548b0 0x7f20f00c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20eed9d700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20f01f2ae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20e0011cd0 tx=0x7f20e000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000fb30 con 0x7f20dc004850 2023-10-16T13:39:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000fc90 con 0x7f20dc004850 2023-10-16T13:39:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004030 con 0x7f20dc004850 2023-10-16T13:39:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.833+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0153c30 con 0x7f20dc004850 2023-10-16T13:39:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.834+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f0148780 con 0x7f20dc004850 2023-10-16T13:39:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.835+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f006eb00 con 0x7f20dc004850 2023-10-16T13:39:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.835+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20e0004190 con 0x7f20dc004850 2023-10-16T13:39:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.835+0000 7f20e77fe700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20d006af00 0x7f20d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.835+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f20e0089c40 con 0x7f20dc004850 2023-10-16T13:39:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.835+0000 7f20ee59c700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20d006af00 0x7f20d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.836+0000 7f20ee59c700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20d006af00 0x7f20d006d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f20f00b0240 tx=0x7f20d8007f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:50.840+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20e0054c90 con 0x7f20dc004850 2023-10-16T13:39:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.041+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20f0160ee0 con 0x7f20dc004850 2023-10-16T13:39:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.043+0000 7f20e77fe700 1 -- 172.21.15.5:0/3969593036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16628 (secure 0 0 0) 0x7f20e0022070 con 0x7f20dc004850 2023-10-16T13:39:51.045 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:51.046 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:43.224207+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:39:18.336237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-16T13:39:19.288524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1052521879":"2023-10-17T13:39:40.217218+0000","172.21.15.112:6835/1052521879":"2023-10-17T13:39:40.217218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.044+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20d006af00 msgr2=0x7f20d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.044+0000 7f20f51cb700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20d006af00 0x7f20d006d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f20f00b0240 tx=0x7f20d8007f90 comp rx=0 tx=0).stop 2023-10-16T13:39:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.044+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 msgr2=0x7f20f01f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.044+0000 7f20f51cb700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20f01f2ae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20e0011cd0 tx=0x7f20e000f520 comp rx=0 tx=0).stop 2023-10-16T13:39:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 shutdown_connections 2023-10-16T13:39:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01548b0 0x7f20f00c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc004850 0x7f20f01f2ae0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20d006af00 0x7f20d006d3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 --2- 172.21.15.5:0/3969593036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20f0154430 0x7f20f01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 >> 172.21.15.5:0/3969593036 conn(0x7f20f00d1620 msgr2=0x7f20f00d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 shutdown_connections 2023-10-16T13:39:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.045+0000 7f20f51cb700 1 -- 172.21.15.5:0/3969593036 wait complete. 2023-10-16T13:39:51.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:39:51.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.183+0000 7fe44dc58700 1 Processor -- start 2023-10-16T13:39:51.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.183+0000 7fe44dc58700 1 -- start start 2023-10-16T13:39:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe44dc58700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe44815d9e0 0x7fe44815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe44dc58700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe4480d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe44dc58700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4480ce350 con 0x7fe448161800 2023-10-16T13:39:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe44dc58700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480b5140 con 0x7fe44815d9e0 2023-10-16T13:39:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe44dc58700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe448162630 con 0x7fe4480d1fc0 2023-10-16T13:39:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe447fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe448161800 0x7fe4480cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54424/0 (socket says 172.21.15.5:54424) 2023-10-16T13:39:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe447fff700 1 -- 172.21.15.5:0/1081947365 learned_addr learned my addr 172.21.15.5:0/1081947365 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe4477fe700 1 --2- 172.21.15.5:0/1081947365 >> v2:172.21.15.112:3300/0 conn(0x7fe44815d9e0 0x7fe44815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe446ffd700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe4480d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868445877 0 0) 0x7fe4480ce350 con 0x7fe448161800 2023-10-16T13:39:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.184+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4340035b0 con 0x7fe448161800 2023-10-16T13:39:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456538966 0 0) 0x7fe4340035b0 con 0x7fe448161800 2023-10-16T13:39:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 msgr2=0x7fe4480d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe4480d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 >> v2:172.21.15.112:3300/0 conn(0x7fe44815d9e0 msgr2=0x7fe44815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 --2- 172.21.15.5:0/1081947365 >> v2:172.21.15.112:3300/0 conn(0x7fe44815d9e0 0x7fe44815ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480ce5f0 con 0x7fe448161800 2023-10-16T13:39:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fe4400019f0 con 0x7fe448161800 2023-10-16T13:39:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 --2- 172.21.15.5:0/1081947365 >> v2:172.21.15.112:3300/0 conn(0x7fe44815d9e0 0x7fe44815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 >> v1:172.21.15.5:6789/0 conn(0x7fe448161800 legacy=0x7fe4480cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe434003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe434004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe434004d90 0x7fe434005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480b5140 con 0x7fe434003a00 2023-10-16T13:39:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe448162630 con 0x7fe434004d90 2023-10-16T13:39:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43400ba10 con 0x7fe4480d1fc0 2023-10-16T13:39:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe434003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe446ffd700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe434004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe447fff700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe434004d90 0x7fe434005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 -- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 msgr2=0x7fe434004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe434004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 -- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe434004d90 msgr2=0x7fe434005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe434004d90 0x7fe434005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 -- 172.21.15.5:0/1081947365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340035b0 con 0x7fe434003a00 2023-10-16T13:39:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe446ffd700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480d1fc0 0x7fe434004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.185+0000 7fe4477fe700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe434003e20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe438009d30 tx=0x7fe434005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8de7a93490cba8d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438009e80 con 0x7fe434003a00 2023-10-16T13:39:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43800e9a0 con 0x7fe434003a00 2023-10-16T13:39:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe4467fc700 1 -- 172.21.15.5:0/1081947365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43800ed30 con 0x7fe434003a00 2023-10-16T13:39:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe44dc58700 1 -- 172.21.15.5:0/1081947365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 msgr2=0x7fe434003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe44dc58700 1 --2- 172.21.15.5:0/1081947365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe434003e20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe438009d30 tx=0x7fe434005880 comp rx=0 tx=0).stop 2023-10-16T13:39:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe447fff700 1 -- 172.21.15.5:0/1081947365 reap_dead start 2023-10-16T13:39:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe44dc58700 1 -- 172.21.15.5:0/1081947365 shutdown_connections 2023-10-16T13:39:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe44dc58700 1 -- 172.21.15.5:0/1081947365 >> 172.21.15.5:0/1081947365 conn(0x7fe44809cb40 msgr2=0x7fe4480d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe44dc58700 1 -- 172.21.15.5:0/1081947365 shutdown_connections 2023-10-16T13:39:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.186+0000 7fe44dc58700 1 -- 172.21.15.5:0/1081947365 wait complete. 2023-10-16T13:39:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.187+0000 7fe44dc58700 1 Processor -- start 2023-10-16T13:39:51.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 -- start start 2023-10-16T13:39:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe4480d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4480d0610 0x7fe4480b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480b1930 0x7fe4480b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480d0a90 con 0x7fe434003a00 2023-10-16T13:39:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480b2750 con 0x7fe4480d0610 2023-10-16T13:39:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe44dc58700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44814a0f0 con 0x7fe4480b1930 2023-10-16T13:39:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe4477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe4480d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe4477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe4480d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44428/0 (socket says 172.21.15.5:44428) 2023-10-16T13:39:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.188+0000 7fe4477fe700 1 -- 172.21.15.5:0/3234159827 learned_addr learned my addr 172.21.15.5:0/3234159827 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe446ffd700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4480d0610 0x7fe4480b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe447fff700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480b1930 0x7fe4480b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe4477fe700 1 -- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480b1930 msgr2=0x7fe4480b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe4477fe700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480b1930 0x7fe4480b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe4477fe700 1 -- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4480d0610 msgr2=0x7fe4480b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe4477fe700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4480d0610 0x7fe4480b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe4477fe700 1 -- 172.21.15.5:0/3234159827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44814a3d0 con 0x7fe434003a00 2023-10-16T13:39:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe446ffd700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4480d0610 0x7fe4480b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe447fff700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480b1930 0x7fe4480b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe4477fe700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe4480d00d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe434004770 tx=0x7fe4380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438006e60 con 0x7fe434003a00 2023-10-16T13:39:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43801c650 con 0x7fe434003a00 2023-10-16T13:39:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43801ca00 con 0x7fe434003a00 2023-10-16T13:39:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4480c8920 con 0x7fe434003a00 2023-10-16T13:39:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.189+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4480ca8a0 con 0x7fe434003a00 2023-10-16T13:39:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.190+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4480d09f0 con 0x7fe434003a00 2023-10-16T13:39:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.191+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe43801cb60 con 0x7fe434003a00 2023-10-16T13:39:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.191+0000 7fe43ffff700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe42806af00 0x7fe42806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.191+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe43808b200 con 0x7fe434003a00 2023-10-16T13:39:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.191+0000 7fe446ffd700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe42806af00 0x7fe42806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.192+0000 7fe446ffd700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe42806af00 0x7fe42806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe4480d1f90 tx=0x7fe430008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.196+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe438056400 con 0x7fe434003a00 2023-10-16T13:39:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.443+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe448067d20 con 0x7fe434003a00 2023-10-16T13:39:51.446 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:39:51.443+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:39:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.444+0000 7fe43ffff700 1 -- 172.21.15.5:0/3234159827 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe438059a20 con 0x7fe434003a00 2023-10-16T13:39:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe42806af00 msgr2=0x7fe42806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe42806af00 0x7fe42806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe4480d1f90 tx=0x7fe430008040 comp rx=0 tx=0).stop 2023-10-16T13:39:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 msgr2=0x7fe4480d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe4480d00d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe434004770 tx=0x7fe4380047c0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 shutdown_connections 2023-10-16T13:39:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe42806af00 0x7fe42806d3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4480b1930 0x7fe4480b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe434003a00 0x7fe4480d00d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 --2- 172.21.15.5:0/3234159827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4480d0610 0x7fe4480b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 >> 172.21.15.5:0/3234159827 conn(0x7fe44809cb40 msgr2=0x7fe4480d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 shutdown_connections 2023-10-16T13:39:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.448+0000 7fe44dc58700 1 -- 172.21.15.5:0/3234159827 wait complete. 2023-10-16T13:39:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:39:51.454 INFO:tasks.ceph.mds.a.smithi005.stderr: -3734> 2023-10-16T13:39:24.782+0000 7f934e5fa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:39:51.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:39:51.481 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:39:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 Processor -- start 2023-10-16T13:39:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 -- start start 2023-10-16T13:39:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f21980cd950 0x7f219815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f219806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21980cf290 con 0x7f21980cede0 2023-10-16T13:39:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21981619a0 con 0x7f21980cd950 2023-10-16T13:39:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.589+0000 7f219df76700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219806b1f0 con 0x7f219806a840 2023-10-16T13:39:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21977fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f21980cd950 0x7f219815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f2197fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f219806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f2196ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f21980cede0 0x7f219815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45430/0 (socket says 172.21.15.5:45430) 2023-10-16T13:39:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f2196ffd700 1 -- 172.21.15.5:0/2797417220 learned_addr learned my addr 172.21.15.5:0/2797417220 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21967fc700 1 -- 172.21.15.5:0/2797417220 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157839690 0 0) 0x7f21980cf290 con 0x7f21980cede0 2023-10-16T13:39:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21967fc700 1 -- 172.21.15.5:0/2797417220 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21800035b0 con 0x7f21980cede0 2023-10-16T13:39:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21977fe700 1 -- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 msgr2=0x7f219806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21977fe700 1 --2- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f219806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21977fe700 1 -- 172.21.15.5:0/2797417220 >> v1:172.21.15.112:6789/0 conn(0x7f21980cede0 legacy=0x7f219815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21977fe700 1 -- 172.21.15.5:0/2797417220 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980b2d60 con 0x7f21980cd950 2023-10-16T13:39:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21977fe700 1 --2- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cd950 0x7f219815e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2188009840 tx=0x7f2188009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c980d43b2be110d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.590+0000 7f21967fc700 1 -- 172.21.15.5:0/2797417220 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011830 con 0x7f21980cd950 2023-10-16T13:39:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f21967fc700 1 -- 172.21.15.5:0/2797417220 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188011990 con 0x7f21980cd950 2023-10-16T13:39:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f21967fc700 1 -- 172.21.15.5:0/2797417220 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011d20 con 0x7f21980cd950 2023-10-16T13:39:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 -- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cd950 msgr2=0x7f219815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 --2- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cd950 0x7f219815e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2188009840 tx=0x7f2188009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 -- 172.21.15.5:0/2797417220 shutdown_connections 2023-10-16T13:39:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 --2- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cd950 0x7f219815e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 --2- 172.21.15.5:0/2797417220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f219806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 -- 172.21.15.5:0/2797417220 >> 172.21.15.5:0/2797417220 conn(0x7f219806dae0 msgr2=0x7f219806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 -- 172.21.15.5:0/2797417220 shutdown_connections 2023-10-16T13:39:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.591+0000 7f219df76700 1 -- 172.21.15.5:0/2797417220 wait complete. 2023-10-16T13:39:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.592+0000 7f219df76700 1 Processor -- start 2023-10-16T13:39:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.592+0000 7f219df76700 1 -- start start 2023-10-16T13:39:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f219df76700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f21980b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f219df76700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 0x7f21981600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f219df76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cede0 0x7f2198160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f219df76700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980b3190 con 0x7f21980cd950 2023-10-16T13:39:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f219df76700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c8250 con 0x7f21980cede0 2023-10-16T13:39:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f219df76700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980b5d00 con 0x7f219806a840 2023-10-16T13:39:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f2196ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 0x7f21981600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f2196ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 0x7f21981600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44456/0 (socket says 172.21.15.5:44456) 2023-10-16T13:39:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f2196ffd700 1 -- 172.21.15.5:0/544515178 learned_addr learned my addr 172.21.15.5:0/544515178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f21977fe700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f21980b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.593+0000 7f2197fff700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cede0 0x7f2198160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2196ffd700 1 -- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 msgr2=0x7f21980b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2196ffd700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f21980b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2196ffd700 1 -- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cede0 msgr2=0x7f2198160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2196ffd700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cede0 0x7f2198160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2196ffd700 1 -- 172.21.15.5:0/544515178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880094a0 con 0x7f21980cd950 2023-10-16T13:39:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2197fff700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cede0 0x7f2198160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f2196ffd700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 0x7f21981600d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f218c001130 tx=0x7f218c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c005dc0 con 0x7f21980cd950 2023-10-16T13:39:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0070d0 con 0x7f21980cd950 2023-10-16T13:39:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21980c7640 con 0x7f21980cd950 2023-10-16T13:39:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c007460 con 0x7f21980cd950 2023-10-16T13:39:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.594+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21980c7c00 con 0x7f21980cd950 2023-10-16T13:39:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.595+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21980c8400 con 0x7f21980cd950 2023-10-16T13:39:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.596+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f218c0075c0 con 0x7f21980cd950 2023-10-16T13:39:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.596+0000 7f217ffff700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af00 0x7f218406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.596+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f218c088df0 con 0x7f21980cd950 2023-10-16T13:39:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.596+0000 7f21977fe700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af00 0x7f218406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.597+0000 7f21977fe700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af00 0x7f218406d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2188000c00 tx=0x7f2188008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.601+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21980c8400 con 0x7f21980cd950 2023-10-16T13:39:51.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:51.848+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f21980c8400 con 0x7f21980cd950 2023-10-16T13:39:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.450+0000 7f217ffff700 1 -- 172.21.15.5:0/544515178 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21980c8400 con 0x7f21980cd950 2023-10-16T13:39:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af00 msgr2=0x7f218406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af00 0x7f218406d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2188000c00 tx=0x7f2188008030 comp rx=0 tx=0).stop 2023-10-16T13:39:52.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 msgr2=0x7f21981600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 0x7f21981600d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f218c001130 tx=0x7f218c00ca90 comp rx=0 tx=0).stop 2023-10-16T13:39:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 shutdown_connections 2023-10-16T13:39:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21980cede0 0x7f2198160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af00 0x7f218406d3c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f219806a840 0x7f21980b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 --2- 172.21.15.5:0/544515178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21980cd950 0x7f21981600d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 >> 172.21.15.5:0/544515178 conn(0x7f219806dae0 msgr2=0x7f21980aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:52.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 shutdown_connections 2023-10-16T13:39:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.452+0000 7f219df76700 1 -- 172.21.15.5:0/544515178 wait complete. 2023-10-16T13:39:52.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:39:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.641+0000 7fbae6d54700 1 Processor -- start 2023-10-16T13:39:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.641+0000 7fbae6d54700 1 -- start start 2023-10-16T13:39:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae6d54700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbae015d840 0x7fbae0162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae6d54700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbae00cda40 0x7fbae00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae6d54700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00cee20 con 0x7fbae00cdfd0 2023-10-16T13:39:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae6d54700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00b2ce0 con 0x7fbae015d840 2023-10-16T13:39:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae6d54700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00ceb40 con 0x7fbae00cda40 2023-10-16T13:39:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae4af0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbae015d840 0x7fbae0162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbadffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbae00cdfd0 0x7fbae00cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54468/0 (socket says 172.21.15.5:54468) 2023-10-16T13:39:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbadffff700 1 -- 172.21.15.5:0/1738560913 learned_addr learned my addr 172.21.15.5:0/1738560913 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae52f1700 1 --2- 172.21.15.5:0/1738560913 >> v2:172.21.15.112:3300/0 conn(0x7fbae00cda40 0x7fbae00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae4af0700 1 -- 172.21.15.5:0/1738560913 >> v2:172.21.15.112:3300/0 conn(0x7fbae00cda40 msgr2=0x7fbae00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae4af0700 1 --2- 172.21.15.5:0/1738560913 >> v2:172.21.15.112:3300/0 conn(0x7fbae00cda40 0x7fbae00ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae4af0700 1 -- 172.21.15.5:0/1738560913 >> v1:172.21.15.5:6789/0 conn(0x7fbae00cdfd0 legacy=0x7fbae00cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.642+0000 7fbae4af0700 1 -- 172.21.15.5:0/1738560913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0161590 con 0x7fbae015d840 2023-10-16T13:39:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae4af0700 1 --2- 172.21.15.5:0/1738560913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae015d840 0x7fbae0162070 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbae00cca30 tx=0x7fbad4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd1d1dffd0eb82d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbadf7fe700 1 -- 172.21.15.5:0/1738560913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011830 con 0x7fbae015d840 2023-10-16T13:39:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbadf7fe700 1 -- 172.21.15.5:0/1738560913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad4011990 con 0x7fbae015d840 2023-10-16T13:39:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbadf7fe700 1 -- 172.21.15.5:0/1738560913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4011d20 con 0x7fbae015d840 2023-10-16T13:39:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 -- 172.21.15.5:0/1738560913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae015d840 msgr2=0x7fbae0162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 --2- 172.21.15.5:0/1738560913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae015d840 0x7fbae0162070 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbae00cca30 tx=0x7fbad4009b20 comp rx=0 tx=0).stop 2023-10-16T13:39:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 -- 172.21.15.5:0/1738560913 shutdown_connections 2023-10-16T13:39:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 --2- 172.21.15.5:0/1738560913 >> v2:172.21.15.112:3300/0 conn(0x7fbae00cda40 0x7fbae00ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 --2- 172.21.15.5:0/1738560913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae015d840 0x7fbae0162070 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 -- 172.21.15.5:0/1738560913 >> 172.21.15.5:0/1738560913 conn(0x7fbae006bd70 msgr2=0x7fbae006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 -- 172.21.15.5:0/1738560913 shutdown_connections 2023-10-16T13:39:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.643+0000 7fbae6d54700 1 -- 172.21.15.5:0/1738560913 wait complete. 2023-10-16T13:39:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.645+0000 7fbae6d54700 1 Processor -- start 2023-10-16T13:39:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.645+0000 7fbae6d54700 1 -- start start 2023-10-16T13:39:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.645+0000 7fbae6d54700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00cda40 0x7fbae0156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.645+0000 7fbae6d54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 0x7fbae00c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.645+0000 7fbae6d54700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbae015d840 0x7fbae00c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.645+0000 7fbae6d54700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00acfa0 con 0x7fbae00cdfd0 2023-10-16T13:39:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbae6d54700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae01e9840 con 0x7fbae015d840 2023-10-16T13:39:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbae6d54700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00ac950 con 0x7fbae00cda40 2023-10-16T13:39:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 0x7fbae00c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 0x7fbae00c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44472/0 (socket says 172.21.15.5:44472) 2023-10-16T13:39:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 -- 172.21.15.5:0/3245701609 learned_addr learned my addr 172.21.15.5:0/3245701609 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbae4af0700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00cda40 0x7fbae0156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 -- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00cda40 msgr2=0x7fbae0156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00cda40 0x7fbae0156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 -- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbae015d840 msgr2=0x7fbae00c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbae015d840 0x7fbae00c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:52.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 -- 172.21.15.5:0/3245701609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40094a0 con 0x7fbae00cdfd0 2023-10-16T13:39:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadffff700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 0x7fbae00c5030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c520 tx=0x7fbacc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc005d70 con 0x7fbae00cdfd0 2023-10-16T13:39:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc0070d0 con 0x7fbae00cdfd0 2023-10-16T13:39:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00acc30 con 0x7fbae00cdfd0 2023-10-16T13:39:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc007440 con 0x7fbae00cdfd0 2023-10-16T13:39:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.646+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae01e9b20 con 0x7fbae00cdfd0 2023-10-16T13:39:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.647+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae0067d20 con 0x7fbae00cdfd0 2023-10-16T13:39:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.648+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbacc0075a0 con 0x7fbae00cdfd0 2023-10-16T13:39:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.648+0000 7fbadd7fa700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbac406af00 0x7fbac406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.648+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbacc088a20 con 0x7fbae00cdfd0 2023-10-16T13:39:52.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.648+0000 7fbae4af0700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbac406af00 0x7fbac406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:52.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.649+0000 7fbae4af0700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbac406af00 0x7fbac406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbad40090b0 tx=0x7fbad4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:52.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.653+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbacc053ad0 con 0x7fbae00cdfd0 2023-10-16T13:39:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:52.852+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbae00b20c0 con 0x7fbae00cdfd0 2023-10-16T13:39:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.451+0000 7fbadd7fa700 1 -- 172.21.15.5:0/3245701609 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbacc0170d0 con 0x7fbae00cdfd0 2023-10-16T13:39:53.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbac406af00 msgr2=0x7fbac406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbac406af00 0x7fbac406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbad40090b0 tx=0x7fbad4008030 comp rx=0 tx=0).stop 2023-10-16T13:39:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 msgr2=0x7fbae00c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 0x7fbae00c5030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c520 tx=0x7fbacc00c8e0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 shutdown_connections 2023-10-16T13:39:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbae015d840 0x7fbae00c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbac406af00 0x7fbac406d3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00cda40 0x7fbae0156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 --2- 172.21.15.5:0/3245701609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae00cdfd0 0x7fbae00c5030 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.455+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 >> 172.21.15.5:0/3245701609 conn(0x7fbae006bd70 msgr2=0x7fbae00cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.456+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 shutdown_connections 2023-10-16T13:39:53.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.456+0000 7fbae6d54700 1 -- 172.21.15.5:0/3245701609 wait complete. 2023-10-16T13:39:53.462 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:39:53.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:39:53.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.601+0000 7f3517653700 1 Processor -- start 2023-10-16T13:39:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.602+0000 7f3517653700 1 -- start start 2023-10-16T13:39:53.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.602+0000 7f3517653700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f35100cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.602+0000 7f3517653700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100cbdb0 con 0x7f35100b0730 2023-10-16T13:39:53.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.602+0000 7f3517653700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100d0b40 con 0x7f35100cdf10 2023-10-16T13:39:53.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.602+0000 7f3517653700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100d0940 con 0x7f35100d04b0 2023-10-16T13:39:53.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3514bee700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f35100b0730 0x7f35100cc240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54482/0 (socket says 172.21.15.5:54482) 2023-10-16T13:39:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3514bee700 1 -- 172.21.15.5:0/570172475 learned_addr learned my addr 172.21.15.5:0/570172475 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087492369 0 0) 0x7f35100cbdb0 con 0x7f35100b0730 2023-10-16T13:39:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0035b0 con 0x7f35100b0730 2023-10-16T13:39:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3515bf0700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f35100cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 928492215 0 0) 0x7f34fc0035b0 con 0x7f35100b0730 2023-10-16T13:39:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 msgr2=0x7f35100cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f35100cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 >> v1:172.21.15.112:6789/0 conn(0x7f35100cdf10 legacy=0x7f35100ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100d0e20 con 0x7f35100b0730 2023-10-16T13:39:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f350c001670 con 0x7f35100b0730 2023-10-16T13:39:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 >> v1:172.21.15.5:6789/0 conn(0x7f35100b0730 legacy=0x7f35100cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f34fc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f34fc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34fc004d90 0x7f34fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100d0940 con 0x7f34fc003fb0 2023-10-16T13:39:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00baf0 con 0x7f34fc004d90 2023-10-16T13:39:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00bcb0 con 0x7f35100d04b0 2023-10-16T13:39:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3514bee700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f34fc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f35153ef700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f34fc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.603+0000 7f3515bf0700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34fc004d90 0x7f34fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3514bee700 1 -- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 msgr2=0x7f34fc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3514bee700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f34fc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3514bee700 1 -- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34fc004d90 msgr2=0x7f34fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3514bee700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34fc004d90 0x7f34fc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3514bee700 1 -- 172.21.15.5:0/570172475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0035b0 con 0x7f34fc003fb0 2023-10-16T13:39:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f35153ef700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100d04b0 0x7f34fc003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3515bf0700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34fc004d90 0x7f34fc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3514bee700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f34fc004850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c240 tx=0x7f34fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa1ef37f03b27ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c007c10 con 0x7f34fc003fb0 2023-10-16T13:39:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00cde0 con 0x7f34fc003fb0 2023-10-16T13:39:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.604+0000 7f3507fff700 1 -- 172.21.15.5:0/570172475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c005ba0 con 0x7f34fc003fb0 2023-10-16T13:39:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3517653700 1 -- 172.21.15.5:0/570172475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 msgr2=0x7f34fc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3517653700 1 --2- 172.21.15.5:0/570172475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f34fc004850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c240 tx=0x7f34fc005880 comp rx=0 tx=0).stop 2023-10-16T13:39:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3515bf0700 1 -- 172.21.15.5:0/570172475 reap_dead start 2023-10-16T13:39:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3517653700 1 -- 172.21.15.5:0/570172475 shutdown_connections 2023-10-16T13:39:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3517653700 1 -- 172.21.15.5:0/570172475 >> 172.21.15.5:0/570172475 conn(0x7f35100d1530 msgr2=0x7f35100d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3517653700 1 -- 172.21.15.5:0/570172475 shutdown_connections 2023-10-16T13:39:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.605+0000 7f3517653700 1 -- 172.21.15.5:0/570172475 wait complete. 2023-10-16T13:39:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.606+0000 7f3517653700 1 Processor -- start 2023-10-16T13:39:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.606+0000 7f3517653700 1 -- start start 2023-10-16T13:39:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f3510159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100cb600 0x7f351015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f351015ba30 0x7f351015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351015c3f0 con 0x7f34fc003fb0 2023-10-16T13:39:53.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100b40b0 con 0x7f351015ba30 2023-10-16T13:39:53.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100c9af0 con 0x7f35100cb600 2023-10-16T13:39:53.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f3510159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f3510159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44488/0 (socket says 172.21.15.5:44488) 2023-10-16T13:39:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 -- 172.21.15.5:0/360570858 learned_addr learned my addr 172.21.15.5:0/360570858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3515bf0700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f351015ba30 0x7f351015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3514bee700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100cb600 0x7f351015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 -- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100cb600 msgr2=0x7f351015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100cb600 0x7f351015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 -- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f351015ba30 msgr2=0x7f351015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f351015ba30 0x7f351015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 -- 172.21.15.5:0/360570858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100c8ee0 con 0x7f34fc003fb0 2023-10-16T13:39:53.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f35153ef700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f3510159be0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f350000e7b0 tx=0x7f350000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:53.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000052e0 con 0x7f34fc003fb0 2023-10-16T13:39:53.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3500005440 con 0x7f34fc003fb0 2023-10-16T13:39:53.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35100c91c0 con 0x7f34fc003fb0 2023-10-16T13:39:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.607+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500003910 con 0x7f34fc003fb0 2023-10-16T13:39:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.608+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35100c9780 con 0x7f34fc003fb0 2023-10-16T13:39:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.608+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35100c9910 con 0x7f34fc003fb0 2023-10-16T13:39:53.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.609+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3500003a70 con 0x7f34fc003fb0 2023-10-16T13:39:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.609+0000 7f3505ffb700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34f406af00 0x7f34f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.609+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f3500088b60 con 0x7f34fc003fb0 2023-10-16T13:39:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.610+0000 7f3514bee700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34f406af00 0x7f34f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.610+0000 7f3514bee700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34f406af00 0x7f34f406d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.614+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3500053dd0 con 0x7f34fc003fb0 2023-10-16T13:39:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:53.814+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3510067d20 con 0x7f34fc003fb0 2023-10-16T13:39:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.453+0000 7f3505ffb700 1 -- 172.21.15.5:0/360570858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35000573f0 con 0x7f34fc003fb0 2023-10-16T13:39:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34f406af00 msgr2=0x7f34f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34f406af00 0x7f34f406d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c007000 comp rx=0 tx=0).stop 2023-10-16T13:39:54.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 msgr2=0x7f3510159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f3510159be0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f350000e7b0 tx=0x7f350000eac0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 shutdown_connections 2023-10-16T13:39:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f351015ba30 0x7f351015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34fc003fb0 0x7f3510159be0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f34f406af00 0x7f34f406d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 --2- 172.21.15.5:0/360570858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35100cb600 0x7f351015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.457+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 >> 172.21.15.5:0/360570858 conn(0x7f35100d1530 msgr2=0x7f35100d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.458+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 shutdown_connections 2023-10-16T13:39:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.459+0000 7f3517653700 1 -- 172.21.15.5:0/360570858 wait complete. 2023-10-16T13:39:54.467 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:39:54.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:39:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.609+0000 7f1c19c28700 1 Processor -- start 2023-10-16T13:39:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.609+0000 7f1c19c28700 1 -- start start 2023-10-16T13:39:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.610+0000 7f1c19c28700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 0x7f1c1415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.610+0000 7f1c19c28700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140cf260 con 0x7f1c1406a840 2023-10-16T13:39:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.610+0000 7f1c19c28700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140b2d60 con 0x7f1c140cede0 2023-10-16T13:39:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.610+0000 7f1c19c28700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c141619a0 con 0x7f1c140cd950 2023-10-16T13:39:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.610+0000 7f1c13fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c1406a840 0x7f1c14161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54502/0 (socket says 172.21.15.5:54502) 2023-10-16T13:39:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.610+0000 7f1c13fff700 1 -- 172.21.15.5:0/3030140425 learned_addr learned my addr 172.21.15.5:0/3030140425 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58182263 0 0) 0x7f1c140cf260 con 0x7f1c1406a840 2023-10-16T13:39:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c000035b0 con 0x7f1c1406a840 2023-10-16T13:39:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c137fe700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 0x7f1c1415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1607273571 0 0) 0x7f1c000035b0 con 0x7f1c1406a840 2023-10-16T13:39:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 msgr2=0x7f1c1415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 0x7f1c1415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 >> v1:172.21.15.112:6789/0 conn(0x7f1c140cede0 legacy=0x7f1c1415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140cdd30 con 0x7f1c1406a840 2023-10-16T13:39:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f1c0c0019f0 con 0x7f1c1406a840 2023-10-16T13:39:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 >> v1:172.21.15.5:6789/0 conn(0x7f1c1406a840 legacy=0x7f1c14161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c00003a30 0x7f1c00003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c00004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 0x7f1c00005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c141619a0 con 0x7f1c00004850 2023-10-16T13:39:54.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000bb40 con 0x7f1c00003a30 2023-10-16T13:39:54.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000bd00 con 0x7f1c140cd950 2023-10-16T13:39:54.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c00004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c137fe700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c00003a30 0x7f1c00003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c13fff700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 0x7f1c00005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c12ffd700 1 -- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 msgr2=0x7f1c00005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:54.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c140cd950 0x7f1c00005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c12ffd700 1 -- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c00003a30 msgr2=0x7f1c00003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c00003a30 0x7f1c00003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.611+0000 7f1c12ffd700 1 -- 172.21.15.5:0/3030140425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000035b0 con 0x7f1c00004850 2023-10-16T13:39:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c00004cd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001820 tx=0x7f1c00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bad296f1c436d5e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:54.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0012e0 con 0x7f1c00004850 2023-10-16T13:39:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0052d0 con 0x7f1c00004850 2023-10-16T13:39:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c127fc700 1 -- 172.21.15.5:0/3030140425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0036d0 con 0x7f1c00004850 2023-10-16T13:39:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c19c28700 1 -- 172.21.15.5:0/3030140425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 msgr2=0x7f1c00004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c19c28700 1 --2- 172.21.15.5:0/3030140425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c00004cd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001820 tx=0x7f1c00005880 comp rx=0 tx=0).stop 2023-10-16T13:39:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c13fff700 1 -- 172.21.15.5:0/3030140425 reap_dead start 2023-10-16T13:39:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c19c28700 1 -- 172.21.15.5:0/3030140425 shutdown_connections 2023-10-16T13:39:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c19c28700 1 -- 172.21.15.5:0/3030140425 >> 172.21.15.5:0/3030140425 conn(0x7f1c1406dae0 msgr2=0x7f1c1406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c19c28700 1 -- 172.21.15.5:0/3030140425 shutdown_connections 2023-10-16T13:39:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.612+0000 7f1c19c28700 1 -- 172.21.15.5:0/3030140425 wait complete. 2023-10-16T13:39:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.614+0000 7f1c19c28700 1 Processor -- start 2023-10-16T13:39:54.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.614+0000 7f1c19c28700 1 -- start start 2023-10-16T13:39:54.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c19c28700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c14158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c19c28700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c140b1660 0x7f1c141539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c19c28700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c14160990 0x7f1c14160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c19c28700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14161380 con 0x7f1c00004850 2023-10-16T13:39:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c19c28700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140b1ae0 con 0x7f1c140b1660 2023-10-16T13:39:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c19c28700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c141587e0 con 0x7f1c14160990 2023-10-16T13:39:54.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c14158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c14158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44508/0 (socket says 172.21.15.5:44508) 2023-10-16T13:39:54.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 -- 172.21.15.5:0/1705617597 learned_addr learned my addr 172.21.15.5:0/1705617597 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:54.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c13fff700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c14160990 0x7f1c14160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c140b1660 0x7f1c141539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 -- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c14160990 msgr2=0x7f1c14160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c14160990 0x7f1c14160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 -- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c140b1660 msgr2=0x7f1c141539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c140b1660 0x7f1c141539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.615+0000 7f1c137fe700 1 -- 172.21.15.5:0/1705617597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14158ac0 con 0x7f1c00004850 2023-10-16T13:39:54.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.616+0000 7f1c137fe700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c14158170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1c040116d0 tx=0x7f1c04011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:54.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.616+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400c070 con 0x7f1c00004850 2023-10-16T13:39:54.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.616+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04015870 con 0x7f1c00004850 2023-10-16T13:39:54.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.616+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c14158da0 con 0x7f1c00004850 2023-10-16T13:39:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.616+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04015c20 con 0x7f1c00004850 2023-10-16T13:39:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.616+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c14159360 con 0x7f1c00004850 2023-10-16T13:39:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.617+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c14067d20 con 0x7f1c00004850 2023-10-16T13:39:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.617+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c04013400 con 0x7f1c00004850 2023-10-16T13:39:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.618+0000 7f1c0bfff700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1bf406af00 0x7f1bf406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.618+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1c04089540 con 0x7f1c00004850 2023-10-16T13:39:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.618+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1bf406af00 0x7f1bf406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.618+0000 7f1c12ffd700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1bf406af00 0x7f1bf406d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1c141618a0 tx=0x7f1bfc009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.622+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c04054890 con 0x7f1c00004850 2023-10-16T13:39:54.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.840+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1c140b2630 con 0x7f1c00004850 2023-10-16T13:39:54.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.843+0000 7f1c0bfff700 1 -- 172.21.15.5:0/1705617597 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1c04057eb0 con 0x7f1c00004850 2023-10-16T13:39:54.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1bf406af00 msgr2=0x7f1bf406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1bf406af00 0x7f1bf406d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1c141618a0 tx=0x7f1bfc009030 comp rx=0 tx=0).stop 2023-10-16T13:39:54.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 msgr2=0x7f1c14158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c14158170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1c040116d0 tx=0x7f1c04011a90 comp rx=0 tx=0).stop 2023-10-16T13:39:54.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 shutdown_connections 2023-10-16T13:39:54.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1bf406af00 0x7f1bf406d3c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c14160990 0x7f1c14160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c00004850 0x7f1c14158170 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 --2- 172.21.15.5:0/1705617597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c140b1660 0x7f1c141539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 >> 172.21.15.5:0/1705617597 conn(0x7f1c1406dae0 msgr2=0x7f1c140cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 shutdown_connections 2023-10-16T13:39:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.845+0000 7f1c19c28700 1 -- 172.21.15.5:0/1705617597 wait complete. 2023-10-16T13:39:54.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-16T13:39:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.983+0000 7feb84db3700 1 Processor -- start 2023-10-16T13:39:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.983+0000 7feb84db3700 1 -- start start 2023-10-16T13:39:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.984+0000 7feb84db3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015f1f0 0x7feb800cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.984+0000 7feb84db3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb800cfc60 0x7feb800cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.984+0000 7feb84db3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8015e7a0 con 0x7feb8015ab10 2023-10-16T13:39:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.984+0000 7feb84db3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800d00d0 con 0x7feb800cfc60 2023-10-16T13:39:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.984+0000 7feb84db3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb800b29a0 con 0x7feb8015f1f0 2023-10-16T13:39:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.984+0000 7feb7ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb800cfc60 0x7feb800cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb800cfc60 0x7feb800cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44516/0 (socket says 172.21.15.5:44516) 2023-10-16T13:39:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 -- 172.21.15.5:0/887647473 learned_addr learned my addr 172.21.15.5:0/887647473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7dd9b700 1 --2- 172.21.15.5:0/887647473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015f1f0 0x7feb800cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 -- 172.21.15.5:0/887647473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015f1f0 msgr2=0x7feb800cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 --2- 172.21.15.5:0/887647473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015f1f0 0x7feb800cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 -- 172.21.15.5:0/887647473 >> v1:172.21.15.112:6789/0 conn(0x7feb8015ab10 legacy=0x7feb800b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 -- 172.21.15.5:0/887647473 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800b2c80 con 0x7feb800cfc60 2023-10-16T13:39:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7ed9d700 1 --2- 172.21.15.5:0/887647473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb800cfc60 0x7feb800cbf40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feb7800d150 tx=0x7feb7800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1ca0b73087df40 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7d59a700 1 -- 172.21.15.5:0/887647473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78010070 con 0x7feb800cfc60 2023-10-16T13:39:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7d59a700 1 -- 172.21.15.5:0/887647473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800ddc0 con 0x7feb800cfc60 2023-10-16T13:39:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.985+0000 7feb7d59a700 1 -- 172.21.15.5:0/887647473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800b310 con 0x7feb800cfc60 2023-10-16T13:39:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 -- 172.21.15.5:0/887647473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb800cfc60 msgr2=0x7feb800cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 --2- 172.21.15.5:0/887647473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb800cfc60 0x7feb800cbf40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feb7800d150 tx=0x7feb7800d460 comp rx=0 tx=0).stop 2023-10-16T13:39:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 -- 172.21.15.5:0/887647473 shutdown_connections 2023-10-16T13:39:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 --2- 172.21.15.5:0/887647473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb800cfc60 0x7feb800cbf40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 --2- 172.21.15.5:0/887647473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015f1f0 0x7feb800cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 -- 172.21.15.5:0/887647473 >> 172.21.15.5:0/887647473 conn(0x7feb8006dae0 msgr2=0x7feb8006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 -- 172.21.15.5:0/887647473 shutdown_connections 2023-10-16T13:39:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.986+0000 7feb84db3700 1 -- 172.21.15.5:0/887647473 wait complete. 2023-10-16T13:39:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.987+0000 7feb84db3700 1 Processor -- start 2023-10-16T13:39:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.987+0000 7feb84db3700 1 -- start start 2023-10-16T13:39:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb84db3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb800cfc60 0x7feb8006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb84db3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015ab10 0x7feb800c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb84db3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 0x7feb800c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb84db3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800c4cb0 con 0x7feb8015f1f0 2023-10-16T13:39:54.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb84db3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800b5250 con 0x7feb800cfc60 2023-10-16T13:39:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb84db3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb800b41b0 con 0x7feb8015ab10 2023-10-16T13:39:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 0x7feb800c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 0x7feb800c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44524/0 (socket says 172.21.15.5:44524) 2023-10-16T13:39:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 -- 172.21.15.5:0/3264418913 learned_addr learned my addr 172.21.15.5:0/3264418913 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7e59c700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb800cfc60 0x7feb8006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7dd9b700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015ab10 0x7feb800c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 -- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015ab10 msgr2=0x7feb800c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015ab10 0x7feb800c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 -- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb800cfc60 msgr2=0x7feb8006e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb800cfc60 0x7feb8006e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.988+0000 7feb7ed9d700 1 -- 172.21.15.5:0/3264418913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7800bd40 con 0x7feb8015f1f0 2023-10-16T13:39:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.989+0000 7feb7ed9d700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 0x7feb800c4770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb8006d4f0 tx=0x7feb78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.989+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78009a10 con 0x7feb8015f1f0 2023-10-16T13:39:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.989+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb78009b90 con 0x7feb8015f1f0 2023-10-16T13:39:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.989+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb800b4490 con 0x7feb8015f1f0 2023-10-16T13:39:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.989+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800b4c0 con 0x7feb8015f1f0 2023-10-16T13:39:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.989+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800b4a50 con 0x7feb8015f1f0 2023-10-16T13:39:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.990+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80067d20 con 0x7feb8015f1f0 2023-10-16T13:39:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.990+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feb78004040 con 0x7feb8015f1f0 2023-10-16T13:39:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.991+0000 7feb76ffd700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feb6006af00 0x7feb6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.991+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7feb7808ab80 con 0x7feb8015f1f0 2023-10-16T13:39:55.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.991+0000 7feb7e59c700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feb6006af00 0x7feb6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.991+0000 7feb7e59c700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feb6006af00 0x7feb6006d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb70007fd0 tx=0x7feb70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:54.995+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb78055f60 con 0x7feb8015f1f0 2023-10-16T13:39:55.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.280+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7feb800afc10 con 0x7feb8015f1f0 2023-10-16T13:39:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.461+0000 7feb76ffd700 1 -- 172.21.15.5:0/3264418913 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v104) v1 ==== 135+0+0 (secure 0 0 0) 0x7feb78059580 con 0x7feb8015f1f0 2023-10-16T13:39:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feb6006af00 msgr2=0x7feb6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feb6006af00 0x7feb6006d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb70007fd0 tx=0x7feb70009040 comp rx=0 tx=0).stop 2023-10-16T13:39:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 msgr2=0x7feb800c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 0x7feb800c4770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb8006d4f0 tx=0x7feb78004ad0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 shutdown_connections 2023-10-16T13:39:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015f1f0 0x7feb800c4770 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb800cfc60 0x7feb8006e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feb6006af00 0x7feb6006d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 --2- 172.21.15.5:0/3264418913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8015ab10 0x7feb800c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 >> 172.21.15.5:0/3264418913 conn(0x7feb8006dae0 msgr2=0x7feb800ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 shutdown_connections 2023-10-16T13:39:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.463+0000 7feb84db3700 1 -- 172.21.15.5:0/3264418913 wait complete. 2023-10-16T13:39:55.478 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-10-16T13:39:55.479 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-10-16T13:39:55.479 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:39:55.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:39:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.603+0000 7fc53f502700 1 Processor -- start 2023-10-16T13:39:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.603+0000 7fc53f502700 1 -- start start 2023-10-16T13:39:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53f502700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc538157d40 0x7fc5380cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53f502700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc53806de50 0x7fc53815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53f502700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc538158120 con 0x7fc53806e2b0 2023-10-16T13:39:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53f502700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53806a840 con 0x7fc53806de50 2023-10-16T13:39:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53f502700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380caef0 con 0x7fc538157d40 2023-10-16T13:39:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53ca9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc53806de50 0x7fc53815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53da9f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc53806e2b0 0x7fc53815a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54536/0 (socket says 172.21.15.5:54536) 2023-10-16T13:39:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53da9f700 1 -- 172.21.15.5:0/3084084200 learned_addr learned my addr 172.21.15.5:0/3084084200 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53d29e700 1 --2- 172.21.15.5:0/3084084200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc538157d40 0x7fc5380cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53ca9d700 1 -- 172.21.15.5:0/3084084200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc538157d40 msgr2=0x7fc5380cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53ca9d700 1 --2- 172.21.15.5:0/3084084200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc538157d40 0x7fc5380cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53ca9d700 1 -- 172.21.15.5:0/3084084200 >> v1:172.21.15.5:6789/0 conn(0x7fc53806e2b0 legacy=0x7fc53815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53ca9d700 1 -- 172.21.15.5:0/3084084200 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53806e750 con 0x7fc53806de50 2023-10-16T13:39:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.604+0000 7fc53ca9d700 1 --2- 172.21.15.5:0/3084084200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc53806de50 0x7fc53815dd50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc528009840 tx=0x7fc528009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edade6cab17dce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc52ffff700 1 -- 172.21.15.5:0/3084084200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528010800 con 0x7fc53806de50 2023-10-16T13:39:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc52ffff700 1 -- 172.21.15.5:0/3084084200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528010960 con 0x7fc53806de50 2023-10-16T13:39:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc52ffff700 1 -- 172.21.15.5:0/3084084200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528010cf0 con 0x7fc53806de50 2023-10-16T13:39:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 -- 172.21.15.5:0/3084084200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc53806de50 msgr2=0x7fc53815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 --2- 172.21.15.5:0/3084084200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc53806de50 0x7fc53815dd50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc528009840 tx=0x7fc528009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 -- 172.21.15.5:0/3084084200 shutdown_connections 2023-10-16T13:39:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 --2- 172.21.15.5:0/3084084200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc538157d40 0x7fc5380cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 --2- 172.21.15.5:0/3084084200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc53806de50 0x7fc53815dd50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 -- 172.21.15.5:0/3084084200 >> 172.21.15.5:0/3084084200 conn(0x7fc5380cc6f0 msgr2=0x7fc5380ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 -- 172.21.15.5:0/3084084200 shutdown_connections 2023-10-16T13:39:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.605+0000 7fc53f502700 1 -- 172.21.15.5:0/3084084200 wait complete. 2023-10-16T13:39:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.606+0000 7fc53f502700 1 Processor -- start 2023-10-16T13:39:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.606+0000 7fc53f502700 1 -- start start 2023-10-16T13:39:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53f502700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc53806de50 0x7fc5381f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53f502700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc53806e2b0 0x7fc5381f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53f502700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 0x7fc53814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53f502700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5381f3700 con 0x7fc538157d40 2023-10-16T13:39:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53f502700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5381f47a0 con 0x7fc53806e2b0 2023-10-16T13:39:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53f502700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53815bcb0 con 0x7fc53806de50 2023-10-16T13:39:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53da9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 0x7fc53814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53da9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 0x7fc53814dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44538/0 (socket says 172.21.15.5:44538) 2023-10-16T13:39:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53da9f700 1 -- 172.21.15.5:0/180344315 learned_addr learned my addr 172.21.15.5:0/180344315 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53ca9d700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc53806e2b0 0x7fc5381f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.607+0000 7fc53d29e700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc53806de50 0x7fc5381f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53da9f700 1 -- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc53806de50 msgr2=0x7fc5381f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53da9f700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc53806de50 0x7fc5381f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53da9f700 1 -- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc53806e2b0 msgr2=0x7fc5381f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53da9f700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc53806e2b0 0x7fc5381f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53da9f700 1 -- 172.21.15.5:0/180344315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280094a0 con 0x7fc538157d40 2023-10-16T13:39:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53ca9d700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc53806e2b0 0x7fc5381f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:39:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53da9f700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 0x7fc53814dd80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc53000cb10 tx=0x7fc53000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53000ab00 con 0x7fc538157d40 2023-10-16T13:39:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53000ac60 con 0x7fc538157d40 2023-10-16T13:39:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53815bf90 con 0x7fc538157d40 2023-10-16T13:39:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530012400 con 0x7fc538157d40 2023-10-16T13:39:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.608+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53815c550 con 0x7fc538157d40 2023-10-16T13:39:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.609+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53806ecf0 con 0x7fc538157d40 2023-10-16T13:39:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.610+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc53001b3b0 con 0x7fc538157d40 2023-10-16T13:39:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.610+0000 7fc52dffb700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc51c06af00 0x7fc51c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.610+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc530088ef0 con 0x7fc538157d40 2023-10-16T13:39:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.610+0000 7fc53d29e700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc51c06af00 0x7fc51c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.611+0000 7fc53d29e700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc51c06af00 0x7fc51c06d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc53400b9b0 tx=0x7fc534008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.615+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc53806ecf0 con 0x7fc538157d40 2023-10-16T13:39:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.816+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc53806ecc0 con 0x7fc538157d40 2023-10-16T13:39:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.817+0000 7fc52dffb700 1 -- 172.21.15.5:0/180344315 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13044 (secure 0 0 0) 0x7fc5300542f0 con 0x7fc538157d40 2023-10-16T13:39:55.820 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:55.820 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:54.452266+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6832/3128747669":"2023-10-17T13:39:51.444330+0000","172.21.15.112:6835/1052521879":"2023-10-17T13:39:40.217218+0000","172.21.15.5:6834/3128747669":"2023-10-17T13:39:51.444330+0000","172.21.15.112:6837/1052521879":"2023-10-17T13:39:40.217218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:39:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc51c06af00 msgr2=0x7fc51c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc51c06af00 0x7fc51c06d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc53400b9b0 tx=0x7fc534008040 comp rx=0 tx=0).stop 2023-10-16T13:39:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 msgr2=0x7fc53814dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 0x7fc53814dd80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc53000cb10 tx=0x7fc53000ced0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 shutdown_connections 2023-10-16T13:39:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc538157d40 0x7fc53814dd80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc51c06af00 0x7fc51c06d3c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc53806de50 0x7fc5381f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 --2- 172.21.15.5:0/180344315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc53806e2b0 0x7fc5381f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 >> 172.21.15.5:0/180344315 conn(0x7fc5380cc6f0 msgr2=0x7fc5380665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 shutdown_connections 2023-10-16T13:39:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.820+0000 7fc53f502700 1 -- 172.21.15.5:0/180344315 wait complete. 2023-10-16T13:39:55.835 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:39:55.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:39:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.960+0000 7f12776b8700 1 Processor -- start 2023-10-16T13:39:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.961+0000 7f12776b8700 1 -- start start 2023-10-16T13:39:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.961+0000 7f12776b8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12700d0c70 0x7f12700cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.961+0000 7f12776b8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f12700ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.961+0000 7f12776b8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700d23e0 con 0x7f127015b740 2023-10-16T13:39:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.961+0000 7f12776b8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127015bb20 con 0x7f12700d0c70 2023-10-16T13:39:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.961+0000 7f12776b8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700cf190 con 0x7f12700c5110 2023-10-16T13:39:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275c55700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f12700ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1274c53700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12700d0c70 0x7f12700cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275454700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f127015b740 0x7f12700d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45522/0 (socket says 172.21.15.5:45522) 2023-10-16T13:39:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275454700 1 -- 172.21.15.5:0/3224307034 learned_addr learned my addr 172.21.15.5:0/3224307034 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275c55700 1 -- 172.21.15.5:0/3224307034 >> v2:172.21.15.112:3300/0 conn(0x7f12700d0c70 msgr2=0x7f12700cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275c55700 1 --2- 172.21.15.5:0/3224307034 >> v2:172.21.15.112:3300/0 conn(0x7f12700d0c70 0x7f12700cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275c55700 1 -- 172.21.15.5:0/3224307034 >> v1:172.21.15.112:6789/0 conn(0x7f127015b740 legacy=0x7f12700d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275c55700 1 -- 172.21.15.5:0/3224307034 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700cbd40 con 0x7f12700c5110 2023-10-16T13:39:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1267fff700 1 -- 172.21.15.5:0/3224307034 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198133367 0 0) 0x7f1260001110 con 0x7f127015b740 2023-10-16T13:39:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1275c55700 1 --2- 172.21.15.5:0/3224307034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f12700ce510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1268009d90 tx=0x7f126800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=615580f0e3b4031a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1267fff700 1 -- 172.21.15.5:0/3224307034 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800e070 con 0x7f12700c5110 2023-10-16T13:39:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1267fff700 1 -- 172.21.15.5:0/3224307034 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800bb20 con 0x7f12700c5110 2023-10-16T13:39:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.962+0000 7f1267fff700 1 -- 172.21.15.5:0/3224307034 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268012430 con 0x7f12700c5110 2023-10-16T13:39:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 -- 172.21.15.5:0/3224307034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 msgr2=0x7f12700ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 --2- 172.21.15.5:0/3224307034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f12700ce510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1268009d90 tx=0x7f126800b330 comp rx=0 tx=0).stop 2023-10-16T13:39:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 -- 172.21.15.5:0/3224307034 shutdown_connections 2023-10-16T13:39:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 --2- 172.21.15.5:0/3224307034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f12700ce510 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 --2- 172.21.15.5:0/3224307034 >> v2:172.21.15.112:3300/0 conn(0x7f12700d0c70 0x7f12700cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 -- 172.21.15.5:0/3224307034 >> 172.21.15.5:0/3224307034 conn(0x7f12700665a0 msgr2=0x7f1270066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 -- 172.21.15.5:0/3224307034 shutdown_connections 2023-10-16T13:39:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.963+0000 7f12776b8700 1 -- 172.21.15.5:0/3224307034 wait complete. 2023-10-16T13:39:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.965+0000 7f12776b8700 1 Processor -- start 2023-10-16T13:39:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.965+0000 7f12776b8700 1 -- start start 2023-10-16T13:39:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f1270159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 0x7f12700cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127015b740 0x7f12700b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700ca340 con 0x7f12700d0c70 2023-10-16T13:39:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700ca620 con 0x7f127015b740 2023-10-16T13:39:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700ca900 con 0x7f12700c5110 2023-10-16T13:39:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 0x7f12700cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 0x7f12700cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44550/0 (socket says 172.21.15.5:44550) 2023-10-16T13:39:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 -- 172.21.15.5:0/1885724375 learned_addr learned my addr 172.21.15.5:0/1885724375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1275454700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f1270159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1275c55700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127015b740 0x7f12700b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 -- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 msgr2=0x7f1270159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f1270159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 -- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127015b740 msgr2=0x7f12700b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127015b740 0x7f12700b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 -- 172.21.15.5:0/1885724375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009a70 con 0x7f12700d0c70 2023-10-16T13:39:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1274c53700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 0x7f12700cb3e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f126c00e9b0 tx=0x7f126c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c009710 con 0x7f12700d0c70 2023-10-16T13:39:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c00c850 con 0x7f12700d0c70 2023-10-16T13:39:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.966+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12700cabe0 con 0x7f12700d0c70 2023-10-16T13:39:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.967+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00cbc0 con 0x7f12700d0c70 2023-10-16T13:39:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.967+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127015a2b0 con 0x7f12700d0c70 2023-10-16T13:39:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.968+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12700cccc0 con 0x7f12700d0c70 2023-10-16T13:39:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.968+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f126c00cd20 con 0x7f12700d0c70 2023-10-16T13:39:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.968+0000 7f1265ffb700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f125406af00 0x7f125406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.969+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f126c089380 con 0x7f12700d0c70 2023-10-16T13:39:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.969+0000 7f1275454700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f125406af00 0x7f125406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.969+0000 7f1275454700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f125406af00 0x7f125406d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1260000f60 tx=0x7f1260007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:55.973+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f126c0546d0 con 0x7f12700d0c70 2023-10-16T13:39:56.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.173+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1270067d20 con 0x7f12700d0c70 2023-10-16T13:39:56.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.173+0000 7f1265ffb700 1 -- 172.21.15.5:0/1885724375 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f126c057cf0 con 0x7f12700d0c70 2023-10-16T13:39:56.176 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:39:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f125406af00 msgr2=0x7f125406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f125406af00 0x7f125406d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1260000f60 tx=0x7f1260007e70 comp rx=0 tx=0).stop 2023-10-16T13:39:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 msgr2=0x7f12700cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 0x7f12700cb3e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f126c00e9b0 tx=0x7f126c00ecc0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 shutdown_connections 2023-10-16T13:39:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127015b740 0x7f12700b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f125406af00 0x7f125406d3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12700c5110 0x7f1270159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 --2- 172.21.15.5:0/1885724375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12700d0c70 0x7f12700cb3e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.175+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 >> 172.21.15.5:0/1885724375 conn(0x7f12700665a0 msgr2=0x7f12700d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.176+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 shutdown_connections 2023-10-16T13:39:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.176+0000 7f12776b8700 1 -- 172.21.15.5:0/1885724375 wait complete. 2023-10-16T13:39:56.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-16T13:39:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.314+0000 7fa05de61700 1 Processor -- start 2023-10-16T13:39:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.314+0000 7fa05de61700 1 -- start start 2023-10-16T13:39:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.314+0000 7fa05de61700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0580cfe30 0x7fa0580cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.314+0000 7fa05de61700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05815e7a0 con 0x7fa05815ab10 2023-10-16T13:39:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.314+0000 7fa05de61700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580b29a0 con 0x7fa05815f1f0 2023-10-16T13:39:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.314+0000 7fa05de61700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0580b2c80 con 0x7fa0580cfe30 2023-10-16T13:39:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa057fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0580cfe30 0x7fa0580cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa0577fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa05815ab10 0x7fa0580b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54560/0 (socket says 172.21.15.5:54560) 2023-10-16T13:39:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa0577fe700 1 -- 172.21.15.5:0/60999177 learned_addr learned my addr 172.21.15.5:0/60999177 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa057fff700 1 -- 172.21.15.5:0/60999177 >> v1:172.21.15.112:6789/0 conn(0x7fa05815f1f0 legacy=0x7fa0580cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa057fff700 1 -- 172.21.15.5:0/60999177 >> v1:172.21.15.5:6789/0 conn(0x7fa05815ab10 legacy=0x7fa0580b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa057fff700 1 -- 172.21.15.5:0/60999177 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05815e9f0 con 0x7fa0580cfe30 2023-10-16T13:39:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa0567fc700 1 -- 172.21.15.5:0/60999177 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086929641 0 0) 0x7fa05815e7a0 con 0x7fa05815ab10 2023-10-16T13:39:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa057fff700 1 --2- 172.21.15.5:0/60999177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0580cbf40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa050009d90 tx=0x7fa05000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6357aaf493d43652 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa0567fc700 1 -- 172.21.15.5:0/60999177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000e070 con 0x7fa0580cfe30 2023-10-16T13:39:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa0567fc700 1 -- 172.21.15.5:0/60999177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000bb90 con 0x7fa0580cfe30 2023-10-16T13:39:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.315+0000 7fa0567fc700 1 -- 172.21.15.5:0/60999177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050003a20 con 0x7fa0580cfe30 2023-10-16T13:39:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 -- 172.21.15.5:0/60999177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 msgr2=0x7fa0580cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 --2- 172.21.15.5:0/60999177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0580cbf40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa050009d90 tx=0x7fa05000b330 comp rx=0 tx=0).stop 2023-10-16T13:39:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 -- 172.21.15.5:0/60999177 shutdown_connections 2023-10-16T13:39:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 --2- 172.21.15.5:0/60999177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0580cbf40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 -- 172.21.15.5:0/60999177 >> 172.21.15.5:0/60999177 conn(0x7fa05806dae0 msgr2=0x7fa05806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 -- 172.21.15.5:0/60999177 shutdown_connections 2023-10-16T13:39:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.316+0000 7fa05de61700 1 -- 172.21.15.5:0/60999177 wait complete. 2023-10-16T13:39:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.317+0000 7fa05de61700 1 Processor -- start 2023-10-16T13:39:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.317+0000 7fa05de61700 1 -- start start 2023-10-16T13:39:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa05de61700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0581f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa05de61700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05815ab10 0x7fa058149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa05de61700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa05815f1f0 0x7fa058149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa05de61700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581f58c0 con 0x7fa0580cfe30 2023-10-16T13:39:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa05de61700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05814bc60 con 0x7fa05815ab10 2023-10-16T13:39:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa05de61700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05814bf40 con 0x7fa05815f1f0 2023-10-16T13:39:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0581f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0581f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44562/0 (socket says 172.21.15.5:44562) 2023-10-16T13:39:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 -- 172.21.15.5:0/503936328 learned_addr learned my addr 172.21.15.5:0/503936328 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa056ffd700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05815ab10 0x7fa058149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 -- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa05815f1f0 msgr2=0x7fa058149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa057fff700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa05815f1f0 0x7fa058149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa05815f1f0 0x7fa058149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 -- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05815ab10 msgr2=0x7fa058149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05815ab10 0x7fa058149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 -- 172.21.15.5:0/503936328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009a70 con 0x7fa0580cfe30 2023-10-16T13:39:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa056ffd700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05815ab10 0x7fa058149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.318+0000 7fa0577fe700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0581f5380 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c550 tx=0x7fa04800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.319+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048004c80 con 0x7fa0580cfe30 2023-10-16T13:39:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.319+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048004e00 con 0x7fa0580cfe30 2023-10-16T13:39:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.319+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05814c220 con 0x7fa0580cfe30 2023-10-16T13:39:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.319+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048007310 con 0x7fa0580cfe30 2023-10-16T13:39:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.319+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05814c7e0 con 0x7fa0580cfe30 2023-10-16T13:39:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.320+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05815f680 con 0x7fa0580cfe30 2023-10-16T13:39:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.320+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa048007470 con 0x7fa0580cfe30 2023-10-16T13:39:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.320+0000 7fa03ffff700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa04406af00 0x7fa04406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.321+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa048089050 con 0x7fa0580cfe30 2023-10-16T13:39:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.321+0000 7fa056ffd700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa04406af00 0x7fa04406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.321+0000 7fa056ffd700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa04406af00 0x7fa04406d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa05815db50 tx=0x7fa04c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:56.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.325+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa05815f680 con 0x7fa0580cfe30 2023-10-16T13:39:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:56.617+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7fa05815f680 con 0x7fa0580cfe30 2023-10-16T13:39:57.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:39:57.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:39:57.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.621+0000 7fa03ffff700 1 -- 172.21.15.5:0/503936328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v106) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa05815f680 con 0x7fa0580cfe30 2023-10-16T13:39:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa04406af00 msgr2=0x7fa04406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa04406af00 0x7fa04406d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa05815db50 tx=0x7fa04c009040 comp rx=0 tx=0).stop 2023-10-16T13:39:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 msgr2=0x7fa0581f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0581f5380 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c550 tx=0x7fa04800c910 comp rx=0 tx=0).stop 2023-10-16T13:39:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 shutdown_connections 2023-10-16T13:39:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa04406af00 0x7fa04406d3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa05815f1f0 0x7fa058149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0580cfe30 0x7fa0581f5380 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 --2- 172.21.15.5:0/503936328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05815ab10 0x7fa058149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 >> 172.21.15.5:0/503936328 conn(0x7fa05806dae0 msgr2=0x7fa05806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 shutdown_connections 2023-10-16T13:39:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.625+0000 7fa05de61700 1 -- 172.21.15.5:0/503936328 wait complete. 2023-10-16T13:39:57.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:39:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.780+0000 7f0539f55700 1 Processor -- start 2023-10-16T13:39:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.780+0000 7f0539f55700 1 -- start start 2023-10-16T13:39:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0539f55700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 0x7f053415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0539f55700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f053406a840 0x7f053406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0539f55700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340cf260 con 0x7f05340cede0 2023-10-16T13:39:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0539f55700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05341619a0 con 0x7f053406a840 2023-10-16T13:39:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0539f55700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053406b1f0 con 0x7f05340cd950 2023-10-16T13:39:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0532ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05340cede0 0x7f053415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54576/0 (socket says 172.21.15.5:54576) 2023-10-16T13:39:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0532ffd700 1 -- 172.21.15.5:0/2424562473 learned_addr learned my addr 172.21.15.5:0/2424562473 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f05337fe700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 0x7f053415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088836664 0 0) 0x7f05340cf260 con 0x7f05340cede0 2023-10-16T13:39:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05200035b0 con 0x7f05340cede0 2023-10-16T13:39:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.781+0000 7f0533fff700 1 --2- 172.21.15.5:0/2424562473 >> v2:172.21.15.112:3300/0 conn(0x7f053406a840 0x7f053406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084434092 0 0) 0x7f05200035b0 con 0x7f05340cede0 2023-10-16T13:39:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 msgr2=0x7f053415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 0x7f053415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 >> v2:172.21.15.112:3300/0 conn(0x7f053406a840 msgr2=0x7f053406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 --2- 172.21.15.5:0/2424562473 >> v2:172.21.15.112:3300/0 conn(0x7f053406a840 0x7f053406acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340b2d60 con 0x7f05340cede0 2023-10-16T13:39:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f05240017f0 con 0x7f05340cede0 2023-10-16T13:39:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 >> v1:172.21.15.5:6789/0 conn(0x7f05340cede0 legacy=0x7f053415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 0x7f0520003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0520003f80 0x7f0520004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520004d90 0x7f0520005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341619a0 con 0x7f0520003f80 2023-10-16T13:39:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053406b1f0 con 0x7f0520004d90 2023-10-16T13:39:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052000ba10 con 0x7f05340cd950 2023-10-16T13:39:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0520003f80 0x7f0520004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f05337fe700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 0x7f0520003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0533fff700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520004d90 0x7f0520005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 -- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 msgr2=0x7f0520003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340cd950 0x7f0520003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 -- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520004d90 msgr2=0x7f0520005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520004d90 0x7f0520005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 -- 172.21.15.5:0/2424562473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200035b0 con 0x7f0520003f80 2023-10-16T13:39:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.782+0000 7f0532ffd700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0520003f80 0x7f0520004850 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f052400c2f0 tx=0x7f0520005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b0bdec20485bcc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524007c30 con 0x7f0520003f80 2023-10-16T13:39:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400cdd0 con 0x7f0520003f80 2023-10-16T13:39:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f05327fc700 1 -- 172.21.15.5:0/2424562473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524007310 con 0x7f0520003f80 2023-10-16T13:39:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0539f55700 1 -- 172.21.15.5:0/2424562473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0520003f80 msgr2=0x7f0520004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0539f55700 1 --2- 172.21.15.5:0/2424562473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0520003f80 0x7f0520004850 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f052400c2f0 tx=0x7f0520005880 comp rx=0 tx=0).stop 2023-10-16T13:39:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0533fff700 1 -- 172.21.15.5:0/2424562473 reap_dead start 2023-10-16T13:39:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0539f55700 1 -- 172.21.15.5:0/2424562473 shutdown_connections 2023-10-16T13:39:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0539f55700 1 -- 172.21.15.5:0/2424562473 >> 172.21.15.5:0/2424562473 conn(0x7f053406dae0 msgr2=0x7f053406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0539f55700 1 -- 172.21.15.5:0/2424562473 shutdown_connections 2023-10-16T13:39:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.783+0000 7f0539f55700 1 -- 172.21.15.5:0/2424562473 wait complete. 2023-10-16T13:39:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.784+0000 7f0539f55700 1 Processor -- start 2023-10-16T13:39:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 -- start start 2023-10-16T13:39:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520003f80 0x7f05341f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340b4140 0x7f05341f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 0x7f05340b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340ae350 con 0x7f05341f49a0 2023-10-16T13:39:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341f36c0 con 0x7f0520003f80 2023-10-16T13:39:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0539f55700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340b48b0 con 0x7f05340b4140 2023-10-16T13:39:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.785+0000 7f0533fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 0x7f05340b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 0x7f05340b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44586/0 (socket says 172.21.15.5:44586) 2023-10-16T13:39:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 -- 172.21.15.5:0/31518707 learned_addr learned my addr 172.21.15.5:0/31518707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f05337fe700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520003f80 0x7f05341f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0532ffd700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340b4140 0x7f05341f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 -- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340b4140 msgr2=0x7f05341f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340b4140 0x7f05341f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 -- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520003f80 msgr2=0x7f05341f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520003f80 0x7f05341f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 -- 172.21.15.5:0/31518707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340b4b90 con 0x7f05341f49a0 2023-10-16T13:39:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f05337fe700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520003f80 0x7f05341f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0532ffd700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340b4140 0x7f05341f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:39:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0533fff700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 0x7f05340b0e20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f05340afed0 tx=0x7f052c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00e040 con 0x7f05341f49a0 2023-10-16T13:39:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00f040 con 0x7f05341f49a0 2023-10-16T13:39:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05340b4e70 con 0x7f05341f49a0 2023-10-16T13:39:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00fde0 con 0x7f05341f49a0 2023-10-16T13:39:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.786+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05341f4e20 con 0x7f05341f49a0 2023-10-16T13:39:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.787+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05340b5060 con 0x7f05341f49a0 2023-10-16T13:39:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.788+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f052c022460 con 0x7f05341f49a0 2023-10-16T13:39:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.788+0000 7f052bfff700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f051406af00 0x7f051406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.788+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f052c0898a0 con 0x7f05341f49a0 2023-10-16T13:39:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.788+0000 7f05337fe700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f051406af00 0x7f051406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.789+0000 7f05337fe700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f051406af00 0x7f051406d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0534157630 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.793+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f052c054bf0 con 0x7f05341f49a0 2023-10-16T13:39:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.996+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0534067d20 con 0x7f05341f49a0 2023-10-16T13:39:58.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:57.999+0000 7f052bfff700 1 -- 172.21.15.5:0/31518707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f052c058210 con 0x7f05341f49a0 2023-10-16T13:39:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f051406af00 msgr2=0x7f051406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f051406af00 0x7f051406d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0534157630 tx=0x7f051c008040 comp rx=0 tx=0).stop 2023-10-16T13:39:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 msgr2=0x7f05340b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 0x7f05340b0e20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f05340afed0 tx=0x7f052c011f80 comp rx=0 tx=0).stop 2023-10-16T13:39:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 shutdown_connections 2023-10-16T13:39:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05341f49a0 0x7f05340b0e20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0520003f80 0x7f05341f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f051406af00 0x7f051406d3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 --2- 172.21.15.5:0/31518707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05340b4140 0x7f05341f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 >> 172.21.15.5:0/31518707 conn(0x7f053406dae0 msgr2=0x7f053415f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 shutdown_connections 2023-10-16T13:39:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.001+0000 7f0539f55700 1 -- 172.21.15.5:0/31518707 wait complete. 2023-10-16T13:39:58.016 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:39:58.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:39:58.053 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:39:58.099 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:39:58.099 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:58.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:58.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:39:58.118 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:58.118 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:58.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:39:58.158 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:39:58.159 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:58.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:39:58.176 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:39:58.177 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:39:58.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:39:58.218 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:39:58.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:39:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.342+0000 7f9b0918d700 1 Processor -- start 2023-10-16T13:39:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.342+0000 7f9b0918d700 1 -- start start 2023-10-16T13:39:58.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.342+0000 7f9b0918d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b0415f130 0x7f9b040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0918d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406af50 0x7f9b040b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0918d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040b3530 con 0x7f9b040b28b0 2023-10-16T13:39:58.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0918d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b040cde00 con 0x7f9b0415f130 2023-10-16T13:39:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0918d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040cd180 con 0x7f9b0406af50 2023-10-16T13:39:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0359e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406af50 0x7f9b040b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b0415f130 0x7f9b040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9b040b28b0 0x7f9b0406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45570/0 (socket says 172.21.15.5:45570) 2023-10-16T13:39:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b0259c700 1 -- 172.21.15.5:0/3975128942 learned_addr learned my addr 172.21.15.5:0/3975128942 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b0415f130 0x7f9b040cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:40486/0 (socket says 172.21.15.5:40486) 2023-10-16T13:39:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 -- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406af50 msgr2=0x7f9b040b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 --2- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406af50 0x7f9b040b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 -- 172.21.15.5:0/3975128942 >> v1:172.21.15.112:6789/0 conn(0x7f9b040b28b0 legacy=0x7f9b0406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 -- 172.21.15.5:0/3975128942 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040cd460 con 0x7f9b0415f130 2023-10-16T13:39:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.343+0000 7f9b02d9d700 1 --2- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0415f130 0x7f9b040cede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009840 tx=0x7f9af4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10e747df3cd9dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b01d9b700 1 -- 172.21.15.5:0/3975128942 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011830 con 0x7f9b0415f130 2023-10-16T13:39:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b01d9b700 1 -- 172.21.15.5:0/3975128942 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4011990 con 0x7f9b0415f130 2023-10-16T13:39:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b01d9b700 1 -- 172.21.15.5:0/3975128942 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011d20 con 0x7f9b0415f130 2023-10-16T13:39:58.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 -- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0415f130 msgr2=0x7f9b040cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 --2- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0415f130 0x7f9b040cede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009840 tx=0x7f9af4009b50 comp rx=0 tx=0).stop 2023-10-16T13:39:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 -- 172.21.15.5:0/3975128942 shutdown_connections 2023-10-16T13:39:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 --2- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0415f130 0x7f9b040cede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 --2- 172.21.15.5:0/3975128942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406af50 0x7f9b040b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 -- 172.21.15.5:0/3975128942 >> 172.21.15.5:0/3975128942 conn(0x7f9b0406dae0 msgr2=0x7f9b0406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:58.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 -- 172.21.15.5:0/3975128942 shutdown_connections 2023-10-16T13:39:58.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.344+0000 7f9b0918d700 1 -- 172.21.15.5:0/3975128942 wait complete. 2023-10-16T13:39:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.346+0000 7f9b0918d700 1 Processor -- start 2023-10-16T13:39:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.346+0000 7f9b0918d700 1 -- start start 2023-10-16T13:39:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.346+0000 7f9b0918d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0406af50 0x7f9b040c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.346+0000 7f9b0918d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 0x7f9b040af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0918d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0415f130 0x7f9b04156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0918d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040af570 con 0x7f9b040b28b0 2023-10-16T13:39:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0918d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c9f10 con 0x7f9b0406af50 2023-10-16T13:39:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0918d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c9670 con 0x7f9b0415f130 2023-10-16T13:39:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 0x7f9b040af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 0x7f9b040af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44598/0 (socket says 172.21.15.5:44598) 2023-10-16T13:39:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 -- 172.21.15.5:0/2368952252 learned_addr learned my addr 172.21.15.5:0/2368952252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:58.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0359e700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0415f130 0x7f9b04156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b02d9d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0406af50 0x7f9b040c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 -- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0415f130 msgr2=0x7f9b04156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0415f130 0x7f9b04156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 -- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0406af50 msgr2=0x7f9b040c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0406af50 0x7f9b040c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 -- 172.21.15.5:0/2368952252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40094a0 con 0x7f9b040b28b0 2023-10-16T13:39:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0259c700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 0x7f9b040af030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c4f0 tx=0x7f9af800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005dc0 con 0x7f9b040b28b0 2023-10-16T13:39:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af80070d0 con 0x7f9b040b28b0 2023-10-16T13:39:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040c9950 con 0x7f9b040b28b0 2023-10-16T13:39:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8007440 con 0x7f9b040b28b0 2023-10-16T13:39:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.347+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b040cabc0 con 0x7f9b040b28b0 2023-10-16T13:39:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.348+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04067d20 con 0x7f9b040b28b0 2023-10-16T13:39:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.349+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9af80075a0 con 0x7f9b040b28b0 2023-10-16T13:39:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.349+0000 7f9aeb7fe700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9af006af30 0x7f9af006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.350+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9af8088520 con 0x7f9b040b28b0 2023-10-16T13:39:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.350+0000 7f9b02d9d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9af006af30 0x7f9af006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.350+0000 7f9b02d9d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9af006af30 0x7f9af006d3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.354+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9af80539b0 con 0x7f9b040b28b0 2023-10-16T13:39:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.603+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b040cee50 con 0x7f9b040b28b0 2023-10-16T13:39:58.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.603+0000 7f9aeb7fe700 1 -- 172.21.15.5:0/2368952252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f9af8017e80 con 0x7f9b040b28b0 2023-10-16T13:39:58.606 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:39:58.607 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3885573841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3885573841},{"type":"v1","addr":"172.21.15.5:6835","nonce":3885573841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/314088225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":314088225},{"type":"v1","addr":"172.21.15.112:6836","nonce":314088225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1675250334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1675250334},{"type":"v1","addr":"172.21.15.112:6837","nonce":1675250334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3543011144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3543011144},{"type":"v1","addr":"172.21.15.5:6834","nonce":3543011144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2023-10-16T13:39:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9af006af30 msgr2=0x7f9af006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9af006af30 0x7f9af006d3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af4008030 comp rx=0 tx=0).stop 2023-10-16T13:39:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 msgr2=0x7f9b040af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 0x7f9b040af030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c4f0 tx=0x7f9af800c800 comp rx=0 tx=0).stop 2023-10-16T13:39:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 shutdown_connections 2023-10-16T13:39:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9af006af30 0x7f9af006d3f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0415f130 0x7f9b04156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b0406af50 0x7f9b040c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 --2- 172.21.15.5:0/2368952252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b040b28b0 0x7f9b040af030 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 >> 172.21.15.5:0/2368952252 conn(0x7f9b0406dae0 msgr2=0x7f9b040b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 shutdown_connections 2023-10-16T13:39:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.605+0000 7f9b0918d700 1 -- 172.21.15.5:0/2368952252 wait complete. 2023-10-16T13:39:58.611 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-10-16T13:39:58.620 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:39:58.620 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:39:58.621 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:39:58.621 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:58.621 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:39:58.622 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:39:58.622 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:39:58.622 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:58.622 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:39:58.623 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:39:58.623 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:39:58.623 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:58.624 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:39:58.624 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:39:58.624 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:39:58.624 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:39:58.630 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:39:58.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:39:58.632 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:39:58.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:39:58.634 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:39:58.635 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:39:58.635 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:39:58.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:39:58.674 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:39:58.674 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:58.676 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:39:58.676 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:58.677 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:39:58.677 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:58.678 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:39:58.678 DEBUG:teuthology.parallel:result is None 2023-10-16T13:39:58.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:39:58.757 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:39:58.757 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:39:58.764 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:39:58.765 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:39:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.807+0000 7f19439e7700 1 Processor -- start 2023-10-16T13:39:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.807+0000 7f19439e7700 1 -- start start 2023-10-16T13:39:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f19439e7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f193c06a840 0x7f193c06daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f19439e7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c06ac60 con 0x7f193c15dc70 2023-10-16T13:39:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f19439e7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c06ae90 con 0x7f193c15d890 2023-10-16T13:39:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f19439e7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c06b170 con 0x7f193c06a840 2023-10-16T13:39:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1940f82700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f193c15dc70 0x7f193c161cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54634/0 (socket says 172.21.15.5:54634) 2023-10-16T13:39:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1940f82700 1 -- 172.21.15.5:0/1683096287 learned_addr learned my addr 172.21.15.5:0/1683096287 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1941f84700 1 --2- 172.21.15.5:0/1683096287 >> v2:172.21.15.112:3300/0 conn(0x7f193c06a840 0x7f193c06daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579669367 0 0) 0x7f193c06ac60 con 0x7f193c15dc70 2023-10-16T13:39:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19280035b0 con 0x7f193c15dc70 2023-10-16T13:39:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111069865 0 0) 0x7f193c06ae90 con 0x7f193c15d890 2023-10-16T13:39:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193c06ac60 con 0x7f193c15d890 2023-10-16T13:39:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1995633444 0 0) 0x7f19280035b0 con 0x7f193c15dc70 2023-10-16T13:39:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 >> v2:172.21.15.112:3300/0 conn(0x7f193c06a840 msgr2=0x7f193c06daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 --2- 172.21.15.5:0/1683096287 >> v2:172.21.15.112:3300/0 conn(0x7f193c06a840 0x7f193c06daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 >> v1:172.21.15.112:6789/0 conn(0x7f193c15d890 legacy=0x7f193c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c06b450 con 0x7f193c15dc70 2023-10-16T13:39:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f192c001670 con 0x7f193c15dc70 2023-10-16T13:39:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 >> v1:172.21.15.5:6789/0 conn(0x7f193c15dc70 legacy=0x7f193c161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.808+0000 7f1933fff700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1928003b90 0x7f1928003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928004850 0x7f1928004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f192800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c06b170 con 0x7f1928005210 2023-10-16T13:39:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192800c090 con 0x7f1928004850 2023-10-16T13:39:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192800c250 con 0x7f1928003b90 2023-10-16T13:39:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 --2- 172.21.15.5:0/1683096287 >> v2:172.21.15.112:3300/0 conn(0x7f193c06a840 0x7f193c06daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1940f82700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928004850 0x7f1928004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941783700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1928003b90 0x7f1928003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f192800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 -- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1928003b90 msgr2=0x7f1928003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1928003b90 0x7f1928003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 -- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928004850 msgr2=0x7f1928004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928004850 0x7f1928004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 -- 172.21.15.5:0/1683096287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280035b0 con 0x7f1928005210 2023-10-16T13:39:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1940f82700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928004850 0x7f1928004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941783700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1928003b90 0x7f1928003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:39:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 -- 172.21.15.5:0/1683096287 reap_dead start 2023-10-16T13:39:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1941f84700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f192800ba10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f193400e350 tx=0x7f1928005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8277e81715c24d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400ee10 con 0x7f1928005210 2023-10-16T13:39:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400f040 con 0x7f1928005210 2023-10-16T13:39:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.809+0000 7f1933fff700 1 -- 172.21.15.5:0/1683096287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003c60 con 0x7f1928005210 2023-10-16T13:39:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 -- 172.21.15.5:0/1683096287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 msgr2=0x7f192800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f192800ba10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f193400e350 tx=0x7f1928005880 comp rx=0 tx=0).stop 2023-10-16T13:39:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 -- 172.21.15.5:0/1683096287 shutdown_connections 2023-10-16T13:39:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 --2- 172.21.15.5:0/1683096287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f192800ba10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 -- 172.21.15.5:0/1683096287 >> 172.21.15.5:0/1683096287 conn(0x7f193c06bd40 msgr2=0x7f193c06c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 -- 172.21.15.5:0/1683096287 shutdown_connections 2023-10-16T13:39:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.810+0000 7f19439e7700 1 -- 172.21.15.5:0/1683096287 wait complete. 2023-10-16T13:39:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.811+0000 7f19439e7700 1 Processor -- start 2023-10-16T13:39:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.811+0000 7f19439e7700 1 -- start start 2023-10-16T13:39:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f19439e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f193c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f19439e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f193c1e7bf0 0x7f193c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f19439e7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f193c1e8070 0x7f193c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f19439e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c160310 con 0x7f1928005210 2023-10-16T13:39:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f19439e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c15f480 con 0x7f193c1e7bf0 2023-10-16T13:39:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f19439e7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c160730 con 0x7f193c1e8070 2023-10-16T13:39:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f193c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f193c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44642/0 (socket says 172.21.15.5:44642) 2023-10-16T13:39:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 -- 172.21.15.5:0/4202804067 learned_addr learned my addr 172.21.15.5:0/4202804067 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1940f82700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f193c1e7bf0 0x7f193c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941f84700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f193c1e8070 0x7f193c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 -- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f193c1e8070 msgr2=0x7f193c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f193c1e8070 0x7f193c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 -- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f193c1e7bf0 msgr2=0x7f193c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f193c1e7bf0 0x7f193c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.812+0000 7f1941783700 1 -- 172.21.15.5:0/4202804067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c15f690 con 0x7f1928005210 2023-10-16T13:39:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.813+0000 7f1941783700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f193c15eac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f193800f940 tx=0x7f193800fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.813+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380052e0 con 0x7f1928005210 2023-10-16T13:39:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.813+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938005440 con 0x7f1928005210 2023-10-16T13:39:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.813+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c15f970 con 0x7f1928005210 2023-10-16T13:39:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.813+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380038c0 con 0x7f1928005210 2023-10-16T13:39:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.813+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c15ff30 con 0x7f1928005210 2023-10-16T13:39:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.814+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c160450 con 0x7f1928005210 2023-10-16T13:39:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.814+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1938003a20 con 0x7f1928005210 2023-10-16T13:39:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.815+0000 7f1931ffb700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f192006af00 0x7f192006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.815+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f19380891d0 con 0x7f1928005210 2023-10-16T13:39:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.815+0000 7f1940f82700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f192006af00 0x7f192006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.816+0000 7f1940f82700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f192006af00 0x7f192006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f192c001050 tx=0x7f192c001e20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:58.820+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19380545b0 con 0x7f1928005210 2023-10-16T13:39:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.036+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f193c067d20 con 0x7f1928005210 2023-10-16T13:39:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.635+0000 7f1931ffb700 1 -- 172.21.15.5:0/4202804067 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1938057bd0 con 0x7f1928005210 2023-10-16T13:39:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f192006af00 msgr2=0x7f192006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f192006af00 0x7f192006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f192c001050 tx=0x7f192c001e20 comp rx=0 tx=0).stop 2023-10-16T13:39:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 msgr2=0x7f193c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f193c15eac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f193800f940 tx=0x7f193800fc50 comp rx=0 tx=0).stop 2023-10-16T13:39:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 shutdown_connections 2023-10-16T13:39:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f192006af00 0x7f192006d3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f193c1e8070 0x7f193c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1928005210 0x7f193c15eac0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 --2- 172.21.15.5:0/4202804067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f193c1e7bf0 0x7f193c1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 >> 172.21.15.5:0/4202804067 conn(0x7f193c06bd40 msgr2=0x7f193c0b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 shutdown_connections 2023-10-16T13:39:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.638+0000 7f19439e7700 1 -- 172.21.15.5:0/4202804067 wait complete. 2023-10-16T13:39:59.643 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:39:59.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:39:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.784+0000 7fbc04537700 1 Processor -- start 2023-10-16T13:39:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.785+0000 7fbc04537700 1 -- start start 2023-10-16T13:39:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.785+0000 7fbc04537700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbfc0cd870 0x7fbbfc0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.785+0000 7fbc04537700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 0x7fbbfc0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc04537700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0afd30 con 0x7fbbfc161730 2023-10-16T13:39:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc04537700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0cce20 con 0x7fbbfc0cd870 2023-10-16T13:39:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc04537700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc161cd0 con 0x7fbbfc0af740 2023-10-16T13:39:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc02ad4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbbfc161730 0x7fbbfc0b01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54656/0 (socket says 172.21.15.5:54656) 2023-10-16T13:39:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc02ad4700 1 -- 172.21.15.5:0/1729661849 learned_addr learned my addr 172.21.15.5:0/1729661849 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:39:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc01ad2700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 0x7fbbfc0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc022d3700 1 --2- 172.21.15.5:0/1729661849 >> v2:172.21.15.112:3300/0 conn(0x7fbbfc0cd870 0x7fbbfc0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990361574 0 0) 0x7fbbfc0afd30 con 0x7fbbfc161730 2023-10-16T13:39:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe80035b0 con 0x7fbbfc161730 2023-10-16T13:39:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207553552 0 0) 0x7fbbe80035b0 con 0x7fbbfc161730 2023-10-16T13:39:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 msgr2=0x7fbbfc0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 0x7fbbfc0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 >> v2:172.21.15.112:3300/0 conn(0x7fbbfc0cd870 msgr2=0x7fbbfc0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 --2- 172.21.15.5:0/1729661849 >> v2:172.21.15.112:3300/0 conn(0x7fbbfc0cd870 0x7fbbfc0cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc161fb0 con 0x7fbbfc161730 2023-10-16T13:39:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fbbf40019f0 con 0x7fbbfc161730 2023-10-16T13:39:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 >> v1:172.21.15.5:6789/0 conn(0x7fbbfc161730 legacy=0x7fbbfc0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 0x7fbbe8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8003f80 0x7fbbe8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbe8004d90 0x7fbbe8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0cce20 con 0x7fbbe8004d90 2023-10-16T13:39:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc161cd0 con 0x7fbbe8003f80 2023-10-16T13:39:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe800ba10 con 0x7fbbfc0af740 2023-10-16T13:39:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbe8004d90 0x7fbbe8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.786+0000 7fbc022d3700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 0x7fbbe8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc01ad2700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8003f80 0x7fbbe8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 -- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 msgr2=0x7fbbe8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbfc0af740 0x7fbbe8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 -- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8003f80 msgr2=0x7fbbe8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:39:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8003f80 0x7fbbe8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 -- 172.21.15.5:0/1729661849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80035b0 con 0x7fbbe8004d90 2023-10-16T13:39:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbe8004d90 0x7fbbe8005210 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a8d0 tx=0x7fbbe8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19bfd99a9e0a4d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400a340 con 0x7fbbe8004d90 2023-10-16T13:39:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4012600 con 0x7fbbe8004d90 2023-10-16T13:39:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc012d1700 1 -- 172.21.15.5:0/1729661849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40129b0 con 0x7fbbe8004d90 2023-10-16T13:39:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc04537700 1 -- 172.21.15.5:0/1729661849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbe8004d90 msgr2=0x7fbbe8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc04537700 1 --2- 172.21.15.5:0/1729661849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbe8004d90 0x7fbbe8005210 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a8d0 tx=0x7fbbe8005880 comp rx=0 tx=0).stop 2023-10-16T13:39:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.787+0000 7fbc02ad4700 1 -- 172.21.15.5:0/1729661849 reap_dead start 2023-10-16T13:39:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.788+0000 7fbc04537700 1 -- 172.21.15.5:0/1729661849 shutdown_connections 2023-10-16T13:39:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.788+0000 7fbc04537700 1 -- 172.21.15.5:0/1729661849 >> 172.21.15.5:0/1729661849 conn(0x7fbbfc099a30 msgr2=0x7fbbfc0d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:39:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.788+0000 7fbc04537700 1 -- 172.21.15.5:0/1729661849 shutdown_connections 2023-10-16T13:39:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.788+0000 7fbc04537700 1 -- 172.21.15.5:0/1729661849 wait complete. 2023-10-16T13:39:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.789+0000 7fbc04537700 1 Processor -- start 2023-10-16T13:39:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.789+0000 7fbc04537700 1 -- start start 2023-10-16T13:39:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbe8004d90 0x7fbbfc0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbfc06ebc0 0x7fbbfc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 0x7fbbfc0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0cb5f0 con 0x7fbbfc0c5120 2023-10-16T13:39:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0c6410 con 0x7fbbfc06ebc0 2023-10-16T13:39:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc06f580 con 0x7fbbe8004d90 2023-10-16T13:39:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 0x7fbbfc0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 0x7fbbfc0c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44668/0 (socket says 172.21.15.5:44668) 2023-10-16T13:39:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 -- 172.21.15.5:0/934769456 learned_addr learned my addr 172.21.15.5:0/934769456 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:39:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc022d3700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbe8004d90 0x7fbbfc0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc01ad2700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbfc06ebc0 0x7fbbfc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 -- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbe8004d90 msgr2=0x7fbbfc0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbe8004d90 0x7fbbfc0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 -- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbfc06ebc0 msgr2=0x7fbbfc06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:39:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbfc06ebc0 0x7fbbfc06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:39:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 -- 172.21.15.5:0/934769456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0c5e50 con 0x7fbbfc0c5120 2023-10-16T13:39:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc02ad4700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 0x7fbbfc0c55a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4001cb0 tx=0x7fbbf4001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400a340 con 0x7fbbfc0c5120 2023-10-16T13:39:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40019c0 con 0x7fbbfc0c5120 2023-10-16T13:39:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc0c6130 con 0x7fbbfc0c5120 2023-10-16T13:39:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.790+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4026640 con 0x7fbbfc0c5120 2023-10-16T13:39:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.791+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc1f4ae0 con 0x7fbbfc0c5120 2023-10-16T13:39:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.791+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc1f4640 con 0x7fbbfc0c5120 2023-10-16T13:39:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.792+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbbf4019030 con 0x7fbbfc0c5120 2023-10-16T13:39:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.792+0000 7fbbeeffd700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbbe006af00 0x7fbbe006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:39:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.792+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbf408a7d0 con 0x7fbbfc0c5120 2023-10-16T13:39:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.793+0000 7fbc022d3700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbbe006af00 0x7fbbe006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:39:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.793+0000 7fbc022d3700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbbe006af00 0x7fbbe006d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009cc0 tx=0x7fbbf80091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:39:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:39:59.797+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbbf4055c80 con 0x7fbbfc0c5120 2023-10-16T13:40:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.081+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbbfc04ebb0 con 0x7fbbfc0c5120 2023-10-16T13:40:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.081+0000 7fbbeeffd700 1 -- 172.21.15.5:0/934769456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbbf4017090 con 0x7fbbfc0c5120 2023-10-16T13:40:00.084 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:00.085 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:40:00.085 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:40:00.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.085 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:40:00.085 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:40:00.086 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:00.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:00.086 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.087 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:40:00.087 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:40:00.087 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.088 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.088 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:00.088 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:00.088 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.089 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:40:00.089 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:40:00.089 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.089 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.090 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:00.090 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:00.090 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.091 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:40:00.091 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:40:00.091 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.091 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.092 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:00.092 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:00.092 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.093 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:40:00.093 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:40:00.093 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.093 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.093 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.093 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.094 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:40:00.094 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:40:00.094 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.095 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.096 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:40:00.096 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:40:00.096 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.096 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.096 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.097 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.097 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:40:00.098 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:40:00.098 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.098 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.099 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:40:00.099 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:40:00.099 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.100 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.101 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:40:00.101 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:40:00.101 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.101 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.102 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.103 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:40:00.103 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:40:00.103 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.103 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.103 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.104 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.104 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:40:00.104 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:40:00.105 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.105 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:00.105 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:00.105 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.106 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:40:00.106 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:40:00.106 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.106 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:40:00.107 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:40:00.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:40:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:40:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:40:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:40:00.109 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:40:00.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.109 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:40:00.110 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:40:00.110 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:40:00.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:40:00.111 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:40:00.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.111 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:40:00.112 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:40:00.112 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.112 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:00.112 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:40:00.112 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:40:00.112 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:40:00.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.113 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:40:00.113 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:40:00.114 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:40:00.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:00.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:00.114 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.115 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:40:00.115 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:40:00.115 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.116 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:40:00.116 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:40:00.116 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:00.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:00.117 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:40:00.117 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:40:00.117 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:00.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:40:00.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:40:00.117 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:00.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:00.118 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:40:00.118 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:40:00.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.083+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbbe006af00 msgr2=0x7fbbe006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.083+0000 7fbc04537700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbbe006af00 0x7fbbe006d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009cc0 tx=0x7fbbf80091c0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.083+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 msgr2=0x7fbbfc0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.083+0000 7fbc04537700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 0x7fbbfc0c55a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4001cb0 tx=0x7fbbf4001360 comp rx=0 tx=0).stop 2023-10-16T13:40:00.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 shutdown_connections 2023-10-16T13:40:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc0c5120 0x7fbbfc0c55a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbbe006af00 0x7fbbe006d3c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbe8004d90 0x7fbbfc0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 --2- 172.21.15.5:0/934769456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbfc06ebc0 0x7fbbfc06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 >> 172.21.15.5:0/934769456 conn(0x7fbbfc099a30 msgr2=0x7fbbfc160ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 shutdown_connections 2023-10-16T13:40:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.084+0000 7fbc04537700 1 -- 172.21.15.5:0/934769456 wait complete. 2023-10-16T13:40:00.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.245+0000 7f4958042700 1 Processor -- start 2023-10-16T13:40:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.246+0000 7f4958042700 1 -- start start 2023-10-16T13:40:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.246+0000 7f4958042700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f495015a580 0x7f49500727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.246+0000 7f4958042700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f495006ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.246+0000 7f4958042700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4950071aa0 con 0x7f495006c9b0 2023-10-16T13:40:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.246+0000 7f4958042700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495006d370 con 0x7f495015a580 2023-10-16T13:40:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.246+0000 7f4958042700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495015f140 con 0x7f495015e8d0 2023-10-16T13:40:00.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f495015a580 0x7f49500727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f495015a580 0x7f49500727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44672/0 (socket says 172.21.15.5:44672) 2023-10-16T13:40:00.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 -- 172.21.15.5:0/3681750405 learned_addr learned my addr 172.21.15.5:0/3681750405 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:00.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f49565df700 1 --2- 172.21.15.5:0/3681750405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f495006ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 -- 172.21.15.5:0/3681750405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 msgr2=0x7f495006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 --2- 172.21.15.5:0/3681750405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f495006ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 -- 172.21.15.5:0/3681750405 >> v1:172.21.15.112:6789/0 conn(0x7f495006c9b0 legacy=0x7f495015e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 -- 172.21.15.5:0/3681750405 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495015ee60 con 0x7f495015a580 2023-10-16T13:40:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4955dde700 1 --2- 172.21.15.5:0/3681750405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495015a580 0x7f49500727b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f494c00bb90 tx=0x7f494c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe479b7ba57251c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4954ddc700 1 -- 172.21.15.5:0/3681750405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00dd30 con 0x7f495015a580 2023-10-16T13:40:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4954ddc700 1 -- 172.21.15.5:0/3681750405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c00de90 con 0x7f495015a580 2023-10-16T13:40:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.247+0000 7f4954ddc700 1 -- 172.21.15.5:0/3681750405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c010690 con 0x7f495015a580 2023-10-16T13:40:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 -- 172.21.15.5:0/3681750405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495015a580 msgr2=0x7f49500727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 --2- 172.21.15.5:0/3681750405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495015a580 0x7f49500727b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f494c00bb90 tx=0x7f494c00bea0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 -- 172.21.15.5:0/3681750405 shutdown_connections 2023-10-16T13:40:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 --2- 172.21.15.5:0/3681750405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f495006ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 --2- 172.21.15.5:0/3681750405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495015a580 0x7f49500727b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 -- 172.21.15.5:0/3681750405 >> 172.21.15.5:0/3681750405 conn(0x7f495006afb0 msgr2=0x7f49500cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 -- 172.21.15.5:0/3681750405 shutdown_connections 2023-10-16T13:40:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.248+0000 7f4958042700 1 -- 172.21.15.5:0/3681750405 wait complete. 2023-10-16T13:40:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 Processor -- start 2023-10-16T13:40:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 -- start start 2023-10-16T13:40:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 0x7f49501f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f495015a580 0x7f49501501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f49500ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c2110 con 0x7f495006c9b0 2023-10-16T13:40:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495014f9b0 con 0x7f495015a580 2023-10-16T13:40:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.250+0000 7f4958042700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495014fc90 con 0x7f495015e8d0 2023-10-16T13:40:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 0x7f49501f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 0x7f49501f7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44678/0 (socket says 172.21.15.5:44678) 2023-10-16T13:40:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 -- 172.21.15.5:0/1455219201 learned_addr learned my addr 172.21.15.5:0/1455219201 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f49565df700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f49500ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f49555dd700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f495015a580 0x7f49501501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 -- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 msgr2=0x7f49500ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f49500ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 -- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f495015a580 msgr2=0x7f49501501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f495015a580 0x7f49501501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 -- 172.21.15.5:0/1455219201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c00b7f0 con 0x7f495006c9b0 2023-10-16T13:40:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f49565df700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f49500ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4955dde700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 0x7f49501f7120 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f494c000c00 tx=0x7f494c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c003cf0 con 0x7f495006c9b0 2023-10-16T13:40:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c003e70 con 0x7f495006c9b0 2023-10-16T13:40:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49501f6920 con 0x7f495006c9b0 2023-10-16T13:40:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c010690 con 0x7f495006c9b0 2023-10-16T13:40:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.251+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49501f7660 con 0x7f495006c9b0 2023-10-16T13:40:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.252+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49501f6e40 con 0x7f495006c9b0 2023-10-16T13:40:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.253+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f494c019400 con 0x7f495006c9b0 2023-10-16T13:40:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.253+0000 7f49427fc700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f493406af00 0x7f493406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.253+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f494c08a670 con 0x7f495006c9b0 2023-10-16T13:40:00.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.253+0000 7f49555dd700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f493406af00 0x7f493406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.254+0000 7f49555dd700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f493406af00 0x7f493406d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f495015e840 tx=0x7f4944009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.258+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49501f6e40 con 0x7f495006c9b0 2023-10-16T13:40:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.462+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49501f6e40 con 0x7f495006c9b0 2023-10-16T13:40:00.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.463+0000 7f49427fc700 1 -- 172.21.15.5:0/1455219201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+12785 (secure 0 0 0) 0x7f49501f6e40 con 0x7f495006c9b0 2023-10-16T13:40:00.466 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:00.466 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:39:59.646649+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f493406af00 msgr2=0x7f493406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f493406af00 0x7f493406d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f495015e840 tx=0x7f4944009040 comp rx=0 tx=0).stop 2023-10-16T13:40:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 msgr2=0x7f49501f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 0x7f49501f7120 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f494c000c00 tx=0x7f494c004750 comp rx=0 tx=0).stop 2023-10-16T13:40:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 shutdown_connections 2023-10-16T13:40:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f493406af00 0x7f493406d3c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f495015e8d0 0x7f49500ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f495006c9b0 0x7f49501f7120 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 --2- 172.21.15.5:0/1455219201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f495015a580 0x7f49501501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 >> 172.21.15.5:0/1455219201 conn(0x7f495006afb0 msgr2=0x7f4950159550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 shutdown_connections 2023-10-16T13:40:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.465+0000 7f4958042700 1 -- 172.21.15.5:0/1455219201 wait complete. 2023-10-16T13:40:00.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:40:00.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:40:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.605+0000 7f0bda2b9700 1 Processor -- start 2023-10-16T13:40:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.606+0000 7f0bda2b9700 1 -- start start 2023-10-16T13:40:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.606+0000 7f0bda2b9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd40cd950 0x7f0bd415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.606+0000 7f0bda2b9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0bd406a840 0x7f0bd406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.606+0000 7f0bda2b9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd40cf260 con 0x7f0bd40cede0 2023-10-16T13:40:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.606+0000 7f0bda2b9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd41619a0 con 0x7f0bd406a840 2023-10-16T13:40:00.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.606+0000 7f0bda2b9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd406b1f0 con 0x7f0bd40cd950 2023-10-16T13:40:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0bd406a840 0x7f0bd406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0bd406a840 0x7f0bd406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44690/0 (socket says 172.21.15.5:44690) 2023-10-16T13:40:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 -- 172.21.15.5:0/3495879218 learned_addr learned my addr 172.21.15.5:0/3495879218 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd3fff700 1 --2- 172.21.15.5:0/3495879218 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd40cd950 0x7f0bd415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 -- 172.21.15.5:0/3495879218 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd40cd950 msgr2=0x7f0bd415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:00.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 --2- 172.21.15.5:0/3495879218 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd40cd950 0x7f0bd415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 -- 172.21.15.5:0/3495879218 >> v1:172.21.15.112:6789/0 conn(0x7f0bd40cede0 legacy=0x7f0bd415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 -- 172.21.15.5:0/3495879218 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40b2d60 con 0x7f0bd406a840 2023-10-16T13:40:00.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd8856700 1 --2- 172.21.15.5:0/3495879218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd406a840 0x7f0bd406acb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009e50 tx=0x7f0bcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5eb72601198f78b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd2ffd700 1 -- 172.21.15.5:0/3495879218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00e070 con 0x7f0bd406a840 2023-10-16T13:40:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd2ffd700 1 -- 172.21.15.5:0/3495879218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc00b910 con 0x7f0bd406a840 2023-10-16T13:40:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.607+0000 7f0bd2ffd700 1 -- 172.21.15.5:0/3495879218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00bcc0 con 0x7f0bd406a840 2023-10-16T13:40:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 -- 172.21.15.5:0/3495879218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd406a840 msgr2=0x7f0bd406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/3495879218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd406a840 0x7f0bd406acb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009e50 tx=0x7f0bcc00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:00.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 -- 172.21.15.5:0/3495879218 shutdown_connections 2023-10-16T13:40:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/3495879218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd406a840 0x7f0bd406acb0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/3495879218 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd40cd950 0x7f0bd415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 -- 172.21.15.5:0/3495879218 >> 172.21.15.5:0/3495879218 conn(0x7f0bd406dae0 msgr2=0x7f0bd406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 -- 172.21.15.5:0/3495879218 shutdown_connections 2023-10-16T13:40:00.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.608+0000 7f0bda2b9700 1 -- 172.21.15.5:0/3495879218 wait complete. 2023-10-16T13:40:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.609+0000 7f0bda2b9700 1 Processor -- start 2023-10-16T13:40:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.609+0000 7f0bda2b9700 1 -- start start 2023-10-16T13:40:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bda2b9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd406a840 0x7f0bd40b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bda2b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd40cd950 0x7f0bd40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bda2b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 0x7f0bd41539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bda2b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40b47d0 con 0x7f0bd40cede0 2023-10-16T13:40:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bda2b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40acfb0 con 0x7f0bd40cd950 2023-10-16T13:40:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bda2b9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40ad290 con 0x7f0bd406a840 2023-10-16T13:40:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bd8856700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 0x7f0bd41539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bd8856700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 0x7f0bd41539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44696/0 (socket says 172.21.15.5:44696) 2023-10-16T13:40:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bd8856700 1 -- 172.21.15.5:0/1251067173 learned_addr learned my addr 172.21.15.5:0/1251067173 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bd3fff700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd406a840 0x7f0bd40b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.610+0000 7f0bd37fe700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd40cd950 0x7f0bd40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd8856700 1 -- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd406a840 msgr2=0x7f0bd40b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd8856700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd406a840 0x7f0bd40b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd8856700 1 -- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd40cd950 msgr2=0x7f0bd40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd8856700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd40cd950 0x7f0bd40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd8856700 1 -- 172.21.15.5:0/1251067173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009b30 con 0x7f0bd40cede0 2023-10-16T13:40:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd3fff700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd406a840 0x7f0bd40b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd8856700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 0x7f0bd41539a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0bd406d4f0 tx=0x7f0bcc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc004960 con 0x7f0bd40cede0 2023-10-16T13:40:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc0092e0 con 0x7f0bd40cede0 2023-10-16T13:40:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd40ad570 con 0x7f0bd40cede0 2023-10-16T13:40:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc01c660 con 0x7f0bd40cede0 2023-10-16T13:40:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.611+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd40adb30 con 0x7f0bd40cede0 2023-10-16T13:40:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.612+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd4067d20 con 0x7f0bd40cede0 2023-10-16T13:40:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.612+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0bcc01c7c0 con 0x7f0bd40cede0 2023-10-16T13:40:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.613+0000 7f0bd0ff9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0bc006af00 0x7f0bc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.613+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0bcc08afa0 con 0x7f0bd40cede0 2023-10-16T13:40:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.613+0000 7f0bd3fff700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0bc006af00 0x7f0bc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.613+0000 7f0bd3fff700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0bc006af00 0x7f0bc006d3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009c30 tx=0x7f0bc4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.617+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0bcc056430 con 0x7f0bd40cede0 2023-10-16T13:40:00.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.819+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bd40b2100 con 0x7f0bd40cede0 2023-10-16T13:40:00.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.820+0000 7f0bd0ff9700 1 -- 172.21.15.5:0/1251067173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bcc059a50 con 0x7f0bd40cede0 2023-10-16T13:40:00.823 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:40:00.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0bc006af00 msgr2=0x7f0bc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0bc006af00 0x7f0bc006d3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009c30 tx=0x7f0bc4008040 comp rx=0 tx=0).stop 2023-10-16T13:40:00.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 msgr2=0x7f0bd41539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 0x7f0bd41539a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0bd406d4f0 tx=0x7f0bcc004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 shutdown_connections 2023-10-16T13:40:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bd40cede0 0x7f0bd41539a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0bc006af00 0x7f0bc006d3c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0bd406a840 0x7f0bd40b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 --2- 172.21.15.5:0/1251067173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd40cd950 0x7f0bd40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 >> 172.21.15.5:0/1251067173 conn(0x7f0bd406dae0 msgr2=0x7f0bd406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:00.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 shutdown_connections 2023-10-16T13:40:00.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.822+0000 7f0bda2b9700 1 -- 172.21.15.5:0/1251067173 wait complete. 2023-10-16T13:40:00.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:40:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.960+0000 7ffb3b150700 1 Processor -- start 2023-10-16T13:40:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.960+0000 7ffb3b150700 1 -- start start 2023-10-16T13:40:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.960+0000 7ffb3b150700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 0x7ffb340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.960+0000 7ffb3b150700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb340cfc60 0x7ffb340cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb3b150700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3415e7a0 con 0x7ffb3415ab10 2023-10-16T13:40:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb3b150700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340d00d0 con 0x7ffb340cfc60 2023-10-16T13:40:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb3b150700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340b29a0 con 0x7ffb3415f1f0 2023-10-16T13:40:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb38eec700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb3415ab10 0x7ffb340b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54706/0 (socket says 172.21.15.5:54706) 2023-10-16T13:40:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb38eec700 1 -- 172.21.15.5:0/3870550363 learned_addr learned my addr 172.21.15.5:0/3870550363 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315017946 0 0) 0x7ffb3415e7a0 con 0x7ffb3415ab10 2023-10-16T13:40:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb240035b0 con 0x7ffb3415ab10 2023-10-16T13:40:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb33fff700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 0x7ffb340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb396ed700 1 --2- 172.21.15.5:0/3870550363 >> v2:172.21.15.112:3300/0 conn(0x7ffb340cfc60 0x7ffb340cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3717443457 0 0) 0x7ffb240035b0 con 0x7ffb3415ab10 2023-10-16T13:40:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 msgr2=0x7ffb340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 0x7ffb340cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 >> v2:172.21.15.112:3300/0 conn(0x7ffb340cfc60 msgr2=0x7ffb340cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 --2- 172.21.15.5:0/3870550363 >> v2:172.21.15.112:3300/0 conn(0x7ffb340cfc60 0x7ffb340cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340b2c80 con 0x7ffb3415ab10 2023-10-16T13:40:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7ffb28001670 con 0x7ffb3415ab10 2023-10-16T13:40:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 >> v1:172.21.15.5:6789/0 conn(0x7ffb3415ab10 legacy=0x7ffb340b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb24003a00 0x7ffb24003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 0x7ffb24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb24004360 0x7ffb24004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340d00d0 con 0x7ffb24004360 2023-10-16T13:40:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340b29a0 con 0x7ffb24003a00 2023-10-16T13:40:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240055b0 con 0x7ffb3415f1f0 2023-10-16T13:40:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.961+0000 7ffb396ed700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb24004360 0x7ffb24004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb38eec700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb24003a00 0x7ffb24003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb33fff700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 0x7ffb24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb396ed700 1 -- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 msgr2=0x7ffb24004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb396ed700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb3415f1f0 0x7ffb24004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb396ed700 1 -- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb24003a00 msgr2=0x7ffb24003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb396ed700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb24003a00 0x7ffb24003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb396ed700 1 -- 172.21.15.5:0/3870550363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240035b0 con 0x7ffb24004360 2023-10-16T13:40:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb396ed700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb24004360 0x7ffb24004d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009fc0 tx=0x7ffb24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb79596849d71f33 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00ec30 con 0x7ffb24004360 2023-10-16T13:40:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00f040 con 0x7ffb24004360 2023-10-16T13:40:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.962+0000 7ffb337fe700 1 -- 172.21.15.5:0/3870550363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c014480 con 0x7ffb24004360 2023-10-16T13:40:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb3b150700 1 -- 172.21.15.5:0/3870550363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb24004360 msgr2=0x7ffb24004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb3b150700 1 --2- 172.21.15.5:0/3870550363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb24004360 0x7ffb24004d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009fc0 tx=0x7ffb24005880 comp rx=0 tx=0).stop 2023-10-16T13:40:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb396ed700 1 -- 172.21.15.5:0/3870550363 reap_dead start 2023-10-16T13:40:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb3b150700 1 -- 172.21.15.5:0/3870550363 shutdown_connections 2023-10-16T13:40:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb3b150700 1 -- 172.21.15.5:0/3870550363 >> 172.21.15.5:0/3870550363 conn(0x7ffb3406dae0 msgr2=0x7ffb3406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb3b150700 1 -- 172.21.15.5:0/3870550363 shutdown_connections 2023-10-16T13:40:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.963+0000 7ffb3b150700 1 -- 172.21.15.5:0/3870550363 wait complete. 2023-10-16T13:40:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.964+0000 7ffb3b150700 1 Processor -- start 2023-10-16T13:40:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.964+0000 7ffb3b150700 1 -- start start 2023-10-16T13:40:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb3b150700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340c3790 0x7ffb340c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb3b150700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 0x7ffb3415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb3b150700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340c4ee0 0x7ffb34157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb3b150700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3415cfc0 con 0x7ffb340c3b70 2023-10-16T13:40:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb3b150700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3415ca00 con 0x7ffb340c3790 2023-10-16T13:40:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb3b150700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3415cce0 con 0x7ffb340c4ee0 2023-10-16T13:40:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 0x7ffb3415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 0x7ffb3415bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44716/0 (socket says 172.21.15.5:44716) 2023-10-16T13:40:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 -- 172.21.15.5:0/1755526133 learned_addr learned my addr 172.21.15.5:0/1755526133 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb38eec700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340c3790 0x7ffb340c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb396ed700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340c4ee0 0x7ffb34157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 -- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340c4ee0 msgr2=0x7ffb34157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340c4ee0 0x7ffb34157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 -- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340c3790 msgr2=0x7ffb340c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340c3790 0x7ffb340c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 -- 172.21.15.5:0/1755526133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340c41a0 con 0x7ffb340c3b70 2023-10-16T13:40:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb396ed700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340c4ee0 0x7ffb34157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.965+0000 7ffb33fff700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 0x7ffb3415bf40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffb200119f0 tx=0x7ffb20011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.966+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20005c30 con 0x7ffb340c3b70 2023-10-16T13:40:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.966+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20005d90 con 0x7ffb340c3b70 2023-10-16T13:40:00.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.966+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340c4480 con 0x7ffb340c3b70 2023-10-16T13:40:00.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.966+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000f950 con 0x7ffb340c3b70 2023-10-16T13:40:00.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.966+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3415c480 con 0x7ffb340c3b70 2023-10-16T13:40:00.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.967+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340c4000 con 0x7ffb340c3b70 2023-10-16T13:40:00.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.967+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb2000fab0 con 0x7ffb340c3b70 2023-10-16T13:40:00.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.968+0000 7ffb317fa700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb1806af00 0x7ffb1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.968+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb20089920 con 0x7ffb340c3b70 2023-10-16T13:40:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.968+0000 7ffb38eec700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb1806af00 0x7ffb1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.968+0000 7ffb38eec700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb1806af00 0x7ffb1806d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffb28001cf0 tx=0x7ffb28007980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:00.972+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb340c4000 con 0x7ffb340c3b70 2023-10-16T13:40:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.174+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffb340c4000 con 0x7ffb340c3b70 2023-10-16T13:40:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.174+0000 7ffb317fa700 1 -- 172.21.15.5:0/1755526133 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffb340c4000 con 0x7ffb340c3b70 2023-10-16T13:40:01.178 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:01.178 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:40:01.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:01.178 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:40:01.178 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:40:01.179 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:01.179 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:40:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb1806af00 msgr2=0x7ffb1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb1806af00 0x7ffb1806d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffb28001cf0 tx=0x7ffb28007980 comp rx=0 tx=0).stop 2023-10-16T13:40:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 msgr2=0x7ffb3415bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 0x7ffb3415bf40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffb200119f0 tx=0x7ffb20011d00 comp rx=0 tx=0).stop 2023-10-16T13:40:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 shutdown_connections 2023-10-16T13:40:01.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb1806af00 0x7ffb1806d3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340c4ee0 0x7ffb34157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340c3790 0x7ffb340c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 --2- 172.21.15.5:0/1755526133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb340c3b70 0x7ffb3415bf40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 >> 172.21.15.5:0/1755526133 conn(0x7ffb3406dae0 msgr2=0x7ffb34158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:01.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 shutdown_connections 2023-10-16T13:40:01.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.177+0000 7ffb3b150700 1 -- 172.21.15.5:0/1755526133 wait complete. 2023-10-16T13:40:01.191 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:40:01.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:40:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.318+0000 7ff7fff5d700 1 Processor -- start 2023-10-16T13:40:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.318+0000 7ff7fff5d700 1 -- start start 2023-10-16T13:40:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fff5d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7f8162070 0x7ff7f80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fff5d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f80cee20 con 0x7ff7f80cd870 2023-10-16T13:40:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fff5d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f80b2ce0 con 0x7ff7f815d840 2023-10-16T13:40:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fff5d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f80cdce0 con 0x7ff7f8162070 2023-10-16T13:40:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fd4f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7f8162070 0x7ff7f80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fd4f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7f8162070 0x7ff7f80cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44724/0 (socket says 172.21.15.5:44724) 2023-10-16T13:40:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1067659963 learned_addr learned my addr 172.21.15.5:0/1067659963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.319+0000 7ff7fe4fa700 1 --1- 172.21.15.5:0/1067659963 >> v1:172.21.15.5:6789/0 conn(0x7ff7f80cd870 0x7ff7f80caa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54730/0 (socket says 172.21.15.5:54730) 2023-10-16T13:40:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1067659963 >> v1:172.21.15.112:6789/0 conn(0x7ff7f815d840 legacy=0x7ff7f80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1067659963 >> v1:172.21.15.5:6789/0 conn(0x7ff7f80cd870 legacy=0x7ff7f80caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1067659963 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80ceb40 con 0x7ff7f8162070 2023-10-16T13:40:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fccf7700 1 -- 172.21.15.5:0/1067659963 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219463742 0 0) 0x7ff7f80cee20 con 0x7ff7f80cd870 2023-10-16T13:40:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fd4f8700 1 --2- 172.21.15.5:0/1067659963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8162070 0x7ff7f80cd330 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40098f0 tx=0x7ff7f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d00848625f98ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fccf7700 1 -- 172.21.15.5:0/1067659963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400b8a0 con 0x7ff7f8162070 2023-10-16T13:40:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fccf7700 1 -- 172.21.15.5:0/1067659963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400ba00 con 0x7ff7f8162070 2023-10-16T13:40:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fccf7700 1 -- 172.21.15.5:0/1067659963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400bd90 con 0x7ff7f8162070 2023-10-16T13:40:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1067659963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8162070 msgr2=0x7ff7f80cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.320+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1067659963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8162070 0x7ff7f80cd330 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40098f0 tx=0x7ff7f4009c00 comp rx=0 tx=0).stop 2023-10-16T13:40:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.321+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1067659963 shutdown_connections 2023-10-16T13:40:01.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.321+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1067659963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8162070 0x7ff7f80cd330 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.321+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1067659963 >> 172.21.15.5:0/1067659963 conn(0x7ff7f806bd70 msgr2=0x7ff7f806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.321+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1067659963 shutdown_connections 2023-10-16T13:40:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.321+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1067659963 wait complete. 2023-10-16T13:40:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.322+0000 7ff7fff5d700 1 Processor -- start 2023-10-16T13:40:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.322+0000 7ff7fff5d700 1 -- start start 2023-10-16T13:40:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fff5d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff7f80cd870 0x7ff7f80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fff5d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 0x7ff7f81f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fff5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f8162070 0x7ff7f80c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fff5d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81f6910 con 0x7ff7f815d840 2023-10-16T13:40:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fff5d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81f6b40 con 0x7ff7f8162070 2023-10-16T13:40:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fff5d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81f6e20 con 0x7ff7f80cd870 2023-10-16T13:40:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fd4f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 0x7ff7f81f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fd4f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 0x7ff7f81f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44730/0 (socket says 172.21.15.5:44730) 2023-10-16T13:40:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1629677551 learned_addr learned my addr 172.21.15.5:0/1629677551 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.323+0000 7ff7fdcf9700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff7f80cd870 0x7ff7f80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fe4fa700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f8162070 0x7ff7f80c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff7f80cd870 msgr2=0x7ff7f80ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fd4f8700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff7f80cd870 0x7ff7f80ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f8162070 msgr2=0x7ff7f80c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fd4f8700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f8162070 0x7ff7f80c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fd4f8700 1 -- 172.21.15.5:0/1629677551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4009550 con 0x7ff7f815d840 2023-10-16T13:40:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fe4fa700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f8162070 0x7ff7f80c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fdcf9700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff7f80cd870 0x7ff7f80ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fd4f8700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 0x7ff7f81f63d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4014040 tx=0x7ff7f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4011a70 con 0x7ff7f815d840 2023-10-16T13:40:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f401f070 con 0x7ff7f815d840 2023-10-16T13:40:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f81f7100 con 0x7ff7f815d840 2023-10-16T13:40:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4011dd0 con 0x7ff7f815d840 2023-10-16T13:40:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.324+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f80c74d0 con 0x7ff7f815d840 2023-10-16T13:40:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.325+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f80c3ed0 con 0x7ff7f815d840 2023-10-16T13:40:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.326+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff7f4026480 con 0x7ff7f815d840 2023-10-16T13:40:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.326+0000 7ff7ee7fc700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff7dc06af00 0x7ff7dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.326+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7f4021070 con 0x7ff7f815d840 2023-10-16T13:40:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.326+0000 7ff7fdcf9700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff7dc06af00 0x7ff7dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.327+0000 7ff7fdcf9700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff7dc06af00 0x7ff7dc06d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8000f60 tx=0x7ff7e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.331+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7f80c3ed0 con 0x7ff7f815d840 2023-10-16T13:40:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.531+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff7f80c42b0 con 0x7ff7f815d840 2023-10-16T13:40:01.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.638+0000 7ff7ee7fc700 1 -- 172.21.15.5:0/1629677551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff7f80c42b0 con 0x7ff7f815d840 2023-10-16T13:40:01.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.640+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff7dc06af00 msgr2=0x7ff7dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.640+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff7dc06af00 0x7ff7dc06d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8000f60 tx=0x7ff7e8009040 comp rx=0 tx=0).stop 2023-10-16T13:40:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.640+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 msgr2=0x7ff7f81f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.640+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 0x7ff7f81f63d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4014040 tx=0x7ff7f4004750 comp rx=0 tx=0).stop 2023-10-16T13:40:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 shutdown_connections 2023-10-16T13:40:01.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f8162070 0x7ff7f80c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff7dc06af00 0x7ff7dc06d3c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff7f80cd870 0x7ff7f80ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 --2- 172.21.15.5:0/1629677551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f815d840 0x7ff7f81f63d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 >> 172.21.15.5:0/1629677551 conn(0x7ff7f806bd70 msgr2=0x7ff7f80caa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:01.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 shutdown_connections 2023-10-16T13:40:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.641+0000 7ff7fff5d700 1 -- 172.21.15.5:0/1629677551 wait complete. 2023-10-16T13:40:01.646 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:40:01.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:40:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.787+0000 7ff4ad6ed700 1 Processor -- start 2023-10-16T13:40:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.787+0000 7ff4ad6ed700 1 -- start start 2023-10-16T13:40:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4ad6ed700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4a815dc90 0x7ff4a80ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4ad6ed700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff4a80d0820 0x7ff4a80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4ad6ed700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a80cf8c0 con 0x7ff4a80d2410 2023-10-16T13:40:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4ad6ed700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a80cecb0 con 0x7ff4a815dc90 2023-10-16T13:40:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4ad6ed700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a80cef90 con 0x7ff4a80d0820 2023-10-16T13:40:01.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4a815dc90 0x7ff4a80ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4a815dc90 0x7ff4a80ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44736/0 (socket says 172.21.15.5:44736) 2023-10-16T13:40:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1936841313 learned_addr learned my addr 172.21.15.5:0/1936841313 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a77fe700 1 --2- 172.21.15.5:0/1936841313 >> v2:172.21.15.112:3300/0 conn(0x7ff4a80d0820 0x7ff4a80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1936841313 >> v2:172.21.15.112:3300/0 conn(0x7ff4a80d0820 msgr2=0x7ff4a80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 --2- 172.21.15.5:0/1936841313 >> v2:172.21.15.112:3300/0 conn(0x7ff4a80d0820 0x7ff4a80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1936841313 >> v1:172.21.15.112:6789/0 conn(0x7ff4a80d2410 legacy=0x7ff4a80d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1936841313 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80cf270 con 0x7ff4a815dc90 2023-10-16T13:40:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.788+0000 7ff4a6ffd700 1 --2- 172.21.15.5:0/1936841313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a815dc90 0x7ff4a80ce6b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80d1240 tx=0x7ff49c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43889bd86d68f54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4a5ffb700 1 -- 172.21.15.5:0/1936841313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c005e30 con 0x7ff4a815dc90 2023-10-16T13:40:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4a5ffb700 1 -- 172.21.15.5:0/1936841313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c004030 con 0x7ff4a815dc90 2023-10-16T13:40:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4a5ffb700 1 -- 172.21.15.5:0/1936841313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0043e0 con 0x7ff4a815dc90 2023-10-16T13:40:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1936841313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a815dc90 msgr2=0x7ff4a80ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1936841313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a815dc90 0x7ff4a80ce6b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80d1240 tx=0x7ff49c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1936841313 shutdown_connections 2023-10-16T13:40:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1936841313 >> v2:172.21.15.112:3300/0 conn(0x7ff4a80d0820 0x7ff4a80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1936841313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a815dc90 0x7ff4a80ce6b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1936841313 >> 172.21.15.5:0/1936841313 conn(0x7ff4a80d37e0 msgr2=0x7ff4a80d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1936841313 shutdown_connections 2023-10-16T13:40:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.789+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1936841313 wait complete. 2023-10-16T13:40:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 Processor -- start 2023-10-16T13:40:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 -- start start 2023-10-16T13:40:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 0x7ff4a80a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a80d2410 0x7ff4a80b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a815dc90 0x7ff4a81506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80cb930 con 0x7ff4a80d0820 2023-10-16T13:40:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80a0550 con 0x7ff4a80d2410 2023-10-16T13:40:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4ad6ed700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80a0830 con 0x7ff4a815dc90 2023-10-16T13:40:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.791+0000 7ff4a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 0x7ff4a80a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 0x7ff4a80a1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44742/0 (socket says 172.21.15.5:44742) 2023-10-16T13:40:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1245157785 learned_addr learned my addr 172.21.15.5:0/1245157785 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a77fe700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a815dc90 0x7ff4a81506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a815dc90 msgr2=0x7ff4a81506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a815dc90 0x7ff4a81506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a80d2410 msgr2=0x7ff4a80b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a80d2410 0x7ff4a80b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 -- 172.21.15.5:0/1245157785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009500 con 0x7ff4a80d0820 2023-10-16T13:40:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4a6ffd700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 0x7ff4a80a1030 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009c10 tx=0x7ff49c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c003e50 con 0x7ff4a80d0820 2023-10-16T13:40:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c01d430 con 0x7ff4a80d0820 2023-10-16T13:40:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a80a0b10 con 0x7ff4a80d0820 2023-10-16T13:40:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c01d7e0 con 0x7ff4a80d0820 2023-10-16T13:40:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.792+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a80b83d0 con 0x7ff4a80d0820 2023-10-16T13:40:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.793+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a80b85c0 con 0x7ff4a80d0820 2023-10-16T13:40:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.794+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff49c01d940 con 0x7ff4a80d0820 2023-10-16T13:40:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.794+0000 7ff48f7fe700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff49406af00 0x7ff49406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.794+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff49c08aa20 con 0x7ff4a80d0820 2023-10-16T13:40:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.794+0000 7ff4a67fc700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff49406af00 0x7ff49406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.795+0000 7ff4a67fc700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff49406af00 0x7ff49406d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff498000f60 tx=0x7ff498007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:01.799+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff49c055cb0 con 0x7ff4a80d0820 2023-10-16T13:40:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.000+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff4a80a0350 con 0x7ff4a80d0820 2023-10-16T13:40:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.639+0000 7ff48f7fe700 1 -- 172.21.15.5:0/1245157785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff49c0592d0 con 0x7ff4a80d0820 2023-10-16T13:40:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff49406af00 msgr2=0x7ff49406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff49406af00 0x7ff49406d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff498000f60 tx=0x7ff498007a40 comp rx=0 tx=0).stop 2023-10-16T13:40:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 msgr2=0x7ff4a80a1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 0x7ff4a80a1030 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009c10 tx=0x7ff49c004750 comp rx=0 tx=0).stop 2023-10-16T13:40:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 shutdown_connections 2023-10-16T13:40:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff49406af00 0x7ff49406d3c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a815dc90 0x7ff4a81506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a80d0820 0x7ff4a80a1030 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 --2- 172.21.15.5:0/1245157785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a80d2410 0x7ff4a80b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 >> 172.21.15.5:0/1245157785 conn(0x7ff4a80d37e0 msgr2=0x7ff4a80d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 shutdown_connections 2023-10-16T13:40:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.643+0000 7ff4ad6ed700 1 -- 172.21.15.5:0/1245157785 wait complete. 2023-10-16T13:40:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:40:02.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:40:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.803+0000 7fdf37a76700 1 Processor -- start 2023-10-16T13:40:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.803+0000 7fdf37a76700 1 -- start start 2023-10-16T13:40:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf37a76700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf300cd950 0x7fdf3015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf37a76700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf3006a840 0x7fdf3006ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf37a76700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300cf290 con 0x7fdf300cede0 2023-10-16T13:40:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf37a76700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf301619a0 con 0x7fdf3006a840 2023-10-16T13:40:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf37a76700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3006b1b0 con 0x7fdf300cd950 2023-10-16T13:40:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf3006a840 0x7fdf3006ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf3006a840 0x7fdf3006ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44754/0 (socket says 172.21.15.5:44754) 2023-10-16T13:40:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 -- 172.21.15.5:0/1331110113 learned_addr learned my addr 172.21.15.5:0/1331110113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf35011700 1 --1- 172.21.15.5:0/1331110113 >> v1:172.21.15.5:6789/0 conn(0x7fdf300cede0 0x7fdf3015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54754/0 (socket says 172.21.15.5:54754) 2023-10-16T13:40:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf35812700 1 --2- 172.21.15.5:0/1331110113 >> v2:172.21.15.112:3300/0 conn(0x7fdf300cd950 0x7fdf3015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 -- 172.21.15.5:0/1331110113 >> v2:172.21.15.112:3300/0 conn(0x7fdf300cd950 msgr2=0x7fdf3015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 --2- 172.21.15.5:0/1331110113 >> v2:172.21.15.112:3300/0 conn(0x7fdf300cd950 0x7fdf3015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 -- 172.21.15.5:0/1331110113 >> v1:172.21.15.5:6789/0 conn(0x7fdf300cede0 legacy=0x7fdf3015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 -- 172.21.15.5:0/1331110113 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300b2d60 con 0x7fdf3006a840 2023-10-16T13:40:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf34810700 1 -- 172.21.15.5:0/1331110113 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917870709 0 0) 0x7fdf300cf290 con 0x7fdf300cede0 2023-10-16T13:40:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf35812700 1 --2- 172.21.15.5:0/1331110113 >> v2:172.21.15.112:3300/0 conn(0x7fdf300cd950 0x7fdf3015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf36013700 1 --2- 172.21.15.5:0/1331110113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3006a840 0x7fdf3006ac70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf300d0430 tx=0x7fdf2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326ef4125af8bbe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf34810700 1 -- 172.21.15.5:0/1331110113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800e070 con 0x7fdf3006a840 2023-10-16T13:40:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf34810700 1 -- 172.21.15.5:0/1331110113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800b9c0 con 0x7fdf3006a840 2023-10-16T13:40:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.804+0000 7fdf34810700 1 -- 172.21.15.5:0/1331110113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800bd70 con 0x7fdf3006a840 2023-10-16T13:40:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 -- 172.21.15.5:0/1331110113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3006a840 msgr2=0x7fdf3006ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 --2- 172.21.15.5:0/1331110113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3006a840 0x7fdf3006ac70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf300d0430 tx=0x7fdf2800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 -- 172.21.15.5:0/1331110113 shutdown_connections 2023-10-16T13:40:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 --2- 172.21.15.5:0/1331110113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3006a840 0x7fdf3006ac70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 --2- 172.21.15.5:0/1331110113 >> v2:172.21.15.112:3300/0 conn(0x7fdf300cd950 0x7fdf3015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 -- 172.21.15.5:0/1331110113 >> 172.21.15.5:0/1331110113 conn(0x7fdf3006dae0 msgr2=0x7fdf3006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 -- 172.21.15.5:0/1331110113 shutdown_connections 2023-10-16T13:40:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.805+0000 7fdf37a76700 1 -- 172.21.15.5:0/1331110113 wait complete. 2023-10-16T13:40:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.806+0000 7fdf37a76700 1 Processor -- start 2023-10-16T13:40:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.806+0000 7fdf37a76700 1 -- start start 2023-10-16T13:40:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf37a76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf3006a840 0x7fdf3015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf37a76700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf300cd950 0x7fdf30159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf37a76700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 0x7fdf300b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf37a76700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300ae860 con 0x7fdf300cede0 2023-10-16T13:40:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf37a76700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300adf30 con 0x7fdf3006a840 2023-10-16T13:40:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf37a76700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300b4400 con 0x7fdf300cd950 2023-10-16T13:40:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf36013700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 0x7fdf300b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf36013700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 0x7fdf300b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44760/0 (socket says 172.21.15.5:44760) 2023-10-16T13:40:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf36013700 1 -- 172.21.15.5:0/572815555 learned_addr learned my addr 172.21.15.5:0/572815555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf35011700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf300cd950 0x7fdf30159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.807+0000 7fdf35812700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf3006a840 0x7fdf3015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf36013700 1 -- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf300cd950 msgr2=0x7fdf30159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf36013700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf300cd950 0x7fdf30159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf36013700 1 -- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf3006a840 msgr2=0x7fdf3015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf36013700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf3006a840 0x7fdf3015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf36013700 1 -- 172.21.15.5:0/572815555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009b30 con 0x7fdf300cede0 2023-10-16T13:40:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf36013700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 0x7fdf300b3a90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b730 tx=0x7fdf28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf280092e0 con 0x7fdf300cede0 2023-10-16T13:40:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2801c440 con 0x7fdf300cede0 2023-10-16T13:40:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300ae1a0 con 0x7fdf300cede0 2023-10-16T13:40:02.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2801c7f0 con 0x7fdf300cede0 2023-10-16T13:40:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.808+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3015a0d0 con 0x7fdf300cede0 2023-10-16T13:40:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.809+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf300ae9a0 con 0x7fdf300cede0 2023-10-16T13:40:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.809+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf2801c950 con 0x7fdf300cede0 2023-10-16T13:40:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.810+0000 7fdf267fc700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf1406af00 0x7fdf1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.810+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdf2808afe0 con 0x7fdf300cede0 2023-10-16T13:40:02.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.810+0000 7fdf35812700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf1406af00 0x7fdf1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:02.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.810+0000 7fdf35812700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf1406af00 0x7fdf1406d3c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c006fd0 tx=0x7fdf2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:02.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:02.815+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf300ae9a0 con 0x7fdf300cede0 2023-10-16T13:40:03.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.059+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdf300ae9a0 con 0x7fdf300cede0 2023-10-16T13:40:03.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.671+0000 7fdf267fc700 1 -- 172.21.15.5:0/572815555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdf300ae9a0 con 0x7fdf300cede0 2023-10-16T13:40:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf1406af00 msgr2=0x7fdf1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf1406af00 0x7fdf1406d3c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c006fd0 tx=0x7fdf2c008040 comp rx=0 tx=0).stop 2023-10-16T13:40:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 msgr2=0x7fdf300b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 0x7fdf300b3a90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b730 tx=0x7fdf28004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 shutdown_connections 2023-10-16T13:40:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300cede0 0x7fdf300b3a90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf3006a840 0x7fdf3015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf1406af00 0x7fdf1406d3c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 --2- 172.21.15.5:0/572815555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf300cd950 0x7fdf30159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 >> 172.21.15.5:0/572815555 conn(0x7fdf3006dae0 msgr2=0x7fdf3006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.687+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 shutdown_connections 2023-10-16T13:40:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.688+0000 7fdf37a76700 1 -- 172.21.15.5:0/572815555 wait complete. 2023-10-16T13:40:03.694 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 8 and data pool 9 2023-10-16T13:40:03.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:03.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.831+0000 7f2b08ace700 1 Processor -- start 2023-10-16T13:40:03.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.831+0000 7f2b08ace700 1 -- start start 2023-10-16T13:40:03.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b08ace700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:03.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b08ace700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b040cede0 0x7f2b0415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:03.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b08ace700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040cf260 con 0x7f2b0406a840 2023-10-16T13:40:03.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b08ace700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b041619a0 con 0x7f2b040cede0 2023-10-16T13:40:03.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b08ace700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b2d60 con 0x7f2b040cd950 2023-10-16T13:40:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:42680/0 (socket says 172.21.15.5:42680) 2023-10-16T13:40:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.832+0000 7f2b0259c700 1 -- 172.21.15.5:0/165932471 learned_addr learned my addr 172.21.15.5:0/165932471 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b01d9b700 1 --2- 172.21.15.5:0/165932471 >> v2:172.21.15.112:3300/0 conn(0x7f2b040cede0 0x7f2b0415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0259c700 1 -- 172.21.15.5:0/165932471 >> v2:172.21.15.112:3300/0 conn(0x7f2b040cede0 msgr2=0x7f2b0415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:03.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0259c700 1 --2- 172.21.15.5:0/165932471 >> v2:172.21.15.112:3300/0 conn(0x7f2b040cede0 0x7f2b0415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0259c700 1 -- 172.21.15.5:0/165932471 >> v1:172.21.15.112:6789/0 conn(0x7f2b0406a840 legacy=0x7f2b04161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:03.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0259c700 1 -- 172.21.15.5:0/165932471 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040cdd30 con 0x7f2b040cd950 2023-10-16T13:40:03.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b01d9b700 1 --2- 172.21.15.5:0/165932471 >> v2:172.21.15.112:3300/0 conn(0x7f2b040cede0 0x7f2b0415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:03.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0159a700 1 -- 172.21.15.5:0/165932471 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574386569 0 0) 0x7f2b040cf260 con 0x7f2b0406a840 2023-10-16T13:40:03.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0259c700 1 --2- 172.21.15.5:0/165932471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2af80098f0 tx=0x7f2af8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c0f2ba9bfce688 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:03.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0159a700 1 -- 172.21.15.5:0/165932471 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8011830 con 0x7f2b040cd950 2023-10-16T13:40:03.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0159a700 1 -- 172.21.15.5:0/165932471 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af8011990 con 0x7f2b040cd950 2023-10-16T13:40:03.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.833+0000 7f2b0159a700 1 -- 172.21.15.5:0/165932471 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8011d20 con 0x7f2b040cd950 2023-10-16T13:40:03.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 -- 172.21.15.5:0/165932471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 msgr2=0x7f2b0415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:03.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 --2- 172.21.15.5:0/165932471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2af80098f0 tx=0x7f2af8009c00 comp rx=0 tx=0).stop 2023-10-16T13:40:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 -- 172.21.15.5:0/165932471 shutdown_connections 2023-10-16T13:40:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 --2- 172.21.15.5:0/165932471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 --2- 172.21.15.5:0/165932471 >> v2:172.21.15.112:3300/0 conn(0x7f2b040cede0 0x7f2b0415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 -- 172.21.15.5:0/165932471 >> 172.21.15.5:0/165932471 conn(0x7f2b0406dae0 msgr2=0x7f2b0406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 -- 172.21.15.5:0/165932471 shutdown_connections 2023-10-16T13:40:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.834+0000 7f2b08ace700 1 -- 172.21.15.5:0/165932471 wait complete. 2023-10-16T13:40:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.835+0000 7f2b08ace700 1 Processor -- start 2023-10-16T13:40:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.835+0000 7f2b08ace700 1 -- start start 2023-10-16T13:40:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b08ace700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 0x7f2b040cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b08ace700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b08ace700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040cede0 0x7f2b04153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b08ace700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415bc40 con 0x7f2b0406a840 2023-10-16T13:40:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b08ace700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415bf20 con 0x7f2b040cede0 2023-10-16T13:40:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b08ace700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415c200 con 0x7f2b040cd950 2023-10-16T13:40:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 0x7f2b040cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 0x7f2b040cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44782/0 (socket says 172.21.15.5:44782) 2023-10-16T13:40:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 -- 172.21.15.5:0/885031940 learned_addr learned my addr 172.21.15.5:0/885031940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b01d9b700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b02d9d700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040cede0 0x7f2b04153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 -- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 msgr2=0x7f2b0415c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 -- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040cede0 msgr2=0x7f2b04153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040cede0 0x7f2b04153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.836+0000 7f2b0259c700 1 -- 172.21.15.5:0/885031940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4009430 con 0x7f2b0406a840 2023-10-16T13:40:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.837+0000 7f2b0259c700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 0x7f2b040cae70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009c40 tx=0x7f2af8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.837+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8004480 con 0x7f2b0406a840 2023-10-16T13:40:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.837+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af801f070 con 0x7f2b0406a840 2023-10-16T13:40:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.837+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af8009550 con 0x7f2b0406a840 2023-10-16T13:40:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.837+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80038c0 con 0x7f2b0406a840 2023-10-16T13:40:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.837+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b040cb3b0 con 0x7f2b0406a840 2023-10-16T13:40:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.838+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b04153f30 con 0x7f2b0406a840 2023-10-16T13:40:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.838+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2af8021030 con 0x7f2b0406a840 2023-10-16T13:40:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.839+0000 7f2af2ffd700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ae406af00 0x7f2ae406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.839+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2af808aa10 con 0x7f2b0406a840 2023-10-16T13:40:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.839+0000 7f2b01d9b700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ae406af00 0x7f2ae406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.839+0000 7f2b01d9b700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ae406af00 0x7f2ae406d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2b04155520 tx=0x7f2af4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:03.843+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b04153f30 con 0x7f2b0406a840 2023-10-16T13:40:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.045+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b04153f30 con 0x7f2b0406a840 2023-10-16T13:40:04.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.046+0000 7f2af2ffd700 1 -- 172.21.15.5:0/885031940 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f2b04153f30 con 0x7f2b0406a840 2023-10-16T13:40:04.050 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":50,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:03.062163+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ae406af00 msgr2=0x7f2ae406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ae406af00 0x7f2ae406d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2b04155520 tx=0x7f2af4008040 comp rx=0 tx=0).stop 2023-10-16T13:40:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 msgr2=0x7f2b040cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 0x7f2b040cae70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009c40 tx=0x7f2af8004750 comp rx=0 tx=0).stop 2023-10-16T13:40:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 shutdown_connections 2023-10-16T13:40:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040cede0 0x7f2b04153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0406a840 0x7f2b040cae70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ae406af00 0x7f2ae406d3c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 --2- 172.21.15.5:0/885031940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b040cd950 0x7f2b0415c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 >> 172.21.15.5:0/885031940 conn(0x7f2b0406dae0 msgr2=0x7f2b0415da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 shutdown_connections 2023-10-16T13:40:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.048+0000 7f2b08ace700 1 -- 172.21.15.5:0/885031940 wait complete. 2023-10-16T13:40:04.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc180901700 1 Processor -- start 2023-10-16T13:40:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc180901700 1 -- start start 2023-10-16T13:40:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc180901700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 0x7fc17c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc180901700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c15ee90 con 0x7fc17c0cf6d0 2023-10-16T13:40:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc180901700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c158370 con 0x7fc17c0d1d90 2023-10-16T13:40:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc180901700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0cfb50 con 0x7fc17c15eab0 2023-10-16T13:40:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc179d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc17c0cf6d0 0x7fc17c0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54794/0 (socket says 172.21.15.5:54794) 2023-10-16T13:40:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.186+0000 7fc179d9b700 1 -- 172.21.15.5:0/2982625643 learned_addr learned my addr 172.21.15.5:0/2982625643 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17a59c700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 0x7fc17c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159516128 0 0) 0x7fc17c15ee90 con 0x7fc17c0cf6d0 2023-10-16T13:40:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1640035b0 con 0x7fc17c0cf6d0 2023-10-16T13:40:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764734068 0 0) 0x7fc1640035b0 con 0x7fc17c0cf6d0 2023-10-16T13:40:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 msgr2=0x7fc17c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 0x7fc17c0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 >> v1:172.21.15.112:6789/0 conn(0x7fc17c0d1d90 legacy=0x7fc17c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0d23b0 con 0x7fc17c0cf6d0 2023-10-16T13:40:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fc16c001670 con 0x7fc17c0cf6d0 2023-10-16T13:40:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 >> v1:172.21.15.5:6789/0 conn(0x7fc17c0cf6d0 legacy=0x7fc17c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc164003a30 0x7fc164003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 0x7fc164004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164004d90 0x7fc164005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0cfb50 con 0x7fc164003a30 2023-10-16T13:40:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16400bac0 con 0x7fc164004d90 2023-10-16T13:40:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16400bc80 con 0x7fc17c15eab0 2023-10-16T13:40:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17a59c700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc164003a30 0x7fc164003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc179d9b700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 0x7fc164004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17ad9d700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164004d90 0x7fc164005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.187+0000 7fc17a59c700 1 -- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 msgr2=0x7fc164004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17a59c700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c15eab0 0x7fc164004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17a59c700 1 -- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164004d90 msgr2=0x7fc164005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17a59c700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164004d90 0x7fc164005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17a59c700 1 -- 172.21.15.5:0/2982625643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640035b0 con 0x7fc164003a30 2023-10-16T13:40:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17ad9d700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164004d90 0x7fc164005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17a59c700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc164003a30 0x7fc164003e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc170009b30 tx=0x7fc164005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227ef386ef50df0f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000e6c0 con 0x7fc164003a30 2023-10-16T13:40:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17000e820 con 0x7fc164003a30 2023-10-16T13:40:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17959a700 1 -- 172.21.15.5:0/2982625643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000eb90 con 0x7fc164003a30 2023-10-16T13:40:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc180901700 1 -- 172.21.15.5:0/2982625643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc164003a30 msgr2=0x7fc164003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc180901700 1 --2- 172.21.15.5:0/2982625643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc164003a30 0x7fc164003e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc170009b30 tx=0x7fc164005880 comp rx=0 tx=0).stop 2023-10-16T13:40:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc17ad9d700 1 -- 172.21.15.5:0/2982625643 reap_dead start 2023-10-16T13:40:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc180901700 1 -- 172.21.15.5:0/2982625643 shutdown_connections 2023-10-16T13:40:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.188+0000 7fc180901700 1 -- 172.21.15.5:0/2982625643 >> 172.21.15.5:0/2982625643 conn(0x7fc17c0665a0 msgr2=0x7fc17c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.189+0000 7fc180901700 1 -- 172.21.15.5:0/2982625643 shutdown_connections 2023-10-16T13:40:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.189+0000 7fc180901700 1 -- 172.21.15.5:0/2982625643 wait complete. 2023-10-16T13:40:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.190+0000 7fc180901700 1 Processor -- start 2023-10-16T13:40:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.190+0000 7fc180901700 1 -- start start 2023-10-16T13:40:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164003a30 0x7fc17c1f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c1f2980 0x7fc17c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 0x7fc17c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c151550 con 0x7fc17c1f2e00 2023-10-16T13:40:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1f43c0 con 0x7fc164003a30 2023-10-16T13:40:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1f7470 con 0x7fc17c1f2980 2023-10-16T13:40:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 0x7fc17c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 0x7fc17c0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44804/0 (socket says 172.21.15.5:44804) 2023-10-16T13:40:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 -- 172.21.15.5:0/3076380315 learned_addr learned my addr 172.21.15.5:0/3076380315 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17a59c700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164003a30 0x7fc17c1f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc179d9b700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c1f2980 0x7fc17c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 -- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c1f2980 msgr2=0x7fc17c0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c1f2980 0x7fc17c0c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 -- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164003a30 msgr2=0x7fc17c1f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164003a30 0x7fc17c1f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 -- 172.21.15.5:0/3076380315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c1f33a0 con 0x7fc17c1f2e00 2023-10-16T13:40:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc17ad9d700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 0x7fc17c0c7a50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc17c067550 tx=0x7fc17400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174003c10 con 0x7fc17c1f2e00 2023-10-16T13:40:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174003d70 con 0x7fc17c1f2e00 2023-10-16T13:40:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1f3680 con 0x7fc17c1f2e00 2023-10-16T13:40:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.191+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1740052d0 con 0x7fc17c1f2e00 2023-10-16T13:40:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.192+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c1f6780 con 0x7fc17c1f2e00 2023-10-16T13:40:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.193+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c1f3ba0 con 0x7fc17c1f2e00 2023-10-16T13:40:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.193+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc174005430 con 0x7fc17c1f2e00 2023-10-16T13:40:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.193+0000 7fc16affd700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc15c06af00 0x7fc15c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.193+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc174089640 con 0x7fc17c1f2e00 2023-10-16T13:40:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.193+0000 7fc17a59c700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc15c06af00 0x7fc15c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.194+0000 7fc17a59c700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc15c06af00 0x7fc15c06d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc1700090b0 tx=0x7fc170008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.198+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc17c1f3ba0 con 0x7fc17c1f2e00 2023-10-16T13:40:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.400+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc17c1f3ba0 con 0x7fc17c1f2e00 2023-10-16T13:40:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.401+0000 7fc16affd700 1 -- 172.21.15.5:0/3076380315 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16506 (secure 0 0 0) 0x7fc17c1f3ba0 con 0x7fc17c1f2e00 2023-10-16T13:40:04.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:04.405 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":50,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:03.062163+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc15c06af00 msgr2=0x7fc15c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc15c06af00 0x7fc15c06d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc1700090b0 tx=0x7fc170008030 comp rx=0 tx=0).stop 2023-10-16T13:40:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 msgr2=0x7fc17c0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 0x7fc17c0c7a50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc17c067550 tx=0x7fc17400ee70 comp rx=0 tx=0).stop 2023-10-16T13:40:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 shutdown_connections 2023-10-16T13:40:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17c1f2e00 0x7fc17c0c7a50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc164003a30 0x7fc17c1f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc15c06af00 0x7fc15c06d3c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 --2- 172.21.15.5:0/3076380315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc17c1f2980 0x7fc17c0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 >> 172.21.15.5:0/3076380315 conn(0x7fc17c0665a0 msgr2=0x7fc17c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 shutdown_connections 2023-10-16T13:40:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.404+0000 7fc180901700 1 -- 172.21.15.5:0/3076380315 wait complete. 2023-10-16T13:40:04.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:40:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.543+0000 7f6dda12e700 1 Processor -- start 2023-10-16T13:40:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.543+0000 7f6dda12e700 1 -- start start 2023-10-16T13:40:04.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dda12e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6dd40cd950 0x7f6dd415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dda12e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dda12e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40cf290 con 0x7f6dd40cede0 2023-10-16T13:40:04.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dda12e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd41619a0 con 0x7f6dd40cd950 2023-10-16T13:40:04.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dda12e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd406b1f0 con 0x7f6dd406a840 2023-10-16T13:40:04.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dd37fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6dd40cd950 0x7f6dd415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dd37fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6dd40cd950 0x7f6dd415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44808/0 (socket says 172.21.15.5:44808) 2023-10-16T13:40:04.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.544+0000 7f6dd37fe700 1 -- 172.21.15.5:0/1697257156 learned_addr learned my addr 172.21.15.5:0/1697257156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd3fff700 1 --2- 172.21.15.5:0/1697257156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd37fe700 1 -- 172.21.15.5:0/1697257156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 msgr2=0x7f6dd406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd37fe700 1 --2- 172.21.15.5:0/1697257156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd406acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd37fe700 1 -- 172.21.15.5:0/1697257156 >> v1:172.21.15.112:6789/0 conn(0x7f6dd40cede0 legacy=0x7f6dd415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd37fe700 1 -- 172.21.15.5:0/1697257156 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40b2d60 con 0x7f6dd40cd950 2023-10-16T13:40:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd37fe700 1 --2- 172.21.15.5:0/1697257156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd415e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098f0 tx=0x7f6dbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba058ed11db34910 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd27fc700 1 -- 172.21.15.5:0/1697257156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004230 con 0x7f6dd40cd950 2023-10-16T13:40:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd27fc700 1 -- 172.21.15.5:0/1697257156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc004390 con 0x7f6dd40cd950 2023-10-16T13:40:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dd27fc700 1 -- 172.21.15.5:0/1697257156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0036a0 con 0x7f6dd40cd950 2023-10-16T13:40:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dda12e700 1 -- 172.21.15.5:0/1697257156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 msgr2=0x7f6dd415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.545+0000 7f6dda12e700 1 --2- 172.21.15.5:0/1697257156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd415e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098f0 tx=0x7f6dbc009c00 comp rx=0 tx=0).stop 2023-10-16T13:40:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.546+0000 7f6dda12e700 1 -- 172.21.15.5:0/1697257156 shutdown_connections 2023-10-16T13:40:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.546+0000 7f6dda12e700 1 --2- 172.21.15.5:0/1697257156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.546+0000 7f6dda12e700 1 --2- 172.21.15.5:0/1697257156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd415e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.546+0000 7f6dda12e700 1 -- 172.21.15.5:0/1697257156 >> 172.21.15.5:0/1697257156 conn(0x7f6dd406dae0 msgr2=0x7f6dd406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.546+0000 7f6dda12e700 1 -- 172.21.15.5:0/1697257156 shutdown_connections 2023-10-16T13:40:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.546+0000 7f6dda12e700 1 -- 172.21.15.5:0/1697257156 wait complete. 2023-10-16T13:40:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.547+0000 7f6dda12e700 1 Processor -- start 2023-10-16T13:40:04.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.547+0000 7f6dda12e700 1 -- start start 2023-10-16T13:40:04.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dda12e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd40b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dda12e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dda12e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd40cede0 0x7f6dd40c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dda12e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40c8ae0 con 0x7f6dd40cd950 2023-10-16T13:40:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dda12e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4153a90 con 0x7f6dd40cede0 2023-10-16T13:40:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dda12e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40c4ff0 con 0x7f6dd406a840 2023-10-16T13:40:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd4153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44816/0 (socket says 172.21.15.5:44816) 2023-10-16T13:40:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 -- 172.21.15.5:0/3642121815 learned_addr learned my addr 172.21.15.5:0/3642121815 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd37fe700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd40b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd3fff700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd40cede0 0x7f6dd40c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 -- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 msgr2=0x7f6dd40b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd40b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 -- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd40cede0 msgr2=0x7f6dd40c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd40cede0 0x7f6dd40c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 -- 172.21.15.5:0/3642121815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009550 con 0x7f6dd40cd950 2023-10-16T13:40:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dd2ffd700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd4153550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c4e0 tx=0x7f6dc400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.548+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4011790 con 0x7f6dd40cd950 2023-10-16T13:40:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.549+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc40118f0 con 0x7f6dd40cd950 2023-10-16T13:40:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.549+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4011ca0 con 0x7f6dd40cd950 2023-10-16T13:40:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.549+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd41f36f0 con 0x7f6dd40cd950 2023-10-16T13:40:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.549+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd40c4d10 con 0x7f6dd40cd950 2023-10-16T13:40:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.549+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd40c8c20 con 0x7f6dd40cd950 2023-10-16T13:40:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.550+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6dc401c460 con 0x7f6dd40cd950 2023-10-16T13:40:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.550+0000 7f6dcbfff700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6db406af00 0x7f6db406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.551+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dc40892e0 con 0x7f6dd40cd950 2023-10-16T13:40:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.551+0000 7f6dd37fe700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6db406af00 0x7f6db406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.551+0000 7f6dd37fe700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6db406af00 0x7f6db406d3c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009130 tx=0x7f6dbc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.555+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dd40c8c20 con 0x7f6dd40cd950 2023-10-16T13:40:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:04.806+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6dd40c8c20 con 0x7f6dd40cd950 2023-10-16T13:40:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.689+0000 7f6dcbfff700 1 -- 172.21.15.5:0/3642121815 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6dd40c8c20 con 0x7f6dd40cd950 2023-10-16T13:40:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.691+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6db406af00 msgr2=0x7f6db406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.691+0000 7f6dda12e700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6db406af00 0x7f6db406d3c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009130 tx=0x7f6dbc008030 comp rx=0 tx=0).stop 2023-10-16T13:40:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.691+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 msgr2=0x7f6dd4153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd4153550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c4e0 tx=0x7f6dc400c7f0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 shutdown_connections 2023-10-16T13:40:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd40cede0 0x7f6dd40c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6db406af00 0x7f6db406d3c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dd406a840 0x7f6dd40b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 --2- 172.21.15.5:0/3642121815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dd40cd950 0x7f6dd4153550 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 >> 172.21.15.5:0/3642121815 conn(0x7f6dd406dae0 msgr2=0x7f6dd4160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 shutdown_connections 2023-10-16T13:40:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.692+0000 7f6dda12e700 1 -- 172.21.15.5:0/3642121815 wait complete. 2023-10-16T13:40:05.709 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:40:05.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:40:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.842+0000 7f2137e41700 1 Processor -- start 2023-10-16T13:40:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.842+0000 7f2137e41700 1 -- start start 2023-10-16T13:40:05.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2137e41700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 0x7f21300cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2137e41700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300b2d60 con 0x7f21300cd950 2023-10-16T13:40:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2137e41700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300cdd30 con 0x7f213015e2f0 2023-10-16T13:40:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2137e41700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21301619a0 con 0x7f213006af50 2023-10-16T13:40:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2135bdd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21300cd950 0x7f213015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54826/0 (socket says 172.21.15.5:54826) 2023-10-16T13:40:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2135bdd700 1 -- 172.21.15.5:0/2032858918 learned_addr learned my addr 172.21.15.5:0/2032858918 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f21363de700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 0x7f21300cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387801540 0 0) 0x7f21300b2d60 con 0x7f21300cd950 2023-10-16T13:40:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f211c0035b0 con 0x7f21300cd950 2023-10-16T13:40:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339656536 0 0) 0x7f21300cdd30 con 0x7f213015e2f0 2023-10-16T13:40:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21300b2d60 con 0x7f213015e2f0 2023-10-16T13:40:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338820291 0 0) 0x7f211c0035b0 con 0x7f21300cd950 2023-10-16T13:40:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 msgr2=0x7f21300cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 0x7f21300cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 >> v1:172.21.15.112:6789/0 conn(0x7f213015e2f0 legacy=0x7f213006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213015e920 con 0x7f21300cd950 2023-10-16T13:40:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f212c001670 con 0x7f21300cd950 2023-10-16T13:40:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.843+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 >> v1:172.21.15.5:6789/0 conn(0x7f21300cd950 legacy=0x7f213015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f211c003bc0 0x7f211c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f211c004850 0x7f211c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 0x7f211c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301619a0 con 0x7f211c003bc0 2023-10-16T13:40:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c00baf0 con 0x7f211c004850 2023-10-16T13:40:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c00bcb0 con 0x7f213006af50 2023-10-16T13:40:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f211c003bc0 0x7f211c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f21353dc700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f211c004850 0x7f211c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f21363de700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 0x7f211c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 -- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 msgr2=0x7f211c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f213006af50 0x7f211c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 -- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f211c004850 msgr2=0x7f211c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f211c004850 0x7f211c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 -- 172.21.15.5:0/2032858918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0035b0 con 0x7f211c003bc0 2023-10-16T13:40:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f21353dc700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f211c004850 0x7f211c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2135bdd700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f211c003bc0 0x7f211c003fc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f212c00c160 tx=0x7f211c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c004131c96f87130 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c00cca0 con 0x7f211c003bc0 2023-10-16T13:40:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c00ce20 con 0x7f211c003bc0 2023-10-16T13:40:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.844+0000 7f2134bdb700 1 -- 172.21.15.5:0/2032858918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c005ba0 con 0x7f211c003bc0 2023-10-16T13:40:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f2137e41700 1 -- 172.21.15.5:0/2032858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f211c003bc0 msgr2=0x7f211c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f2137e41700 1 --2- 172.21.15.5:0/2032858918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f211c003bc0 0x7f211c003fc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f212c00c160 tx=0x7f211c005880 comp rx=0 tx=0).stop 2023-10-16T13:40:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f21363de700 1 -- 172.21.15.5:0/2032858918 reap_dead start 2023-10-16T13:40:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f2137e41700 1 -- 172.21.15.5:0/2032858918 shutdown_connections 2023-10-16T13:40:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f2137e41700 1 -- 172.21.15.5:0/2032858918 >> 172.21.15.5:0/2032858918 conn(0x7f213006dae0 msgr2=0x7f213006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f2137e41700 1 -- 172.21.15.5:0/2032858918 shutdown_connections 2023-10-16T13:40:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.845+0000 7f2137e41700 1 -- 172.21.15.5:0/2032858918 wait complete. 2023-10-16T13:40:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.847+0000 7f2137e41700 1 Processor -- start 2023-10-16T13:40:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.847+0000 7f2137e41700 1 -- start start 2023-10-16T13:40:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f211c003bc0 0x7f2130153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 0x7f21300b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f213015bfd0 0x7f213015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130153fe0 con 0x7f21300b3a60 2023-10-16T13:40:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213015c990 con 0x7f213015bfd0 2023-10-16T13:40:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21300c90c0 con 0x7f211c003bc0 2023-10-16T13:40:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 0x7f21300b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 0x7f21300b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44836/0 (socket says 172.21.15.5:44836) 2023-10-16T13:40:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 -- 172.21.15.5:0/3104446752 learned_addr learned my addr 172.21.15.5:0/3104446752 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2135bdd700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f211c003bc0 0x7f2130153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21363de700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f213015bfd0 0x7f213015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 -- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f211c003bc0 msgr2=0x7f2130153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f211c003bc0 0x7f2130153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 -- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f213015bfd0 msgr2=0x7f213015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f213015bfd0 0x7f213015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 -- 172.21.15.5:0/3104446752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300c8790 con 0x7f21300b3a60 2023-10-16T13:40:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21363de700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f213015bfd0 0x7f213015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21353dc700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 0x7f21300b3ee0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f212000e7b0 tx=0x7f212000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200052e0 con 0x7f21300b3a60 2023-10-16T13:40:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120005440 con 0x7f21300b3a60 2023-10-16T13:40:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21300c8a70 con 0x7f21300b3a60 2023-10-16T13:40:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200038d0 con 0x7f21300b3a60 2023-10-16T13:40:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.848+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21300c9550 con 0x7f21300b3a60 2023-10-16T13:40:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.849+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2130067d20 con 0x7f21300b3a60 2023-10-16T13:40:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.850+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2120003a30 con 0x7f21300b3a60 2023-10-16T13:40:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.850+0000 7f21267fc700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f211406af00 0x7f211406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.850+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2120088b60 con 0x7f21300b3a60 2023-10-16T13:40:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.850+0000 7f2135bdd700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f211406af00 0x7f211406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:05.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.851+0000 7f2135bdd700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f211406af00 0x7f211406d3c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c00 tx=0x7f212c007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:05.855+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2120053b80 con 0x7f21300b3a60 2023-10-16T13:40:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.103+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21300c9200 con 0x7f21300b3a60 2023-10-16T13:40:06.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.690+0000 7f21267fc700 1 -- 172.21.15.5:0/3104446752 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f21200571a0 con 0x7f21300b3a60 2023-10-16T13:40:06.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.692+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f211406af00 msgr2=0x7f211406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.692+0000 7f2137e41700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f211406af00 0x7f211406d3c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c00 tx=0x7f212c007000 comp rx=0 tx=0).stop 2023-10-16T13:40:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.692+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 msgr2=0x7f21300b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.692+0000 7f2137e41700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 0x7f21300b3ee0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f212000e7b0 tx=0x7f212000eac0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 shutdown_connections 2023-10-16T13:40:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f213015bfd0 0x7f213015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f211406af00 0x7f211406d3c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f211c003bc0 0x7f2130153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 --2- 172.21.15.5:0/3104446752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21300b3a60 0x7f21300b3ee0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 >> 172.21.15.5:0/3104446752 conn(0x7f213006dae0 msgr2=0x7f21300b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 shutdown_connections 2023-10-16T13:40:06.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.693+0000 7f2137e41700 1 -- 172.21.15.5:0/3104446752 wait complete. 2023-10-16T13:40:06.709 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:40:06.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:06.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.836+0000 7f75ca9db700 1 Processor -- start 2023-10-16T13:40:06.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.836+0000 7f75ca9db700 1 -- start start 2023-10-16T13:40:06.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75ca9db700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f75c40cf8a0 0x7f75c40d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:06.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75ca9db700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75c40d1bc0 0x7f75c40cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:06.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75ca9db700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c415ee90 con 0x7f75c415eab0 2023-10-16T13:40:06.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75ca9db700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c4158370 con 0x7f75c40d1bc0 2023-10-16T13:40:06.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75ca9db700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c40d23b0 con 0x7f75c40cf8a0 2023-10-16T13:40:06.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75c40d1bc0 0x7f75c40cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:06.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75c40d1bc0 0x7f75c40cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44846/0 (socket says 172.21.15.5:44846) 2023-10-16T13:40:06.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 -- 172.21.15.5:0/1081121468 learned_addr learned my addr 172.21.15.5:0/1081121468 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:06.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c37fe700 1 --2- 172.21.15.5:0/1081121468 >> v2:172.21.15.112:3300/0 conn(0x7f75c40cf8a0 0x7f75c40d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:06.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 -- 172.21.15.5:0/1081121468 >> v2:172.21.15.112:3300/0 conn(0x7f75c40cf8a0 msgr2=0x7f75c40d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 --2- 172.21.15.5:0/1081121468 >> v2:172.21.15.112:3300/0 conn(0x7f75c40cf8a0 0x7f75c40d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 -- 172.21.15.5:0/1081121468 >> v1:172.21.15.112:6789/0 conn(0x7f75c415eab0 legacy=0x7f75c40cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c8f78700 1 -- 172.21.15.5:0/1081121468 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40cda20 con 0x7f75c40d1bc0 2023-10-16T13:40:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.837+0000 7f75c37fe700 1 --2- 172.21.15.5:0/1081121468 >> v2:172.21.15.112:3300/0 conn(0x7f75c40cf8a0 0x7f75c40d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75c8f78700 1 --2- 172.21.15.5:0/1081121468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40d1bc0 0x7f75c40cbc10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f75c40b3180 tx=0x7f75bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7f334c8006bf82 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:06.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75c2ffd700 1 -- 172.21.15.5:0/1081121468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00e070 con 0x7f75c40d1bc0 2023-10-16T13:40:06.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75c2ffd700 1 -- 172.21.15.5:0/1081121468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc003a20 con 0x7f75c40d1bc0 2023-10-16T13:40:06.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75c2ffd700 1 -- 172.21.15.5:0/1081121468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc003dd0 con 0x7f75c40d1bc0 2023-10-16T13:40:06.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 -- 172.21.15.5:0/1081121468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40d1bc0 msgr2=0x7f75c40cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:06.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1081121468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40d1bc0 0x7f75c40cbc10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f75c40b3180 tx=0x7f75bc00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:06.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 -- 172.21.15.5:0/1081121468 shutdown_connections 2023-10-16T13:40:06.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1081121468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40d1bc0 0x7f75c40cbc10 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1081121468 >> v2:172.21.15.112:3300/0 conn(0x7f75c40cf8a0 0x7f75c40d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 -- 172.21.15.5:0/1081121468 >> 172.21.15.5:0/1081121468 conn(0x7f75c40665a0 msgr2=0x7f75c4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:06.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 -- 172.21.15.5:0/1081121468 shutdown_connections 2023-10-16T13:40:06.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.838+0000 7f75ca9db700 1 -- 172.21.15.5:0/1081121468 wait complete. 2023-10-16T13:40:06.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.840+0000 7f75ca9db700 1 Processor -- start 2023-10-16T13:40:06.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.840+0000 7f75ca9db700 1 -- start start 2023-10-16T13:40:06.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 0x7f75c415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:06.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f75c40d1bc0 0x7f75c4157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:06.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c415eab0 0x7f75c40b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:06.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4161960 con 0x7f75c40cf8a0 2023-10-16T13:40:06.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4160d50 con 0x7f75c415eab0 2023-10-16T13:40:06.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4161030 con 0x7f75c40d1bc0 2023-10-16T13:40:06.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 0x7f75c415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:06.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 0x7f75c415fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44848/0 (socket says 172.21.15.5:44848) 2023-10-16T13:40:06.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 -- 172.21.15.5:0/1345345622 learned_addr learned my addr 172.21.15.5:0/1345345622 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:06.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c37fe700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f75c40d1bc0 0x7f75c4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:06.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c8f78700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c415eab0 0x7f75c40b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:06.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 -- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f75c40d1bc0 msgr2=0x7f75c4157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:06.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f75c40d1bc0 0x7f75c4157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 -- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c415eab0 msgr2=0x7f75c40b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:06.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c415eab0 0x7f75c40b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:06.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 -- 172.21.15.5:0/1345345622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009b30 con 0x7f75c40cf8a0 2023-10-16T13:40:06.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c3fff700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 0x7f75c415fa60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f75b400c4d0 tx=0x7f75b400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:06.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011790 con 0x7f75c40cf8a0 2023-10-16T13:40:06.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b40118f0 con 0x7f75c40cf8a0 2023-10-16T13:40:06.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4161310 con 0x7f75c40cf8a0 2023-10-16T13:40:06.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011ca0 con 0x7f75c40cf8a0 2023-10-16T13:40:06.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.841+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c4161df0 con 0x7f75c40cf8a0 2023-10-16T13:40:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.842+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4161c40 con 0x7f75c40cf8a0 2023-10-16T13:40:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.843+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75b401c460 con 0x7f75c40cf8a0 2023-10-16T13:40:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.843+0000 7f75c0ff9700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f75a406af00 0x7f75a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.843+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75b4089230 con 0x7f75c40cf8a0 2023-10-16T13:40:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.844+0000 7f75c37fe700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f75a406af00 0x7f75a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.844+0000 7f75c37fe700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f75a406af00 0x7f75a406d3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75c40cf7e0 tx=0x7f75ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:06.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:06.848+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75b4054370 con 0x7f75c40cf8a0 2023-10-16T13:40:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.098+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75c40ce290 con 0x7f75c40cf8a0 2023-10-16T13:40:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.098+0000 7f75c0ff9700 1 -- 172.21.15.5:0/1345345622 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f75b4057990 con 0x7f75c40cf8a0 2023-10-16T13:40:07.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:07.101 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:03.062480+0000","modified":"2023-10-16T13:40:06.104790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1547849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1547849780},{"type":"v1","addr":"172.21.15.5:6835","nonce":1547849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-16T13:40:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f75a406af00 msgr2=0x7f75a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f75a406af00 0x7f75a406d3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75c40cf7e0 tx=0x7f75ac008040 comp rx=0 tx=0).stop 2023-10-16T13:40:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 msgr2=0x7f75c415fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 0x7f75c415fa60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f75b400c4d0 tx=0x7f75b400c7e0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 shutdown_connections 2023-10-16T13:40:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c415eab0 0x7f75c40b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c40cf8a0 0x7f75c415fa60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f75a406af00 0x7f75a406d3c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 --2- 172.21.15.5:0/1345345622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f75c40d1bc0 0x7f75c4157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 >> 172.21.15.5:0/1345345622 conn(0x7f75c40665a0 msgr2=0x7f75c406c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 shutdown_connections 2023-10-16T13:40:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.100+0000 7f75ca9db700 1 -- 172.21.15.5:0/1345345622 wait complete. 2023-10-16T13:40:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2023-10-16T13:40:07.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:07.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.238+0000 7f2d117e4700 1 Processor -- start 2023-10-16T13:40:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.238+0000 7f2d117e4700 1 -- start start 2023-10-16T13:40:07.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d117e4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d0c15dbc0 0x7f2d0c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d117e4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d117e4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c15e4e0 con 0x7f2d0c0b7050 2023-10-16T13:40:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d117e4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b7560 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d117e4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b7840 con 0x7f2d0c0d3fc0 2023-10-16T13:40:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d0c15dbc0 0x7f2d0c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d0c15dbc0 0x7f2d0c15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44856/0 (socket says 172.21.15.5:44856) 2023-10-16T13:40:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 -- 172.21.15.5:0/1352112773 learned_addr learned my addr 172.21.15.5:0/1352112773 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0a7fc700 1 --2- 172.21.15.5:0/1352112773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 -- 172.21.15.5:0/1352112773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 msgr2=0x7f2d0c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 --2- 172.21.15.5:0/1352112773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 -- 172.21.15.5:0/1352112773 >> v1:172.21.15.112:6789/0 conn(0x7f2d0c0b7050 legacy=0x7f2d0c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 -- 172.21.15.5:0/1352112773 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0b7b20 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d0affd700 1 --2- 172.21.15.5:0/1352112773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c15dfa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc006fd0 tx=0x7f2cfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad64e66ac115d955 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d09ffb700 1 -- 172.21.15.5:0/1352112773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc005e30 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d09ffb700 1 -- 172.21.15.5:0/1352112773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc006030 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.239+0000 7f2d09ffb700 1 -- 172.21.15.5:0/1352112773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0063c0 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 -- 172.21.15.5:0/1352112773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 msgr2=0x7f2d0c15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1352112773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c15dfa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc006fd0 tx=0x7f2cfc009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 -- 172.21.15.5:0/1352112773 shutdown_connections 2023-10-16T13:40:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1352112773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c15dfa0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1352112773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 -- 172.21.15.5:0/1352112773 >> 172.21.15.5:0/1352112773 conn(0x7f2d0c09cb40 msgr2=0x7f2d0c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 -- 172.21.15.5:0/1352112773 shutdown_connections 2023-10-16T13:40:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.240+0000 7f2d117e4700 1 -- 172.21.15.5:0/1352112773 wait complete. 2023-10-16T13:40:07.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.242+0000 7f2d117e4700 1 Processor -- start 2023-10-16T13:40:07.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.242+0000 7f2d117e4700 1 -- start start 2023-10-16T13:40:07.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d117e4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0c0b7050 0x7f2d0c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d117e4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c1e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d117e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c1e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d117e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c154490 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d117e4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0c72c0 con 0x7f2d0c0b7050 2023-10-16T13:40:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d117e4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c158d80 con 0x7f2d0c0d3fc0 2023-10-16T13:40:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c1e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c1e7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44866/0 (socket says 172.21.15.5:44866) 2023-10-16T13:40:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 -- 172.21.15.5:0/1521831924 learned_addr learned my addr 172.21.15.5:0/1521831924 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0a7fc700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c1e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0affd700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0c0b7050 0x7f2d0c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 -- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 msgr2=0x7f2d0c1e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c1e7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 -- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0c0b7050 msgr2=0x7f2d0c153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0c0b7050 0x7f2d0c153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 -- 172.21.15.5:0/1521831924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009500 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.243+0000 7f2d0b7fe700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c1e7960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c780 tx=0x7f2d0400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.244+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04003e10 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.244+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d04005070 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.244+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c159060 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.244+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04005420 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.244+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c159620 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.245+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c04ebb0 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.245+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d04005580 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.246+0000 7f2cf37fe700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2cf806af00 0x7f2cf806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.246+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d04088b40 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.246+0000 7f2d0affd700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2cf806af00 0x7f2cf806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.246+0000 7f2d0affd700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2cf806af00 0x7f2cf806d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc013040 tx=0x7f2cfc008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:07.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.250+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d04053c80 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.453+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d0c0b80b0 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.455+0000 7f2cf37fe700 1 -- 172.21.15.5:0/1521831924 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f2d04017070 con 0x7f2d0c15dbc0 2023-10-16T13:40:07.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:07.458 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:04.656921+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:07.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2cf806af00 msgr2=0x7f2cf806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2cf806af00 0x7f2cf806d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc013040 tx=0x7f2cfc008070 comp rx=0 tx=0).stop 2023-10-16T13:40:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 msgr2=0x7f2d0c1e7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c1e7960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c780 tx=0x7f2d0400ca90 comp rx=0 tx=0).stop 2023-10-16T13:40:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 shutdown_connections 2023-10-16T13:40:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15dbc0 0x7f2d0c1e7960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d0c0b7050 0x7f2d0c153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2cf806af00 0x7f2cf806d3c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 --2- 172.21.15.5:0/1521831924 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d0c0d3fc0 0x7f2d0c1e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 >> 172.21.15.5:0/1521831924 conn(0x7f2d0c09cb40 msgr2=0x7f2d0c155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 shutdown_connections 2023-10-16T13:40:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.457+0000 7f2d117e4700 1 -- 172.21.15.5:0/1521831924 wait complete. 2023-10-16T13:40:07.472 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:40:07.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.595+0000 7ff988152700 1 Processor -- start 2023-10-16T13:40:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.595+0000 7ff988152700 1 -- start start 2023-10-16T13:40:07.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.596+0000 7ff988152700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dfd0 0x7ff9800d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.596+0000 7ff988152700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff980070770 0x7ff9800cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.596+0000 7ff988152700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff980070be0 con 0x7ff98015dbf0 2023-10-16T13:40:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.596+0000 7ff988152700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98006f710 con 0x7ff980070770 2023-10-16T13:40:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.596+0000 7ff988152700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98006f9b0 con 0x7ff98015dfd0 2023-10-16T13:40:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9866ef700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff980070770 0x7ff9800cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9856ed700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dfd0 0x7ff9800d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff985eee700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff98015dbf0 0x7ff9800b07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45850/0 (socket says 172.21.15.5:45850) 2023-10-16T13:40:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff985eee700 1 -- 172.21.15.5:0/1189004116 learned_addr learned my addr 172.21.15.5:0/1189004116 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff984eec700 1 -- 172.21.15.5:0/1189004116 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869397435 0 0) 0x7ff980070be0 con 0x7ff98015dbf0 2023-10-16T13:40:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff984eec700 1 -- 172.21.15.5:0/1189004116 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff96c0035b0 con 0x7ff98015dbf0 2023-10-16T13:40:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9866ef700 1 -- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dfd0 msgr2=0x7ff9800d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9866ef700 1 --2- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dfd0 0x7ff9800d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9866ef700 1 -- 172.21.15.5:0/1189004116 >> v1:172.21.15.112:6789/0 conn(0x7ff98015dbf0 legacy=0x7ff9800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9866ef700 1 -- 172.21.15.5:0/1189004116 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98006fc90 con 0x7ff980070770 2023-10-16T13:40:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9856ed700 1 --2- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dfd0 0x7ff9800d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff9866ef700 1 --2- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9800cf520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff978009d90 tx=0x7ff97800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268acf0f2c15322b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff984eec700 1 -- 172.21.15.5:0/1189004116 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800e070 con 0x7ff980070770 2023-10-16T13:40:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff984eec700 1 -- 172.21.15.5:0/1189004116 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97800bb20 con 0x7ff980070770 2023-10-16T13:40:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.597+0000 7ff984eec700 1 -- 172.21.15.5:0/1189004116 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800be90 con 0x7ff980070770 2023-10-16T13:40:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 -- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 msgr2=0x7ff9800cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 --2- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9800cf520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff978009d90 tx=0x7ff97800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 -- 172.21.15.5:0/1189004116 shutdown_connections 2023-10-16T13:40:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 --2- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9800cf520 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 --2- 172.21.15.5:0/1189004116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dfd0 0x7ff9800d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 -- 172.21.15.5:0/1189004116 >> 172.21.15.5:0/1189004116 conn(0x7ff9800d1620 msgr2=0x7ff9800d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 -- 172.21.15.5:0/1189004116 shutdown_connections 2023-10-16T13:40:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.598+0000 7ff988152700 1 -- 172.21.15.5:0/1189004116 wait complete. 2023-10-16T13:40:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.599+0000 7ff988152700 1 Processor -- start 2023-10-16T13:40:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.599+0000 7ff988152700 1 -- start start 2023-10-16T13:40:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff988152700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9801e7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff988152700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dbf0 0x7ff9801e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff988152700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 0x7ff9800ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff988152700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98009c120 con 0x7ff98015dfd0 2023-10-16T13:40:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff988152700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c71f0 con 0x7ff980070770 2023-10-16T13:40:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff988152700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c74d0 con 0x7ff98015dbf0 2023-10-16T13:40:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 0x7ff9800ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 0x7ff9800ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44880/0 (socket says 172.21.15.5:44880) 2023-10-16T13:40:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 -- 172.21.15.5:0/1396272437 learned_addr learned my addr 172.21.15.5:0/1396272437 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff985eee700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9801e7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9856ed700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dbf0 0x7ff9801e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 -- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dbf0 msgr2=0x7ff9801e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dbf0 0x7ff9801e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 -- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 msgr2=0x7ff9801e7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9801e7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff9866ef700 1 -- 172.21.15.5:0/1396272437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0094a0 con 0x7ff98015dfd0 2023-10-16T13:40:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.600+0000 7ff985eee700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9801e7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.601+0000 7ff9866ef700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 0x7ff9800ae2b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff978014040 tx=0x7ff978004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.601+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978004960 con 0x7ff98015dfd0 2023-10-16T13:40:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.601+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978020070 con 0x7ff98015dfd0 2023-10-16T13:40:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.601+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff978009a70 con 0x7ff98015dfd0 2023-10-16T13:40:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.601+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780276c0 con 0x7ff98015dfd0 2023-10-16T13:40:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.601+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9800c7a90 con 0x7ff98015dfd0 2023-10-16T13:40:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.602+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980067d20 con 0x7ff98015dfd0 2023-10-16T13:40:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.602+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff978012430 con 0x7ff98015dfd0 2023-10-16T13:40:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.603+0000 7ff9767fc700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff96406af00 0x7ff96406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.603+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff978022070 con 0x7ff98015dfd0 2023-10-16T13:40:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.603+0000 7ff985eee700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff96406af00 0x7ff96406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.603+0000 7ff985eee700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff96406af00 0x7ff96406d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff970005910 tx=0x7ff970009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.607+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff978056730 con 0x7ff98015dfd0 2023-10-16T13:40:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.806+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff980070250 con 0x7ff96406af00 2023-10-16T13:40:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.815+0000 7ff9767fc700 1 -- 172.21.15.5:0/1396272437 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284215 (secure 0 0 0) 0x7ff9700014f0 con 0x7ff96406af00 2023-10-16T13:40:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:07.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff96406af00 msgr2=0x7ff96406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff96406af00 0x7ff96406d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff970005910 tx=0x7ff970009040 comp rx=0 tx=0).stop 2023-10-16T13:40:07.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 msgr2=0x7ff9800ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:07.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 0x7ff9800ae2b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff978014040 tx=0x7ff978004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 shutdown_connections 2023-10-16T13:40:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98015dfd0 0x7ff9800ae2b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980070770 0x7ff9801e7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff96406af00 0x7ff96406d3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 --2- 172.21.15.5:0/1396272437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff98015dbf0 0x7ff9801e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 >> 172.21.15.5:0/1396272437 conn(0x7ff9800d1620 msgr2=0x7ff98015eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 shutdown_connections 2023-10-16T13:40:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.818+0000 7ff988152700 1 -- 172.21.15.5:0/1396272437 wait complete. 2023-10-16T13:40:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:07.832 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-16T13:40:07.483062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221908,"kb_used_data":5716,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752812,"statfs":{"total":773094113280,"available":772866879488,"internally_reserved":0,"allocated":5853184,"data_stored":3147111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.840428"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652350+0000","last_change":"2023-10-16T13:40:02.652350+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652350+0000","last_undegraded":"2023-10-16T13:40:02.652350+0000","last_fullsized":"2023-10-16T13:40:02.652350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658053+0000","last_change":"2023-10-16T13:40:02.658053+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658053+0000","last_undegraded":"2023-10-16T13:40:02.658053+0000","last_fullsized":"2023-10-16T13:40:02.658053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657955+0000","last_change":"2023-10-16T13:40:02.657955+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657955+0000","last_undegraded":"2023-10-16T13:40:02.657955+0000","last_fullsized":"2023-10-16T13:40:02.657955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647013+0000","last_change":"2023-10-16T13:40:02.647013+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647013+0000","last_undegraded":"2023-10-16T13:40:02.647013+0000","last_fullsized":"2023-10-16T13:40:02.647013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649569+0000","last_change":"2023-10-16T13:40:02.649569+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649569+0000","last_undegraded":"2023-10-16T13:40:02.649569+0000","last_fullsized":"2023-10-16T13:40:02.649569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651902+0000","last_change":"2023-10-16T13:40:02.651902+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651902+0000","last_undegraded":"2023-10-16T13:40:02.651902+0000","last_fullsized":"2023-10-16T13:40:02.651902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649878+0000","last_change":"2023-10-16T13:40:02.649878+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649878+0000","last_undegraded":"2023-10-16T13:40:02.649878+0000","last_fullsized":"2023-10-16T13:40:02.649878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660006+0000","last_change":"2023-10-16T13:40:02.660006+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660006+0000","last_undegraded":"2023-10-16T13:40:02.660006+0000","last_fullsized":"2023-10-16T13:40:02.660006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649674+0000","last_change":"2023-10-16T13:40:02.649674+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649674+0000","last_undegraded":"2023-10-16T13:40:02.649674+0000","last_fullsized":"2023-10-16T13:40:02.649674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647653+0000","last_change":"2023-10-16T13:40:02.647653+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647653+0000","last_undegraded":"2023-10-16T13:40:02.647653+0000","last_fullsized":"2023-10-16T13:40:02.647653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647996+0000","last_change":"2023-10-16T13:40:02.647996+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647996+0000","last_undegraded":"2023-10-16T13:40:02.647996+0000","last_fullsized":"2023-10-16T13:40:02.647996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646494+0000","last_change":"2023-10-16T13:40:02.646494+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646494+0000","last_undegraded":"2023-10-16T13:40:02.646494+0000","last_fullsized":"2023-10-16T13:40:02.646494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650532+0000","last_change":"2023-10-16T13:40:02.650532+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650532+0000","last_undegraded":"2023-10-16T13:40:02.650532+0000","last_fullsized":"2023-10-16T13:40:02.650532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649997+0000","last_change":"2023-10-16T13:40:02.649997+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649997+0000","last_undegraded":"2023-10-16T13:40:02.649997+0000","last_fullsized":"2023-10-16T13:40:02.649997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649396+0000","last_change":"2023-10-16T13:40:02.649396+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649396+0000","last_undegraded":"2023-10-16T13:40:02.649396+0000","last_fullsized":"2023-10-16T13:40:02.649396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651560+0000","last_change":"2023-10-16T13:40:02.651560+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651560+0000","last_undegraded":"2023-10-16T13:40:02.651560+0000","last_fullsized":"2023-10-16T13:40:02.651560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658186+0000","last_change":"2023-10-16T13:40:02.658186+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658186+0000","last_undegraded":"2023-10-16T13:40:02.658186+0000","last_fullsized":"2023-10-16T13:40:02.658186+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655939+0000","last_change":"2023-10-16T13:40:02.655939+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655939+0000","last_undegraded":"2023-10-16T13:40:02.655939+0000","last_fullsized":"2023-10-16T13:40:02.655939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648803+0000","last_change":"2023-10-16T13:40:02.648803+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648803+0000","last_undegraded":"2023-10-16T13:40:02.648803+0000","last_fullsized":"2023-10-16T13:40:02.648803+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657721+0000","last_change":"2023-10-16T13:40:02.657721+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657721+0000","last_undegraded":"2023-10-16T13:40:02.657721+0000","last_fullsized":"2023-10-16T13:40:02.657721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654720+0000","last_change":"2023-10-16T13:40:02.654720+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654720+0000","last_undegraded":"2023-10-16T13:40:02.654720+0000","last_fullsized":"2023-10-16T13:40:02.654720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649790+0000","last_change":"2023-10-16T13:40:02.649790+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649790+0000","last_undegraded":"2023-10-16T13:40:02.649790+0000","last_fullsized":"2023-10-16T13:40:02.649790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.656662+0000","last_change":"2023-10-16T13:40:02.656662+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.656662+0000","last_undegraded":"2023-10-16T13:40:02.656662+0000","last_fullsized":"2023-10-16T13:40:02.656662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651516+0000","last_change":"2023-10-16T13:40:02.651516+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651516+0000","last_undegraded":"2023-10-16T13:40:02.651516+0000","last_fullsized":"2023-10-16T13:40:02.651516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649215+0000","last_change":"2023-10-16T13:40:02.649215+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649215+0000","last_undegraded":"2023-10-16T13:40:02.649215+0000","last_fullsized":"2023-10-16T13:40:02.649215+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646953+0000","last_change":"2023-10-16T13:40:02.646953+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646953+0000","last_undegraded":"2023-10-16T13:40:02.646953+0000","last_fullsized":"2023-10-16T13:40:02.646953+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653875+0000","last_change":"2023-10-16T13:40:02.653875+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653875+0000","last_undegraded":"2023-10-16T13:40:02.653875+0000","last_fullsized":"2023-10-16T13:40:02.653875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649033+0000","last_change":"2023-10-16T13:40:02.649033+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649033+0000","last_undegraded":"2023-10-16T13:40:02.649033+0000","last_fullsized":"2023-10-16T13:40:02.649033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660059+0000","last_change":"2023-10-16T13:40:02.660059+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660059+0000","last_undegraded":"2023-10-16T13:40:02.660059+0000","last_fullsized":"2023-10-16T13:40:02.660059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654174+0000","last_change":"2023-10-16T13:40:02.654174+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654174+0000","last_undegraded":"2023-10-16T13:40:02.654174+0000","last_fullsized":"2023-10-16T13:40:02.654174+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649183+0000","last_change":"2023-10-16T13:40:02.649183+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649183+0000","last_undegraded":"2023-10-16T13:40:02.649183+0000","last_fullsized":"2023-10-16T13:40:02.649183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653815+0000","last_change":"2023-10-16T13:40:02.653815+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653815+0000","last_undegraded":"2023-10-16T13:40:02.653815+0000","last_fullsized":"2023-10-16T13:40:02.653815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653274+0000","last_change":"2023-10-16T13:40:02.653274+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653274+0000","last_undegraded":"2023-10-16T13:40:02.653274+0000","last_fullsized":"2023-10-16T13:40:02.653274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664926+0000","last_change":"2023-10-16T13:40:02.660186+0000","last_active":"2023-10-16T13:40:02.664926+0000","last_peered":"2023-10-16T13:40:02.664926+0000","last_clean":"2023-10-16T13:40:02.664926+0000","last_became_active":"2023-10-16T13:40:02.659896+0000","last_became_peered":"2023-10-16T13:40:02.659896+0000","last_unstale":"2023-10-16T13:40:02.664926+0000","last_undegraded":"2023-10-16T13:40:02.664926+0000","last_fullsized":"2023-10-16T13:40:02.664926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647495+0000","last_change":"2023-10-16T13:40:02.647495+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647495+0000","last_undegraded":"2023-10-16T13:40:02.647495+0000","last_fullsized":"2023-10-16T13:40:02.647495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668203+0000","last_change":"2023-10-16T13:40:02.666794+0000","last_active":"2023-10-16T13:40:02.668203+0000","last_peered":"2023-10-16T13:40:02.668203+0000","last_clean":"2023-10-16T13:40:02.668203+0000","last_became_active":"2023-10-16T13:40:02.666442+0000","last_became_peered":"2023-10-16T13:40:02.666442+0000","last_unstale":"2023-10-16T13:40:02.668203+0000","last_undegraded":"2023-10-16T13:40:02.668203+0000","last_fullsized":"2023-10-16T13:40:02.668203+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:56.624959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650911+0000","last_change":"2023-10-16T13:40:02.650911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650911+0000","last_undegraded":"2023-10-16T13:40:02.650911+0000","last_fullsized":"2023-10-16T13:40:02.650911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659218+0000","last_change":"2023-10-16T13:40:02.657293+0000","last_active":"2023-10-16T13:40:02.659218+0000","last_peered":"2023-10-16T13:40:02.659218+0000","last_clean":"2023-10-16T13:40:02.659218+0000","last_became_active":"2023-10-16T13:40:02.657011+0000","last_became_peered":"2023-10-16T13:40:02.657011+0000","last_unstale":"2023-10-16T13:40:02.659218+0000","last_undegraded":"2023-10-16T13:40:02.659218+0000","last_fullsized":"2023-10-16T13:40:02.659218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653377+0000","last_change":"2023-10-16T13:40:02.653377+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653377+0000","last_undegraded":"2023-10-16T13:40:02.653377+0000","last_fullsized":"2023-10-16T13:40:02.653377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664604+0000","last_change":"2023-10-16T13:40:02.662600+0000","last_active":"2023-10-16T13:40:02.664604+0000","last_peered":"2023-10-16T13:40:02.664604+0000","last_clean":"2023-10-16T13:40:02.664604+0000","last_became_active":"2023-10-16T13:40:02.662253+0000","last_became_peered":"2023-10-16T13:40:02.662253+0000","last_unstale":"2023-10-16T13:40:02.664604+0000","last_undegraded":"2023-10-16T13:40:02.664604+0000","last_fullsized":"2023-10-16T13:40:02.664604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:16:57.664802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649328+0000","last_change":"2023-10-16T13:40:02.649328+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649328+0000","last_undegraded":"2023-10-16T13:40:02.649328+0000","last_fullsized":"2023-10-16T13:40:02.649328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662839+0000","last_change":"2023-10-16T13:40:02.658317+0000","last_active":"2023-10-16T13:40:02.662839+0000","last_peered":"2023-10-16T13:40:02.662839+0000","last_clean":"2023-10-16T13:40:02.662839+0000","last_became_active":"2023-10-16T13:40:02.658043+0000","last_became_peered":"2023-10-16T13:40:02.658043+0000","last_unstale":"2023-10-16T13:40:02.662839+0000","last_undegraded":"2023-10-16T13:40:02.662839+0000","last_fullsized":"2023-10-16T13:40:02.662839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650172+0000","last_change":"2023-10-16T13:40:02.650172+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650172+0000","last_undegraded":"2023-10-16T13:40:02.650172+0000","last_fullsized":"2023-10-16T13:40:02.650172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664918+0000","last_change":"2023-10-16T13:40:02.661653+0000","last_active":"2023-10-16T13:40:02.664918+0000","last_peered":"2023-10-16T13:40:02.664918+0000","last_clean":"2023-10-16T13:40:02.664918+0000","last_became_active":"2023-10-16T13:40:02.661255+0000","last_became_peered":"2023-10-16T13:40:02.661255+0000","last_unstale":"2023-10-16T13:40:02.664918+0000","last_undegraded":"2023-10-16T13:40:02.664918+0000","last_fullsized":"2023-10-16T13:40:02.664918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650235+0000","last_change":"2023-10-16T13:40:02.650235+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650235+0000","last_undegraded":"2023-10-16T13:40:02.650235+0000","last_fullsized":"2023-10-16T13:40:02.650235+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657719+0000","last_change":"2023-10-16T13:40:02.654143+0000","last_active":"2023-10-16T13:40:02.657719+0000","last_peered":"2023-10-16T13:40:02.657719+0000","last_clean":"2023-10-16T13:40:02.657719+0000","last_became_active":"2023-10-16T13:40:02.653839+0000","last_became_peered":"2023-10-16T13:40:02.653839+0000","last_unstale":"2023-10-16T13:40:02.657719+0000","last_undegraded":"2023-10-16T13:40:02.657719+0000","last_fullsized":"2023-10-16T13:40:02.657719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658466+0000","last_change":"2023-10-16T13:40:02.658466+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658466+0000","last_undegraded":"2023-10-16T13:40:02.658466+0000","last_fullsized":"2023-10-16T13:40:02.658466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668351+0000","last_change":"2023-10-16T13:40:02.667918+0000","last_active":"2023-10-16T13:40:02.668351+0000","last_peered":"2023-10-16T13:40:02.668351+0000","last_clean":"2023-10-16T13:40:02.668351+0000","last_became_active":"2023-10-16T13:40:02.667614+0000","last_became_peered":"2023-10-16T13:40:02.667614+0000","last_unstale":"2023-10-16T13:40:02.668351+0000","last_undegraded":"2023-10-16T13:40:02.668351+0000","last_fullsized":"2023-10-16T13:40:02.668351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648744+0000","last_change":"2023-10-16T13:40:02.648744+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648744+0000","last_undegraded":"2023-10-16T13:40:02.648744+0000","last_fullsized":"2023-10-16T13:40:02.648744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.666729+0000","last_change":"2023-10-16T13:40:02.665632+0000","last_active":"2023-10-16T13:40:02.666729+0000","last_peered":"2023-10-16T13:40:02.666729+0000","last_clean":"2023-10-16T13:40:02.666729+0000","last_became_active":"2023-10-16T13:40:02.665364+0000","last_became_peered":"2023-10-16T13:40:02.665364+0000","last_unstale":"2023-10-16T13:40:02.666729+0000","last_undegraded":"2023-10-16T13:40:02.666729+0000","last_fullsized":"2023-10-16T13:40:02.666729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:42.515990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654385+0000","last_change":"2023-10-16T13:40:02.654385+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654385+0000","last_undegraded":"2023-10-16T13:40:02.654385+0000","last_fullsized":"2023-10-16T13:40:02.654385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667496+0000","last_change":"2023-10-16T13:40:02.663678+0000","last_active":"2023-10-16T13:40:02.667496+0000","last_peered":"2023-10-16T13:40:02.667496+0000","last_clean":"2023-10-16T13:40:02.667496+0000","last_became_active":"2023-10-16T13:40:02.663346+0000","last_became_peered":"2023-10-16T13:40:02.663346+0000","last_unstale":"2023-10-16T13:40:02.667496+0000","last_undegraded":"2023-10-16T13:40:02.667496+0000","last_fullsized":"2023-10-16T13:40:02.667496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:11:41.509831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647474+0000","last_change":"2023-10-16T13:40:02.647474+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647474+0000","last_undegraded":"2023-10-16T13:40:02.647474+0000","last_fullsized":"2023-10-16T13:40:02.647474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668429+0000","last_change":"2023-10-16T13:40:02.666624+0000","last_active":"2023-10-16T13:40:02.668429+0000","last_peered":"2023-10-16T13:40:02.668429+0000","last_clean":"2023-10-16T13:40:02.668429+0000","last_became_active":"2023-10-16T13:40:02.666354+0000","last_became_peered":"2023-10-16T13:40:02.666354+0000","last_unstale":"2023-10-16T13:40:02.668429+0000","last_undegraded":"2023-10-16T13:40:02.668429+0000","last_fullsized":"2023-10-16T13:40:02.668429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:48.340218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657529+0000","last_change":"2023-10-16T13:40:02.657529+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657529+0000","last_undegraded":"2023-10-16T13:40:02.657529+0000","last_fullsized":"2023-10-16T13:40:02.657529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662286+0000","last_change":"2023-10-16T13:40:02.660676+0000","last_active":"2023-10-16T13:40:02.662286+0000","last_peered":"2023-10-16T13:40:02.662286+0000","last_clean":"2023-10-16T13:40:02.662286+0000","last_became_active":"2023-10-16T13:40:02.659992+0000","last_became_peered":"2023-10-16T13:40:02.659992+0000","last_unstale":"2023-10-16T13:40:02.662286+0000","last_undegraded":"2023-10-16T13:40:02.662286+0000","last_fullsized":"2023-10-16T13:40:02.662286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646232+0000","last_change":"2023-10-16T13:40:02.646232+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646232+0000","last_undegraded":"2023-10-16T13:40:02.646232+0000","last_fullsized":"2023-10-16T13:40:02.646232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668041+0000","last_change":"2023-10-16T13:40:02.664721+0000","last_active":"2023-10-16T13:40:02.668041+0000","last_peered":"2023-10-16T13:40:02.668041+0000","last_clean":"2023-10-16T13:40:02.668041+0000","last_became_active":"2023-10-16T13:40:02.664294+0000","last_became_peered":"2023-10-16T13:40:02.664294+0000","last_unstale":"2023-10-16T13:40:02.668041+0000","last_undegraded":"2023-10-16T13:40:02.668041+0000","last_fullsized":"2023-10-16T13:40:02.668041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:18.414495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654079+0000","last_change":"2023-10-16T13:40:02.654079+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654079+0000","last_undegraded":"2023-10-16T13:40:02.654079+0000","last_fullsized":"2023-10-16T13:40:02.654079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664346+0000","last_change":"2023-10-16T13:40:02.661169+0000","last_active":"2023-10-16T13:40:02.664346+0000","last_peered":"2023-10-16T13:40:02.664346+0000","last_clean":"2023-10-16T13:40:02.664346+0000","last_became_active":"2023-10-16T13:40:02.660689+0000","last_became_peered":"2023-10-16T13:40:02.660689+0000","last_unstale":"2023-10-16T13:40:02.664346+0000","last_undegraded":"2023-10-16T13:40:02.664346+0000","last_fullsized":"2023-10-16T13:40:02.664346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:07.468974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649481+0000","last_change":"2023-10-16T13:40:02.649481+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649481+0000","last_undegraded":"2023-10-16T13:40:02.649481+0000","last_fullsized":"2023-10-16T13:40:02.649481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664614+0000","last_change":"2023-10-16T13:40:02.662603+0000","last_active":"2023-10-16T13:40:02.664614+0000","last_peered":"2023-10-16T13:40:02.664614+0000","last_clean":"2023-10-16T13:40:02.664614+0000","last_became_active":"2023-10-16T13:40:02.662287+0000","last_became_peered":"2023-10-16T13:40:02.662287+0000","last_unstale":"2023-10-16T13:40:02.664614+0000","last_undegraded":"2023-10-16T13:40:02.664614+0000","last_fullsized":"2023-10-16T13:40:02.664614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655877+0000","last_change":"2023-10-16T13:40:02.655877+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655877+0000","last_undegraded":"2023-10-16T13:40:02.655877+0000","last_fullsized":"2023-10-16T13:40:02.655877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663364+0000","last_change":"2023-10-16T13:40:02.660270+0000","last_active":"2023-10-16T13:40:02.663364+0000","last_peered":"2023-10-16T13:40:02.663364+0000","last_clean":"2023-10-16T13:40:02.663364+0000","last_became_active":"2023-10-16T13:40:02.659826+0000","last_became_peered":"2023-10-16T13:40:02.659826+0000","last_unstale":"2023-10-16T13:40:02.663364+0000","last_undegraded":"2023-10-16T13:40:02.663364+0000","last_fullsized":"2023-10-16T13:40:02.663364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:47.920849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655354+0000","last_change":"2023-10-16T13:40:02.655354+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655354+0000","last_undegraded":"2023-10-16T13:40:02.655354+0000","last_fullsized":"2023-10-16T13:40:02.655354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668126+0000","last_change":"2023-10-16T13:40:02.666774+0000","last_active":"2023-10-16T13:40:02.668126+0000","last_peered":"2023-10-16T13:40:02.668126+0000","last_clean":"2023-10-16T13:40:02.668126+0000","last_became_active":"2023-10-16T13:40:02.666419+0000","last_became_peered":"2023-10-16T13:40:02.666419+0000","last_unstale":"2023-10-16T13:40:02.668126+0000","last_undegraded":"2023-10-16T13:40:02.668126+0000","last_fullsized":"2023-10-16T13:40:02.668126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:29.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646813+0000","last_change":"2023-10-16T13:40:02.646813+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646813+0000","last_undegraded":"2023-10-16T13:40:02.646813+0000","last_fullsized":"2023-10-16T13:40:02.646813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664840+0000","last_change":"2023-10-16T13:40:02.660792+0000","last_active":"2023-10-16T13:40:02.664840+0000","last_peered":"2023-10-16T13:40:02.664840+0000","last_clean":"2023-10-16T13:40:02.664840+0000","last_became_active":"2023-10-16T13:40:02.659728+0000","last_became_peered":"2023-10-16T13:40:02.659728+0000","last_unstale":"2023-10-16T13:40:02.664840+0000","last_undegraded":"2023-10-16T13:40:02.664840+0000","last_fullsized":"2023-10-16T13:40:02.664840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657214+0000","last_change":"2023-10-16T13:40:02.657214+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657214+0000","last_undegraded":"2023-10-16T13:40:02.657214+0000","last_fullsized":"2023-10-16T13:40:02.657214+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664644+0000","last_change":"2023-10-16T13:40:02.662725+0000","last_active":"2023-10-16T13:40:02.664644+0000","last_peered":"2023-10-16T13:40:02.664644+0000","last_clean":"2023-10-16T13:40:02.664644+0000","last_became_active":"2023-10-16T13:40:02.662395+0000","last_became_peered":"2023-10-16T13:40:02.662395+0000","last_unstale":"2023-10-16T13:40:02.664644+0000","last_undegraded":"2023-10-16T13:40:02.664644+0000","last_fullsized":"2023-10-16T13:40:02.664644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657070+0000","last_change":"2023-10-16T13:40:02.657070+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657070+0000","last_undegraded":"2023-10-16T13:40:02.657070+0000","last_fullsized":"2023-10-16T13:40:02.657070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668431+0000","last_change":"2023-10-16T13:40:02.666967+0000","last_active":"2023-10-16T13:40:02.668431+0000","last_peered":"2023-10-16T13:40:02.668431+0000","last_clean":"2023-10-16T13:40:02.668431+0000","last_became_active":"2023-10-16T13:40:02.666653+0000","last_became_peered":"2023-10-16T13:40:02.666653+0000","last_unstale":"2023-10-16T13:40:02.668431+0000","last_undegraded":"2023-10-16T13:40:02.668431+0000","last_fullsized":"2023-10-16T13:40:02.668431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.645606+0000","last_change":"2023-10-16T13:40:02.645606+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.645606+0000","last_undegraded":"2023-10-16T13:40:02.645606+0000","last_fullsized":"2023-10-16T13:40:02.645606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667402+0000","last_change":"2023-10-16T13:40:02.664562+0000","last_active":"2023-10-16T13:40:02.667402+0000","last_peered":"2023-10-16T13:40:02.667402+0000","last_clean":"2023-10-16T13:40:02.667402+0000","last_became_active":"2023-10-16T13:40:02.664036+0000","last_became_peered":"2023-10-16T13:40:02.664036+0000","last_unstale":"2023-10-16T13:40:02.667402+0000","last_undegraded":"2023-10-16T13:40:02.667402+0000","last_fullsized":"2023-10-16T13:40:02.667402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:04.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651226+0000","last_change":"2023-10-16T13:40:02.651226+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651226+0000","last_undegraded":"2023-10-16T13:40:02.651226+0000","last_fullsized":"2023-10-16T13:40:02.651226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657892+0000","last_change":"2023-10-16T13:40:02.656748+0000","last_active":"2023-10-16T13:40:02.657892+0000","last_peered":"2023-10-16T13:40:02.657892+0000","last_clean":"2023-10-16T13:40:02.657892+0000","last_became_active":"2023-10-16T13:40:02.656407+0000","last_became_peered":"2023-10-16T13:40:02.656407+0000","last_unstale":"2023-10-16T13:40:02.657892+0000","last_undegraded":"2023-10-16T13:40:02.657892+0000","last_fullsized":"2023-10-16T13:40:02.657892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:33:31.641363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654072+0000","last_change":"2023-10-16T13:40:02.654072+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654072+0000","last_undegraded":"2023-10-16T13:40:02.654072+0000","last_fullsized":"2023-10-16T13:40:02.654072+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.665424+0000","last_change":"2023-10-16T13:40:02.664585+0000","last_active":"2023-10-16T13:40:02.665424+0000","last_peered":"2023-10-16T13:40:02.665424+0000","last_clean":"2023-10-16T13:40:02.665424+0000","last_became_active":"2023-10-16T13:40:02.664322+0000","last_became_peered":"2023-10-16T13:40:02.664322+0000","last_unstale":"2023-10-16T13:40:02.665424+0000","last_undegraded":"2023-10-16T13:40:02.665424+0000","last_fullsized":"2023-10-16T13:40:02.665424+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646115+0000","last_change":"2023-10-16T13:40:02.646115+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646115+0000","last_undegraded":"2023-10-16T13:40:02.646115+0000","last_fullsized":"2023-10-16T13:40:02.646115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.669069+0000","last_change":"2023-10-16T13:40:02.668493+0000","last_active":"2023-10-16T13:40:02.669069+0000","last_peered":"2023-10-16T13:40:02.669069+0000","last_clean":"2023-10-16T13:40:02.669069+0000","last_became_active":"2023-10-16T13:40:02.668204+0000","last_became_peered":"2023-10-16T13:40:02.668204+0000","last_unstale":"2023-10-16T13:40:02.669069+0000","last_undegraded":"2023-10-16T13:40:02.669069+0000","last_fullsized":"2023-10-16T13:40:02.669069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:02:07.224716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647329+0000","last_change":"2023-10-16T13:40:02.647329+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647329+0000","last_undegraded":"2023-10-16T13:40:02.647329+0000","last_fullsized":"2023-10-16T13:40:02.647329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659073+0000","last_change":"2023-10-16T13:40:02.656852+0000","last_active":"2023-10-16T13:40:02.659073+0000","last_peered":"2023-10-16T13:40:02.659073+0000","last_clean":"2023-10-16T13:40:02.659073+0000","last_became_active":"2023-10-16T13:40:02.656565+0000","last_became_peered":"2023-10-16T13:40:02.656565+0000","last_unstale":"2023-10-16T13:40:02.659073+0000","last_undegraded":"2023-10-16T13:40:02.659073+0000","last_fullsized":"2023-10-16T13:40:02.659073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646911+0000","last_change":"2023-10-16T13:40:02.646911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646911+0000","last_undegraded":"2023-10-16T13:40:02.646911+0000","last_fullsized":"2023-10-16T13:40:02.646911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.658832+0000","last_change":"2023-10-16T13:40:02.656866+0000","last_active":"2023-10-16T13:40:02.658832+0000","last_peered":"2023-10-16T13:40:02.658832+0000","last_clean":"2023-10-16T13:40:02.658832+0000","last_became_active":"2023-10-16T13:40:02.656586+0000","last_became_peered":"2023-10-16T13:40:02.656586+0000","last_unstale":"2023-10-16T13:40:02.658832+0000","last_undegraded":"2023-10-16T13:40:02.658832+0000","last_fullsized":"2023-10-16T13:40:02.658832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:42:41.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652823+0000","last_change":"2023-10-16T13:40:02.652823+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652823+0000","last_undegraded":"2023-10-16T13:40:02.652823+0000","last_fullsized":"2023-10-16T13:40:02.652823+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.656462+0000","last_change":"2023-10-16T13:40:02.653438+0000","last_active":"2023-10-16T13:40:02.656462+0000","last_peered":"2023-10-16T13:40:02.656462+0000","last_clean":"2023-10-16T13:40:02.656462+0000","last_became_active":"2023-10-16T13:40:02.653107+0000","last_became_peered":"2023-10-16T13:40:02.653107+0000","last_unstale":"2023-10-16T13:40:02.656462+0000","last_undegraded":"2023-10-16T13:40:02.656462+0000","last_fullsized":"2023-10-16T13:40:02.656462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648785+0000","last_change":"2023-10-16T13:40:02.648785+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648785+0000","last_undegraded":"2023-10-16T13:40:02.648785+0000","last_fullsized":"2023-10-16T13:40:02.648785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.652665+0000","last_change":"2023-10-16T13:40:02.650139+0000","last_active":"2023-10-16T13:40:02.652665+0000","last_peered":"2023-10-16T13:40:02.652665+0000","last_clean":"2023-10-16T13:40:02.652665+0000","last_became_active":"2023-10-16T13:40:02.649855+0000","last_became_peered":"2023-10-16T13:40:02.649855+0000","last_unstale":"2023-10-16T13:40:02.652665+0000","last_undegraded":"2023-10-16T13:40:02.652665+0000","last_fullsized":"2023-10-16T13:40:02.652665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653555+0000","last_change":"2023-10-16T13:40:02.653555+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653555+0000","last_undegraded":"2023-10-16T13:40:02.653555+0000","last_fullsized":"2023-10-16T13:40:02.653555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662260+0000","last_change":"2023-10-16T13:40:02.660323+0000","last_active":"2023-10-16T13:40:02.662260+0000","last_peered":"2023-10-16T13:40:02.662260+0000","last_clean":"2023-10-16T13:40:02.662260+0000","last_became_active":"2023-10-16T13:40:02.660045+0000","last_became_peered":"2023-10-16T13:40:02.660045+0000","last_unstale":"2023-10-16T13:40:02.662260+0000","last_undegraded":"2023-10-16T13:40:02.662260+0000","last_fullsized":"2023-10-16T13:40:02.662260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646925+0000","last_change":"2023-10-16T13:40:02.646925+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646925+0000","last_undegraded":"2023-10-16T13:40:02.646925+0000","last_fullsized":"2023-10-16T13:40:02.646925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664561+0000","last_change":"2023-10-16T13:40:02.659573+0000","last_active":"2023-10-16T13:40:02.664561+0000","last_peered":"2023-10-16T13:40:02.664561+0000","last_clean":"2023-10-16T13:40:02.664561+0000","last_became_active":"2023-10-16T13:40:02.659277+0000","last_became_peered":"2023-10-16T13:40:02.659277+0000","last_unstale":"2023-10-16T13:40:02.664561+0000","last_undegraded":"2023-10-16T13:40:02.664561+0000","last_fullsized":"2023-10-16T13:40:02.664561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648713+0000","last_change":"2023-10-16T13:40:02.648713+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648713+0000","last_undegraded":"2023-10-16T13:40:02.648713+0000","last_fullsized":"2023-10-16T13:40:02.648713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667235+0000","last_change":"2023-10-16T13:40:02.663715+0000","last_active":"2023-10-16T13:40:02.667235+0000","last_peered":"2023-10-16T13:40:02.667235+0000","last_clean":"2023-10-16T13:40:02.667235+0000","last_became_active":"2023-10-16T13:40:02.663331+0000","last_became_peered":"2023-10-16T13:40:02.663331+0000","last_unstale":"2023-10-16T13:40:02.667235+0000","last_undegraded":"2023-10-16T13:40:02.667235+0000","last_fullsized":"2023-10-16T13:40:02.667235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:29.749990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649233+0000","last_change":"2023-10-16T13:40:02.649233+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649233+0000","last_undegraded":"2023-10-16T13:40:02.649233+0000","last_fullsized":"2023-10-16T13:40:02.649233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663222+0000","last_change":"2023-10-16T13:40:02.659715+0000","last_active":"2023-10-16T13:40:02.663222+0000","last_peered":"2023-10-16T13:40:02.663222+0000","last_clean":"2023-10-16T13:40:02.663222+0000","last_became_active":"2023-10-16T13:40:02.659427+0000","last_became_peered":"2023-10-16T13:40:02.659427+0000","last_unstale":"2023-10-16T13:40:02.663222+0000","last_undegraded":"2023-10-16T13:40:02.663222+0000","last_fullsized":"2023-10-16T13:40:02.663222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:55:14.871789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-16T13:40:01.648870+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:01.648870+0000","last_peered":"2023-10-16T13:40:01.648870+0000","last_clean":"2023-10-16T13:40:01.648870+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:01.648870+0000","last_undegraded":"2023-10-16T13:40:01.648870+0000","last_fullsized":"2023-10-16T13:40:01.648870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":837203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.373}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.76300000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58899999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.433},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":240568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.503},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.874}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.79600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":836184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.307},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.504}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":245816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.27600000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.25},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.314}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.33500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.624},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:07.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:07.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.994+0000 7fa5e76a1700 1 Processor -- start 2023-10-16T13:40:07.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.995+0000 7fa5e76a1700 1 -- start start 2023-10-16T13:40:08.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e76a1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5e015db30 0x7fa5e00cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e76a1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5e00aeb70 0x7fa5e00aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e76a1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e00ca7b0 con 0x7fa5e006a840 2023-10-16T13:40:08.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e76a1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e00af530 con 0x7fa5e015db30 2023-10-16T13:40:08.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e76a1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e00caa90 con 0x7fa5e00aeb70 2023-10-16T13:40:08.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5e015db30 0x7fa5e00cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5e015db30 0x7fa5e00cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44884/0 (socket says 172.21.15.5:44884) 2023-10-16T13:40:08.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e5c3e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa5e006a840 0x7fa5e006acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54890/0 (socket says 172.21.15.5:54890) 2023-10-16T13:40:08.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 -- 172.21.15.5:0/2580798905 learned_addr learned my addr 172.21.15.5:0/2580798905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e4c3c700 1 --2- 172.21.15.5:0/2580798905 >> v2:172.21.15.112:3300/0 conn(0x7fa5e00aeb70 0x7fa5e00aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 -- 172.21.15.5:0/2580798905 >> v2:172.21.15.112:3300/0 conn(0x7fa5e00aeb70 msgr2=0x7fa5e00aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 --2- 172.21.15.5:0/2580798905 >> v2:172.21.15.112:3300/0 conn(0x7fa5e00aeb70 0x7fa5e00aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 -- 172.21.15.5:0/2580798905 >> v1:172.21.15.5:6789/0 conn(0x7fa5e006a840 legacy=0x7fa5e006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5e543d700 1 -- 172.21.15.5:0/2580798905 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00cad70 con 0x7fa5e015db30 2023-10-16T13:40:08.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.996+0000 7fa5d7fff700 1 -- 172.21.15.5:0/2580798905 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005416112 0 0) 0x7fa5e00ca7b0 con 0x7fa5e006a840 2023-10-16T13:40:08.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e543d700 1 --2- 172.21.15.5:0/2580798905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e00cb570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0070e90 tx=0x7fa5dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2ae6e978929751 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5d7fff700 1 -- 172.21.15.5:0/2580798905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00b870 con 0x7fa5e015db30 2023-10-16T13:40:08.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5d7fff700 1 -- 172.21.15.5:0/2580798905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00b9d0 con 0x7fa5e015db30 2023-10-16T13:40:08.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5d7fff700 1 -- 172.21.15.5:0/2580798905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00bd60 con 0x7fa5e015db30 2023-10-16T13:40:08.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 -- 172.21.15.5:0/2580798905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 msgr2=0x7fa5e00cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/2580798905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e00cb570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0070e90 tx=0x7fa5dc009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 -- 172.21.15.5:0/2580798905 shutdown_connections 2023-10-16T13:40:08.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/2580798905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e00cb570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/2580798905 >> v2:172.21.15.112:3300/0 conn(0x7fa5e00aeb70 0x7fa5e00aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 -- 172.21.15.5:0/2580798905 >> 172.21.15.5:0/2580798905 conn(0x7fa5e00cc6f0 msgr2=0x7fa5e00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:08.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 -- 172.21.15.5:0/2580798905 shutdown_connections 2023-10-16T13:40:08.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.997+0000 7fa5e76a1700 1 -- 172.21.15.5:0/2580798905 wait complete. 2023-10-16T13:40:08.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 Processor -- start 2023-10-16T13:40:08.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 -- start start 2023-10-16T13:40:08.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5e006a840 0x7fa5e01498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5e00aeb70 0x7fa5e0160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e01f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e01f7790 con 0x7fa5e015db30 2023-10-16T13:40:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e014c870 con 0x7fa5e00aeb70 2023-10-16T13:40:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e76a1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e014bcf0 con 0x7fa5e006a840 2023-10-16T13:40:08.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:07.999+0000 7fa5e5c3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e01f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e01f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44892/0 (socket says 172.21.15.5:44892) 2023-10-16T13:40:08.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 -- 172.21.15.5:0/3911545707 learned_addr learned my addr 172.21.15.5:0/3911545707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:08.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e4c3c700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5e00aeb70 0x7fa5e0160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e543d700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5e006a840 0x7fa5e01498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 -- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5e006a840 msgr2=0x7fa5e01498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5e006a840 0x7fa5e01498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 -- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5e00aeb70 msgr2=0x7fa5e0160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5e00aeb70 0x7fa5e0160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 -- 172.21.15.5:0/3911545707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009550 con 0x7fa5e015db30 2023-10-16T13:40:08.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e5c3e700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e01f7250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800cba0 tx=0x7fa5d800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800ab80 con 0x7fa5e015db30 2023-10-16T13:40:08.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d800ad00 con 0x7fa5e015db30 2023-10-16T13:40:08.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8007310 con 0x7fa5e015db30 2023-10-16T13:40:08.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e014bfd0 con 0x7fa5e015db30 2023-10-16T13:40:08.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.000+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e014c590 con 0x7fa5e015db30 2023-10-16T13:40:08.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.001+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e00c6dd0 con 0x7fa5e015db30 2023-10-16T13:40:08.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.002+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5d8007470 con 0x7fa5e015db30 2023-10-16T13:40:08.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.002+0000 7fa5d5ffb700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5c406af00 0x7fa5c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.002+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5d8088fd0 con 0x7fa5e015db30 2023-10-16T13:40:08.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.002+0000 7fa5e543d700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5c406af00 0x7fa5c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.003+0000 7fa5e543d700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5c406af00 0x7fa5c406d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc000c00 tx=0x7fa5dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.007+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5d8054110 con 0x7fa5e015db30 2023-10-16T13:40:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.201+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5e00cbab0 con 0x7fa5c406af00 2023-10-16T13:40:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.210+0000 7fa5d5ffb700 1 -- 172.21.15.5:0/3911545707 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284215 (secure 0 0 0) 0x7fa5dc00bb40 con 0x7fa5c406af00 2023-10-16T13:40:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5c406af00 msgr2=0x7fa5c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5c406af00 0x7fa5c406d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc000c00 tx=0x7fa5dc008030 comp rx=0 tx=0).stop 2023-10-16T13:40:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 msgr2=0x7fa5e01f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e01f7250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800cba0 tx=0x7fa5d800cf60 comp rx=0 tx=0).stop 2023-10-16T13:40:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 shutdown_connections 2023-10-16T13:40:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e015db30 0x7fa5e01f7250 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5c406af00 0x7fa5c406d3c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5e006a840 0x7fa5e01498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 --2- 172.21.15.5:0/3911545707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5e00aeb70 0x7fa5e0160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 >> 172.21.15.5:0/3911545707 conn(0x7fa5e00cc6f0 msgr2=0x7fa5e006b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 shutdown_connections 2023-10-16T13:40:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.213+0000 7fa5e76a1700 1 -- 172.21.15.5:0/3911545707 wait complete. 2023-10-16T13:40:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:08.228 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-16T13:40:07.483062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221908,"kb_used_data":5716,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752812,"statfs":{"total":773094113280,"available":772866879488,"internally_reserved":0,"allocated":5853184,"data_stored":3147111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.840428"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652350+0000","last_change":"2023-10-16T13:40:02.652350+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652350+0000","last_undegraded":"2023-10-16T13:40:02.652350+0000","last_fullsized":"2023-10-16T13:40:02.652350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658053+0000","last_change":"2023-10-16T13:40:02.658053+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658053+0000","last_undegraded":"2023-10-16T13:40:02.658053+0000","last_fullsized":"2023-10-16T13:40:02.658053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657955+0000","last_change":"2023-10-16T13:40:02.657955+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657955+0000","last_undegraded":"2023-10-16T13:40:02.657955+0000","last_fullsized":"2023-10-16T13:40:02.657955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647013+0000","last_change":"2023-10-16T13:40:02.647013+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647013+0000","last_undegraded":"2023-10-16T13:40:02.647013+0000","last_fullsized":"2023-10-16T13:40:02.647013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649569+0000","last_change":"2023-10-16T13:40:02.649569+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649569+0000","last_undegraded":"2023-10-16T13:40:02.649569+0000","last_fullsized":"2023-10-16T13:40:02.649569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651902+0000","last_change":"2023-10-16T13:40:02.651902+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651902+0000","last_undegraded":"2023-10-16T13:40:02.651902+0000","last_fullsized":"2023-10-16T13:40:02.651902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649878+0000","last_change":"2023-10-16T13:40:02.649878+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649878+0000","last_undegraded":"2023-10-16T13:40:02.649878+0000","last_fullsized":"2023-10-16T13:40:02.649878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660006+0000","last_change":"2023-10-16T13:40:02.660006+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660006+0000","last_undegraded":"2023-10-16T13:40:02.660006+0000","last_fullsized":"2023-10-16T13:40:02.660006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649674+0000","last_change":"2023-10-16T13:40:02.649674+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649674+0000","last_undegraded":"2023-10-16T13:40:02.649674+0000","last_fullsized":"2023-10-16T13:40:02.649674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647653+0000","last_change":"2023-10-16T13:40:02.647653+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647653+0000","last_undegraded":"2023-10-16T13:40:02.647653+0000","last_fullsized":"2023-10-16T13:40:02.647653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647996+0000","last_change":"2023-10-16T13:40:02.647996+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647996+0000","last_undegraded":"2023-10-16T13:40:02.647996+0000","last_fullsized":"2023-10-16T13:40:02.647996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646494+0000","last_change":"2023-10-16T13:40:02.646494+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646494+0000","last_undegraded":"2023-10-16T13:40:02.646494+0000","last_fullsized":"2023-10-16T13:40:02.646494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650532+0000","last_change":"2023-10-16T13:40:02.650532+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650532+0000","last_undegraded":"2023-10-16T13:40:02.650532+0000","last_fullsized":"2023-10-16T13:40:02.650532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649997+0000","last_change":"2023-10-16T13:40:02.649997+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649997+0000","last_undegraded":"2023-10-16T13:40:02.649997+0000","last_fullsized":"2023-10-16T13:40:02.649997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649396+0000","last_change":"2023-10-16T13:40:02.649396+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649396+0000","last_undegraded":"2023-10-16T13:40:02.649396+0000","last_fullsized":"2023-10-16T13:40:02.649396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651560+0000","last_change":"2023-10-16T13:40:02.651560+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651560+0000","last_undegraded":"2023-10-16T13:40:02.651560+0000","last_fullsized":"2023-10-16T13:40:02.651560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658186+0000","last_change":"2023-10-16T13:40:02.658186+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658186+0000","last_undegraded":"2023-10-16T13:40:02.658186+0000","last_fullsized":"2023-10-16T13:40:02.658186+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655939+0000","last_change":"2023-10-16T13:40:02.655939+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655939+0000","last_undegraded":"2023-10-16T13:40:02.655939+0000","last_fullsized":"2023-10-16T13:40:02.655939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648803+0000","last_change":"2023-10-16T13:40:02.648803+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648803+0000","last_undegraded":"2023-10-16T13:40:02.648803+0000","last_fullsized":"2023-10-16T13:40:02.648803+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657721+0000","last_change":"2023-10-16T13:40:02.657721+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657721+0000","last_undegraded":"2023-10-16T13:40:02.657721+0000","last_fullsized":"2023-10-16T13:40:02.657721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654720+0000","last_change":"2023-10-16T13:40:02.654720+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654720+0000","last_undegraded":"2023-10-16T13:40:02.654720+0000","last_fullsized":"2023-10-16T13:40:02.654720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649790+0000","last_change":"2023-10-16T13:40:02.649790+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649790+0000","last_undegraded":"2023-10-16T13:40:02.649790+0000","last_fullsized":"2023-10-16T13:40:02.649790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.656662+0000","last_change":"2023-10-16T13:40:02.656662+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.656662+0000","last_undegraded":"2023-10-16T13:40:02.656662+0000","last_fullsized":"2023-10-16T13:40:02.656662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651516+0000","last_change":"2023-10-16T13:40:02.651516+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651516+0000","last_undegraded":"2023-10-16T13:40:02.651516+0000","last_fullsized":"2023-10-16T13:40:02.651516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649215+0000","last_change":"2023-10-16T13:40:02.649215+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649215+0000","last_undegraded":"2023-10-16T13:40:02.649215+0000","last_fullsized":"2023-10-16T13:40:02.649215+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646953+0000","last_change":"2023-10-16T13:40:02.646953+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646953+0000","last_undegraded":"2023-10-16T13:40:02.646953+0000","last_fullsized":"2023-10-16T13:40:02.646953+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653875+0000","last_change":"2023-10-16T13:40:02.653875+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653875+0000","last_undegraded":"2023-10-16T13:40:02.653875+0000","last_fullsized":"2023-10-16T13:40:02.653875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649033+0000","last_change":"2023-10-16T13:40:02.649033+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649033+0000","last_undegraded":"2023-10-16T13:40:02.649033+0000","last_fullsized":"2023-10-16T13:40:02.649033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660059+0000","last_change":"2023-10-16T13:40:02.660059+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660059+0000","last_undegraded":"2023-10-16T13:40:02.660059+0000","last_fullsized":"2023-10-16T13:40:02.660059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654174+0000","last_change":"2023-10-16T13:40:02.654174+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654174+0000","last_undegraded":"2023-10-16T13:40:02.654174+0000","last_fullsized":"2023-10-16T13:40:02.654174+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649183+0000","last_change":"2023-10-16T13:40:02.649183+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649183+0000","last_undegraded":"2023-10-16T13:40:02.649183+0000","last_fullsized":"2023-10-16T13:40:02.649183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653815+0000","last_change":"2023-10-16T13:40:02.653815+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653815+0000","last_undegraded":"2023-10-16T13:40:02.653815+0000","last_fullsized":"2023-10-16T13:40:02.653815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653274+0000","last_change":"2023-10-16T13:40:02.653274+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653274+0000","last_undegraded":"2023-10-16T13:40:02.653274+0000","last_fullsized":"2023-10-16T13:40:02.653274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664926+0000","last_change":"2023-10-16T13:40:02.660186+0000","last_active":"2023-10-16T13:40:02.664926+0000","last_peered":"2023-10-16T13:40:02.664926+0000","last_clean":"2023-10-16T13:40:02.664926+0000","last_became_active":"2023-10-16T13:40:02.659896+0000","last_became_peered":"2023-10-16T13:40:02.659896+0000","last_unstale":"2023-10-16T13:40:02.664926+0000","last_undegraded":"2023-10-16T13:40:02.664926+0000","last_fullsized":"2023-10-16T13:40:02.664926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647495+0000","last_change":"2023-10-16T13:40:02.647495+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647495+0000","last_undegraded":"2023-10-16T13:40:02.647495+0000","last_fullsized":"2023-10-16T13:40:02.647495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668203+0000","last_change":"2023-10-16T13:40:02.666794+0000","last_active":"2023-10-16T13:40:02.668203+0000","last_peered":"2023-10-16T13:40:02.668203+0000","last_clean":"2023-10-16T13:40:02.668203+0000","last_became_active":"2023-10-16T13:40:02.666442+0000","last_became_peered":"2023-10-16T13:40:02.666442+0000","last_unstale":"2023-10-16T13:40:02.668203+0000","last_undegraded":"2023-10-16T13:40:02.668203+0000","last_fullsized":"2023-10-16T13:40:02.668203+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:56.624959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650911+0000","last_change":"2023-10-16T13:40:02.650911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650911+0000","last_undegraded":"2023-10-16T13:40:02.650911+0000","last_fullsized":"2023-10-16T13:40:02.650911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659218+0000","last_change":"2023-10-16T13:40:02.657293+0000","last_active":"2023-10-16T13:40:02.659218+0000","last_peered":"2023-10-16T13:40:02.659218+0000","last_clean":"2023-10-16T13:40:02.659218+0000","last_became_active":"2023-10-16T13:40:02.657011+0000","last_became_peered":"2023-10-16T13:40:02.657011+0000","last_unstale":"2023-10-16T13:40:02.659218+0000","last_undegraded":"2023-10-16T13:40:02.659218+0000","last_fullsized":"2023-10-16T13:40:02.659218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653377+0000","last_change":"2023-10-16T13:40:02.653377+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653377+0000","last_undegraded":"2023-10-16T13:40:02.653377+0000","last_fullsized":"2023-10-16T13:40:02.653377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664604+0000","last_change":"2023-10-16T13:40:02.662600+0000","last_active":"2023-10-16T13:40:02.664604+0000","last_peered":"2023-10-16T13:40:02.664604+0000","last_clean":"2023-10-16T13:40:02.664604+0000","last_became_active":"2023-10-16T13:40:02.662253+0000","last_became_peered":"2023-10-16T13:40:02.662253+0000","last_unstale":"2023-10-16T13:40:02.664604+0000","last_undegraded":"2023-10-16T13:40:02.664604+0000","last_fullsized":"2023-10-16T13:40:02.664604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:16:57.664802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649328+0000","last_change":"2023-10-16T13:40:02.649328+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649328+0000","last_undegraded":"2023-10-16T13:40:02.649328+0000","last_fullsized":"2023-10-16T13:40:02.649328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662839+0000","last_change":"2023-10-16T13:40:02.658317+0000","last_active":"2023-10-16T13:40:02.662839+0000","last_peered":"2023-10-16T13:40:02.662839+0000","last_clean":"2023-10-16T13:40:02.662839+0000","last_became_active":"2023-10-16T13:40:02.658043+0000","last_became_peered":"2023-10-16T13:40:02.658043+0000","last_unstale":"2023-10-16T13:40:02.662839+0000","last_undegraded":"2023-10-16T13:40:02.662839+0000","last_fullsized":"2023-10-16T13:40:02.662839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650172+0000","last_change":"2023-10-16T13:40:02.650172+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650172+0000","last_undegraded":"2023-10-16T13:40:02.650172+0000","last_fullsized":"2023-10-16T13:40:02.650172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664918+0000","last_change":"2023-10-16T13:40:02.661653+0000","last_active":"2023-10-16T13:40:02.664918+0000","last_peered":"2023-10-16T13:40:02.664918+0000","last_clean":"2023-10-16T13:40:02.664918+0000","last_became_active":"2023-10-16T13:40:02.661255+0000","last_became_peered":"2023-10-16T13:40:02.661255+0000","last_unstale":"2023-10-16T13:40:02.664918+0000","last_undegraded":"2023-10-16T13:40:02.664918+0000","last_fullsized":"2023-10-16T13:40:02.664918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650235+0000","last_change":"2023-10-16T13:40:02.650235+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650235+0000","last_undegraded":"2023-10-16T13:40:02.650235+0000","last_fullsized":"2023-10-16T13:40:02.650235+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657719+0000","last_change":"2023-10-16T13:40:02.654143+0000","last_active":"2023-10-16T13:40:02.657719+0000","last_peered":"2023-10-16T13:40:02.657719+0000","last_clean":"2023-10-16T13:40:02.657719+0000","last_became_active":"2023-10-16T13:40:02.653839+0000","last_became_peered":"2023-10-16T13:40:02.653839+0000","last_unstale":"2023-10-16T13:40:02.657719+0000","last_undegraded":"2023-10-16T13:40:02.657719+0000","last_fullsized":"2023-10-16T13:40:02.657719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658466+0000","last_change":"2023-10-16T13:40:02.658466+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658466+0000","last_undegraded":"2023-10-16T13:40:02.658466+0000","last_fullsized":"2023-10-16T13:40:02.658466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668351+0000","last_change":"2023-10-16T13:40:02.667918+0000","last_active":"2023-10-16T13:40:02.668351+0000","last_peered":"2023-10-16T13:40:02.668351+0000","last_clean":"2023-10-16T13:40:02.668351+0000","last_became_active":"2023-10-16T13:40:02.667614+0000","last_became_peered":"2023-10-16T13:40:02.667614+0000","last_unstale":"2023-10-16T13:40:02.668351+0000","last_undegraded":"2023-10-16T13:40:02.668351+0000","last_fullsized":"2023-10-16T13:40:02.668351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648744+0000","last_change":"2023-10-16T13:40:02.648744+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648744+0000","last_undegraded":"2023-10-16T13:40:02.648744+0000","last_fullsized":"2023-10-16T13:40:02.648744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.666729+0000","last_change":"2023-10-16T13:40:02.665632+0000","last_active":"2023-10-16T13:40:02.666729+0000","last_peered":"2023-10-16T13:40:02.666729+0000","last_clean":"2023-10-16T13:40:02.666729+0000","last_became_active":"2023-10-16T13:40:02.665364+0000","last_became_peered":"2023-10-16T13:40:02.665364+0000","last_unstale":"2023-10-16T13:40:02.666729+0000","last_undegraded":"2023-10-16T13:40:02.666729+0000","last_fullsized":"2023-10-16T13:40:02.666729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:42.515990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654385+0000","last_change":"2023-10-16T13:40:02.654385+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654385+0000","last_undegraded":"2023-10-16T13:40:02.654385+0000","last_fullsized":"2023-10-16T13:40:02.654385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667496+0000","last_change":"2023-10-16T13:40:02.663678+0000","last_active":"2023-10-16T13:40:02.667496+0000","last_peered":"2023-10-16T13:40:02.667496+0000","last_clean":"2023-10-16T13:40:02.667496+0000","last_became_active":"2023-10-16T13:40:02.663346+0000","last_became_peered":"2023-10-16T13:40:02.663346+0000","last_unstale":"2023-10-16T13:40:02.667496+0000","last_undegraded":"2023-10-16T13:40:02.667496+0000","last_fullsized":"2023-10-16T13:40:02.667496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:11:41.509831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647474+0000","last_change":"2023-10-16T13:40:02.647474+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647474+0000","last_undegraded":"2023-10-16T13:40:02.647474+0000","last_fullsized":"2023-10-16T13:40:02.647474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668429+0000","last_change":"2023-10-16T13:40:02.666624+0000","last_active":"2023-10-16T13:40:02.668429+0000","last_peered":"2023-10-16T13:40:02.668429+0000","last_clean":"2023-10-16T13:40:02.668429+0000","last_became_active":"2023-10-16T13:40:02.666354+0000","last_became_peered":"2023-10-16T13:40:02.666354+0000","last_unstale":"2023-10-16T13:40:02.668429+0000","last_undegraded":"2023-10-16T13:40:02.668429+0000","last_fullsized":"2023-10-16T13:40:02.668429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:48.340218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657529+0000","last_change":"2023-10-16T13:40:02.657529+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657529+0000","last_undegraded":"2023-10-16T13:40:02.657529+0000","last_fullsized":"2023-10-16T13:40:02.657529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662286+0000","last_change":"2023-10-16T13:40:02.660676+0000","last_active":"2023-10-16T13:40:02.662286+0000","last_peered":"2023-10-16T13:40:02.662286+0000","last_clean":"2023-10-16T13:40:02.662286+0000","last_became_active":"2023-10-16T13:40:02.659992+0000","last_became_peered":"2023-10-16T13:40:02.659992+0000","last_unstale":"2023-10-16T13:40:02.662286+0000","last_undegraded":"2023-10-16T13:40:02.662286+0000","last_fullsized":"2023-10-16T13:40:02.662286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646232+0000","last_change":"2023-10-16T13:40:02.646232+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646232+0000","last_undegraded":"2023-10-16T13:40:02.646232+0000","last_fullsized":"2023-10-16T13:40:02.646232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668041+0000","last_change":"2023-10-16T13:40:02.664721+0000","last_active":"2023-10-16T13:40:02.668041+0000","last_peered":"2023-10-16T13:40:02.668041+0000","last_clean":"2023-10-16T13:40:02.668041+0000","last_became_active":"2023-10-16T13:40:02.664294+0000","last_became_peered":"2023-10-16T13:40:02.664294+0000","last_unstale":"2023-10-16T13:40:02.668041+0000","last_undegraded":"2023-10-16T13:40:02.668041+0000","last_fullsized":"2023-10-16T13:40:02.668041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:18.414495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654079+0000","last_change":"2023-10-16T13:40:02.654079+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654079+0000","last_undegraded":"2023-10-16T13:40:02.654079+0000","last_fullsized":"2023-10-16T13:40:02.654079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664346+0000","last_change":"2023-10-16T13:40:02.661169+0000","last_active":"2023-10-16T13:40:02.664346+0000","last_peered":"2023-10-16T13:40:02.664346+0000","last_clean":"2023-10-16T13:40:02.664346+0000","last_became_active":"2023-10-16T13:40:02.660689+0000","last_became_peered":"2023-10-16T13:40:02.660689+0000","last_unstale":"2023-10-16T13:40:02.664346+0000","last_undegraded":"2023-10-16T13:40:02.664346+0000","last_fullsized":"2023-10-16T13:40:02.664346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:07.468974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649481+0000","last_change":"2023-10-16T13:40:02.649481+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649481+0000","last_undegraded":"2023-10-16T13:40:02.649481+0000","last_fullsized":"2023-10-16T13:40:02.649481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664614+0000","last_change":"2023-10-16T13:40:02.662603+0000","last_active":"2023-10-16T13:40:02.664614+0000","last_peered":"2023-10-16T13:40:02.664614+0000","last_clean":"2023-10-16T13:40:02.664614+0000","last_became_active":"2023-10-16T13:40:02.662287+0000","last_became_peered":"2023-10-16T13:40:02.662287+0000","last_unstale":"2023-10-16T13:40:02.664614+0000","last_undegraded":"2023-10-16T13:40:02.664614+0000","last_fullsized":"2023-10-16T13:40:02.664614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655877+0000","last_change":"2023-10-16T13:40:02.655877+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655877+0000","last_undegraded":"2023-10-16T13:40:02.655877+0000","last_fullsized":"2023-10-16T13:40:02.655877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663364+0000","last_change":"2023-10-16T13:40:02.660270+0000","last_active":"2023-10-16T13:40:02.663364+0000","last_peered":"2023-10-16T13:40:02.663364+0000","last_clean":"2023-10-16T13:40:02.663364+0000","last_became_active":"2023-10-16T13:40:02.659826+0000","last_became_peered":"2023-10-16T13:40:02.659826+0000","last_unstale":"2023-10-16T13:40:02.663364+0000","last_undegraded":"2023-10-16T13:40:02.663364+0000","last_fullsized":"2023-10-16T13:40:02.663364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:47.920849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655354+0000","last_change":"2023-10-16T13:40:02.655354+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655354+0000","last_undegraded":"2023-10-16T13:40:02.655354+0000","last_fullsized":"2023-10-16T13:40:02.655354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668126+0000","last_change":"2023-10-16T13:40:02.666774+0000","last_active":"2023-10-16T13:40:02.668126+0000","last_peered":"2023-10-16T13:40:02.668126+0000","last_clean":"2023-10-16T13:40:02.668126+0000","last_became_active":"2023-10-16T13:40:02.666419+0000","last_became_peered":"2023-10-16T13:40:02.666419+0000","last_unstale":"2023-10-16T13:40:02.668126+0000","last_undegraded":"2023-10-16T13:40:02.668126+0000","last_fullsized":"2023-10-16T13:40:02.668126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:29.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646813+0000","last_change":"2023-10-16T13:40:02.646813+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646813+0000","last_undegraded":"2023-10-16T13:40:02.646813+0000","last_fullsized":"2023-10-16T13:40:02.646813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664840+0000","last_change":"2023-10-16T13:40:02.660792+0000","last_active":"2023-10-16T13:40:02.664840+0000","last_peered":"2023-10-16T13:40:02.664840+0000","last_clean":"2023-10-16T13:40:02.664840+0000","last_became_active":"2023-10-16T13:40:02.659728+0000","last_became_peered":"2023-10-16T13:40:02.659728+0000","last_unstale":"2023-10-16T13:40:02.664840+0000","last_undegraded":"2023-10-16T13:40:02.664840+0000","last_fullsized":"2023-10-16T13:40:02.664840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657214+0000","last_change":"2023-10-16T13:40:02.657214+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657214+0000","last_undegraded":"2023-10-16T13:40:02.657214+0000","last_fullsized":"2023-10-16T13:40:02.657214+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664644+0000","last_change":"2023-10-16T13:40:02.662725+0000","last_active":"2023-10-16T13:40:02.664644+0000","last_peered":"2023-10-16T13:40:02.664644+0000","last_clean":"2023-10-16T13:40:02.664644+0000","last_became_active":"2023-10-16T13:40:02.662395+0000","last_became_peered":"2023-10-16T13:40:02.662395+0000","last_unstale":"2023-10-16T13:40:02.664644+0000","last_undegraded":"2023-10-16T13:40:02.664644+0000","last_fullsized":"2023-10-16T13:40:02.664644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657070+0000","last_change":"2023-10-16T13:40:02.657070+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657070+0000","last_undegraded":"2023-10-16T13:40:02.657070+0000","last_fullsized":"2023-10-16T13:40:02.657070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668431+0000","last_change":"2023-10-16T13:40:02.666967+0000","last_active":"2023-10-16T13:40:02.668431+0000","last_peered":"2023-10-16T13:40:02.668431+0000","last_clean":"2023-10-16T13:40:02.668431+0000","last_became_active":"2023-10-16T13:40:02.666653+0000","last_became_peered":"2023-10-16T13:40:02.666653+0000","last_unstale":"2023-10-16T13:40:02.668431+0000","last_undegraded":"2023-10-16T13:40:02.668431+0000","last_fullsized":"2023-10-16T13:40:02.668431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.645606+0000","last_change":"2023-10-16T13:40:02.645606+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.645606+0000","last_undegraded":"2023-10-16T13:40:02.645606+0000","last_fullsized":"2023-10-16T13:40:02.645606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667402+0000","last_change":"2023-10-16T13:40:02.664562+0000","last_active":"2023-10-16T13:40:02.667402+0000","last_peered":"2023-10-16T13:40:02.667402+0000","last_clean":"2023-10-16T13:40:02.667402+0000","last_became_active":"2023-10-16T13:40:02.664036+0000","last_became_peered":"2023-10-16T13:40:02.664036+0000","last_unstale":"2023-10-16T13:40:02.667402+0000","last_undegraded":"2023-10-16T13:40:02.667402+0000","last_fullsized":"2023-10-16T13:40:02.667402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:04.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651226+0000","last_change":"2023-10-16T13:40:02.651226+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651226+0000","last_undegraded":"2023-10-16T13:40:02.651226+0000","last_fullsized":"2023-10-16T13:40:02.651226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657892+0000","last_change":"2023-10-16T13:40:02.656748+0000","last_active":"2023-10-16T13:40:02.657892+0000","last_peered":"2023-10-16T13:40:02.657892+0000","last_clean":"2023-10-16T13:40:02.657892+0000","last_became_active":"2023-10-16T13:40:02.656407+0000","last_became_peered":"2023-10-16T13:40:02.656407+0000","last_unstale":"2023-10-16T13:40:02.657892+0000","last_undegraded":"2023-10-16T13:40:02.657892+0000","last_fullsized":"2023-10-16T13:40:02.657892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:33:31.641363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654072+0000","last_change":"2023-10-16T13:40:02.654072+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654072+0000","last_undegraded":"2023-10-16T13:40:02.654072+0000","last_fullsized":"2023-10-16T13:40:02.654072+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.665424+0000","last_change":"2023-10-16T13:40:02.664585+0000","last_active":"2023-10-16T13:40:02.665424+0000","last_peered":"2023-10-16T13:40:02.665424+0000","last_clean":"2023-10-16T13:40:02.665424+0000","last_became_active":"2023-10-16T13:40:02.664322+0000","last_became_peered":"2023-10-16T13:40:02.664322+0000","last_unstale":"2023-10-16T13:40:02.665424+0000","last_undegraded":"2023-10-16T13:40:02.665424+0000","last_fullsized":"2023-10-16T13:40:02.665424+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646115+0000","last_change":"2023-10-16T13:40:02.646115+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646115+0000","last_undegraded":"2023-10-16T13:40:02.646115+0000","last_fullsized":"2023-10-16T13:40:02.646115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.669069+0000","last_change":"2023-10-16T13:40:02.668493+0000","last_active":"2023-10-16T13:40:02.669069+0000","last_peered":"2023-10-16T13:40:02.669069+0000","last_clean":"2023-10-16T13:40:02.669069+0000","last_became_active":"2023-10-16T13:40:02.668204+0000","last_became_peered":"2023-10-16T13:40:02.668204+0000","last_unstale":"2023-10-16T13:40:02.669069+0000","last_undegraded":"2023-10-16T13:40:02.669069+0000","last_fullsized":"2023-10-16T13:40:02.669069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:02:07.224716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647329+0000","last_change":"2023-10-16T13:40:02.647329+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647329+0000","last_undegraded":"2023-10-16T13:40:02.647329+0000","last_fullsized":"2023-10-16T13:40:02.647329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659073+0000","last_change":"2023-10-16T13:40:02.656852+0000","last_active":"2023-10-16T13:40:02.659073+0000","last_peered":"2023-10-16T13:40:02.659073+0000","last_clean":"2023-10-16T13:40:02.659073+0000","last_became_active":"2023-10-16T13:40:02.656565+0000","last_became_peered":"2023-10-16T13:40:02.656565+0000","last_unstale":"2023-10-16T13:40:02.659073+0000","last_undegraded":"2023-10-16T13:40:02.659073+0000","last_fullsized":"2023-10-16T13:40:02.659073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646911+0000","last_change":"2023-10-16T13:40:02.646911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646911+0000","last_undegraded":"2023-10-16T13:40:02.646911+0000","last_fullsized":"2023-10-16T13:40:02.646911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.658832+0000","last_change":"2023-10-16T13:40:02.656866+0000","last_active":"2023-10-16T13:40:02.658832+0000","last_peered":"2023-10-16T13:40:02.658832+0000","last_clean":"2023-10-16T13:40:02.658832+0000","last_became_active":"2023-10-16T13:40:02.656586+0000","last_became_peered":"2023-10-16T13:40:02.656586+0000","last_unstale":"2023-10-16T13:40:02.658832+0000","last_undegraded":"2023-10-16T13:40:02.658832+0000","last_fullsized":"2023-10-16T13:40:02.658832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:42:41.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652823+0000","last_change":"2023-10-16T13:40:02.652823+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652823+0000","last_undegraded":"2023-10-16T13:40:02.652823+0000","last_fullsized":"2023-10-16T13:40:02.652823+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.656462+0000","last_change":"2023-10-16T13:40:02.653438+0000","last_active":"2023-10-16T13:40:02.656462+0000","last_peered":"2023-10-16T13:40:02.656462+0000","last_clean":"2023-10-16T13:40:02.656462+0000","last_became_active":"2023-10-16T13:40:02.653107+0000","last_became_peered":"2023-10-16T13:40:02.653107+0000","last_unstale":"2023-10-16T13:40:02.656462+0000","last_undegraded":"2023-10-16T13:40:02.656462+0000","last_fullsized":"2023-10-16T13:40:02.656462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648785+0000","last_change":"2023-10-16T13:40:02.648785+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648785+0000","last_undegraded":"2023-10-16T13:40:02.648785+0000","last_fullsized":"2023-10-16T13:40:02.648785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.652665+0000","last_change":"2023-10-16T13:40:02.650139+0000","last_active":"2023-10-16T13:40:02.652665+0000","last_peered":"2023-10-16T13:40:02.652665+0000","last_clean":"2023-10-16T13:40:02.652665+0000","last_became_active":"2023-10-16T13:40:02.649855+0000","last_became_peered":"2023-10-16T13:40:02.649855+0000","last_unstale":"2023-10-16T13:40:02.652665+0000","last_undegraded":"2023-10-16T13:40:02.652665+0000","last_fullsized":"2023-10-16T13:40:02.652665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653555+0000","last_change":"2023-10-16T13:40:02.653555+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653555+0000","last_undegraded":"2023-10-16T13:40:02.653555+0000","last_fullsized":"2023-10-16T13:40:02.653555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662260+0000","last_change":"2023-10-16T13:40:02.660323+0000","last_active":"2023-10-16T13:40:02.662260+0000","last_peered":"2023-10-16T13:40:02.662260+0000","last_clean":"2023-10-16T13:40:02.662260+0000","last_became_active":"2023-10-16T13:40:02.660045+0000","last_became_peered":"2023-10-16T13:40:02.660045+0000","last_unstale":"2023-10-16T13:40:02.662260+0000","last_undegraded":"2023-10-16T13:40:02.662260+0000","last_fullsized":"2023-10-16T13:40:02.662260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646925+0000","last_change":"2023-10-16T13:40:02.646925+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646925+0000","last_undegraded":"2023-10-16T13:40:02.646925+0000","last_fullsized":"2023-10-16T13:40:02.646925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664561+0000","last_change":"2023-10-16T13:40:02.659573+0000","last_active":"2023-10-16T13:40:02.664561+0000","last_peered":"2023-10-16T13:40:02.664561+0000","last_clean":"2023-10-16T13:40:02.664561+0000","last_became_active":"2023-10-16T13:40:02.659277+0000","last_became_peered":"2023-10-16T13:40:02.659277+0000","last_unstale":"2023-10-16T13:40:02.664561+0000","last_undegraded":"2023-10-16T13:40:02.664561+0000","last_fullsized":"2023-10-16T13:40:02.664561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648713+0000","last_change":"2023-10-16T13:40:02.648713+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648713+0000","last_undegraded":"2023-10-16T13:40:02.648713+0000","last_fullsized":"2023-10-16T13:40:02.648713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667235+0000","last_change":"2023-10-16T13:40:02.663715+0000","last_active":"2023-10-16T13:40:02.667235+0000","last_peered":"2023-10-16T13:40:02.667235+0000","last_clean":"2023-10-16T13:40:02.667235+0000","last_became_active":"2023-10-16T13:40:02.663331+0000","last_became_peered":"2023-10-16T13:40:02.663331+0000","last_unstale":"2023-10-16T13:40:02.667235+0000","last_undegraded":"2023-10-16T13:40:02.667235+0000","last_fullsized":"2023-10-16T13:40:02.667235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:29.749990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649233+0000","last_change":"2023-10-16T13:40:02.649233+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649233+0000","last_undegraded":"2023-10-16T13:40:02.649233+0000","last_fullsized":"2023-10-16T13:40:02.649233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663222+0000","last_change":"2023-10-16T13:40:02.659715+0000","last_active":"2023-10-16T13:40:02.663222+0000","last_peered":"2023-10-16T13:40:02.663222+0000","last_clean":"2023-10-16T13:40:02.663222+0000","last_became_active":"2023-10-16T13:40:02.659427+0000","last_became_peered":"2023-10-16T13:40:02.659427+0000","last_unstale":"2023-10-16T13:40:02.663222+0000","last_undegraded":"2023-10-16T13:40:02.663222+0000","last_fullsized":"2023-10-16T13:40:02.663222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:55:14.871789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-16T13:40:01.648870+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:01.648870+0000","last_peered":"2023-10-16T13:40:01.648870+0000","last_clean":"2023-10-16T13:40:01.648870+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:01.648870+0000","last_undegraded":"2023-10-16T13:40:01.648870+0000","last_fullsized":"2023-10-16T13:40:01.648870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":837203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.373}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.76300000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58899999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.433},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":240568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.503},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.874}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.79600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":836184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.307},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.504}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":245816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.27600000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.25},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.314}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.33500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.624},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:08.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.390+0000 7ffbdaf52700 1 Processor -- start 2023-10-16T13:40:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.390+0000 7ffbdaf52700 1 -- start start 2023-10-16T13:40:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbdaf52700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbdaf52700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffbd406a840 0x7ffbd40cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbdaf52700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd406adb0 con 0x7ffbd406be50 2023-10-16T13:40:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbdaf52700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd406b090 con 0x7ffbd406a840 2023-10-16T13:40:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbdaf52700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd406b370 con 0x7ffbd415e030 2023-10-16T13:40:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbd3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffbd406a840 0x7ffbd40cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.391+0000 7ffbd94ef700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ffbd406be50 0x7ffbd406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45880/0 (socket says 172.21.15.5:45880) 2023-10-16T13:40:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd94ef700 1 -- 172.21.15.5:0/4284651576 learned_addr learned my addr 172.21.15.5:0/4284651576 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd8cee700 1 --2- 172.21.15.5:0/4284651576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd8cee700 1 -- 172.21.15.5:0/4284651576 >> v2:172.21.15.112:3300/0 conn(0x7ffbd406a840 msgr2=0x7ffbd40cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd8cee700 1 --2- 172.21.15.5:0/4284651576 >> v2:172.21.15.112:3300/0 conn(0x7ffbd406a840 0x7ffbd40cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd8cee700 1 -- 172.21.15.5:0/4284651576 >> v1:172.21.15.112:6789/0 conn(0x7ffbd406be50 legacy=0x7ffbd406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd8cee700 1 -- 172.21.15.5:0/4284651576 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd406b650 con 0x7ffbd415e030 2023-10-16T13:40:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd3fff700 1 --2- 172.21.15.5:0/4284651576 >> v2:172.21.15.112:3300/0 conn(0x7ffbd406a840 0x7ffbd40cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd8cee700 1 --2- 172.21.15.5:0/4284651576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40cb3a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009840 tx=0x7ffbc8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaaf6ea29c55debe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd37fe700 1 -- 172.21.15.5:0/4284651576 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8011830 con 0x7ffbd415e030 2023-10-16T13:40:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd37fe700 1 -- 172.21.15.5:0/4284651576 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8011990 con 0x7ffbd415e030 2023-10-16T13:40:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.392+0000 7ffbd37fe700 1 -- 172.21.15.5:0/4284651576 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8011d20 con 0x7ffbd415e030 2023-10-16T13:40:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 -- 172.21.15.5:0/4284651576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 msgr2=0x7ffbd40cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 --2- 172.21.15.5:0/4284651576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40cb3a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009840 tx=0x7ffbc8009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 -- 172.21.15.5:0/4284651576 shutdown_connections 2023-10-16T13:40:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 --2- 172.21.15.5:0/4284651576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40cb3a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 --2- 172.21.15.5:0/4284651576 >> v2:172.21.15.112:3300/0 conn(0x7ffbd406a840 0x7ffbd40cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 -- 172.21.15.5:0/4284651576 >> 172.21.15.5:0/4284651576 conn(0x7ffbd40cc6f0 msgr2=0x7ffbd40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 -- 172.21.15.5:0/4284651576 shutdown_connections 2023-10-16T13:40:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.393+0000 7ffbdaf52700 1 -- 172.21.15.5:0/4284651576 wait complete. 2023-10-16T13:40:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.394+0000 7ffbdaf52700 1 Processor -- start 2023-10-16T13:40:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.394+0000 7ffbdaf52700 1 -- start start 2023-10-16T13:40:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbdaf52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 0x7ffbd40c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbdaf52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd406be50 0x7ffbd40b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbdaf52700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbdaf52700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c47a0 con 0x7ffbd406a840 2023-10-16T13:40:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbdaf52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c4a40 con 0x7ffbd406be50 2023-10-16T13:40:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbdaf52700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c4d20 con 0x7ffbd415e030 2023-10-16T13:40:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbd8cee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 0x7ffbd40c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbd8cee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 0x7ffbd40c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44902/0 (socket says 172.21.15.5:44902) 2023-10-16T13:40:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbd8cee700 1 -- 172.21.15.5:0/1199965341 learned_addr learned my addr 172.21.15.5:0/1199965341 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbd3fff700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd406be50 0x7ffbd40b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.395+0000 7ffbd94ef700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd8cee700 1 -- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 msgr2=0x7ffbd40b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd8cee700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd8cee700 1 -- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd406be50 msgr2=0x7ffbd40b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd8cee700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd406be50 0x7ffbd40b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd8cee700 1 -- 172.21.15.5:0/1199965341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00094a0 con 0x7ffbd406a840 2023-10-16T13:40:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd8cee700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 0x7ffbd40c5ae0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009fd0 tx=0x7ffbc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc80036a0 con 0x7ffbd406a840 2023-10-16T13:40:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc801f070 con 0x7ffbd406a840 2023-10-16T13:40:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8003a20 con 0x7ffbd406a840 2023-10-16T13:40:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbdaf52700 1 -- 172.21.15.5:0/1199965341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc80094a0 con 0x7ffbd406a840 2023-10-16T13:40:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.396+0000 7ffbdaf52700 1 -- 172.21.15.5:0/1199965341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd40c52e0 con 0x7ffbd406a840 2023-10-16T13:40:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.397+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac0052f0 con 0x7ffbd406a840 2023-10-16T13:40:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.397+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffbc8003b80 con 0x7ffbd406a840 2023-10-16T13:40:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.398+0000 7ffbd17fa700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbb806af00 0x7ffbb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.398+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbc8021070 con 0x7ffbd406a840 2023-10-16T13:40:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.398+0000 7ffbd3fff700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbb806af00 0x7ffbb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.399+0000 7ffbd3fff700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbb806af00 0x7ffbb806d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40aeff0 tx=0x7ffbc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.403+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbc8055fb0 con 0x7ffbd406a840 2023-10-16T13:40:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.597+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbac000bc0 con 0x7ffbb806af00 2023-10-16T13:40:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.606+0000 7ffbd17fa700 1 -- 172.21.15.5:0/1199965341 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284215 (secure 0 0 0) 0x7ffbac000bc0 con 0x7ffbb806af00 2023-10-16T13:40:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbb806af00 msgr2=0x7ffbb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbb806af00 0x7ffbb806d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40aeff0 tx=0x7ffbc0008040 comp rx=0 tx=0).stop 2023-10-16T13:40:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 msgr2=0x7ffbd40c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 0x7ffbd40c5ae0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009fd0 tx=0x7ffbc8004750 comp rx=0 tx=0).stop 2023-10-16T13:40:08.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 shutdown_connections 2023-10-16T13:40:08.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbb806af00 0x7ffbb806d3c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd415e030 0x7ffbd40b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd406a840 0x7ffbd40c5ae0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 --2- 172.21.15.5:0/1199965341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd406be50 0x7ffbd40b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 >> 172.21.15.5:0/1199965341 conn(0x7ffbd40cc6f0 msgr2=0x7ffbd415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:08.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 shutdown_connections 2023-10-16T13:40:08.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.609+0000 7ffbbeffd700 1 -- 172.21.15.5:0/1199965341 wait complete. 2023-10-16T13:40:08.616 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:08.624 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-16T13:40:07.483062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221908,"kb_used_data":5716,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752812,"statfs":{"total":773094113280,"available":772866879488,"internally_reserved":0,"allocated":5853184,"data_stored":3147111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.840428"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652350+0000","last_change":"2023-10-16T13:40:02.652350+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652350+0000","last_undegraded":"2023-10-16T13:40:02.652350+0000","last_fullsized":"2023-10-16T13:40:02.652350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658053+0000","last_change":"2023-10-16T13:40:02.658053+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658053+0000","last_undegraded":"2023-10-16T13:40:02.658053+0000","last_fullsized":"2023-10-16T13:40:02.658053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657955+0000","last_change":"2023-10-16T13:40:02.657955+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657955+0000","last_undegraded":"2023-10-16T13:40:02.657955+0000","last_fullsized":"2023-10-16T13:40:02.657955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647013+0000","last_change":"2023-10-16T13:40:02.647013+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647013+0000","last_undegraded":"2023-10-16T13:40:02.647013+0000","last_fullsized":"2023-10-16T13:40:02.647013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649569+0000","last_change":"2023-10-16T13:40:02.649569+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649569+0000","last_undegraded":"2023-10-16T13:40:02.649569+0000","last_fullsized":"2023-10-16T13:40:02.649569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651902+0000","last_change":"2023-10-16T13:40:02.651902+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651902+0000","last_undegraded":"2023-10-16T13:40:02.651902+0000","last_fullsized":"2023-10-16T13:40:02.651902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649878+0000","last_change":"2023-10-16T13:40:02.649878+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649878+0000","last_undegraded":"2023-10-16T13:40:02.649878+0000","last_fullsized":"2023-10-16T13:40:02.649878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660006+0000","last_change":"2023-10-16T13:40:02.660006+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660006+0000","last_undegraded":"2023-10-16T13:40:02.660006+0000","last_fullsized":"2023-10-16T13:40:02.660006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649674+0000","last_change":"2023-10-16T13:40:02.649674+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649674+0000","last_undegraded":"2023-10-16T13:40:02.649674+0000","last_fullsized":"2023-10-16T13:40:02.649674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647653+0000","last_change":"2023-10-16T13:40:02.647653+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647653+0000","last_undegraded":"2023-10-16T13:40:02.647653+0000","last_fullsized":"2023-10-16T13:40:02.647653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647996+0000","last_change":"2023-10-16T13:40:02.647996+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647996+0000","last_undegraded":"2023-10-16T13:40:02.647996+0000","last_fullsized":"2023-10-16T13:40:02.647996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646494+0000","last_change":"2023-10-16T13:40:02.646494+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646494+0000","last_undegraded":"2023-10-16T13:40:02.646494+0000","last_fullsized":"2023-10-16T13:40:02.646494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650532+0000","last_change":"2023-10-16T13:40:02.650532+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650532+0000","last_undegraded":"2023-10-16T13:40:02.650532+0000","last_fullsized":"2023-10-16T13:40:02.650532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649997+0000","last_change":"2023-10-16T13:40:02.649997+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649997+0000","last_undegraded":"2023-10-16T13:40:02.649997+0000","last_fullsized":"2023-10-16T13:40:02.649997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649396+0000","last_change":"2023-10-16T13:40:02.649396+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649396+0000","last_undegraded":"2023-10-16T13:40:02.649396+0000","last_fullsized":"2023-10-16T13:40:02.649396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651560+0000","last_change":"2023-10-16T13:40:02.651560+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651560+0000","last_undegraded":"2023-10-16T13:40:02.651560+0000","last_fullsized":"2023-10-16T13:40:02.651560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658186+0000","last_change":"2023-10-16T13:40:02.658186+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658186+0000","last_undegraded":"2023-10-16T13:40:02.658186+0000","last_fullsized":"2023-10-16T13:40:02.658186+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655939+0000","last_change":"2023-10-16T13:40:02.655939+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655939+0000","last_undegraded":"2023-10-16T13:40:02.655939+0000","last_fullsized":"2023-10-16T13:40:02.655939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648803+0000","last_change":"2023-10-16T13:40:02.648803+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648803+0000","last_undegraded":"2023-10-16T13:40:02.648803+0000","last_fullsized":"2023-10-16T13:40:02.648803+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657721+0000","last_change":"2023-10-16T13:40:02.657721+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657721+0000","last_undegraded":"2023-10-16T13:40:02.657721+0000","last_fullsized":"2023-10-16T13:40:02.657721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654720+0000","last_change":"2023-10-16T13:40:02.654720+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654720+0000","last_undegraded":"2023-10-16T13:40:02.654720+0000","last_fullsized":"2023-10-16T13:40:02.654720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649790+0000","last_change":"2023-10-16T13:40:02.649790+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649790+0000","last_undegraded":"2023-10-16T13:40:02.649790+0000","last_fullsized":"2023-10-16T13:40:02.649790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.656662+0000","last_change":"2023-10-16T13:40:02.656662+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.656662+0000","last_undegraded":"2023-10-16T13:40:02.656662+0000","last_fullsized":"2023-10-16T13:40:02.656662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651516+0000","last_change":"2023-10-16T13:40:02.651516+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651516+0000","last_undegraded":"2023-10-16T13:40:02.651516+0000","last_fullsized":"2023-10-16T13:40:02.651516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649215+0000","last_change":"2023-10-16T13:40:02.649215+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649215+0000","last_undegraded":"2023-10-16T13:40:02.649215+0000","last_fullsized":"2023-10-16T13:40:02.649215+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646953+0000","last_change":"2023-10-16T13:40:02.646953+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646953+0000","last_undegraded":"2023-10-16T13:40:02.646953+0000","last_fullsized":"2023-10-16T13:40:02.646953+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653875+0000","last_change":"2023-10-16T13:40:02.653875+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653875+0000","last_undegraded":"2023-10-16T13:40:02.653875+0000","last_fullsized":"2023-10-16T13:40:02.653875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649033+0000","last_change":"2023-10-16T13:40:02.649033+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649033+0000","last_undegraded":"2023-10-16T13:40:02.649033+0000","last_fullsized":"2023-10-16T13:40:02.649033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660059+0000","last_change":"2023-10-16T13:40:02.660059+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660059+0000","last_undegraded":"2023-10-16T13:40:02.660059+0000","last_fullsized":"2023-10-16T13:40:02.660059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654174+0000","last_change":"2023-10-16T13:40:02.654174+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654174+0000","last_undegraded":"2023-10-16T13:40:02.654174+0000","last_fullsized":"2023-10-16T13:40:02.654174+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649183+0000","last_change":"2023-10-16T13:40:02.649183+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649183+0000","last_undegraded":"2023-10-16T13:40:02.649183+0000","last_fullsized":"2023-10-16T13:40:02.649183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653815+0000","last_change":"2023-10-16T13:40:02.653815+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653815+0000","last_undegraded":"2023-10-16T13:40:02.653815+0000","last_fullsized":"2023-10-16T13:40:02.653815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653274+0000","last_change":"2023-10-16T13:40:02.653274+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653274+0000","last_undegraded":"2023-10-16T13:40:02.653274+0000","last_fullsized":"2023-10-16T13:40:02.653274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664926+0000","last_change":"2023-10-16T13:40:02.660186+0000","last_active":"2023-10-16T13:40:02.664926+0000","last_peered":"2023-10-16T13:40:02.664926+0000","last_clean":"2023-10-16T13:40:02.664926+0000","last_became_active":"2023-10-16T13:40:02.659896+0000","last_became_peered":"2023-10-16T13:40:02.659896+0000","last_unstale":"2023-10-16T13:40:02.664926+0000","last_undegraded":"2023-10-16T13:40:02.664926+0000","last_fullsized":"2023-10-16T13:40:02.664926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647495+0000","last_change":"2023-10-16T13:40:02.647495+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647495+0000","last_undegraded":"2023-10-16T13:40:02.647495+0000","last_fullsized":"2023-10-16T13:40:02.647495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668203+0000","last_change":"2023-10-16T13:40:02.666794+0000","last_active":"2023-10-16T13:40:02.668203+0000","last_peered":"2023-10-16T13:40:02.668203+0000","last_clean":"2023-10-16T13:40:02.668203+0000","last_became_active":"2023-10-16T13:40:02.666442+0000","last_became_peered":"2023-10-16T13:40:02.666442+0000","last_unstale":"2023-10-16T13:40:02.668203+0000","last_undegraded":"2023-10-16T13:40:02.668203+0000","last_fullsized":"2023-10-16T13:40:02.668203+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:56.624959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650911+0000","last_change":"2023-10-16T13:40:02.650911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650911+0000","last_undegraded":"2023-10-16T13:40:02.650911+0000","last_fullsized":"2023-10-16T13:40:02.650911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659218+0000","last_change":"2023-10-16T13:40:02.657293+0000","last_active":"2023-10-16T13:40:02.659218+0000","last_peered":"2023-10-16T13:40:02.659218+0000","last_clean":"2023-10-16T13:40:02.659218+0000","last_became_active":"2023-10-16T13:40:02.657011+0000","last_became_peered":"2023-10-16T13:40:02.657011+0000","last_unstale":"2023-10-16T13:40:02.659218+0000","last_undegraded":"2023-10-16T13:40:02.659218+0000","last_fullsized":"2023-10-16T13:40:02.659218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653377+0000","last_change":"2023-10-16T13:40:02.653377+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653377+0000","last_undegraded":"2023-10-16T13:40:02.653377+0000","last_fullsized":"2023-10-16T13:40:02.653377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664604+0000","last_change":"2023-10-16T13:40:02.662600+0000","last_active":"2023-10-16T13:40:02.664604+0000","last_peered":"2023-10-16T13:40:02.664604+0000","last_clean":"2023-10-16T13:40:02.664604+0000","last_became_active":"2023-10-16T13:40:02.662253+0000","last_became_peered":"2023-10-16T13:40:02.662253+0000","last_unstale":"2023-10-16T13:40:02.664604+0000","last_undegraded":"2023-10-16T13:40:02.664604+0000","last_fullsized":"2023-10-16T13:40:02.664604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:16:57.664802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649328+0000","last_change":"2023-10-16T13:40:02.649328+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649328+0000","last_undegraded":"2023-10-16T13:40:02.649328+0000","last_fullsized":"2023-10-16T13:40:02.649328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662839+0000","last_change":"2023-10-16T13:40:02.658317+0000","last_active":"2023-10-16T13:40:02.662839+0000","last_peered":"2023-10-16T13:40:02.662839+0000","last_clean":"2023-10-16T13:40:02.662839+0000","last_became_active":"2023-10-16T13:40:02.658043+0000","last_became_peered":"2023-10-16T13:40:02.658043+0000","last_unstale":"2023-10-16T13:40:02.662839+0000","last_undegraded":"2023-10-16T13:40:02.662839+0000","last_fullsized":"2023-10-16T13:40:02.662839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650172+0000","last_change":"2023-10-16T13:40:02.650172+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650172+0000","last_undegraded":"2023-10-16T13:40:02.650172+0000","last_fullsized":"2023-10-16T13:40:02.650172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664918+0000","last_change":"2023-10-16T13:40:02.661653+0000","last_active":"2023-10-16T13:40:02.664918+0000","last_peered":"2023-10-16T13:40:02.664918+0000","last_clean":"2023-10-16T13:40:02.664918+0000","last_became_active":"2023-10-16T13:40:02.661255+0000","last_became_peered":"2023-10-16T13:40:02.661255+0000","last_unstale":"2023-10-16T13:40:02.664918+0000","last_undegraded":"2023-10-16T13:40:02.664918+0000","last_fullsized":"2023-10-16T13:40:02.664918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650235+0000","last_change":"2023-10-16T13:40:02.650235+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650235+0000","last_undegraded":"2023-10-16T13:40:02.650235+0000","last_fullsized":"2023-10-16T13:40:02.650235+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657719+0000","last_change":"2023-10-16T13:40:02.654143+0000","last_active":"2023-10-16T13:40:02.657719+0000","last_peered":"2023-10-16T13:40:02.657719+0000","last_clean":"2023-10-16T13:40:02.657719+0000","last_became_active":"2023-10-16T13:40:02.653839+0000","last_became_peered":"2023-10-16T13:40:02.653839+0000","last_unstale":"2023-10-16T13:40:02.657719+0000","last_undegraded":"2023-10-16T13:40:02.657719+0000","last_fullsized":"2023-10-16T13:40:02.657719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658466+0000","last_change":"2023-10-16T13:40:02.658466+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658466+0000","last_undegraded":"2023-10-16T13:40:02.658466+0000","last_fullsized":"2023-10-16T13:40:02.658466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668351+0000","last_change":"2023-10-16T13:40:02.667918+0000","last_active":"2023-10-16T13:40:02.668351+0000","last_peered":"2023-10-16T13:40:02.668351+0000","last_clean":"2023-10-16T13:40:02.668351+0000","last_became_active":"2023-10-16T13:40:02.667614+0000","last_became_peered":"2023-10-16T13:40:02.667614+0000","last_unstale":"2023-10-16T13:40:02.668351+0000","last_undegraded":"2023-10-16T13:40:02.668351+0000","last_fullsized":"2023-10-16T13:40:02.668351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648744+0000","last_change":"2023-10-16T13:40:02.648744+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648744+0000","last_undegraded":"2023-10-16T13:40:02.648744+0000","last_fullsized":"2023-10-16T13:40:02.648744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.666729+0000","last_change":"2023-10-16T13:40:02.665632+0000","last_active":"2023-10-16T13:40:02.666729+0000","last_peered":"2023-10-16T13:40:02.666729+0000","last_clean":"2023-10-16T13:40:02.666729+0000","last_became_active":"2023-10-16T13:40:02.665364+0000","last_became_peered":"2023-10-16T13:40:02.665364+0000","last_unstale":"2023-10-16T13:40:02.666729+0000","last_undegraded":"2023-10-16T13:40:02.666729+0000","last_fullsized":"2023-10-16T13:40:02.666729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:42.515990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654385+0000","last_change":"2023-10-16T13:40:02.654385+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654385+0000","last_undegraded":"2023-10-16T13:40:02.654385+0000","last_fullsized":"2023-10-16T13:40:02.654385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667496+0000","last_change":"2023-10-16T13:40:02.663678+0000","last_active":"2023-10-16T13:40:02.667496+0000","last_peered":"2023-10-16T13:40:02.667496+0000","last_clean":"2023-10-16T13:40:02.667496+0000","last_became_active":"2023-10-16T13:40:02.663346+0000","last_became_peered":"2023-10-16T13:40:02.663346+0000","last_unstale":"2023-10-16T13:40:02.667496+0000","last_undegraded":"2023-10-16T13:40:02.667496+0000","last_fullsized":"2023-10-16T13:40:02.667496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:11:41.509831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647474+0000","last_change":"2023-10-16T13:40:02.647474+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647474+0000","last_undegraded":"2023-10-16T13:40:02.647474+0000","last_fullsized":"2023-10-16T13:40:02.647474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668429+0000","last_change":"2023-10-16T13:40:02.666624+0000","last_active":"2023-10-16T13:40:02.668429+0000","last_peered":"2023-10-16T13:40:02.668429+0000","last_clean":"2023-10-16T13:40:02.668429+0000","last_became_active":"2023-10-16T13:40:02.666354+0000","last_became_peered":"2023-10-16T13:40:02.666354+0000","last_unstale":"2023-10-16T13:40:02.668429+0000","last_undegraded":"2023-10-16T13:40:02.668429+0000","last_fullsized":"2023-10-16T13:40:02.668429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:48.340218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657529+0000","last_change":"2023-10-16T13:40:02.657529+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657529+0000","last_undegraded":"2023-10-16T13:40:02.657529+0000","last_fullsized":"2023-10-16T13:40:02.657529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662286+0000","last_change":"2023-10-16T13:40:02.660676+0000","last_active":"2023-10-16T13:40:02.662286+0000","last_peered":"2023-10-16T13:40:02.662286+0000","last_clean":"2023-10-16T13:40:02.662286+0000","last_became_active":"2023-10-16T13:40:02.659992+0000","last_became_peered":"2023-10-16T13:40:02.659992+0000","last_unstale":"2023-10-16T13:40:02.662286+0000","last_undegraded":"2023-10-16T13:40:02.662286+0000","last_fullsized":"2023-10-16T13:40:02.662286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646232+0000","last_change":"2023-10-16T13:40:02.646232+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646232+0000","last_undegraded":"2023-10-16T13:40:02.646232+0000","last_fullsized":"2023-10-16T13:40:02.646232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668041+0000","last_change":"2023-10-16T13:40:02.664721+0000","last_active":"2023-10-16T13:40:02.668041+0000","last_peered":"2023-10-16T13:40:02.668041+0000","last_clean":"2023-10-16T13:40:02.668041+0000","last_became_active":"2023-10-16T13:40:02.664294+0000","last_became_peered":"2023-10-16T13:40:02.664294+0000","last_unstale":"2023-10-16T13:40:02.668041+0000","last_undegraded":"2023-10-16T13:40:02.668041+0000","last_fullsized":"2023-10-16T13:40:02.668041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:18.414495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654079+0000","last_change":"2023-10-16T13:40:02.654079+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654079+0000","last_undegraded":"2023-10-16T13:40:02.654079+0000","last_fullsized":"2023-10-16T13:40:02.654079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664346+0000","last_change":"2023-10-16T13:40:02.661169+0000","last_active":"2023-10-16T13:40:02.664346+0000","last_peered":"2023-10-16T13:40:02.664346+0000","last_clean":"2023-10-16T13:40:02.664346+0000","last_became_active":"2023-10-16T13:40:02.660689+0000","last_became_peered":"2023-10-16T13:40:02.660689+0000","last_unstale":"2023-10-16T13:40:02.664346+0000","last_undegraded":"2023-10-16T13:40:02.664346+0000","last_fullsized":"2023-10-16T13:40:02.664346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:07.468974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649481+0000","last_change":"2023-10-16T13:40:02.649481+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649481+0000","last_undegraded":"2023-10-16T13:40:02.649481+0000","last_fullsized":"2023-10-16T13:40:02.649481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664614+0000","last_change":"2023-10-16T13:40:02.662603+0000","last_active":"2023-10-16T13:40:02.664614+0000","last_peered":"2023-10-16T13:40:02.664614+0000","last_clean":"2023-10-16T13:40:02.664614+0000","last_became_active":"2023-10-16T13:40:02.662287+0000","last_became_peered":"2023-10-16T13:40:02.662287+0000","last_unstale":"2023-10-16T13:40:02.664614+0000","last_undegraded":"2023-10-16T13:40:02.664614+0000","last_fullsized":"2023-10-16T13:40:02.664614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655877+0000","last_change":"2023-10-16T13:40:02.655877+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655877+0000","last_undegraded":"2023-10-16T13:40:02.655877+0000","last_fullsized":"2023-10-16T13:40:02.655877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663364+0000","last_change":"2023-10-16T13:40:02.660270+0000","last_active":"2023-10-16T13:40:02.663364+0000","last_peered":"2023-10-16T13:40:02.663364+0000","last_clean":"2023-10-16T13:40:02.663364+0000","last_became_active":"2023-10-16T13:40:02.659826+0000","last_became_peered":"2023-10-16T13:40:02.659826+0000","last_unstale":"2023-10-16T13:40:02.663364+0000","last_undegraded":"2023-10-16T13:40:02.663364+0000","last_fullsized":"2023-10-16T13:40:02.663364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:47.920849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655354+0000","last_change":"2023-10-16T13:40:02.655354+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655354+0000","last_undegraded":"2023-10-16T13:40:02.655354+0000","last_fullsized":"2023-10-16T13:40:02.655354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668126+0000","last_change":"2023-10-16T13:40:02.666774+0000","last_active":"2023-10-16T13:40:02.668126+0000","last_peered":"2023-10-16T13:40:02.668126+0000","last_clean":"2023-10-16T13:40:02.668126+0000","last_became_active":"2023-10-16T13:40:02.666419+0000","last_became_peered":"2023-10-16T13:40:02.666419+0000","last_unstale":"2023-10-16T13:40:02.668126+0000","last_undegraded":"2023-10-16T13:40:02.668126+0000","last_fullsized":"2023-10-16T13:40:02.668126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:29.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646813+0000","last_change":"2023-10-16T13:40:02.646813+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646813+0000","last_undegraded":"2023-10-16T13:40:02.646813+0000","last_fullsized":"2023-10-16T13:40:02.646813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664840+0000","last_change":"2023-10-16T13:40:02.660792+0000","last_active":"2023-10-16T13:40:02.664840+0000","last_peered":"2023-10-16T13:40:02.664840+0000","last_clean":"2023-10-16T13:40:02.664840+0000","last_became_active":"2023-10-16T13:40:02.659728+0000","last_became_peered":"2023-10-16T13:40:02.659728+0000","last_unstale":"2023-10-16T13:40:02.664840+0000","last_undegraded":"2023-10-16T13:40:02.664840+0000","last_fullsized":"2023-10-16T13:40:02.664840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657214+0000","last_change":"2023-10-16T13:40:02.657214+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657214+0000","last_undegraded":"2023-10-16T13:40:02.657214+0000","last_fullsized":"2023-10-16T13:40:02.657214+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664644+0000","last_change":"2023-10-16T13:40:02.662725+0000","last_active":"2023-10-16T13:40:02.664644+0000","last_peered":"2023-10-16T13:40:02.664644+0000","last_clean":"2023-10-16T13:40:02.664644+0000","last_became_active":"2023-10-16T13:40:02.662395+0000","last_became_peered":"2023-10-16T13:40:02.662395+0000","last_unstale":"2023-10-16T13:40:02.664644+0000","last_undegraded":"2023-10-16T13:40:02.664644+0000","last_fullsized":"2023-10-16T13:40:02.664644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657070+0000","last_change":"2023-10-16T13:40:02.657070+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657070+0000","last_undegraded":"2023-10-16T13:40:02.657070+0000","last_fullsized":"2023-10-16T13:40:02.657070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668431+0000","last_change":"2023-10-16T13:40:02.666967+0000","last_active":"2023-10-16T13:40:02.668431+0000","last_peered":"2023-10-16T13:40:02.668431+0000","last_clean":"2023-10-16T13:40:02.668431+0000","last_became_active":"2023-10-16T13:40:02.666653+0000","last_became_peered":"2023-10-16T13:40:02.666653+0000","last_unstale":"2023-10-16T13:40:02.668431+0000","last_undegraded":"2023-10-16T13:40:02.668431+0000","last_fullsized":"2023-10-16T13:40:02.668431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.645606+0000","last_change":"2023-10-16T13:40:02.645606+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.645606+0000","last_undegraded":"2023-10-16T13:40:02.645606+0000","last_fullsized":"2023-10-16T13:40:02.645606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667402+0000","last_change":"2023-10-16T13:40:02.664562+0000","last_active":"2023-10-16T13:40:02.667402+0000","last_peered":"2023-10-16T13:40:02.667402+0000","last_clean":"2023-10-16T13:40:02.667402+0000","last_became_active":"2023-10-16T13:40:02.664036+0000","last_became_peered":"2023-10-16T13:40:02.664036+0000","last_unstale":"2023-10-16T13:40:02.667402+0000","last_undegraded":"2023-10-16T13:40:02.667402+0000","last_fullsized":"2023-10-16T13:40:02.667402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:04.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651226+0000","last_change":"2023-10-16T13:40:02.651226+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651226+0000","last_undegraded":"2023-10-16T13:40:02.651226+0000","last_fullsized":"2023-10-16T13:40:02.651226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657892+0000","last_change":"2023-10-16T13:40:02.656748+0000","last_active":"2023-10-16T13:40:02.657892+0000","last_peered":"2023-10-16T13:40:02.657892+0000","last_clean":"2023-10-16T13:40:02.657892+0000","last_became_active":"2023-10-16T13:40:02.656407+0000","last_became_peered":"2023-10-16T13:40:02.656407+0000","last_unstale":"2023-10-16T13:40:02.657892+0000","last_undegraded":"2023-10-16T13:40:02.657892+0000","last_fullsized":"2023-10-16T13:40:02.657892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:33:31.641363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654072+0000","last_change":"2023-10-16T13:40:02.654072+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654072+0000","last_undegraded":"2023-10-16T13:40:02.654072+0000","last_fullsized":"2023-10-16T13:40:02.654072+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.665424+0000","last_change":"2023-10-16T13:40:02.664585+0000","last_active":"2023-10-16T13:40:02.665424+0000","last_peered":"2023-10-16T13:40:02.665424+0000","last_clean":"2023-10-16T13:40:02.665424+0000","last_became_active":"2023-10-16T13:40:02.664322+0000","last_became_peered":"2023-10-16T13:40:02.664322+0000","last_unstale":"2023-10-16T13:40:02.665424+0000","last_undegraded":"2023-10-16T13:40:02.665424+0000","last_fullsized":"2023-10-16T13:40:02.665424+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646115+0000","last_change":"2023-10-16T13:40:02.646115+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646115+0000","last_undegraded":"2023-10-16T13:40:02.646115+0000","last_fullsized":"2023-10-16T13:40:02.646115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.669069+0000","last_change":"2023-10-16T13:40:02.668493+0000","last_active":"2023-10-16T13:40:02.669069+0000","last_peered":"2023-10-16T13:40:02.669069+0000","last_clean":"2023-10-16T13:40:02.669069+0000","last_became_active":"2023-10-16T13:40:02.668204+0000","last_became_peered":"2023-10-16T13:40:02.668204+0000","last_unstale":"2023-10-16T13:40:02.669069+0000","last_undegraded":"2023-10-16T13:40:02.669069+0000","last_fullsized":"2023-10-16T13:40:02.669069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:02:07.224716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647329+0000","last_change":"2023-10-16T13:40:02.647329+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647329+0000","last_undegraded":"2023-10-16T13:40:02.647329+0000","last_fullsized":"2023-10-16T13:40:02.647329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659073+0000","last_change":"2023-10-16T13:40:02.656852+0000","last_active":"2023-10-16T13:40:02.659073+0000","last_peered":"2023-10-16T13:40:02.659073+0000","last_clean":"2023-10-16T13:40:02.659073+0000","last_became_active":"2023-10-16T13:40:02.656565+0000","last_became_peered":"2023-10-16T13:40:02.656565+0000","last_unstale":"2023-10-16T13:40:02.659073+0000","last_undegraded":"2023-10-16T13:40:02.659073+0000","last_fullsized":"2023-10-16T13:40:02.659073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646911+0000","last_change":"2023-10-16T13:40:02.646911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646911+0000","last_undegraded":"2023-10-16T13:40:02.646911+0000","last_fullsized":"2023-10-16T13:40:02.646911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.658832+0000","last_change":"2023-10-16T13:40:02.656866+0000","last_active":"2023-10-16T13:40:02.658832+0000","last_peered":"2023-10-16T13:40:02.658832+0000","last_clean":"2023-10-16T13:40:02.658832+0000","last_became_active":"2023-10-16T13:40:02.656586+0000","last_became_peered":"2023-10-16T13:40:02.656586+0000","last_unstale":"2023-10-16T13:40:02.658832+0000","last_undegraded":"2023-10-16T13:40:02.658832+0000","last_fullsized":"2023-10-16T13:40:02.658832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:42:41.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652823+0000","last_change":"2023-10-16T13:40:02.652823+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652823+0000","last_undegraded":"2023-10-16T13:40:02.652823+0000","last_fullsized":"2023-10-16T13:40:02.652823+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.656462+0000","last_change":"2023-10-16T13:40:02.653438+0000","last_active":"2023-10-16T13:40:02.656462+0000","last_peered":"2023-10-16T13:40:02.656462+0000","last_clean":"2023-10-16T13:40:02.656462+0000","last_became_active":"2023-10-16T13:40:02.653107+0000","last_became_peered":"2023-10-16T13:40:02.653107+0000","last_unstale":"2023-10-16T13:40:02.656462+0000","last_undegraded":"2023-10-16T13:40:02.656462+0000","last_fullsized":"2023-10-16T13:40:02.656462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648785+0000","last_change":"2023-10-16T13:40:02.648785+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648785+0000","last_undegraded":"2023-10-16T13:40:02.648785+0000","last_fullsized":"2023-10-16T13:40:02.648785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.652665+0000","last_change":"2023-10-16T13:40:02.650139+0000","last_active":"2023-10-16T13:40:02.652665+0000","last_peered":"2023-10-16T13:40:02.652665+0000","last_clean":"2023-10-16T13:40:02.652665+0000","last_became_active":"2023-10-16T13:40:02.649855+0000","last_became_peered":"2023-10-16T13:40:02.649855+0000","last_unstale":"2023-10-16T13:40:02.652665+0000","last_undegraded":"2023-10-16T13:40:02.652665+0000","last_fullsized":"2023-10-16T13:40:02.652665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653555+0000","last_change":"2023-10-16T13:40:02.653555+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653555+0000","last_undegraded":"2023-10-16T13:40:02.653555+0000","last_fullsized":"2023-10-16T13:40:02.653555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662260+0000","last_change":"2023-10-16T13:40:02.660323+0000","last_active":"2023-10-16T13:40:02.662260+0000","last_peered":"2023-10-16T13:40:02.662260+0000","last_clean":"2023-10-16T13:40:02.662260+0000","last_became_active":"2023-10-16T13:40:02.660045+0000","last_became_peered":"2023-10-16T13:40:02.660045+0000","last_unstale":"2023-10-16T13:40:02.662260+0000","last_undegraded":"2023-10-16T13:40:02.662260+0000","last_fullsized":"2023-10-16T13:40:02.662260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646925+0000","last_change":"2023-10-16T13:40:02.646925+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646925+0000","last_undegraded":"2023-10-16T13:40:02.646925+0000","last_fullsized":"2023-10-16T13:40:02.646925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664561+0000","last_change":"2023-10-16T13:40:02.659573+0000","last_active":"2023-10-16T13:40:02.664561+0000","last_peered":"2023-10-16T13:40:02.664561+0000","last_clean":"2023-10-16T13:40:02.664561+0000","last_became_active":"2023-10-16T13:40:02.659277+0000","last_became_peered":"2023-10-16T13:40:02.659277+0000","last_unstale":"2023-10-16T13:40:02.664561+0000","last_undegraded":"2023-10-16T13:40:02.664561+0000","last_fullsized":"2023-10-16T13:40:02.664561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648713+0000","last_change":"2023-10-16T13:40:02.648713+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648713+0000","last_undegraded":"2023-10-16T13:40:02.648713+0000","last_fullsized":"2023-10-16T13:40:02.648713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667235+0000","last_change":"2023-10-16T13:40:02.663715+0000","last_active":"2023-10-16T13:40:02.667235+0000","last_peered":"2023-10-16T13:40:02.667235+0000","last_clean":"2023-10-16T13:40:02.667235+0000","last_became_active":"2023-10-16T13:40:02.663331+0000","last_became_peered":"2023-10-16T13:40:02.663331+0000","last_unstale":"2023-10-16T13:40:02.667235+0000","last_undegraded":"2023-10-16T13:40:02.667235+0000","last_fullsized":"2023-10-16T13:40:02.667235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:29.749990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649233+0000","last_change":"2023-10-16T13:40:02.649233+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649233+0000","last_undegraded":"2023-10-16T13:40:02.649233+0000","last_fullsized":"2023-10-16T13:40:02.649233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663222+0000","last_change":"2023-10-16T13:40:02.659715+0000","last_active":"2023-10-16T13:40:02.663222+0000","last_peered":"2023-10-16T13:40:02.663222+0000","last_clean":"2023-10-16T13:40:02.663222+0000","last_became_active":"2023-10-16T13:40:02.659427+0000","last_became_peered":"2023-10-16T13:40:02.659427+0000","last_unstale":"2023-10-16T13:40:02.663222+0000","last_undegraded":"2023-10-16T13:40:02.663222+0000","last_fullsized":"2023-10-16T13:40:02.663222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:55:14.871789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-16T13:40:01.648870+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:01.648870+0000","last_peered":"2023-10-16T13:40:01.648870+0000","last_clean":"2023-10-16T13:40:01.648870+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:01.648870+0000","last_undegraded":"2023-10-16T13:40:01.648870+0000","last_fullsized":"2023-10-16T13:40:01.648870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":837203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.373}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.76300000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58899999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.433},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":240568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.503},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.874}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.79600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":836184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.307},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.504}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":245816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.27600000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.25},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.314}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.33500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.624},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:08.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-16T13:40:08.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.652350+0000', 'last_change': '2023-10-16T13:40:02.652350+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.652350+0000', 'last_undegraded': '2023-10-16T13:40:02.652350+0000', 'last_fullsized': '2023-10-16T13:40:02.652350+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:40:08.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-16T13:40:08.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.658053+0000', 'last_change': '2023-10-16T13:40:02.658053+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.658053+0000', 'last_undegraded': '2023-10-16T13:40:02.658053+0000', 'last_fullsized': '2023-10-16T13:40:02.658053+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-16T13:40:08.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.657955+0000', 'last_change': '2023-10-16T13:40:02.657955+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.657955+0000', 'last_undegraded': '2023-10-16T13:40:02.657955+0000', 'last_fullsized': '2023-10-16T13:40:02.657955+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-16T13:40:08.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.647013+0000', 'last_change': '2023-10-16T13:40:02.647013+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.647013+0000', 'last_undegraded': '2023-10-16T13:40:02.647013+0000', 'last_fullsized': '2023-10-16T13:40:02.647013+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-16T13:40:08.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649569+0000', 'last_change': '2023-10-16T13:40:02.649569+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649569+0000', 'last_undegraded': '2023-10-16T13:40:02.649569+0000', 'last_fullsized': '2023-10-16T13:40:02.649569+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:40:08.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-16T13:40:08.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.651902+0000', 'last_change': '2023-10-16T13:40:02.651902+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.651902+0000', 'last_undegraded': '2023-10-16T13:40:02.651902+0000', 'last_fullsized': '2023-10-16T13:40:02.651902+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-16T13:40:08.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649878+0000', 'last_change': '2023-10-16T13:40:02.649878+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649878+0000', 'last_undegraded': '2023-10-16T13:40:02.649878+0000', 'last_fullsized': '2023-10-16T13:40:02.649878+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:08.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-16T13:40:08.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.660006+0000', 'last_change': '2023-10-16T13:40:02.660006+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.660006+0000', 'last_undegraded': '2023-10-16T13:40:02.660006+0000', 'last_fullsized': '2023-10-16T13:40:02.660006+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-16T13:40:08.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649674+0000', 'last_change': '2023-10-16T13:40:02.649674+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649674+0000', 'last_undegraded': '2023-10-16T13:40:02.649674+0000', 'last_fullsized': '2023-10-16T13:40:02.649674+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:08.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-16T13:40:08.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.647653+0000', 'last_change': '2023-10-16T13:40:02.647653+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.647653+0000', 'last_undegraded': '2023-10-16T13:40:02.647653+0000', 'last_fullsized': '2023-10-16T13:40:02.647653+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:40:08.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-16T13:40:08.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.647996+0000', 'last_change': '2023-10-16T13:40:02.647996+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.647996+0000', 'last_undegraded': '2023-10-16T13:40:02.647996+0000', 'last_fullsized': '2023-10-16T13:40:02.647996+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:40:08.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-16T13:40:08.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646494+0000', 'last_change': '2023-10-16T13:40:02.646494+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646494+0000', 'last_undegraded': '2023-10-16T13:40:02.646494+0000', 'last_fullsized': '2023-10-16T13:40:02.646494+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-16T13:40:08.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.650532+0000', 'last_change': '2023-10-16T13:40:02.650532+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.650532+0000', 'last_undegraded': '2023-10-16T13:40:02.650532+0000', 'last_fullsized': '2023-10-16T13:40:02.650532+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:40:08.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-16T13:40:08.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649997+0000', 'last_change': '2023-10-16T13:40:02.649997+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649997+0000', 'last_undegraded': '2023-10-16T13:40:02.649997+0000', 'last_fullsized': '2023-10-16T13:40:02.649997+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:08.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-16T13:40:08.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649396+0000', 'last_change': '2023-10-16T13:40:02.649396+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649396+0000', 'last_undegraded': '2023-10-16T13:40:02.649396+0000', 'last_fullsized': '2023-10-16T13:40:02.649396+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:08.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-16T13:40:08.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.651560+0000', 'last_change': '2023-10-16T13:40:02.651560+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.651560+0000', 'last_undegraded': '2023-10-16T13:40:02.651560+0000', 'last_fullsized': '2023-10-16T13:40:02.651560+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-16T13:40:08.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.658186+0000', 'last_change': '2023-10-16T13:40:02.658186+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.658186+0000', 'last_undegraded': '2023-10-16T13:40:02.658186+0000', 'last_fullsized': '2023-10-16T13:40:02.658186+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-16T13:40:08.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.655939+0000', 'last_change': '2023-10-16T13:40:02.655939+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.655939+0000', 'last_undegraded': '2023-10-16T13:40:02.655939+0000', 'last_fullsized': '2023-10-16T13:40:02.655939+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-16T13:40:08.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.648803+0000', 'last_change': '2023-10-16T13:40:02.648803+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.648803+0000', 'last_undegraded': '2023-10-16T13:40:02.648803+0000', 'last_fullsized': '2023-10-16T13:40:02.648803+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:40:08.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-16T13:40:08.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.657721+0000', 'last_change': '2023-10-16T13:40:02.657721+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.657721+0000', 'last_undegraded': '2023-10-16T13:40:02.657721+0000', 'last_fullsized': '2023-10-16T13:40:02.657721+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-16T13:40:08.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.654720+0000', 'last_change': '2023-10-16T13:40:02.654720+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.654720+0000', 'last_undegraded': '2023-10-16T13:40:02.654720+0000', 'last_fullsized': '2023-10-16T13:40:02.654720+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-16T13:40:08.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649790+0000', 'last_change': '2023-10-16T13:40:02.649790+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649790+0000', 'last_undegraded': '2023-10-16T13:40:02.649790+0000', 'last_fullsized': '2023-10-16T13:40:02.649790+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-16T13:40:08.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.656662+0000', 'last_change': '2023-10-16T13:40:02.656662+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.656662+0000', 'last_undegraded': '2023-10-16T13:40:02.656662+0000', 'last_fullsized': '2023-10-16T13:40:02.656662+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-16T13:40:08.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.651516+0000', 'last_change': '2023-10-16T13:40:02.651516+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.651516+0000', 'last_undegraded': '2023-10-16T13:40:02.651516+0000', 'last_fullsized': '2023-10-16T13:40:02.651516+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:40:08.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-16T13:40:08.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649215+0000', 'last_change': '2023-10-16T13:40:02.649215+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649215+0000', 'last_undegraded': '2023-10-16T13:40:02.649215+0000', 'last_fullsized': '2023-10-16T13:40:02.649215+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:40:08.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-16T13:40:08.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646953+0000', 'last_change': '2023-10-16T13:40:02.646953+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646953+0000', 'last_undegraded': '2023-10-16T13:40:02.646953+0000', 'last_fullsized': '2023-10-16T13:40:02.646953+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-16T13:40:08.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.653875+0000', 'last_change': '2023-10-16T13:40:02.653875+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.653875+0000', 'last_undegraded': '2023-10-16T13:40:02.653875+0000', 'last_fullsized': '2023-10-16T13:40:02.653875+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-16T13:40:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649033+0000', 'last_change': '2023-10-16T13:40:02.649033+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649033+0000', 'last_undegraded': '2023-10-16T13:40:02.649033+0000', 'last_fullsized': '2023-10-16T13:40:02.649033+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:40:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-16T13:40:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.660059+0000', 'last_change': '2023-10-16T13:40:02.660059+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.660059+0000', 'last_undegraded': '2023-10-16T13:40:02.660059+0000', 'last_fullsized': '2023-10-16T13:40:02.660059+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-16T13:40:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.654174+0000', 'last_change': '2023-10-16T13:40:02.654174+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.654174+0000', 'last_undegraded': '2023-10-16T13:40:02.654174+0000', 'last_fullsized': '2023-10-16T13:40:02.654174+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-16T13:40:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649183+0000', 'last_change': '2023-10-16T13:40:02.649183+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649183+0000', 'last_undegraded': '2023-10-16T13:40:02.649183+0000', 'last_fullsized': '2023-10-16T13:40:02.649183+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:40:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-16T13:40:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.653815+0000', 'last_change': '2023-10-16T13:40:02.653815+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.653815+0000', 'last_undegraded': '2023-10-16T13:40:02.653815+0000', 'last_fullsized': '2023-10-16T13:40:02.653815+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-16T13:40:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.653274+0000', 'last_change': '2023-10-16T13:40:02.653274+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.653274+0000', 'last_undegraded': '2023-10-16T13:40:02.653274+0000', 'last_fullsized': '2023-10-16T13:40:02.653274+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-16T13:40:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.647495+0000', 'last_change': '2023-10-16T13:40:02.647495+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.647495+0000', 'last_undegraded': '2023-10-16T13:40:02.647495+0000', 'last_fullsized': '2023-10-16T13:40:02.647495+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:40:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-16T13:40:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.650911+0000', 'last_change': '2023-10-16T13:40:02.650911+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.650911+0000', 'last_undegraded': '2023-10-16T13:40:02.650911+0000', 'last_fullsized': '2023-10-16T13:40:02.650911+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-16T13:40:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.653377+0000', 'last_change': '2023-10-16T13:40:02.653377+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.653377+0000', 'last_undegraded': '2023-10-16T13:40:02.653377+0000', 'last_fullsized': '2023-10-16T13:40:02.653377+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-16T13:40:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649328+0000', 'last_change': '2023-10-16T13:40:02.649328+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649328+0000', 'last_undegraded': '2023-10-16T13:40:02.649328+0000', 'last_fullsized': '2023-10-16T13:40:02.649328+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-16T13:40:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.650172+0000', 'last_change': '2023-10-16T13:40:02.650172+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.650172+0000', 'last_undegraded': '2023-10-16T13:40:02.650172+0000', 'last_fullsized': '2023-10-16T13:40:02.650172+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-16T13:40:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.650235+0000', 'last_change': '2023-10-16T13:40:02.650235+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.650235+0000', 'last_undegraded': '2023-10-16T13:40:02.650235+0000', 'last_fullsized': '2023-10-16T13:40:02.650235+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:40:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-16T13:40:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.658466+0000', 'last_change': '2023-10-16T13:40:02.658466+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.658466+0000', 'last_undegraded': '2023-10-16T13:40:02.658466+0000', 'last_fullsized': '2023-10-16T13:40:02.658466+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-16T13:40:08.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.648744+0000', 'last_change': '2023-10-16T13:40:02.648744+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.648744+0000', 'last_undegraded': '2023-10-16T13:40:02.648744+0000', 'last_fullsized': '2023-10-16T13:40:02.648744+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:08.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-16T13:40:08.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.654385+0000', 'last_change': '2023-10-16T13:40:02.654385+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.654385+0000', 'last_undegraded': '2023-10-16T13:40:02.654385+0000', 'last_fullsized': '2023-10-16T13:40:02.654385+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-16T13:40:08.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.647474+0000', 'last_change': '2023-10-16T13:40:02.647474+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.647474+0000', 'last_undegraded': '2023-10-16T13:40:02.647474+0000', 'last_fullsized': '2023-10-16T13:40:02.647474+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:40:08.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-16T13:40:08.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.657529+0000', 'last_change': '2023-10-16T13:40:02.657529+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.657529+0000', 'last_undegraded': '2023-10-16T13:40:02.657529+0000', 'last_fullsized': '2023-10-16T13:40:02.657529+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-16T13:40:08.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646232+0000', 'last_change': '2023-10-16T13:40:02.646232+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646232+0000', 'last_undegraded': '2023-10-16T13:40:02.646232+0000', 'last_fullsized': '2023-10-16T13:40:02.646232+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-16T13:40:08.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.654079+0000', 'last_change': '2023-10-16T13:40:02.654079+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.654079+0000', 'last_undegraded': '2023-10-16T13:40:02.654079+0000', 'last_fullsized': '2023-10-16T13:40:02.654079+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-16T13:40:08.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649481+0000', 'last_change': '2023-10-16T13:40:02.649481+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649481+0000', 'last_undegraded': '2023-10-16T13:40:02.649481+0000', 'last_fullsized': '2023-10-16T13:40:02.649481+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:08.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-16T13:40:08.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.655877+0000', 'last_change': '2023-10-16T13:40:02.655877+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.655877+0000', 'last_undegraded': '2023-10-16T13:40:02.655877+0000', 'last_fullsized': '2023-10-16T13:40:02.655877+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-16T13:40:08.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.655354+0000', 'last_change': '2023-10-16T13:40:02.655354+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.655354+0000', 'last_undegraded': '2023-10-16T13:40:02.655354+0000', 'last_fullsized': '2023-10-16T13:40:02.655354+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-16T13:40:08.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646813+0000', 'last_change': '2023-10-16T13:40:02.646813+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646813+0000', 'last_undegraded': '2023-10-16T13:40:02.646813+0000', 'last_fullsized': '2023-10-16T13:40:02.646813+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-16T13:40:08.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.657214+0000', 'last_change': '2023-10-16T13:40:02.657214+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.657214+0000', 'last_undegraded': '2023-10-16T13:40:02.657214+0000', 'last_fullsized': '2023-10-16T13:40:02.657214+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-16T13:40:08.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.657070+0000', 'last_change': '2023-10-16T13:40:02.657070+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.657070+0000', 'last_undegraded': '2023-10-16T13:40:02.657070+0000', 'last_fullsized': '2023-10-16T13:40:02.657070+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-16T13:40:08.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.645606+0000', 'last_change': '2023-10-16T13:40:02.645606+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.645606+0000', 'last_undegraded': '2023-10-16T13:40:02.645606+0000', 'last_fullsized': '2023-10-16T13:40:02.645606+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-16T13:40:08.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.651226+0000', 'last_change': '2023-10-16T13:40:02.651226+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.651226+0000', 'last_undegraded': '2023-10-16T13:40:02.651226+0000', 'last_fullsized': '2023-10-16T13:40:02.651226+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-16T13:40:08.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.654072+0000', 'last_change': '2023-10-16T13:40:02.654072+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.654072+0000', 'last_undegraded': '2023-10-16T13:40:02.654072+0000', 'last_fullsized': '2023-10-16T13:40:02.654072+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-16T13:40:08.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646115+0000', 'last_change': '2023-10-16T13:40:02.646115+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646115+0000', 'last_undegraded': '2023-10-16T13:40:02.646115+0000', 'last_fullsized': '2023-10-16T13:40:02.646115+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-16T13:40:08.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.647329+0000', 'last_change': '2023-10-16T13:40:02.647329+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.647329+0000', 'last_undegraded': '2023-10-16T13:40:02.647329+0000', 'last_fullsized': '2023-10-16T13:40:02.647329+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:40:08.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-16T13:40:08.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646911+0000', 'last_change': '2023-10-16T13:40:02.646911+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646911+0000', 'last_undegraded': '2023-10-16T13:40:02.646911+0000', 'last_fullsized': '2023-10-16T13:40:02.646911+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:40:08.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-16T13:40:08.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.652823+0000', 'last_change': '2023-10-16T13:40:02.652823+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.652823+0000', 'last_undegraded': '2023-10-16T13:40:02.652823+0000', 'last_fullsized': '2023-10-16T13:40:02.652823+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:08.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-16T13:40:08.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.648785+0000', 'last_change': '2023-10-16T13:40:02.648785+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.648785+0000', 'last_undegraded': '2023-10-16T13:40:02.648785+0000', 'last_fullsized': '2023-10-16T13:40:02.648785+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-16T13:40:08.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.653555+0000', 'last_change': '2023-10-16T13:40:02.653555+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.653555+0000', 'last_undegraded': '2023-10-16T13:40:02.653555+0000', 'last_fullsized': '2023-10-16T13:40:02.653555+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:08.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-16T13:40:08.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.646925+0000', 'last_change': '2023-10-16T13:40:02.646925+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.646925+0000', 'last_undegraded': '2023-10-16T13:40:02.646925+0000', 'last_fullsized': '2023-10-16T13:40:02.646925+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:40:08.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-16T13:40:08.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.648713+0000', 'last_change': '2023-10-16T13:40:02.648713+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.648713+0000', 'last_undegraded': '2023-10-16T13:40:02.648713+0000', 'last_fullsized': '2023-10-16T13:40:02.648713+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-16T13:40:08.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:02.649233+0000', 'last_change': '2023-10-16T13:40:02.649233+0000', 'last_active': '2023-10-16T13:40:02.639394+0000', 'last_peered': '2023-10-16T13:40:02.639394+0000', 'last_clean': '2023-10-16T13:40:02.639394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:02.649233+0000', 'last_undegraded': '2023-10-16T13:40:02.649233+0000', 'last_fullsized': '2023-10-16T13:40:02.649233+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:02.639394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:40:08.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T13:40:08.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.798+0000 7ff69f743700 1 Processor -- start 2023-10-16T13:40:08.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.798+0000 7ff69f743700 1 -- start start 2023-10-16T13:40:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69f743700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 0x7ff6980ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69f743700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff69815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69f743700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69815ee20 con 0x7ff69815e910 2023-10-16T13:40:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69f743700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69815bd30 con 0x7ff6980cf330 2023-10-16T13:40:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69f743700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980cd840 con 0x7ff6980cf710 2023-10-16T13:40:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69ccde700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff69815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69d4df700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 0x7ff6980ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69dce0700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff69815e910 0x7ff6980b5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:45894/0 (socket says 172.21.15.5:45894) 2023-10-16T13:40:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69d4df700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 0x7ff6980ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:40806/0 (socket says 172.21.15.5:40806) 2023-10-16T13:40:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.799+0000 7ff69dce0700 1 -- 172.21.15.5:0/4251274606 learned_addr learned my addr 172.21.15.5:0/4251274606 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff69ccde700 1 -- 172.21.15.5:0/4251274606 >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 msgr2=0x7ff6980ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff69ccde700 1 --2- 172.21.15.5:0/4251274606 >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 0x7ff6980ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff69ccde700 1 -- 172.21.15.5:0/4251274606 >> v1:172.21.15.112:6789/0 conn(0x7ff69815e910 legacy=0x7ff6980b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff69ccde700 1 -- 172.21.15.5:0/4251274606 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69815f100 con 0x7ff6980cf710 2023-10-16T13:40:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff69d4df700 1 --2- 172.21.15.5:0/4251274606 >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 0x7ff6980ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff69ccde700 1 --2- 172.21.15.5:0/4251274606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff69815e3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff688009840 tx=0x7ff688009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be41a66f1727fb14 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff68ffff700 1 -- 172.21.15.5:0/4251274606 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688011830 con 0x7ff6980cf710 2023-10-16T13:40:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff68ffff700 1 -- 172.21.15.5:0/4251274606 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff688011990 con 0x7ff6980cf710 2023-10-16T13:40:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.800+0000 7ff68ffff700 1 -- 172.21.15.5:0/4251274606 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688011d20 con 0x7ff6980cf710 2023-10-16T13:40:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 -- 172.21.15.5:0/4251274606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 msgr2=0x7ff69815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 --2- 172.21.15.5:0/4251274606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff69815e3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff688009840 tx=0x7ff688009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 -- 172.21.15.5:0/4251274606 shutdown_connections 2023-10-16T13:40:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 --2- 172.21.15.5:0/4251274606 >> v2:172.21.15.112:3300/0 conn(0x7ff6980cf330 0x7ff6980ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 --2- 172.21.15.5:0/4251274606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff69815e3d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 -- 172.21.15.5:0/4251274606 >> 172.21.15.5:0/4251274606 conn(0x7ff6980b17f0 msgr2=0x7ff6980b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 -- 172.21.15.5:0/4251274606 shutdown_connections 2023-10-16T13:40:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.801+0000 7ff69f743700 1 -- 172.21.15.5:0/4251274606 wait complete. 2023-10-16T13:40:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.802+0000 7ff69f743700 1 Processor -- start 2023-10-16T13:40:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.802+0000 7ff69f743700 1 -- start start 2023-10-16T13:40:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69f743700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 0x7ff6980b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69f743700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff6981f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69f743700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69815e910 0x7ff698158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69f743700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980b3610 con 0x7ff6980cf330 2023-10-16T13:40:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69f743700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980b4430 con 0x7ff69815e910 2023-10-16T13:40:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69f743700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980b3820 con 0x7ff6980cf710 2023-10-16T13:40:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 0x7ff6980b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 0x7ff6980b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44916/0 (socket says 172.21.15.5:44916) 2023-10-16T13:40:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 -- 172.21.15.5:0/2446793421 learned_addr learned my addr 172.21.15.5:0/2446793421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69ccde700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff6981f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69dce0700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69815e910 0x7ff698158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 -- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 msgr2=0x7ff6981f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff6981f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 -- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69815e910 msgr2=0x7ff698158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69815e910 0x7ff698158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 -- 172.21.15.5:0/2446793421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940094a0 con 0x7ff6980cf330 2023-10-16T13:40:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.803+0000 7ff69d4df700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 0x7ff6980b30d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff69400ebe0 tx=0x7ff69400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.804+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400c850 con 0x7ff6980cf330 2023-10-16T13:40:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.804+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400c9b0 con 0x7ff6980cf330 2023-10-16T13:40:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.804+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400cd40 con 0x7ff6980cf330 2023-10-16T13:40:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.804+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6880094a0 con 0x7ff6980cf330 2023-10-16T13:40:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.804+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6980b3de0 con 0x7ff6980cf330 2023-10-16T13:40:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.805+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69804ec20 con 0x7ff6980cf330 2023-10-16T13:40:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.805+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff694013470 con 0x7ff6980cf330 2023-10-16T13:40:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.806+0000 7ff68dffb700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff67c06af00 0x7ff67c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.806+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff694089650 con 0x7ff6980cf330 2023-10-16T13:40:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.806+0000 7ff69ccde700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff67c06af00 0x7ff67c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.806+0000 7ff69ccde700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff67c06af00 0x7ff67c06d3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff6980cfb30 tx=0x7ff688008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:08.810+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff694054700 con 0x7ff6980cf330 2023-10-16T13:40:09.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.092+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff6980ca000 con 0x7ff6980cf330 2023-10-16T13:40:09.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.093+0000 7ff68dffb700 1 -- 172.21.15.5:0/2446793421 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1452 (secure 0 0 0) 0x7ff69400cea0 con 0x7ff6980cf330 2023-10-16T13:40:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:09.096 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":127,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1697463492,"num_in_osds":8,"osd_in_since":1697463484,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":227233792,"bytes_avail":772866879488,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5586}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-16T13:39:51.479327+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-16T13:40:09.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff67c06af00 msgr2=0x7ff67c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff67c06af00 0x7ff67c06d3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff6980cfb30 tx=0x7ff688008030 comp rx=0 tx=0).stop 2023-10-16T13:40:09.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 msgr2=0x7ff6980b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 0x7ff6980b30d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff69400ebe0 tx=0x7ff69400eef0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 shutdown_connections 2023-10-16T13:40:09.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69815e910 0x7ff698158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cf330 0x7ff6980b30d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff67c06af00 0x7ff67c06d3c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 --2- 172.21.15.5:0/2446793421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6980cf710 0x7ff6981f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 >> 172.21.15.5:0/2446793421 conn(0x7ff6980b17f0 msgr2=0x7ff69815a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:09.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 shutdown_connections 2023-10-16T13:40:09.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.095+0000 7ff69f743700 1 -- 172.21.15.5:0/2446793421 wait complete. 2023-10-16T13:40:09.110 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T13:40:09.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.233+0000 7f91ecbc6700 1 Processor -- start 2023-10-16T13:40:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.233+0000 7f91ecbc6700 1 -- start start 2023-10-16T13:40:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.234+0000 7f91ecbc6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91e80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.234+0000 7f91ecbc6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e815e7a0 con 0x7f91e815ab10 2023-10-16T13:40:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.234+0000 7f91ecbc6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80b29a0 con 0x7f91e815f1f0 2023-10-16T13:40:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.234+0000 7f91ecbc6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80b2c80 con 0x7f91e80cfe30 2023-10-16T13:40:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.234+0000 7f91e659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91e815ab10 0x7f91e80b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54928/0 (socket says 172.21.15.5:54928) 2023-10-16T13:40:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.234+0000 7f91e659c700 1 -- 172.21.15.5:0/585215948 learned_addr learned my addr 172.21.15.5:0/585215948 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91e80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959593301 0 0) 0x7f91e815e7a0 con 0x7f91e815ab10 2023-10-16T13:40:09.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d40035b0 con 0x7f91e815ab10 2023-10-16T13:40:09.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348567805 0 0) 0x7f91e80b29a0 con 0x7f91e815f1f0 2023-10-16T13:40:09.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e815e7a0 con 0x7f91e815f1f0 2023-10-16T13:40:09.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115667952 0 0) 0x7f91d40035b0 con 0x7f91e815ab10 2023-10-16T13:40:09.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 msgr2=0x7f91e80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:09.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91e80cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 >> v1:172.21.15.112:6789/0 conn(0x7f91e815f1f0 legacy=0x7f91e80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e815e9f0 con 0x7f91e815ab10 2023-10-16T13:40:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f91d8001670 con 0x7f91e815ab10 2023-10-16T13:40:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 >> v1:172.21.15.5:6789/0 conn(0x7f91e815ab10 legacy=0x7f91e80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d4003bc0 0x7f91d4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4004d90 0x7f91d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80b2c80 con 0x7f91d4004d90 2023-10-16T13:40:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400baf0 con 0x7f91d4003bc0 2023-10-16T13:40:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400bcb0 con 0x7f91e80cfe30 2023-10-16T13:40:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4004d90 0x7f91d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e659c700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d4003bc0 0x7f91d4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e5d9b700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 -- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 msgr2=0x7f91d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 -- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d4003bc0 msgr2=0x7f91d4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91d4003bc0 0x7f91d4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e6d9d700 1 -- 172.21.15.5:0/585215948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40035b0 con 0x7f91d4004d90 2023-10-16T13:40:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.235+0000 7f91e5d9b700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91e80cfe30 0x7f91d4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91e6d9d700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4004d90 0x7f91d4005210 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f91e80d0400 tx=0x7f91d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acac1816fa1579f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0010ee0 con 0x7f91d4004d90 2023-10-16T13:40:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0003a20 con 0x7f91d4004d90 2023-10-16T13:40:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91e559a700 1 -- 172.21.15.5:0/585215948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0003dd0 con 0x7f91d4004d90 2023-10-16T13:40:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91ecbc6700 1 -- 172.21.15.5:0/585215948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4004d90 msgr2=0x7f91d4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/585215948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4004d90 0x7f91d4005210 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f91e80d0400 tx=0x7f91d4005880 comp rx=0 tx=0).stop 2023-10-16T13:40:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91e6d9d700 1 -- 172.21.15.5:0/585215948 reap_dead start 2023-10-16T13:40:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91ecbc6700 1 -- 172.21.15.5:0/585215948 shutdown_connections 2023-10-16T13:40:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91ecbc6700 1 -- 172.21.15.5:0/585215948 >> 172.21.15.5:0/585215948 conn(0x7f91e806dae0 msgr2=0x7f91e806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91ecbc6700 1 -- 172.21.15.5:0/585215948 shutdown_connections 2023-10-16T13:40:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.236+0000 7f91ecbc6700 1 -- 172.21.15.5:0/585215948 wait complete. 2023-10-16T13:40:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.238+0000 7f91ecbc6700 1 Processor -- start 2023-10-16T13:40:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.238+0000 7f91ecbc6700 1 -- start start 2023-10-16T13:40:09.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91d4004d90 0x7f91e81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 0x7f91e8157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91e815aef0 0x7f91e815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81583e0 con 0x7f91e8157a20 2023-10-16T13:40:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815b8b0 con 0x7f91e815aef0 2023-10-16T13:40:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80c8a50 con 0x7f91d4004d90 2023-10-16T13:40:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 0x7f91e8157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 0x7f91e8157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44938/0 (socket says 172.21.15.5:44938) 2023-10-16T13:40:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 -- 172.21.15.5:0/2928603567 learned_addr learned my addr 172.21.15.5:0/2928603567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e659c700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91d4004d90 0x7f91e81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e6d9d700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91e815aef0 0x7f91e815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 -- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91d4004d90 msgr2=0x7f91e81549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91d4004d90 0x7f91e81549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 -- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91e815aef0 msgr2=0x7f91e815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91e815aef0 0x7f91e815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 -- 172.21.15.5:0/2928603567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80b0f70 con 0x7f91e8157a20 2023-10-16T13:40:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91e5d9b700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 0x7f91e8157ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f91d000e7b0 tx=0x7f91d000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00052e0 con 0x7f91e8157a20 2023-10-16T13:40:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0005440 con 0x7f91e8157a20 2023-10-16T13:40:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e815bad0 con 0x7f91e8157a20 2023-10-16T13:40:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0003910 con 0x7f91e8157a20 2023-10-16T13:40:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.239+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e815c090 con 0x7f91e8157a20 2023-10-16T13:40:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.240+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e80c8c30 con 0x7f91e8157a20 2023-10-16T13:40:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.241+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f91d0003a70 con 0x7f91e8157a20 2023-10-16T13:40:09.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.242+0000 7f91deffd700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f91c806af00 0x7f91c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:09.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.242+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91d0088d00 con 0x7f91e8157a20 2023-10-16T13:40:09.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.242+0000 7f91e659c700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f91c806af00 0x7f91c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:09.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.242+0000 7f91e659c700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f91c806af00 0x7f91c806d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001b80 tx=0x7f91d8001a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:09.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.246+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91e80c8c30 con 0x7f91e8157a20 2023-10-16T13:40:09.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.441+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91e815f6a0 con 0x7f91c806af00 2023-10-16T13:40:09.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.450+0000 7f91deffd700 1 -- 172.21.15.5:0/2928603567 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284215 (secure 0 0 0) 0x7f91d80070c0 con 0x7f91c806af00 2023-10-16T13:40:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:09.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f91c806af00 msgr2=0x7f91c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f91c806af00 0x7f91c806d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001b80 tx=0x7f91d8001a30 comp rx=0 tx=0).stop 2023-10-16T13:40:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 msgr2=0x7f91e8157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 0x7f91e8157ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f91d000e7b0 tx=0x7f91d000eac0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 shutdown_connections 2023-10-16T13:40:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91e815aef0 0x7f91e815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f91c806af00 0x7f91c806d3c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91d4004d90 0x7f91e81549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 --2- 172.21.15.5:0/2928603567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e8157a20 0x7f91e8157ea0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 >> 172.21.15.5:0/2928603567 conn(0x7f91e806dae0 msgr2=0x7f91e80b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 shutdown_connections 2023-10-16T13:40:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:09.453+0000 7f91ecbc6700 1 -- 172.21.15.5:0/2928603567 wait complete. 2023-10-16T13:40:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:09.467 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-16T13:40:07.483062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221908,"kb_used_data":5716,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752812,"statfs":{"total":773094113280,"available":772866879488,"internally_reserved":0,"allocated":5853184,"data_stored":3147111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.840428"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652350+0000","last_change":"2023-10-16T13:40:02.652350+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652350+0000","last_undegraded":"2023-10-16T13:40:02.652350+0000","last_fullsized":"2023-10-16T13:40:02.652350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658053+0000","last_change":"2023-10-16T13:40:02.658053+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658053+0000","last_undegraded":"2023-10-16T13:40:02.658053+0000","last_fullsized":"2023-10-16T13:40:02.658053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657955+0000","last_change":"2023-10-16T13:40:02.657955+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657955+0000","last_undegraded":"2023-10-16T13:40:02.657955+0000","last_fullsized":"2023-10-16T13:40:02.657955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647013+0000","last_change":"2023-10-16T13:40:02.647013+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647013+0000","last_undegraded":"2023-10-16T13:40:02.647013+0000","last_fullsized":"2023-10-16T13:40:02.647013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649569+0000","last_change":"2023-10-16T13:40:02.649569+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649569+0000","last_undegraded":"2023-10-16T13:40:02.649569+0000","last_fullsized":"2023-10-16T13:40:02.649569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651902+0000","last_change":"2023-10-16T13:40:02.651902+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651902+0000","last_undegraded":"2023-10-16T13:40:02.651902+0000","last_fullsized":"2023-10-16T13:40:02.651902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649878+0000","last_change":"2023-10-16T13:40:02.649878+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649878+0000","last_undegraded":"2023-10-16T13:40:02.649878+0000","last_fullsized":"2023-10-16T13:40:02.649878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660006+0000","last_change":"2023-10-16T13:40:02.660006+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660006+0000","last_undegraded":"2023-10-16T13:40:02.660006+0000","last_fullsized":"2023-10-16T13:40:02.660006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649674+0000","last_change":"2023-10-16T13:40:02.649674+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649674+0000","last_undegraded":"2023-10-16T13:40:02.649674+0000","last_fullsized":"2023-10-16T13:40:02.649674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647653+0000","last_change":"2023-10-16T13:40:02.647653+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647653+0000","last_undegraded":"2023-10-16T13:40:02.647653+0000","last_fullsized":"2023-10-16T13:40:02.647653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647996+0000","last_change":"2023-10-16T13:40:02.647996+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647996+0000","last_undegraded":"2023-10-16T13:40:02.647996+0000","last_fullsized":"2023-10-16T13:40:02.647996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646494+0000","last_change":"2023-10-16T13:40:02.646494+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646494+0000","last_undegraded":"2023-10-16T13:40:02.646494+0000","last_fullsized":"2023-10-16T13:40:02.646494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650532+0000","last_change":"2023-10-16T13:40:02.650532+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650532+0000","last_undegraded":"2023-10-16T13:40:02.650532+0000","last_fullsized":"2023-10-16T13:40:02.650532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649997+0000","last_change":"2023-10-16T13:40:02.649997+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649997+0000","last_undegraded":"2023-10-16T13:40:02.649997+0000","last_fullsized":"2023-10-16T13:40:02.649997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649396+0000","last_change":"2023-10-16T13:40:02.649396+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649396+0000","last_undegraded":"2023-10-16T13:40:02.649396+0000","last_fullsized":"2023-10-16T13:40:02.649396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651560+0000","last_change":"2023-10-16T13:40:02.651560+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651560+0000","last_undegraded":"2023-10-16T13:40:02.651560+0000","last_fullsized":"2023-10-16T13:40:02.651560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658186+0000","last_change":"2023-10-16T13:40:02.658186+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658186+0000","last_undegraded":"2023-10-16T13:40:02.658186+0000","last_fullsized":"2023-10-16T13:40:02.658186+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655939+0000","last_change":"2023-10-16T13:40:02.655939+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655939+0000","last_undegraded":"2023-10-16T13:40:02.655939+0000","last_fullsized":"2023-10-16T13:40:02.655939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648803+0000","last_change":"2023-10-16T13:40:02.648803+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648803+0000","last_undegraded":"2023-10-16T13:40:02.648803+0000","last_fullsized":"2023-10-16T13:40:02.648803+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657721+0000","last_change":"2023-10-16T13:40:02.657721+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657721+0000","last_undegraded":"2023-10-16T13:40:02.657721+0000","last_fullsized":"2023-10-16T13:40:02.657721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654720+0000","last_change":"2023-10-16T13:40:02.654720+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654720+0000","last_undegraded":"2023-10-16T13:40:02.654720+0000","last_fullsized":"2023-10-16T13:40:02.654720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649790+0000","last_change":"2023-10-16T13:40:02.649790+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649790+0000","last_undegraded":"2023-10-16T13:40:02.649790+0000","last_fullsized":"2023-10-16T13:40:02.649790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.656662+0000","last_change":"2023-10-16T13:40:02.656662+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.656662+0000","last_undegraded":"2023-10-16T13:40:02.656662+0000","last_fullsized":"2023-10-16T13:40:02.656662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651516+0000","last_change":"2023-10-16T13:40:02.651516+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651516+0000","last_undegraded":"2023-10-16T13:40:02.651516+0000","last_fullsized":"2023-10-16T13:40:02.651516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649215+0000","last_change":"2023-10-16T13:40:02.649215+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649215+0000","last_undegraded":"2023-10-16T13:40:02.649215+0000","last_fullsized":"2023-10-16T13:40:02.649215+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646953+0000","last_change":"2023-10-16T13:40:02.646953+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646953+0000","last_undegraded":"2023-10-16T13:40:02.646953+0000","last_fullsized":"2023-10-16T13:40:02.646953+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653875+0000","last_change":"2023-10-16T13:40:02.653875+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653875+0000","last_undegraded":"2023-10-16T13:40:02.653875+0000","last_fullsized":"2023-10-16T13:40:02.653875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649033+0000","last_change":"2023-10-16T13:40:02.649033+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649033+0000","last_undegraded":"2023-10-16T13:40:02.649033+0000","last_fullsized":"2023-10-16T13:40:02.649033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.660059+0000","last_change":"2023-10-16T13:40:02.660059+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.660059+0000","last_undegraded":"2023-10-16T13:40:02.660059+0000","last_fullsized":"2023-10-16T13:40:02.660059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654174+0000","last_change":"2023-10-16T13:40:02.654174+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654174+0000","last_undegraded":"2023-10-16T13:40:02.654174+0000","last_fullsized":"2023-10-16T13:40:02.654174+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649183+0000","last_change":"2023-10-16T13:40:02.649183+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649183+0000","last_undegraded":"2023-10-16T13:40:02.649183+0000","last_fullsized":"2023-10-16T13:40:02.649183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653815+0000","last_change":"2023-10-16T13:40:02.653815+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653815+0000","last_undegraded":"2023-10-16T13:40:02.653815+0000","last_fullsized":"2023-10-16T13:40:02.653815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653274+0000","last_change":"2023-10-16T13:40:02.653274+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653274+0000","last_undegraded":"2023-10-16T13:40:02.653274+0000","last_fullsized":"2023-10-16T13:40:02.653274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664926+0000","last_change":"2023-10-16T13:40:02.660186+0000","last_active":"2023-10-16T13:40:02.664926+0000","last_peered":"2023-10-16T13:40:02.664926+0000","last_clean":"2023-10-16T13:40:02.664926+0000","last_became_active":"2023-10-16T13:40:02.659896+0000","last_became_peered":"2023-10-16T13:40:02.659896+0000","last_unstale":"2023-10-16T13:40:02.664926+0000","last_undegraded":"2023-10-16T13:40:02.664926+0000","last_fullsized":"2023-10-16T13:40:02.664926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647495+0000","last_change":"2023-10-16T13:40:02.647495+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647495+0000","last_undegraded":"2023-10-16T13:40:02.647495+0000","last_fullsized":"2023-10-16T13:40:02.647495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668203+0000","last_change":"2023-10-16T13:40:02.666794+0000","last_active":"2023-10-16T13:40:02.668203+0000","last_peered":"2023-10-16T13:40:02.668203+0000","last_clean":"2023-10-16T13:40:02.668203+0000","last_became_active":"2023-10-16T13:40:02.666442+0000","last_became_peered":"2023-10-16T13:40:02.666442+0000","last_unstale":"2023-10-16T13:40:02.668203+0000","last_undegraded":"2023-10-16T13:40:02.668203+0000","last_fullsized":"2023-10-16T13:40:02.668203+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:56.624959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650911+0000","last_change":"2023-10-16T13:40:02.650911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650911+0000","last_undegraded":"2023-10-16T13:40:02.650911+0000","last_fullsized":"2023-10-16T13:40:02.650911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659218+0000","last_change":"2023-10-16T13:40:02.657293+0000","last_active":"2023-10-16T13:40:02.659218+0000","last_peered":"2023-10-16T13:40:02.659218+0000","last_clean":"2023-10-16T13:40:02.659218+0000","last_became_active":"2023-10-16T13:40:02.657011+0000","last_became_peered":"2023-10-16T13:40:02.657011+0000","last_unstale":"2023-10-16T13:40:02.659218+0000","last_undegraded":"2023-10-16T13:40:02.659218+0000","last_fullsized":"2023-10-16T13:40:02.659218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653377+0000","last_change":"2023-10-16T13:40:02.653377+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653377+0000","last_undegraded":"2023-10-16T13:40:02.653377+0000","last_fullsized":"2023-10-16T13:40:02.653377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664604+0000","last_change":"2023-10-16T13:40:02.662600+0000","last_active":"2023-10-16T13:40:02.664604+0000","last_peered":"2023-10-16T13:40:02.664604+0000","last_clean":"2023-10-16T13:40:02.664604+0000","last_became_active":"2023-10-16T13:40:02.662253+0000","last_became_peered":"2023-10-16T13:40:02.662253+0000","last_unstale":"2023-10-16T13:40:02.664604+0000","last_undegraded":"2023-10-16T13:40:02.664604+0000","last_fullsized":"2023-10-16T13:40:02.664604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:16:57.664802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649328+0000","last_change":"2023-10-16T13:40:02.649328+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649328+0000","last_undegraded":"2023-10-16T13:40:02.649328+0000","last_fullsized":"2023-10-16T13:40:02.649328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662839+0000","last_change":"2023-10-16T13:40:02.658317+0000","last_active":"2023-10-16T13:40:02.662839+0000","last_peered":"2023-10-16T13:40:02.662839+0000","last_clean":"2023-10-16T13:40:02.662839+0000","last_became_active":"2023-10-16T13:40:02.658043+0000","last_became_peered":"2023-10-16T13:40:02.658043+0000","last_unstale":"2023-10-16T13:40:02.662839+0000","last_undegraded":"2023-10-16T13:40:02.662839+0000","last_fullsized":"2023-10-16T13:40:02.662839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650172+0000","last_change":"2023-10-16T13:40:02.650172+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650172+0000","last_undegraded":"2023-10-16T13:40:02.650172+0000","last_fullsized":"2023-10-16T13:40:02.650172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664918+0000","last_change":"2023-10-16T13:40:02.661653+0000","last_active":"2023-10-16T13:40:02.664918+0000","last_peered":"2023-10-16T13:40:02.664918+0000","last_clean":"2023-10-16T13:40:02.664918+0000","last_became_active":"2023-10-16T13:40:02.661255+0000","last_became_peered":"2023-10-16T13:40:02.661255+0000","last_unstale":"2023-10-16T13:40:02.664918+0000","last_undegraded":"2023-10-16T13:40:02.664918+0000","last_fullsized":"2023-10-16T13:40:02.664918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.650235+0000","last_change":"2023-10-16T13:40:02.650235+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.650235+0000","last_undegraded":"2023-10-16T13:40:02.650235+0000","last_fullsized":"2023-10-16T13:40:02.650235+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657719+0000","last_change":"2023-10-16T13:40:02.654143+0000","last_active":"2023-10-16T13:40:02.657719+0000","last_peered":"2023-10-16T13:40:02.657719+0000","last_clean":"2023-10-16T13:40:02.657719+0000","last_became_active":"2023-10-16T13:40:02.653839+0000","last_became_peered":"2023-10-16T13:40:02.653839+0000","last_unstale":"2023-10-16T13:40:02.657719+0000","last_undegraded":"2023-10-16T13:40:02.657719+0000","last_fullsized":"2023-10-16T13:40:02.657719+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.658466+0000","last_change":"2023-10-16T13:40:02.658466+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.658466+0000","last_undegraded":"2023-10-16T13:40:02.658466+0000","last_fullsized":"2023-10-16T13:40:02.658466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668351+0000","last_change":"2023-10-16T13:40:02.667918+0000","last_active":"2023-10-16T13:40:02.668351+0000","last_peered":"2023-10-16T13:40:02.668351+0000","last_clean":"2023-10-16T13:40:02.668351+0000","last_became_active":"2023-10-16T13:40:02.667614+0000","last_became_peered":"2023-10-16T13:40:02.667614+0000","last_unstale":"2023-10-16T13:40:02.668351+0000","last_undegraded":"2023-10-16T13:40:02.668351+0000","last_fullsized":"2023-10-16T13:40:02.668351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648744+0000","last_change":"2023-10-16T13:40:02.648744+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648744+0000","last_undegraded":"2023-10-16T13:40:02.648744+0000","last_fullsized":"2023-10-16T13:40:02.648744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.666729+0000","last_change":"2023-10-16T13:40:02.665632+0000","last_active":"2023-10-16T13:40:02.666729+0000","last_peered":"2023-10-16T13:40:02.666729+0000","last_clean":"2023-10-16T13:40:02.666729+0000","last_became_active":"2023-10-16T13:40:02.665364+0000","last_became_peered":"2023-10-16T13:40:02.665364+0000","last_unstale":"2023-10-16T13:40:02.666729+0000","last_undegraded":"2023-10-16T13:40:02.666729+0000","last_fullsized":"2023-10-16T13:40:02.666729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:42.515990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654385+0000","last_change":"2023-10-16T13:40:02.654385+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654385+0000","last_undegraded":"2023-10-16T13:40:02.654385+0000","last_fullsized":"2023-10-16T13:40:02.654385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667496+0000","last_change":"2023-10-16T13:40:02.663678+0000","last_active":"2023-10-16T13:40:02.667496+0000","last_peered":"2023-10-16T13:40:02.667496+0000","last_clean":"2023-10-16T13:40:02.667496+0000","last_became_active":"2023-10-16T13:40:02.663346+0000","last_became_peered":"2023-10-16T13:40:02.663346+0000","last_unstale":"2023-10-16T13:40:02.667496+0000","last_undegraded":"2023-10-16T13:40:02.667496+0000","last_fullsized":"2023-10-16T13:40:02.667496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:11:41.509831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647474+0000","last_change":"2023-10-16T13:40:02.647474+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647474+0000","last_undegraded":"2023-10-16T13:40:02.647474+0000","last_fullsized":"2023-10-16T13:40:02.647474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668429+0000","last_change":"2023-10-16T13:40:02.666624+0000","last_active":"2023-10-16T13:40:02.668429+0000","last_peered":"2023-10-16T13:40:02.668429+0000","last_clean":"2023-10-16T13:40:02.668429+0000","last_became_active":"2023-10-16T13:40:02.666354+0000","last_became_peered":"2023-10-16T13:40:02.666354+0000","last_unstale":"2023-10-16T13:40:02.668429+0000","last_undegraded":"2023-10-16T13:40:02.668429+0000","last_fullsized":"2023-10-16T13:40:02.668429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:48.340218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657529+0000","last_change":"2023-10-16T13:40:02.657529+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657529+0000","last_undegraded":"2023-10-16T13:40:02.657529+0000","last_fullsized":"2023-10-16T13:40:02.657529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662286+0000","last_change":"2023-10-16T13:40:02.660676+0000","last_active":"2023-10-16T13:40:02.662286+0000","last_peered":"2023-10-16T13:40:02.662286+0000","last_clean":"2023-10-16T13:40:02.662286+0000","last_became_active":"2023-10-16T13:40:02.659992+0000","last_became_peered":"2023-10-16T13:40:02.659992+0000","last_unstale":"2023-10-16T13:40:02.662286+0000","last_undegraded":"2023-10-16T13:40:02.662286+0000","last_fullsized":"2023-10-16T13:40:02.662286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646232+0000","last_change":"2023-10-16T13:40:02.646232+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646232+0000","last_undegraded":"2023-10-16T13:40:02.646232+0000","last_fullsized":"2023-10-16T13:40:02.646232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668041+0000","last_change":"2023-10-16T13:40:02.664721+0000","last_active":"2023-10-16T13:40:02.668041+0000","last_peered":"2023-10-16T13:40:02.668041+0000","last_clean":"2023-10-16T13:40:02.668041+0000","last_became_active":"2023-10-16T13:40:02.664294+0000","last_became_peered":"2023-10-16T13:40:02.664294+0000","last_unstale":"2023-10-16T13:40:02.668041+0000","last_undegraded":"2023-10-16T13:40:02.668041+0000","last_fullsized":"2023-10-16T13:40:02.668041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:18.414495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654079+0000","last_change":"2023-10-16T13:40:02.654079+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654079+0000","last_undegraded":"2023-10-16T13:40:02.654079+0000","last_fullsized":"2023-10-16T13:40:02.654079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664346+0000","last_change":"2023-10-16T13:40:02.661169+0000","last_active":"2023-10-16T13:40:02.664346+0000","last_peered":"2023-10-16T13:40:02.664346+0000","last_clean":"2023-10-16T13:40:02.664346+0000","last_became_active":"2023-10-16T13:40:02.660689+0000","last_became_peered":"2023-10-16T13:40:02.660689+0000","last_unstale":"2023-10-16T13:40:02.664346+0000","last_undegraded":"2023-10-16T13:40:02.664346+0000","last_fullsized":"2023-10-16T13:40:02.664346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:46:07.468974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649481+0000","last_change":"2023-10-16T13:40:02.649481+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649481+0000","last_undegraded":"2023-10-16T13:40:02.649481+0000","last_fullsized":"2023-10-16T13:40:02.649481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664614+0000","last_change":"2023-10-16T13:40:02.662603+0000","last_active":"2023-10-16T13:40:02.664614+0000","last_peered":"2023-10-16T13:40:02.664614+0000","last_clean":"2023-10-16T13:40:02.664614+0000","last_became_active":"2023-10-16T13:40:02.662287+0000","last_became_peered":"2023-10-16T13:40:02.662287+0000","last_unstale":"2023-10-16T13:40:02.664614+0000","last_undegraded":"2023-10-16T13:40:02.664614+0000","last_fullsized":"2023-10-16T13:40:02.664614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:49.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655877+0000","last_change":"2023-10-16T13:40:02.655877+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655877+0000","last_undegraded":"2023-10-16T13:40:02.655877+0000","last_fullsized":"2023-10-16T13:40:02.655877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663364+0000","last_change":"2023-10-16T13:40:02.660270+0000","last_active":"2023-10-16T13:40:02.663364+0000","last_peered":"2023-10-16T13:40:02.663364+0000","last_clean":"2023-10-16T13:40:02.663364+0000","last_became_active":"2023-10-16T13:40:02.659826+0000","last_became_peered":"2023-10-16T13:40:02.659826+0000","last_unstale":"2023-10-16T13:40:02.663364+0000","last_undegraded":"2023-10-16T13:40:02.663364+0000","last_fullsized":"2023-10-16T13:40:02.663364+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:47.920849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.655354+0000","last_change":"2023-10-16T13:40:02.655354+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.655354+0000","last_undegraded":"2023-10-16T13:40:02.655354+0000","last_fullsized":"2023-10-16T13:40:02.655354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668126+0000","last_change":"2023-10-16T13:40:02.666774+0000","last_active":"2023-10-16T13:40:02.668126+0000","last_peered":"2023-10-16T13:40:02.668126+0000","last_clean":"2023-10-16T13:40:02.668126+0000","last_became_active":"2023-10-16T13:40:02.666419+0000","last_became_peered":"2023-10-16T13:40:02.666419+0000","last_unstale":"2023-10-16T13:40:02.668126+0000","last_undegraded":"2023-10-16T13:40:02.668126+0000","last_fullsized":"2023-10-16T13:40:02.668126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:29.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646813+0000","last_change":"2023-10-16T13:40:02.646813+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646813+0000","last_undegraded":"2023-10-16T13:40:02.646813+0000","last_fullsized":"2023-10-16T13:40:02.646813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664840+0000","last_change":"2023-10-16T13:40:02.660792+0000","last_active":"2023-10-16T13:40:02.664840+0000","last_peered":"2023-10-16T13:40:02.664840+0000","last_clean":"2023-10-16T13:40:02.664840+0000","last_became_active":"2023-10-16T13:40:02.659728+0000","last_became_peered":"2023-10-16T13:40:02.659728+0000","last_unstale":"2023-10-16T13:40:02.664840+0000","last_undegraded":"2023-10-16T13:40:02.664840+0000","last_fullsized":"2023-10-16T13:40:02.664840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657214+0000","last_change":"2023-10-16T13:40:02.657214+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657214+0000","last_undegraded":"2023-10-16T13:40:02.657214+0000","last_fullsized":"2023-10-16T13:40:02.657214+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664644+0000","last_change":"2023-10-16T13:40:02.662725+0000","last_active":"2023-10-16T13:40:02.664644+0000","last_peered":"2023-10-16T13:40:02.664644+0000","last_clean":"2023-10-16T13:40:02.664644+0000","last_became_active":"2023-10-16T13:40:02.662395+0000","last_became_peered":"2023-10-16T13:40:02.662395+0000","last_unstale":"2023-10-16T13:40:02.664644+0000","last_undegraded":"2023-10-16T13:40:02.664644+0000","last_fullsized":"2023-10-16T13:40:02.664644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:09:49.177471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.657070+0000","last_change":"2023-10-16T13:40:02.657070+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.657070+0000","last_undegraded":"2023-10-16T13:40:02.657070+0000","last_fullsized":"2023-10-16T13:40:02.657070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.668431+0000","last_change":"2023-10-16T13:40:02.666967+0000","last_active":"2023-10-16T13:40:02.668431+0000","last_peered":"2023-10-16T13:40:02.668431+0000","last_clean":"2023-10-16T13:40:02.668431+0000","last_became_active":"2023-10-16T13:40:02.666653+0000","last_became_peered":"2023-10-16T13:40:02.666653+0000","last_unstale":"2023-10-16T13:40:02.668431+0000","last_undegraded":"2023-10-16T13:40:02.668431+0000","last_fullsized":"2023-10-16T13:40:02.668431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:57:23.312563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.645606+0000","last_change":"2023-10-16T13:40:02.645606+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.645606+0000","last_undegraded":"2023-10-16T13:40:02.645606+0000","last_fullsized":"2023-10-16T13:40:02.645606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667402+0000","last_change":"2023-10-16T13:40:02.664562+0000","last_active":"2023-10-16T13:40:02.667402+0000","last_peered":"2023-10-16T13:40:02.667402+0000","last_clean":"2023-10-16T13:40:02.667402+0000","last_became_active":"2023-10-16T13:40:02.664036+0000","last_became_peered":"2023-10-16T13:40:02.664036+0000","last_unstale":"2023-10-16T13:40:02.667402+0000","last_undegraded":"2023-10-16T13:40:02.667402+0000","last_fullsized":"2023-10-16T13:40:02.667402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:04.729894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.651226+0000","last_change":"2023-10-16T13:40:02.651226+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.651226+0000","last_undegraded":"2023-10-16T13:40:02.651226+0000","last_fullsized":"2023-10-16T13:40:02.651226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.657892+0000","last_change":"2023-10-16T13:40:02.656748+0000","last_active":"2023-10-16T13:40:02.657892+0000","last_peered":"2023-10-16T13:40:02.657892+0000","last_clean":"2023-10-16T13:40:02.657892+0000","last_became_active":"2023-10-16T13:40:02.656407+0000","last_became_peered":"2023-10-16T13:40:02.656407+0000","last_unstale":"2023-10-16T13:40:02.657892+0000","last_undegraded":"2023-10-16T13:40:02.657892+0000","last_fullsized":"2023-10-16T13:40:02.657892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:33:31.641363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.654072+0000","last_change":"2023-10-16T13:40:02.654072+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.654072+0000","last_undegraded":"2023-10-16T13:40:02.654072+0000","last_fullsized":"2023-10-16T13:40:02.654072+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.665424+0000","last_change":"2023-10-16T13:40:02.664585+0000","last_active":"2023-10-16T13:40:02.665424+0000","last_peered":"2023-10-16T13:40:02.665424+0000","last_clean":"2023-10-16T13:40:02.665424+0000","last_became_active":"2023-10-16T13:40:02.664322+0000","last_became_peered":"2023-10-16T13:40:02.664322+0000","last_unstale":"2023-10-16T13:40:02.665424+0000","last_undegraded":"2023-10-16T13:40:02.665424+0000","last_fullsized":"2023-10-16T13:40:02.665424+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646115+0000","last_change":"2023-10-16T13:40:02.646115+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646115+0000","last_undegraded":"2023-10-16T13:40:02.646115+0000","last_fullsized":"2023-10-16T13:40:02.646115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.669069+0000","last_change":"2023-10-16T13:40:02.668493+0000","last_active":"2023-10-16T13:40:02.669069+0000","last_peered":"2023-10-16T13:40:02.669069+0000","last_clean":"2023-10-16T13:40:02.669069+0000","last_became_active":"2023-10-16T13:40:02.668204+0000","last_became_peered":"2023-10-16T13:40:02.668204+0000","last_unstale":"2023-10-16T13:40:02.669069+0000","last_undegraded":"2023-10-16T13:40:02.669069+0000","last_fullsized":"2023-10-16T13:40:02.669069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:02:07.224716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.647329+0000","last_change":"2023-10-16T13:40:02.647329+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.647329+0000","last_undegraded":"2023-10-16T13:40:02.647329+0000","last_fullsized":"2023-10-16T13:40:02.647329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.659073+0000","last_change":"2023-10-16T13:40:02.656852+0000","last_active":"2023-10-16T13:40:02.659073+0000","last_peered":"2023-10-16T13:40:02.659073+0000","last_clean":"2023-10-16T13:40:02.659073+0000","last_became_active":"2023-10-16T13:40:02.656565+0000","last_became_peered":"2023-10-16T13:40:02.656565+0000","last_unstale":"2023-10-16T13:40:02.659073+0000","last_undegraded":"2023-10-16T13:40:02.659073+0000","last_fullsized":"2023-10-16T13:40:02.659073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646911+0000","last_change":"2023-10-16T13:40:02.646911+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646911+0000","last_undegraded":"2023-10-16T13:40:02.646911+0000","last_fullsized":"2023-10-16T13:40:02.646911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.658832+0000","last_change":"2023-10-16T13:40:02.656866+0000","last_active":"2023-10-16T13:40:02.658832+0000","last_peered":"2023-10-16T13:40:02.658832+0000","last_clean":"2023-10-16T13:40:02.658832+0000","last_became_active":"2023-10-16T13:40:02.656586+0000","last_became_peered":"2023-10-16T13:40:02.656586+0000","last_unstale":"2023-10-16T13:40:02.658832+0000","last_undegraded":"2023-10-16T13:40:02.658832+0000","last_fullsized":"2023-10-16T13:40:02.658832+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:42:41.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.652823+0000","last_change":"2023-10-16T13:40:02.652823+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.652823+0000","last_undegraded":"2023-10-16T13:40:02.652823+0000","last_fullsized":"2023-10-16T13:40:02.652823+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.656462+0000","last_change":"2023-10-16T13:40:02.653438+0000","last_active":"2023-10-16T13:40:02.656462+0000","last_peered":"2023-10-16T13:40:02.656462+0000","last_clean":"2023-10-16T13:40:02.656462+0000","last_became_active":"2023-10-16T13:40:02.653107+0000","last_became_peered":"2023-10-16T13:40:02.653107+0000","last_unstale":"2023-10-16T13:40:02.656462+0000","last_undegraded":"2023-10-16T13:40:02.656462+0000","last_fullsized":"2023-10-16T13:40:02.656462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648785+0000","last_change":"2023-10-16T13:40:02.648785+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648785+0000","last_undegraded":"2023-10-16T13:40:02.648785+0000","last_fullsized":"2023-10-16T13:40:02.648785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.652665+0000","last_change":"2023-10-16T13:40:02.650139+0000","last_active":"2023-10-16T13:40:02.652665+0000","last_peered":"2023-10-16T13:40:02.652665+0000","last_clean":"2023-10-16T13:40:02.652665+0000","last_became_active":"2023-10-16T13:40:02.649855+0000","last_became_peered":"2023-10-16T13:40:02.649855+0000","last_unstale":"2023-10-16T13:40:02.652665+0000","last_undegraded":"2023-10-16T13:40:02.652665+0000","last_fullsized":"2023-10-16T13:40:02.652665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:35.792091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.653555+0000","last_change":"2023-10-16T13:40:02.653555+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.653555+0000","last_undegraded":"2023-10-16T13:40:02.653555+0000","last_fullsized":"2023-10-16T13:40:02.653555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.662260+0000","last_change":"2023-10-16T13:40:02.660323+0000","last_active":"2023-10-16T13:40:02.662260+0000","last_peered":"2023-10-16T13:40:02.662260+0000","last_clean":"2023-10-16T13:40:02.662260+0000","last_became_active":"2023-10-16T13:40:02.660045+0000","last_became_peered":"2023-10-16T13:40:02.660045+0000","last_unstale":"2023-10-16T13:40:02.662260+0000","last_undegraded":"2023-10-16T13:40:02.662260+0000","last_fullsized":"2023-10-16T13:40:02.662260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:16.853893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.646925+0000","last_change":"2023-10-16T13:40:02.646925+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.646925+0000","last_undegraded":"2023-10-16T13:40:02.646925+0000","last_fullsized":"2023-10-16T13:40:02.646925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.664561+0000","last_change":"2023-10-16T13:40:02.659573+0000","last_active":"2023-10-16T13:40:02.664561+0000","last_peered":"2023-10-16T13:40:02.664561+0000","last_clean":"2023-10-16T13:40:02.664561+0000","last_became_active":"2023-10-16T13:40:02.659277+0000","last_became_peered":"2023-10-16T13:40:02.659277+0000","last_unstale":"2023-10-16T13:40:02.664561+0000","last_undegraded":"2023-10-16T13:40:02.664561+0000","last_fullsized":"2023-10-16T13:40:02.664561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:46.081444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.648713+0000","last_change":"2023-10-16T13:40:02.648713+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.648713+0000","last_undegraded":"2023-10-16T13:40:02.648713+0000","last_fullsized":"2023-10-16T13:40:02.648713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.667235+0000","last_change":"2023-10-16T13:40:02.663715+0000","last_active":"2023-10-16T13:40:02.667235+0000","last_peered":"2023-10-16T13:40:02.667235+0000","last_clean":"2023-10-16T13:40:02.667235+0000","last_became_active":"2023-10-16T13:40:02.663331+0000","last_became_peered":"2023-10-16T13:40:02.663331+0000","last_unstale":"2023-10-16T13:40:02.667235+0000","last_undegraded":"2023-10-16T13:40:02.667235+0000","last_fullsized":"2023-10-16T13:40:02.667235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:29.749990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-10-16T13:40:02.649233+0000","last_change":"2023-10-16T13:40:02.649233+0000","last_active":"2023-10-16T13:40:02.639394+0000","last_peered":"2023-10-16T13:40:02.639394+0000","last_clean":"2023-10-16T13:40:02.639394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:02.649233+0000","last_undegraded":"2023-10-16T13:40:02.649233+0000","last_fullsized":"2023-10-16T13:40:02.649233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-16T13:40:02.663222+0000","last_change":"2023-10-16T13:40:02.659715+0000","last_active":"2023-10-16T13:40:02.663222+0000","last_peered":"2023-10-16T13:40:02.663222+0000","last_clean":"2023-10-16T13:40:02.663222+0000","last_became_active":"2023-10-16T13:40:02.659427+0000","last_became_peered":"2023-10-16T13:40:02.659427+0000","last_unstale":"2023-10-16T13:40:02.663222+0000","last_undegraded":"2023-10-16T13:40:02.663222+0000","last_fullsized":"2023-10-16T13:40:02.663222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:55:14.871789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-16T13:40:01.648870+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:01.648870+0000","last_peered":"2023-10-16T13:40:01.648870+0000","last_clean":"2023-10-16T13:40:01.648870+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:01.648870+0000","last_undegraded":"2023-10-16T13:40:01.648870+0000","last_fullsized":"2023-10-16T13:40:01.648870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":837203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.373}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.76300000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58899999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.433},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":240568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.503},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.874}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.79600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":836184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.307},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.504}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":245816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.27600000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.25},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.314}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":246835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.33500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.624},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:09.638 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-10-16T13:40:09.635+0000 7f807df6a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:40:12.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:12.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.613+0000 7f31b3aea700 1 Processor -- start 2023-10-16T13:40:12.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.613+0000 7f31b3aea700 1 -- start start 2023-10-16T13:40:12.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b3aea700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 0x7f31ac15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:12.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b3aea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31ac0cfe30 0x7f31ac0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:12.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b3aea700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac15e7a0 con 0x7f31ac0b1f50 2023-10-16T13:40:12.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b3aea700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac15f730 con 0x7f31ac0cfe30 2023-10-16T13:40:12.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b3aea700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0b29a0 con 0x7f31ac15ab10 2023-10-16T13:40:12.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b1886700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 0x7f31ac15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:12.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b1886700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 0x7f31ac15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:42848/0 (socket says 172.21.15.5:42848) 2023-10-16T13:40:12.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b2087700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31ac0cfe30 0x7f31ac0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b1886700 1 -- 172.21.15.5:0/69817892 learned_addr learned my addr 172.21.15.5:0/69817892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b1886700 1 -- 172.21.15.5:0/69817892 >> v2:172.21.15.112:3300/0 conn(0x7f31ac0cfe30 msgr2=0x7f31ac0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b1886700 1 --2- 172.21.15.5:0/69817892 >> v2:172.21.15.112:3300/0 conn(0x7f31ac0cfe30 0x7f31ac0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.614+0000 7f31b1886700 1 -- 172.21.15.5:0/69817892 >> v1:172.21.15.112:6789/0 conn(0x7f31ac0b1f50 legacy=0x7f31ac0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b1886700 1 -- 172.21.15.5:0/69817892 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0b2c80 con 0x7f31ac15ab10 2023-10-16T13:40:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b1886700 1 --2- 172.21.15.5:0/69817892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 0x7f31ac15f1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31a800bb90 tx=0x7f31a800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7a36a59b4d396c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b0884700 1 -- 172.21.15.5:0/69817892 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a800dd30 con 0x7f31ac15ab10 2023-10-16T13:40:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b0884700 1 -- 172.21.15.5:0/69817892 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a800de90 con 0x7f31ac15ab10 2023-10-16T13:40:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b0884700 1 -- 172.21.15.5:0/69817892 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8010690 con 0x7f31ac15ab10 2023-10-16T13:40:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b3aea700 1 -- 172.21.15.5:0/69817892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 msgr2=0x7f31ac15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:12.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b3aea700 1 --2- 172.21.15.5:0/69817892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 0x7f31ac15f1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31a800bb90 tx=0x7f31a800bea0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b3aea700 1 -- 172.21.15.5:0/69817892 shutdown_connections 2023-10-16T13:40:12.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b3aea700 1 --2- 172.21.15.5:0/69817892 >> v2:172.21.15.112:3300/0 conn(0x7f31ac0cfe30 0x7f31ac0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b3aea700 1 --2- 172.21.15.5:0/69817892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac15ab10 0x7f31ac15f1f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.615+0000 7f31b3aea700 1 -- 172.21.15.5:0/69817892 >> 172.21.15.5:0/69817892 conn(0x7f31ac06dae0 msgr2=0x7f31ac06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:12.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.616+0000 7f31b3aea700 1 -- 172.21.15.5:0/69817892 shutdown_connections 2023-10-16T13:40:12.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.616+0000 7f31b3aea700 1 -- 172.21.15.5:0/69817892 wait complete. 2023-10-16T13:40:12.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.617+0000 7f31b3aea700 1 Processor -- start 2023-10-16T13:40:12.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.617+0000 7f31b3aea700 1 -- start start 2023-10-16T13:40:12.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.617+0000 7f31b3aea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac0b1f50 0x7f31ac1f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:12.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b3aea700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac0cfe30 0x7f31ac15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:12.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b3aea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 0x7f31ac155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:12.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b3aea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1f0440 con 0x7f31ac15ab10 2023-10-16T13:40:12.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b3aea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1f39e0 con 0x7f31ac0b1f50 2023-10-16T13:40:12.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b3aea700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac15dd20 con 0x7f31ac0cfe30 2023-10-16T13:40:12.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 0x7f31ac155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:12.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 0x7f31ac155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44954/0 (socket says 172.21.15.5:44954) 2023-10-16T13:40:12.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 -- 172.21.15.5:0/576443438 learned_addr learned my addr 172.21.15.5:0/576443438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:12.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b1886700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac0b1f50 0x7f31ac1f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:12.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b1085700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac0cfe30 0x7f31ac15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:12.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 -- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac0cfe30 msgr2=0x7f31ac15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:12.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac0cfe30 0x7f31ac15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 -- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac0b1f50 msgr2=0x7f31ac1f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:12.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac0b1f50 0x7f31ac1f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 -- 172.21.15.5:0/576443438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a800b7f0 con 0x7f31ac15ab10 2023-10-16T13:40:12.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b1886700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac0b1f50 0x7f31ac1f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:12.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b2087700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 0x7f31ac155d30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f31a400efc0 tx=0x7f31a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:12.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400cc90 con 0x7f31ac15ab10 2023-10-16T13:40:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400f040 con 0x7f31ac15ab10 2023-10-16T13:40:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4014480 con 0x7f31ac15ab10 2023-10-16T13:40:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.618+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac0b32d0 con 0x7f31ac15ab10 2023-10-16T13:40:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.619+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac1ef960 con 0x7f31ac15ab10 2023-10-16T13:40:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.619+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac067d20 con 0x7f31ac15ab10 2023-10-16T13:40:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.620+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f31a4014600 con 0x7f31ac15ab10 2023-10-16T13:40:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.620+0000 7f31a27fc700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f319006af00 0x7f319006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.620+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31a408a090 con 0x7f31ac15ab10 2023-10-16T13:40:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.621+0000 7f31b1886700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f319006af00 0x7f319006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.621+0000 7f31b1886700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f319006af00 0x7f319006d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31a800bee0 tx=0x7f31a8013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.625+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31a40551d0 con 0x7f31ac15ab10 2023-10-16T13:40:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.823+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31ac15ecd0 con 0x7f319006af00 2023-10-16T13:40:12.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.832+0000 7f31a27fc700 1 -- 172.21.15.5:0/576443438 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289457 (secure 0 0 0) 0x7f31a8020040 con 0x7f319006af00 2023-10-16T13:40:12.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f319006af00 msgr2=0x7f319006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f319006af00 0x7f319006d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31a800bee0 tx=0x7f31a8013000 comp rx=0 tx=0).stop 2023-10-16T13:40:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 msgr2=0x7f31ac155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 0x7f31ac155d30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f31a400efc0 tx=0x7f31a400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 shutdown_connections 2023-10-16T13:40:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ac15ab10 0x7f31ac155d30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac0b1f50 0x7f31ac1f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f319006af00 0x7f319006d3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 --2- 172.21.15.5:0/576443438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31ac0cfe30 0x7f31ac15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 >> 172.21.15.5:0/576443438 conn(0x7f31ac06dae0 msgr2=0x7f31ac0b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 shutdown_connections 2023-10-16T13:40:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:12.835+0000 7f31b3aea700 1 -- 172.21.15.5:0/576443438 wait complete. 2023-10-16T13:40:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:12.850 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-16T13:40:11.484202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222172,"kb_used_data":5984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752548,"statfs":{"total":773094113280,"available":772866609152,"internally_reserved":0,"allocated":6127616,"data_stored":3262798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002049"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660211+0000","last_change":"2023-10-16T13:40:03.680016+0000","last_active":"2023-10-16T13:40:04.660211+0000","last_peered":"2023-10-16T13:40:04.660211+0000","last_clean":"2023-10-16T13:40:04.660211+0000","last_became_active":"2023-10-16T13:40:03.679716+0000","last_became_peered":"2023-10-16T13:40:03.679716+0000","last_unstale":"2023-10-16T13:40:04.660211+0000","last_undegraded":"2023-10-16T13:40:04.660211+0000","last_fullsized":"2023-10-16T13:40:04.660211+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:54.305008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129511+0000","last_change":"2023-10-16T13:40:03.671372+0000","last_active":"2023-10-16T13:40:05.129511+0000","last_peered":"2023-10-16T13:40:05.129511+0000","last_clean":"2023-10-16T13:40:05.129511+0000","last_became_active":"2023-10-16T13:40:03.671089+0000","last_became_peered":"2023-10-16T13:40:03.671089+0000","last_unstale":"2023-10-16T13:40:05.129511+0000","last_undegraded":"2023-10-16T13:40:05.129511+0000","last_fullsized":"2023-10-16T13:40:05.129511+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:00.722148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130091+0000","last_change":"2023-10-16T13:40:03.669657+0000","last_active":"2023-10-16T13:40:05.130091+0000","last_peered":"2023-10-16T13:40:05.130091+0000","last_clean":"2023-10-16T13:40:05.130091+0000","last_became_active":"2023-10-16T13:40:03.669353+0000","last_became_peered":"2023-10-16T13:40:03.669353+0000","last_unstale":"2023-10-16T13:40:05.130091+0000","last_undegraded":"2023-10-16T13:40:05.130091+0000","last_fullsized":"2023-10-16T13:40:05.130091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:19.652625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.662158+0000","last_change":"2023-10-16T13:40:03.681033+0000","last_active":"2023-10-16T13:40:04.662158+0000","last_peered":"2023-10-16T13:40:04.662158+0000","last_clean":"2023-10-16T13:40:04.662158+0000","last_became_active":"2023-10-16T13:40:03.680658+0000","last_became_peered":"2023-10-16T13:40:03.680658+0000","last_unstale":"2023-10-16T13:40:04.662158+0000","last_undegraded":"2023-10-16T13:40:04.662158+0000","last_fullsized":"2023-10-16T13:40:04.662158+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:30.918986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660122+0000","last_change":"2023-10-16T13:40:03.674824+0000","last_active":"2023-10-16T13:40:04.660122+0000","last_peered":"2023-10-16T13:40:04.660122+0000","last_clean":"2023-10-16T13:40:04.660122+0000","last_became_active":"2023-10-16T13:40:03.674563+0000","last_became_peered":"2023-10-16T13:40:03.674563+0000","last_unstale":"2023-10-16T13:40:04.660122+0000","last_undegraded":"2023-10-16T13:40:04.660122+0000","last_fullsized":"2023-10-16T13:40:04.660122+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:02:24.642200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130184+0000","last_change":"2023-10-16T13:40:03.682520+0000","last_active":"2023-10-16T13:40:05.130184+0000","last_peered":"2023-10-16T13:40:05.130184+0000","last_clean":"2023-10-16T13:40:05.130184+0000","last_became_active":"2023-10-16T13:40:03.682209+0000","last_became_peered":"2023-10-16T13:40:03.682209+0000","last_unstale":"2023-10-16T13:40:05.130184+0000","last_undegraded":"2023-10-16T13:40:05.130184+0000","last_fullsized":"2023-10-16T13:40:05.130184+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:30.918986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660776+0000","last_change":"2023-10-16T13:40:03.673418+0000","last_active":"2023-10-16T13:40:04.660776+0000","last_peered":"2023-10-16T13:40:04.660776+0000","last_clean":"2023-10-16T13:40:04.660776+0000","last_became_active":"2023-10-16T13:40:03.671919+0000","last_became_peered":"2023-10-16T13:40:03.671919+0000","last_unstale":"2023-10-16T13:40:04.660776+0000","last_undegraded":"2023-10-16T13:40:04.660776+0000","last_fullsized":"2023-10-16T13:40:04.660776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:40.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129410+0000","last_change":"2023-10-16T13:40:03.670744+0000","last_active":"2023-10-16T13:40:05.129410+0000","last_peered":"2023-10-16T13:40:05.129410+0000","last_clean":"2023-10-16T13:40:05.129410+0000","last_became_active":"2023-10-16T13:40:03.670445+0000","last_became_peered":"2023-10-16T13:40:03.670445+0000","last_unstale":"2023-10-16T13:40:05.129410+0000","last_undegraded":"2023-10-16T13:40:05.129410+0000","last_fullsized":"2023-10-16T13:40:05.129410+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:52.460928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661192+0000","last_change":"2023-10-16T13:40:03.685175+0000","last_active":"2023-10-16T13:40:04.661192+0000","last_peered":"2023-10-16T13:40:04.661192+0000","last_clean":"2023-10-16T13:40:04.661192+0000","last_became_active":"2023-10-16T13:40:03.684832+0000","last_became_peered":"2023-10-16T13:40:03.684832+0000","last_unstale":"2023-10-16T13:40:04.661192+0000","last_undegraded":"2023-10-16T13:40:04.661192+0000","last_fullsized":"2023-10-16T13:40:04.661192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:05.220772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130136+0000","last_change":"2023-10-16T13:40:03.679268+0000","last_active":"2023-10-16T13:40:05.130136+0000","last_peered":"2023-10-16T13:40:05.130136+0000","last_clean":"2023-10-16T13:40:05.130136+0000","last_became_active":"2023-10-16T13:40:03.679004+0000","last_became_peered":"2023-10-16T13:40:03.679004+0000","last_unstale":"2023-10-16T13:40:05.130136+0000","last_undegraded":"2023-10-16T13:40:05.130136+0000","last_fullsized":"2023-10-16T13:40:05.130136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:43.519215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129917+0000","last_change":"2023-10-16T13:40:03.683278+0000","last_active":"2023-10-16T13:40:05.129917+0000","last_peered":"2023-10-16T13:40:05.129917+0000","last_clean":"2023-10-16T13:40:05.129917+0000","last_became_active":"2023-10-16T13:40:03.682668+0000","last_became_peered":"2023-10-16T13:40:03.682668+0000","last_unstale":"2023-10-16T13:40:05.129917+0000","last_undegraded":"2023-10-16T13:40:05.129917+0000","last_fullsized":"2023-10-16T13:40:05.129917+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:49.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.662305+0000","last_change":"2023-10-16T13:40:03.670876+0000","last_active":"2023-10-16T13:40:04.662305+0000","last_peered":"2023-10-16T13:40:04.662305+0000","last_clean":"2023-10-16T13:40:04.662305+0000","last_became_active":"2023-10-16T13:40:03.670611+0000","last_became_peered":"2023-10-16T13:40:03.670611+0000","last_unstale":"2023-10-16T13:40:04.662305+0000","last_undegraded":"2023-10-16T13:40:04.662305+0000","last_fullsized":"2023-10-16T13:40:04.662305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:56:53.959881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129861+0000","last_change":"2023-10-16T13:40:03.687012+0000","last_active":"2023-10-16T13:40:05.129861+0000","last_peered":"2023-10-16T13:40:05.129861+0000","last_clean":"2023-10-16T13:40:05.129861+0000","last_became_active":"2023-10-16T13:40:03.686702+0000","last_became_peered":"2023-10-16T13:40:03.686702+0000","last_unstale":"2023-10-16T13:40:05.129861+0000","last_undegraded":"2023-10-16T13:40:05.129861+0000","last_fullsized":"2023-10-16T13:40:05.129861+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:13:02.699351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661317+0000","last_change":"2023-10-16T13:40:03.681139+0000","last_active":"2023-10-16T13:40:04.661317+0000","last_peered":"2023-10-16T13:40:04.661317+0000","last_clean":"2023-10-16T13:40:04.661317+0000","last_became_active":"2023-10-16T13:40:03.680858+0000","last_became_peered":"2023-10-16T13:40:03.680858+0000","last_unstale":"2023-10-16T13:40:04.661317+0000","last_undegraded":"2023-10-16T13:40:04.661317+0000","last_fullsized":"2023-10-16T13:40:04.661317+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:05.673182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661423+0000","last_change":"2023-10-16T13:40:03.668461+0000","last_active":"2023-10-16T13:40:04.661423+0000","last_peered":"2023-10-16T13:40:04.661423+0000","last_clean":"2023-10-16T13:40:04.661423+0000","last_became_active":"2023-10-16T13:40:03.668154+0000","last_became_peered":"2023-10-16T13:40:03.668154+0000","last_unstale":"2023-10-16T13:40:04.661423+0000","last_undegraded":"2023-10-16T13:40:04.661423+0000","last_fullsized":"2023-10-16T13:40:04.661423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:11.192592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129730+0000","last_change":"2023-10-16T13:40:03.684588+0000","last_active":"2023-10-16T13:40:05.129730+0000","last_peered":"2023-10-16T13:40:05.129730+0000","last_clean":"2023-10-16T13:40:05.129730+0000","last_became_active":"2023-10-16T13:40:03.684266+0000","last_became_peered":"2023-10-16T13:40:03.684266+0000","last_unstale":"2023-10-16T13:40:05.129730+0000","last_undegraded":"2023-10-16T13:40:05.129730+0000","last_fullsized":"2023-10-16T13:40:05.129730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:57.628184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129733+0000","last_change":"2023-10-16T13:40:03.676489+0000","last_active":"2023-10-16T13:40:05.129733+0000","last_peered":"2023-10-16T13:40:05.129733+0000","last_clean":"2023-10-16T13:40:05.129733+0000","last_became_active":"2023-10-16T13:40:03.676011+0000","last_became_peered":"2023-10-16T13:40:03.676011+0000","last_unstale":"2023-10-16T13:40:05.129733+0000","last_undegraded":"2023-10-16T13:40:05.129733+0000","last_fullsized":"2023-10-16T13:40:05.129733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:29:28.835970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129878+0000","last_change":"2023-10-16T13:40:03.689869+0000","last_active":"2023-10-16T13:40:05.129878+0000","last_peered":"2023-10-16T13:40:05.129878+0000","last_clean":"2023-10-16T13:40:05.129878+0000","last_became_active":"2023-10-16T13:40:03.689537+0000","last_became_peered":"2023-10-16T13:40:03.689537+0000","last_unstale":"2023-10-16T13:40:05.129878+0000","last_undegraded":"2023-10-16T13:40:05.129878+0000","last_fullsized":"2023-10-16T13:40:05.129878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:49.651495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660288+0000","last_change":"2023-10-16T13:40:03.680331+0000","last_active":"2023-10-16T13:40:04.660288+0000","last_peered":"2023-10-16T13:40:04.660288+0000","last_clean":"2023-10-16T13:40:04.660288+0000","last_became_active":"2023-10-16T13:40:03.680046+0000","last_became_peered":"2023-10-16T13:40:03.680046+0000","last_unstale":"2023-10-16T13:40:04.660288+0000","last_undegraded":"2023-10-16T13:40:04.660288+0000","last_fullsized":"2023-10-16T13:40:04.660288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:12:55.873842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130425+0000","last_change":"2023-10-16T13:40:03.687492+0000","last_active":"2023-10-16T13:40:05.130425+0000","last_peered":"2023-10-16T13:40:05.130425+0000","last_clean":"2023-10-16T13:40:05.130425+0000","last_became_active":"2023-10-16T13:40:03.686519+0000","last_became_peered":"2023-10-16T13:40:03.686519+0000","last_unstale":"2023-10-16T13:40:05.130425+0000","last_undegraded":"2023-10-16T13:40:05.130425+0000","last_fullsized":"2023-10-16T13:40:05.130425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:15.145248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129720+0000","last_change":"2023-10-16T13:40:03.676052+0000","last_active":"2023-10-16T13:40:05.129720+0000","last_peered":"2023-10-16T13:40:05.129720+0000","last_clean":"2023-10-16T13:40:05.129720+0000","last_became_active":"2023-10-16T13:40:03.675685+0000","last_became_peered":"2023-10-16T13:40:03.675685+0000","last_unstale":"2023-10-16T13:40:05.129720+0000","last_undegraded":"2023-10-16T13:40:05.129720+0000","last_fullsized":"2023-10-16T13:40:05.129720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:58.183928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129846+0000","last_change":"2023-10-16T13:40:03.685749+0000","last_active":"2023-10-16T13:40:05.129846+0000","last_peered":"2023-10-16T13:40:05.129846+0000","last_clean":"2023-10-16T13:40:05.129846+0000","last_became_active":"2023-10-16T13:40:03.685457+0000","last_became_peered":"2023-10-16T13:40:03.685457+0000","last_unstale":"2023-10-16T13:40:05.129846+0000","last_undegraded":"2023-10-16T13:40:05.129846+0000","last_fullsized":"2023-10-16T13:40:05.129846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:48:26.085355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129809+0000","last_change":"2023-10-16T13:40:03.675557+0000","last_active":"2023-10-16T13:40:05.129809+0000","last_peered":"2023-10-16T13:40:05.129809+0000","last_clean":"2023-10-16T13:40:05.129809+0000","last_became_active":"2023-10-16T13:40:03.675247+0000","last_became_peered":"2023-10-16T13:40:03.675247+0000","last_unstale":"2023-10-16T13:40:05.129809+0000","last_undegraded":"2023-10-16T13:40:05.129809+0000","last_fullsized":"2023-10-16T13:40:05.129809+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:57:53.622861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129372+0000","last_change":"2023-10-16T13:40:03.686974+0000","last_active":"2023-10-16T13:40:05.129372+0000","last_peered":"2023-10-16T13:40:05.129372+0000","last_clean":"2023-10-16T13:40:05.129372+0000","last_became_active":"2023-10-16T13:40:03.686707+0000","last_became_peered":"2023-10-16T13:40:03.686707+0000","last_unstale":"2023-10-16T13:40:05.129372+0000","last_undegraded":"2023-10-16T13:40:05.129372+0000","last_fullsized":"2023-10-16T13:40:05.129372+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:51:31.254074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660309+0000","last_change":"2023-10-16T13:40:03.672089+0000","last_active":"2023-10-16T13:40:04.660309+0000","last_peered":"2023-10-16T13:40:04.660309+0000","last_clean":"2023-10-16T13:40:04.660309+0000","last_became_active":"2023-10-16T13:40:03.671772+0000","last_became_peered":"2023-10-16T13:40:03.671772+0000","last_unstale":"2023-10-16T13:40:04.660309+0000","last_undegraded":"2023-10-16T13:40:04.660309+0000","last_fullsized":"2023-10-16T13:40:04.660309+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:45:24.340971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661578+0000","last_change":"2023-10-16T13:40:03.668461+0000","last_active":"2023-10-16T13:40:04.661578+0000","last_peered":"2023-10-16T13:40:04.661578+0000","last_clean":"2023-10-16T13:40:04.661578+0000","last_became_active":"2023-10-16T13:40:03.668187+0000","last_became_peered":"2023-10-16T13:40:03.668187+0000","last_unstale":"2023-10-16T13:40:04.661578+0000","last_undegraded":"2023-10-16T13:40:04.661578+0000","last_fullsized":"2023-10-16T13:40:04.661578+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:19.417720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129284+0000","last_change":"2023-10-16T13:40:03.691144+0000","last_active":"2023-10-16T13:40:05.129284+0000","last_peered":"2023-10-16T13:40:05.129284+0000","last_clean":"2023-10-16T13:40:05.129284+0000","last_became_active":"2023-10-16T13:40:03.690853+0000","last_became_peered":"2023-10-16T13:40:03.690853+0000","last_unstale":"2023-10-16T13:40:05.129284+0000","last_undegraded":"2023-10-16T13:40:05.129284+0000","last_fullsized":"2023-10-16T13:40:05.129284+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:30.753215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660146+0000","last_change":"2023-10-16T13:40:03.680229+0000","last_active":"2023-10-16T13:40:04.660146+0000","last_peered":"2023-10-16T13:40:04.660146+0000","last_clean":"2023-10-16T13:40:04.660146+0000","last_became_active":"2023-10-16T13:40:03.679839+0000","last_became_peered":"2023-10-16T13:40:03.679839+0000","last_unstale":"2023-10-16T13:40:04.660146+0000","last_undegraded":"2023-10-16T13:40:04.660146+0000","last_fullsized":"2023-10-16T13:40:04.660146+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:15:45.910831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129361+0000","last_change":"2023-10-16T13:40:03.670669+0000","last_active":"2023-10-16T13:40:05.129361+0000","last_peered":"2023-10-16T13:40:05.129361+0000","last_clean":"2023-10-16T13:40:05.129361+0000","last_became_active":"2023-10-16T13:40:03.670235+0000","last_became_peered":"2023-10-16T13:40:03.670235+0000","last_unstale":"2023-10-16T13:40:05.129361+0000","last_undegraded":"2023-10-16T13:40:05.129361+0000","last_fullsized":"2023-10-16T13:40:05.129361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:19.957821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129593+0000","last_change":"2023-10-16T13:40:03.670115+0000","last_active":"2023-10-16T13:40:05.129593+0000","last_peered":"2023-10-16T13:40:05.129593+0000","last_clean":"2023-10-16T13:40:05.129593+0000","last_became_active":"2023-10-16T13:40:03.669847+0000","last_became_peered":"2023-10-16T13:40:03.669847+0000","last_unstale":"2023-10-16T13:40:05.129593+0000","last_undegraded":"2023-10-16T13:40:05.129593+0000","last_fullsized":"2023-10-16T13:40:05.129593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:23.578838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.659910+0000","last_change":"2023-10-16T13:40:03.674625+0000","last_active":"2023-10-16T13:40:04.659910+0000","last_peered":"2023-10-16T13:40:04.659910+0000","last_clean":"2023-10-16T13:40:04.659910+0000","last_became_active":"2023-10-16T13:40:03.674274+0000","last_became_peered":"2023-10-16T13:40:03.674274+0000","last_unstale":"2023-10-16T13:40:04.659910+0000","last_undegraded":"2023-10-16T13:40:04.659910+0000","last_fullsized":"2023-10-16T13:40:04.659910+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:54.136241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129506+0000","last_change":"2023-10-16T13:40:03.687906+0000","last_active":"2023-10-16T13:40:05.129506+0000","last_peered":"2023-10-16T13:40:05.129506+0000","last_clean":"2023-10-16T13:40:05.129506+0000","last_became_active":"2023-10-16T13:40:03.687588+0000","last_became_peered":"2023-10-16T13:40:03.687588+0000","last_unstale":"2023-10-16T13:40:05.129506+0000","last_undegraded":"2023-10-16T13:40:05.129506+0000","last_fullsized":"2023-10-16T13:40:05.129506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:11:42.513056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130660+0000","last_change":"2023-10-16T13:40:03.675906+0000","last_active":"2023-10-16T13:40:05.130660+0000","last_peered":"2023-10-16T13:40:05.130660+0000","last_clean":"2023-10-16T13:40:05.130660+0000","last_became_active":"2023-10-16T13:40:03.675592+0000","last_became_peered":"2023-10-16T13:40:03.675592+0000","last_unstale":"2023-10-16T13:40:05.130660+0000","last_undegraded":"2023-10-16T13:40:05.130660+0000","last_fullsized":"2023-10-16T13:40:05.130660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:19:38.405156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.688145+0000","last_change":"2023-10-16T13:40:02.660186+0000","last_active":"2023-10-16T13:40:03.688145+0000","last_peered":"2023-10-16T13:40:03.688145+0000","last_clean":"2023-10-16T13:40:03.688145+0000","last_became_active":"2023-10-16T13:40:02.659896+0000","last_became_peered":"2023-10-16T13:40:02.659896+0000","last_unstale":"2023-10-16T13:40:03.688145+0000","last_undegraded":"2023-10-16T13:40:03.688145+0000","last_fullsized":"2023-10-16T13:40:03.688145+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:10.189367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130280+0000","last_change":"2023-10-16T13:40:03.673926+0000","last_active":"2023-10-16T13:40:05.130280+0000","last_peered":"2023-10-16T13:40:05.130280+0000","last_clean":"2023-10-16T13:40:05.130280+0000","last_became_active":"2023-10-16T13:40:03.673461+0000","last_became_peered":"2023-10-16T13:40:03.673461+0000","last_unstale":"2023-10-16T13:40:05.130280+0000","last_undegraded":"2023-10-16T13:40:05.130280+0000","last_fullsized":"2023-10-16T13:40:05.130280+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:40.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.694414+0000","last_change":"2023-10-16T13:40:02.666794+0000","last_active":"2023-10-16T13:40:03.694414+0000","last_peered":"2023-10-16T13:40:03.694414+0000","last_clean":"2023-10-16T13:40:03.694414+0000","last_became_active":"2023-10-16T13:40:02.666442+0000","last_became_peered":"2023-10-16T13:40:02.666442+0000","last_unstale":"2023-10-16T13:40:03.694414+0000","last_undegraded":"2023-10-16T13:40:03.694414+0000","last_fullsized":"2023-10-16T13:40:03.694414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:48.648270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130230+0000","last_change":"2023-10-16T13:40:03.674895+0000","last_active":"2023-10-16T13:40:05.130230+0000","last_peered":"2023-10-16T13:40:05.130230+0000","last_clean":"2023-10-16T13:40:05.130230+0000","last_became_active":"2023-10-16T13:40:03.674543+0000","last_became_peered":"2023-10-16T13:40:03.674543+0000","last_unstale":"2023-10-16T13:40:05.130230+0000","last_undegraded":"2023-10-16T13:40:05.130230+0000","last_fullsized":"2023-10-16T13:40:05.130230+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:56:53.959881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.690527+0000","last_change":"2023-10-16T13:40:02.657293+0000","last_active":"2023-10-16T13:40:03.690527+0000","last_peered":"2023-10-16T13:40:03.690527+0000","last_clean":"2023-10-16T13:40:03.690527+0000","last_became_active":"2023-10-16T13:40:02.657011+0000","last_became_peered":"2023-10-16T13:40:02.657011+0000","last_unstale":"2023-10-16T13:40:03.690527+0000","last_undegraded":"2023-10-16T13:40:03.690527+0000","last_fullsized":"2023-10-16T13:40:03.690527+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:41.574666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130367+0000","last_change":"2023-10-16T13:40:03.685120+0000","last_active":"2023-10-16T13:40:05.130367+0000","last_peered":"2023-10-16T13:40:05.130367+0000","last_clean":"2023-10-16T13:40:05.130367+0000","last_became_active":"2023-10-16T13:40:03.684812+0000","last_became_peered":"2023-10-16T13:40:03.684812+0000","last_unstale":"2023-10-16T13:40:05.130367+0000","last_undegraded":"2023-10-16T13:40:05.130367+0000","last_fullsized":"2023-10-16T13:40:05.130367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:34:49.422915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.682931+0000","last_change":"2023-10-16T13:40:02.662600+0000","last_active":"2023-10-16T13:40:03.682931+0000","last_peered":"2023-10-16T13:40:03.682931+0000","last_clean":"2023-10-16T13:40:03.682931+0000","last_became_active":"2023-10-16T13:40:02.662253+0000","last_became_peered":"2023-10-16T13:40:02.662253+0000","last_unstale":"2023-10-16T13:40:03.682931+0000","last_undegraded":"2023-10-16T13:40:03.682931+0000","last_fullsized":"2023-10-16T13:40:03.682931+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:42.515990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129929+0000","last_change":"2023-10-16T13:40:03.685684+0000","last_active":"2023-10-16T13:40:05.129929+0000","last_peered":"2023-10-16T13:40:05.129929+0000","last_clean":"2023-10-16T13:40:05.129929+0000","last_became_active":"2023-10-16T13:40:03.685317+0000","last_became_peered":"2023-10-16T13:40:03.685317+0000","last_unstale":"2023-10-16T13:40:05.129929+0000","last_undegraded":"2023-10-16T13:40:05.129929+0000","last_fullsized":"2023-10-16T13:40:05.129929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:40.887809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.682701+0000","last_change":"2023-10-16T13:40:02.658317+0000","last_active":"2023-10-16T13:40:03.682701+0000","last_peered":"2023-10-16T13:40:03.682701+0000","last_clean":"2023-10-16T13:40:03.682701+0000","last_became_active":"2023-10-16T13:40:02.658043+0000","last_became_peered":"2023-10-16T13:40:02.658043+0000","last_unstale":"2023-10-16T13:40:03.682701+0000","last_undegraded":"2023-10-16T13:40:03.682701+0000","last_fullsized":"2023-10-16T13:40:03.682701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:59.244532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129524+0000","last_change":"2023-10-16T13:40:03.688978+0000","last_active":"2023-10-16T13:40:05.129524+0000","last_peered":"2023-10-16T13:40:05.129524+0000","last_clean":"2023-10-16T13:40:05.129524+0000","last_became_active":"2023-10-16T13:40:03.688500+0000","last_became_peered":"2023-10-16T13:40:03.688500+0000","last_unstale":"2023-10-16T13:40:05.129524+0000","last_undegraded":"2023-10-16T13:40:05.129524+0000","last_fullsized":"2023-10-16T13:40:05.129524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:25:22.991610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.688248+0000","last_change":"2023-10-16T13:40:02.661653+0000","last_active":"2023-10-16T13:40:03.688248+0000","last_peered":"2023-10-16T13:40:03.688248+0000","last_clean":"2023-10-16T13:40:03.688248+0000","last_became_active":"2023-10-16T13:40:02.661255+0000","last_became_peered":"2023-10-16T13:40:02.661255+0000","last_unstale":"2023-10-16T13:40:03.688248+0000","last_undegraded":"2023-10-16T13:40:03.688248+0000","last_fullsized":"2023-10-16T13:40:03.688248+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:42.515990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129551+0000","last_change":"2023-10-16T13:40:03.673559+0000","last_active":"2023-10-16T13:40:05.129551+0000","last_peered":"2023-10-16T13:40:05.129551+0000","last_clean":"2023-10-16T13:40:05.129551+0000","last_became_active":"2023-10-16T13:40:03.673295+0000","last_became_peered":"2023-10-16T13:40:03.673295+0000","last_unstale":"2023-10-16T13:40:05.129551+0000","last_undegraded":"2023-10-16T13:40:05.129551+0000","last_fullsized":"2023-10-16T13:40:05.129551+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:28.171856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.660826+0000","last_change":"2023-10-16T13:40:02.654143+0000","last_active":"2023-10-16T13:40:03.660826+0000","last_peered":"2023-10-16T13:40:03.660826+0000","last_clean":"2023-10-16T13:40:03.660826+0000","last_became_active":"2023-10-16T13:40:02.653839+0000","last_became_peered":"2023-10-16T13:40:02.653839+0000","last_unstale":"2023-10-16T13:40:03.660826+0000","last_undegraded":"2023-10-16T13:40:03.660826+0000","last_fullsized":"2023-10-16T13:40:03.660826+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:48.340218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129994+0000","last_change":"2023-10-16T13:40:03.677854+0000","last_active":"2023-10-16T13:40:05.129994+0000","last_peered":"2023-10-16T13:40:05.129994+0000","last_clean":"2023-10-16T13:40:05.129994+0000","last_became_active":"2023-10-16T13:40:03.677020+0000","last_became_peered":"2023-10-16T13:40:03.677020+0000","last_unstale":"2023-10-16T13:40:05.129994+0000","last_undegraded":"2023-10-16T13:40:05.129994+0000","last_fullsized":"2023-10-16T13:40:05.129994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:23.824780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.663015+0000","last_change":"2023-10-16T13:40:02.667918+0000","last_active":"2023-10-16T13:40:03.663015+0000","last_peered":"2023-10-16T13:40:03.663015+0000","last_clean":"2023-10-16T13:40:03.663015+0000","last_became_active":"2023-10-16T13:40:02.667614+0000","last_became_peered":"2023-10-16T13:40:02.667614+0000","last_unstale":"2023-10-16T13:40:03.663015+0000","last_undegraded":"2023-10-16T13:40:03.663015+0000","last_fullsized":"2023-10-16T13:40:03.663015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:48.340218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661146+0000","last_change":"2023-10-16T13:40:03.670313+0000","last_active":"2023-10-16T13:40:04.661146+0000","last_peered":"2023-10-16T13:40:04.661146+0000","last_clean":"2023-10-16T13:40:04.661146+0000","last_became_active":"2023-10-16T13:40:03.669833+0000","last_became_peered":"2023-10-16T13:40:03.669833+0000","last_unstale":"2023-10-16T13:40:04.661146+0000","last_undegraded":"2023-10-16T13:40:04.661146+0000","last_fullsized":"2023-10-16T13:40:04.661146+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:42.577891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.666182+0000","last_change":"2023-10-16T13:40:02.665632+0000","last_active":"2023-10-16T13:40:03.666182+0000","last_peered":"2023-10-16T13:40:03.666182+0000","last_clean":"2023-10-16T13:40:03.666182+0000","last_became_active":"2023-10-16T13:40:02.665364+0000","last_became_peered":"2023-10-16T13:40:02.665364+0000","last_unstale":"2023-10-16T13:40:03.666182+0000","last_undegraded":"2023-10-16T13:40:03.666182+0000","last_fullsized":"2023-10-16T13:40:03.666182+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:56:29.915761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129820+0000","last_change":"2023-10-16T13:40:03.673094+0000","last_active":"2023-10-16T13:40:05.129820+0000","last_peered":"2023-10-16T13:40:05.129820+0000","last_clean":"2023-10-16T13:40:05.129820+0000","last_became_active":"2023-10-16T13:40:03.672721+0000","last_became_peered":"2023-10-16T13:40:03.672721+0000","last_unstale":"2023-10-16T13:40:05.129820+0000","last_undegraded":"2023-10-16T13:40:05.129820+0000","last_fullsized":"2023-10-16T13:40:05.129820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:46.419214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.659784+0000","last_change":"2023-10-16T13:40:02.663678+0000","last_active":"2023-10-16T13:40:03.659784+0000","last_peered":"2023-10-16T13:40:03.659784+0000","last_clean":"2023-10-16T13:40:03.659784+0000","last_became_active":"2023-10-16T13:40:02.663346+0000","last_became_peered":"2023-10-16T13:40:02.663346+0000","last_unstale":"2023-10-16T13:40:03.659784+0000","last_undegraded":"2023-10-16T13:40:03.659784+0000","last_fullsized":"2023-10-16T13:40:03.659784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:26.873842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129509+0000","last_change":"2023-10-16T13:40:03.672670+0000","last_active":"2023-10-16T13:40:05.129509+0000","last_peered":"2023-10-16T13:40:05.129509+0000","last_clean":"2023-10-16T13:40:05.129509+0000","last_became_active":"2023-10-16T13:40:03.672350+0000","last_became_peered":"2023-10-16T13:40:03.672350+0000","last_unstale":"2023-10-16T13:40:05.129509+0000","last_undegraded":"2023-10-16T13:40:05.129509+0000","last_fullsized":"2023-10-16T13:40:05.129509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:00.247757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.686578+0000","last_change":"2023-10-16T13:40:02.666624+0000","last_active":"2023-10-16T13:40:03.686578+0000","last_peered":"2023-10-16T13:40:03.686578+0000","last_clean":"2023-10-16T13:40:03.686578+0000","last_became_active":"2023-10-16T13:40:02.666354+0000","last_became_peered":"2023-10-16T13:40:02.666354+0000","last_unstale":"2023-10-16T13:40:03.686578+0000","last_undegraded":"2023-10-16T13:40:03.686578+0000","last_fullsized":"2023-10-16T13:40:03.686578+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:19:37.401931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130136+0000","last_change":"2023-10-16T13:40:03.673105+0000","last_active":"2023-10-16T13:40:05.130136+0000","last_peered":"2023-10-16T13:40:05.130136+0000","last_clean":"2023-10-16T13:40:05.130136+0000","last_became_active":"2023-10-16T13:40:03.672073+0000","last_became_peered":"2023-10-16T13:40:03.672073+0000","last_unstale":"2023-10-16T13:40:05.130136+0000","last_undegraded":"2023-10-16T13:40:05.130136+0000","last_fullsized":"2023-10-16T13:40:05.130136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:55.722866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.693077+0000","last_change":"2023-10-16T13:40:02.660676+0000","last_active":"2023-10-16T13:40:03.693077+0000","last_peered":"2023-10-16T13:40:03.693077+0000","last_clean":"2023-10-16T13:40:03.693077+0000","last_became_active":"2023-10-16T13:40:02.659992+0000","last_became_peered":"2023-10-16T13:40:02.659992+0000","last_unstale":"2023-10-16T13:40:03.693077+0000","last_undegraded":"2023-10-16T13:40:03.693077+0000","last_fullsized":"2023-10-16T13:40:03.693077+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:47.920849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660964+0000","last_change":"2023-10-16T13:40:03.669264+0000","last_active":"2023-10-16T13:40:04.660964+0000","last_peered":"2023-10-16T13:40:04.660964+0000","last_clean":"2023-10-16T13:40:04.660964+0000","last_became_active":"2023-10-16T13:40:03.669005+0000","last_became_peered":"2023-10-16T13:40:03.669005+0000","last_unstale":"2023-10-16T13:40:04.660964+0000","last_undegraded":"2023-10-16T13:40:04.660964+0000","last_fullsized":"2023-10-16T13:40:04.660964+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:11.192592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.692311+0000","last_change":"2023-10-16T13:40:02.664721+0000","last_active":"2023-10-16T13:40:03.692311+0000","last_peered":"2023-10-16T13:40:03.692311+0000","last_clean":"2023-10-16T13:40:03.692311+0000","last_became_active":"2023-10-16T13:40:02.664294+0000","last_became_peered":"2023-10-16T13:40:02.664294+0000","last_unstale":"2023-10-16T13:40:03.692311+0000","last_undegraded":"2023-10-16T13:40:03.692311+0000","last_fullsized":"2023-10-16T13:40:03.692311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:24.815155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129899+0000","last_change":"2023-10-16T13:40:03.674249+0000","last_active":"2023-10-16T13:40:05.129899+0000","last_peered":"2023-10-16T13:40:05.129899+0000","last_clean":"2023-10-16T13:40:05.129899+0000","last_became_active":"2023-10-16T13:40:03.673731+0000","last_became_peered":"2023-10-16T13:40:03.673731+0000","last_unstale":"2023-10-16T13:40:05.129899+0000","last_undegraded":"2023-10-16T13:40:05.129899+0000","last_fullsized":"2023-10-16T13:40:05.129899+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:43:27.877067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.666194+0000","last_change":"2023-10-16T13:40:02.661169+0000","last_active":"2023-10-16T13:40:03.666194+0000","last_peered":"2023-10-16T13:40:03.666194+0000","last_clean":"2023-10-16T13:40:03.666194+0000","last_became_active":"2023-10-16T13:40:02.660689+0000","last_became_peered":"2023-10-16T13:40:02.660689+0000","last_unstale":"2023-10-16T13:40:03.666194+0000","last_undegraded":"2023-10-16T13:40:03.666194+0000","last_fullsized":"2023-10-16T13:40:03.666194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:45:23.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.660723+0000","last_change":"2023-10-16T13:40:03.670319+0000","last_active":"2023-10-16T13:40:04.660723+0000","last_peered":"2023-10-16T13:40:04.660723+0000","last_clean":"2023-10-16T13:40:04.660723+0000","last_became_active":"2023-10-16T13:40:03.670034+0000","last_became_peered":"2023-10-16T13:40:03.670034+0000","last_unstale":"2023-10-16T13:40:04.660723+0000","last_undegraded":"2023-10-16T13:40:04.660723+0000","last_fullsized":"2023-10-16T13:40:04.660723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:43.519215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.660875+0000","last_change":"2023-10-16T13:40:02.662603+0000","last_active":"2023-10-16T13:40:03.660875+0000","last_peered":"2023-10-16T13:40:03.660875+0000","last_clean":"2023-10-16T13:40:03.660875+0000","last_became_active":"2023-10-16T13:40:02.662287+0000","last_became_peered":"2023-10-16T13:40:02.662287+0000","last_unstale":"2023-10-16T13:40:03.660875+0000","last_undegraded":"2023-10-16T13:40:03.660875+0000","last_fullsized":"2023-10-16T13:40:03.660875+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:39.586463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129719+0000","last_change":"2023-10-16T13:40:03.669541+0000","last_active":"2023-10-16T13:40:05.129719+0000","last_peered":"2023-10-16T13:40:05.129719+0000","last_clean":"2023-10-16T13:40:05.129719+0000","last_became_active":"2023-10-16T13:40:03.669265+0000","last_became_peered":"2023-10-16T13:40:03.669265+0000","last_unstale":"2023-10-16T13:40:05.129719+0000","last_undegraded":"2023-10-16T13:40:05.129719+0000","last_fullsized":"2023-10-16T13:40:05.129719+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:11.120120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.684074+0000","last_change":"2023-10-16T13:40:02.660270+0000","last_active":"2023-10-16T13:40:03.684074+0000","last_peered":"2023-10-16T13:40:03.684074+0000","last_clean":"2023-10-16T13:40:03.684074+0000","last_became_active":"2023-10-16T13:40:02.659826+0000","last_became_peered":"2023-10-16T13:40:02.659826+0000","last_unstale":"2023-10-16T13:40:03.684074+0000","last_undegraded":"2023-10-16T13:40:03.684074+0000","last_fullsized":"2023-10-16T13:40:03.684074+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:35.504309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129971+0000","last_change":"2023-10-16T13:40:03.674193+0000","last_active":"2023-10-16T13:40:05.129971+0000","last_peered":"2023-10-16T13:40:05.129971+0000","last_clean":"2023-10-16T13:40:05.129971+0000","last_became_active":"2023-10-16T13:40:03.673895+0000","last_became_peered":"2023-10-16T13:40:03.673895+0000","last_unstale":"2023-10-16T13:40:05.129971+0000","last_undegraded":"2023-10-16T13:40:05.129971+0000","last_fullsized":"2023-10-16T13:40:05.129971+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:01.117137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.690922+0000","last_change":"2023-10-16T13:40:02.666774+0000","last_active":"2023-10-16T13:40:03.690922+0000","last_peered":"2023-10-16T13:40:03.690922+0000","last_clean":"2023-10-16T13:40:03.690922+0000","last_became_active":"2023-10-16T13:40:02.666419+0000","last_became_peered":"2023-10-16T13:40:02.666419+0000","last_unstale":"2023-10-16T13:40:03.690922+0000","last_undegraded":"2023-10-16T13:40:03.690922+0000","last_fullsized":"2023-10-16T13:40:03.690922+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:16.257763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661452+0000","last_change":"2023-10-16T13:40:03.673776+0000","last_active":"2023-10-16T13:40:04.661452+0000","last_peered":"2023-10-16T13:40:04.661452+0000","last_clean":"2023-10-16T13:40:04.661452+0000","last_became_active":"2023-10-16T13:40:03.673533+0000","last_became_peered":"2023-10-16T13:40:03.673533+0000","last_unstale":"2023-10-16T13:40:04.661452+0000","last_undegraded":"2023-10-16T13:40:04.661452+0000","last_fullsized":"2023-10-16T13:40:04.661452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:11:42.513056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.687716+0000","last_change":"2023-10-16T13:40:02.660792+0000","last_active":"2023-10-16T13:40:03.687716+0000","last_peered":"2023-10-16T13:40:03.687716+0000","last_clean":"2023-10-16T13:40:03.687716+0000","last_became_active":"2023-10-16T13:40:02.659728+0000","last_became_peered":"2023-10-16T13:40:02.659728+0000","last_unstale":"2023-10-16T13:40:03.687716+0000","last_undegraded":"2023-10-16T13:40:03.687716+0000","last_fullsized":"2023-10-16T13:40:03.687716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:04.669957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130548+0000","last_change":"2023-10-16T13:40:03.670136+0000","last_active":"2023-10-16T13:40:05.130548+0000","last_peered":"2023-10-16T13:40:05.130548+0000","last_clean":"2023-10-16T13:40:05.130548+0000","last_became_active":"2023-10-16T13:40:03.669807+0000","last_became_peered":"2023-10-16T13:40:03.669807+0000","last_unstale":"2023-10-16T13:40:05.130548+0000","last_undegraded":"2023-10-16T13:40:05.130548+0000","last_fullsized":"2023-10-16T13:40:05.130548+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:29.647184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.683661+0000","last_change":"2023-10-16T13:40:02.662725+0000","last_active":"2023-10-16T13:40:03.683661+0000","last_peered":"2023-10-16T13:40:03.683661+0000","last_clean":"2023-10-16T13:40:03.683661+0000","last_became_active":"2023-10-16T13:40:02.662395+0000","last_became_peered":"2023-10-16T13:40:02.662395+0000","last_unstale":"2023-10-16T13:40:03.683661+0000","last_undegraded":"2023-10-16T13:40:03.683661+0000","last_fullsized":"2023-10-16T13:40:03.683661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:41.574666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130249+0000","last_change":"2023-10-16T13:40:03.674974+0000","last_active":"2023-10-16T13:40:05.130249+0000","last_peered":"2023-10-16T13:40:05.130249+0000","last_clean":"2023-10-16T13:40:05.130249+0000","last_became_active":"2023-10-16T13:40:03.672415+0000","last_became_peered":"2023-10-16T13:40:03.672415+0000","last_unstale":"2023-10-16T13:40:05.130249+0000","last_undegraded":"2023-10-16T13:40:05.130249+0000","last_fullsized":"2023-10-16T13:40:05.130249+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:25.818380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.674311+0000","last_change":"2023-10-16T13:40:02.666967+0000","last_active":"2023-10-16T13:40:03.674311+0000","last_peered":"2023-10-16T13:40:03.674311+0000","last_clean":"2023-10-16T13:40:03.674311+0000","last_became_active":"2023-10-16T13:40:02.666653+0000","last_became_peered":"2023-10-16T13:40:02.666653+0000","last_unstale":"2023-10-16T13:40:03.674311+0000","last_undegraded":"2023-10-16T13:40:03.674311+0000","last_fullsized":"2023-10-16T13:40:03.674311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:39.586463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661108+0000","last_change":"2023-10-16T13:40:03.671287+0000","last_active":"2023-10-16T13:40:04.661108+0000","last_peered":"2023-10-16T13:40:04.661108+0000","last_clean":"2023-10-16T13:40:04.661108+0000","last_became_active":"2023-10-16T13:40:03.670980+0000","last_became_peered":"2023-10-16T13:40:03.670980+0000","last_unstale":"2023-10-16T13:40:04.661108+0000","last_undegraded":"2023-10-16T13:40:04.661108+0000","last_fullsized":"2023-10-16T13:40:04.661108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:30.753215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.692258+0000","last_change":"2023-10-16T13:40:02.664562+0000","last_active":"2023-10-16T13:40:03.692258+0000","last_peered":"2023-10-16T13:40:03.692258+0000","last_clean":"2023-10-16T13:40:03.692258+0000","last_became_active":"2023-10-16T13:40:02.664036+0000","last_became_peered":"2023-10-16T13:40:02.664036+0000","last_unstale":"2023-10-16T13:40:03.692258+0000","last_undegraded":"2023-10-16T13:40:03.692258+0000","last_fullsized":"2023-10-16T13:40:03.692258+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:11.519225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129808+0000","last_change":"2023-10-16T13:40:03.685319+0000","last_active":"2023-10-16T13:40:05.129808+0000","last_peered":"2023-10-16T13:40:05.129808+0000","last_clean":"2023-10-16T13:40:05.129808+0000","last_became_active":"2023-10-16T13:40:03.684900+0000","last_became_peered":"2023-10-16T13:40:03.684900+0000","last_unstale":"2023-10-16T13:40:05.129808+0000","last_undegraded":"2023-10-16T13:40:05.129808+0000","last_fullsized":"2023-10-16T13:40:05.129808+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:19.417720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.669044+0000","last_change":"2023-10-16T13:40:02.656748+0000","last_active":"2023-10-16T13:40:03.669044+0000","last_peered":"2023-10-16T13:40:03.669044+0000","last_clean":"2023-10-16T13:40:03.669044+0000","last_became_active":"2023-10-16T13:40:02.656407+0000","last_became_peered":"2023-10-16T13:40:02.656407+0000","last_unstale":"2023-10-16T13:40:03.669044+0000","last_undegraded":"2023-10-16T13:40:03.669044+0000","last_fullsized":"2023-10-16T13:40:03.669044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:13.101811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129410+0000","last_change":"2023-10-16T13:40:03.684510+0000","last_active":"2023-10-16T13:40:05.129410+0000","last_peered":"2023-10-16T13:40:05.129410+0000","last_clean":"2023-10-16T13:40:05.129410+0000","last_became_active":"2023-10-16T13:40:03.684187+0000","last_became_peered":"2023-10-16T13:40:03.684187+0000","last_unstale":"2023-10-16T13:40:05.129410+0000","last_undegraded":"2023-10-16T13:40:05.129410+0000","last_fullsized":"2023-10-16T13:40:05.129410+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:05.733119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.660348+0000","last_change":"2023-10-16T13:40:02.664585+0000","last_active":"2023-10-16T13:40:03.660348+0000","last_peered":"2023-10-16T13:40:03.660348+0000","last_clean":"2023-10-16T13:40:03.660348+0000","last_became_active":"2023-10-16T13:40:02.664322+0000","last_became_peered":"2023-10-16T13:40:02.664322+0000","last_unstale":"2023-10-16T13:40:03.660348+0000","last_undegraded":"2023-10-16T13:40:03.660348+0000","last_fullsized":"2023-10-16T13:40:03.660348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:13:13.101811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661555+0000","last_change":"2023-10-16T13:40:03.681269+0000","last_active":"2023-10-16T13:40:04.661555+0000","last_peered":"2023-10-16T13:40:04.661555+0000","last_clean":"2023-10-16T13:40:04.661555+0000","last_became_active":"2023-10-16T13:40:03.680997+0000","last_became_peered":"2023-10-16T13:40:03.680997+0000","last_unstale":"2023-10-16T13:40:04.661555+0000","last_undegraded":"2023-10-16T13:40:04.661555+0000","last_fullsized":"2023-10-16T13:40:04.661555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:57.628184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.688590+0000","last_change":"2023-10-16T13:40:02.668493+0000","last_active":"2023-10-16T13:40:03.688590+0000","last_peered":"2023-10-16T13:40:03.688590+0000","last_clean":"2023-10-16T13:40:03.688590+0000","last_became_active":"2023-10-16T13:40:02.668204+0000","last_became_peered":"2023-10-16T13:40:02.668204+0000","last_unstale":"2023-10-16T13:40:03.688590+0000","last_undegraded":"2023-10-16T13:40:03.688590+0000","last_fullsized":"2023-10-16T13:40:03.688590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:22:53.411726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:04.661326+0000","last_change":"2023-10-16T13:40:03.671007+0000","last_active":"2023-10-16T13:40:04.661326+0000","last_peered":"2023-10-16T13:40:04.661326+0000","last_clean":"2023-10-16T13:40:04.661326+0000","last_became_active":"2023-10-16T13:40:03.670729+0000","last_became_peered":"2023-10-16T13:40:03.670729+0000","last_unstale":"2023-10-16T13:40:04.661326+0000","last_undegraded":"2023-10-16T13:40:04.661326+0000","last_fullsized":"2023-10-16T13:40:04.661326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:05.733119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.675109+0000","last_change":"2023-10-16T13:40:02.656852+0000","last_active":"2023-10-16T13:40:03.675109+0000","last_peered":"2023-10-16T13:40:03.675109+0000","last_clean":"2023-10-16T13:40:03.675109+0000","last_became_active":"2023-10-16T13:40:02.656565+0000","last_became_peered":"2023-10-16T13:40:02.656565+0000","last_unstale":"2023-10-16T13:40:03.675109+0000","last_undegraded":"2023-10-16T13:40:03.675109+0000","last_fullsized":"2023-10-16T13:40:03.675109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:04.217547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129645+0000","last_change":"2023-10-16T13:40:03.668590+0000","last_active":"2023-10-16T13:40:05.129645+0000","last_peered":"2023-10-16T13:40:05.129645+0000","last_clean":"2023-10-16T13:40:05.129645+0000","last_became_active":"2023-10-16T13:40:03.667978+0000","last_became_peered":"2023-10-16T13:40:03.667978+0000","last_unstale":"2023-10-16T13:40:05.129645+0000","last_undegraded":"2023-10-16T13:40:05.129645+0000","last_fullsized":"2023-10-16T13:40:05.129645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:48.924074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.666355+0000","last_change":"2023-10-16T13:40:02.656866+0000","last_active":"2023-10-16T13:40:03.666355+0000","last_peered":"2023-10-16T13:40:03.666355+0000","last_clean":"2023-10-16T13:40:03.666355+0000","last_became_active":"2023-10-16T13:40:02.656586+0000","last_became_peered":"2023-10-16T13:40:02.656586+0000","last_unstale":"2023-10-16T13:40:03.666355+0000","last_undegraded":"2023-10-16T13:40:03.666355+0000","last_fullsized":"2023-10-16T13:40:03.666355+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:26.719682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130575+0000","last_change":"2023-10-16T13:40:03.685181+0000","last_active":"2023-10-16T13:40:05.130575+0000","last_peered":"2023-10-16T13:40:05.130575+0000","last_clean":"2023-10-16T13:40:05.130575+0000","last_became_active":"2023-10-16T13:40:03.684866+0000","last_became_peered":"2023-10-16T13:40:03.684866+0000","last_unstale":"2023-10-16T13:40:05.130575+0000","last_undegraded":"2023-10-16T13:40:05.130575+0000","last_fullsized":"2023-10-16T13:40:05.130575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:36.507534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.662684+0000","last_change":"2023-10-16T13:40:02.653438+0000","last_active":"2023-10-16T13:40:03.662684+0000","last_peered":"2023-10-16T13:40:03.662684+0000","last_clean":"2023-10-16T13:40:03.662684+0000","last_became_active":"2023-10-16T13:40:02.653107+0000","last_became_peered":"2023-10-16T13:40:02.653107+0000","last_unstale":"2023-10-16T13:40:03.662684+0000","last_undegraded":"2023-10-16T13:40:03.662684+0000","last_fullsized":"2023-10-16T13:40:03.662684+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:04.669957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130013+0000","last_change":"2023-10-16T13:40:03.671414+0000","last_active":"2023-10-16T13:40:05.130013+0000","last_peered":"2023-10-16T13:40:05.130013+0000","last_clean":"2023-10-16T13:40:05.130013+0000","last_became_active":"2023-10-16T13:40:03.671060+0000","last_became_peered":"2023-10-16T13:40:03.671060+0000","last_unstale":"2023-10-16T13:40:05.130013+0000","last_undegraded":"2023-10-16T13:40:05.130013+0000","last_fullsized":"2023-10-16T13:40:05.130013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:49:42.863662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.669539+0000","last_change":"2023-10-16T13:40:02.650139+0000","last_active":"2023-10-16T13:40:03.669539+0000","last_peered":"2023-10-16T13:40:03.669539+0000","last_clean":"2023-10-16T13:40:03.669539+0000","last_became_active":"2023-10-16T13:40:02.649855+0000","last_became_peered":"2023-10-16T13:40:02.649855+0000","last_unstale":"2023-10-16T13:40:03.669539+0000","last_undegraded":"2023-10-16T13:40:03.669539+0000","last_fullsized":"2023-10-16T13:40:03.669539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:37:56.424001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129963+0000","last_change":"2023-10-16T13:40:03.673539+0000","last_active":"2023-10-16T13:40:05.129963+0000","last_peered":"2023-10-16T13:40:05.129963+0000","last_clean":"2023-10-16T13:40:05.129963+0000","last_became_active":"2023-10-16T13:40:03.673250+0000","last_became_peered":"2023-10-16T13:40:03.673250+0000","last_unstale":"2023-10-16T13:40:05.129963+0000","last_undegraded":"2023-10-16T13:40:05.129963+0000","last_fullsized":"2023-10-16T13:40:05.129963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:00:00.935034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.662754+0000","last_change":"2023-10-16T13:40:02.660323+0000","last_active":"2023-10-16T13:40:03.662754+0000","last_peered":"2023-10-16T13:40:03.662754+0000","last_clean":"2023-10-16T13:40:03.662754+0000","last_became_active":"2023-10-16T13:40:02.660045+0000","last_became_peered":"2023-10-16T13:40:02.660045+0000","last_unstale":"2023-10-16T13:40:03.662754+0000","last_undegraded":"2023-10-16T13:40:03.662754+0000","last_fullsized":"2023-10-16T13:40:03.662754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:26.337432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129139+0000","last_change":"2023-10-16T13:40:03.677280+0000","last_active":"2023-10-16T13:40:05.129139+0000","last_peered":"2023-10-16T13:40:05.129139+0000","last_clean":"2023-10-16T13:40:05.129139+0000","last_became_active":"2023-10-16T13:40:03.676891+0000","last_became_peered":"2023-10-16T13:40:03.676891+0000","last_unstale":"2023-10-16T13:40:05.129139+0000","last_undegraded":"2023-10-16T13:40:05.129139+0000","last_fullsized":"2023-10-16T13:40:05.129139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:27.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.668836+0000","last_change":"2023-10-16T13:40:02.659573+0000","last_active":"2023-10-16T13:40:03.668836+0000","last_peered":"2023-10-16T13:40:03.668836+0000","last_clean":"2023-10-16T13:40:03.668836+0000","last_became_active":"2023-10-16T13:40:02.659277+0000","last_became_peered":"2023-10-16T13:40:02.659277+0000","last_unstale":"2023-10-16T13:40:03.668836+0000","last_undegraded":"2023-10-16T13:40:03.668836+0000","last_fullsized":"2023-10-16T13:40:03.668836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:16.151988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.130027+0000","last_change":"2023-10-16T13:40:03.678065+0000","last_active":"2023-10-16T13:40:05.130027+0000","last_peered":"2023-10-16T13:40:05.130027+0000","last_clean":"2023-10-16T13:40:05.130027+0000","last_became_active":"2023-10-16T13:40:03.677492+0000","last_became_peered":"2023-10-16T13:40:03.677492+0000","last_unstale":"2023-10-16T13:40:05.130027+0000","last_undegraded":"2023-10-16T13:40:05.130027+0000","last_fullsized":"2023-10-16T13:40:05.130027+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:09.167402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.659603+0000","last_change":"2023-10-16T13:40:02.663715+0000","last_active":"2023-10-16T13:40:03.659603+0000","last_peered":"2023-10-16T13:40:03.659603+0000","last_clean":"2023-10-16T13:40:03.659603+0000","last_became_active":"2023-10-16T13:40:02.663331+0000","last_became_peered":"2023-10-16T13:40:02.663331+0000","last_unstale":"2023-10-16T13:40:03.659603+0000","last_undegraded":"2023-10-16T13:40:03.659603+0000","last_fullsized":"2023-10-16T13:40:03.659603+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:10.116895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-16T13:40:05.129620+0000","last_change":"2023-10-16T13:40:03.686437+0000","last_active":"2023-10-16T13:40:05.129620+0000","last_peered":"2023-10-16T13:40:05.129620+0000","last_clean":"2023-10-16T13:40:05.129620+0000","last_became_active":"2023-10-16T13:40:03.685963+0000","last_became_peered":"2023-10-16T13:40:03.685963+0000","last_unstale":"2023-10-16T13:40:05.129620+0000","last_undegraded":"2023-10-16T13:40:05.129620+0000","last_fullsized":"2023-10-16T13:40:05.129620+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:02.639394+0000","last_clean_scrub_stamp":"2023-10-16T13:40:02.639394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:46:01.014126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.666100+0000","last_change":"2023-10-16T13:40:02.659715+0000","last_active":"2023-10-16T13:40:03.666100+0000","last_peered":"2023-10-16T13:40:03.666100+0000","last_clean":"2023-10-16T13:40:03.666100+0000","last_became_active":"2023-10-16T13:40:02.659427+0000","last_became_peered":"2023-10-16T13:40:02.659427+0000","last_unstale":"2023-10-16T13:40:03.666100+0000","last_undegraded":"2023-10-16T13:40:03.666100+0000","last_fullsized":"2023-10-16T13:40:03.666100+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:01.636168+0000","last_clean_scrub_stamp":"2023-10-16T13:40:01.636168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:12:54.870617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-16T13:40:03.667568+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:03.667568+0000","last_peered":"2023-10-16T13:40:03.667568+0000","last_clean":"2023-10-16T13:40:03.667568+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:03.667568+0000","last_undegraded":"2023-10-16T13:40:03.667568+0000","last_fullsized":"2023-10-16T13:40:03.667568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":850438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.37},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":259910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.964,"5min":10.964,"15min":10.964},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.71499999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.747},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":260000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.29099999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.374},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42099999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56100000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1216512,"data_stored":851453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.26800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33700000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.42599999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.48099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":258947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.24399999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.317}]},{"osd":3,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.498},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.433}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":259966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.253},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.27500000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.8559999999999999,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.621}]},{"osd":7,"last update":"Mon Oct 16 13:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":261522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.443},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.625}]},{"osd":3,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.54400000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.503},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":260562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.629},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.5}]},{"osd":1,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.311},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.37}]},{"osd":6,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.39300000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.438},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:12.856 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:40:12.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:40:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.019+0000 7f27fff5d700 1 Processor -- start 2023-10-16T13:40:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.020+0000 7f27fff5d700 1 -- start start 2023-10-16T13:40:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.020+0000 7f27fff5d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f815a730 0x7f27f80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.020+0000 7f27fff5d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f80cce90 0x7f27f80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.020+0000 7f27fff5d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80cd7e0 con 0x7f27f80cecf0 2023-10-16T13:40:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fff5d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80b1fc0 con 0x7f27f80cce90 2023-10-16T13:40:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fff5d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80b6400 con 0x7f27f815a730 2023-10-16T13:40:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f80cce90 0x7f27f80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f80cce90 0x7f27f80cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44962/0 (socket says 172.21.15.5:44962) 2023-10-16T13:40:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fd4f8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27f80cecf0 0x7f27f815e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54962/0 (socket says 172.21.15.5:54962) 2023-10-16T13:40:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 -- 172.21.15.5:0/3269562548 learned_addr learned my addr 172.21.15.5:0/3269562548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 -- 172.21.15.5:0/3269562548 >> v2:172.21.15.112:3300/0 conn(0x7f27f815a730 msgr2=0x7f27f80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fdcf9700 1 --2- 172.21.15.5:0/3269562548 >> v2:172.21.15.112:3300/0 conn(0x7f27f815a730 0x7f27f80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 --2- 172.21.15.5:0/3269562548 >> v2:172.21.15.112:3300/0 conn(0x7f27f815a730 0x7f27f80b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 -- 172.21.15.5:0/3269562548 >> v1:172.21.15.5:6789/0 conn(0x7f27f80cecf0 legacy=0x7f27f815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 -- 172.21.15.5:0/3269562548 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f815ea30 con 0x7f27f80cce90 2023-10-16T13:40:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fe4fa700 1 --2- 172.21.15.5:0/3269562548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cce90 0x7f27f80cd2a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f27f80b2fe0 tx=0x7f27f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cbb009dbf9d134 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fccf7700 1 -- 172.21.15.5:0/3269562548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000e070 con 0x7f27f80cce90 2023-10-16T13:40:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fccf7700 1 -- 172.21.15.5:0/3269562548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0003a20 con 0x7f27f80cce90 2023-10-16T13:40:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.021+0000 7f27fccf7700 1 -- 172.21.15.5:0/3269562548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003dd0 con 0x7f27f80cce90 2023-10-16T13:40:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 -- 172.21.15.5:0/3269562548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cce90 msgr2=0x7f27f80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 --2- 172.21.15.5:0/3269562548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cce90 0x7f27f80cd2a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f27f80b2fe0 tx=0x7f27f000b330 comp rx=0 tx=0).stop 2023-10-16T13:40:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 -- 172.21.15.5:0/3269562548 shutdown_connections 2023-10-16T13:40:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 --2- 172.21.15.5:0/3269562548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cce90 0x7f27f80cd2a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 --2- 172.21.15.5:0/3269562548 >> v2:172.21.15.112:3300/0 conn(0x7f27f815a730 0x7f27f80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 -- 172.21.15.5:0/3269562548 >> 172.21.15.5:0/3269562548 conn(0x7f27f806dac0 msgr2=0x7f27f806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 -- 172.21.15.5:0/3269562548 shutdown_connections 2023-10-16T13:40:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.022+0000 7f27fff5d700 1 -- 172.21.15.5:0/3269562548 wait complete. 2023-10-16T13:40:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.023+0000 7f27fff5d700 1 Processor -- start 2023-10-16T13:40:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.023+0000 7f27fff5d700 1 -- start start 2023-10-16T13:40:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fff5d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27f80cce90 0x7f27f80c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fff5d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 0x7f27f80c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fff5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f815a730 0x7f27f8155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fff5d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c89f0 con 0x7f27f80cecf0 2023-10-16T13:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fff5d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c7ac0 con 0x7f27f815a730 2023-10-16T13:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fff5d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f81560e0 con 0x7f27f80cce90 2023-10-16T13:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 0x7f27f80c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 0x7f27f80c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44966/0 (socket says 172.21.15.5:44966) 2023-10-16T13:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 -- 172.21.15.5:0/2687657020 learned_addr learned my addr 172.21.15.5:0/2687657020 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fdcf9700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27f80cce90 0x7f27f80c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fe4fa700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f815a730 0x7f27f8155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 -- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27f80cce90 msgr2=0x7f27f80c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27f80cce90 0x7f27f80c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 -- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f815a730 msgr2=0x7f27f8155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f815a730 0x7f27f8155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fd4f8700 1 -- 172.21.15.5:0/2687657020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009b30 con 0x7f27f80cecf0 2023-10-16T13:40:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fdcf9700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27f80cce90 0x7f27f80c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.024+0000 7f27fe4fa700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f815a730 0x7f27f8155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.025+0000 7f27fd4f8700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 0x7f27f80c7580 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c7e0 tx=0x7f27f400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.025+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4004c80 con 0x7f27f80cecf0 2023-10-16T13:40:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.025+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4004de0 con 0x7f27f80cecf0 2023-10-16T13:40:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.025+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f80c7cf0 con 0x7f27f80cecf0 2023-10-16T13:40:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.025+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4007310 con 0x7f27f80cecf0 2023-10-16T13:40:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.025+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f80c82b0 con 0x7f27f80cecf0 2023-10-16T13:40:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.026+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f80c8b30 con 0x7f27f80cecf0 2023-10-16T13:40:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.026+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27f4007470 con 0x7f27f80cecf0 2023-10-16T13:40:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.027+0000 7f27ea7fc700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27dc06af00 0x7f27dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.027+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27f4088730 con 0x7f27f80cecf0 2023-10-16T13:40:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.027+0000 7f27fdcf9700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27dc06af00 0x7f27dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.027+0000 7f27fdcf9700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27dc06af00 0x7f27dc06d3c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.031+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27f80c8b30 con 0x7f27f80cecf0 2023-10-16T13:40:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.316+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f27f80c8b30 con 0x7f27f80cecf0 2023-10-16T13:40:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.318+0000 7f27ea7fc700 1 -- 172.21.15.5:0/2687657020 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f27f80c8b30 con 0x7f27f80cecf0 2023-10-16T13:40:13.321 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:40:13.321 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:40:13.321 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:40:13.321 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:40:13.322 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:40:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27dc06af00 msgr2=0x7f27dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27dc06af00 0x7f27dc06d3c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).stop 2023-10-16T13:40:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 msgr2=0x7f27f80c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 0x7f27f80c7580 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c7e0 tx=0x7f27f400cba0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 shutdown_connections 2023-10-16T13:40:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f815a730 0x7f27f8155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27dc06af00 0x7f27dc06d3c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27f80cce90 0x7f27f80c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 --2- 172.21.15.5:0/2687657020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f80cecf0 0x7f27f80c7580 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 >> 172.21.15.5:0/2687657020 conn(0x7f27f806dac0 msgr2=0x7f27f81596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 shutdown_connections 2023-10-16T13:40:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.320+0000 7f27fff5d700 1 -- 172.21.15.5:0/2687657020 wait complete. 2023-10-16T13:40:13.326 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:40:13.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.458+0000 7fdd1eadd700 1 Processor -- start 2023-10-16T13:40:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.458+0000 7fdd1eadd700 1 -- start start 2023-10-16T13:40:13.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1eadd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd1815bb50 0x7fdd1806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1eadd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd1806ed50 0x7fdd180cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1eadd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1815bf30 con 0x7fdd180ce0b0 2023-10-16T13:40:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1eadd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1806f1d0 con 0x7fdd1806ed50 2023-10-16T13:40:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1eadd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180ce540 con 0x7fdd1815bb50 2023-10-16T13:40:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd1806ed50 0x7fdd180cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1d07a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd180ce0b0 0x7fdd1815f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54978/0 (socket says 172.21.15.5:54978) 2023-10-16T13:40:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1d07a700 1 -- 172.21.15.5:0/349096984 learned_addr learned my addr 172.21.15.5:0/349096984 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 --2- 172.21.15.5:0/349096984 >> v2:172.21.15.5:3300/0 conn(0x7fdd1806ed50 0x7fdd180cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44972/0 (socket says 172.21.15.5:44972) 2023-10-16T13:40:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1c879700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd1815bb50 0x7fdd1806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd177fe700 1 -- 172.21.15.5:0/349096984 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359185269 0 0) 0x7fdd1815bf30 con 0x7fdd180ce0b0 2023-10-16T13:40:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd177fe700 1 -- 172.21.15.5:0/349096984 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd080035b0 con 0x7fdd180ce0b0 2023-10-16T13:40:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 -- 172.21.15.5:0/349096984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd1815bb50 msgr2=0x7fdd1806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd1815bb50 0x7fdd1806e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 -- 172.21.15.5:0/349096984 >> v1:172.21.15.5:6789/0 conn(0x7fdd180ce0b0 legacy=0x7fdd1815f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 -- 172.21.15.5:0/349096984 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1806d500 con 0x7fdd1806ed50 2023-10-16T13:40:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd1c879700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd1815bb50 0x7fdd1806e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd17fff700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1806ed50 0x7fdd180cdb70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009870 tx=0x7fdd04009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668daa91a33d73ff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd177fe700 1 -- 172.21.15.5:0/349096984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04011830 con 0x7fdd1806ed50 2023-10-16T13:40:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd177fe700 1 -- 172.21.15.5:0/349096984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd04011990 con 0x7fdd1806ed50 2023-10-16T13:40:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.459+0000 7fdd177fe700 1 -- 172.21.15.5:0/349096984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04011d20 con 0x7fdd1806ed50 2023-10-16T13:40:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 -- 172.21.15.5:0/349096984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1806ed50 msgr2=0x7fdd180cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1806ed50 0x7fdd180cdb70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009870 tx=0x7fdd04009b80 comp rx=0 tx=0).stop 2023-10-16T13:40:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 -- 172.21.15.5:0/349096984 shutdown_connections 2023-10-16T13:40:13.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd1815bb50 0x7fdd1806e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/349096984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1806ed50 0x7fdd180cdb70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 -- 172.21.15.5:0/349096984 >> 172.21.15.5:0/349096984 conn(0x7fdd180cc6f0 msgr2=0x7fdd180ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:13.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 -- 172.21.15.5:0/349096984 shutdown_connections 2023-10-16T13:40:13.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.460+0000 7fdd1eadd700 1 -- 172.21.15.5:0/349096984 wait complete. 2023-10-16T13:40:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.461+0000 7fdd1eadd700 1 Processor -- start 2023-10-16T13:40:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.461+0000 7fdd1eadd700 1 -- start start 2023-10-16T13:40:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1eadd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd1806ed50 0x7fdd18158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1eadd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd180ce0b0 0x7fdd180c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1eadd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 0x7fdd181f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1eadd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a9380 con 0x7fdd1815bb50 2023-10-16T13:40:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1eadd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a8dc0 con 0x7fdd1806ed50 2023-10-16T13:40:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1eadd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a90a0 con 0x7fdd180ce0b0 2023-10-16T13:40:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1d07a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 0x7fdd181f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1d07a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 0x7fdd181f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44980/0 (socket says 172.21.15.5:44980) 2023-10-16T13:40:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.462+0000 7fdd1d07a700 1 -- 172.21.15.5:0/3256833204 learned_addr learned my addr 172.21.15.5:0/3256833204 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:13.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd17fff700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd180ce0b0 0x7fdd180c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1c879700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd1806ed50 0x7fdd18158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1d07a700 1 -- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd180ce0b0 msgr2=0x7fdd180c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1d07a700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd180ce0b0 0x7fdd180c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1d07a700 1 -- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd1806ed50 msgr2=0x7fdd18158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1d07a700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd1806ed50 0x7fdd18158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1d07a700 1 -- 172.21.15.5:0/3256833204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040094a0 con 0x7fdd1815bb50 2023-10-16T13:40:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd17fff700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd180ce0b0 0x7fdd180c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1d07a700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 0x7fdd181f43b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000cb40 tx=0x7fdd1000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:13.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000ab50 con 0x7fdd1815bb50 2023-10-16T13:40:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000acb0 con 0x7fdd1815bb50 2023-10-16T13:40:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd180c7e10 con 0x7fdd1815bb50 2023-10-16T13:40:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10012620 con 0x7fdd1815bb50 2023-10-16T13:40:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.463+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd180c66a0 con 0x7fdd1815bb50 2023-10-16T13:40:13.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.464+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd180c8330 con 0x7fdd1815bb50 2023-10-16T13:40:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.464+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd1001b3b0 con 0x7fdd1815bb50 2023-10-16T13:40:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.465+0000 7fdd157fa700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcfc06af00 0x7fdcfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.465+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd10089420 con 0x7fdd1815bb50 2023-10-16T13:40:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.465+0000 7fdd1c879700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcfc06af00 0x7fdcfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:13.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.466+0000 7fdd1c879700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcfc06af00 0x7fdcfc06d3c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdd181f54b0 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:13.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.470+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd180c8330 con 0x7fdd1815bb50 2023-10-16T13:40:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.713+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd180c8330 con 0x7fdd1815bb50 2023-10-16T13:40:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.713+0000 7fdd157fa700 1 -- 172.21.15.5:0/3256833204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fdd180c8330 con 0x7fdd1815bb50 2023-10-16T13:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:03.062480+0000","modified":"2023-10-16T13:40:06.104790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1547849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1547849780},{"type":"v1","addr":"172.21.15.5:6835","nonce":1547849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-16T13:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcfc06af00 msgr2=0x7fdcfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcfc06af00 0x7fdcfc06d3c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdd181f54b0 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2023-10-16T13:40:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 msgr2=0x7fdd181f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 0x7fdd181f43b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000cb40 tx=0x7fdd1000cf00 comp rx=0 tx=0).stop 2023-10-16T13:40:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 shutdown_connections 2023-10-16T13:40:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd1815bb50 0x7fdd181f43b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd1806ed50 0x7fdd18158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcfc06af00 0x7fdcfc06d3c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 --2- 172.21.15.5:0/3256833204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd180ce0b0 0x7fdd180c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 >> 172.21.15.5:0/3256833204 conn(0x7fdd180cc6f0 msgr2=0x7fdd180ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 shutdown_connections 2023-10-16T13:40:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:13.716+0000 7fdd1eadd700 1 -- 172.21.15.5:0/3256833204 wait complete. 2023-10-16T13:40:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2023-10-16T13:40:14.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:40:03.062480+0000', 'modified': '2023-10-16T13:40:06.104790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5586': {'gid': 5586, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1547849780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 1547849780}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1547849780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:40:14.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:40:14.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T13:40:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.261+0000 7fc2eb2ff700 1 Processor -- start 2023-10-16T13:40:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2eb2ff700 1 -- start start 2023-10-16T13:40:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2eb2ff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2e40cc3f0 0x7fc2e40cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2eb2ff700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e4071ab0 con 0x7fc2e406af50 2023-10-16T13:40:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2eb2ff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e4161bc0 con 0x7fc2e4161670 2023-10-16T13:40:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2eb2ff700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e4161ea0 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2e909b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2e40cc3f0 0x7fc2e40cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2e909b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2e40cc3f0 0x7fc2e40cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44984/0 (socket says 172.21.15.5:44984) 2023-10-16T13:40:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.262+0000 7fc2e909b700 1 -- 172.21.15.5:0/645172755 learned_addr learned my addr 172.21.15.5:0/645172755 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2e909b700 1 -- 172.21.15.5:0/645172755 >> v1:172.21.15.112:6789/0 conn(0x7fc2e4161670 legacy=0x7fc2e406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2e909b700 1 -- 172.21.15.5:0/645172755 >> v1:172.21.15.5:6789/0 conn(0x7fc2e406af50 legacy=0x7fc2e4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2e909b700 1 -- 172.21.15.5:0/645172755 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4162180 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2dbfff700 1 -- 172.21.15.5:0/645172755 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807770483 0 0) 0x7fc2e4071ab0 con 0x7fc2e406af50 2023-10-16T13:40:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2e909b700 1 --2- 172.21.15.5:0/645172755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e40cc7d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40098f0 tx=0x7fc2d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba938aa16e9fed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2dbfff700 1 -- 172.21.15.5:0/645172755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4004230 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2dbfff700 1 -- 172.21.15.5:0/645172755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4004390 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.263+0000 7fc2dbfff700 1 -- 172.21.15.5:0/645172755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40036a0 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/645172755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 msgr2=0x7fc2e40cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/645172755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e40cc7d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40098f0 tx=0x7fc2d4009c00 comp rx=0 tx=0).stop 2023-10-16T13:40:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/645172755 shutdown_connections 2023-10-16T13:40:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/645172755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e40cc7d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/645172755 >> 172.21.15.5:0/645172755 conn(0x7fc2e406dac0 msgr2=0x7fc2e406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/645172755 shutdown_connections 2023-10-16T13:40:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.264+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/645172755 wait complete. 2023-10-16T13:40:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.265+0000 7fc2eb2ff700 1 Processor -- start 2023-10-16T13:40:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.265+0000 7fc2eb2ff700 1 -- start start 2023-10-16T13:40:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2eb2ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2e406af50 0x7fc2e40b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2eb2ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2eb2ff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2e4161670 0x7fc2e40b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2eb2ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40c7c00 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2eb2ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40af2a0 con 0x7fc2e406af50 2023-10-16T13:40:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2eb2ff700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40b3520 con 0x7fc2e4161670 2023-10-16T13:40:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44990/0 (socket says 172.21.15.5:44990) 2023-10-16T13:40:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 -- 172.21.15.5:0/3415278637 learned_addr learned my addr 172.21.15.5:0/3415278637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2e406af50 0x7fc2e40b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e989c700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2e4161670 0x7fc2e40b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 -- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2e4161670 msgr2=0x7fc2e40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2e4161670 0x7fc2e40b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 -- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2e406af50 msgr2=0x7fc2e40b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2e406af50 0x7fc2e40b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 -- 172.21.15.5:0/3415278637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4009550 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e415ef40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c4d0 tx=0x7fc2e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.266+0000 7fc2d9ffb700 1 -- 172.21.15.5:0/3415278637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0011790 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.267+0000 7fc2d9ffb700 1 -- 172.21.15.5:0/3415278637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00118f0 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.267+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e40b3800 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.267+0000 7fc2d9ffb700 1 -- 172.21.15.5:0/3415278637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0011ca0 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.267+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40b3dc0 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.268+0000 7fc2d9ffb700 1 -- 172.21.15.5:0/3415278637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc2e001c460 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.268+0000 7fc2d9ffb700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc2c806af00 0x7fc2c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.269+0000 7fc2d9ffb700 1 -- 172.21.15.5:0/3415278637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2e0089420 con 0x7fc2e40cc3f0 2023-10-16T13:40:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.269+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc2c806af00 0x7fc2c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.269+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc2c806af00 0x7fc2c806d3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009130 tx=0x7fc2d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.270+0000 7fc2f74e9b80 1 Processor -- start 2023-10-16T13:40:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 -- start start 2023-10-16T13:40:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bfea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 0x564fe1bfefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1bd26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1b48c20 con 0x564fe1bfc630 2023-10-16T13:40:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1b2dc10 con 0x564fe1bf7220 2023-10-16T13:40:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fe1b2b530 con 0x564fe1bd2010 2023-10-16T13:40:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2e889a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 0x564fe1bfefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2e889a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 0x564fe1bfefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44998/0 (socket says 172.21.15.5:44998) 2023-10-16T13:40:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2e889a700 1 -- 172.21.15.5:0/1497095221 learned_addr learned my addr 172.21.15.5:0/1497095221 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.271+0000 7fc2e909b700 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bfea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e989c700 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1bd26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e889a700 1 -- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 msgr2=0x564fe1bd26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e889a700 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1bd26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e889a700 1 -- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 msgr2=0x564fe1bfea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e889a700 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bfea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e889a700 1 -- 172.21.15.5:0/1497095221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fe1ae43a0 con 0x564fe1bfc630 2023-10-16T13:40:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2e889a700 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 0x564fe1bfefb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0087a00 tx=0x7fc2e0054690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336f7ea0ec07b599 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2ceffd700 1 -- 172.21.15.5:0/1497095221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e006f070 con 0x564fe1bfc630 2023-10-16T13:40:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2ceffd700 1 -- 172.21.15.5:0/1497095221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e005c370 con 0x564fe1bfc630 2023-10-16T13:40:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.272+0000 7fc2ceffd700 1 -- 172.21.15.5:0/1497095221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0060520 con 0x564fe1bfc630 2023-10-16T13:40:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/1497095221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 msgr2=0x564fe1bfefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 0x564fe1bfefb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0087a00 tx=0x7fc2e0054690 comp rx=0 tx=0).stop 2023-10-16T13:40:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/1497095221 shutdown_connections 2023-10-16T13:40:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1bd26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bfea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/1497095221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bfc630 0x564fe1bfefb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/1497095221 >> 172.21.15.5:0/1497095221 conn(0x564fe1b01d80 msgr2=0x564fe1c1cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/1497095221 shutdown_connections 2023-10-16T13:40:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/1497095221 wait complete. 2023-10-16T13:40:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.273+0000 7fc2f74e9b80 1 -- start start 2023-10-16T13:40:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 Processor -- start 2023-10-16T13:40:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bf7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bf8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1bfda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1b26e20 con 0x564fe1bd2010 2023-10-16T13:40:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1ac36c0 con 0x564fe1bf7220 2023-10-16T13:40:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.274+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fe1ac3360 con 0x564fe1bfc630 2023-10-16T13:40:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2f74e9b80 10 client.0 _ll_register_callbacks cb 0x564fe19207b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:40:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bf7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bf7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45002/0 (socket says 172.21.15.5:45002) 2023-10-16T13:40:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 -- 172.21.15.5:0/3948207792 learned_addr learned my addr 172.21.15.5:0/3948207792 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e989c700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1bfda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bf8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 -- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 msgr2=0x564fe1bfda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1bfda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 -- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 msgr2=0x564fe1bf8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bf8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 -- 172.21.15.5:0/3948207792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40b3dc0 con 0x564fe1bd2010 2023-10-16T13:40:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bf7ac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b0e0 tx=0x7fc2d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6cd744b5a0a0d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:40:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3948207792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400bd40 con 0x564fe1bd2010 2023-10-16T13:40:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3948207792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2d401c450 con 0x564fe1bd2010 2023-10-16T13:40:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fe1bc75b0 con 0x564fe1bd2010 2023-10-16T13:40:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3948207792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d400bea0 con 0x564fe1bd2010 2023-10-16T13:40:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2f74e9b80 10 client.5745 fetch_fsmap learned FSMap version 31 2023-10-16T13:40:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.275+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x564fe1951d90 con 0x564fe1bd2010 2023-10-16T13:40:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3948207792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564fe1bc75b0 con 0x564fe1bd2010 2023-10-16T13:40:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3948207792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc2d401c610 con 0x564fe1bd2010 2023-10-16T13:40:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2f74e9b80 10 client.5745 fetch_fsmap finished waiting for FSMap version 31 2023-10-16T13:40:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2f74e9b80 10 client.5745 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:40:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2f74e9b80 20 client.5745 populate_metadata read hostname 'smithi005' 2023-10-16T13:40:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bf63b0 0x564fe1bfffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2f74e9b80 4 client.5745 mds_command: new command op to 5586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:40:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 --> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fe1b1fe00 con 0x564fe1bf63b0 2023-10-16T13:40:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bf63b0 0x564fe1bfffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2c3fff700 10 client.5745 ms_handle_connect on v2:172.21.15.5:6833/1547849780 2023-10-16T13:40:14.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.276+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bf63b0 0x564fe1bfffe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef429d20bfacd473 server_cookie=69fad8967f5953f5 in_seq=0 out_seq=0 2023-10-16T13:40:14.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3948207792 <== mds.0 v2:172.21.15.5:6833/1547849780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564fe1b1fe00 con 0x564fe1bf63b0 2023-10-16T13:40:14.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2c3fff700 10 client.5745 handle_command_reply: tid=0 2023-10-16T13:40:14.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 client.5745 shutdown 2023-10-16T13:40:14.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 msgr2=0x564fe1bf7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bf7ac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b0e0 tx=0x7fc2d40047c0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 shutdown_connections 2023-10-16T13:40:14.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bf63b0 0x564fe1bfffe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1bfda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bf7ac0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3948207792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1bf8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2c3fff700 0 client.5745 ms_handle_reset on v2:172.21.15.5:6833/1547849780 2023-10-16T13:40:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 >> 172.21.15.5:0/3948207792 conn(0x564fe1b01d80 msgr2=0x564fe1c138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 shutdown_connections 2023-10-16T13:40:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3948207792 wait complete. 2023-10-16T13:40:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.277+0000 7fc2f74e9b80 20 client.5745 trim_cache size 0 max 16384 2023-10-16T13:40:14.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.295+0000 7fc2f74e9b80 1 Processor -- start 2023-10-16T13:40:14.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.295+0000 7fc2f74e9b80 1 -- start start 2023-10-16T13:40:14.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.295+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bfb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1c28300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1c28840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe19a78d0 con 0x564fe1bd2010 2023-10-16T13:40:14.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1c1a400 con 0x564fe1bf7220 2023-10-16T13:40:14.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fe1c007e0 con 0x564fe1bfc630 2023-10-16T13:40:14.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bfb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bfb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45010/0 (socket says 172.21.15.5:45010) 2023-10-16T13:40:14.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 -- 172.21.15.5:0/2163602574 learned_addr learned my addr 172.21.15.5:0/2163602574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e989c700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1c28840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 -- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 msgr2=0x564fe1c28840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1c28840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 -- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 msgr2=0x564fe1c28300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e889a700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1c28300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1c28300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 -- 172.21.15.5:0/2163602574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fe193ac10 con 0x564fe1bd2010 2023-10-16T13:40:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e989c700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1c28840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e889a700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1c28300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2e909b700 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bfb2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40045e0 tx=0x7fc2d402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceff39a07058e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2cf7fe700 1 -- 172.21.15.5:0/2163602574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400b980 con 0x564fe1bd2010 2023-10-16T13:40:14.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2cf7fe700 1 -- 172.21.15.5:0/2163602574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4006ab0 con 0x564fe1bd2010 2023-10-16T13:40:14.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.296+0000 7fc2cf7fe700 1 -- 172.21.15.5:0/2163602574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d401cad0 con 0x564fe1bd2010 2023-10-16T13:40:14.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/2163602574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 msgr2=0x564fe1bfb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bfb2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40045e0 tx=0x7fc2d402c040 comp rx=0 tx=0).stop 2023-10-16T13:40:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/2163602574 shutdown_connections 2023-10-16T13:40:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bfc630 0x564fe1c28840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bd2010 0x564fe1bfb2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/2163602574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bf7220 0x564fe1c28300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/2163602574 >> 172.21.15.5:0/2163602574 conn(0x564fe1b01d80 msgr2=0x564fe1c138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/2163602574 shutdown_connections 2023-10-16T13:40:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/2163602574 wait complete. 2023-10-16T13:40:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.297+0000 7fc2f74e9b80 1 -- start start 2023-10-16T13:40:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.298+0000 7fc2f74e9b80 1 Processor -- start 2023-10-16T13:40:14.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1c2af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 0x564fe1c1d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bfc630 0x564fe1c1d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1c80e40 con 0x564fe1bf7220 2023-10-16T13:40:14.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fe1bf7600 con 0x564fe1bfc630 2023-10-16T13:40:14.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fe1bf8420 con 0x564fe1bd2010 2023-10-16T13:40:14.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2f74e9b80 10 client.0 _ll_register_callbacks cb 0x7fc2d4004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:40:14.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 0x564fe1c1d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 0x564fe1c1d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45018/0 (socket says 172.21.15.5:45018) 2023-10-16T13:40:14.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 -- 172.21.15.5:0/3211865221 learned_addr learned my addr 172.21.15.5:0/3211865221 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1c2af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e989c700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bfc630 0x564fe1c1d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 -- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 msgr2=0x564fe1c2af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1c2af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 -- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bfc630 msgr2=0x564fe1c1d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bfc630 0x564fe1c1d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 -- 172.21.15.5:0/3211865221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fe1951d90 con 0x564fe1bf7220 2023-10-16T13:40:14.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1c2af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:14.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2e889a700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 0x564fe1c1d070 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0054720 tx=0x7fc2e001e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31248421e42c4d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.299+0000 7fc2c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:40:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3211865221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e006f040 con 0x564fe1bf7220 2023-10-16T13:40:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3211865221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2e0087030 con 0x564fe1bf7220 2023-10-16T13:40:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2e005c370 con 0x564fe1bf7220 2023-10-16T13:40:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3211865221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2e005c120 con 0x564fe1bf7220 2023-10-16T13:40:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 10 client.5751 fetch_fsmap learned FSMap version 31 2023-10-16T13:40:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x564fe1978200 con 0x564fe1bf7220 2023-10-16T13:40:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3211865221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e005c370 con 0x564fe1bf7220 2023-10-16T13:40:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3211865221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc2e000e280 con 0x564fe1bf7220 2023-10-16T13:40:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 10 client.5751 fetch_fsmap finished waiting for FSMap version 31 2023-10-16T13:40:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 10 client.5751 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:40:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 20 client.5751 populate_metadata read hostname 'smithi005' 2023-10-16T13:40:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bd2b60 0x564fe1bd2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 4 client.5751 mds_command: new command op to 5586 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:40:14.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 --> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564fe1b1fb20 con 0x564fe1bd2b60 2023-10-16T13:40:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bd2b60 0x564fe1bd2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2c3fff700 10 client.5751 ms_handle_connect on v2:172.21.15.5:6833/1547849780 2023-10-16T13:40:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.300+0000 7fc2e909b700 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bd2b60 0x564fe1bd2f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d794c8c37538ad server_cookie=249b9be1b5c01c88 in_seq=0 out_seq=0 2023-10-16T13:40:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2c3fff700 1 -- 172.21.15.5:0/3211865221 <== mds.0 v2:172.21.15.5:6833/1547849780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564fe1b1fb20 con 0x564fe1bd2b60 2023-10-16T13:40:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2c3fff700 10 client.5751 handle_command_reply: tid=0 2023-10-16T13:40:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 client.5751 shutdown 2023-10-16T13:40:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 msgr2=0x564fe1c1d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 0x564fe1c1d070 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0054720 tx=0x7fc2e001e070 comp rx=0 tx=0).stop 2023-10-16T13:40:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 shutdown_connections 2023-10-16T13:40:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564fe1bfc630 0x564fe1c1d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:6833/1547849780,v1:172.21.15.5:6835/1547849780] conn(0x564fe1bd2b60 0x564fe1bd2f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x564fe1bd2010 0x564fe1c2af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 --2- 172.21.15.5:0/3211865221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fe1bf7220 0x564fe1c1d070 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2c3fff700 0 client.5751 ms_handle_reset on v2:172.21.15.5:6833/1547849780 2023-10-16T13:40:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 >> 172.21.15.5:0/3211865221 conn(0x564fe1b01d80 msgr2=0x564fe1bfb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 shutdown_connections 2023-10-16T13:40:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 1 -- 172.21.15.5:0/3211865221 wait complete. 2023-10-16T13:40:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.301+0000 7fc2f74e9b80 20 client.5751 trim_cache size 0 max 16384 2023-10-16T13:40:14.327 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:40:14.328 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:40:14.328 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:40:14.328 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5586, 2023-10-16T13:40:14.328 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:40:14.329 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:40:14.329 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:40:14.329 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.630901290000001, 2023-10-16T13:40:14.329 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 31, 2023-10-16T13:40:14.329 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 51, 2023-10-16T13:40:14.330 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 51, 2023-10-16T13:40:14.330 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.544510367000001 2023-10-16T13:40:14.330 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:40:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc2c806af00 msgr2=0x7fc2c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc2c806af00 0x7fc2c806d3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009130 tx=0x7fc2d4008030 comp rx=0 tx=0).stop 2023-10-16T13:40:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 msgr2=0x7fc2e415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e415ef40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c4d0 tx=0x7fc2e000c890 comp rx=0 tx=0).stop 2023-10-16T13:40:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 shutdown_connections 2023-10-16T13:40:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc2c806af00 0x7fc2c806d3c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2e4161670 0x7fc2e40b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2e406af50 0x7fc2e40b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 --2- 172.21.15.5:0/3415278637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40cc3f0 0x7fc2e415ef40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 >> 172.21.15.5:0/3415278637 conn(0x7fc2e406dac0 msgr2=0x7fc2e4160740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 shutdown_connections 2023-10-16T13:40:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.302+0000 7fc2eb2ff700 1 -- 172.21.15.5:0/3415278637 wait complete. 2023-10-16T13:40:14.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:40:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.456+0000 7f992d222700 1 Processor -- start 2023-10-16T13:40:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.456+0000 7f992d222700 1 -- start start 2023-10-16T13:40:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992d222700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f992815e2f0 0x7f99280cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992d222700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f992806a840 0x7f992806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992d222700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280b2d60 con 0x7f99280cd950 2023-10-16T13:40:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992d222700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99281619a0 con 0x7f992815e2f0 2023-10-16T13:40:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992d222700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992806b1f0 con 0x7f992806a840 2023-10-16T13:40:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f992815e2f0 0x7f99280cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f9926d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f99280cd950 0x7f992815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55028/0 (socket says 172.21.15.5:55028) 2023-10-16T13:40:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f9926d9d700 1 -- 172.21.15.5:0/2498773898 learned_addr learned my addr 172.21.15.5:0/2498773898 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.457+0000 7f992759e700 1 --2- 172.21.15.5:0/2498773898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f992806a840 0x7f992806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992659c700 1 -- 172.21.15.5:0/2498773898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f992806a840 msgr2=0x7f992806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992659c700 1 --2- 172.21.15.5:0/2498773898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f992806a840 0x7f992806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992659c700 1 -- 172.21.15.5:0/2498773898 >> v1:172.21.15.5:6789/0 conn(0x7f99280cd950 legacy=0x7f992815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f9925d9b700 1 -- 172.21.15.5:0/2498773898 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332209963 0 0) 0x7f99280b2d60 con 0x7f99280cd950 2023-10-16T13:40:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992659c700 1 -- 172.21.15.5:0/2498773898 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280cdd30 con 0x7f992815e2f0 2023-10-16T13:40:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992659c700 1 --2- 172.21.15.5:0/2498773898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99280cede0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9928161ae0 tx=0x7f9910009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866c7f7660988f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f9925d9b700 1 -- 172.21.15.5:0/2498773898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910015070 con 0x7f992815e2f0 2023-10-16T13:40:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f9925d9b700 1 -- 172.21.15.5:0/2498773898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910005c30 con 0x7f992815e2f0 2023-10-16T13:40:14.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f9925d9b700 1 -- 172.21.15.5:0/2498773898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910004020 con 0x7f992815e2f0 2023-10-16T13:40:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992d222700 1 -- 172.21.15.5:0/2498773898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 msgr2=0x7f99280cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992d222700 1 --2- 172.21.15.5:0/2498773898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99280cede0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9928161ae0 tx=0x7f9910009b00 comp rx=0 tx=0).stop 2023-10-16T13:40:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992d222700 1 -- 172.21.15.5:0/2498773898 shutdown_connections 2023-10-16T13:40:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992d222700 1 --2- 172.21.15.5:0/2498773898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f992806a840 0x7f992806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.458+0000 7f992d222700 1 --2- 172.21.15.5:0/2498773898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99280cede0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.459+0000 7f992d222700 1 -- 172.21.15.5:0/2498773898 >> 172.21.15.5:0/2498773898 conn(0x7f992806dae0 msgr2=0x7f992806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.459+0000 7f992d222700 1 -- 172.21.15.5:0/2498773898 shutdown_connections 2023-10-16T13:40:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.459+0000 7f992d222700 1 -- 172.21.15.5:0/2498773898 wait complete. 2023-10-16T13:40:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.460+0000 7f992d222700 1 Processor -- start 2023-10-16T13:40:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.460+0000 7f992d222700 1 -- start start 2023-10-16T13:40:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992d222700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f992806a840 0x7f99280c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992d222700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99280cd950 0x7f99281f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992d222700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99281f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992d222700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99281f7d30 con 0x7f992815e2f0 2023-10-16T13:40:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992d222700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99281f4730 con 0x7f992806a840 2023-10-16T13:40:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992d222700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280c5af0 con 0x7f99280cd950 2023-10-16T13:40:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99281f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99281f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45034/0 (socket says 172.21.15.5:45034) 2023-10-16T13:40:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 -- 172.21.15.5:0/2054603405 learned_addr learned my addr 172.21.15.5:0/2054603405 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f9926d9d700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f992806a840 0x7f99280c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992659c700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99280cd950 0x7f99281f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 -- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99280cd950 msgr2=0x7f99281f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99280cd950 0x7f99281f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 -- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f992806a840 msgr2=0x7f99280c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f992806a840 0x7f99280c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.461+0000 7f992759e700 1 -- 172.21.15.5:0/2054603405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910009430 con 0x7f992815e2f0 2023-10-16T13:40:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.462+0000 7f992759e700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99281f77f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9920007e60 tx=0x7f992000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.462+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000ede0 con 0x7f992815e2f0 2023-10-16T13:40:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.462+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9920014420 con 0x7f992815e2f0 2023-10-16T13:40:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.462+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99281f3e90 con 0x7f992815e2f0 2023-10-16T13:40:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.462+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99200147d0 con 0x7f992815e2f0 2023-10-16T13:40:14.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.462+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99281f4450 con 0x7f992815e2f0 2023-10-16T13:40:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.463+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9928067d20 con 0x7f992815e2f0 2023-10-16T13:40:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.463+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9920014930 con 0x7f992815e2f0 2023-10-16T13:40:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.464+0000 7f991f7fe700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f990806af00 0x7f990806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:14.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.464+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9920089ca0 con 0x7f992815e2f0 2023-10-16T13:40:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.464+0000 7f9926d9d700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f990806af00 0x7f990806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.465+0000 7f9926d9d700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f990806af00 0x7f990806d3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9918000f60 tx=0x7f9918007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:14.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.469+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9920054de0 con 0x7f992815e2f0 2023-10-16T13:40:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.714+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99280b2630 con 0x7f992815e2f0 2023-10-16T13:40:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.715+0000 7f991f7fe700 1 -- 172.21.15.5:0/2054603405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9920058400 con 0x7f992815e2f0 2023-10-16T13:40:14.718 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:40:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f990806af00 msgr2=0x7f990806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f990806af00 0x7f990806d3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9918000f60 tx=0x7f9918007be0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 msgr2=0x7f99281f77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99281f77f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9920007e60 tx=0x7f992000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 shutdown_connections 2023-10-16T13:40:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f992815e2f0 0x7f99281f77f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f992806a840 0x7f99280c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f990806af00 0x7f990806d3c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 --2- 172.21.15.5:0/2054603405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99280cd950 0x7f99281f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 >> 172.21.15.5:0/2054603405 conn(0x7f992806dae0 msgr2=0x7f99280b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 shutdown_connections 2023-10-16T13:40:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:14.717+0000 7f992d222700 1 -- 172.21.15.5:0/2054603405 wait complete. 2023-10-16T13:40:14.732 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:40:14.732 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:40:14.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:40:14.733 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:40:14.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:14.733 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:40:14.734 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:40:14.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:40:14.734 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:40:14.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:14.735 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:40:14.753 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:40:14.753 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:40:14.753 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:40:14.753 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.753 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:40:14.754 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:14.754 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:14.755 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:14.755 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:40:14.755 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:14.755 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:40:14.755 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42288sec preferred_lft 42288sec 2023-10-16T13:40:14.756 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:40:14.756 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.756 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:14.756 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:14.756 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:40:14.757 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:14.757 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:40:14.757 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.757 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:40:14.757 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.758 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:14.758 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:40:14.758 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:40:14.758 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.758 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:14.759 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:40:14.759 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:40:14.759 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:14.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:14.760 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:40:14.819 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:40:14.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:14.821 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:40:14.879 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:40:14.880 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:40:14.880 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:40:14.880 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:40:14.881 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:40:14.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:14.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:40:14.882 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:40:14.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:40:14.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:40:14.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:40:14.883 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:40:14.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:14.989 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:40:15.006 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:40:15.006 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:40:15.006 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:40:15.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:15.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:40:15.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:15.074 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:15.131 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:40:15.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:15.132 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:15.189 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:40:15.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:15.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:15.276 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:15.276 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:15.308 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:15.308 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:15.308 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:15.309 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:15.309 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:15.309 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:15.309 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:15.309 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:15.381 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:15.382 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:15.382 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:15.382 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:15.382 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:15.383 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:15.383 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:15.383 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:15.383 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:40:15.383 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:40:15.384 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:40:15.385 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:40:15.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:15.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:15.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:15.414 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:40:15.496 INFO:teuthology.orchestra.run.smithi005.stdout:client5171 2023-10-16T13:40:15.496 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:15.497 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:15.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:40:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.717+0000 7f6cea596700 1 Processor -- start 2023-10-16T13:40:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.717+0000 7f6cea596700 1 -- start start 2023-10-16T13:40:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6cea596700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce40d08a0 0x7f6ce40d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6cea596700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ce40b7ab0 0x7f6ce40ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6cea596700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40b6610 con 0x7f6ce4160e30 2023-10-16T13:40:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6cea596700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40d1da0 con 0x7f6ce40b7ab0 2023-10-16T13:40:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6cea596700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40d2080 con 0x7f6ce40d08a0 2023-10-16T13:40:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ce4160e30 0x7f6ce40d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55046/0 (socket says 172.21.15.5:55046) 2023-10-16T13:40:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce3fff700 1 -- 172.21.15.5:0/2850976496 learned_addr learned my addr 172.21.15.5:0/2850976496 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce8b33700 1 --2- 172.21.15.5:0/2850976496 >> v2:172.21.15.5:3300/0 conn(0x7f6ce40b7ab0 0x7f6ce40ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce37fe700 1 --2- 172.21.15.5:0/2850976496 >> v2:172.21.15.112:3300/0 conn(0x7f6ce40d08a0 0x7f6ce40d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce2ffd700 1 -- 172.21.15.5:0/2850976496 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746218383 0 0) 0x7f6ce40b6610 con 0x7f6ce4160e30 2023-10-16T13:40:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce2ffd700 1 -- 172.21.15.5:0/2850976496 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ccc0035b0 con 0x7f6ce4160e30 2023-10-16T13:40:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce8b33700 1 -- 172.21.15.5:0/2850976496 >> v2:172.21.15.112:3300/0 conn(0x7f6ce40d08a0 msgr2=0x7f6ce40d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce8b33700 1 --2- 172.21.15.5:0/2850976496 >> v2:172.21.15.112:3300/0 conn(0x7f6ce40d08a0 0x7f6ce40d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce8b33700 1 -- 172.21.15.5:0/2850976496 >> v1:172.21.15.5:6789/0 conn(0x7f6ce4160e30 legacy=0x7f6ce40d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.718+0000 7f6ce8b33700 1 -- 172.21.15.5:0/2850976496 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40d2360 con 0x7f6ce40b7ab0 2023-10-16T13:40:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6ce8b33700 1 --2- 172.21.15.5:0/2850976496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40b7ab0 0x7f6ce40ce3d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40cdf10 tx=0x7f6cdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13fba6758d2a204 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6ce2ffd700 1 -- 172.21.15.5:0/2850976496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00e070 con 0x7f6ce40b7ab0 2023-10-16T13:40:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6ce2ffd700 1 -- 172.21.15.5:0/2850976496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc00bb20 con 0x7f6ce40b7ab0 2023-10-16T13:40:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6ce2ffd700 1 -- 172.21.15.5:0/2850976496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc012430 con 0x7f6ce40b7ab0 2023-10-16T13:40:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 -- 172.21.15.5:0/2850976496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40b7ab0 msgr2=0x7f6ce40ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 --2- 172.21.15.5:0/2850976496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40b7ab0 0x7f6ce40ce3d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40cdf10 tx=0x7f6cdc00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 -- 172.21.15.5:0/2850976496 shutdown_connections 2023-10-16T13:40:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 --2- 172.21.15.5:0/2850976496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40b7ab0 0x7f6ce40ce3d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 --2- 172.21.15.5:0/2850976496 >> v2:172.21.15.112:3300/0 conn(0x7f6ce40d08a0 0x7f6ce40d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 -- 172.21.15.5:0/2850976496 >> 172.21.15.5:0/2850976496 conn(0x7f6ce409cb40 msgr2=0x7f6ce40d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 -- 172.21.15.5:0/2850976496 shutdown_connections 2023-10-16T13:40:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.719+0000 7f6cea596700 1 -- 172.21.15.5:0/2850976496 wait complete. 2023-10-16T13:40:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.721+0000 7f6cea596700 1 Processor -- start 2023-10-16T13:40:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.721+0000 7f6cea596700 1 -- start start 2023-10-16T13:40:15.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.721+0000 7f6cea596700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce40b7ab0 0x7f6ce415ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:15.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 0x7f6ce415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:15.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4160e30 0x7f6ce415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:15.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c7de0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c80c0 con 0x7f6ce4160e30 2023-10-16T13:40:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40ca930 con 0x7f6ce40b7ab0 2023-10-16T13:40:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 0x7f6ce415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 0x7f6ce415bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45050/0 (socket says 172.21.15.5:45050) 2023-10-16T13:40:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 -- 172.21.15.5:0/3309937179 learned_addr learned my addr 172.21.15.5:0/3309937179 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce8b33700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4160e30 0x7f6ce415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce3fff700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce40b7ab0 0x7f6ce415ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 -- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce40b7ab0 msgr2=0x7f6ce415ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce40b7ab0 0x7f6ce415ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 -- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4160e30 msgr2=0x7f6ce415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4160e30 0x7f6ce415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 -- 172.21.15.5:0/3309937179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc009a70 con 0x7f6ce40d08a0 2023-10-16T13:40:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce3fff700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce40b7ab0 0x7f6ce415ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce37fe700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 0x7f6ce415bce0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800e980 tx=0x7f6cd800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8009710 con 0x7f6ce40d08a0 2023-10-16T13:40:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd800eed0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce40cac10 con 0x7f6ce40d08a0 2023-10-16T13:40:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800ca90 con 0x7f6ce40d08a0 2023-10-16T13:40:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.722+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce415b1a0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.723+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4067d20 con 0x7f6ce40d08a0 2023-10-16T13:40:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.724+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6cd800cbf0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.724+0000 7f6ce0ff9700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cd006af00 0x7f6cd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.725+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd80896e0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.725+0000 7f6ce3fff700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cd006af00 0x7f6cd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:15.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.725+0000 7f6ce3fff700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cd006af00 0x7f6cd006d3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40010e0 tx=0x7f6cd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:15.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.729+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cd80546f0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.976+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ce40b5cd0 con 0x7f6ce40d08a0 2023-10-16T13:40:15.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.976+0000 7f6ce0ff9700 1 -- 172.21.15.5:0/3309937179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6cd8057d10 con 0x7f6ce40d08a0 2023-10-16T13:40:15.979 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:40:15.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cd006af00 msgr2=0x7f6cd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:15.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cd006af00 0x7f6cd006d3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40010e0 tx=0x7f6cd4009040 comp rx=0 tx=0).stop 2023-10-16T13:40:15.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 msgr2=0x7f6ce415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:15.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 0x7f6ce415bce0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800e980 tx=0x7f6cd800ec90 comp rx=0 tx=0).stop 2023-10-16T13:40:15.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 shutdown_connections 2023-10-16T13:40:15.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4160e30 0x7f6ce415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cd006af00 0x7f6cd006d3c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce40b7ab0 0x7f6ce415ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 --2- 172.21.15.5:0/3309937179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce40d08a0 0x7f6ce415bce0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 >> 172.21.15.5:0/3309937179 conn(0x7f6ce409cb40 msgr2=0x7f6ce40ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 shutdown_connections 2023-10-16T13:40:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:15.978+0000 7f6cea596700 1 -- 172.21.15.5:0/3309937179 wait complete. 2023-10-16T13:40:15.993 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:40:15.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:40:15.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:40:15.994 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:40:15.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:15.995 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:40:15.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:40:15.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:40:15.995 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:40:15.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:15.996 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:40:16.017 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:40:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:40:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:40:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:40:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.019 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:16.019 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:16.019 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:16.019 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:16.019 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:16.020 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:16.020 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:40:16.020 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:16.021 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:40:16.021 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42302sec preferred_lft 42302sec 2023-10-16T13:40:16.021 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:40:16.021 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.021 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:40:16.021 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:16.022 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:40:16.022 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.022 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:40:16.022 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.023 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:16.023 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:40:16.023 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:40:16.023 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.023 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:16.023 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:40:16.024 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:40:16.024 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:16.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.025 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:40:16.088 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:40:16.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.090 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:40:16.151 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:40:16.151 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:40:16.151 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:40:16.152 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:40:16.152 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:40:16.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.153 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:40:16.154 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:40:16.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:40:16.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:40:16.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:40:16.156 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:40:16.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.260 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:40:16.277 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:40:16.278 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:40:16.278 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:40:16.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:40:16.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:16.344 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:16.401 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:40:16.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:16.402 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:16.457 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:40:16.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:16.543 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:16.543 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:16.570 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:16.570 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:16.570 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:40:16.604 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:40:16.604 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:40:16.605 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:40:16.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.606 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:16.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:16.641 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:40:16.712 INFO:teuthology.orchestra.run.smithi112.stdout:client5177 2023-10-16T13:40:16.713 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:16.713 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:16.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:40:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.912+0000 7f086e144700 1 Processor -- start 2023-10-16T13:40:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.912+0000 7f086e144700 1 -- start start 2023-10-16T13:40:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f086e144700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f086815d840 0x7f0868162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f086e144700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680cee20 con 0x7f08680cdfd0 2023-10-16T13:40:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f086e144700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680b2ce0 con 0x7f08680cda40 2023-10-16T13:40:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f086e144700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680ceb40 con 0x7f086815d840 2023-10-16T13:40:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f08677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f086815d840 0x7f0868162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f0866ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08680cdfd0 0x7f08680cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55060/0 (socket says 172.21.15.5:55060) 2023-10-16T13:40:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f08677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f086815d840 0x7f0868162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45056/0 (socket says 172.21.15.5:45056) 2023-10-16T13:40:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.913+0000 7f0866ffd700 1 -- 172.21.15.5:0/2549423950 learned_addr learned my addr 172.21.15.5:0/2549423950 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08677fe700 1 -- 172.21.15.5:0/2549423950 >> v1:172.21.15.112:6789/0 conn(0x7f08680cda40 legacy=0x7f08680caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08677fe700 1 -- 172.21.15.5:0/2549423950 >> v1:172.21.15.5:6789/0 conn(0x7f08680cdfd0 legacy=0x7f08680cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08677fe700 1 -- 172.21.15.5:0/2549423950 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868161590 con 0x7f086815d840 2023-10-16T13:40:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08667fc700 1 -- 172.21.15.5:0/2549423950 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196298218 0 0) 0x7f08680cee20 con 0x7f08680cdfd0 2023-10-16T13:40:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08677fe700 1 --2- 172.21.15.5:0/2549423950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086815d840 0x7f0868162070 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0858009840 tx=0x7f0858009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a89706b20443dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08667fc700 1 -- 172.21.15.5:0/2549423950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858011830 con 0x7f086815d840 2023-10-16T13:40:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08667fc700 1 -- 172.21.15.5:0/2549423950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0858011990 con 0x7f086815d840 2023-10-16T13:40:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f08667fc700 1 -- 172.21.15.5:0/2549423950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858011d20 con 0x7f086815d840 2023-10-16T13:40:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f086e144700 1 -- 172.21.15.5:0/2549423950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086815d840 msgr2=0x7f0868162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.914+0000 7f086e144700 1 --2- 172.21.15.5:0/2549423950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086815d840 0x7f0868162070 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0858009840 tx=0x7f0858009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.915+0000 7f086e144700 1 -- 172.21.15.5:0/2549423950 shutdown_connections 2023-10-16T13:40:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.915+0000 7f086e144700 1 --2- 172.21.15.5:0/2549423950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086815d840 0x7f0868162070 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.915+0000 7f086e144700 1 -- 172.21.15.5:0/2549423950 >> 172.21.15.5:0/2549423950 conn(0x7f086806bd70 msgr2=0x7f086806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.915+0000 7f086e144700 1 -- 172.21.15.5:0/2549423950 shutdown_connections 2023-10-16T13:40:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.915+0000 7f086e144700 1 -- 172.21.15.5:0/2549423950 wait complete. 2023-10-16T13:40:16.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.916+0000 7f086e144700 1 Processor -- start 2023-10-16T13:40:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.916+0000 7f086e144700 1 -- start start 2023-10-16T13:40:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f086e144700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 0x7f08680b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f086e144700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08680cdfd0 0x7f08680ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f086e144700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086815d840 0x7f08680c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f086e144700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680b4db0 con 0x7f08680cda40 2023-10-16T13:40:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f086e144700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680c4610 con 0x7f086815d840 2023-10-16T13:40:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f086e144700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08680c48f0 con 0x7f08680cdfd0 2023-10-16T13:40:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 0x7f08680b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 0x7f08680b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45060/0 (socket says 172.21.15.5:45060) 2023-10-16T13:40:16.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 -- 172.21.15.5:0/3999145036 learned_addr learned my addr 172.21.15.5:0/3999145036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:16.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f0866ffd700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08680cdfd0 0x7f08680ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:16.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f0867fff700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086815d840 0x7f08680c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:16.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 -- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08680cdfd0 msgr2=0x7f08680ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:16.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08680cdfd0 0x7f08680ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 -- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086815d840 msgr2=0x7f08680c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086815d840 0x7f08680c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 -- 172.21.15.5:0/3999145036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580094a0 con 0x7f08680cda40 2023-10-16T13:40:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f0866ffd700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08680cdfd0 0x7f08680ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f0867fff700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086815d840 0x7f08680c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.917+0000 7f08677fe700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 0x7f08680b5920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0858009b90 tx=0x7f0858004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.918+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08580036a0 con 0x7f08680cda40 2023-10-16T13:40:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.918+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085801e070 con 0x7f08680cda40 2023-10-16T13:40:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.918+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08680c4bd0 con 0x7f08680cda40 2023-10-16T13:40:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.918+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858003a00 con 0x7f08680cda40 2023-10-16T13:40:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.918+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08680c5190 con 0x7f08680cda40 2023-10-16T13:40:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.919+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868067d20 con 0x7f08680cda40 2023-10-16T13:40:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.919+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0858003b60 con 0x7f08680cda40 2023-10-16T13:40:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.920+0000 7f085ffff700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f084806af00 0x7f084806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.920+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f085808a6c0 con 0x7f08680cda40 2023-10-16T13:40:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.920+0000 7f0866ffd700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f084806af00 0x7f084806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.920+0000 7f0866ffd700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f084806af00 0x7f084806d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f08680c3e30 tx=0x7f0850007ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:16.925+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0858055800 con 0x7f08680cda40 2023-10-16T13:40:17.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.172+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f08680b20c0 con 0x7f08680cda40 2023-10-16T13:40:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.722+0000 7f085ffff700 1 -- 172.21.15.5:0/3999145036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0858058e20 con 0x7f08680cda40 2023-10-16T13:40:17.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f084806af00 msgr2=0x7f084806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f084806af00 0x7f084806d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f08680c3e30 tx=0x7f0850007ce0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 msgr2=0x7f08680b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 0x7f08680b5920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0858009b90 tx=0x7f0858004750 comp rx=0 tx=0).stop 2023-10-16T13:40:17.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 shutdown_connections 2023-10-16T13:40:17.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086815d840 0x7f08680c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08680cda40 0x7f08680b5920 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f084806af00 0x7f084806d3c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 --2- 172.21.15.5:0/3999145036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08680cdfd0 0x7f08680ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.724+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 >> 172.21.15.5:0/3999145036 conn(0x7f086806bd70 msgr2=0x7f08680aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:17.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.725+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 shutdown_connections 2023-10-16T13:40:17.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.725+0000 7f086e144700 1 -- 172.21.15.5:0/3999145036 wait complete. 2023-10-16T13:40:17.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:40:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.873+0000 7fc96eef6700 1 Processor -- start 2023-10-16T13:40:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.873+0000 7fc96eef6700 1 -- start start 2023-10-16T13:40:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc96eef6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 0x7fc9680d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc96eef6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680cce60 con 0x7fc9680ce4c0 2023-10-16T13:40:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc96eef6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680b2ba0 con 0x7fc96815bbc0 2023-10-16T13:40:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc96eef6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680cd4e0 con 0x7fc96815bfa0 2023-10-16T13:40:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc967fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc9680ce4c0 0x7fc9680b0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55074/0 (socket says 172.21.15.5:55074) 2023-10-16T13:40:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc967fff700 1 -- 172.21.15.5:0/834591583 learned_addr learned my addr 172.21.15.5:0/834591583 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc96d493700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 0x7fc9680d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134323286 0 0) 0x7fc9680cce60 con 0x7fc9680ce4c0 2023-10-16T13:40:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9580035b0 con 0x7fc9680ce4c0 2023-10-16T13:40:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.874+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992518153 0 0) 0x7fc9580035b0 con 0x7fc9680ce4c0 2023-10-16T13:40:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 msgr2=0x7fc9680d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 0x7fc9680d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 >> v1:172.21.15.112:6789/0 conn(0x7fc96815bbc0 legacy=0x7fc9680cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680cd100 con 0x7fc9680ce4c0 2023-10-16T13:40:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fc954001670 con 0x7fc9680ce4c0 2023-10-16T13:40:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 >> v1:172.21.15.5:6789/0 conn(0x7fc9680ce4c0 legacy=0x7fc9680b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc958003a30 0x7fc958003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580043e0 0x7fc9580048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 0x7fc9580051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680cd4e0 con 0x7fc958003a30 2023-10-16T13:40:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95800baf0 con 0x7fc9580043e0 2023-10-16T13:40:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95800bcb0 con 0x7fc96815bfa0 2023-10-16T13:40:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc958003a30 0x7fc958003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc967fff700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580043e0 0x7fc9580048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96d493700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 0x7fc9580051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 -- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 msgr2=0x7fc9580051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc96815bfa0 0x7fc9580051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 -- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580043e0 msgr2=0x7fc9580048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580043e0 0x7fc9580048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 -- 172.21.15.5:0/834591583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580035b0 con 0x7fc958003a30 2023-10-16T13:40:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc96cc92700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc958003a30 0x7fc958003e10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc95c001980 tx=0x7fc958005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a735dffe6734b3c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c016070 con 0x7fc958003a30 2023-10-16T13:40:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c006860 con 0x7fc958003a30 2023-10-16T13:40:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.875+0000 7fc9677fe700 1 -- 172.21.15.5:0/834591583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c001420 con 0x7fc958003a30 2023-10-16T13:40:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96eef6700 1 -- 172.21.15.5:0/834591583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc958003a30 msgr2=0x7fc958003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96eef6700 1 --2- 172.21.15.5:0/834591583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc958003a30 0x7fc958003e10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc95c001980 tx=0x7fc958005880 comp rx=0 tx=0).stop 2023-10-16T13:40:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96d493700 1 -- 172.21.15.5:0/834591583 reap_dead start 2023-10-16T13:40:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96eef6700 1 -- 172.21.15.5:0/834591583 shutdown_connections 2023-10-16T13:40:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96eef6700 1 -- 172.21.15.5:0/834591583 >> 172.21.15.5:0/834591583 conn(0x7fc9680d15f0 msgr2=0x7fc9680d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96eef6700 1 -- 172.21.15.5:0/834591583 shutdown_connections 2023-10-16T13:40:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.876+0000 7fc96eef6700 1 -- 172.21.15.5:0/834591583 wait complete. 2023-10-16T13:40:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.877+0000 7fc96eef6700 1 Processor -- start 2023-10-16T13:40:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.877+0000 7fc96eef6700 1 -- start start 2023-10-16T13:40:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96eef6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc958003a30 0x7fc96814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96eef6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 0x7fc9680b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96eef6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9680b1300 0x7fc9680b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96eef6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680b1cf0 con 0x7fc9680b39f0 2023-10-16T13:40:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96eef6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681591d0 con 0x7fc9680b1300 2023-10-16T13:40:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96eef6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680c9860 con 0x7fc958003a30 2023-10-16T13:40:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc967fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 0x7fc9680b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc967fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 0x7fc9680b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45082/0 (socket says 172.21.15.5:45082) 2023-10-16T13:40:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc967fff700 1 -- 172.21.15.5:0/3093119236 learned_addr learned my addr 172.21.15.5:0/3093119236 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96cc92700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc958003a30 0x7fc96814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.878+0000 7fc96d493700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9680b1300 0x7fc9680b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc967fff700 1 -- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc958003a30 msgr2=0x7fc96814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc967fff700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc958003a30 0x7fc96814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc967fff700 1 -- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9680b1300 msgr2=0x7fc9680b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc967fff700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9680b1300 0x7fc9680b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc967fff700 1 -- 172.21.15.5:0/3093119236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680b6190 con 0x7fc9680b39f0 2023-10-16T13:40:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc96d493700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9680b1300 0x7fc9680b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:17.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc967fff700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 0x7fc9680b3e70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc9540072c0 tx=0x7fc9540075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:17.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954011580 con 0x7fc9680b39f0 2023-10-16T13:40:17.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9540116e0 con 0x7fc9680b39f0 2023-10-16T13:40:17.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9680b6470 con 0x7fc9680b39f0 2023-10-16T13:40:17.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954011a90 con 0x7fc9680b39f0 2023-10-16T13:40:17.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.879+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680b6a30 con 0x7fc9680b39f0 2023-10-16T13:40:17.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.880+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9680c99d0 con 0x7fc9680b39f0 2023-10-16T13:40:17.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.881+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc954011bf0 con 0x7fc9680b39f0 2023-10-16T13:40:17.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.881+0000 7fc9657fa700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc94c06af00 0x7fc94c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:17.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.881+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9540894e0 con 0x7fc9680b39f0 2023-10-16T13:40:17.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.881+0000 7fc96cc92700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc94c06af00 0x7fc94c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:17.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.882+0000 7fc96cc92700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc94c06af00 0x7fc94c06d3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc95c000fb0 tx=0x7fc95c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:17.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:17.886+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc954054620 con 0x7fc9680b39f0 2023-10-16T13:40:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.117+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9680b2e80 con 0x7fc94c06af00 2023-10-16T13:40:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.119+0000 7fc9657fa700 1 -- 172.21.15.5:0/3093119236 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc95c00c610 con 0x7fc94c06af00 2023-10-16T13:40:18.121 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:40:18.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:18.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:40:18.122 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:18.122 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:40:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.120+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc94c06af00 msgr2=0x7fc94c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.120+0000 7fc96eef6700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc94c06af00 0x7fc94c06d3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc95c000fb0 tx=0x7fc95c009030 comp rx=0 tx=0).stop 2023-10-16T13:40:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.120+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 msgr2=0x7fc9680b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.120+0000 7fc96eef6700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 0x7fc9680b3e70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc9540072c0 tx=0x7fc9540075d0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 shutdown_connections 2023-10-16T13:40:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9680b1300 0x7fc9680b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc94c06af00 0x7fc94c06d3c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc958003a30 0x7fc96814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 --2- 172.21.15.5:0/3093119236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b39f0 0x7fc9680b3e70 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 >> 172.21.15.5:0/3093119236 conn(0x7fc9680d15f0 msgr2=0x7fc96815a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 shutdown_connections 2023-10-16T13:40:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.121+0000 7fc96eef6700 1 -- 172.21.15.5:0/3093119236 wait complete. 2023-10-16T13:40:18.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:40:18.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.261+0000 7f04ceb29700 1 Processor -- start 2023-10-16T13:40:18.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.261+0000 7f04ceb29700 1 -- start start 2023-10-16T13:40:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04ceb29700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04c80cd950 0x7f04c815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04ceb29700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c80cede0 0x7f04c815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04ceb29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04ceb29700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c81619a0 con 0x7f04c80cede0 2023-10-16T13:40:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04ceb29700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c806b1f0 con 0x7f04c80cd950 2023-10-16T13:40:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04ceb29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80cf290 con 0x7f04c806a840 2023-10-16T13:40:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c80cede0 0x7f04c815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c80cede0 0x7f04c815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45090/0 (socket says 172.21.15.5:45090) 2023-10-16T13:40:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 -- 172.21.15.5:0/2662755764 learned_addr learned my addr 172.21.15.5:0/2662755764 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04cc8c5700 1 --2- 172.21.15.5:0/2662755764 >> v2:172.21.15.112:3300/0 conn(0x7f04c80cd950 0x7f04c815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04cd0c6700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 -- 172.21.15.5:0/2662755764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 msgr2=0x7f04c806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 -- 172.21.15.5:0/2662755764 >> v2:172.21.15.112:3300/0 conn(0x7f04c80cd950 msgr2=0x7f04c815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 --2- 172.21.15.5:0/2662755764 >> v2:172.21.15.112:3300/0 conn(0x7f04c80cd950 0x7f04c815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 -- 172.21.15.5:0/2662755764 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80b2d60 con 0x7f04c80cede0 2023-10-16T13:40:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04cc8c5700 1 --2- 172.21.15.5:0/2662755764 >> v2:172.21.15.112:3300/0 conn(0x7f04c80cd950 0x7f04c815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04cd0c6700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.262+0000 7f04c7fff700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c815f570 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f04c80d0430 tx=0x7f04b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae5f47a7293b827 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04c77fe700 1 -- 172.21.15.5:0/2662755764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4005e30 con 0x7f04c80cede0 2023-10-16T13:40:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04c77fe700 1 -- 172.21.15.5:0/2662755764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4004030 con 0x7f04c80cede0 2023-10-16T13:40:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04c77fe700 1 -- 172.21.15.5:0/2662755764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40043e0 con 0x7f04c80cede0 2023-10-16T13:40:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 -- 172.21.15.5:0/2662755764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 msgr2=0x7f04c815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c815f570 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f04c80d0430 tx=0x7f04b4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 -- 172.21.15.5:0/2662755764 shutdown_connections 2023-10-16T13:40:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 --2- 172.21.15.5:0/2662755764 >> v2:172.21.15.112:3300/0 conn(0x7f04c80cd950 0x7f04c815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 --2- 172.21.15.5:0/2662755764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c815f570 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 -- 172.21.15.5:0/2662755764 >> 172.21.15.5:0/2662755764 conn(0x7f04c806dae0 msgr2=0x7f04c806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 -- 172.21.15.5:0/2662755764 shutdown_connections 2023-10-16T13:40:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.263+0000 7f04ceb29700 1 -- 172.21.15.5:0/2662755764 wait complete. 2023-10-16T13:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.265+0000 7f04ceb29700 1 Processor -- start 2023-10-16T13:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.265+0000 7f04ceb29700 1 -- start start 2023-10-16T13:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04ceb29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04ceb29700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c80cd950 0x7f04c80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04ceb29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c80b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04ceb29700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80af4d0 con 0x7f04c80cede0 2023-10-16T13:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04ceb29700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80af040 con 0x7f04c80cd950 2023-10-16T13:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04ceb29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80ae430 con 0x7f04c806a840 2023-10-16T13:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c80b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c80b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45098/0 (socket says 172.21.15.5:45098) 2023-10-16T13:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 -- 172.21.15.5:0/3687413880 learned_addr learned my addr 172.21.15.5:0/3687413880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04c7fff700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c80cd950 0x7f04c80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cc8c5700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 -- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 msgr2=0x7f04c815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c815c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 -- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c80cd950 msgr2=0x7f04c80ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c80cd950 0x7f04c80ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cd0c6700 1 -- 172.21.15.5:0/3687413880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009500 con 0x7f04c80cede0 2023-10-16T13:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04c7fff700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c80cd950 0x7f04c80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.266+0000 7f04cc8c5700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04cd0c6700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c80b57c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04c000cd10 tx=0x7f04c000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000f480 con 0x7f04c80cede0 2023-10-16T13:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000f600 con 0x7f04c80cede0 2023-10-16T13:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c80ae710 con 0x7f04c80cede0 2023-10-16T13:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000f9b0 con 0x7f04c80cede0 2023-10-16T13:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.267+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c80aecd0 con 0x7f04c80cede0 2023-10-16T13:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.268+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c8067d20 con 0x7f04c80cede0 2023-10-16T13:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.268+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04c000b040 con 0x7f04c80cede0 2023-10-16T13:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.269+0000 7f04c57fa700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04ac06af00 0x7f04ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.269+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04c0089e20 con 0x7f04c80cede0 2023-10-16T13:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.269+0000 7f04cc8c5700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04ac06af00 0x7f04ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.269+0000 7f04cc8c5700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04ac06af00 0x7f04ac06d3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04bc006fd0 tx=0x7f04bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.273+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04c0054e40 con 0x7f04c80cede0 2023-10-16T13:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.475+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f04c80af180 con 0x7f04c80cede0 2023-10-16T13:40:18.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.475+0000 7f04c57fa700 1 -- 172.21.15.5:0/3687413880 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04c0058460 con 0x7f04c80cede0 2023-10-16T13:40:18.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04ac06af00 msgr2=0x7f04ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04ac06af00 0x7f04ac06d3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04bc006fd0 tx=0x7f04bc008040 comp rx=0 tx=0).stop 2023-10-16T13:40:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 msgr2=0x7f04c80b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c80b57c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04c000cd10 tx=0x7f04c000a560 comp rx=0 tx=0).stop 2023-10-16T13:40:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 shutdown_connections 2023-10-16T13:40:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c80cede0 0x7f04c80b57c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04ac06af00 0x7f04ac06d3c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c806a840 0x7f04c815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 --2- 172.21.15.5:0/3687413880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c80cd950 0x7f04c80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 >> 172.21.15.5:0/3687413880 conn(0x7f04c806dae0 msgr2=0x7f04c8160810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 shutdown_connections 2023-10-16T13:40:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.477+0000 7f04ceb29700 1 -- 172.21.15.5:0/3687413880 wait complete. 2023-10-16T13:40:18.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000962217 2023-10-16T13:40:18.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.619+0000 7f4cef1f5700 1 Processor -- start 2023-10-16T13:40:18.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.619+0000 7f4cef1f5700 1 -- start start 2023-10-16T13:40:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4cef1f5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ce815ab10 0x7f4ce815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4cef1f5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80cfe30 0x7f4ce80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4cef1f5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce815e7a0 con 0x7f4ce80b1f50 2023-10-16T13:40:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4cef1f5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce815f730 con 0x7f4ce815ab10 2023-10-16T13:40:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4cef1f5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80b29a0 con 0x7f4ce80cfe30 2023-10-16T13:40:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4cecf91700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ce815ab10 0x7f4ce815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4ced792700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80cfe30 0x7f4ce80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4ce7fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4ce80b1f50 0x7f4ce80cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46084/0 (socket says 172.21.15.5:46084) 2023-10-16T13:40:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.620+0000 7f4ce7fff700 1 -- 172.21.15.5:0/2149199892 learned_addr learned my addr 172.21.15.5:0/2149199892 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ced792700 1 -- 172.21.15.5:0/2149199892 >> v2:172.21.15.112:3300/0 conn(0x7f4ce815ab10 msgr2=0x7f4ce815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ced792700 1 --2- 172.21.15.5:0/2149199892 >> v2:172.21.15.112:3300/0 conn(0x7f4ce815ab10 0x7f4ce815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ced792700 1 -- 172.21.15.5:0/2149199892 >> v1:172.21.15.112:6789/0 conn(0x7f4ce80b1f50 legacy=0x7f4ce80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ce77fe700 1 -- 172.21.15.5:0/2149199892 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764880083 0 0) 0x7f4ce815e7a0 con 0x7f4ce80b1f50 2023-10-16T13:40:18.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ced792700 1 -- 172.21.15.5:0/2149199892 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80b2c80 con 0x7f4ce80cfe30 2023-10-16T13:40:18.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4cecf91700 1 --2- 172.21.15.5:0/2149199892 >> v2:172.21.15.112:3300/0 conn(0x7f4ce815ab10 0x7f4ce815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:18.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ced792700 1 --2- 172.21.15.5:0/2149199892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80cfe30 0x7f4ce80cbf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009d90 tx=0x7f4ce000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45b52ca5dc75ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ce77fe700 1 -- 172.21.15.5:0/2149199892 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000e070 con 0x7f4ce80cfe30 2023-10-16T13:40:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ce77fe700 1 -- 172.21.15.5:0/2149199892 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000bb20 con 0x7f4ce80cfe30 2023-10-16T13:40:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.621+0000 7f4ce77fe700 1 -- 172.21.15.5:0/2149199892 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0012430 con 0x7f4ce80cfe30 2023-10-16T13:40:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2149199892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80cfe30 msgr2=0x7f4ce80cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2149199892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80cfe30 0x7f4ce80cbf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009d90 tx=0x7f4ce000b330 comp rx=0 tx=0).stop 2023-10-16T13:40:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2149199892 shutdown_connections 2023-10-16T13:40:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2149199892 >> v2:172.21.15.112:3300/0 conn(0x7f4ce815ab10 0x7f4ce815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2149199892 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80cfe30 0x7f4ce80cbf40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2149199892 >> 172.21.15.5:0/2149199892 conn(0x7f4ce806dae0 msgr2=0x7f4ce806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2149199892 shutdown_connections 2023-10-16T13:40:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.622+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2149199892 wait complete. 2023-10-16T13:40:18.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.623+0000 7f4cef1f5700 1 Processor -- start 2023-10-16T13:40:18.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.623+0000 7f4cef1f5700 1 -- start start 2023-10-16T13:40:18.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cef1f5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80b1f50 0x7f4ce81f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cef1f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 0x7f4ce81f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cef1f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ce815ab10 0x7f4ce80cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cef1f5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81f46b0 con 0x7f4ce80cfe30 2023-10-16T13:40:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cef1f5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81f10f0 con 0x7f4ce815ab10 2023-10-16T13:40:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cef1f5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81f7b40 con 0x7f4ce80b1f50 2023-10-16T13:40:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 0x7f4ce81f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 0x7f4ce81f0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45110/0 (socket says 172.21.15.5:45110) 2023-10-16T13:40:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4ce7fff700 1 -- 172.21.15.5:0/2792023804 learned_addr learned my addr 172.21.15.5:0/2792023804 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4cecf91700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80b1f50 0x7f4ce81f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.624+0000 7f4ced792700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ce815ab10 0x7f4ce80cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce7fff700 1 -- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80b1f50 msgr2=0x7f4ce81f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce7fff700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80b1f50 0x7f4ce81f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce7fff700 1 -- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ce815ab10 msgr2=0x7f4ce80cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce7fff700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ce815ab10 0x7f4ce80cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce7fff700 1 -- 172.21.15.5:0/2792023804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc00b740 con 0x7f4ce80cfe30 2023-10-16T13:40:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ced792700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ce815ab10 0x7f4ce80cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce7fff700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 0x7f4ce81f0bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c430 tx=0x7f4cd400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4004cd0 con 0x7f4ce80cfe30 2023-10-16T13:40:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4004e30 con 0x7f4ce80cfe30 2023-10-16T13:40:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce0009a70 con 0x7f4ce80cfe30 2023-10-16T13:40:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4007310 con 0x7f4ce80cfe30 2023-10-16T13:40:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.625+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce81f7060 con 0x7f4ce80cfe30 2023-10-16T13:40:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.626+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce8067d20 con 0x7f4ce80cfe30 2023-10-16T13:40:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.626+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4cd4007470 con 0x7f4ce80cfe30 2023-10-16T13:40:18.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.627+0000 7f4ce57fa700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ccc06af00 0x7f4ccc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:18.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.627+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cd4089240 con 0x7f4ce80cfe30 2023-10-16T13:40:18.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.627+0000 7f4cecf91700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ccc06af00 0x7f4ccc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:18.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.628+0000 7f4cecf91700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ccc06af00 0x7f4ccc06d3c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00bef0 tx=0x7f4cdc00b420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:18.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.632+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4cd4054270 con 0x7f4ce80cfe30 2023-10-16T13:40:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.867+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000962217", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ce815ecd0 con 0x7f4ccc06af00 2023-10-16T13:40:18.875 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:18.873+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:18.876 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:18.873+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:18.876 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:18.873+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:18.876 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:18.873+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:18.876 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:18.873+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.888+0000 7f4ce57fa700 1 -- 172.21.15.5:0/2792023804 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4cdc004020 con 0x7f4ccc06af00 2023-10-16T13:40:18.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.890+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ccc06af00 msgr2=0x7f4ccc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.890+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ccc06af00 0x7f4ccc06d3c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00bef0 tx=0x7f4cdc00b420 comp rx=0 tx=0).stop 2023-10-16T13:40:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.890+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 msgr2=0x7f4ce81f0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.890+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 0x7f4ce81f0bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c430 tx=0x7f4cd400c740 comp rx=0 tx=0).stop 2023-10-16T13:40:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 shutdown_connections 2023-10-16T13:40:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ce815ab10 0x7f4ce80cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ccc06af00 0x7f4ccc06d3c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ce80b1f50 0x7f4ce81f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 --2- 172.21.15.5:0/2792023804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80cfe30 0x7f4ce81f0bb0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:18.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 >> 172.21.15.5:0/2792023804 conn(0x7f4ce806dae0 msgr2=0x7f4ce80cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:18.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 shutdown_connections 2023-10-16T13:40:18.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:18.891+0000 7f4cef1f5700 1 -- 172.21.15.5:0/2792023804 wait complete. 2023-10-16T13:40:18.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-16T13:40:19.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.030+0000 7f7904405700 1 Processor -- start 2023-10-16T13:40:19.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.030+0000 7f7904405700 1 -- start start 2023-10-16T13:40:19.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f7904405700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc15ab10 0x7f78fc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f7904405700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f78fc0b1f50 0x7f78fc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f7904405700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc15e7a0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f7904405700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc15f730 con 0x7f78fc0b1f50 2023-10-16T13:40:19.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f7904405700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0b29a0 con 0x7f78fc15ab10 2023-10-16T13:40:19.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f79029a2700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78fc0b23d0 0x7f78fc0cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55124/0 (socket says 172.21.15.5:55124) 2023-10-16T13:40:19.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.031+0000 7f79029a2700 1 -- 172.21.15.5:0/2278498859 learned_addr learned my addr 172.21.15.5:0/2278498859 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:19.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79019a0700 1 --2- 172.21.15.5:0/2278498859 >> v2:172.21.15.112:3300/0 conn(0x7f78fc0b1f50 0x7f78fc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79021a1700 1 --2- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc15ab10 0x7f78fc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f790119f700 1 -- 172.21.15.5:0/2278498859 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723129926 0 0) 0x7f78fc15e7a0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f790119f700 1 -- 172.21.15.5:0/2278498859 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e80035b0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79019a0700 1 -- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc15ab10 msgr2=0x7f78fc15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79019a0700 1 --2- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc15ab10 0x7f78fc15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79019a0700 1 -- 172.21.15.5:0/2278498859 >> v1:172.21.15.5:6789/0 conn(0x7f78fc0b23d0 legacy=0x7f78fc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79019a0700 1 -- 172.21.15.5:0/2278498859 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0b2c80 con 0x7f78fc0b1f50 2023-10-16T13:40:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f79019a0700 1 --2- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc0b1f50 0x7f78fc0cf720 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009820 tx=0x7f78f8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daad8b6704837192 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f790119f700 1 -- 172.21.15.5:0/2278498859 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8005e30 con 0x7f78fc0b1f50 2023-10-16T13:40:19.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f790119f700 1 -- 172.21.15.5:0/2278498859 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8006030 con 0x7f78fc0b1f50 2023-10-16T13:40:19.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.032+0000 7f790119f700 1 -- 172.21.15.5:0/2278498859 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80063c0 con 0x7f78fc0b1f50 2023-10-16T13:40:19.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 -- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc0b1f50 msgr2=0x7f78fc0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 --2- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc0b1f50 0x7f78fc0cf720 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009820 tx=0x7f78f8009b30 comp rx=0 tx=0).stop 2023-10-16T13:40:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 -- 172.21.15.5:0/2278498859 shutdown_connections 2023-10-16T13:40:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 --2- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc15ab10 0x7f78fc15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 --2- 172.21.15.5:0/2278498859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc0b1f50 0x7f78fc0cf720 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 -- 172.21.15.5:0/2278498859 >> 172.21.15.5:0/2278498859 conn(0x7f78fc06dae0 msgr2=0x7f78fc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 -- 172.21.15.5:0/2278498859 shutdown_connections 2023-10-16T13:40:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.033+0000 7f7904405700 1 -- 172.21.15.5:0/2278498859 wait complete. 2023-10-16T13:40:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.034+0000 7f7904405700 1 Processor -- start 2023-10-16T13:40:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.034+0000 7f7904405700 1 -- start start 2023-10-16T13:40:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f7904405700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc0b1f50 0x7f78fc154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f7904405700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 0x7f78fc0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f7904405700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc15ab10 0x7f78fc150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f7904405700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1549e0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f7904405700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc155440 con 0x7f78fc15ab10 2023-10-16T13:40:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f7904405700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc154e80 con 0x7f78fc0b1f50 2023-10-16T13:40:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f79019a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 0x7f78fc0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f79019a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 0x7f78fc0c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45124/0 (socket says 172.21.15.5:45124) 2023-10-16T13:40:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f79019a0700 1 -- 172.21.15.5:0/1053716993 learned_addr learned my addr 172.21.15.5:0/1053716993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f79029a2700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc15ab10 0x7f78fc150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.035+0000 7f79021a1700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc0b1f50 0x7f78fc154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79019a0700 1 -- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc0b1f50 msgr2=0x7f78fc154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79019a0700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc0b1f50 0x7f78fc154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79019a0700 1 -- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc15ab10 msgr2=0x7f78fc150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79019a0700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc15ab10 0x7f78fc150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79019a0700 1 -- 172.21.15.5:0/1053716993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8009430 con 0x7f78fc0b23d0 2023-10-16T13:40:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79021a1700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc0b1f50 0x7f78fc154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f79019a0700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 0x7f78fc0c5ee0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80063a0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8020070 con 0x7f78fc0b23d0 2023-10-16T13:40:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc155160 con 0x7f78fc0b23d0 2023-10-16T13:40:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8006760 con 0x7f78fc0b23d0 2023-10-16T13:40:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.036+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc150fb0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.037+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc1535d0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.037+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78f8022030 con 0x7f78fc0b23d0 2023-10-16T13:40:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.038+0000 7f78f2ffd700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78e006af00 0x7f78e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.038+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78f808a9b0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.038+0000 7f79021a1700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78e006af00 0x7f78e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.038+0000 7f79021a1700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78e006af00 0x7f78e006d3c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0b60c0 tx=0x7f78ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.043+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78fc1535d0 con 0x7f78fc0b23d0 2023-10-16T13:40:19.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.272+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f78fc15ecd0 con 0x7f78e006af00 2023-10-16T13:40:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.275+0000 7f78f2ffd700 1 -- 172.21.15.5:0/1053716993 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+529 (secure 0 0 0) 0x7f78ec009980 con 0x7f78e006af00 2023-10-16T13:40:19.278 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:40:19.278 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_addrs": [ 2023-10-16T13:40:19.279 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.5:6789", 2023-10-16T13:40:19.279 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6789", 2023-10-16T13:40:19.279 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6790" 2023-10-16T13:40:19.279 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:40:19.279 INFO:teuthology.orchestra.run.smithi005.stdout: "pending_subvolume_deletions": 0, 2023-10-16T13:40:19.279 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": { 2023-10-16T13:40:19.280 INFO:teuthology.orchestra.run.smithi005.stdout: "data": [ 2023-10-16T13:40:19.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:19.280 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": 367104163840, 2023-10-16T13:40:19.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_data", 2023-10-16T13:40:19.280 INFO:teuthology.orchestra.run.smithi005.stdout: "used": 0 2023-10-16T13:40:19.281 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:19.281 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:40:19.281 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": [ 2023-10-16T13:40:19.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:19.281 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": 367104163840, 2023-10-16T13:40:19.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_metadata", 2023-10-16T13:40:19.282 INFO:teuthology.orchestra.run.smithi005.stdout: "used": 65536 2023-10-16T13:40:19.282 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:19.282 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:40:19.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:19.282 INFO:teuthology.orchestra.run.smithi005.stdout: "used_size": 0 2023-10-16T13:40:19.283 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:40:19.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78e006af00 msgr2=0x7f78e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78e006af00 0x7f78e006d3c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0b60c0 tx=0x7f78ec008040 comp rx=0 tx=0).stop 2023-10-16T13:40:19.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 msgr2=0x7f78fc0c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 0x7f78fc0c5ee0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8004750 comp rx=0 tx=0).stop 2023-10-16T13:40:19.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 shutdown_connections 2023-10-16T13:40:19.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78fc15ab10 0x7f78fc150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f78e006af00 0x7f78e006d3c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78fc0b1f50 0x7f78fc154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 --2- 172.21.15.5:0/1053716993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78fc0b23d0 0x7f78fc0c5ee0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 >> 172.21.15.5:0/1053716993 conn(0x7f78fc06dae0 msgr2=0x7f78fc159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:19.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 shutdown_connections 2023-10-16T13:40:19.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.278+0000 7f7904405700 1 -- 172.21.15.5:0/1053716993 wait complete. 2023-10-16T13:40:19.293 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:40:19.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:40:19.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:40:19.382 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:40:19.383 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:19.383 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:19.401 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:19.402 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:19.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:19.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.620+0000 7f2e1b0ac700 1 Processor -- start 2023-10-16T13:40:19.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.620+0000 7f2e1b0ac700 1 -- start start 2023-10-16T13:40:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e1b0ac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1415e030 0x7f2e140cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e1b0ac700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e1406a840 0x7f2e140cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e1b0ac700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1406be50 0x7f2e140ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e1b0ac700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1406adb0 con 0x7f2e1406be50 2023-10-16T13:40:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e1b0ac700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1406b090 con 0x7f2e1406a840 2023-10-16T13:40:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e1b0ac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1406b370 con 0x7f2e1415e030 2023-10-16T13:40:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e19649700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1406be50 0x7f2e140ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e19649700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1406be50 0x7f2e140ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45132/0 (socket says 172.21.15.5:45132) 2023-10-16T13:40:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.621+0000 7f2e19649700 1 -- 172.21.15.5:0/999475216 learned_addr learned my addr 172.21.15.5:0/999475216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:19.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e13fff700 1 --2- 172.21.15.5:0/999475216 >> v2:172.21.15.112:3300/0 conn(0x7f2e1406a840 0x7f2e140cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e18e48700 1 --2- 172.21.15.5:0/999475216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1415e030 0x7f2e140cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e19649700 1 -- 172.21.15.5:0/999475216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1415e030 msgr2=0x7f2e140cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:19.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e19649700 1 --2- 172.21.15.5:0/999475216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1415e030 0x7f2e140cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e19649700 1 -- 172.21.15.5:0/999475216 >> v2:172.21.15.112:3300/0 conn(0x7f2e1406a840 msgr2=0x7f2e140cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e19649700 1 --2- 172.21.15.5:0/999475216 >> v2:172.21.15.112:3300/0 conn(0x7f2e1406a840 0x7f2e140cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e19649700 1 -- 172.21.15.5:0/999475216 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1406b650 con 0x7f2e1406be50 2023-10-16T13:40:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e13fff700 1 --2- 172.21.15.5:0/999475216 >> v2:172.21.15.112:3300/0 conn(0x7f2e1406a840 0x7f2e140cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e19649700 1 --2- 172.21.15.5:0/999475216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1406be50 0x7f2e140ce0b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2e14070f10 tx=0x7f2e0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615a02b5b3695511 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e137fe700 1 -- 172.21.15.5:0/999475216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00e070 con 0x7f2e1406be50 2023-10-16T13:40:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e137fe700 1 -- 172.21.15.5:0/999475216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00b9c0 con 0x7f2e1406be50 2023-10-16T13:40:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.622+0000 7f2e137fe700 1 -- 172.21.15.5:0/999475216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00bd70 con 0x7f2e1406be50 2023-10-16T13:40:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/999475216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1406be50 msgr2=0x7f2e140ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/999475216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1406be50 0x7f2e140ce0b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2e14070f10 tx=0x7f2e0c00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/999475216 shutdown_connections 2023-10-16T13:40:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/999475216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1406be50 0x7f2e140ce0b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/999475216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1415e030 0x7f2e140cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/999475216 >> v2:172.21.15.112:3300/0 conn(0x7f2e1406a840 0x7f2e140cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/999475216 >> 172.21.15.5:0/999475216 conn(0x7f2e140cc6f0 msgr2=0x7f2e140ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/999475216 shutdown_connections 2023-10-16T13:40:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.623+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/999475216 wait complete. 2023-10-16T13:40:19.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.624+0000 7f2e1b0ac700 1 Processor -- start 2023-10-16T13:40:19.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.624+0000 7f2e1b0ac700 1 -- start start 2023-10-16T13:40:19.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.625+0000 7f2e1b0ac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1406a840 0x7f2e140c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.625+0000 7f2e1b0ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e1406be50 0x7f2e140c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e1b0ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 0x7f2e140c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e1b0ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c6110 con 0x7f2e1415e030 2023-10-16T13:40:19.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e1b0ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14150aa0 con 0x7f2e1406be50 2023-10-16T13:40:19.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e1b0ac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c6360 con 0x7f2e1406a840 2023-10-16T13:40:19.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 0x7f2e140c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 0x7f2e140c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45138/0 (socket says 172.21.15.5:45138) 2023-10-16T13:40:19.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 -- 172.21.15.5:0/215649850 learned_addr learned my addr 172.21.15.5:0/215649850 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:19.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e13fff700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e1406be50 0x7f2e140c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e18e48700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1406a840 0x7f2e140c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 -- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1406a840 msgr2=0x7f2e140c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1406a840 0x7f2e140c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 -- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e1406be50 msgr2=0x7f2e140c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e1406be50 0x7f2e140c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 -- 172.21.15.5:0/215649850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c009b30 con 0x7f2e1415e030 2023-10-16T13:40:19.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e19649700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 0x7f2e140c3ce0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e140b2900 tx=0x7f2e0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0099b0 con 0x7f2e1415e030 2023-10-16T13:40:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c004250 con 0x7f2e1415e030 2023-10-16T13:40:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e140c6640 con 0x7f2e1415e030 2023-10-16T13:40:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c004600 con 0x7f2e1415e030 2023-10-16T13:40:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.626+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e140c8b20 con 0x7f2e1415e030 2023-10-16T13:40:19.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.627+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14067d20 con 0x7f2e1415e030 2023-10-16T13:40:19.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.628+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2e0c004760 con 0x7f2e1415e030 2023-10-16T13:40:19.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.629+0000 7f2e117fa700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2df806af00 0x7f2df806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.629+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e0c08aa20 con 0x7f2e1415e030 2023-10-16T13:40:19.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.629+0000 7f2e18e48700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2df806af00 0x7f2df806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.629+0000 7f2e18e48700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2df806af00 0x7f2df806d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e08006b20 tx=0x7f2e08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.633+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e0c055ac0 con 0x7f2e1415e030 2023-10-16T13:40:19.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.840+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e140c9d70 con 0x7f2e1415e030 2023-10-16T13:40:19.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.842+0000 7f2e117fa700 1 -- 172.21.15.5:0/215649850 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f2e0c082e60 con 0x7f2e1415e030 2023-10-16T13:40:19.844 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:19.845 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:04.656921+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:19.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2df806af00 msgr2=0x7f2df806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2df806af00 0x7f2df806d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e08006b20 tx=0x7f2e08008040 comp rx=0 tx=0).stop 2023-10-16T13:40:19.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 msgr2=0x7f2e140c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 0x7f2e140c3ce0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e140b2900 tx=0x7f2e0c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 shutdown_connections 2023-10-16T13:40:19.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1415e030 0x7f2e140c3ce0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2df806af00 0x7f2df806d3c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e1406a840 0x7f2e140c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 --2- 172.21.15.5:0/215649850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e1406be50 0x7f2e140c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 >> 172.21.15.5:0/215649850 conn(0x7f2e140cc6f0 msgr2=0x7f2e140ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:19.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 shutdown_connections 2023-10-16T13:40:19.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.844+0000 7f2e1b0ac700 1 -- 172.21.15.5:0/215649850 wait complete. 2023-10-16T13:40:19.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:40:01.561842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:40:02.032316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:40:19.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:40:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.985+0000 7fb2dfd65700 1 Processor -- start 2023-10-16T13:40:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.985+0000 7fb2dfd65700 1 -- start start 2023-10-16T13:40:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dfd65700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d815dbc0 0x7fb2d815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dfd65700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2d80d3fc0 0x7fb2d80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dfd65700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d815e4e0 con 0x7fb2d80b7050 2023-10-16T13:40:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dfd65700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80b7560 con 0x7fb2d80d3fc0 2023-10-16T13:40:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dfd65700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b7840 con 0x7fb2d815dbc0 2023-10-16T13:40:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dd300700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2d80d3fc0 0x7fb2d80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2de302700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2d80b7050 0x7fb2d80d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55150/0 (socket says 172.21.15.5:55150) 2023-10-16T13:40:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2dd300700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2d80d3fc0 0x7fb2d80d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45142/0 (socket says 172.21.15.5:45142) 2023-10-16T13:40:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.986+0000 7fb2de302700 1 -- 172.21.15.5:0/1252900031 learned_addr learned my addr 172.21.15.5:0/1252900031 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dd300700 1 -- 172.21.15.5:0/1252900031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d815dbc0 msgr2=0x7fb2d815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2ddb01700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d815dbc0 0x7fb2d815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dcaff700 1 -- 172.21.15.5:0/1252900031 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130729789 0 0) 0x7fb2d815e4e0 con 0x7fb2d80b7050 2023-10-16T13:40:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dd300700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d815dbc0 0x7fb2d815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dd300700 1 -- 172.21.15.5:0/1252900031 >> v1:172.21.15.5:6789/0 conn(0x7fb2d80b7050 legacy=0x7fb2d80d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dd300700 1 -- 172.21.15.5:0/1252900031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80b7b20 con 0x7fb2d80d3fc0 2023-10-16T13:40:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2ddb01700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d815dbc0 0x7fb2d815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dd300700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80d3fc0 0x7fb2d80d1ac0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009840 tx=0x7fb2d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55a28ca6ef220d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dcaff700 1 -- 172.21.15.5:0/1252900031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011830 con 0x7fb2d80d3fc0 2023-10-16T13:40:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dcaff700 1 -- 172.21.15.5:0/1252900031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4011990 con 0x7fb2d80d3fc0 2023-10-16T13:40:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.987+0000 7fb2dcaff700 1 -- 172.21.15.5:0/1252900031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011d20 con 0x7fb2d80d3fc0 2023-10-16T13:40:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 -- 172.21.15.5:0/1252900031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80d3fc0 msgr2=0x7fb2d80d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80d3fc0 0x7fb2d80d1ac0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009840 tx=0x7fb2d4009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 -- 172.21.15.5:0/1252900031 shutdown_connections 2023-10-16T13:40:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d815dbc0 0x7fb2d815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/1252900031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80d3fc0 0x7fb2d80d1ac0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 -- 172.21.15.5:0/1252900031 >> 172.21.15.5:0/1252900031 conn(0x7fb2d809cb40 msgr2=0x7fb2d80d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 -- 172.21.15.5:0/1252900031 shutdown_connections 2023-10-16T13:40:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.988+0000 7fb2dfd65700 1 -- 172.21.15.5:0/1252900031 wait complete. 2023-10-16T13:40:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.989+0000 7fb2dfd65700 1 Processor -- start 2023-10-16T13:40:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.989+0000 7fb2dfd65700 1 -- start start 2023-10-16T13:40:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 0x7fb2d81e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d80d3fc0 0x7fb2d80c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d815dbc0 0x7fb2d80c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81e7f00 con 0x7fb2d80b7050 2023-10-16T13:40:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81e56e0 con 0x7fb2d815dbc0 2023-10-16T13:40:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81e59a0 con 0x7fb2d80d3fc0 2023-10-16T13:40:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 0x7fb2d81e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 0x7fb2d81e79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45148/0 (socket says 172.21.15.5:45148) 2023-10-16T13:40:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 -- 172.21.15.5:0/719634983 learned_addr learned my addr 172.21.15.5:0/719634983 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dd300700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d80d3fc0 0x7fb2d80c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2de302700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d815dbc0 0x7fb2d80c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 -- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d80d3fc0 msgr2=0x7fb2d80c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d80d3fc0 0x7fb2d80c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 -- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d815dbc0 msgr2=0x7fb2d80c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d815dbc0 0x7fb2d80c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 -- 172.21.15.5:0/719634983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40094a0 con 0x7fb2d80b7050 2023-10-16T13:40:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ddb01700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 0x7fb2d81e79c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c7f0 tx=0x7fb2cc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc005c20 con 0x7fb2d80b7050 2023-10-16T13:40:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc005d80 con 0x7fb2d80b7050 2023-10-16T13:40:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc011820 con 0x7fb2d80b7050 2023-10-16T13:40:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.990+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d81e5c80 con 0x7fb2d80b7050 2023-10-16T13:40:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.991+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d81e8390 con 0x7fb2d80b7050 2023-10-16T13:40:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.991+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d80ca310 con 0x7fb2d80b7050 2023-10-16T13:40:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.992+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb2cc011980 con 0x7fb2d80b7050 2023-10-16T13:40:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.992+0000 7fb2ca7fc700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb2bc06af00 0x7fb2bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.993+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2cc0891e0 con 0x7fb2d80b7050 2023-10-16T13:40:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.993+0000 7fb2dd300700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb2bc06af00 0x7fb2bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.993+0000 7fb2dd300700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb2bc06af00 0x7fb2bc06d3c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40090b0 tx=0x7fb2d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:19.997+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2cc054320 con 0x7fb2d80b7050 2023-10-16T13:40:20.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.194+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2d80ca010 con 0x7fb2d80b7050 2023-10-16T13:40:20.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.195+0000 7fb2ca7fc700 1 -- 172.21.15.5:0/719634983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2cc057940 con 0x7fb2d80b7050 2023-10-16T13:40:20.198 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:40:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb2bc06af00 msgr2=0x7fb2bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb2bc06af00 0x7fb2bc06d3c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40090b0 tx=0x7fb2d4008030 comp rx=0 tx=0).stop 2023-10-16T13:40:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 msgr2=0x7fb2d81e79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 0x7fb2d81e79c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c7f0 tx=0x7fb2cc00cb00 comp rx=0 tx=0).stop 2023-10-16T13:40:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 shutdown_connections 2023-10-16T13:40:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d815dbc0 0x7fb2d80c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2d80b7050 0x7fb2d81e79c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb2bc06af00 0x7fb2bc06d3c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 --2- 172.21.15.5:0/719634983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2d80d3fc0 0x7fb2d80c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 >> 172.21.15.5:0/719634983 conn(0x7fb2d809cb40 msgr2=0x7fb2d8156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 shutdown_connections 2023-10-16T13:40:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.197+0000 7fb2dfd65700 1 -- 172.21.15.5:0/719634983 wait complete. 2023-10-16T13:40:20.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:40:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.337+0000 7f1f9888a700 1 Processor -- start 2023-10-16T13:40:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.337+0000 7f1f9888a700 1 -- start start 2023-10-16T13:40:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f9888a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f9415eab0 0x7f1f940cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f9888a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f940d1d90 0x7f1f940cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f9888a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9415ee90 con 0x7f1f940cf6d0 2023-10-16T13:40:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f9888a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f940cfb50 con 0x7f1f940d1d90 2023-10-16T13:40:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f9888a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94158370 con 0x7f1f9415eab0 2023-10-16T13:40:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f92d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f940d1d90 0x7f1f940cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f92d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f940d1d90 0x7f1f940cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45160/0 (socket says 172.21.15.5:45160) 2023-10-16T13:40:20.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f92d9d700 1 -- 172.21.15.5:0/347869059 learned_addr learned my addr 172.21.15.5:0/347869059 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:20.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.338+0000 7f1f9259c700 1 --2- 172.21.15.5:0/347869059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f9415eab0 0x7f1f940cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f92d9d700 1 -- 172.21.15.5:0/347869059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f9415eab0 msgr2=0x7f1f940cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:20.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f92d9d700 1 --2- 172.21.15.5:0/347869059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f9415eab0 0x7f1f940cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f92d9d700 1 -- 172.21.15.5:0/347869059 >> v1:172.21.15.112:6789/0 conn(0x7f1f940cf6d0 legacy=0x7f1f940d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f92d9d700 1 -- 172.21.15.5:0/347869059 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940d23b0 con 0x7f1f940d1d90 2023-10-16T13:40:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f92d9d700 1 --2- 172.21.15.5:0/347869059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f940d1d90 0x7f1f940cbc10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1f9415f020 tx=0x7f1f8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f4ce804071d4ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f9159a700 1 -- 172.21.15.5:0/347869059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00e070 con 0x7f1f940d1d90 2023-10-16T13:40:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f9159a700 1 -- 172.21.15.5:0/347869059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c003a20 con 0x7f1f940d1d90 2023-10-16T13:40:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f9159a700 1 -- 172.21.15.5:0/347869059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c003dd0 con 0x7f1f940d1d90 2023-10-16T13:40:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f9888a700 1 -- 172.21.15.5:0/347869059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f940d1d90 msgr2=0x7f1f940cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.339+0000 7f1f9888a700 1 --2- 172.21.15.5:0/347869059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f940d1d90 0x7f1f940cbc10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1f9415f020 tx=0x7f1f8c00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.340+0000 7f1f9888a700 1 -- 172.21.15.5:0/347869059 shutdown_connections 2023-10-16T13:40:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.340+0000 7f1f9888a700 1 --2- 172.21.15.5:0/347869059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f940d1d90 0x7f1f940cbc10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.340+0000 7f1f9888a700 1 --2- 172.21.15.5:0/347869059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f9415eab0 0x7f1f940cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.340+0000 7f1f9888a700 1 -- 172.21.15.5:0/347869059 >> 172.21.15.5:0/347869059 conn(0x7f1f940665a0 msgr2=0x7f1f94066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:20.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.340+0000 7f1f9888a700 1 -- 172.21.15.5:0/347869059 shutdown_connections 2023-10-16T13:40:20.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.340+0000 7f1f9888a700 1 -- 172.21.15.5:0/347869059 wait complete. 2023-10-16T13:40:20.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.341+0000 7f1f9888a700 1 Processor -- start 2023-10-16T13:40:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.341+0000 7f1f9888a700 1 -- start start 2023-10-16T13:40:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9888a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f940cf6d0 0x7f1f940ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9888a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f940d1d90 0x7f1f941f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9888a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 0x7f1f941f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9888a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940af5e0 con 0x7f1f9415eab0 2023-10-16T13:40:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9888a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940ae6e0 con 0x7f1f940cf6d0 2023-10-16T13:40:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9888a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f940ae960 con 0x7f1f940d1d90 2023-10-16T13:40:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 0x7f1f941f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 0x7f1f941f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45166/0 (socket says 172.21.15.5:45166) 2023-10-16T13:40:20.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 -- 172.21.15.5:0/1303372522 learned_addr learned my addr 172.21.15.5:0/1303372522 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:20.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f9259c700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f940cf6d0 0x7f1f940ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f91d9b700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f940d1d90 0x7f1f941f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 -- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f940d1d90 msgr2=0x7f1f941f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f940d1d90 0x7f1f941f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 -- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f940cf6d0 msgr2=0x7f1f940ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f940cf6d0 0x7f1f940ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 -- 172.21.15.5:0/1303372522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009b30 con 0x7f1f9415eab0 2023-10-16T13:40:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f91d9b700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f940d1d90 0x7f1f941f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f92d9d700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 0x7f1f941f61d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00b370 tx=0x7f1f8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.342+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004440 con 0x7f1f9415eab0 2023-10-16T13:40:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.343+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c0045a0 con 0x7f1f9415eab0 2023-10-16T13:40:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.343+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0099b0 con 0x7f1f9415eab0 2023-10-16T13:40:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.343+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f940aec40 con 0x7f1f9415eab0 2023-10-16T13:40:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.343+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f940af200 con 0x7f1f9415eab0 2023-10-16T13:40:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.343+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f940af720 con 0x7f1f9415eab0 2023-10-16T13:40:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.344+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1f8c012430 con 0x7f1f9415eab0 2023-10-16T13:40:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.344+0000 7f1f82ffd700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1f7406af00 0x7f1f7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.344+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f8c08aaa0 con 0x7f1f9415eab0 2023-10-16T13:40:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.345+0000 7f1f9259c700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1f7406af00 0x7f1f7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.345+0000 7f1f9259c700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1f7406af00 0x7f1f7406d3c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b9b0 tx=0x7f1f88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.349+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f940af720 con 0x7f1f9415eab0 2023-10-16T13:40:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.548+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f940af720 con 0x7f1f9415eab0 2023-10-16T13:40:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.548+0000 7f1f82ffd700 1 -- 172.21.15.5:0/1303372522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f8c017020 con 0x7f1f9415eab0 2023-10-16T13:40:20.551 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:40:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1f7406af00 msgr2=0x7f1f7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1f7406af00 0x7f1f7406d3c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b9b0 tx=0x7f1f88008040 comp rx=0 tx=0).stop 2023-10-16T13:40:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 msgr2=0x7f1f941f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 0x7f1f941f61d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00b370 tx=0x7f1f8c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 shutdown_connections 2023-10-16T13:40:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9415eab0 0x7f1f941f61d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f940cf6d0 0x7f1f940ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1f7406af00 0x7f1f7406d3c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 --2- 172.21.15.5:0/1303372522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f940d1d90 0x7f1f941f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 >> 172.21.15.5:0/1303372522 conn(0x7f1f940665a0 msgr2=0x7f1f9415dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 shutdown_connections 2023-10-16T13:40:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.550+0000 7f1f9888a700 1 -- 172.21.15.5:0/1303372522 wait complete. 2023-10-16T13:40:20.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:40:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.691+0000 7fc3d9d84700 1 Processor -- start 2023-10-16T13:40:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.691+0000 7fc3d9d84700 1 -- start start 2023-10-16T13:40:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d9d84700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3d406a840 0x7fc3d40cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d9d84700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d406adb0 con 0x7fc3d406be50 2023-10-16T13:40:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d9d84700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d406b090 con 0x7fc3d415e030 2023-10-16T13:40:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d9d84700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d40cbab0 con 0x7fc3d406a840 2023-10-16T13:40:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3d406a840 0x7fc3d40cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3d406be50 0x7fc3d406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55178/0 (socket says 172.21.15.5:55178) 2023-10-16T13:40:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d3fff700 1 -- 172.21.15.5:0/190426517 learned_addr learned my addr 172.21.15.5:0/190426517 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d2ffd700 1 -- 172.21.15.5:0/190426517 >> v1:172.21.15.112:6789/0 conn(0x7fc3d415e030 legacy=0x7fc3d40cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d2ffd700 1 -- 172.21.15.5:0/190426517 >> v1:172.21.15.5:6789/0 conn(0x7fc3d406be50 legacy=0x7fc3d406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d2ffd700 1 -- 172.21.15.5:0/190426517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d406b370 con 0x7fc3d406a840 2023-10-16T13:40:20.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d27fc700 1 -- 172.21.15.5:0/190426517 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472433824 0 0) 0x7fc3d406adb0 con 0x7fc3d406be50 2023-10-16T13:40:20.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.692+0000 7fc3d2ffd700 1 --2- 172.21.15.5:0/190426517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d406a840 0x7fc3d40cdb70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009840 tx=0x7fc3c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9e5ac3e439dcd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d27fc700 1 -- 172.21.15.5:0/190426517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8011830 con 0x7fc3d406a840 2023-10-16T13:40:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d27fc700 1 -- 172.21.15.5:0/190426517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8011990 con 0x7fc3d406a840 2023-10-16T13:40:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d27fc700 1 -- 172.21.15.5:0/190426517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8011d20 con 0x7fc3d406a840 2023-10-16T13:40:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 -- 172.21.15.5:0/190426517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d406a840 msgr2=0x7fc3d40cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/190426517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d406a840 0x7fc3d40cdb70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009840 tx=0x7fc3c8009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 -- 172.21.15.5:0/190426517 shutdown_connections 2023-10-16T13:40:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/190426517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d406a840 0x7fc3d40cdb70 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 -- 172.21.15.5:0/190426517 >> 172.21.15.5:0/190426517 conn(0x7fc3d40cc6f0 msgr2=0x7fc3d40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 -- 172.21.15.5:0/190426517 shutdown_connections 2023-10-16T13:40:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.693+0000 7fc3d9d84700 1 -- 172.21.15.5:0/190426517 wait complete. 2023-10-16T13:40:20.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.694+0000 7fc3d9d84700 1 Processor -- start 2023-10-16T13:40:20.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 -- start start 2023-10-16T13:40:20.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d406a840 0x7fc3d4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3d406be50 0x7fc3d4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 0x7fc3d415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d41603e0 con 0x7fc3d415e030 2023-10-16T13:40:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d415a760 con 0x7fc3d406a840 2023-10-16T13:40:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d9d84700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d415aa40 con 0x7fc3d406be50 2023-10-16T13:40:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 0x7fc3d415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 0x7fc3d415b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45180/0 (socket says 172.21.15.5:45180) 2023-10-16T13:40:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.695+0000 7fc3d3fff700 1 -- 172.21.15.5:0/1612119607 learned_addr learned my addr 172.21.15.5:0/1612119607 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:20.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d37fe700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d406a840 0x7fc3d4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d2ffd700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3d406be50 0x7fc3d4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d3fff700 1 -- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3d406be50 msgr2=0x7fc3d4147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d3fff700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3d406be50 0x7fc3d4147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d3fff700 1 -- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d406a840 msgr2=0x7fc3d4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d3fff700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d406a840 0x7fc3d4159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d3fff700 1 -- 172.21.15.5:0/1612119607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80094a0 con 0x7fc3d415e030 2023-10-16T13:40:20.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d37fe700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d406a840 0x7fc3d4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:20.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d3fff700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 0x7fc3d415b9e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00cca0 tx=0x7fc3cc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00cea0 con 0x7fc3d415e030 2023-10-16T13:40:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00ade0 con 0x7fc3d415e030 2023-10-16T13:40:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc007310 con 0x7fc3d415e030 2023-10-16T13:40:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d415fd20 con 0x7fc3d415e030 2023-10-16T13:40:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.696+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d415a470 con 0x7fc3d415e030 2023-10-16T13:40:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.697+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d415fb80 con 0x7fc3d415e030 2023-10-16T13:40:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.698+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3cc007470 con 0x7fc3d415e030 2023-10-16T13:40:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.698+0000 7fc3bbfff700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3c006af30 0x7fc3c006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.698+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3cc0891b0 con 0x7fc3d415e030 2023-10-16T13:40:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.698+0000 7fc3d37fe700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3c006af30 0x7fc3c006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.699+0000 7fc3d37fe700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3c006af30 0x7fc3c006d3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000f60 tx=0x7fc3c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.703+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3d415fb80 con 0x7fc3d415e030 2023-10-16T13:40:20.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.736+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fc3cc0545a0 con 0x7fc3d415e030 2023-10-16T13:40:20.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.906+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3d415fb80 con 0x7fc3d415e030 2023-10-16T13:40:20.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.906+0000 7fc3bbfff700 1 -- 172.21.15.5:0/1612119607 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3d415fb80 con 0x7fc3d415e030 2023-10-16T13:40:20.909 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:40:20.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3c006af30 msgr2=0x7fc3c006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3c006af30 0x7fc3c006d3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000f60 tx=0x7fc3c4009040 comp rx=0 tx=0).stop 2023-10-16T13:40:20.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 msgr2=0x7fc3d415b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:20.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 0x7fc3d415b9e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00cca0 tx=0x7fc3cc00a340 comp rx=0 tx=0).stop 2023-10-16T13:40:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 shutdown_connections 2023-10-16T13:40:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d415e030 0x7fc3d415b9e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d406a840 0x7fc3d4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc3c006af30 0x7fc3c006d3f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 --2- 172.21.15.5:0/1612119607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3d406be50 0x7fc3d4147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:20.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 >> 172.21.15.5:0/1612119607 conn(0x7fc3d40cc6f0 msgr2=0x7fc3d40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:20.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 shutdown_connections 2023-10-16T13:40:20.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:20.908+0000 7fc3d9d84700 1 -- 172.21.15.5:0/1612119607 wait complete. 2023-10-16T13:40:20.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:40:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.046+0000 7f76e7df5700 1 Processor -- start 2023-10-16T13:40:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.047+0000 7f76e7df5700 1 -- start start 2023-10-16T13:40:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.047+0000 7f76e7df5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76e015a850 0x7f76e00cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.047+0000 7f76e7df5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00b2940 0x7f76e00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.047+0000 7f76e7df5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00ce3b0 con 0x7f76e00cd2e0 2023-10-16T13:40:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.047+0000 7f76e7df5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00b2df0 con 0x7f76e015a850 2023-10-16T13:40:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.047+0000 7f76e7df5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00b6290 con 0x7f76e00b2940 2023-10-16T13:40:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76e015a850 0x7f76e00cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76e015a850 0x7f76e00cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45184/0 (socket says 172.21.15.5:45184) 2023-10-16T13:40:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 -- 172.21.15.5:0/1637086782 learned_addr learned my addr 172.21.15.5:0/1637086782 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5390700 1 --2- 172.21.15.5:0/1637086782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00b2940 0x7f76e00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 -- 172.21.15.5:0/1637086782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00b2940 msgr2=0x7f76e00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 --2- 172.21.15.5:0/1637086782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00b2940 0x7f76e00ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 -- 172.21.15.5:0/1637086782 >> v1:172.21.15.112:6789/0 conn(0x7f76e00cd2e0 legacy=0x7f76e0071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 -- 172.21.15.5:0/1637086782 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00cc220 con 0x7f76e015a850 2023-10-16T13:40:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e5b91700 1 --2- 172.21.15.5:0/1637086782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00cbc40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f76d400bb90 tx=0x7f76d400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6403a76ac7ee599 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e4b8f700 1 -- 172.21.15.5:0/1637086782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400dd50 con 0x7f76e015a850 2023-10-16T13:40:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e4b8f700 1 -- 172.21.15.5:0/1637086782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4010470 con 0x7f76e015a850 2023-10-16T13:40:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.048+0000 7f76e4b8f700 1 -- 172.21.15.5:0/1637086782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4010800 con 0x7f76e015a850 2023-10-16T13:40:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 -- 172.21.15.5:0/1637086782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 msgr2=0x7f76e00cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 --2- 172.21.15.5:0/1637086782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00cbc40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f76d400bb90 tx=0x7f76d400bea0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 -- 172.21.15.5:0/1637086782 shutdown_connections 2023-10-16T13:40:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 --2- 172.21.15.5:0/1637086782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00cbc40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 --2- 172.21.15.5:0/1637086782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00b2940 0x7f76e00ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 -- 172.21.15.5:0/1637086782 >> 172.21.15.5:0/1637086782 conn(0x7f76e006dac0 msgr2=0x7f76e006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 -- 172.21.15.5:0/1637086782 shutdown_connections 2023-10-16T13:40:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.049+0000 7f76e7df5700 1 -- 172.21.15.5:0/1637086782 wait complete. 2023-10-16T13:40:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.050+0000 7f76e7df5700 1 Processor -- start 2023-10-16T13:40:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.050+0000 7f76e7df5700 1 -- start start 2023-10-16T13:40:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e7df5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e00b2940 0x7f76e0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e7df5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00cd2e0 0x7f76e00b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e7df5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e7df5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00c3fe0 con 0x7f76e015a850 2023-10-16T13:40:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e7df5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00aeca0 con 0x7f76e00b2940 2023-10-16T13:40:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e7df5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00aef80 con 0x7f76e00cd2e0 2023-10-16T13:40:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45194/0 (socket says 172.21.15.5:45194) 2023-10-16T13:40:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 -- 172.21.15.5:0/4001040088 learned_addr learned my addr 172.21.15.5:0/4001040088 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e5b91700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e00b2940 0x7f76e0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e5390700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00cd2e0 0x7f76e00b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 -- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00cd2e0 msgr2=0x7f76e00b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00cd2e0 0x7f76e00b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 -- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e00b2940 msgr2=0x7f76e0155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e00b2940 0x7f76e0155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 -- 172.21.15.5:0/4001040088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d400b7f0 con 0x7f76e015a850 2023-10-16T13:40:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.051+0000 7f76e6392700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00b5780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f76d800cb50 tx=0x7f76d800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.052+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8003c00 con 0x7f76e015a850 2023-10-16T13:40:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.052+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d8003d60 con 0x7f76e015a850 2023-10-16T13:40:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.052+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e00af260 con 0x7f76e015a850 2023-10-16T13:40:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.052+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800aa20 con 0x7f76e015a850 2023-10-16T13:40:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.052+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e0155f50 con 0x7f76e015a850 2023-10-16T13:40:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.053+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e00c4460 con 0x7f76e015a850 2023-10-16T13:40:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.053+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f76d800ab80 con 0x7f76e015a850 2023-10-16T13:40:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.054+0000 7f76d27fc700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76c406af90 0x7f76c406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.054+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76d80896e0 con 0x7f76e015a850 2023-10-16T13:40:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.054+0000 7f76e5b91700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76c406af90 0x7f76c406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.054+0000 7f76e5b91700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76c406af90 0x7f76c406d450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f76d400bee0 tx=0x7f76d4013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.059+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76d8058130 con 0x7f76e015a850 2023-10-16T13:40:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.276+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f76e0067d20 con 0x7f76e015a850 2023-10-16T13:40:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.276+0000 7f76d27fc700 1 -- 172.21.15.5:0/4001040088 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76d8057cc0 con 0x7f76e015a850 2023-10-16T13:40:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76c406af90 msgr2=0x7f76c406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76c406af90 0x7f76c406d450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f76d400bee0 tx=0x7f76d4013000 comp rx=0 tx=0).stop 2023-10-16T13:40:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 msgr2=0x7f76e00b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00b5780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f76d800cb50 tx=0x7f76d800ce60 comp rx=0 tx=0).stop 2023-10-16T13:40:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 shutdown_connections 2023-10-16T13:40:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76e015a850 0x7f76e00b5780 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e00b2940 0x7f76e0155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76c406af90 0x7f76c406d450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 --2- 172.21.15.5:0/4001040088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e00cd2e0 0x7f76e00b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 >> 172.21.15.5:0/4001040088 conn(0x7f76e006dac0 msgr2=0x7f76e0158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 shutdown_connections 2023-10-16T13:40:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.278+0000 7f76e7df5700 1 -- 172.21.15.5:0/4001040088 wait complete. 2023-10-16T13:40:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:40:21.293 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:40:21.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:21.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:21.339 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:40:21.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:21.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:40:21.357 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:21.357 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:21.379 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:21.379 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:21.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.562+0000 7f21a737e700 1 Processor -- start 2023-10-16T13:40:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.562+0000 7f21a737e700 1 -- start start 2023-10-16T13:40:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a737e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f21a015e2f0 0x7f21a00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a737e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00b2d60 con 0x7f21a00cd950 2023-10-16T13:40:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a737e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00cdd30 con 0x7f21a006a840 2023-10-16T13:40:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a737e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a01619a0 con 0x7f21a015e2f0 2023-10-16T13:40:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a511a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21a00cd950 0x7f21a015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55202/0 (socket says 172.21.15.5:55202) 2023-10-16T13:40:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a511a700 1 -- 172.21.15.5:0/1086713054 learned_addr learned my addr 172.21.15.5:0/1086713054 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a4919700 1 --2- 172.21.15.5:0/1086713054 >> v2:172.21.15.112:3300/0 conn(0x7f21a015e2f0 0x7f21a00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855136918 0 0) 0x7f21a00b2d60 con 0x7f21a00cd950 2023-10-16T13:40:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f218c0035b0 con 0x7f21a00cd950 2023-10-16T13:40:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172522618 0 0) 0x7f21a00cdd30 con 0x7f21a006a840 2023-10-16T13:40:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a00b2d60 con 0x7f21a006a840 2023-10-16T13:40:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628190098 0 0) 0x7f218c0035b0 con 0x7f21a00cd950 2023-10-16T13:40:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 >> v2:172.21.15.112:3300/0 conn(0x7f21a015e2f0 msgr2=0x7f21a00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 --2- 172.21.15.5:0/1086713054 >> v2:172.21.15.112:3300/0 conn(0x7f21a015e2f0 0x7f21a00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 >> v1:172.21.15.112:6789/0 conn(0x7f21a006a840 legacy=0x7f21a006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a015e920 con 0x7f21a00cd950 2023-10-16T13:40:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f21a4919700 1 --2- 172.21.15.5:0/1086713054 >> v2:172.21.15.112:3300/0 conn(0x7f21a015e2f0 0x7f21a00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f219c001670 con 0x7f21a00cd950 2023-10-16T13:40:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 >> v1:172.21.15.5:6789/0 conn(0x7f21a00cd950 legacy=0x7f21a015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f218c003b90 0x7f218c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f218c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f218c005210 0x7f218c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01619a0 con 0x7f218c004850 2023-10-16T13:40:21.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c00c090 con 0x7f218c003b90 2023-10-16T13:40:21.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.563+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c00c250 con 0x7f218c005210 2023-10-16T13:40:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f218c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a511a700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f218c003b90 0x7f218c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a591b700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f218c005210 0x7f218c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 -- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f218c005210 msgr2=0x7f218c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f218c005210 0x7f218c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 -- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f218c003b90 msgr2=0x7f218c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:21.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f218c003b90 0x7f218c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a591b700 1 -- 172.21.15.5:0/1086713054 reap_dead start 2023-10-16T13:40:21.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 -- 172.21.15.5:0/1086713054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0035b0 con 0x7f218c004850 2023-10-16T13:40:21.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f21a4919700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f218c004cd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2190009d10 tx=0x7f218c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcdc0ea9335d95b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190009e60 con 0x7f218c004850 2023-10-16T13:40:21.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219000e9a0 con 0x7f218c004850 2023-10-16T13:40:21.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.564+0000 7f2197fff700 1 -- 172.21.15.5:0/1086713054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000ed10 con 0x7f218c004850 2023-10-16T13:40:21.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 -- 172.21.15.5:0/1086713054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 msgr2=0x7f218c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f218c004cd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2190009d10 tx=0x7f218c005880 comp rx=0 tx=0).stop 2023-10-16T13:40:21.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 -- 172.21.15.5:0/1086713054 shutdown_connections 2023-10-16T13:40:21.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 --2- 172.21.15.5:0/1086713054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f218c004cd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 -- 172.21.15.5:0/1086713054 >> 172.21.15.5:0/1086713054 conn(0x7f21a006dae0 msgr2=0x7f21a006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:21.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 -- 172.21.15.5:0/1086713054 shutdown_connections 2023-10-16T13:40:21.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.565+0000 7f21a737e700 1 -- 172.21.15.5:0/1086713054 wait complete. 2023-10-16T13:40:21.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.566+0000 7f21a737e700 1 Processor -- start 2023-10-16T13:40:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.566+0000 7f21a737e700 1 -- start start 2023-10-16T13:40:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a737e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f21a01e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a737e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a015ad30 0x7f21a00c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a737e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a00c5dc0 0x7f21a00b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a737e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a015b1b0 con 0x7f218c004850 2023-10-16T13:40:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a737e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00c6530 con 0x7f21a00c5dc0 2023-10-16T13:40:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a737e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00c6810 con 0x7f21a015ad30 2023-10-16T13:40:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f21a01e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f21a01e6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45210/0 (socket says 172.21.15.5:45210) 2023-10-16T13:40:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 -- 172.21.15.5:0/669261352 learned_addr learned my addr 172.21.15.5:0/669261352 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a591b700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a00c5dc0 0x7f21a00b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a4919700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a015ad30 0x7f21a00c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 -- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a015ad30 msgr2=0x7f21a00c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a015ad30 0x7f21a00c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 -- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a00c5dc0 msgr2=0x7f21a00b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a00c5dc0 0x7f21a00b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 -- 172.21.15.5:0/669261352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00b4330 con 0x7f218c004850 2023-10-16T13:40:21.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a4919700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a015ad30 0x7f21a00c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:21.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f21a511a700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f21a01e6a70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f219c0072c0 tx=0x7f219c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.567+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c0077b0 con 0x7f218c004850 2023-10-16T13:40:21.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.568+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00f8d0 con 0x7f218c004850 2023-10-16T13:40:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.568+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a00b4610 con 0x7f218c004850 2023-10-16T13:40:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.568+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00fc80 con 0x7f218c004850 2023-10-16T13:40:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.568+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a00b3f50 con 0x7f218c004850 2023-10-16T13:40:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.569+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a00b4170 con 0x7f218c004850 2023-10-16T13:40:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.569+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f219c01d460 con 0x7f218c004850 2023-10-16T13:40:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.569+0000 7f2195ffb700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af90 0x7f218406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.569+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f219c0895d0 con 0x7f218c004850 2023-10-16T13:40:21.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.570+0000 7f21a4919700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af90 0x7f218406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.570+0000 7f21a4919700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af90 0x7f218406d450 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f21a00b0180 tx=0x7f2190008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.574+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f219c0581d0 con 0x7f218c004850 2023-10-16T13:40:21.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.778+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21a00b2630 con 0x7f218c004850 2023-10-16T13:40:21.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.779+0000 7f2195ffb700 1 -- 172.21.15.5:0/669261352 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f219c057d60 con 0x7f218c004850 2023-10-16T13:40:21.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:21.783 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:04.656921+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:21.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af90 msgr2=0x7f218406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af90 0x7f218406d450 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f21a00b0180 tx=0x7f2190008030 comp rx=0 tx=0).stop 2023-10-16T13:40:21.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 msgr2=0x7f21a01e6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f21a01e6a70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f219c0072c0 tx=0x7f219c0075d0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 shutdown_connections 2023-10-16T13:40:21.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a00c5dc0 0x7f21a00b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f218c004850 0x7f21a01e6a70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f218406af90 0x7f218406d450 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 --2- 172.21.15.5:0/669261352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21a015ad30 0x7f21a00c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 >> 172.21.15.5:0/669261352 conn(0x7f21a006dae0 msgr2=0x7f21a015d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:21.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 shutdown_connections 2023-10-16T13:40:21.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.782+0000 7f21a737e700 1 -- 172.21.15.5:0/669261352 wait complete. 2023-10-16T13:40:21.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:40:01.561842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:40:02.032316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:40:21.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:40:21.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.924+0000 7f5cea654700 1 Processor -- start 2023-10-16T13:40:21.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.924+0000 7f5cea654700 1 -- start start 2023-10-16T13:40:21.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.924+0000 7f5cea654700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ce415e460 0x7f5ce41650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.924+0000 7f5cea654700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce4158120 con 0x7f5ce40cee90 2023-10-16T13:40:21.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.924+0000 7f5cea654700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce406a840 con 0x7f5ce4157d40 2023-10-16T13:40:21.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.924+0000 7f5cea654700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce406e560 con 0x7f5ce415e460 2023-10-16T13:40:21.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ce415e460 0x7f5ce41650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ce415e460 0x7f5ce41650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45222/0 (socket says 172.21.15.5:45222) 2023-10-16T13:40:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 -- 172.21.15.5:0/2573174582 learned_addr learned my addr 172.21.15.5:0/2573174582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ce40cee90 0x7f5ce415dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55224/0 (socket says 172.21.15.5:55224) 2023-10-16T13:40:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 -- 172.21.15.5:0/2573174582 >> v1:172.21.15.112:6789/0 conn(0x7f5ce4157d40 legacy=0x7f5ce406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 -- 172.21.15.5:0/2573174582 >> v1:172.21.15.5:6789/0 conn(0x7f5ce40cee90 legacy=0x7f5ce415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce2ffd700 1 -- 172.21.15.5:0/2573174582 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207227120 0 0) 0x7f5ce4158120 con 0x7f5ce40cee90 2023-10-16T13:40:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 -- 172.21.15.5:0/2573174582 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40caef0 con 0x7f5ce415e460 2023-10-16T13:40:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce8bf1700 1 --2- 172.21.15.5:0/2573174582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce415e460 0x7f5ce41650e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009e50 tx=0x7f5cdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4915bd9ec0523ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce2ffd700 1 -- 172.21.15.5:0/2573174582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00e070 con 0x7f5ce415e460 2023-10-16T13:40:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce2ffd700 1 -- 172.21.15.5:0/2573174582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc00b9c0 con 0x7f5ce415e460 2023-10-16T13:40:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.925+0000 7f5ce2ffd700 1 -- 172.21.15.5:0/2573174582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00bd70 con 0x7f5ce415e460 2023-10-16T13:40:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 -- 172.21.15.5:0/2573174582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce415e460 msgr2=0x7f5ce41650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 --2- 172.21.15.5:0/2573174582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce415e460 0x7f5ce41650e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009e50 tx=0x7f5cdc00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 -- 172.21.15.5:0/2573174582 shutdown_connections 2023-10-16T13:40:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 --2- 172.21.15.5:0/2573174582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce415e460 0x7f5ce41650e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 -- 172.21.15.5:0/2573174582 >> 172.21.15.5:0/2573174582 conn(0x7f5ce40cc6f0 msgr2=0x7f5ce40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:21.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 -- 172.21.15.5:0/2573174582 shutdown_connections 2023-10-16T13:40:21.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.926+0000 7f5cea654700 1 -- 172.21.15.5:0/2573174582 wait complete. 2023-10-16T13:40:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.927+0000 7f5cea654700 1 Processor -- start 2023-10-16T13:40:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.927+0000 7f5cea654700 1 -- start start 2023-10-16T13:40:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5cea654700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 0x7f5ce40c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5cea654700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce4157d40 0x7f5ce4159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5cea654700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce415e460 0x7f5ce4150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5cea654700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4150e80 con 0x7f5ce40cee90 2023-10-16T13:40:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5cea654700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4151a30 con 0x7f5ce4157d40 2023-10-16T13:40:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5cea654700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4150ba0 con 0x7f5ce415e460 2023-10-16T13:40:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5ce3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 0x7f5ce40c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5ce3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 0x7f5ce40c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45224/0 (socket says 172.21.15.5:45224) 2023-10-16T13:40:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5ce3fff700 1 -- 172.21.15.5:0/2305879174 learned_addr learned my addr 172.21.15.5:0/2305879174 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5ce37fe700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce4157d40 0x7f5ce4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.928+0000 7f5ce8bf1700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce415e460 0x7f5ce4150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce3fff700 1 -- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce415e460 msgr2=0x7f5ce4150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce3fff700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce415e460 0x7f5ce4150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce3fff700 1 -- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce4157d40 msgr2=0x7f5ce4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce3fff700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce4157d40 0x7f5ce4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce3fff700 1 -- 172.21.15.5:0/2305879174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc009b30 con 0x7f5ce40cee90 2023-10-16T13:40:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce8bf1700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce415e460 0x7f5ce4150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce3fff700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 0x7f5ce40c3480 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400e940 tx=0x7f5cd400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40052d0 con 0x7f5ce40cee90 2023-10-16T13:40:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd4005430 con 0x7f5ce40cee90 2023-10-16T13:40:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd400ca20 con 0x7f5ce40cee90 2023-10-16T13:40:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce40af850 con 0x7f5ce40cee90 2023-10-16T13:40:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.929+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce40afe10 con 0x7f5ce40cee90 2023-10-16T13:40:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.930+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce40cf270 con 0x7f5ce40cee90 2023-10-16T13:40:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.930+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f5cd400cb80 con 0x7f5ce40cee90 2023-10-16T13:40:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.931+0000 7f5ce0ff9700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cd006af90 0x7f5cd006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.931+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cd408b680 con 0x7f5ce40cee90 2023-10-16T13:40:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.931+0000 7f5ce37fe700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cd006af90 0x7f5cd006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.931+0000 7f5ce37fe700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cd006af90 0x7f5cd006d450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ce414ead0 tx=0x7f5cd8004a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:21.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:21.936+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cd40566c0 con 0x7f5ce40cee90 2023-10-16T13:40:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.137+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ce4067d20 con 0x7f5ce40cee90 2023-10-16T13:40:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.138+0000 7f5ce0ff9700 1 -- 172.21.15.5:0/2305879174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cd401f020 con 0x7f5ce40cee90 2023-10-16T13:40:22.141 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:40:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cd006af90 msgr2=0x7f5cd006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cd006af90 0x7f5cd006d450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ce414ead0 tx=0x7f5cd8004a50 comp rx=0 tx=0).stop 2023-10-16T13:40:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 msgr2=0x7f5ce40c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 0x7f5ce40c3480 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400e940 tx=0x7f5cd400ec50 comp rx=0 tx=0).stop 2023-10-16T13:40:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 shutdown_connections 2023-10-16T13:40:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cd006af90 0x7f5cd006d450 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce415e460 0x7f5ce4150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce40cee90 0x7f5ce40c3480 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 --2- 172.21.15.5:0/2305879174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce4157d40 0x7f5ce4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 >> 172.21.15.5:0/2305879174 conn(0x7f5ce40cc6f0 msgr2=0x7f5ce414f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 shutdown_connections 2023-10-16T13:40:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.140+0000 7f5cea654700 1 -- 172.21.15.5:0/2305879174 wait complete. 2023-10-16T13:40:22.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:40:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.280+0000 7fdab7674700 1 Processor -- start 2023-10-16T13:40:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.280+0000 7fdab7674700 1 -- start start 2023-10-16T13:40:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab7674700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdab015f1f0 0x7fdab00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab7674700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdab00cfc60 0x7fdab00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab7674700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab015e7a0 con 0x7fdab015ab10 2023-10-16T13:40:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab7674700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00d0090 con 0x7fdab00cfc60 2023-10-16T13:40:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab7674700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00b29a0 con 0x7fdab015f1f0 2023-10-16T13:40:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab5c11700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdab00cfc60 0x7fdab00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab5410700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdab015ab10 0x7fdab00b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55236/0 (socket says 172.21.15.5:55236) 2023-10-16T13:40:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab5c11700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdab00cfc60 0x7fdab00cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45236/0 (socket says 172.21.15.5:45236) 2023-10-16T13:40:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab5410700 1 -- 172.21.15.5:0/511226808 learned_addr learned my addr 172.21.15.5:0/511226808 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.281+0000 7fdab4c0f700 1 --2- 172.21.15.5:0/511226808 >> v2:172.21.15.112:3300/0 conn(0x7fdab015f1f0 0x7fdab00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab5c11700 1 -- 172.21.15.5:0/511226808 >> v2:172.21.15.112:3300/0 conn(0x7fdab015f1f0 msgr2=0x7fdab00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab5c11700 1 --2- 172.21.15.5:0/511226808 >> v2:172.21.15.112:3300/0 conn(0x7fdab015f1f0 0x7fdab00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab5c11700 1 -- 172.21.15.5:0/511226808 >> v1:172.21.15.5:6789/0 conn(0x7fdab015ab10 legacy=0x7fdab00b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab5c11700 1 -- 172.21.15.5:0/511226808 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00b2c80 con 0x7fdab00cfc60 2023-10-16T13:40:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab5c11700 1 --2- 172.21.15.5:0/511226808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab00cbf40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdab006d470 tx=0x7fdaa800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe80afa16b4e27c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdaa7fff700 1 -- 172.21.15.5:0/511226808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8010070 con 0x7fdab00cfc60 2023-10-16T13:40:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdaa7fff700 1 -- 172.21.15.5:0/511226808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800b2e0 con 0x7fdab00cfc60 2023-10-16T13:40:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdaa7fff700 1 -- 172.21.15.5:0/511226808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800dcc0 con 0x7fdab00cfc60 2023-10-16T13:40:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab7674700 1 -- 172.21.15.5:0/511226808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 msgr2=0x7fdab00cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab7674700 1 --2- 172.21.15.5:0/511226808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab00cbf40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdab006d470 tx=0x7fdaa800d330 comp rx=0 tx=0).stop 2023-10-16T13:40:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab7674700 1 -- 172.21.15.5:0/511226808 shutdown_connections 2023-10-16T13:40:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab7674700 1 --2- 172.21.15.5:0/511226808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab00cbf40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab7674700 1 --2- 172.21.15.5:0/511226808 >> v2:172.21.15.112:3300/0 conn(0x7fdab015f1f0 0x7fdab00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.282+0000 7fdab7674700 1 -- 172.21.15.5:0/511226808 >> 172.21.15.5:0/511226808 conn(0x7fdab006dae0 msgr2=0x7fdab006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.283+0000 7fdab7674700 1 -- 172.21.15.5:0/511226808 shutdown_connections 2023-10-16T13:40:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.283+0000 7fdab7674700 1 -- 172.21.15.5:0/511226808 wait complete. 2023-10-16T13:40:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.284+0000 7fdab7674700 1 Processor -- start 2023-10-16T13:40:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.284+0000 7fdab7674700 1 -- start start 2023-10-16T13:40:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.284+0000 7fdab7674700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab0145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.284+0000 7fdab7674700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab015ab10 0x7fdab015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab7674700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab015f1f0 0x7fdab00cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab7674700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015d730 con 0x7fdab00cfc60 2023-10-16T13:40:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab7674700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00c4070 con 0x7fdab015f1f0 2023-10-16T13:40:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab7674700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015cab0 con 0x7fdab015ab10 2023-10-16T13:40:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab0145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab0145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45238/0 (socket says 172.21.15.5:45238) 2023-10-16T13:40:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 -- 172.21.15.5:0/2995962769 learned_addr learned my addr 172.21.15.5:0/2995962769 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab4c0f700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab015ab10 0x7fdab015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 -- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab015ab10 msgr2=0x7fdab015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab015ab10 0x7fdab015b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5c11700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab015f1f0 0x7fdab00cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 -- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab015f1f0 msgr2=0x7fdab00cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab015f1f0 0x7fdab00cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 -- 172.21.15.5:0/2995962769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa800bc80 con 0x7fdab00cfc60 2023-10-16T13:40:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab5410700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab0145a50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c480 tx=0x7fdaa000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0005d70 con 0x7fdab00cfc60 2023-10-16T13:40:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa00070d0 con 0x7fdab00cfc60 2023-10-16T13:40:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab015cd90 con 0x7fdab00cfc60 2023-10-16T13:40:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0007440 con 0x7fdab00cfc60 2023-10-16T13:40:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.285+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab015d350 con 0x7fdab00cfc60 2023-10-16T13:40:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.286+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab015d4e0 con 0x7fdab00cfc60 2023-10-16T13:40:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.287+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fdaa00075a0 con 0x7fdab00cfc60 2023-10-16T13:40:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.287+0000 7fdaa5ffb700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda9406af90 0x7fda9406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.287+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaa0088ac0 con 0x7fdab00cfc60 2023-10-16T13:40:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.287+0000 7fdab4c0f700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda9406af90 0x7fda9406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.288+0000 7fdab4c0f700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda9406af90 0x7fda9406d450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006fd0 tx=0x7fdaac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.292+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaa0053ba0 con 0x7fdab00cfc60 2023-10-16T13:40:22.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.490+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdab0067d20 con 0x7fdab00cfc60 2023-10-16T13:40:22.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.490+0000 7fdaa5ffb700 1 -- 172.21.15.5:0/2995962769 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdaa00170a0 con 0x7fdab00cfc60 2023-10-16T13:40:22.493 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:40:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda9406af90 msgr2=0x7fda9406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda9406af90 0x7fda9406d450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006fd0 tx=0x7fdaac008040 comp rx=0 tx=0).stop 2023-10-16T13:40:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 msgr2=0x7fdab0145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab0145a50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c480 tx=0x7fdaa000c840 comp rx=0 tx=0).stop 2023-10-16T13:40:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 shutdown_connections 2023-10-16T13:40:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab015f1f0 0x7fdab00cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab00cfc60 0x7fdab0145a50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda9406af90 0x7fda9406d450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 --2- 172.21.15.5:0/2995962769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab015ab10 0x7fdab015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 >> 172.21.15.5:0/2995962769 conn(0x7fdab006dae0 msgr2=0x7fdab006b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 shutdown_connections 2023-10-16T13:40:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.492+0000 7fdab7674700 1 -- 172.21.15.5:0/2995962769 wait complete. 2023-10-16T13:40:22.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:40:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.633+0000 7fd8d6863700 1 Processor -- start 2023-10-16T13:40:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.633+0000 7fd8d6863700 1 -- start start 2023-10-16T13:40:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8d6863700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8d00cf8a0 0x7fd8d00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8d6863700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00d1bc0 0x7fd8d00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8d6863700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d015ee90 con 0x7fd8d015eab0 2023-10-16T13:40:22.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8d6863700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d0158370 con 0x7fd8d00cf8a0 2023-10-16T13:40:22.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8d6863700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00d23b0 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8d00cf8a0 0x7fd8d00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8d00cf8a0 0x7fd8d00d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45248/0 (socket says 172.21.15.5:45248) 2023-10-16T13:40:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1868678016 learned_addr learned my addr 172.21.15.5:0/1868678016 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8d4e00700 1 --2- 172.21.15.5:0/1868678016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00d1bc0 0x7fd8d00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1868678016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00d1bc0 msgr2=0x7fd8d00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 --2- 172.21.15.5:0/1868678016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00d1bc0 0x7fd8d00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1868678016 >> v1:172.21.15.112:6789/0 conn(0x7fd8d015eab0 legacy=0x7fd8d00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1868678016 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00cda20 con 0x7fd8d00cf8a0 2023-10-16T13:40:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.634+0000 7fd8cf7fe700 1 --2- 172.21.15.5:0/1868678016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cf8a0 0x7fd8d00d1680 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd8d015f020 tx=0x7fd8c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0ac277bca21ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8ceffd700 1 -- 172.21.15.5:0/1868678016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4004230 con 0x7fd8d00cf8a0 2023-10-16T13:40:22.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8ceffd700 1 -- 172.21.15.5:0/1868678016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4004390 con 0x7fd8d00cf8a0 2023-10-16T13:40:22.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8ceffd700 1 -- 172.21.15.5:0/1868678016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40036a0 con 0x7fd8d00cf8a0 2023-10-16T13:40:22.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 -- 172.21.15.5:0/1868678016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cf8a0 msgr2=0x7fd8d00d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1868678016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cf8a0 0x7fd8d00d1680 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd8d015f020 tx=0x7fd8c4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 -- 172.21.15.5:0/1868678016 shutdown_connections 2023-10-16T13:40:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1868678016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00d1bc0 0x7fd8d00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1868678016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cf8a0 0x7fd8d00d1680 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 -- 172.21.15.5:0/1868678016 >> 172.21.15.5:0/1868678016 conn(0x7fd8d00665a0 msgr2=0x7fd8d0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 -- 172.21.15.5:0/1868678016 shutdown_connections 2023-10-16T13:40:22.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.635+0000 7fd8d6863700 1 -- 172.21.15.5:0/1868678016 wait complete. 2023-10-16T13:40:22.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 Processor -- start 2023-10-16T13:40:22.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 -- start start 2023-10-16T13:40:22.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00cf8a0 0x7fd8d01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 0x7fd8d00b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8d015eab0 0x7fd8d00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f3360 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0160790 con 0x7fd8d015eab0 2023-10-16T13:40:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.637+0000 7fd8d6863700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0160a70 con 0x7fd8d00cf8a0 2023-10-16T13:40:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 0x7fd8d00b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 0x7fd8d00b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45252/0 (socket says 172.21.15.5:45252) 2023-10-16T13:40:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1674996339 learned_addr learned my addr 172.21.15.5:0/1674996339 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8d4e00700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8d015eab0 0x7fd8d00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cffff700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00cf8a0 0x7fd8d01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00cf8a0 msgr2=0x7fd8d01f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00cf8a0 0x7fd8d01f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8d015eab0 msgr2=0x7fd8d00b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8d015eab0 0x7fd8d00b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 -- 172.21.15.5:0/1674996339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4009550 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cffff700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00cf8a0 0x7fd8d01f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8cf7fe700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 0x7fd8d00b1aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009130 tx=0x7fd8c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4003da0 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c400b670 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d0160d50 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400ba20 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.638+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d0161030 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.639+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d01611c0 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.640+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fd8c400bb80 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.640+0000 7fd8ccff9700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd8bc06af90 0x7fd8bc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.640+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8c408ad90 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.640+0000 7fd8cffff700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd8bc06af90 0x7fd8bc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.641+0000 7fd8cffff700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd8bc06af90 0x7fd8bc06d450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000f60 tx=0x7fd8c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.645+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8c4055e50 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.846+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8d00d2010 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.847+0000 7fd8ccff9700 1 -- 172.21.15.5:0/1674996339 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8c4010380 con 0x7fd8d00d1bc0 2023-10-16T13:40:22.850 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:40:22.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd8bc06af90 msgr2=0x7fd8bc06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd8bc06af90 0x7fd8bc06d450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000f60 tx=0x7fd8c0009040 comp rx=0 tx=0).stop 2023-10-16T13:40:22.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 msgr2=0x7fd8d00b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 0x7fd8d00b1aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009130 tx=0x7fd8c4004750 comp rx=0 tx=0).stop 2023-10-16T13:40:22.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 shutdown_connections 2023-10-16T13:40:22.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8d015eab0 0x7fd8d00b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd8bc06af90 0x7fd8bc06d450 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8d00cf8a0 0x7fd8d01f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 --2- 172.21.15.5:0/1674996339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00d1bc0 0x7fd8d00b1aa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 >> 172.21.15.5:0/1674996339 conn(0x7fd8d00665a0 msgr2=0x7fd8d00b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:22.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 shutdown_connections 2023-10-16T13:40:22.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.849+0000 7fd8d6863700 1 -- 172.21.15.5:0/1674996339 wait complete. 2023-10-16T13:40:22.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:40:22.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.986+0000 7f9f27fad700 1 Processor -- start 2023-10-16T13:40:22.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.987+0000 7f9f27fad700 1 -- start start 2023-10-16T13:40:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.987+0000 7f9f27fad700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 0x7f9f2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.987+0000 7f9f27fad700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 0x7f9f2006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.987+0000 7f9f27fad700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f20071ab0 con 0x7f9f200cc3f0 2023-10-16T13:40:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.987+0000 7f9f27fad700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f20161bc0 con 0x7f9f200b2950 2023-10-16T13:40:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.987+0000 7f9f27fad700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20161ea0 con 0x7f9f20161670 2023-10-16T13:40:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 0x7f9f2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f2654a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 0x7f9f2006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f2654a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 0x7f9f2006ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41160/0 (socket says 172.21.15.5:41160) 2023-10-16T13:40:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25d49700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9f200cc3f0 0x7f9f200cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46240/0 (socket says 172.21.15.5:46240) 2023-10-16T13:40:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 0x7f9f2006a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43166/0 (socket says 172.21.15.5:43166) 2023-10-16T13:40:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f2654a700 1 -- 172.21.15.5:0/1899502454 learned_addr learned my addr 172.21.15.5:0/1899502454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 -- 172.21.15.5:0/1899502454 >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 msgr2=0x7f9f2006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 --2- 172.21.15.5:0/1899502454 >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 0x7f9f2006ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 -- 172.21.15.5:0/1899502454 >> v1:172.21.15.112:6789/0 conn(0x7f9f200cc3f0 legacy=0x7f9f200cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 -- 172.21.15.5:0/1899502454 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f20162180 con 0x7f9f20161670 2023-10-16T13:40:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f2654a700 1 --2- 172.21.15.5:0/1899502454 >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 0x7f9f2006ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.988+0000 7f9f25548700 1 --2- 172.21.15.5:0/1899502454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 0x7f9f2006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009840 tx=0x7f9f14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e54ee5cba8e902 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f24d47700 1 -- 172.21.15.5:0/1899502454 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011830 con 0x7f9f20161670 2023-10-16T13:40:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f24d47700 1 -- 172.21.15.5:0/1899502454 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14011990 con 0x7f9f20161670 2023-10-16T13:40:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f24d47700 1 -- 172.21.15.5:0/1899502454 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011d20 con 0x7f9f20161670 2023-10-16T13:40:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 -- 172.21.15.5:0/1899502454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 msgr2=0x7f9f2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 --2- 172.21.15.5:0/1899502454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 0x7f9f2006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009840 tx=0x7f9f14009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 -- 172.21.15.5:0/1899502454 shutdown_connections 2023-10-16T13:40:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 --2- 172.21.15.5:0/1899502454 >> v2:172.21.15.112:3300/0 conn(0x7f9f200b2950 0x7f9f2006ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 --2- 172.21.15.5:0/1899502454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f20161670 0x7f9f2006a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 -- 172.21.15.5:0/1899502454 >> 172.21.15.5:0/1899502454 conn(0x7f9f2006dac0 msgr2=0x7f9f2006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 -- 172.21.15.5:0/1899502454 shutdown_connections 2023-10-16T13:40:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.989+0000 7f9f27fad700 1 -- 172.21.15.5:0/1899502454 wait complete. 2023-10-16T13:40:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.990+0000 7f9f27fad700 1 Processor -- start 2023-10-16T13:40:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.990+0000 7f9f27fad700 1 -- start start 2023-10-16T13:40:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f27fad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f200b2950 0x7f9f201f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f27fad700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f200cc3f0 0x7f9f200c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f27fad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 0x7f9f20151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f27fad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c9880 con 0x7f9f20161670 2023-10-16T13:40:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f27fad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c8c00 con 0x7f9f200b2950 2023-10-16T13:40:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f27fad700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c8ee0 con 0x7f9f200cc3f0 2023-10-16T13:40:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f2654a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 0x7f9f20151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f2654a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 0x7f9f20151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45270/0 (socket says 172.21.15.5:45270) 2023-10-16T13:40:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f2654a700 1 -- 172.21.15.5:0/925235718 learned_addr learned my addr 172.21.15.5:0/925235718 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f25548700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f200cc3f0 0x7f9f200c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.991+0000 7f9f25d49700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f200b2950 0x7f9f201f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f2654a700 1 -- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f200cc3f0 msgr2=0x7f9f200c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f2654a700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f200cc3f0 0x7f9f200c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f2654a700 1 -- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f200b2950 msgr2=0x7f9f201f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f2654a700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f200b2950 0x7f9f201f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f2654a700 1 -- 172.21.15.5:0/925235718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009b30 con 0x7f9f20161670 2023-10-16T13:40:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f25548700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f200cc3f0 0x7f9f200c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f2654a700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 0x7f9f20151280 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800efc0 tx=0x7f9f1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800ca80 con 0x7f9f20161670 2023-10-16T13:40:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1800f040 con 0x7f9f20161670 2023-10-16T13:40:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f140094a0 con 0x7f9f20161670 2023-10-16T13:40:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800ce40 con 0x7f9f20161670 2023-10-16T13:40:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.992+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f200cd060 con 0x7f9f20161670 2023-10-16T13:40:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.993+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f200c99c0 con 0x7f9f20161670 2023-10-16T13:40:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.994+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f9f18014480 con 0x7f9f20161670 2023-10-16T13:40:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.994+0000 7f9f127fc700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f0406af90 0x7f9f0406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.994+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f18089c30 con 0x7f9f20161670 2023-10-16T13:40:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.994+0000 7f9f25d49700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f0406af90 0x7f9f0406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.995+0000 7f9f25d49700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f0406af90 0x7f9f0406d450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000f60 tx=0x7f9f1c007ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:22.999+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f200c99c0 con 0x7f9f20161670 2023-10-16T13:40:23.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.215+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f200c99c0 con 0x7f9f20161670 2023-10-16T13:40:23.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.215+0000 7f9f127fc700 1 -- 172.21.15.5:0/925235718 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f200c99c0 con 0x7f9f20161670 2023-10-16T13:40:23.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.217+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f0406af90 msgr2=0x7f9f0406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.217+0000 7f9f27fad700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f0406af90 0x7f9f0406d450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000f60 tx=0x7f9f1c007ed0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.217+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 msgr2=0x7f9f20151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.217+0000 7f9f27fad700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 0x7f9f20151280 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800efc0 tx=0x7f9f1800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.217+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 shutdown_connections 2023-10-16T13:40:23.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f20161670 0x7f9f20151280 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f200b2950 0x7f9f201f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9f0406af90 0x7f9f0406d450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 --2- 172.21.15.5:0/925235718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9f200cc3f0 0x7f9f200c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 >> 172.21.15.5:0/925235718 conn(0x7f9f2006dac0 msgr2=0x7f9f200cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 shutdown_connections 2023-10-16T13:40:23.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.218+0000 7f9f27fad700 1 -- 172.21.15.5:0/925235718 wait complete. 2023-10-16T13:40:23.223 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:40:23.232 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:40:23.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:23.233 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:23.276 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:40:23.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:23.277 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:40:23.337 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:23.338 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:23.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:40:23.357 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:23.358 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:23.396 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:40:23.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:23.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 Processor -- start 2023-10-16T13:40:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 -- start start 2023-10-16T13:40:23.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 0x7f76e00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f76e00ce6e0 0x7f76e00cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00cf190 con 0x7f76e00d0c70 2023-10-16T13:40:23.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e015bb20 con 0x7f76e00ce6e0 2023-10-16T13:40:23.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.520+0000 7f76e6549700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00cbd40 con 0x7f76e015b740 2023-10-16T13:40:23.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76df7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f76e00d0c70 0x7f76e00cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55278/0 (socket says 172.21.15.5:55278) 2023-10-16T13:40:23.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76df7fe700 1 -- 172.21.15.5:0/4166373704 learned_addr learned my addr 172.21.15.5:0/4166373704 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:23.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76dffff700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 0x7f76e00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76e4ae6700 1 --2- 172.21.15.5:0/4166373704 >> v2:172.21.15.112:3300/0 conn(0x7f76e00ce6e0 0x7f76e00cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692938404 0 0) 0x7f76e00cf190 con 0x7f76e00d0c70 2023-10-16T13:40:23.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c80035b0 con 0x7f76e00d0c70 2023-10-16T13:40:23.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909266423 0 0) 0x7f76c80035b0 con 0x7f76e00d0c70 2023-10-16T13:40:23.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 msgr2=0x7f76e00d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 0x7f76e00d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 >> v2:172.21.15.112:3300/0 conn(0x7f76e00ce6e0 msgr2=0x7f76e00cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 --2- 172.21.15.5:0/4166373704 >> v2:172.21.15.112:3300/0 conn(0x7f76e00ce6e0 0x7f76e00cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00cc020 con 0x7f76e00d0c70 2023-10-16T13:40:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f76d4001670 con 0x7f76e00d0c70 2023-10-16T13:40:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76e4ae6700 1 --2- 172.21.15.5:0/4166373704 >> v2:172.21.15.112:3300/0 conn(0x7f76e00ce6e0 0x7f76e00cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 >> v1:172.21.15.5:6789/0 conn(0x7f76e00d0c70 legacy=0x7f76e00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 0x7f76c8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c8003f80 0x7f76c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8004d90 0x7f76c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e015bb20 con 0x7f76c8004d90 2023-10-16T13:40:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00cbd40 con 0x7f76c8003f80 2023-10-16T13:40:23.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c800ba60 con 0x7f76e015b740 2023-10-16T13:40:23.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76e4ae6700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8004d90 0x7f76c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c8003f80 0x7f76c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.521+0000 7f76dffff700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 0x7f76c8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76df7fe700 1 -- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 msgr2=0x7f76c8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e015b740 0x7f76c8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76df7fe700 1 -- 172.21.15.5:0/4166373704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8004d90 msgr2=0x7f76c8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8004d90 0x7f76c8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76df7fe700 1 -- 172.21.15.5:0/4166373704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80035b0 con 0x7f76c8003f80 2023-10-16T13:40:23.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76e4ae6700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8004d90 0x7f76c8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:23.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c8003f80 0x7f76c8004850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c370 tx=0x7f76c8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6c0329bcda369b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4007c60 con 0x7f76c8003f80 2023-10-16T13:40:23.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4005960 con 0x7f76c8003f80 2023-10-16T13:40:23.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.522+0000 7f76deffd700 1 -- 172.21.15.5:0/4166373704 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4005d10 con 0x7f76c8003f80 2023-10-16T13:40:23.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e6549700 1 -- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c8003f80 msgr2=0x7f76c8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e6549700 1 --2- 172.21.15.5:0/4166373704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76c8003f80 0x7f76c8004850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c370 tx=0x7f76c8005880 comp rx=0 tx=0).stop 2023-10-16T13:40:23.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e4ae6700 1 -- 172.21.15.5:0/4166373704 reap_dead start 2023-10-16T13:40:23.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e6549700 1 -- 172.21.15.5:0/4166373704 shutdown_connections 2023-10-16T13:40:23.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e6549700 1 -- 172.21.15.5:0/4166373704 >> 172.21.15.5:0/4166373704 conn(0x7f76e00665a0 msgr2=0x7f76e0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:23.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e6549700 1 -- 172.21.15.5:0/4166373704 shutdown_connections 2023-10-16T13:40:23.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.523+0000 7f76e6549700 1 -- 172.21.15.5:0/4166373704 wait complete. 2023-10-16T13:40:23.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.524+0000 7f76e6549700 1 Processor -- start 2023-10-16T13:40:23.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.524+0000 7f76e6549700 1 -- start start 2023-10-16T13:40:23.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e6549700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 0x7f76e00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e6549700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e0159690 0x7f76e00b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e6549700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e006ce50 0x7f76e00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e6549700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00b5100 con 0x7f76c8003f80 2023-10-16T13:40:23.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e6549700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e006d980 con 0x7f76e006ce50 2023-10-16T13:40:23.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e6549700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e01f2dc0 con 0x7f76e0159690 2023-10-16T13:40:23.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 0x7f76e00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 0x7f76e00affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45286/0 (socket says 172.21.15.5:45286) 2023-10-16T13:40:23.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 -- 172.21.15.5:0/4141572833 learned_addr learned my addr 172.21.15.5:0/4141572833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:23.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e0159690 0x7f76e00b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76e4ae6700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e006ce50 0x7f76e00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 -- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e0159690 msgr2=0x7f76e00b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e0159690 0x7f76e00b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 -- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e006ce50 msgr2=0x7f76e00ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e006ce50 0x7f76e00ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 -- 172.21.15.5:0/4141572833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e006d6a0 con 0x7f76c8003f80 2023-10-16T13:40:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.525+0000 7f76dffff700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 0x7f76e00affd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f76d0011aa0 tx=0x7f76d0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.526+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011ed0 con 0x7f76c8003f80 2023-10-16T13:40:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.526+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d000f940 con 0x7f76c8003f80 2023-10-16T13:40:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.526+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d000fcf0 con 0x7f76c8003f80 2023-10-16T13:40:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.526+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e00b40e0 con 0x7f76c8003f80 2023-10-16T13:40:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.526+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e00b46a0 con 0x7f76c8003f80 2023-10-16T13:40:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.526+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e00b4a10 con 0x7f76c8003f80 2023-10-16T13:40:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.527+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f76d0014440 con 0x7f76c8003f80 2023-10-16T13:40:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.528+0000 7f76dcff9700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76cc06af90 0x7f76cc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.528+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76d0089aa0 con 0x7f76c8003f80 2023-10-16T13:40:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.528+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76cc06af90 0x7f76cc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.528+0000 7f76df7fe700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76cc06af90 0x7f76cc06d450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f76d4015040 tx=0x7f76d400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.532+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76d0054cb0 con 0x7f76c8003f80 2023-10-16T13:40:23.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.776+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76e00c50b0 con 0x7f76c8003f80 2023-10-16T13:40:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.777+0000 7f76dcff9700 1 -- 172.21.15.5:0/4141572833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f76d0022020 con 0x7f76c8003f80 2023-10-16T13:40:23.780 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:23.780 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:03.062480+0000","modified":"2023-10-16T13:40:06.104790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1547849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1547849780},{"type":"v1","addr":"172.21.15.5:6835","nonce":1547849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-16T13:40:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76cc06af90 msgr2=0x7f76cc06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76cc06af90 0x7f76cc06d450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f76d4015040 tx=0x7f76d400a000 comp rx=0 tx=0).stop 2023-10-16T13:40:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 msgr2=0x7f76e00affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 0x7f76e00affd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f76d0011aa0 tx=0x7f76d0011db0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 shutdown_connections 2023-10-16T13:40:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e006ce50 0x7f76e00ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76c8003f80 0x7f76e00affd0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f76cc06af90 0x7f76cc06d450 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 --2- 172.21.15.5:0/4141572833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76e0159690 0x7f76e00b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 >> 172.21.15.5:0/4141572833 conn(0x7f76e00665a0 msgr2=0x7f76e015a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:23.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 shutdown_connections 2023-10-16T13:40:23.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.779+0000 7f76e6549700 1 -- 172.21.15.5:0/4141572833 wait complete. 2023-10-16T13:40:23.784 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-10-16T13:40:23.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.917+0000 7f1094b9e700 1 Processor -- start 2023-10-16T13:40:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.917+0000 7f1094b9e700 1 -- start start 2023-10-16T13:40:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f1094b9e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1090160c40 0x7f10900cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f1094b9e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b2860 0x7f10900ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f1094b9e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900ceb60 con 0x7f10900ca8d0 2023-10-16T13:40:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f1094b9e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900cf4b0 con 0x7f1090160c40 2023-10-16T13:40:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f1094b9e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1090071970 con 0x7f10900b2860 2023-10-16T13:40:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f108effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10900ca8d0 0x7f109006ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55300/0 (socket says 172.21.15.5:55300) 2023-10-16T13:40:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f108effd700 1 -- 172.21.15.5:0/1771354676 learned_addr learned my addr 172.21.15.5:0/1771354676 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f108ffff700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b2860 0x7f10900ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.918+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1771354676 >> v2:172.21.15.112:3300/0 conn(0x7f1090160c40 0x7f10900cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638713534 0 0) 0x7f10900ceb60 con 0x7f10900ca8d0 2023-10-16T13:40:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f107c0035b0 con 0x7f10900ca8d0 2023-10-16T13:40:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3957137544 0 0) 0x7f107c0035b0 con 0x7f10900ca8d0 2023-10-16T13:40:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b2860 msgr2=0x7f10900ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b2860 0x7f10900ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 >> v2:172.21.15.112:3300/0 conn(0x7f1090160c40 msgr2=0x7f10900cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 --2- 172.21.15.5:0/1771354676 >> v2:172.21.15.112:3300/0 conn(0x7f1090160c40 0x7f10900cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090071c50 con 0x7f10900ca8d0 2023-10-16T13:40:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f1080001670 con 0x7f10900ca8d0 2023-10-16T13:40:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 >> v1:172.21.15.5:6789/0 conn(0x7f10900ca8d0 legacy=0x7f109006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c003a00 0x7f107c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f107c004850 0x7f107c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c005210 0x7f107c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090071970 con 0x7f107c003a00 2023-10-16T13:40:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c00bfb0 con 0x7f107c005210 2023-10-16T13:40:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c00c170 con 0x7f107c004850 2023-10-16T13:40:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1771354676 >> v2:172.21.15.112:3300/0 conn(0x7f1090160c40 0x7f10900cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108ffff700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b2860 0x7f10900ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c003a00 0x7f107c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108effd700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f107c004850 0x7f107c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108ffff700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c005210 0x7f107c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 -- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f107c004850 msgr2=0x7f107c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f107c004850 0x7f107c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 -- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c005210 msgr2=0x7f107c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c005210 0x7f107c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.919+0000 7f108f7fe700 1 -- 172.21.15.5:0/1771354676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c0035b0 con 0x7f107c003a00 2023-10-16T13:40:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c003a00 0x7f107c003e20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1078009d10 tx=0x7f107c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11710ec9e53ff7ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078009e60 con 0x7f107c003a00 2023-10-16T13:40:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800e9a0 con 0x7f107c003a00 2023-10-16T13:40:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f108e7fc700 1 -- 172.21.15.5:0/1771354676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800ed10 con 0x7f107c003a00 2023-10-16T13:40:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f1094b9e700 1 -- 172.21.15.5:0/1771354676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c003a00 msgr2=0x7f107c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1771354676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f107c003a00 0x7f107c003e20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1078009d10 tx=0x7f107c005880 comp rx=0 tx=0).stop 2023-10-16T13:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f108ffff700 1 -- 172.21.15.5:0/1771354676 reap_dead start 2023-10-16T13:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f1094b9e700 1 -- 172.21.15.5:0/1771354676 shutdown_connections 2023-10-16T13:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f1094b9e700 1 -- 172.21.15.5:0/1771354676 >> 172.21.15.5:0/1771354676 conn(0x7f10900b1d70 msgr2=0x7f10900b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f1094b9e700 1 -- 172.21.15.5:0/1771354676 shutdown_connections 2023-10-16T13:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.920+0000 7f1094b9e700 1 -- 172.21.15.5:0/1771354676 wait complete. 2023-10-16T13:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 Processor -- start 2023-10-16T13:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 -- start start 2023-10-16T13:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c003a00 0x7f10901512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b0540 0x7f10900b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 0x7f109015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900b0f00 con 0x7f109015da80 2023-10-16T13:40:23.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900ad950 con 0x7f107c003a00 2023-10-16T13:40:23.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.922+0000 7f1094b9e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900ac8b0 con 0x7f10900b0540 2023-10-16T13:40:23.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 0x7f109015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 0x7f109015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45310/0 (socket says 172.21.15.5:45310) 2023-10-16T13:40:23.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 -- 172.21.15.5:0/1612560007 learned_addr learned my addr 172.21.15.5:0/1612560007 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:23.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c003a00 0x7f10901512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108effd700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b0540 0x7f10900b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 -- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b0540 msgr2=0x7f10900b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b0540 0x7f10900b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 -- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c003a00 msgr2=0x7f10901512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c003a00 0x7f10901512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 -- 172.21.15.5:0/1612560007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900acb90 con 0x7f109015da80 2023-10-16T13:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f108ffff700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 0x7f109015dee0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f10900c3a70 tx=0x7f108800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800e040 con 0x7f109015da80 2023-10-16T13:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800f040 con 0x7f109015da80 2023-10-16T13:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10900ace70 con 0x7f109015da80 2023-10-16T13:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800fed0 con 0x7f109015da80 2023-10-16T13:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.923+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900ad430 con 0x7f109015da80 2023-10-16T13:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.924+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090071ef0 con 0x7f109015da80 2023-10-16T13:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.925+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f1088003a20 con 0x7f109015da80 2023-10-16T13:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.925+0000 7f1087fff700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f107006af90 0x7f107006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.925+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10880893f0 con 0x7f109015da80 2023-10-16T13:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.925+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f107006af90 0x7f107006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.926+0000 7f108f7fe700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f107006af90 0x7f107006d450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f10780090b0 tx=0x7f107801d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:23.930+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10880543a0 con 0x7f109015da80 2023-10-16T13:40:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.131+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10900ad650 con 0x7f109015da80 2023-10-16T13:40:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.132+0000 7f1087fff700 1 -- 172.21.15.5:0/1612560007 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f10880579c0 con 0x7f109015da80 2023-10-16T13:40:24.135 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:24.135 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:04.656921+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f107006af90 msgr2=0x7f107006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f107006af90 0x7f107006d450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f10780090b0 tx=0x7f107801d040 comp rx=0 tx=0).stop 2023-10-16T13:40:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 msgr2=0x7f109015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 0x7f109015dee0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f10900c3a70 tx=0x7f108800f6c0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 shutdown_connections 2023-10-16T13:40:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f109015da80 0x7f109015dee0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f107c003a00 0x7f10901512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f107006af90 0x7f107006d450 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 --2- 172.21.15.5:0/1612560007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10900b0540 0x7f10900b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 >> 172.21.15.5:0/1612560007 conn(0x7f10900b1d70 msgr2=0x7f109015fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 shutdown_connections 2023-10-16T13:40:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.134+0000 7f1094b9e700 1 -- 172.21.15.5:0/1612560007 wait complete. 2023-10-16T13:40:24.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:40:01.561842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:40:02.032316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:40:24.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:40:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 Processor -- start 2023-10-16T13:40:24.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 -- start start 2023-10-16T13:40:24.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298815bb50 0x7f298806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29880ce280 0x7f298806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298815bf30 con 0x7f298806ed50 2023-10-16T13:40:24.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298806f1d0 con 0x7f298815bb50 2023-10-16T13:40:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.276+0000 7f298e372700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29880b2d70 con 0x7f29880ce280 2023-10-16T13:40:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f298c90f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29880ce280 0x7f298806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298815bb50 0x7f298806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f298c90f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29880ce280 0x7f298806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43218/0 (socket says 172.21.15.5:43218) 2023-10-16T13:40:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f29877fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f298806ed50 0x7f29880cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46294/0 (socket says 172.21.15.5:46294) 2023-10-16T13:40:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298815bb50 0x7f298806e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41210/0 (socket says 172.21.15.5:41210) 2023-10-16T13:40:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f298c90f700 1 -- 172.21.15.5:0/2345786052 learned_addr learned my addr 172.21.15.5:0/2345786052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 -- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29880ce280 msgr2=0x7f298806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 --2- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29880ce280 0x7f298806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 -- 172.21.15.5:0/2345786052 >> v1:172.21.15.112:6789/0 conn(0x7f298806ed50 legacy=0x7f29880cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2986ffd700 1 -- 172.21.15.5:0/2345786052 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223959061 0 0) 0x7f298815bf30 con 0x7f298806ed50 2023-10-16T13:40:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 -- 172.21.15.5:0/2345786052 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298806d500 con 0x7f298815bb50 2023-10-16T13:40:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.277+0000 7f2987fff700 1 --2- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815bb50 0x7f298806e810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2978009840 tx=0x7f2978009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b30ec3d9d07fefe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f2986ffd700 1 -- 172.21.15.5:0/2345786052 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011830 con 0x7f298815bb50 2023-10-16T13:40:24.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f2986ffd700 1 -- 172.21.15.5:0/2345786052 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2978011990 con 0x7f298815bb50 2023-10-16T13:40:24.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f2986ffd700 1 -- 172.21.15.5:0/2345786052 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011d20 con 0x7f298815bb50 2023-10-16T13:40:24.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 -- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815bb50 msgr2=0x7f298806e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 --2- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815bb50 0x7f298806e810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2978009840 tx=0x7f2978009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:24.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 -- 172.21.15.5:0/2345786052 shutdown_connections 2023-10-16T13:40:24.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 --2- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815bb50 0x7f298806e810 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 --2- 172.21.15.5:0/2345786052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29880ce280 0x7f298806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 -- 172.21.15.5:0/2345786052 >> 172.21.15.5:0/2345786052 conn(0x7f29880cc6f0 msgr2=0x7f29880ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:24.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 -- 172.21.15.5:0/2345786052 shutdown_connections 2023-10-16T13:40:24.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.278+0000 7f298e372700 1 -- 172.21.15.5:0/2345786052 wait complete. 2023-10-16T13:40:24.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.279+0000 7f298e372700 1 Processor -- start 2023-10-16T13:40:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 -- start start 2023-10-16T13:40:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298806ed50 0x7f2988158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 0x7f29881f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815bb50 0x7f29880a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880a8e80 con 0x7f29880ce280 2023-10-16T13:40:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880a9160 con 0x7f298806ed50 2023-10-16T13:40:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f298e372700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29880a9440 con 0x7f298815bb50 2023-10-16T13:40:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.280+0000 7f29877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 0x7f29881f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 0x7f29881f1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45320/0 (socket says 172.21.15.5:45320) 2023-10-16T13:40:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 -- 172.21.15.5:0/3486653424 learned_addr learned my addr 172.21.15.5:0/3486653424 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f2987fff700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298806ed50 0x7f2988158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f298c90f700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815bb50 0x7f29880a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 -- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815bb50 msgr2=0x7f29880a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815bb50 0x7f29880a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 -- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298806ed50 msgr2=0x7f2988158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298806ed50 0x7f2988158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 -- 172.21.15.5:0/3486653424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780094a0 con 0x7f29880ce280 2023-10-16T13:40:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f29877fe700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 0x7f29881f1100 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c550 tx=0x7f297c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c004c80 con 0x7f29880ce280 2023-10-16T13:40:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c004e00 con 0x7f29880ce280 2023-10-16T13:40:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29880a9720 con 0x7f29880ce280 2023-10-16T13:40:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c007310 con 0x7f29880ce280 2023-10-16T13:40:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.281+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988158960 con 0x7f29880ce280 2023-10-16T13:40:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.282+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29880a9c40 con 0x7f29880ce280 2023-10-16T13:40:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.283+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f297c007470 con 0x7f29880ce280 2023-10-16T13:40:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.283+0000 7f2984ff9700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f297406af90 0x7f297406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.283+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f297c089100 con 0x7f29880ce280 2023-10-16T13:40:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.283+0000 7f2987fff700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f297406af90 0x7f297406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.284+0000 7f2987fff700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f297406af90 0x7f297406d450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29780090b0 tx=0x7f2978008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.288+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29880a9c40 con 0x7f29880ce280 2023-10-16T13:40:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.487+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29880a9c40 con 0x7f29880ce280 2023-10-16T13:40:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.487+0000 7f2984ff9700 1 -- 172.21.15.5:0/3486653424 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29880a9c40 con 0x7f29880ce280 2023-10-16T13:40:24.491 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:40:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f297406af90 msgr2=0x7f297406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f297406af90 0x7f297406d450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29780090b0 tx=0x7f2978008030 comp rx=0 tx=0).stop 2023-10-16T13:40:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 msgr2=0x7f29881f1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 0x7f29881f1100 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c550 tx=0x7f297c00c860 comp rx=0 tx=0).stop 2023-10-16T13:40:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 shutdown_connections 2023-10-16T13:40:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f297406af90 0x7f297406d450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815bb50 0x7f29880a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298806ed50 0x7f2988158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 --2- 172.21.15.5:0/3486653424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29880ce280 0x7f29881f1100 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 >> 172.21.15.5:0/3486653424 conn(0x7f29880cc6f0 msgr2=0x7f29880ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 shutdown_connections 2023-10-16T13:40:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.490+0000 7f298e372700 1 -- 172.21.15.5:0/3486653424 wait complete. 2023-10-16T13:40:24.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:40:24.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.631+0000 7fdba38d9700 1 Processor -- start 2023-10-16T13:40:24.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.631+0000 7fdba38d9700 1 -- start start 2023-10-16T13:40:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba38d9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdb9c15ab10 0x7fdb9c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba38d9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c15e7a0 con 0x7fdb9c0cfe30 2023-10-16T13:40:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba38d9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c15f730 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba38d9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c0b29a0 con 0x7fdb9c15ab10 2023-10-16T13:40:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba1e76700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdb9c0cfe30 0x7fdb9c0cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55332/0 (socket says 172.21.15.5:55332) 2023-10-16T13:40:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba1e76700 1 -- 172.21.15.5:0/1333566449 learned_addr learned my addr 172.21.15.5:0/1333566449 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdba1675700 1 --2- 172.21.15.5:0/1333566449 >> v2:172.21.15.112:3300/0 conn(0x7fdb9c15ab10 0x7fdb9c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917502539 0 0) 0x7fdb9c15e7a0 con 0x7fdb9c0cfe30 2023-10-16T13:40:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.632+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb880035b0 con 0x7fdb9c0cfe30 2023-10-16T13:40:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966864299 0 0) 0x7fdb9c15f730 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb9c15e7a0 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630569554 0 0) 0x7fdb880035b0 con 0x7fdb9c0cfe30 2023-10-16T13:40:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdba1675700 1 -- 172.21.15.5:0/1333566449 >> v1:172.21.15.112:6789/0 conn(0x7fdb9c0b1f50 legacy=0x7fdb9c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdba1675700 1 -- 172.21.15.5:0/1333566449 >> v1:172.21.15.5:6789/0 conn(0x7fdb9c0cfe30 legacy=0x7fdb9c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdba1675700 1 -- 172.21.15.5:0/1333566449 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0b2c80 con 0x7fdb9c15ab10 2023-10-16T13:40:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdba1675700 1 --2- 172.21.15.5:0/1333566449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c15ab10 0x7fdb9c15f1f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009840 tx=0x7fdb8c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c77aaaf770b362 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940019f0 con 0x7fdb9c15ab10 2023-10-16T13:40:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c004030 con 0x7fdb9c15ab10 2023-10-16T13:40:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.633+0000 7fdb93fff700 1 -- 172.21.15.5:0/1333566449 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0043c0 con 0x7fdb9c15ab10 2023-10-16T13:40:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 -- 172.21.15.5:0/1333566449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c15ab10 msgr2=0x7fdb9c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 --2- 172.21.15.5:0/1333566449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c15ab10 0x7fdb9c15f1f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009840 tx=0x7fdb8c009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 -- 172.21.15.5:0/1333566449 shutdown_connections 2023-10-16T13:40:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 --2- 172.21.15.5:0/1333566449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c15ab10 0x7fdb9c15f1f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 -- 172.21.15.5:0/1333566449 >> 172.21.15.5:0/1333566449 conn(0x7fdb9c06dae0 msgr2=0x7fdb9c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 -- 172.21.15.5:0/1333566449 shutdown_connections 2023-10-16T13:40:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.634+0000 7fdba38d9700 1 -- 172.21.15.5:0/1333566449 wait complete. 2023-10-16T13:40:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.635+0000 7fdba38d9700 1 Processor -- start 2023-10-16T13:40:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.635+0000 7fdba38d9700 1 -- start start 2023-10-16T13:40:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 0x7fdb9c0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0cfe30 0x7fdb9c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c15ab10 0x7fdb9c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c9f40 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c9680 con 0x7fdb9c0cfe30 2023-10-16T13:40:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c98f0 con 0x7fdb9c15ab10 2023-10-16T13:40:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 0x7fdb9c0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 0x7fdb9c0c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45330/0 (socket says 172.21.15.5:45330) 2023-10-16T13:40:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 -- 172.21.15.5:0/3884965699 learned_addr learned my addr 172.21.15.5:0/3884965699 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba0e74700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0cfe30 0x7fdb9c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1e76700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c15ab10 0x7fdb9c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 -- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c15ab10 msgr2=0x7fdb9c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c15ab10 0x7fdb9c155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 -- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0cfe30 msgr2=0x7fdb9c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0cfe30 0x7fdb9c154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 -- 172.21.15.5:0/3884965699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0094a0 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba1675700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 0x7fdb9c0c7a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c06d4f0 tx=0x7fdb8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c004570 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c01f070 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.636+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0c9bd0 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.637+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c011870 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.637+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c0c7f80 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.638+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c067d20 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.638+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fdb8c0119d0 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.638+0000 7fdb91ffb700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdb8006afc0 0x7fdb8006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.638+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb8c021070 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.639+0000 7fdba0e74700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdb8006afc0 0x7fdb8006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.639+0000 7fdba0e74700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdb8006afc0 0x7fdb8006d480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c155b10 tx=0x7fdb98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.643+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb8c056150 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.845+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb9c0afc10 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.845+0000 7fdb91ffb700 1 -- 172.21.15.5:0/3884965699 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb8c059770 con 0x7fdb9c0b1f50 2023-10-16T13:40:24.848 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:40:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdb8006afc0 msgr2=0x7fdb8006d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdb8006afc0 0x7fdb8006d480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c155b10 tx=0x7fdb98009040 comp rx=0 tx=0).stop 2023-10-16T13:40:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 msgr2=0x7fdb9c0c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 0x7fdb9c0c7a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c06d4f0 tx=0x7fdb8c004750 comp rx=0 tx=0).stop 2023-10-16T13:40:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 shutdown_connections 2023-10-16T13:40:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdb8006afc0 0x7fdb8006d480 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c15ab10 0x7fdb9c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0b1f50 0x7fdb9c0c7a40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 --2- 172.21.15.5:0/3884965699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0cfe30 0x7fdb9c154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 >> 172.21.15.5:0/3884965699 conn(0x7fdb9c06dae0 msgr2=0x7fdb9c0cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 shutdown_connections 2023-10-16T13:40:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.847+0000 7fdba38d9700 1 -- 172.21.15.5:0/3884965699 wait complete. 2023-10-16T13:40:24.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:40:24.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.988+0000 7fcec0cb1700 1 Processor -- start 2023-10-16T13:40:24.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.988+0000 7fcec0cb1700 1 -- start start 2023-10-16T13:40:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fcec0cb1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fcec0cb1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcebc0cede0 0x7fcebc15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fcec0cb1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0cf260 con 0x7fcebc06a840 2023-10-16T13:40:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fcec0cb1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc1619a0 con 0x7fcebc0cede0 2023-10-16T13:40:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fcec0cb1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0b2d60 con 0x7fcebc0cd950 2023-10-16T13:40:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcebc0cede0 0x7fcebc15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcebc0cede0 0x7fcebc15f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45338/0 (socket says 172.21.15.5:45338) 2023-10-16T13:40:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 -- 172.21.15.5:0/3242025808 learned_addr learned my addr 172.21.15.5:0/3242025808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceba59c700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 -- 172.21.15.5:0/3242025808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 msgr2=0x7fcebc15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 -- 172.21.15.5:0/3242025808 >> v1:172.21.15.112:6789/0 conn(0x7fcebc06a840 legacy=0x7fcebc161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 -- 172.21.15.5:0/3242025808 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0cdd30 con 0x7fcebc0cede0 2023-10-16T13:40:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceba59c700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb9d9b700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc0cede0 0x7fcebc15f570 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fceac006fd0 tx=0x7fceac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a24c18abde38ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.989+0000 7fceb959a700 1 -- 172.21.15.5:0/3242025808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac005e30 con 0x7fcebc0cede0 2023-10-16T13:40:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fceb959a700 1 -- 172.21.15.5:0/3242025808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac004030 con 0x7fcebc0cede0 2023-10-16T13:40:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fceb959a700 1 -- 172.21.15.5:0/3242025808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0043e0 con 0x7fcebc0cede0 2023-10-16T13:40:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 -- 172.21.15.5:0/3242025808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc0cede0 msgr2=0x7fcebc15f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc0cede0 0x7fcebc15f570 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fceac006fd0 tx=0x7fceac009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 -- 172.21.15.5:0/3242025808 shutdown_connections 2023-10-16T13:40:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/3242025808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc0cede0 0x7fcebc15f570 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 -- 172.21.15.5:0/3242025808 >> 172.21.15.5:0/3242025808 conn(0x7fcebc06dae0 msgr2=0x7fcebc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 -- 172.21.15.5:0/3242025808 shutdown_connections 2023-10-16T13:40:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.990+0000 7fcec0cb1700 1 -- 172.21.15.5:0/3242025808 wait complete. 2023-10-16T13:40:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.992+0000 7fcec0cb1700 1 Processor -- start 2023-10-16T13:40:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.992+0000 7fcec0cb1700 1 -- start start 2023-10-16T13:40:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcec0cb1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 0x7fcebc0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcec0cb1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcec0cb1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc0cede0 0x7fcebc0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcec0cb1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0b4610 con 0x7fcebc06a840 2023-10-16T13:40:25.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcec0cb1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0b4800 con 0x7fcebc0cede0 2023-10-16T13:40:25.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcec0cb1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0b4ae0 con 0x7fcebc0cd950 2023-10-16T13:40:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 0x7fcebc0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 0x7fcebc0c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45342/0 (socket says 172.21.15.5:45342) 2023-10-16T13:40:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 -- 172.21.15.5:0/324676051 learned_addr learned my addr 172.21.15.5:0/324676051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceb9d9b700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fcebad9d700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc0cede0 0x7fcebc0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 -- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 msgr2=0x7fcebc0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 -- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc0cede0 msgr2=0x7fcebc0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc0cede0 0x7fcebc0c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 -- 172.21.15.5:0/324676051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009500 con 0x7fcebc06a840 2023-10-16T13:40:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.993+0000 7fceba59c700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 0x7fcebc0c6f80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e810 tx=0x7fceb000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.994+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0004230 con 0x7fcebc06a840 2023-10-16T13:40:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.994+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0004390 con 0x7fcebc06a840 2023-10-16T13:40:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.994+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb00036a0 con 0x7fcebc06a840 2023-10-16T13:40:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.994+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0b4dc0 con 0x7fcebc06a840 2023-10-16T13:40:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.994+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc0b5380 con 0x7fcebc06a840 2023-10-16T13:40:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.995+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc0cc420 con 0x7fcebc06a840 2023-10-16T13:40:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.995+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fceb0003800 con 0x7fcebc06a840 2023-10-16T13:40:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.995+0000 7fceaaffd700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce9c06af90 0x7fce9c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.996+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceb0089110 con 0x7fcebc06a840 2023-10-16T13:40:25.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.996+0000 7fceb9d9b700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce9c06af90 0x7fce9c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:24.996+0000 7fceb9d9b700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce9c06af90 0x7fce9c06d450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fceac014040 tx=0x7fceac008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.000+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fceb0054150 con 0x7fcebc06a840 2023-10-16T13:40:25.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.198+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcebc067d20 con 0x7fcebc06a840 2023-10-16T13:40:25.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.198+0000 7fceaaffd700 1 -- 172.21.15.5:0/324676051 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fceb00094c0 con 0x7fcebc06a840 2023-10-16T13:40:25.201 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:40:25.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce9c06af90 msgr2=0x7fce9c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce9c06af90 0x7fce9c06d450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fceac014040 tx=0x7fceac008070 comp rx=0 tx=0).stop 2023-10-16T13:40:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 msgr2=0x7fcebc0c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 0x7fcebc0c6f80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e810 tx=0x7fceb000ebd0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 shutdown_connections 2023-10-16T13:40:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc0cede0 0x7fcebc0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcebc06a840 0x7fcebc0c6f80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce9c06af90 0x7fce9c06d450 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 --2- 172.21.15.5:0/324676051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcebc0cd950 0x7fcebc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 >> 172.21.15.5:0/324676051 conn(0x7fcebc06dae0 msgr2=0x7fcebc072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 shutdown_connections 2023-10-16T13:40:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.200+0000 7fcec0cb1700 1 -- 172.21.15.5:0/324676051 wait complete. 2023-10-16T13:40:25.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.337+0000 7f72d25bf700 1 Processor -- start 2023-10-16T13:40:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.337+0000 7f72d25bf700 1 -- start start 2023-10-16T13:40:25.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d25bf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72cc0b2880 0x7f72cc06c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d25bf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72cc0ce570 0x7f72cc15d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d25bf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0d0d00 con 0x7f72cc0b2c60 2023-10-16T13:40:25.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d25bf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0d2450 con 0x7f72cc0ce570 2023-10-16T13:40:25.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d25bf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0cfc60 con 0x7f72cc0b2880 2023-10-16T13:40:25.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72cc0ce570 0x7f72cc15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72cc0ce570 0x7f72cc15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45354/0 (socket says 172.21.15.5:45354) 2023-10-16T13:40:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 -- 172.21.15.5:0/1671269297 learned_addr learned my addr 172.21.15.5:0/1671269297 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 -- 172.21.15.5:0/1671269297 >> v2:172.21.15.112:3300/0 conn(0x7f72cc0b2880 msgr2=0x7f72cc06c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72cbfff700 1 --2- 172.21.15.5:0/1671269297 >> v2:172.21.15.112:3300/0 conn(0x7f72cc0b2880 0x7f72cc06c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 --2- 172.21.15.5:0/1671269297 >> v2:172.21.15.112:3300/0 conn(0x7f72cc0b2880 0x7f72cc06c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 -- 172.21.15.5:0/1671269297 >> v1:172.21.15.112:6789/0 conn(0x7f72cc0b2c60 legacy=0x7f72cc0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 -- 172.21.15.5:0/1671269297 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0cff40 con 0x7f72cc0ce570 2023-10-16T13:40:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72cbfff700 1 --2- 172.21.15.5:0/1671269297 >> v2:172.21.15.112:3300/0 conn(0x7f72cc0b2880 0x7f72cc06c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.338+0000 7f72d0b5c700 1 --2- 172.21.15.5:0/1671269297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0ce570 0x7f72cc15d250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06e380 tx=0x7f72c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249afcb3641d4d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72caffd700 1 -- 172.21.15.5:0/1671269297 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400e070 con 0x7f72cc0ce570 2023-10-16T13:40:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72caffd700 1 -- 172.21.15.5:0/1671269297 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4003a20 con 0x7f72cc0ce570 2023-10-16T13:40:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72caffd700 1 -- 172.21.15.5:0/1671269297 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003dd0 con 0x7f72cc0ce570 2023-10-16T13:40:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 -- 172.21.15.5:0/1671269297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0ce570 msgr2=0x7f72cc15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 --2- 172.21.15.5:0/1671269297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0ce570 0x7f72cc15d250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06e380 tx=0x7f72c400b330 comp rx=0 tx=0).stop 2023-10-16T13:40:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 -- 172.21.15.5:0/1671269297 shutdown_connections 2023-10-16T13:40:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 --2- 172.21.15.5:0/1671269297 >> v2:172.21.15.112:3300/0 conn(0x7f72cc0b2880 0x7f72cc06c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 --2- 172.21.15.5:0/1671269297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0ce570 0x7f72cc15d250 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 -- 172.21.15.5:0/1671269297 >> 172.21.15.5:0/1671269297 conn(0x7f72cc0d15e0 msgr2=0x7f72cc0d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 -- 172.21.15.5:0/1671269297 shutdown_connections 2023-10-16T13:40:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.339+0000 7f72d25bf700 1 -- 172.21.15.5:0/1671269297 wait complete. 2023-10-16T13:40:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.340+0000 7f72d25bf700 1 Processor -- start 2023-10-16T13:40:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 -- start start 2023-10-16T13:40:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72cc0b2880 0x7f72cc1d8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 0x7f72cc1e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc0ce570 0x7f72cc1e8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1d9de0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1d9540 con 0x7f72cc0ce570 2023-10-16T13:40:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.341+0000 7f72d25bf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1d9820 con 0x7f72cc0b2880 2023-10-16T13:40:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 0x7f72cc1e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 0x7f72cc1e7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45358/0 (socket says 172.21.15.5:45358) 2023-10-16T13:40:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 -- 172.21.15.5:0/14593824 learned_addr learned my addr 172.21.15.5:0/14593824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72d0b5c700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc0ce570 0x7f72cc1e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cbfff700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72cc0b2880 0x7f72cc1d8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 -- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72cc0b2880 msgr2=0x7f72cc1d8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72cc0b2880 0x7f72cc1d8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 -- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc0ce570 msgr2=0x7f72cc1e8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc0ce570 0x7f72cc1e8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 -- 172.21.15.5:0/14593824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4009b30 con 0x7f72cc0b2c60 2023-10-16T13:40:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72cb7fe700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 0x7f72cc1e7e00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c4d0 tx=0x7f72bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc011790 con 0x7f72cc0b2c60 2023-10-16T13:40:25.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0118f0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc1d9b00 con 0x7f72cc0b2c60 2023-10-16T13:40:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc011ca0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.342+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc1da220 con 0x7f72cc0b2c60 2023-10-16T13:40:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.343+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc1e57b0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.344+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f72bc01c460 con 0x7f72cc0b2c60 2023-10-16T13:40:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.344+0000 7f72c8ff9700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72ac06af90 0x7f72ac06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.344+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72bc089410 con 0x7f72cc0b2c60 2023-10-16T13:40:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.345+0000 7f72cbfff700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72ac06af90 0x7f72ac06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.345+0000 7f72cbfff700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72ac06af90 0x7f72ac06d450 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72b400aa50 tx=0x7f72b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.349+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72cc1e57b0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.594+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72cc1e57b0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.594+0000 7f72c8ff9700 1 -- 172.21.15.5:0/14593824 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f72cc1e57b0 con 0x7f72cc0b2c60 2023-10-16T13:40:25.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:25.597 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:03.062480+0000","modified":"2023-10-16T13:40:06.104790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1547849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1547849780},{"type":"v1","addr":"172.21.15.5:6835","nonce":1547849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-16T13:40:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72ac06af90 msgr2=0x7f72ac06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72ac06af90 0x7f72ac06d450 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72b400aa50 tx=0x7f72b4008040 comp rx=0 tx=0).stop 2023-10-16T13:40:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 msgr2=0x7f72cc1e7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 0x7f72cc1e7e00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c4d0 tx=0x7f72bc00c890 comp rx=0 tx=0).stop 2023-10-16T13:40:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 shutdown_connections 2023-10-16T13:40:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc0ce570 0x7f72cc1e8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72ac06af90 0x7f72ac06d450 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72cc0b2880 0x7f72cc1d8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 --2- 172.21.15.5:0/14593824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0b2c60 0x7f72cc1e7e00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 >> 172.21.15.5:0/14593824 conn(0x7f72cc0d15e0 msgr2=0x7f72cc1e4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 shutdown_connections 2023-10-16T13:40:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.596+0000 7f72d25bf700 1 -- 172.21.15.5:0/14593824 wait complete. 2023-10-16T13:40:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-10-16T13:40:25.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:25.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 Processor -- start 2023-10-16T13:40:25.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 -- start start 2023-10-16T13:40:25.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc9c15ab10 0x7fcc9c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc9c0b1f50 0x7fcc9c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c0b2400 0x7fcc9c0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c15e7a0 con 0x7fcc9c15ab10 2023-10-16T13:40:25.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c15f730 con 0x7fcc9c0b1f50 2023-10-16T13:40:25.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca2d5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b29a0 con 0x7fcc9c0b2400 2023-10-16T13:40:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.734+0000 7fcca0af7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc9c15ab10 0x7fcc9c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc9c15ab10 0x7fcc9c15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45364/0 (socket says 172.21.15.5:45364) 2023-10-16T13:40:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 -- 172.21.15.5:0/4143461539 learned_addr learned my addr 172.21.15.5:0/4143461539 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcc9bfff700 1 --2- 172.21.15.5:0/4143461539 >> v2:172.21.15.112:3300/0 conn(0x7fcc9c0b1f50 0x7fcc9c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca12f8700 1 --2- 172.21.15.5:0/4143461539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c0b2400 0x7fcc9c0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 -- 172.21.15.5:0/4143461539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c0b2400 msgr2=0x7fcc9c0cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 --2- 172.21.15.5:0/4143461539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c0b2400 0x7fcc9c0cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 -- 172.21.15.5:0/4143461539 >> v2:172.21.15.112:3300/0 conn(0x7fcc9c0b1f50 msgr2=0x7fcc9c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 --2- 172.21.15.5:0/4143461539 >> v2:172.21.15.112:3300/0 conn(0x7fcc9c0b1f50 0x7fcc9c0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 -- 172.21.15.5:0/4143461539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0b2c80 con 0x7fcc9c15ab10 2023-10-16T13:40:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcca0af7700 1 --2- 172.21.15.5:0/4143461539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c15ab10 0x7fcc9c15f1f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c06d470 tx=0x7fcc90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c14018f5ab06f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcc9b7fe700 1 -- 172.21.15.5:0/4143461539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000b870 con 0x7fcc9c15ab10 2023-10-16T13:40:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcc9b7fe700 1 -- 172.21.15.5:0/4143461539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9000b9d0 con 0x7fcc9c15ab10 2023-10-16T13:40:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.735+0000 7fcc9b7fe700 1 -- 172.21.15.5:0/4143461539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000bd60 con 0x7fcc9c15ab10 2023-10-16T13:40:25.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 -- 172.21.15.5:0/4143461539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c15ab10 msgr2=0x7fcc9c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/4143461539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c15ab10 0x7fcc9c15f1f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c06d470 tx=0x7fcc90009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 -- 172.21.15.5:0/4143461539 shutdown_connections 2023-10-16T13:40:25.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/4143461539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c0b2400 0x7fcc9c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/4143461539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c15ab10 0x7fcc9c15f1f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/4143461539 >> v2:172.21.15.112:3300/0 conn(0x7fcc9c0b1f50 0x7fcc9c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 -- 172.21.15.5:0/4143461539 >> 172.21.15.5:0/4143461539 conn(0x7fcc9c06dae0 msgr2=0x7fcc9c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 -- 172.21.15.5:0/4143461539 shutdown_connections 2023-10-16T13:40:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.736+0000 7fcca2d5b700 1 -- 172.21.15.5:0/4143461539 wait complete. 2023-10-16T13:40:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.737+0000 7fcca2d5b700 1 Processor -- start 2023-10-16T13:40:25.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.737+0000 7fcca2d5b700 1 -- start start 2023-10-16T13:40:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca2d5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc9c0b1f50 0x7fcc9c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca2d5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 0x7fcc9c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca2d5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c15ab10 0x7fcc9c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca2d5b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0c75a0 con 0x7fcc9c0b2400 2023-10-16T13:40:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca2d5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0c80b0 con 0x7fcc9c0b1f50 2023-10-16T13:40:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca2d5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0c6650 con 0x7fcc9c15ab10 2023-10-16T13:40:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 0x7fcc9c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 0x7fcc9c0c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45370/0 (socket says 172.21.15.5:45370) 2023-10-16T13:40:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 -- 172.21.15.5:0/2338906223 learned_addr learned my addr 172.21.15.5:0/2338906223 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca12f8700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c15ab10 0x7fcc9c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcca0af7700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc9c0b1f50 0x7fcc9c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 -- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c15ab10 msgr2=0x7fcc9c0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c15ab10 0x7fcc9c0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 -- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc9c0b1f50 msgr2=0x7fcc9c1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc9c0b1f50 0x7fcc9c1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 -- 172.21.15.5:0/2338906223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009550 con 0x7fcc9c0b2400 2023-10-16T13:40:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.738+0000 7fcc9bfff700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 0x7fcc9c0c6110 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800d7d0 tx=0x7fcc8800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.739+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc880125f0 con 0x7fcc9c0b2400 2023-10-16T13:40:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.739+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc88012750 con 0x7fcc9c0b2400 2023-10-16T13:40:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.739+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88012ae0 con 0x7fcc9c0b2400 2023-10-16T13:40:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.739+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c0c7780 con 0x7fcc9c0b2400 2023-10-16T13:40:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.739+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c0c7d40 con 0x7fcc9c0b2400 2023-10-16T13:40:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.740+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c067d20 con 0x7fcc9c0b2400 2023-10-16T13:40:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.740+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fcc88012c40 con 0x7fcc9c0b2400 2023-10-16T13:40:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.741+0000 7fcc997fa700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc8006af90 0x7fcc8006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.741+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc880898b0 con 0x7fcc9c0b2400 2023-10-16T13:40:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.741+0000 7fcca0af7700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc8006af90 0x7fcc8006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.741+0000 7fcca0af7700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc8006af90 0x7fcc8006d450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000c00 tx=0x7fcc90008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.745+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc88054970 con 0x7fcc9c0b2400 2023-10-16T13:40:25.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.947+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc9c0b5cf0 con 0x7fcc9c0b2400 2023-10-16T13:40:25.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.949+0000 7fcc997fa700 1 -- 172.21.15.5:0/2338906223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fcc88057f90 con 0x7fcc9c0b2400 2023-10-16T13:40:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:25.952 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:04.656921+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc8006af90 msgr2=0x7fcc8006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc8006af90 0x7fcc8006d450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000c00 tx=0x7fcc90008030 comp rx=0 tx=0).stop 2023-10-16T13:40:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 msgr2=0x7fcc9c0c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 0x7fcc9c0c6110 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800d7d0 tx=0x7fcc8800db90 comp rx=0 tx=0).stop 2023-10-16T13:40:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 shutdown_connections 2023-10-16T13:40:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc8006af90 0x7fcc8006d450 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9c15ab10 0x7fcc9c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc9c0b1f50 0x7fcc9c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 --2- 172.21.15.5:0/2338906223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9c0b2400 0x7fcc9c0c6110 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 >> 172.21.15.5:0/2338906223 conn(0x7fcc9c06dae0 msgr2=0x7fcc9c0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 shutdown_connections 2023-10-16T13:40:25.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:25.951+0000 7fcca2d5b700 1 -- 172.21.15.5:0/2338906223 wait complete. 2023-10-16T13:40:25.966 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:40:25.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.089+0000 7f4404e16700 1 Processor -- start 2023-10-16T13:40:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.089+0000 7f4404e16700 1 -- start start 2023-10-16T13:40:26.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f4404e16700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f440015ab10 0x7f440015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f4404e16700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44000b1f50 0x7f44000cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f4404e16700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440015e7a0 con 0x7f44000b2400 2023-10-16T13:40:26.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f4404e16700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440015f730 con 0x7f440015ab10 2023-10-16T13:40:26.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f4404e16700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44000b29a0 con 0x7f44000b1f50 2023-10-16T13:40:26.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f440015ab10 0x7f440015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f440015ab10 0x7f440015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45376/0 (socket says 172.21.15.5:45376) 2023-10-16T13:40:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 -- 172.21.15.5:0/2322696794 learned_addr learned my addr 172.21.15.5:0/2322696794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fdd9b700 1 --2- 172.21.15.5:0/2322696794 >> v2:172.21.15.112:3300/0 conn(0x7f44000b1f50 0x7f44000cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 -- 172.21.15.5:0/2322696794 >> v2:172.21.15.112:3300/0 conn(0x7f44000b1f50 msgr2=0x7f44000cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 --2- 172.21.15.5:0/2322696794 >> v2:172.21.15.112:3300/0 conn(0x7f44000b1f50 0x7f44000cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 -- 172.21.15.5:0/2322696794 >> v1:172.21.15.112:6789/0 conn(0x7f44000b2400 legacy=0x7f44000cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 -- 172.21.15.5:0/2322696794 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000b2c80 con 0x7f440015ab10 2023-10-16T13:40:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fdd9b700 1 --2- 172.21.15.5:0/2322696794 >> v2:172.21.15.112:3300/0 conn(0x7f44000b1f50 0x7f44000cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.090+0000 7f43fe59c700 1 --2- 172.21.15.5:0/2322696794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f440015f1f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f440006d470 tx=0x7f43f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4b6b130f984dd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f43fd59a700 1 -- 172.21.15.5:0/2322696794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000b870 con 0x7f440015ab10 2023-10-16T13:40:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f43fd59a700 1 -- 172.21.15.5:0/2322696794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000b9d0 con 0x7f440015ab10 2023-10-16T13:40:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f43fd59a700 1 -- 172.21.15.5:0/2322696794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000bd60 con 0x7f440015ab10 2023-10-16T13:40:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 -- 172.21.15.5:0/2322696794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 msgr2=0x7f440015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 --2- 172.21.15.5:0/2322696794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f440015f1f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f440006d470 tx=0x7f43f0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 -- 172.21.15.5:0/2322696794 shutdown_connections 2023-10-16T13:40:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 --2- 172.21.15.5:0/2322696794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f440015f1f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 --2- 172.21.15.5:0/2322696794 >> v2:172.21.15.112:3300/0 conn(0x7f44000b1f50 0x7f44000cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 -- 172.21.15.5:0/2322696794 >> 172.21.15.5:0/2322696794 conn(0x7f440006dae0 msgr2=0x7f440006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 -- 172.21.15.5:0/2322696794 shutdown_connections 2023-10-16T13:40:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.091+0000 7f4404e16700 1 -- 172.21.15.5:0/2322696794 wait complete. 2023-10-16T13:40:26.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 Processor -- start 2023-10-16T13:40:26.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 -- start start 2023-10-16T13:40:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44000b1f50 0x7f440014d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44000b2400 0x7f44000b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f44000b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44001f8030 con 0x7f440015ab10 2023-10-16T13:40:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.093+0000 7f4404e16700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44001f73b0 con 0x7f44000b2400 2023-10-16T13:40:26.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f4404e16700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44001f7690 con 0x7f44000b1f50 2023-10-16T13:40:26.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f44000b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f44000b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45386/0 (socket says 172.21.15.5:45386) 2023-10-16T13:40:26.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 -- 172.21.15.5:0/220124514 learned_addr learned my addr 172.21.15.5:0/220124514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:26.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fdd9b700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44000b2400 0x7f44000b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fe59c700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44000b1f50 0x7f440014d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 -- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44000b1f50 msgr2=0x7f440014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44000b1f50 0x7f440014d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 -- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44000b2400 msgr2=0x7f44000b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44000b2400 0x7f44000b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 -- 172.21.15.5:0/220124514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009550 con 0x7f440015ab10 2023-10-16T13:40:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fdd9b700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44000b2400 0x7f44000b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43fed9d700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f44000b0f50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f43f800cb50 tx=0x7f43f800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003c00 con 0x7f440015ab10 2023-10-16T13:40:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f8003d60 con 0x7f440015ab10 2023-10-16T13:40:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44001f7970 con 0x7f440015ab10 2023-10-16T13:40:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800ab70 con 0x7f440015ab10 2023-10-16T13:40:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.094+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440014dd80 con 0x7f440015ab10 2023-10-16T13:40:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.095+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440014df40 con 0x7f440015ab10 2023-10-16T13:40:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.096+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f43f800acd0 con 0x7f440015ab10 2023-10-16T13:40:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.096+0000 7f43eeffd700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f43e006af90 0x7f43e006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.096+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43f8089650 con 0x7f440015ab10 2023-10-16T13:40:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.096+0000 7f43fe59c700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f43e006af90 0x7f43e006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.097+0000 7f43fe59c700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f43e006af90 0x7f43e006d450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43f0000c00 tx=0x7f43f0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.101+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43f8054710 con 0x7f440015ab10 2023-10-16T13:40:26.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.346+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4400067d20 con 0x7f440015ab10 2023-10-16T13:40:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.346+0000 7f43eeffd700 1 -- 172.21.15.5:0/220124514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f43f8057d30 con 0x7f440015ab10 2023-10-16T13:40:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:26.350 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:03.062480+0000","modified":"2023-10-16T13:40:06.104790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1547849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1547849780},{"type":"v1","addr":"172.21.15.5:6835","nonce":1547849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-16T13:40:26.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.348+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f43e006af90 msgr2=0x7f43e006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.348+0000 7f4404e16700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f43e006af90 0x7f43e006d450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43f0000c00 tx=0x7f43f0008030 comp rx=0 tx=0).stop 2023-10-16T13:40:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.348+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 msgr2=0x7f44000b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.348+0000 7f4404e16700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f44000b0f50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f43f800cb50 tx=0x7f43f800cf10 comp rx=0 tx=0).stop 2023-10-16T13:40:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 shutdown_connections 2023-10-16T13:40:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440015ab10 0x7f44000b0f50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f43e006af90 0x7f43e006d450 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44000b1f50 0x7f440014d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 --2- 172.21.15.5:0/220124514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44000b2400 0x7f44000b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 >> 172.21.15.5:0/220124514 conn(0x7f440006dae0 msgr2=0x7f44000cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 shutdown_connections 2023-10-16T13:40:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.349+0000 7f4404e16700 1 -- 172.21.15.5:0/220124514 wait complete. 2023-10-16T13:40:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-10-16T13:40:26.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.486+0000 7f3abacfe700 1 Processor -- start 2023-10-16T13:40:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.486+0000 7f3abacfe700 1 -- start start 2023-10-16T13:40:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3abacfe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ab40b54f0 0x7f3ab415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3abacfe700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab40b5c70 con 0x7f3ab406e750 2023-10-16T13:40:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3abacfe700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab40b5990 con 0x7f3ab406eb30 2023-10-16T13:40:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3abacfe700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab415b2b0 con 0x7f3ab40b54f0 2023-10-16T13:40:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab929b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ab40b54f0 0x7f3ab415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab8a9a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ab406e750 0x7f3ab40ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55394/0 (socket says 172.21.15.5:55394) 2023-10-16T13:40:26.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab8a9a700 1 -- 172.21.15.5:0/1607330225 learned_addr learned my addr 172.21.15.5:0/1607330225 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:26.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab929b700 1 -- 172.21.15.5:0/1607330225 >> v1:172.21.15.112:6789/0 conn(0x7f3ab406eb30 legacy=0x7f3ab415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:26.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab929b700 1 -- 172.21.15.5:0/1607330225 >> v1:172.21.15.5:6789/0 conn(0x7f3ab406e750 legacy=0x7f3ab40ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab929b700 1 -- 172.21.15.5:0/1607330225 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab415b590 con 0x7f3ab40b54f0 2023-10-16T13:40:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab929b700 1 --2- 172.21.15.5:0/1607330225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab40b54f0 0x7f3ab415ee10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009dc0 tx=0x7f3aac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d09ba691f35a780 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab37fe700 1 -- 172.21.15.5:0/1607330225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00e070 con 0x7f3ab40b54f0 2023-10-16T13:40:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab37fe700 1 -- 172.21.15.5:0/1607330225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac00bb50 con 0x7f3ab40b54f0 2023-10-16T13:40:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.487+0000 7f3ab37fe700 1 -- 172.21.15.5:0/1607330225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac003a20 con 0x7f3ab40b54f0 2023-10-16T13:40:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 -- 172.21.15.5:0/1607330225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab40b54f0 msgr2=0x7f3ab415ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 --2- 172.21.15.5:0/1607330225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab40b54f0 0x7f3ab415ee10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009dc0 tx=0x7f3aac00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 -- 172.21.15.5:0/1607330225 shutdown_connections 2023-10-16T13:40:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 --2- 172.21.15.5:0/1607330225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab40b54f0 0x7f3ab415ee10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 -- 172.21.15.5:0/1607330225 >> 172.21.15.5:0/1607330225 conn(0x7f3ab40cc6f0 msgr2=0x7f3ab40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 -- 172.21.15.5:0/1607330225 shutdown_connections 2023-10-16T13:40:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.488+0000 7f3abacfe700 1 -- 172.21.15.5:0/1607330225 wait complete. 2023-10-16T13:40:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.489+0000 7f3abacfe700 1 Processor -- start 2023-10-16T13:40:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.489+0000 7f3abacfe700 1 -- start start 2023-10-16T13:40:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3abacfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 0x7f3ab41f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3abacfe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab406eb30 0x7f3ab41f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3abacfe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab40b54f0 0x7f3ab4158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3abacfe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab415a6e0 con 0x7f3ab406e750 2023-10-16T13:40:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3abacfe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab4159ad0 con 0x7f3ab406eb30 2023-10-16T13:40:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3abacfe700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab4159db0 con 0x7f3ab40b54f0 2023-10-16T13:40:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3ab8a9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 0x7f3ab41f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3ab8a9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 0x7f3ab41f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45396/0 (socket says 172.21.15.5:45396) 2023-10-16T13:40:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3ab8a9a700 1 -- 172.21.15.5:0/2053994542 learned_addr learned my addr 172.21.15.5:0/2053994542 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3ab3fff700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab406eb30 0x7f3ab41f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.490+0000 7f3ab929b700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab40b54f0 0x7f3ab4158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab8a9a700 1 -- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab40b54f0 msgr2=0x7f3ab4158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab8a9a700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab40b54f0 0x7f3ab4158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab8a9a700 1 -- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab406eb30 msgr2=0x7f3ab41f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab8a9a700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab406eb30 0x7f3ab41f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab8a9a700 1 -- 172.21.15.5:0/2053994542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009a70 con 0x7f3ab406e750 2023-10-16T13:40:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab3fff700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab406eb30 0x7f3ab41f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab8a9a700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 0x7f3ab41f27c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800c520 tx=0x7f3aa800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8005d70 con 0x7f3ab406e750 2023-10-16T13:40:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa80070d0 con 0x7f3ab406e750 2023-10-16T13:40:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab415a090 con 0x7f3ab406e750 2023-10-16T13:40:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8007440 con 0x7f3ab406e750 2023-10-16T13:40:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.491+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab4156a00 con 0x7f3ab406e750 2023-10-16T13:40:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.492+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab406b950 con 0x7f3ab406e750 2023-10-16T13:40:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.492+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f3aa80075a0 con 0x7f3ab406e750 2023-10-16T13:40:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.493+0000 7f3ab17fa700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a9806af90 0x7f3a9806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.493+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3aa80889f0 con 0x7f3ab406e750 2023-10-16T13:40:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.493+0000 7f3ab3fff700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a9806af90 0x7f3a9806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.493+0000 7f3ab3fff700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a9806af90 0x7f3a9806d450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4072840 tx=0x7f3aa0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.497+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3aa808ae60 con 0x7f3ab406e750 2023-10-16T13:40:26.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.748+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ab415eaf0 con 0x7f3ab406e750 2023-10-16T13:40:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.748+0000 7f3ab17fa700 1 -- 172.21.15.5:0/2053994542 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f3aa8017090 con 0x7f3ab406e750 2023-10-16T13:40:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:26.752 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:03.062480+0000","modified":"2023-10-16T13:40:06.104790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1547849780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1547849780},{"type":"v1","addr":"172.21.15.5:6835","nonce":1547849780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-16T13:40:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a9806af90 msgr2=0x7f3a9806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a9806af90 0x7f3a9806d450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4072840 tx=0x7f3aa0009040 comp rx=0 tx=0).stop 2023-10-16T13:40:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 msgr2=0x7f3ab41f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 0x7f3ab41f27c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800c520 tx=0x7f3aa800c8e0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 shutdown_connections 2023-10-16T13:40:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a9806af90 0x7f3a9806d450 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab40b54f0 0x7f3ab4158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab406e750 0x7f3ab41f27c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 --2- 172.21.15.5:0/2053994542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab406eb30 0x7f3ab41f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 >> 172.21.15.5:0/2053994542 conn(0x7f3ab40cc6f0 msgr2=0x7f3ab40ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 shutdown_connections 2023-10-16T13:40:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.751+0000 7f3abacfe700 1 -- 172.21.15.5:0/2053994542 wait complete. 2023-10-16T13:40:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-10-16T13:40:26.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:26.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.888+0000 7f9369333700 1 Processor -- start 2023-10-16T13:40:26.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.888+0000 7f9369333700 1 -- start start 2023-10-16T13:40:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f9369333700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93640b7050 0x7f936415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f9369333700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936415e4e0 con 0x7f936415dbc0 2023-10-16T13:40:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f9369333700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93640d28e0 con 0x7f93640d3fc0 2023-10-16T13:40:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f9369333700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640b7560 con 0x7f93640b7050 2023-10-16T13:40:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f93637fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93640b7050 0x7f936415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f9362ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f936415dbc0 0x7f93640d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55408/0 (socket says 172.21.15.5:55408) 2023-10-16T13:40:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f93637fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93640b7050 0x7f936415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45408/0 (socket says 172.21.15.5:45408) 2023-10-16T13:40:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.889+0000 7f9362ffd700 1 -- 172.21.15.5:0/2756225004 learned_addr learned my addr 172.21.15.5:0/2756225004 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f93637fe700 1 -- 172.21.15.5:0/2756225004 >> v1:172.21.15.112:6789/0 conn(0x7f93640d3fc0 legacy=0x7f93640d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f93637fe700 1 -- 172.21.15.5:0/2756225004 >> v1:172.21.15.5:6789/0 conn(0x7f936415dbc0 legacy=0x7f93640d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f93637fe700 1 -- 172.21.15.5:0/2756225004 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640b7840 con 0x7f93640b7050 2023-10-16T13:40:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f9361ffb700 1 -- 172.21.15.5:0/2756225004 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593728761 0 0) 0x7f936415e4e0 con 0x7f936415dbc0 2023-10-16T13:40:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f93637fe700 1 --2- 172.21.15.5:0/2756225004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640b7050 0x7f936415dfa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f935c009d90 tx=0x7f935c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a8cbb60b0cd6d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f9361ffb700 1 -- 172.21.15.5:0/2756225004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00e070 con 0x7f93640b7050 2023-10-16T13:40:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f9361ffb700 1 -- 172.21.15.5:0/2756225004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c00bb90 con 0x7f93640b7050 2023-10-16T13:40:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.890+0000 7f9361ffb700 1 -- 172.21.15.5:0/2756225004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c003a20 con 0x7f93640b7050 2023-10-16T13:40:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 -- 172.21.15.5:0/2756225004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640b7050 msgr2=0x7f936415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 --2- 172.21.15.5:0/2756225004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640b7050 0x7f936415dfa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f935c009d90 tx=0x7f935c00b330 comp rx=0 tx=0).stop 2023-10-16T13:40:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 -- 172.21.15.5:0/2756225004 shutdown_connections 2023-10-16T13:40:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 --2- 172.21.15.5:0/2756225004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640b7050 0x7f936415dfa0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 -- 172.21.15.5:0/2756225004 >> 172.21.15.5:0/2756225004 conn(0x7f936409cb40 msgr2=0x7f93640d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 -- 172.21.15.5:0/2756225004 shutdown_connections 2023-10-16T13:40:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.891+0000 7f9369333700 1 -- 172.21.15.5:0/2756225004 wait complete. 2023-10-16T13:40:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.892+0000 7f9369333700 1 Processor -- start 2023-10-16T13:40:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.892+0000 7f9369333700 1 -- start start 2023-10-16T13:40:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9369333700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93640b7050 0x7f93641e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9369333700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93640d3fc0 0x7f93640d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9369333700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 0x7f93640d0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9369333700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93641f38f0 con 0x7f936415dbc0 2023-10-16T13:40:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9369333700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936414a780 con 0x7f93640d3fc0 2023-10-16T13:40:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9369333700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93641f3610 con 0x7f93640b7050 2023-10-16T13:40:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 0x7f93640d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 0x7f93640d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45414/0 (socket says 172.21.15.5:45414) 2023-10-16T13:40:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 -- 172.21.15.5:0/214193439 learned_addr learned my addr 172.21.15.5:0/214193439 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93627fc700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93640d3fc0 0x7f93640d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f9362ffd700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93640b7050 0x7f93641e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 -- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93640b7050 msgr2=0x7f93641e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93640b7050 0x7f93641e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 -- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93640d3fc0 msgr2=0x7f93640d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93640d3fc0 0x7f93640d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 -- 172.21.15.5:0/214193439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c009a70 con 0x7f936415dbc0 2023-10-16T13:40:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.893+0000 7f93637fe700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 0x7f93640d0910 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f936406b4b0 tx=0x7f935c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.894+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c003a20 con 0x7f936415dbc0 2023-10-16T13:40:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.894+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c012670 con 0x7f936415dbc0 2023-10-16T13:40:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.894+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936414a980 con 0x7f936415dbc0 2023-10-16T13:40:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.894+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c004970 con 0x7f936415dbc0 2023-10-16T13:40:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.894+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936414af40 con 0x7f936415dbc0 2023-10-16T13:40:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.895+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936404ebb0 con 0x7f936415dbc0 2023-10-16T13:40:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.895+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f935c012a20 con 0x7f936415dbc0 2023-10-16T13:40:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.896+0000 7f934b7fe700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935006afc0 0x7f935006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.896+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f935c08bc20 con 0x7f936415dbc0 2023-10-16T13:40:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.896+0000 7f9362ffd700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935006afc0 0x7f935006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.897+0000 7f9362ffd700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935006afc0 0x7f935006d480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9358007fd0 tx=0x7f9358009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:26.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:26.901+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f935c05a6f0 con 0x7f936415dbc0 2023-10-16T13:40:27.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.104+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f936406a8b0 con 0x7f936415dbc0 2023-10-16T13:40:27.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.105+0000 7f934b7fe700 1 -- 172.21.15.5:0/214193439 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f935c05a280 con 0x7f936415dbc0 2023-10-16T13:40:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:27.109 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:04.656921+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:01.561842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:02.032316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935006afc0 msgr2=0x7f935006d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935006afc0 0x7f935006d480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9358007fd0 tx=0x7f9358009040 comp rx=0 tx=0).stop 2023-10-16T13:40:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 msgr2=0x7f93640d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 0x7f93640d0910 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f936406b4b0 tx=0x7f935c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 shutdown_connections 2023-10-16T13:40:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f936415dbc0 0x7f93640d0910 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935006afc0 0x7f935006d480 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93640b7050 0x7f93641e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 --2- 172.21.15.5:0/214193439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93640d3fc0 0x7f93640d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 >> 172.21.15.5:0/214193439 conn(0x7f936409cb40 msgr2=0x7f93640c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 shutdown_connections 2023-10-16T13:40:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.108+0000 7f9369333700 1 -- 172.21.15.5:0/214193439 wait complete. 2023-10-16T13:40:27.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:40:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.246+0000 7f905ccb8700 1 Processor -- start 2023-10-16T13:40:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.246+0000 7f905ccb8700 1 -- start start 2023-10-16T13:40:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905ccb8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90580cc3f0 0x7f90580cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905ccb8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905ccb8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9058071ab0 con 0x7f9058161670 2023-10-16T13:40:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905ccb8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9058161bc0 con 0x7f90580cc3f0 2023-10-16T13:40:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905ccb8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9058161ea0 con 0x7f905806af50 2023-10-16T13:40:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90580cc3f0 0x7f90580cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f9056d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f9056d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43326/0 (socket says 172.21.15.5:43326) 2023-10-16T13:40:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90580cc3f0 0x7f90580cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41314/0 (socket says 172.21.15.5:41314) 2023-10-16T13:40:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f9056d9d700 1 -- 172.21.15.5:0/706082744 learned_addr learned my addr 172.21.15.5:0/706082744 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f9055d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9058161670 0x7f905806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46398/0 (socket says 172.21.15.5:46398) 2023-10-16T13:40:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905659c700 1 -- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 msgr2=0x7f9058071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905659c700 1 --2- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905659c700 1 -- 172.21.15.5:0/706082744 >> v1:172.21.15.112:6789/0 conn(0x7f9058161670 legacy=0x7f905806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f905659c700 1 -- 172.21.15.5:0/706082744 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058162180 con 0x7f90580cc3f0 2023-10-16T13:40:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.247+0000 7f9056d9d700 1 --2- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905659c700 1 --2- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f90580cc7d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9048009840 tx=0x7f9048009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bb39668a7e1f5e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905559a700 1 -- 172.21.15.5:0/706082744 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048011830 con 0x7f90580cc3f0 2023-10-16T13:40:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905559a700 1 -- 172.21.15.5:0/706082744 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048011990 con 0x7f90580cc3f0 2023-10-16T13:40:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905559a700 1 -- 172.21.15.5:0/706082744 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048011d20 con 0x7f90580cc3f0 2023-10-16T13:40:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 -- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 msgr2=0x7f90580cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 --2- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f90580cc7d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9048009840 tx=0x7f9048009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 -- 172.21.15.5:0/706082744 shutdown_connections 2023-10-16T13:40:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 --2- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f90580cc7d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 --2- 172.21.15.5:0/706082744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 -- 172.21.15.5:0/706082744 >> 172.21.15.5:0/706082744 conn(0x7f905806dac0 msgr2=0x7f905806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.248+0000 7f905ccb8700 1 -- 172.21.15.5:0/706082744 shutdown_connections 2023-10-16T13:40:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.249+0000 7f905ccb8700 1 -- 172.21.15.5:0/706082744 wait complete. 2023-10-16T13:40:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.250+0000 7f905ccb8700 1 Processor -- start 2023-10-16T13:40:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.250+0000 7f905ccb8700 1 -- start start 2023-10-16T13:40:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f905815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 0x7f90580c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580c4600 con 0x7f9058161670 2023-10-16T13:40:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058155d40 con 0x7f90580cc3f0 2023-10-16T13:40:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90580c6c40 con 0x7f905806af50 2023-10-16T13:40:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9056d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 0x7f90580c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f905815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905659c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9056d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 0x7f90580c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45428/0 (socket says 172.21.15.5:45428) 2023-10-16T13:40:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9056d9d700 1 -- 172.21.15.5:0/2168222328 learned_addr learned my addr 172.21.15.5:0/2168222328 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 -- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 msgr2=0x7f9058155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 -- 172.21.15.5:0/2168222328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 msgr2=0x7f90580c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 0x7f90580c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 -- 172.21.15.5:0/2168222328 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9050009b30 con 0x7f90580cc3f0 2023-10-16T13:40:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9056d9d700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 0x7f90580c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9055d9b700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f905815d010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c3c0 tx=0x7f904c00c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c004a70 con 0x7f90580cc3f0 2023-10-16T13:40:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c004bd0 con 0x7f90580cc3f0 2023-10-16T13:40:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.251+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90480094a0 con 0x7f90580cc3f0 2023-10-16T13:40:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.252+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0070d0 con 0x7f90580cc3f0 2023-10-16T13:40:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.252+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90580b5890 con 0x7f90580cc3f0 2023-10-16T13:40:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.252+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058067d20 con 0x7f90580cc3f0 2023-10-16T13:40:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.253+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f904c007230 con 0x7f90580cc3f0 2023-10-16T13:40:27.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.253+0000 7f9046ffd700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f903806af90 0x7f903806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.254+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f904c088e00 con 0x7f90580cc3f0 2023-10-16T13:40:27.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.254+0000 7f905659c700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f903806af90 0x7f903806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.254+0000 7f905659c700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f903806af90 0x7f903806d450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9048000c00 tx=0x7f9048008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:27.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.259+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f904c053d40 con 0x7f90580cc3f0 2023-10-16T13:40:27.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:40:27.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:40:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.503+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f90580b6430 con 0x7f90580cc3f0 2023-10-16T13:40:27.507 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:40:27.504+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:40:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.509+0000 7f9046ffd700 1 -- 172.21.15.5:0/2168222328 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f904c057360 con 0x7f90580cc3f0 2023-10-16T13:40:27.513 INFO:tasks.ceph.mds.a.smithi005.stderr: -4550> 2023-10-16T13:40:09.635+0000 7f807df6a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:40:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f903806af90 msgr2=0x7f903806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f903806af90 0x7f903806d450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9048000c00 tx=0x7f9048008030 comp rx=0 tx=0).stop 2023-10-16T13:40:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 msgr2=0x7f905815d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f905815d010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c3c0 tx=0x7f904c00c6d0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 shutdown_connections 2023-10-16T13:40:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9058161670 0x7f90580c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f903806af90 0x7f903806d450 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f905806af50 0x7f9058155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 --2- 172.21.15.5:0/2168222328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90580cc3f0 0x7f905815d010 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.511+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 >> 172.21.15.5:0/2168222328 conn(0x7f905806dac0 msgr2=0x7f9058160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.512+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 shutdown_connections 2023-10-16T13:40:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.512+0000 7f905ccb8700 1 -- 172.21.15.5:0/2168222328 wait complete. 2023-10-16T13:40:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:40:27.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:40:27.543 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:40:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 Processor -- start 2023-10-16T13:40:27.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 -- start start 2023-10-16T13:40:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0180cf8a0 0x7fe0180d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0180d1bc0 0x7fe0180cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01815ee90 con 0x7fe01815eab0 2023-10-16T13:40:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe018158370 con 0x7fe0180cf8a0 2023-10-16T13:40:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.653+0000 7fe01e93a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180d23b0 con 0x7fe0180d1bc0 2023-10-16T13:40:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0180cf8a0 0x7fe0180d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0180cf8a0 0x7fe0180d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45446/0 (socket says 172.21.15.5:45446) 2023-10-16T13:40:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 -- 172.21.15.5:0/2017363746 learned_addr learned my addr 172.21.15.5:0/2017363746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe01ced7700 1 --2- 172.21.15.5:0/2017363746 >> v2:172.21.15.112:3300/0 conn(0x7fe0180d1bc0 0x7fe0180cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 -- 172.21.15.5:0/2017363746 >> v2:172.21.15.112:3300/0 conn(0x7fe0180d1bc0 msgr2=0x7fe0180cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 --2- 172.21.15.5:0/2017363746 >> v2:172.21.15.112:3300/0 conn(0x7fe0180d1bc0 0x7fe0180cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 -- 172.21.15.5:0/2017363746 >> v1:172.21.15.112:6789/0 conn(0x7fe01815eab0 legacy=0x7fe0180cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 -- 172.21.15.5:0/2017363746 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0180cda20 con 0x7fe0180cf8a0 2023-10-16T13:40:27.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe0177fe700 1 --2- 172.21.15.5:0/2017363746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180cf8a0 0x7fe0180d1680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe0180ccfd0 tx=0x7fe00c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd631c98768a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:27.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe016ffd700 1 -- 172.21.15.5:0/2017363746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c004230 con 0x7fe0180cf8a0 2023-10-16T13:40:27.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe016ffd700 1 -- 172.21.15.5:0/2017363746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c004390 con 0x7fe0180cf8a0 2023-10-16T13:40:27.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.654+0000 7fe016ffd700 1 -- 172.21.15.5:0/2017363746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0036a0 con 0x7fe0180cf8a0 2023-10-16T13:40:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 -- 172.21.15.5:0/2017363746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180cf8a0 msgr2=0x7fe0180d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2017363746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180cf8a0 0x7fe0180d1680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe0180ccfd0 tx=0x7fe00c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 -- 172.21.15.5:0/2017363746 shutdown_connections 2023-10-16T13:40:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2017363746 >> v2:172.21.15.112:3300/0 conn(0x7fe0180d1bc0 0x7fe0180cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2017363746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180cf8a0 0x7fe0180d1680 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 -- 172.21.15.5:0/2017363746 >> 172.21.15.5:0/2017363746 conn(0x7fe0180665a0 msgr2=0x7fe018066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 -- 172.21.15.5:0/2017363746 shutdown_connections 2023-10-16T13:40:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.655+0000 7fe01e93a700 1 -- 172.21.15.5:0/2017363746 wait complete. 2023-10-16T13:40:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.656+0000 7fe01e93a700 1 Processor -- start 2023-10-16T13:40:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.656+0000 7fe01e93a700 1 -- start start 2023-10-16T13:40:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01e93a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0180cf8a0 0x7fe018152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01e93a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 0x7fe0180b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01e93a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe01815eab0 0x7fe0181f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01e93a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180c8700 con 0x7fe0180d1bc0 2023-10-16T13:40:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01e93a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01814dce0 con 0x7fe0180cf8a0 2023-10-16T13:40:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01e93a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180b4a10 con 0x7fe01815eab0 2023-10-16T13:40:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 0x7fe0180b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 0x7fe0180b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45452/0 (socket says 172.21.15.5:45452) 2023-10-16T13:40:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 -- 172.21.15.5:0/2043213523 learned_addr learned my addr 172.21.15.5:0/2043213523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe01ced7700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe01815eab0 0x7fe0181f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe017fff700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0180cf8a0 0x7fe018152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 -- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe01815eab0 msgr2=0x7fe0181f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe01815eab0 0x7fe0181f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 -- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0180cf8a0 msgr2=0x7fe018152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.657+0000 7fe0177fe700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0180cf8a0 0x7fe018152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe0177fe700 1 -- 172.21.15.5:0/2043213523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c009550 con 0x7fe0180d1bc0 2023-10-16T13:40:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe0177fe700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 0x7fe0180b44d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009130 tx=0x7fe00c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011630 con 0x7fe0180d1bc0 2023-10-16T13:40:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c011790 con 0x7fe0180d1bc0 2023-10-16T13:40:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0181526d0 con 0x7fe0180d1bc0 2023-10-16T13:40:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011b40 con 0x7fe0180d1bc0 2023-10-16T13:40:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.658+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe018152c90 con 0x7fe0180d1bc0 2023-10-16T13:40:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.659+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0180c8840 con 0x7fe0180d1bc0 2023-10-16T13:40:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.659+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fe00c011ca0 con 0x7fe0180d1bc0 2023-10-16T13:40:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.660+0000 7fe014ff9700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe00406af90 0x7fe00406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.660+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe00c08ac30 con 0x7fe0180d1bc0 2023-10-16T13:40:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.660+0000 7fe017fff700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe00406af90 0x7fe00406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.661+0000 7fe017fff700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe00406af90 0x7fe00406d450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe008001790 tx=0x7fe008009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.665+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0180c8840 con 0x7fe0180d1bc0 2023-10-16T13:40:27.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:27.915+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe0180c8840 con 0x7fe0180d1bc0 2023-10-16T13:40:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.507+0000 7fe014ff9700 1 -- 172.21.15.5:0/2043213523 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe0180c8840 con 0x7fe0180d1bc0 2023-10-16T13:40:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe00406af90 msgr2=0x7fe00406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe00406af90 0x7fe00406d450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe008001790 tx=0x7fe008009040 comp rx=0 tx=0).stop 2023-10-16T13:40:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 msgr2=0x7fe0180b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 0x7fe0180b44d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009130 tx=0x7fe00c004750 comp rx=0 tx=0).stop 2023-10-16T13:40:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 shutdown_connections 2023-10-16T13:40:28.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe00406af90 0x7fe00406d450 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe01815eab0 0x7fe0181f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0180cf8a0 0x7fe018152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 --2- 172.21.15.5:0/2043213523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0180d1bc0 0x7fe0180b44d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 >> 172.21.15.5:0/2043213523 conn(0x7fe0180665a0 msgr2=0x7fe0180b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:28.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 shutdown_connections 2023-10-16T13:40:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.511+0000 7fe01e93a700 1 -- 172.21.15.5:0/2043213523 wait complete. 2023-10-16T13:40:28.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:40:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.662+0000 7f8ce617a700 1 Processor -- start 2023-10-16T13:40:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.662+0000 7f8ce617a700 1 -- start start 2023-10-16T13:40:28.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8ce617a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce015d840 0x7f8ce0162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:28.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8ce617a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce00cdfd0 0x7f8ce00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:28.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8ce617a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00cee20 con 0x7f8ce00cd330 2023-10-16T13:40:28.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8ce617a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce00b2ce0 con 0x7f8ce00cdfd0 2023-10-16T13:40:28.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8ce617a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00ceb40 con 0x7f8ce015d840 2023-10-16T13:40:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8cdeffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce00cdfd0 0x7f8ce00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8cdffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ce00cd330 0x7f8ce00caa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55468/0 (socket says 172.21.15.5:55468) 2023-10-16T13:40:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8cdeffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce00cdfd0 0x7f8ce00ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45462/0 (socket says 172.21.15.5:45462) 2023-10-16T13:40:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.663+0000 7f8cdffff700 1 -- 172.21.15.5:0/1397892167 learned_addr learned my addr 172.21.15.5:0/1397892167 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cdf7fe700 1 --2- 172.21.15.5:0/1397892167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce015d840 0x7f8ce0162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cdeffd700 1 -- 172.21.15.5:0/1397892167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce015d840 msgr2=0x7f8ce0162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cdeffd700 1 --2- 172.21.15.5:0/1397892167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce015d840 0x7f8ce0162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cdeffd700 1 -- 172.21.15.5:0/1397892167 >> v1:172.21.15.5:6789/0 conn(0x7f8ce00cd330 legacy=0x7f8ce00caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cde7fc700 1 -- 172.21.15.5:0/1397892167 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978088389 0 0) 0x7f8ce00cee20 con 0x7f8ce00cd330 2023-10-16T13:40:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cdeffd700 1 -- 172.21.15.5:0/1397892167 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0161590 con 0x7f8ce00cdfd0 2023-10-16T13:40:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cdeffd700 1 --2- 172.21.15.5:0/1397892167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cdfd0 0x7f8ce00ce450 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009840 tx=0x7f8cc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198cd56473e87869 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cde7fc700 1 -- 172.21.15.5:0/1397892167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011830 con 0x7f8ce00cdfd0 2023-10-16T13:40:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cde7fc700 1 -- 172.21.15.5:0/1397892167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8011990 con 0x7f8ce00cdfd0 2023-10-16T13:40:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.664+0000 7f8cde7fc700 1 -- 172.21.15.5:0/1397892167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011d20 con 0x7f8ce00cdfd0 2023-10-16T13:40:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 -- 172.21.15.5:0/1397892167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cdfd0 msgr2=0x7f8ce00ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1397892167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cdfd0 0x7f8ce00ce450 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009840 tx=0x7f8cc8009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 -- 172.21.15.5:0/1397892167 shutdown_connections 2023-10-16T13:40:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1397892167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce015d840 0x7f8ce0162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1397892167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cdfd0 0x7f8ce00ce450 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 -- 172.21.15.5:0/1397892167 >> 172.21.15.5:0/1397892167 conn(0x7f8ce006bd70 msgr2=0x7f8ce006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 -- 172.21.15.5:0/1397892167 shutdown_connections 2023-10-16T13:40:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.665+0000 7f8ce617a700 1 -- 172.21.15.5:0/1397892167 wait complete. 2023-10-16T13:40:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.666+0000 7f8ce617a700 1 Processor -- start 2023-10-16T13:40:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.666+0000 7f8ce617a700 1 -- start start 2023-10-16T13:40:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8ce617a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 0x7f8ce0153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8ce617a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce00cdfd0 0x7f8ce00caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8ce617a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ce015d840 0x7f8ce00caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8ce617a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0160640 con 0x7f8ce00cd330 2023-10-16T13:40:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8ce617a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0160920 con 0x7f8ce015d840 2023-10-16T13:40:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8ce617a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0160c00 con 0x7f8ce00cdfd0 2023-10-16T13:40:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 0x7f8ce0153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 0x7f8ce0153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45466/0 (socket says 172.21.15.5:45466) 2023-10-16T13:40:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 -- 172.21.15.5:0/1752555564 learned_addr learned my addr 172.21.15.5:0/1752555564 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdeffd700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce00cdfd0 0x7f8ce00caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdffff700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ce015d840 0x7f8ce00caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 -- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce00cdfd0 msgr2=0x7f8ce00caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce00cdfd0 0x7f8ce00caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 -- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ce015d840 msgr2=0x7f8ce00caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ce015d840 0x7f8ce00caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdf7fe700 1 -- 172.21.15.5:0/1752555564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80094a0 con 0x7f8ce00cd330 2023-10-16T13:40:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.667+0000 7f8cdffff700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ce015d840 0x7f8ce00caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.668+0000 7f8cdf7fe700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 0x7f8ce0153f40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000d800 tx=0x7f8cd000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.668+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00125f0 con 0x7f8ce00cd330 2023-10-16T13:40:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.668+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0012750 con 0x7f8ce00cd330 2023-10-16T13:40:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.668+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0160ee0 con 0x7f8ce00cd330 2023-10-16T13:40:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.668+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0012b00 con 0x7f8ce00cd330 2023-10-16T13:40:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.668+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce0154480 con 0x7f8ce00cd330 2023-10-16T13:40:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.669+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0067d20 con 0x7f8ce00cd330 2023-10-16T13:40:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.669+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f8cd0012c60 con 0x7f8ce00cd330 2023-10-16T13:40:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.670+0000 7f8cd7fff700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cc006af90 0x7f8cc006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.670+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8cd0089ad0 con 0x7f8ce00cd330 2023-10-16T13:40:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.670+0000 7f8cdeffd700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cc006af90 0x7f8cc006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.670+0000 7f8cdeffd700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cc006af90 0x7f8cc006d450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ce015ce20 tx=0x7f8cc8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.674+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cd0054a30 con 0x7f8ce00cd330 2023-10-16T13:40:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:28.875+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ce00ce490 con 0x7f8ce00cd330 2023-10-16T13:40:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.764+0000 7f8cd7fff700 1 -- 172.21.15.5:0/1752555564 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8cd0058050 con 0x7f8ce00cd330 2023-10-16T13:40:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cc006af90 msgr2=0x7f8cc006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cc006af90 0x7f8cc006d450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ce015ce20 tx=0x7f8cc8008030 comp rx=0 tx=0).stop 2023-10-16T13:40:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 msgr2=0x7f8ce0153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 0x7f8ce0153f40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000d800 tx=0x7f8cd000dbc0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 shutdown_connections 2023-10-16T13:40:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ce015d840 0x7f8ce00caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce00cd330 0x7f8ce0153f40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cc006af90 0x7f8cc006d450 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 --2- 172.21.15.5:0/1752555564 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ce00cdfd0 0x7f8ce00caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 >> 172.21.15.5:0/1752555564 conn(0x7f8ce006bd70 msgr2=0x7f8ce006c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 shutdown_connections 2023-10-16T13:40:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.767+0000 7f8ce617a700 1 -- 172.21.15.5:0/1752555564 wait complete. 2023-10-16T13:40:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:40:29.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:40:29.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.919+0000 7fcde932a700 1 Processor -- start 2023-10-16T13:40:29.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.919+0000 7fcde932a700 1 -- start start 2023-10-16T13:40:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde932a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcde40d0890 0x7fcde40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde932a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde40b7300 con 0x7fcde415daf0 2023-10-16T13:40:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde932a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde40b66f0 con 0x7fcde40d15c0 2023-10-16T13:40:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde932a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40b69d0 con 0x7fcde40d0890 2023-10-16T13:40:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde2ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcde415daf0 0x7fcde40d4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55476/0 (socket says 172.21.15.5:55476) 2023-10-16T13:40:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde2ffd700 1 -- 172.21.15.5:0/1775581143 learned_addr learned my addr 172.21.15.5:0/1775581143 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde37fe700 1 --2- 172.21.15.5:0/1775581143 >> v2:172.21.15.112:3300/0 conn(0x7fcde40d0890 0x7fcde40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569751688 0 0) 0x7fcde40b7300 con 0x7fcde415daf0 2023-10-16T13:40:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.920+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdcc0035b0 con 0x7fcde415daf0 2023-10-16T13:40:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3112095506 0 0) 0x7fcdcc0035b0 con 0x7fcde415daf0 2023-10-16T13:40:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 >> v2:172.21.15.112:3300/0 conn(0x7fcde40d0890 msgr2=0x7fcde40b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 --2- 172.21.15.5:0/1775581143 >> v2:172.21.15.112:3300/0 conn(0x7fcde40d0890 0x7fcde40b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 >> v1:172.21.15.112:6789/0 conn(0x7fcde40d15c0 legacy=0x7fcde40d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40b6cb0 con 0x7fcde415daf0 2023-10-16T13:40:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fcdd80017f0 con 0x7fcde415daf0 2023-10-16T13:40:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 >> v1:172.21.15.5:6789/0 conn(0x7fcde415daf0 legacy=0x7fcde40d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc003a00 0x7fcdcc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcdcc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc005210 0x7fcdcc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40b69d0 con 0x7fcdcc004850 2023-10-16T13:40:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc00c0b0 con 0x7fcdcc003a00 2023-10-16T13:40:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc00c270 con 0x7fcdcc005210 2023-10-16T13:40:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcdcc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde2ffd700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc003a00 0x7fcdcc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde37fe700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc005210 0x7fcdcc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 -- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc005210 msgr2=0x7fcdcc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc005210 0x7fcdcc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 -- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc003a00 msgr2=0x7fcdcc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc003a00 0x7fcdcc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 -- 172.21.15.5:0/1775581143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0035b0 con 0x7fcdcc004850 2023-10-16T13:40:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde37fe700 1 -- 172.21.15.5:0/1775581143 reap_dead start 2023-10-16T13:40:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.921+0000 7fcde27fc700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcdcc004cd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcde40d1a00 tx=0x7fcdcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665554fbbf28f469 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40052d0 con 0x7fcdcc004850 2023-10-16T13:40:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4005430 con 0x7fcdcc004850 2023-10-16T13:40:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde1ffb700 1 -- 172.21.15.5:0/1775581143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40038c0 con 0x7fcdcc004850 2023-10-16T13:40:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 -- 172.21.15.5:0/1775581143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 msgr2=0x7fcdcc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcdcc004cd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcde40d1a00 tx=0x7fcdcc005880 comp rx=0 tx=0).stop 2023-10-16T13:40:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 -- 172.21.15.5:0/1775581143 shutdown_connections 2023-10-16T13:40:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 --2- 172.21.15.5:0/1775581143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcdcc004cd0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 -- 172.21.15.5:0/1775581143 >> 172.21.15.5:0/1775581143 conn(0x7fcde409ca80 msgr2=0x7fcde40d3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 -- 172.21.15.5:0/1775581143 shutdown_connections 2023-10-16T13:40:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.922+0000 7fcde932a700 1 -- 172.21.15.5:0/1775581143 wait complete. 2023-10-16T13:40:29.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 Processor -- start 2023-10-16T13:40:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 -- start start 2023-10-16T13:40:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcde409e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde415b610 0x7fcde409de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4160220 0x7fcde41606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40ca6e0 con 0x7fcdcc004850 2023-10-16T13:40:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde4160be0 con 0x7fcde4160220 2023-10-16T13:40:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde932a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde409fa50 con 0x7fcde415b610 2023-10-16T13:40:29.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.924+0000 7fcde2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcde409e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcde409e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45482/0 (socket says 172.21.15.5:45482) 2023-10-16T13:40:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 -- 172.21.15.5:0/2279480573 learned_addr learned my addr 172.21.15.5:0/2279480573 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde37fe700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4160220 0x7fcde41606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde27fc700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde415b610 0x7fcde409de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 -- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde415b610 msgr2=0x7fcde409de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde415b610 0x7fcde409de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 -- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4160220 msgr2=0x7fcde41606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4160220 0x7fcde41606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 -- 172.21.15.5:0/2279480573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde409e3b0 con 0x7fcdcc004850 2023-10-16T13:40:29.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde37fe700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4160220 0x7fcde41606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde27fc700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde415b610 0x7fcde409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde2ffd700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcde409e7f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007fd0 tx=0x7fcdd800fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80072e0 con 0x7fcdcc004850 2023-10-16T13:40:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd8007440 con 0x7fcdcc004850 2023-10-16T13:40:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde409ee40 con 0x7fcdcc004850 2023-10-16T13:40:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8005830 con 0x7fcdcc004850 2023-10-16T13:40:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.925+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde409f400 con 0x7fcdcc004850 2023-10-16T13:40:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.926+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde40d0100 con 0x7fcdcc004850 2023-10-16T13:40:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.927+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fcdd8005990 con 0x7fcdcc004850 2023-10-16T13:40:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.927+0000 7fcdcb7fe700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd006af90 0x7fcdd006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.927+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fcdd80894d0 con 0x7fcdcc004850 2023-10-16T13:40:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.927+0000 7fcde27fc700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd006af90 0x7fcdd006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.928+0000 7fcde27fc700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd006af90 0x7fcdd006d450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcde4160eb0 tx=0x7fcdd4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:29.932+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdd80546f0 con 0x7fcdcc004850 2023-10-16T13:40:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.139+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcde404ebb0 con 0x7fcdcc004850 2023-10-16T13:40:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.766+0000 7fcdcb7fe700 1 -- 172.21.15.5:0/2279480573 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcdd8057d10 con 0x7fcdcc004850 2023-10-16T13:40:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd006af90 msgr2=0x7fcdd006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd006af90 0x7fcdd006d450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcde4160eb0 tx=0x7fcdd4009030 comp rx=0 tx=0).stop 2023-10-16T13:40:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 msgr2=0x7fcde409e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcde409e7f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007fd0 tx=0x7fcdd800fe50 comp rx=0 tx=0).stop 2023-10-16T13:40:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 shutdown_connections 2023-10-16T13:40:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4160220 0x7fcde41606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdcc004850 0x7fcde409e7f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd006af90 0x7fcdd006d450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 --2- 172.21.15.5:0/2279480573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde415b610 0x7fcde409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 >> 172.21.15.5:0/2279480573 conn(0x7fcde409ca80 msgr2=0x7fcde40d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 shutdown_connections 2023-10-16T13:40:30.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.769+0000 7fcde932a700 1 -- 172.21.15.5:0/2279480573 wait complete. 2023-10-16T13:40:30.774 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:40:30.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:40:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.918+0000 7fae11911700 1 Processor -- start 2023-10-16T13:40:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.918+0000 7fae11911700 1 -- start start 2023-10-16T13:40:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.919+0000 7fae11911700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae0c0cf8a0 0x7fae0c0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.919+0000 7fae11911700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 0x7fae0c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.919+0000 7fae11911700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c15ee90 con 0x7fae0c15eab0 2023-10-16T13:40:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.919+0000 7fae11911700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c158370 con 0x7fae0c0cf8a0 2023-10-16T13:40:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.919+0000 7fae11911700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0d23b0 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 0x7fae0c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 0x7fae0c0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43398/0 (socket says 172.21.15.5:43398) 2023-10-16T13:40:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 -- 172.21.15.5:0/2941244100 learned_addr learned my addr 172.21.15.5:0/2941244100 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0a7fc700 1 --2- 172.21.15.5:0/2941244100 >> v2:172.21.15.112:3300/0 conn(0x7fae0c0cf8a0 0x7fae0c0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 -- 172.21.15.5:0/2941244100 >> v2:172.21.15.112:3300/0 conn(0x7fae0c0cf8a0 msgr2=0x7fae0c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 --2- 172.21.15.5:0/2941244100 >> v2:172.21.15.112:3300/0 conn(0x7fae0c0cf8a0 0x7fae0c0d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 -- 172.21.15.5:0/2941244100 >> v1:172.21.15.112:6789/0 conn(0x7fae0c15eab0 legacy=0x7fae0c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 -- 172.21.15.5:0/2941244100 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0cda20 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae0b7fe700 1 --2- 172.21.15.5:0/2941244100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 0x7fae0c0cbc10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae0c15f020 tx=0x7fae0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=897cc0e314c64330 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae09ffb700 1 -- 172.21.15.5:0/2941244100 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400e070 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae09ffb700 1 -- 172.21.15.5:0/2941244100 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04003a20 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.920+0000 7fae09ffb700 1 -- 172.21.15.5:0/2941244100 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04003dd0 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 -- 172.21.15.5:0/2941244100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 msgr2=0x7fae0c0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 --2- 172.21.15.5:0/2941244100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 0x7fae0c0cbc10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae0c15f020 tx=0x7fae0400b330 comp rx=0 tx=0).stop 2023-10-16T13:40:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 -- 172.21.15.5:0/2941244100 shutdown_connections 2023-10-16T13:40:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 --2- 172.21.15.5:0/2941244100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c0d1bc0 0x7fae0c0cbc10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 --2- 172.21.15.5:0/2941244100 >> v2:172.21.15.112:3300/0 conn(0x7fae0c0cf8a0 0x7fae0c0d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 -- 172.21.15.5:0/2941244100 >> 172.21.15.5:0/2941244100 conn(0x7fae0c0665a0 msgr2=0x7fae0c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 -- 172.21.15.5:0/2941244100 shutdown_connections 2023-10-16T13:40:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.921+0000 7fae11911700 1 -- 172.21.15.5:0/2941244100 wait complete. 2023-10-16T13:40:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.922+0000 7fae11911700 1 Processor -- start 2023-10-16T13:40:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.922+0000 7fae11911700 1 -- start start 2023-10-16T13:40:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae11911700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c0cf8a0 0x7fae0c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae11911700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 0x7fae0c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae11911700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15eab0 0x7fae0c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae11911700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c160160 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae11911700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c15f550 con 0x7fae0c0cf8a0 2023-10-16T13:40:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae11911700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c15f830 con 0x7fae0c15eab0 2023-10-16T13:40:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae0a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 0x7fae0c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae0a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 0x7fae0c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45498/0 (socket says 172.21.15.5:45498) 2023-10-16T13:40:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae0a7fc700 1 -- 172.21.15.5:0/1599994238 learned_addr learned my addr 172.21.15.5:0/1599994238 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae0affd700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c0cf8a0 0x7fae0c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.923+0000 7fae0b7fe700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15eab0 0x7fae0c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae0a7fc700 1 -- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15eab0 msgr2=0x7fae0c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae0a7fc700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15eab0 0x7fae0c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae0a7fc700 1 -- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c0cf8a0 msgr2=0x7fae0c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae0a7fc700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c0cf8a0 0x7fae0c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae0a7fc700 1 -- 172.21.15.5:0/1599994238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04009b30 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae0a7fc700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 0x7fae0c156d90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e870 tx=0x7fadfc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc009590 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc013680 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c15fb10 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0139f0 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.924+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c1572d0 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.925+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c0c8f30 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.925+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fadfc013b50 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.926+0000 7fadf3fff700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadf806af90 0x7fadf806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.926+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fadfc089190 con 0x7fae0c0d1bc0 2023-10-16T13:40:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.926+0000 7fae0affd700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadf806af90 0x7fadf806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.927+0000 7fae0affd700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadf806af90 0x7fadf806d450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fae00007fd0 tx=0x7fae00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:30.931+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae0c0c8f30 con 0x7fae0c0d1bc0 2023-10-16T13:40:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.131+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fae0c0c8f10 con 0x7fae0c0d1bc0 2023-10-16T13:40:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.135+0000 7fadf3fff700 1 -- 172.21.15.5:0/1599994238 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadfc057ff0 con 0x7fae0c0d1bc0 2023-10-16T13:40:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadf806af90 msgr2=0x7fadf806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadf806af90 0x7fadf806d450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fae00007fd0 tx=0x7fae00009040 comp rx=0 tx=0).stop 2023-10-16T13:40:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 msgr2=0x7fae0c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 0x7fae0c156d90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e870 tx=0x7fadfc00eb80 comp rx=0 tx=0).stop 2023-10-16T13:40:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 shutdown_connections 2023-10-16T13:40:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadf806af90 0x7fadf806d450 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15eab0 0x7fae0c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c0cf8a0 0x7fae0c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 --2- 172.21.15.5:0/1599994238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0d1bc0 0x7fae0c156d90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 >> 172.21.15.5:0/1599994238 conn(0x7fae0c0665a0 msgr2=0x7fae0c0cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 shutdown_connections 2023-10-16T13:40:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.137+0000 7fae11911700 1 -- 172.21.15.5:0/1599994238 wait complete. 2023-10-16T13:40:31.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-16T13:40:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.278+0000 7f13b563a700 1 Processor -- start 2023-10-16T13:40:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.278+0000 7f13b563a700 1 -- start start 2023-10-16T13:40:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.278+0000 7f13b563a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13b015e2f0 0x7f13b00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.278+0000 7f13b563a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b00b2d60 con 0x7f13b006a840 2023-10-16T13:40:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.278+0000 7f13b563a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b00cdd30 con 0x7f13b00cd950 2023-10-16T13:40:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.278+0000 7f13b563a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b01619a0 con 0x7f13b015e2f0 2023-10-16T13:40:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13b015e2f0 0x7f13b00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13b015e2f0 0x7f13b00cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45506/0 (socket says 172.21.15.5:45506) 2023-10-16T13:40:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 -- 172.21.15.5:0/588656454 learned_addr learned my addr 172.21.15.5:0/588656454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13af7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f13b006a840 0x7f13b006ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55510/0 (socket says 172.21.15.5:55510) 2023-10-16T13:40:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 -- 172.21.15.5:0/588656454 >> v1:172.21.15.112:6789/0 conn(0x7f13b00cd950 legacy=0x7f13b015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 -- 172.21.15.5:0/588656454 >> v1:172.21.15.5:6789/0 conn(0x7f13b006a840 legacy=0x7f13b006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13adffb700 1 -- 172.21.15.5:0/588656454 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572705258 0 0) 0x7f13b00b2d60 con 0x7f13b006a840 2023-10-16T13:40:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 -- 172.21.15.5:0/588656454 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b015e920 con 0x7f13b015e2f0 2023-10-16T13:40:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13ae7fc700 1 --2- 172.21.15.5:0/588656454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00cede0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f13a4006fd0 tx=0x7f13a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e909ffacfabd302f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13adffb700 1 -- 172.21.15.5:0/588656454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4005e30 con 0x7f13b015e2f0 2023-10-16T13:40:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13adffb700 1 -- 172.21.15.5:0/588656454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4004030 con 0x7f13b015e2f0 2023-10-16T13:40:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.279+0000 7f13adffb700 1 -- 172.21.15.5:0/588656454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40043e0 con 0x7f13b015e2f0 2023-10-16T13:40:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 -- 172.21.15.5:0/588656454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 msgr2=0x7f13b00cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 --2- 172.21.15.5:0/588656454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00cede0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f13a4006fd0 tx=0x7f13a4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 -- 172.21.15.5:0/588656454 shutdown_connections 2023-10-16T13:40:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 --2- 172.21.15.5:0/588656454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00cede0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 -- 172.21.15.5:0/588656454 >> 172.21.15.5:0/588656454 conn(0x7f13b006dae0 msgr2=0x7f13b006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 -- 172.21.15.5:0/588656454 shutdown_connections 2023-10-16T13:40:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.280+0000 7f13b563a700 1 -- 172.21.15.5:0/588656454 wait complete. 2023-10-16T13:40:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.281+0000 7f13b563a700 1 Processor -- start 2023-10-16T13:40:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.281+0000 7f13b563a700 1 -- start start 2023-10-16T13:40:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13b563a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13b006a840 0x7f13b00c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13b563a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13b00cd950 0x7f13b00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13b563a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13b563a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00ae1f0 con 0x7f13b015e2f0 2023-10-16T13:40:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13b563a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00ae4d0 con 0x7f13b00cd950 2023-10-16T13:40:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13b563a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00ae7b0 con 0x7f13b006a840 2023-10-16T13:40:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45514/0 (socket says 172.21.15.5:45514) 2023-10-16T13:40:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13af7fe700 1 -- 172.21.15.5:0/4268163563 learned_addr learned my addr 172.21.15.5:0/4268163563 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13ae7fc700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13b00cd950 0x7f13b00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.282+0000 7f13aeffd700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13b006a840 0x7f13b00c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13af7fe700 1 -- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13b006a840 msgr2=0x7f13b00c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13af7fe700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13b006a840 0x7f13b00c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13af7fe700 1 -- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13b00cd950 msgr2=0x7f13b00b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13af7fe700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13b00cd950 0x7f13b00b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13af7fe700 1 -- 172.21.15.5:0/4268163563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009500 con 0x7f13b015e2f0 2023-10-16T13:40:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13af7fe700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00b0a90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f13a8002230 tx=0x7f13a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800ac20 con 0x7f13b015e2f0 2023-10-16T13:40:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800ada0 con 0x7f13b015e2f0 2023-10-16T13:40:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b00aea90 con 0x7f13b015e2f0 2023-10-16T13:40:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8007310 con 0x7f13b015e2f0 2023-10-16T13:40:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.283+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b00b5020 con 0x7f13b015e2f0 2023-10-16T13:40:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.284+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00aefb0 con 0x7f13b015e2f0 2023-10-16T13:40:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.284+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f13a8007470 con 0x7f13b015e2f0 2023-10-16T13:40:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.285+0000 7f13977fe700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f139c06af90 0x7f139c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.285+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f13a8089160 con 0x7f13b015e2f0 2023-10-16T13:40:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.285+0000 7f13aeffd700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f139c06af90 0x7f139c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.285+0000 7f13aeffd700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f139c06af90 0x7f139c06d450 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f13a0000f60 tx=0x7f13a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.289+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13b00aefb0 con 0x7f13b015e2f0 2023-10-16T13:40:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.575+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f13b00aefb0 con 0x7f13b015e2f0 2023-10-16T13:40:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.774+0000 7f13977fe700 1 -- 172.21.15.5:0/4268163563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v139) v1 ==== 133+0+0 (secure 0 0 0) 0x7f13b00aefb0 con 0x7f13b015e2f0 2023-10-16T13:40:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f139c06af90 msgr2=0x7f139c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f139c06af90 0x7f139c06d450 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f13a0000f60 tx=0x7f13a0009040 comp rx=0 tx=0).stop 2023-10-16T13:40:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 msgr2=0x7f13b00b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00b0a90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f13a8002230 tx=0x7f13a800a060 comp rx=0 tx=0).stop 2023-10-16T13:40:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 shutdown_connections 2023-10-16T13:40:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b015e2f0 0x7f13b00b0a90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f139c06af90 0x7f139c06d450 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13b006a840 0x7f13b00c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 --2- 172.21.15.5:0/4268163563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13b00cd950 0x7f13b00b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 >> 172.21.15.5:0/4268163563 conn(0x7f13b006dae0 msgr2=0x7f13b006ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.776+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 shutdown_connections 2023-10-16T13:40:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.777+0000 7f13b563a700 1 -- 172.21.15.5:0/4268163563 wait complete. 2023-10-16T13:40:31.792 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-10-16T13:40:31.792 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-10-16T13:40:31.792 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:40:31.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:31.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.921+0000 7f913ab39700 1 Processor -- start 2023-10-16T13:40:31.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.921+0000 7f913ab39700 1 -- start start 2023-10-16T13:40:31.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f913ab39700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f913415f1f0 0x7f91340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f913ab39700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913415e7a0 con 0x7f913415ab10 2023-10-16T13:40:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f913ab39700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91340d0090 con 0x7f91340cfc60 2023-10-16T13:40:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f913ab39700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91340b29a0 con 0x7f913415f1f0 2023-10-16T13:40:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f91388d5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f913415ab10 0x7f91340b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55522/0 (socket says 172.21.15.5:55522) 2023-10-16T13:40:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f91388d5700 1 -- 172.21.15.5:0/3799073114 learned_addr learned my addr 172.21.15.5:0/3799073114 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026860728 0 0) 0x7f913415e7a0 con 0x7f913415ab10 2023-10-16T13:40:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f9133fff700 1 --2- 172.21.15.5:0/3799073114 >> v2:172.21.15.112:3300/0 conn(0x7f913415f1f0 0x7f91340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.922+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91240035b0 con 0x7f913415ab10 2023-10-16T13:40:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595556445 0 0) 0x7f91240035b0 con 0x7f913415ab10 2023-10-16T13:40:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 >> v2:172.21.15.112:3300/0 conn(0x7f913415f1f0 msgr2=0x7f91340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 --2- 172.21.15.5:0/3799073114 >> v2:172.21.15.112:3300/0 conn(0x7f913415f1f0 0x7f91340cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 >> v1:172.21.15.112:6789/0 conn(0x7f91340cfc60 legacy=0x7f91340cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340b2c80 con 0x7f913415ab10 2023-10-16T13:40:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f9128001670 con 0x7f913415ab10 2023-10-16T13:40:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 >> v1:172.21.15.5:6789/0 conn(0x7f913415ab10 legacy=0x7f91340b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9124003a00 0x7f9124003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f9124004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9124005210 0x7f912400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340b29a0 con 0x7f9124004850 2023-10-16T13:40:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912400c0b0 con 0x7f9124003a00 2023-10-16T13:40:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912400c270 con 0x7f9124005210 2023-10-16T13:40:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f9124004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91388d5700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9124003a00 0x7f9124003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91390d6700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9124005210 0x7f912400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 -- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9124005210 msgr2=0x7f912400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9124005210 0x7f912400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 -- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9124003a00 msgr2=0x7f9124003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9124003a00 0x7f9124003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 -- 172.21.15.5:0/3799073114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240035b0 con 0x7f9124004850 2023-10-16T13:40:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91390d6700 1 -- 172.21.15.5:0/3799073114 reap_dead start 2023-10-16T13:40:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f9133fff700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f9124004cd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9120009b40 tx=0x7f9124005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1db92f745eae0d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120005a20 con 0x7f9124004850 2023-10-16T13:40:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9120005b80 con 0x7f9124004850 2023-10-16T13:40:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.923+0000 7f91337fe700 1 -- 172.21.15.5:0/3799073114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000e6c0 con 0x7f9124004850 2023-10-16T13:40:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 -- 172.21.15.5:0/3799073114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 msgr2=0x7f9124004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f9124004cd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9120009b40 tx=0x7f9124005880 comp rx=0 tx=0).stop 2023-10-16T13:40:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 -- 172.21.15.5:0/3799073114 shutdown_connections 2023-10-16T13:40:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 --2- 172.21.15.5:0/3799073114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f9124004cd0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 -- 172.21.15.5:0/3799073114 >> 172.21.15.5:0/3799073114 conn(0x7f913406dae0 msgr2=0x7f913406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 -- 172.21.15.5:0/3799073114 shutdown_connections 2023-10-16T13:40:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.924+0000 7f913ab39700 1 -- 172.21.15.5:0/3799073114 wait complete. 2023-10-16T13:40:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.925+0000 7f913ab39700 1 Processor -- start 2023-10-16T13:40:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.925+0000 7f913ab39700 1 -- start start 2023-10-16T13:40:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f913ab39700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f91340b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f913ab39700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91340c45e0 0x7f91340c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f913ab39700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9134151870 0x7f9134151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f913ab39700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9134152260 con 0x7f9124004850 2023-10-16T13:40:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f913ab39700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340b18b0 con 0x7f91340c45e0 2023-10-16T13:40:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f913ab39700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91340c4280 con 0x7f9134151870 2023-10-16T13:40:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f91388d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f91340b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f91388d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f91340b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45530/0 (socket says 172.21.15.5:45530) 2023-10-16T13:40:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f91388d5700 1 -- 172.21.15.5:0/2174065986 learned_addr learned my addr 172.21.15.5:0/2174065986 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f9133fff700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91340c45e0 0x7f91340c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.926+0000 7f91390d6700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9134151870 0x7f9134151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91388d5700 1 -- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9134151870 msgr2=0x7f9134151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91388d5700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9134151870 0x7f9134151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91388d5700 1 -- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91340c45e0 msgr2=0x7f91340c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91388d5700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91340c45e0 0x7f91340c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91388d5700 1 -- 172.21.15.5:0/2174065986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340b02d0 con 0x7f9124004850 2023-10-16T13:40:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f9133fff700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91340c45e0 0x7f91340c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91390d6700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9134151870 0x7f9134151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91388d5700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f91340b1370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f91280017a0 tx=0x7f9128007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128001500 con 0x7f9124004850 2023-10-16T13:40:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912800f7f0 con 0x7f9124004850 2023-10-16T13:40:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91340b05b0 con 0x7f9124004850 2023-10-16T13:40:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800fba0 con 0x7f9124004850 2023-10-16T13:40:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.927+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91340b0b70 con 0x7f9124004850 2023-10-16T13:40:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.928+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91340afc10 con 0x7f9124004850 2023-10-16T13:40:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.929+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f912800fd00 con 0x7f9124004850 2023-10-16T13:40:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.929+0000 7f91317fa700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f911806af90 0x7f911806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.929+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91280892f0 con 0x7f9124004850 2023-10-16T13:40:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.929+0000 7f9133fff700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f911806af90 0x7f911806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.930+0000 7f9133fff700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f911806af90 0x7f911806d450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9120000c00 tx=0x7f9120008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:31.934+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91280546b0 con 0x7f9124004850 2023-10-16T13:40:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.134+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91340d0220 con 0x7f9124004850 2023-10-16T13:40:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.136+0000 7f91317fa700 1 -- 172.21.15.5:0/2174065986 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+12912 (secure 0 0 0) 0x7f9128057cd0 con 0x7f9124004850 2023-10-16T13:40:32.139 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:32.139 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":54,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:30.765450+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1547849780":"2023-10-17T13:40:27.505489+0000","172.21.15.5:6833/1547849780":"2023-10-17T13:40:27.505489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.138+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f911806af90 msgr2=0x7f911806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.138+0000 7f913ab39700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f911806af90 0x7f911806d450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9120000c00 tx=0x7f9120008030 comp rx=0 tx=0).stop 2023-10-16T13:40:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.138+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 msgr2=0x7f91340b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.138+0000 7f913ab39700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f91340b1370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f91280017a0 tx=0x7f9128007620 comp rx=0 tx=0).stop 2023-10-16T13:40:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 shutdown_connections 2023-10-16T13:40:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f911806af90 0x7f911806d450 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9134151870 0x7f9134151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9124004850 0x7f91340b1370 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 --2- 172.21.15.5:0/2174065986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91340c45e0 0x7f91340c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 >> 172.21.15.5:0/2174065986 conn(0x7f913406dae0 msgr2=0x7f91340d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 shutdown_connections 2023-10-16T13:40:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.139+0000 7f913ab39700 1 -- 172.21.15.5:0/2174065986 wait complete. 2023-10-16T13:40:32.153 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:40:32.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:40:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.279+0000 7fabf762f700 1 Processor -- start 2023-10-16T13:40:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.279+0000 7fabf762f700 1 -- start start 2023-10-16T13:40:32.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf762f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fabf00cd950 0x7fabf015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf762f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabf00cede0 0x7fabf015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf762f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf00cf290 con 0x7fabf006a840 2023-10-16T13:40:32.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf762f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf01619a0 con 0x7fabf00cede0 2023-10-16T13:40:32.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf762f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00b2d60 con 0x7fabf00cd950 2023-10-16T13:40:32.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf4bca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabf00cede0 0x7fabf015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf4bca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabf00cede0 0x7fabf015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45540/0 (socket says 172.21.15.5:45540) 2023-10-16T13:40:32.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf4bca700 1 -- 172.21.15.5:0/53630038 learned_addr learned my addr 172.21.15.5:0/53630038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf53cb700 1 --2- 172.21.15.5:0/53630038 >> v2:172.21.15.112:3300/0 conn(0x7fabf00cd950 0x7fabf015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.280+0000 7fabf4bca700 1 -- 172.21.15.5:0/53630038 >> v2:172.21.15.112:3300/0 conn(0x7fabf00cd950 msgr2=0x7fabf015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf4bca700 1 --2- 172.21.15.5:0/53630038 >> v2:172.21.15.112:3300/0 conn(0x7fabf00cd950 0x7fabf015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf4bca700 1 -- 172.21.15.5:0/53630038 >> v1:172.21.15.112:6789/0 conn(0x7fabf006a840 legacy=0x7fabf0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf4bca700 1 -- 172.21.15.5:0/53630038 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00cdd30 con 0x7fabf00cede0 2023-10-16T13:40:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf53cb700 1 --2- 172.21.15.5:0/53630038 >> v2:172.21.15.112:3300/0 conn(0x7fabf00cd950 0x7fabf015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf4bca700 1 --2- 172.21.15.5:0/53630038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf00cede0 0x7fabf015f570 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fabf0161ae0 tx=0x7fabec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949a31cfdc123a19 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabe7fff700 1 -- 172.21.15.5:0/53630038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec005e30 con 0x7fabf00cede0 2023-10-16T13:40:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabe7fff700 1 -- 172.21.15.5:0/53630038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec004030 con 0x7fabf00cede0 2023-10-16T13:40:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabe7fff700 1 -- 172.21.15.5:0/53630038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0043e0 con 0x7fabf00cede0 2023-10-16T13:40:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf762f700 1 -- 172.21.15.5:0/53630038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf00cede0 msgr2=0x7fabf015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf762f700 1 --2- 172.21.15.5:0/53630038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf00cede0 0x7fabf015f570 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fabf0161ae0 tx=0x7fabec009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf762f700 1 -- 172.21.15.5:0/53630038 shutdown_connections 2023-10-16T13:40:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf762f700 1 --2- 172.21.15.5:0/53630038 >> v2:172.21.15.112:3300/0 conn(0x7fabf00cd950 0x7fabf015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf762f700 1 --2- 172.21.15.5:0/53630038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf00cede0 0x7fabf015f570 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.281+0000 7fabf762f700 1 -- 172.21.15.5:0/53630038 >> 172.21.15.5:0/53630038 conn(0x7fabf006dae0 msgr2=0x7fabf006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.282+0000 7fabf762f700 1 -- 172.21.15.5:0/53630038 shutdown_connections 2023-10-16T13:40:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.282+0000 7fabf762f700 1 -- 172.21.15.5:0/53630038 wait complete. 2023-10-16T13:40:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 Processor -- start 2023-10-16T13:40:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 -- start start 2023-10-16T13:40:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 0x7fabf00c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabf00cd950 0x7fabf01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf00cede0 0x7fabf00c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c54f0 con 0x7fabf006a840 2023-10-16T13:40:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c4870 con 0x7fabf00cede0 2023-10-16T13:40:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.283+0000 7fabf762f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c4b50 con 0x7fabf00cd950 2023-10-16T13:40:32.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 0x7fabf00c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 0x7fabf00c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45544/0 (socket says 172.21.15.5:45544) 2023-10-16T13:40:32.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 -- 172.21.15.5:0/3358336656 learned_addr learned my addr 172.21.15.5:0/3358336656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:32.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf5bcc700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf00cede0 0x7fabf00c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf4bca700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabf00cd950 0x7fabf01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 -- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabf00cd950 msgr2=0x7fabf01527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabf00cd950 0x7fabf01527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 -- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf00cede0 msgr2=0x7fabf00c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf00cede0 0x7fabf00c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 -- 172.21.15.5:0/3358336656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009500 con 0x7fabf006a840 2023-10-16T13:40:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf53cb700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 0x7fabf00c3fe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c750 tx=0x7fabe000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011800 con 0x7fabf006a840 2023-10-16T13:40:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0011960 con 0x7fabf006a840 2023-10-16T13:40:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf00c4e30 con 0x7fabf006a840 2023-10-16T13:40:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.284+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011cd0 con 0x7fabf006a840 2023-10-16T13:40:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.285+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf00c4520 con 0x7fabf006a840 2023-10-16T13:40:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.285+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00c5760 con 0x7fabf006a840 2023-10-16T13:40:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.286+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fabe0021350 con 0x7fabf006a840 2023-10-16T13:40:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.286+0000 7fabe5ffb700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabd406af90 0x7fabd406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.286+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fabe0089200 con 0x7fabf006a840 2023-10-16T13:40:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.286+0000 7fabf4bca700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabd406af90 0x7fabd406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.287+0000 7fabf4bca700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabd406af90 0x7fabd406d450 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabec013000 tx=0x7fabec008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.291+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabe00544b0 con 0x7fabf006a840 2023-10-16T13:40:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.491+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabf0067d20 con 0x7fabf006a840 2023-10-16T13:40:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.492+0000 7fabe5ffb700 1 -- 172.21.15.5:0/3358336656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabe0057ad0 con 0x7fabf006a840 2023-10-16T13:40:32.495 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:40:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabd406af90 msgr2=0x7fabd406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabd406af90 0x7fabd406d450 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabec013000 tx=0x7fabec008070 comp rx=0 tx=0).stop 2023-10-16T13:40:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 msgr2=0x7fabf00c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 0x7fabf00c3fe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c750 tx=0x7fabe000ca60 comp rx=0 tx=0).stop 2023-10-16T13:40:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 shutdown_connections 2023-10-16T13:40:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf00cede0 0x7fabf00c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabf006a840 0x7fabf00c3fe0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabd406af90 0x7fabd406d450 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 --2- 172.21.15.5:0/3358336656 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabf00cd950 0x7fabf01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 >> 172.21.15.5:0/3358336656 conn(0x7fabf006dae0 msgr2=0x7fabf0160010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:32.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 shutdown_connections 2023-10-16T13:40:32.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.494+0000 7fabf762f700 1 -- 172.21.15.5:0/3358336656 wait complete. 2023-10-16T13:40:32.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-16T13:40:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.632+0000 7fa0f39c4700 1 Processor -- start 2023-10-16T13:40:32.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.632+0000 7fa0f39c4700 1 -- start start 2023-10-16T13:40:32.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f39c4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f39c4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0ec06af50 0x7fa0ec0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f39c4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec0b3530 con 0x7fa0ec0b28b0 2023-10-16T13:40:32.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f39c4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ec0cde00 con 0x7fa0ec06af50 2023-10-16T13:40:32.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f39c4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0cd180 con 0x7fa0ec15f130 2023-10-16T13:40:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0ec06af50 0x7fa0ec0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0ec06af50 0x7fa0ec0b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45556/0 (socket says 172.21.15.5:45556) 2023-10-16T13:40:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 -- 172.21.15.5:0/2135839873 learned_addr learned my addr 172.21.15.5:0/2135839873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f0f5f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0ec0b28b0 0x7fa0ec06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55558/0 (socket says 172.21.15.5:55558) 2023-10-16T13:40:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1760700 1 --2- 172.21.15.5:0/2135839873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 -- 172.21.15.5:0/2135839873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 msgr2=0x7fa0ec0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 --2- 172.21.15.5:0/2135839873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 -- 172.21.15.5:0/2135839873 >> v1:172.21.15.5:6789/0 conn(0x7fa0ec0b28b0 legacy=0x7fa0ec06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0e3fff700 1 -- 172.21.15.5:0/2135839873 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600657140 0 0) 0x7fa0ec0b3530 con 0x7fa0ec0b28b0 2023-10-16T13:40:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 -- 172.21.15.5:0/2135839873 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0cd460 con 0x7fa0ec06af50 2023-10-16T13:40:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.633+0000 7fa0f1f61700 1 --2- 172.21.15.5:0/2135839873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec0b3960 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009e50 tx=0x7fa0e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9638fd9c967927e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0e3fff700 1 -- 172.21.15.5:0/2135839873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400e070 con 0x7fa0ec06af50 2023-10-16T13:40:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0e3fff700 1 -- 172.21.15.5:0/2135839873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400b9c0 con 0x7fa0ec06af50 2023-10-16T13:40:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0e3fff700 1 -- 172.21.15.5:0/2135839873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400bd70 con 0x7fa0ec06af50 2023-10-16T13:40:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 -- 172.21.15.5:0/2135839873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 msgr2=0x7fa0ec0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/2135839873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec0b3960 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009e50 tx=0x7fa0e400b330 comp rx=0 tx=0).stop 2023-10-16T13:40:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 -- 172.21.15.5:0/2135839873 shutdown_connections 2023-10-16T13:40:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/2135839873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec0b3960 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/2135839873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 -- 172.21.15.5:0/2135839873 >> 172.21.15.5:0/2135839873 conn(0x7fa0ec06dae0 msgr2=0x7fa0ec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:32.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 -- 172.21.15.5:0/2135839873 shutdown_connections 2023-10-16T13:40:32.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.634+0000 7fa0f39c4700 1 -- 172.21.15.5:0/2135839873 wait complete. 2023-10-16T13:40:32.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 Processor -- start 2023-10-16T13:40:32.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 -- start start 2023-10-16T13:40:32.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0ec0b28b0 0x7fa0ec0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0c7bd0 con 0x7fa0ec06af50 2023-10-16T13:40:32.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0c75a0 con 0x7fa0ec0b28b0 2023-10-16T13:40:32.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f39c4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0c9a50 con 0x7fa0ec15f130 2023-10-16T13:40:32.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f1760700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f1760700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45558/0 (socket says 172.21.15.5:45558) 2023-10-16T13:40:32.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.636+0000 7fa0f1760700 1 -- 172.21.15.5:0/179326278 learned_addr learned my addr 172.21.15.5:0/179326278 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:32.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1760700 1 -- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 msgr2=0x7fa0ec15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1f61700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f0f5f700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0ec0b28b0 0x7fa0ec0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1760700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1760700 1 -- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0ec0b28b0 msgr2=0x7fa0ec0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1760700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0ec0b28b0 0x7fa0ec0c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1760700 1 -- 172.21.15.5:0/179326278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009b30 con 0x7fa0ec06af50 2023-10-16T13:40:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f1760700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec156f90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00d800 tx=0x7fa0dc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0125f0 con 0x7fa0ec06af50 2023-10-16T13:40:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc012750 con 0x7fa0ec06af50 2023-10-16T13:40:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec0c9d30 con 0x7fa0ec06af50 2023-10-16T13:40:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc012b00 con 0x7fa0ec06af50 2023-10-16T13:40:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.637+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec157cf0 con 0x7fa0ec06af50 2023-10-16T13:40:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.638+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec074460 con 0x7fa0ec06af50 2023-10-16T13:40:32.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.639+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fa0dc012c60 con 0x7fa0ec06af50 2023-10-16T13:40:32.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.639+0000 7fa0e1ffb700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0d006af90 0x7fa0d006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:32.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.639+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0dc0895e0 con 0x7fa0ec06af50 2023-10-16T13:40:32.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.639+0000 7fa0f0f5f700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0d006af90 0x7fa0d006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:32.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.640+0000 7fa0f0f5f700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0d006af90 0x7fa0d006d450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8007fd0 tx=0x7fa0e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:32.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.644+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0ec074460 con 0x7fa0ec06af50 2023-10-16T13:40:32.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:32.925+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7fa0ec074460 con 0x7fa0ec06af50 2023-10-16T13:40:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.779+0000 7fa0e1ffb700 1 -- 172.21.15.5:0/179326278 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v141) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa0ec074460 con 0x7fa0ec06af50 2023-10-16T13:40:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0d006af90 msgr2=0x7fa0d006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0d006af90 0x7fa0d006d450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8007fd0 tx=0x7fa0e8009040 comp rx=0 tx=0).stop 2023-10-16T13:40:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 msgr2=0x7fa0ec156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec156f90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00d800 tx=0x7fa0dc00dbc0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 shutdown_connections 2023-10-16T13:40:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0d006af90 0x7fa0d006d450 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0ec15f130 0x7fa0ec15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ec06af50 0x7fa0ec156f90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 --2- 172.21.15.5:0/179326278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0ec0b28b0 0x7fa0ec0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.782+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 >> 172.21.15.5:0/179326278 conn(0x7fa0ec06dae0 msgr2=0x7fa0ec159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.783+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 shutdown_connections 2023-10-16T13:40:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.783+0000 7fa0f39c4700 1 -- 172.21.15.5:0/179326278 wait complete. 2023-10-16T13:40:33.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:40:33.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.933+0000 7f41a54e6700 1 Processor -- start 2023-10-16T13:40:33.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.933+0000 7f41a54e6700 1 -- start start 2023-10-16T13:40:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f41a54e6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41a015dbc0 0x7f41a015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f41a54e6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41a00d3fc0 0x7f41a00d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f41a54e6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a015e4e0 con 0x7f41a00b7050 2023-10-16T13:40:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f41a54e6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a00b7560 con 0x7f41a00d3fc0 2023-10-16T13:40:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f41a54e6700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a00b7840 con 0x7f41a015dbc0 2023-10-16T13:40:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f419e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41a00d3fc0 0x7f41a00d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f419e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41a00d3fc0 0x7f41a00d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45566/0 (socket says 172.21.15.5:45566) 2023-10-16T13:40:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f419e7fc700 1 -- 172.21.15.5:0/1367783368 learned_addr learned my addr 172.21.15.5:0/1367783368 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f419e7fc700 1 -- 172.21.15.5:0/1367783368 >> v2:172.21.15.112:3300/0 conn(0x7f41a015dbc0 msgr2=0x7f41a015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f419effd700 1 --2- 172.21.15.5:0/1367783368 >> v2:172.21.15.112:3300/0 conn(0x7f41a015dbc0 0x7f41a015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.934+0000 7f419e7fc700 1 --2- 172.21.15.5:0/1367783368 >> v2:172.21.15.112:3300/0 conn(0x7f41a015dbc0 0x7f41a015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419e7fc700 1 -- 172.21.15.5:0/1367783368 >> v1:172.21.15.112:6789/0 conn(0x7f41a00b7050 legacy=0x7f41a00d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419e7fc700 1 -- 172.21.15.5:0/1367783368 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a00b7b20 con 0x7f41a00d3fc0 2023-10-16T13:40:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419effd700 1 --2- 172.21.15.5:0/1367783368 >> v2:172.21.15.112:3300/0 conn(0x7f41a015dbc0 0x7f41a015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419e7fc700 1 --2- 172.21.15.5:0/1367783368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a00d1ac0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f41a0072db0 tx=0x7f4190009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ed9553cc19eb02 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419dffb700 1 -- 172.21.15.5:0/1367783368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190004230 con 0x7f41a00d3fc0 2023-10-16T13:40:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419dffb700 1 -- 172.21.15.5:0/1367783368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190004390 con 0x7f41a00d3fc0 2023-10-16T13:40:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f419dffb700 1 -- 172.21.15.5:0/1367783368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900036a0 con 0x7f41a00d3fc0 2023-10-16T13:40:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f41a54e6700 1 -- 172.21.15.5:0/1367783368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 msgr2=0x7f41a00d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1367783368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a00d1ac0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f41a0072db0 tx=0x7f4190009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f41a54e6700 1 -- 172.21.15.5:0/1367783368 shutdown_connections 2023-10-16T13:40:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.935+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1367783368 >> v2:172.21.15.112:3300/0 conn(0x7f41a015dbc0 0x7f41a015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.936+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1367783368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a00d1ac0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.936+0000 7f41a54e6700 1 -- 172.21.15.5:0/1367783368 >> 172.21.15.5:0/1367783368 conn(0x7f41a009cb40 msgr2=0x7f41a00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.936+0000 7f41a54e6700 1 -- 172.21.15.5:0/1367783368 shutdown_connections 2023-10-16T13:40:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.936+0000 7f41a54e6700 1 -- 172.21.15.5:0/1367783368 wait complete. 2023-10-16T13:40:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.937+0000 7f41a54e6700 1 Processor -- start 2023-10-16T13:40:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.937+0000 7f41a54e6700 1 -- start start 2023-10-16T13:40:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41a54e6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41a00b7050 0x7f41a006bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41a54e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41a54e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41a015dbc0 0x7f41a01e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41a54e6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00a0430 con 0x7f41a00d3fc0 2023-10-16T13:40:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41a54e6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00a0850 con 0x7f41a015dbc0 2023-10-16T13:40:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41a54e6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a009f7b0 con 0x7f41a00b7050 2023-10-16T13:40:33.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45574/0 (socket says 172.21.15.5:45574) 2023-10-16T13:40:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 -- 172.21.15.5:0/1327792923 learned_addr learned my addr 172.21.15.5:0/1327792923 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419effd700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41a00b7050 0x7f41a006bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419f7fe700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41a015dbc0 0x7f41a01e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 -- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41a00b7050 msgr2=0x7f41a006bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:33.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41a00b7050 0x7f41a006bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 -- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41a015dbc0 msgr2=0x7f41a01e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41a015dbc0 0x7f41a01e5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 -- 172.21.15.5:0/1327792923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190009550 con 0x7f41a00d3fc0 2023-10-16T13:40:33.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419effd700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41a00b7050 0x7f41a006bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419f7fe700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41a015dbc0 0x7f41a01e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f419e7fc700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a006c4a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f41a006b4b0 tx=0x7f4190004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.938+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190003d80 con 0x7f41a00d3fc0 2023-10-16T13:40:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.939+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419001f070 con 0x7f41a00d3fc0 2023-10-16T13:40:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.939+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a009fa90 con 0x7f41a00d3fc0 2023-10-16T13:40:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.939+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011870 con 0x7f41a00d3fc0 2023-10-16T13:40:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.939+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a00a0050 con 0x7f41a00d3fc0 2023-10-16T13:40:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.940+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a00a0570 con 0x7f41a00d3fc0 2023-10-16T13:40:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.940+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f4190021030 con 0x7f41a00d3fc0 2023-10-16T13:40:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.940+0000 7f41877fe700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f418c06af90 0x7f418c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.940+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f419008a940 con 0x7f41a00d3fc0 2023-10-16T13:40:33.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.941+0000 7f419effd700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f418c06af90 0x7f418c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:33.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.941+0000 7f419effd700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f418c06af90 0x7f418c06d450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f419400aa10 tx=0x7f4194008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:33.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:33.945+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41a00a0570 con 0x7f41a00d3fc0 2023-10-16T13:40:34.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.144+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f41a00a0570 con 0x7f41a00d3fc0 2023-10-16T13:40:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.147+0000 7f41877fe700 1 -- 172.21.15.5:0/1327792923 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41a00a0570 con 0x7f41a00d3fc0 2023-10-16T13:40:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f418c06af90 msgr2=0x7f418c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f418c06af90 0x7f418c06d450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f419400aa10 tx=0x7f4194008040 comp rx=0 tx=0).stop 2023-10-16T13:40:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 msgr2=0x7f41a006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a006c4a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f41a006b4b0 tx=0x7f4190004750 comp rx=0 tx=0).stop 2023-10-16T13:40:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 shutdown_connections 2023-10-16T13:40:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41a015dbc0 0x7f41a01e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f418c06af90 0x7f418c06d450 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41a00b7050 0x7f41a006bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 --2- 172.21.15.5:0/1327792923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a00d3fc0 0x7f41a006c4a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 >> 172.21.15.5:0/1327792923 conn(0x7f41a009cb40 msgr2=0x7f41a00d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 shutdown_connections 2023-10-16T13:40:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.149+0000 7f41a54e6700 1 -- 172.21.15.5:0/1327792923 wait complete. 2023-10-16T13:40:34.163 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:40:34.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:40:34.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:40:34.252 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:40:34.252 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:34.253 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:34.270 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:40:34.271 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:34.271 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:34.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:40:34.292 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:34.292 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:34.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:40:34.328 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:34.328 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:34.352 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:40:34.353 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:40:34.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.489+0000 7fabe064d700 1 Processor -- start 2023-10-16T13:40:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.489+0000 7fabe064d700 1 -- start start 2023-10-16T13:40:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabe064d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabe064d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabd80d1d90 0x7fabd80cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabe064d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd815ee90 con 0x7fabd80cf6d0 2023-10-16T13:40:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabe064d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80cfb50 con 0x7fabd80d1d90 2023-10-16T13:40:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabe064d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8158370 con 0x7fabd815eab0 2023-10-16T13:40:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabdebea700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabd80d1d90 0x7fabd80cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabdebea700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabd80d1d90 0x7fabd80cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45584/0 (socket says 172.21.15.5:45584) 2023-10-16T13:40:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabdebea700 1 -- 172.21.15.5:0/3485220370 learned_addr learned my addr 172.21.15.5:0/3485220370 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.490+0000 7fabde3e9700 1 --2- 172.21.15.5:0/3485220370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdebea700 1 -- 172.21.15.5:0/3485220370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 msgr2=0x7fabd80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdebea700 1 --2- 172.21.15.5:0/3485220370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdebea700 1 -- 172.21.15.5:0/3485220370 >> v1:172.21.15.112:6789/0 conn(0x7fabd80cf6d0 legacy=0x7fabd80d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdebea700 1 -- 172.21.15.5:0/3485220370 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80d23b0 con 0x7fabd80d1d90 2023-10-16T13:40:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdebea700 1 --2- 172.21.15.5:0/3485220370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80d1d90 0x7fabd80cbc10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fabd815f020 tx=0x7fabd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6b0fa70bf7b745 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdd3e7700 1 -- 172.21.15.5:0/3485220370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000e070 con 0x7fabd80d1d90 2023-10-16T13:40:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdd3e7700 1 -- 172.21.15.5:0/3485220370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0003a20 con 0x7fabd80d1d90 2023-10-16T13:40:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabdd3e7700 1 -- 172.21.15.5:0/3485220370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0003dd0 con 0x7fabd80d1d90 2023-10-16T13:40:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabe064d700 1 -- 172.21.15.5:0/3485220370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80d1d90 msgr2=0x7fabd80cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.491+0000 7fabe064d700 1 --2- 172.21.15.5:0/3485220370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80d1d90 0x7fabd80cbc10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fabd815f020 tx=0x7fabd000b330 comp rx=0 tx=0).stop 2023-10-16T13:40:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.492+0000 7fabe064d700 1 -- 172.21.15.5:0/3485220370 shutdown_connections 2023-10-16T13:40:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.492+0000 7fabe064d700 1 --2- 172.21.15.5:0/3485220370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80d1d90 0x7fabd80cbc10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.492+0000 7fabe064d700 1 --2- 172.21.15.5:0/3485220370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.492+0000 7fabe064d700 1 -- 172.21.15.5:0/3485220370 >> 172.21.15.5:0/3485220370 conn(0x7fabd80665a0 msgr2=0x7fabd8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.492+0000 7fabe064d700 1 -- 172.21.15.5:0/3485220370 shutdown_connections 2023-10-16T13:40:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.492+0000 7fabe064d700 1 -- 172.21.15.5:0/3485220370 wait complete. 2023-10-16T13:40:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.493+0000 7fabe064d700 1 Processor -- start 2023-10-16T13:40:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.493+0000 7fabe064d700 1 -- start start 2023-10-16T13:40:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabe064d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 0x7fabd81f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabe064d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd80d1d90 0x7fabd80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabe064d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabe064d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8160920 con 0x7fabd80cf6d0 2023-10-16T13:40:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabe064d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80acdf0 con 0x7fabd80d1d90 2023-10-16T13:40:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabe064d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8161980 con 0x7fabd815eab0 2023-10-16T13:40:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 0x7fabd81f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 0x7fabd81f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45586/0 (socket says 172.21.15.5:45586) 2023-10-16T13:40:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 -- 172.21.15.5:0/130805346 learned_addr learned my addr 172.21.15.5:0/130805346 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:34.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabdebea700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabddbe8700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd80d1d90 0x7fabd80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 -- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 msgr2=0x7fabd80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 -- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd80d1d90 msgr2=0x7fabd80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd80d1d90 0x7fabd80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 -- 172.21.15.5:0/130805346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009b30 con 0x7fabd80cf6d0 2023-10-16T13:40:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabde3e9700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 0x7fabd81f7450 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fabc800d800 tx=0x7fabc800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80125f0 con 0x7fabd80cf6d0 2023-10-16T13:40:34.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.494+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8012750 con 0x7fabd80cf6d0 2023-10-16T13:40:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.495+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd8160bc0 con 0x7fabd80cf6d0 2023-10-16T13:40:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.495+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8012b00 con 0x7fabd80cf6d0 2023-10-16T13:40:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.495+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd8161180 con 0x7fabd80cf6d0 2023-10-16T13:40:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.496+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd81617d0 con 0x7fabd80cf6d0 2023-10-16T13:40:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.496+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fabc8012c60 con 0x7fabd80cf6d0 2023-10-16T13:40:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.496+0000 7fabceffd700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabbc06af90 0x7fabbc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.496+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fabc8089310 con 0x7fabd80cf6d0 2023-10-16T13:40:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.497+0000 7fabddbe8700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabbc06af90 0x7fabbc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.497+0000 7fabddbe8700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabbc06af90 0x7fabbc06d450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fabd81486e0 tx=0x7fabd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:34.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.501+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabc8054780 con 0x7fabd80cf6d0 2023-10-16T13:40:34.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.748+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabd8067d20 con 0x7fabd80cf6d0 2023-10-16T13:40:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.748+0000 7fabceffd700 1 -- 172.21.15.5:0/130805346 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3696 (secure 0 0 0) 0x7fabc8057da0 con 0x7fabd80cf6d0 2023-10-16T13:40:34.751 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:34.751 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3898097785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3898097785},{"type":"v1","addr":"172.21.15.112:6836","nonce":3898097785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1103213015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1103213015},{"type":"v1","addr":"172.21.15.112:6837","nonce":1103213015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1279465886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1279465886},{"type":"v1","addr":"172.21.15.5:6834","nonce":1279465886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5949,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/585492244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":585492244},{"type":"v1","addr":"172.21.15.5:6835","nonce":585492244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[]} 2023-10-16T13:40:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabbc06af90 msgr2=0x7fabbc06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabbc06af90 0x7fabbc06d450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fabd81486e0 tx=0x7fabd4009040 comp rx=0 tx=0).stop 2023-10-16T13:40:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 msgr2=0x7fabd81f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 0x7fabd81f7450 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fabc800d800 tx=0x7fabc800db10 comp rx=0 tx=0).stop 2023-10-16T13:40:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 shutdown_connections 2023-10-16T13:40:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabbc06af90 0x7fabbc06d450 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabd815eab0 0x7fabd80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd80cf6d0 0x7fabd81f7450 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 --2- 172.21.15.5:0/130805346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd80d1d90 0x7fabd80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 >> 172.21.15.5:0/130805346 conn(0x7fabd80665a0 msgr2=0x7fabd80b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 shutdown_connections 2023-10-16T13:40:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.750+0000 7fabe064d700 1 -- 172.21.15.5:0/130805346 wait complete. 2023-10-16T13:40:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2023-10-16T13:40:34.765 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:40:34.765 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:40:34.766 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:40:34.766 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:40:34.766 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:40:34.767 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:40:34.767 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:40:34.767 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:40:34.768 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:40:34.768 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:40:34.768 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:40:34.768 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:40:34.769 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:40:34.769 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:40:34.769 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:40:34.769 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:40:34.775 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:40:34.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:40:34.776 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:40:34.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:40:34.780 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:40:34.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:40:34.782 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:40:34.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:40:34.818 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:40:34.818 DEBUG:teuthology.parallel:result is None 2023-10-16T13:40:34.819 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:40:34.819 DEBUG:teuthology.parallel:result is None 2023-10-16T13:40:34.824 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:40:34.825 DEBUG:teuthology.parallel:result is None 2023-10-16T13:40:34.826 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:40:34.826 DEBUG:teuthology.parallel:result is None 2023-10-16T13:40:34.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:40:34.900 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:40:34.900 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:40:34.913 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:40:34.913 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:40:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.957+0000 7f08b2328700 1 Processor -- start 2023-10-16T13:40:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.957+0000 7f08b2328700 1 -- start start 2023-10-16T13:40:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b2328700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08ac15d9e0 0x7f08ac15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b2328700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08ac0d1fc0 0x7f08ac0d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b2328700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac0ce350 con 0x7f08ac161800 2023-10-16T13:40:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b2328700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac0b5140 con 0x7f08ac15d9e0 2023-10-16T13:40:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b2328700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac162630 con 0x7f08ac0d1fc0 2023-10-16T13:40:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08abfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08ac15d9e0 0x7f08ac15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b08c5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08ac161800 0x7f08ac0cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55626/0 (socket says 172.21.15.5:55626) 2023-10-16T13:40:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.958+0000 7f08b08c5700 1 -- 172.21.15.5:0/3580856539 learned_addr learned my addr 172.21.15.5:0/3580856539 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08ab7fe700 1 --2- 172.21.15.5:0/3580856539 >> v2:172.21.15.112:3300/0 conn(0x7f08ac0d1fc0 0x7f08ac0d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08abfff700 1 -- 172.21.15.5:0/3580856539 >> v2:172.21.15.112:3300/0 conn(0x7f08ac0d1fc0 msgr2=0x7f08ac0d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08abfff700 1 --2- 172.21.15.5:0/3580856539 >> v2:172.21.15.112:3300/0 conn(0x7f08ac0d1fc0 0x7f08ac0d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08abfff700 1 -- 172.21.15.5:0/3580856539 >> v1:172.21.15.5:6789/0 conn(0x7f08ac161800 legacy=0x7f08ac0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08aaffd700 1 -- 172.21.15.5:0/3580856539 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544468152 0 0) 0x7f08ac0ce350 con 0x7f08ac161800 2023-10-16T13:40:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08abfff700 1 -- 172.21.15.5:0/3580856539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0ce5f0 con 0x7f08ac15d9e0 2023-10-16T13:40:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08abfff700 1 --2- 172.21.15.5:0/3580856539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac15d9e0 0x7f08ac15ddc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0b9880 tx=0x7f089c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654c72b266cbed9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08aaffd700 1 -- 172.21.15.5:0/3580856539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c011830 con 0x7f08ac15d9e0 2023-10-16T13:40:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08aaffd700 1 -- 172.21.15.5:0/3580856539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c011990 con 0x7f08ac15d9e0 2023-10-16T13:40:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.959+0000 7f08aaffd700 1 -- 172.21.15.5:0/3580856539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c011d20 con 0x7f08ac15d9e0 2023-10-16T13:40:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 -- 172.21.15.5:0/3580856539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac15d9e0 msgr2=0x7f08ac15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 --2- 172.21.15.5:0/3580856539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac15d9e0 0x7f08ac15ddc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0b9880 tx=0x7f089c009b20 comp rx=0 tx=0).stop 2023-10-16T13:40:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 -- 172.21.15.5:0/3580856539 shutdown_connections 2023-10-16T13:40:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 --2- 172.21.15.5:0/3580856539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac15d9e0 0x7f08ac15ddc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 --2- 172.21.15.5:0/3580856539 >> v2:172.21.15.112:3300/0 conn(0x7f08ac0d1fc0 0x7f08ac0d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 -- 172.21.15.5:0/3580856539 >> 172.21.15.5:0/3580856539 conn(0x7f08ac09cb40 msgr2=0x7f08ac0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:34.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 -- 172.21.15.5:0/3580856539 shutdown_connections 2023-10-16T13:40:34.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.960+0000 7f08b2328700 1 -- 172.21.15.5:0/3580856539 wait complete. 2023-10-16T13:40:34.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.961+0000 7f08b2328700 1 Processor -- start 2023-10-16T13:40:34.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.961+0000 7f08b2328700 1 -- start start 2023-10-16T13:40:34.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b2328700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac0d1fc0 0x7f08ac0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b2328700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08ac15d9e0 0x7f08ac159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b2328700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 0x7f08ac0ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b2328700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0ca5f0 con 0x7f08ac161800 2023-10-16T13:40:34.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b2328700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1f7400 con 0x7f08ac0d1fc0 2023-10-16T13:40:34.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b2328700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1f67f0 con 0x7f08ac15d9e0 2023-10-16T13:40:34.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 0x7f08ac0ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 0x7f08ac0ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45628/0 (socket says 172.21.15.5:45628) 2023-10-16T13:40:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 -- 172.21.15.5:0/2693008673 learned_addr learned my addr 172.21.15.5:0/2693008673 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08abfff700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac0d1fc0 0x7f08ac0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08ab7fe700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08ac15d9e0 0x7f08ac159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 -- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08ac15d9e0 msgr2=0x7f08ac159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08ac15d9e0 0x7f08ac159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 -- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac0d1fc0 msgr2=0x7f08ac0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac0d1fc0 0x7f08ac0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 -- 172.21.15.5:0/2693008673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0094a0 con 0x7f08ac161800 2023-10-16T13:40:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08ab7fe700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08ac15d9e0 0x7f08ac159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.962+0000 7f08b08c5700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 0x7f08ac0ca0b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f08a400cba0 tx=0x7f08a400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.963+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a400aad0 con 0x7f08ac161800 2023-10-16T13:40:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.963+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a400ac50 con 0x7f08ac161800 2023-10-16T13:40:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.963+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac1f6ad0 con 0x7f08ac161800 2023-10-16T13:40:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.963+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40070d0 con 0x7f08ac161800 2023-10-16T13:40:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.963+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac1f7090 con 0x7f08ac161800 2023-10-16T13:40:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.964+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac067d20 con 0x7f08ac161800 2023-10-16T13:40:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.964+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f08a4007230 con 0x7f08ac161800 2023-10-16T13:40:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.964+0000 7f08a8ff9700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f088c06af90 0x7f088c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.965+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08a4089020 con 0x7f08ac161800 2023-10-16T13:40:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.965+0000 7f08abfff700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f088c06af90 0x7f088c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.965+0000 7f08abfff700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f088c06af90 0x7f088c06d450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f089c0090b0 tx=0x7f089c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:34.969+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08a4054470 con 0x7f08ac161800 2023-10-16T13:40:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.185+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f08ac1f7540 con 0x7f08ac161800 2023-10-16T13:40:35.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.791+0000 7f08a8ff9700 1 -- 172.21.15.5:0/2693008673 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7f08a4057a90 con 0x7f08ac161800 2023-10-16T13:40:35.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f088c06af90 msgr2=0x7f088c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:35.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f088c06af90 0x7f088c06d450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f089c0090b0 tx=0x7f089c008030 comp rx=0 tx=0).stop 2023-10-16T13:40:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 msgr2=0x7f08ac0ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 0x7f08ac0ca0b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f08a400cba0 tx=0x7f08a400ceb0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 shutdown_connections 2023-10-16T13:40:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac161800 0x7f08ac0ca0b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac0d1fc0 0x7f08ac0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f088c06af90 0x7f088c06d450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 --2- 172.21.15.5:0/2693008673 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08ac15d9e0 0x7f08ac159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.795+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 >> 172.21.15.5:0/2693008673 conn(0x7f08ac09cb40 msgr2=0x7f08ac15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:35.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.796+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 shutdown_connections 2023-10-16T13:40:35.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.796+0000 7f08b2328700 1 -- 172.21.15.5:0/2693008673 wait complete. 2023-10-16T13:40:35.801 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:40:35.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:40:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.943+0000 7f8c9d6ae700 1 Processor -- start 2023-10-16T13:40:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.943+0000 7f8c9d6ae700 1 -- start start 2023-10-16T13:40:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c9d6ae700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c9815dbc0 0x7f8c9815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c9d6ae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c980d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c9d6ae700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9815e4e0 con 0x7f8c980d3fc0 2023-10-16T13:40:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c9d6ae700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980b7560 con 0x7f8c9815dbc0 2023-10-16T13:40:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c9d6ae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980b7840 con 0x7f8c980b7050 2023-10-16T13:40:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c96ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c9815dbc0 0x7f8c9815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:35.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c977fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c980d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:35.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c967fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8c980d3fc0 0x7f8c980d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46614/0 (socket says 172.21.15.5:46614) 2023-10-16T13:40:35.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.944+0000 7f8c967fc700 1 -- 172.21.15.5:0/954189322 learned_addr learned my addr 172.21.15.5:0/954189322 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:35.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c95ffb700 1 -- 172.21.15.5:0/954189322 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945038586 0 0) 0x7f8c9815e4e0 con 0x7f8c980d3fc0 2023-10-16T13:40:35.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c95ffb700 1 -- 172.21.15.5:0/954189322 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c800035b0 con 0x7f8c980d3fc0 2023-10-16T13:40:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c977fe700 1 -- 172.21.15.5:0/954189322 >> v2:172.21.15.112:3300/0 conn(0x7f8c9815dbc0 msgr2=0x7f8c9815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c977fe700 1 --2- 172.21.15.5:0/954189322 >> v2:172.21.15.112:3300/0 conn(0x7f8c9815dbc0 0x7f8c9815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c977fe700 1 -- 172.21.15.5:0/954189322 >> v1:172.21.15.112:6789/0 conn(0x7f8c980d3fc0 legacy=0x7f8c980d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c977fe700 1 -- 172.21.15.5:0/954189322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980b7b20 con 0x7f8c980b7050 2023-10-16T13:40:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c96ffd700 1 --2- 172.21.15.5:0/954189322 >> v2:172.21.15.112:3300/0 conn(0x7f8c9815dbc0 0x7f8c9815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c977fe700 1 --2- 172.21.15.5:0/954189322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c980d21d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009d90 tx=0x7f8c9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2524e3421cf5207a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c95ffb700 1 -- 172.21.15.5:0/954189322 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9000e070 con 0x7f8c980b7050 2023-10-16T13:40:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c95ffb700 1 -- 172.21.15.5:0/954189322 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9000bb20 con 0x7f8c980b7050 2023-10-16T13:40:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.945+0000 7f8c95ffb700 1 -- 172.21.15.5:0/954189322 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90012430 con 0x7f8c980b7050 2023-10-16T13:40:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/954189322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 msgr2=0x7f8c980d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/954189322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c980d21d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009d90 tx=0x7f8c9000b330 comp rx=0 tx=0).stop 2023-10-16T13:40:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/954189322 shutdown_connections 2023-10-16T13:40:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/954189322 >> v2:172.21.15.112:3300/0 conn(0x7f8c9815dbc0 0x7f8c9815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/954189322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c980d21d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/954189322 >> 172.21.15.5:0/954189322 conn(0x7f8c9809cb40 msgr2=0x7f8c980d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/954189322 shutdown_connections 2023-10-16T13:40:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.946+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/954189322 wait complete. 2023-10-16T13:40:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.947+0000 7f8c9d6ae700 1 Processor -- start 2023-10-16T13:40:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.947+0000 7f8c9d6ae700 1 -- start start 2023-10-16T13:40:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c9d6ae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c9809dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c9d6ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 0x7f8c980b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c9d6ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9815dbc0 0x7f8c980b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c9d6ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980b3d80 con 0x7f8c980d3fc0 2023-10-16T13:40:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c9d6ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9809e7c0 con 0x7f8c9815dbc0 2023-10-16T13:40:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c9d6ae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9809eaa0 con 0x7f8c980b7050 2023-10-16T13:40:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 0x7f8c980b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 0x7f8c980b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45642/0 (socket says 172.21.15.5:45642) 2023-10-16T13:40:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 -- 172.21.15.5:0/3331259042 learned_addr learned my addr 172.21.15.5:0/3331259042 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c977fe700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9815dbc0 0x7f8c980b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c96ffd700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c9809dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 -- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 msgr2=0x7f8c9809dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c9809dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 -- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9815dbc0 msgr2=0x7f8c980b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9815dbc0 0x7f8c980b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c967fc700 1 -- 172.21.15.5:0/3331259042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009430 con 0x7f8c980d3fc0 2023-10-16T13:40:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.948+0000 7f8c96ffd700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c9809dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:35.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.949+0000 7f8c967fc700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 0x7f8c980b1810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c700 tx=0x7f8c8800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:35.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.949+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88005d70 con 0x7f8c980d3fc0 2023-10-16T13:40:35.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.949+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c880070d0 con 0x7f8c980d3fc0 2023-10-16T13:40:35.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.949+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c90009a70 con 0x7f8c980d3fc0 2023-10-16T13:40:35.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.949+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88007460 con 0x7f8c980d3fc0 2023-10-16T13:40:35.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.949+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c980b39a0 con 0x7f8c980d3fc0 2023-10-16T13:40:35.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.950+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c980b3800 con 0x7f8c980d3fc0 2023-10-16T13:40:35.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.950+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f8c880075c0 con 0x7f8c980d3fc0 2023-10-16T13:40:35.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.951+0000 7f8c7f7fe700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8c8406af90 0x7f8c8406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:35.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.951+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c88088790 con 0x7f8c980d3fc0 2023-10-16T13:40:35.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.951+0000 7f8c96ffd700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8c8406af90 0x7f8c8406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:35.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.951+0000 7f8c96ffd700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8c8406af90 0x7f8c8406d450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009d00 tx=0x7f8c8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:35.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:35.955+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c980b3800 con 0x7f8c980d3fc0 2023-10-16T13:40:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.234+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8c980b3ec0 con 0x7f8c980d3fc0 2023-10-16T13:40:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.234+0000 7f8c7f7fe700 1 -- 172.21.15.5:0/3331259042 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8c980b3ec0 con 0x7f8c980d3fc0 2023-10-16T13:40:36.237 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:36.238 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:40:36.238 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:40:36.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.238 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:40:36.238 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:40:36.239 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:36.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:36.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.240 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:40:36.240 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:40:36.241 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:36.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:36.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.242 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:40:36.242 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:40:36.243 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:36.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:36.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.244 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:40:36.244 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:40:36.245 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:36.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:36.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.246 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:40:36.246 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:40:36.246 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.248 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:40:36.248 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:40:36.248 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.249 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:40:36.250 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:40:36.250 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.250 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.250 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.251 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.251 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:40:36.251 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:40:36.251 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.253 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:40:36.253 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:40:36.253 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.253 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.253 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.254 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.254 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:40:36.255 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:40:36.255 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.256 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:40:36.256 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:40:36.256 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.257 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.258 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:40:36.258 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:40:36.258 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.258 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:40:36.258 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:40:36.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.259 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:40:36.260 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:40:36.260 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.260 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.260 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:40:36.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:40:36.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.261 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:40:36.261 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:40:36.261 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.262 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.262 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:40:36.262 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:40:36.262 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:40:36.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.263 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:40:36.263 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:40:36.263 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.264 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.264 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:40:36.264 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:40:36.264 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:40:36.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.265 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:40:36.265 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:40:36.265 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.265 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:40:36.265 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:40:36.266 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:40:36.266 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:40:36.266 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.267 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:40:36.267 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:40:36.267 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.267 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:40:36.267 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:40:36.268 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:40:36.268 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.268 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.268 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:40:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:40:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:40:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:40:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:40:36.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:36.270 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:40:36.270 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:40:36.270 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:40:36.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:40:36.271 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:40:36.271 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:40:36.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:36.272 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:40:36.272 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:40:36.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.236+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8c8406af90 msgr2=0x7f8c8406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.236+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8c8406af90 0x7f8c8406d450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009d00 tx=0x7f8c8c008040 comp rx=0 tx=0).stop 2023-10-16T13:40:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.236+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 msgr2=0x7f8c980b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.236+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 0x7f8c980b1810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c700 tx=0x7f8c8800ca10 comp rx=0 tx=0).stop 2023-10-16T13:40:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 shutdown_connections 2023-10-16T13:40:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9815dbc0 0x7f8c980b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8c8406af90 0x7f8c8406d450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c980b7050 0x7f8c9809dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 --2- 172.21.15.5:0/3331259042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c980d3fc0 0x7f8c980b1810 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 >> 172.21.15.5:0/3331259042 conn(0x7f8c9809cb40 msgr2=0x7f8c9815ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 shutdown_connections 2023-10-16T13:40:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.237+0000 7f8c9d6ae700 1 -- 172.21.15.5:0/3331259042 wait complete. 2023-10-16T13:40:36.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.399+0000 7f0d5dcb7700 1 Processor -- start 2023-10-16T13:40:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.399+0000 7f0d5dcb7700 1 -- start start 2023-10-16T13:40:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d5dcb7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0d5815f050 0x7f0d580cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d5dcb7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d580b0580 0x7f0d580ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d5dcb7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d580b0a80 con 0x7f0d580ce620 2023-10-16T13:40:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d5dcb7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d580cea50 con 0x7f0d580b0580 2023-10-16T13:40:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d5dcb7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d580ccee0 con 0x7f0d5815f050 2023-10-16T13:40:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d580b0580 0x7f0d580ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d580b0580 0x7f0d580ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45650/0 (socket says 172.21.15.5:45650) 2023-10-16T13:40:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3766738852 learned_addr learned my addr 172.21.15.5:0/3766738852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d577fe700 1 --2- 172.21.15.5:0/3766738852 >> v2:172.21.15.112:3300/0 conn(0x7f0d5815f050 0x7f0d580cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3766738852 >> v2:172.21.15.112:3300/0 conn(0x7f0d5815f050 msgr2=0x7f0d580cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 --2- 172.21.15.5:0/3766738852 >> v2:172.21.15.112:3300/0 conn(0x7f0d5815f050 0x7f0d580cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3766738852 >> v1:172.21.15.112:6789/0 conn(0x7f0d580ce620 legacy=0x7f0d580cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3766738852 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d580cd1c0 con 0x7f0d580b0580 2023-10-16T13:40:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.400+0000 7f0d56ffd700 1 --2- 172.21.15.5:0/3766738852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580b0580 0x7f0d580ce0e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806b820 tx=0x7f0d48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a01f9dde7712d47 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d567fc700 1 -- 172.21.15.5:0/3766738852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48004230 con 0x7f0d580b0580 2023-10-16T13:40:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d567fc700 1 -- 172.21.15.5:0/3766738852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48004390 con 0x7f0d580b0580 2023-10-16T13:40:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d567fc700 1 -- 172.21.15.5:0/3766738852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480036a0 con 0x7f0d580b0580 2023-10-16T13:40:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3766738852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580b0580 msgr2=0x7f0d580ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3766738852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580b0580 0x7f0d580ce0e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806b820 tx=0x7f0d48009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3766738852 shutdown_connections 2023-10-16T13:40:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3766738852 >> v2:172.21.15.112:3300/0 conn(0x7f0d5815f050 0x7f0d580cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3766738852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580b0580 0x7f0d580ce0e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3766738852 >> 172.21.15.5:0/3766738852 conn(0x7f0d580d1620 msgr2=0x7f0d580d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3766738852 shutdown_connections 2023-10-16T13:40:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.401+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3766738852 wait complete. 2023-10-16T13:40:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.402+0000 7f0d5dcb7700 1 Processor -- start 2023-10-16T13:40:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 -- start start 2023-10-16T13:40:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d580b0580 0x7f0d581f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 0x7f0d5815c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d5815f050 0x7f0d580ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581f3b20 con 0x7f0d580ce620 2023-10-16T13:40:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581f3210 con 0x7f0d580b0580 2023-10-16T13:40:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.403+0000 7f0d5dcb7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580cb580 con 0x7f0d5815f050 2023-10-16T13:40:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 0x7f0d5815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 0x7f0d5815c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45656/0 (socket says 172.21.15.5:45656) 2023-10-16T13:40:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3485781743 learned_addr learned my addr 172.21.15.5:0/3485781743 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d577fe700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d580b0580 0x7f0d581f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d57fff700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d5815f050 0x7f0d580ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d5815f050 msgr2=0x7f0d580ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d5815f050 0x7f0d580ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d580b0580 msgr2=0x7f0d581f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d580b0580 0x7f0d581f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 -- 172.21.15.5:0/3485781743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009550 con 0x7f0d580ce620 2023-10-16T13:40:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d577fe700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d580b0580 0x7f0d581f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d56ffd700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 0x7f0d5815c680 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009130 tx=0x7f0d48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48003d40 con 0x7f0d580ce620 2023-10-16T13:40:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4801f070 con 0x7f0d580ce620 2023-10-16T13:40:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d581f34d0 con 0x7f0d580ce620 2023-10-16T13:40:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011870 con 0x7f0d580ce620 2023-10-16T13:40:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.404+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5815cbc0 con 0x7f0d580ce620 2023-10-16T13:40:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.405+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5815cd50 con 0x7f0d580ce620 2023-10-16T13:40:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.406+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f0d48021030 con 0x7f0d580ce620 2023-10-16T13:40:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.406+0000 7f0d4ffff700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d3806af90 0x7f0d3806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.406+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d4808a790 con 0x7f0d580ce620 2023-10-16T13:40:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.406+0000 7f0d577fe700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d3806af90 0x7f0d3806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.407+0000 7f0d577fe700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d3806af90 0x7f0d3806d450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d40007a50 tx=0x7f0d40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:36.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.411+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d48055c30 con 0x7f0d580ce620 2023-10-16T13:40:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.613+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d58067d20 con 0x7f0d580ce620 2023-10-16T13:40:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.614+0000 7f0d4ffff700 1 -- 172.21.15.5:0/3485781743 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+12785 (secure 0 0 0) 0x7f0d48059250 con 0x7f0d580ce620 2023-10-16T13:40:36.617 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:36.617 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":58,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:35.799595+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d3806af90 msgr2=0x7f0d3806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d3806af90 0x7f0d3806d450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d40007a50 tx=0x7f0d40008040 comp rx=0 tx=0).stop 2023-10-16T13:40:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 msgr2=0x7f0d5815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 0x7f0d5815c680 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009130 tx=0x7f0d48004750 comp rx=0 tx=0).stop 2023-10-16T13:40:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 shutdown_connections 2023-10-16T13:40:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d3806af90 0x7f0d3806d450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d5815f050 0x7f0d580ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d580b0580 0x7f0d581f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 --2- 172.21.15.5:0/3485781743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d580ce620 0x7f0d5815c680 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 >> 172.21.15.5:0/3485781743 conn(0x7f0d580d1620 msgr2=0x7f0d580739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 shutdown_connections 2023-10-16T13:40:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.616+0000 7f0d5dcb7700 1 -- 172.21.15.5:0/3485781743 wait complete. 2023-10-16T13:40:36.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:40:36.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:40:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.758+0000 7f52773ce700 1 Processor -- start 2023-10-16T13:40:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f52773ce700 1 -- start start 2023-10-16T13:40:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f52773ce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f527006af50 0x7f52700cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f52773ce700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700b2d60 con 0x7f527015e2f0 2023-10-16T13:40:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f52773ce700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700cdd30 con 0x7f52700cd950 2023-10-16T13:40:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f52773ce700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52701619a0 con 0x7f527006af50 2023-10-16T13:40:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f527596b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f527006af50 0x7f52700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f5274969700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f527015e2f0 0x7f527006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55668/0 (socket says 172.21.15.5:55668) 2023-10-16T13:40:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.759+0000 7f5274969700 1 -- 172.21.15.5:0/219497202 learned_addr learned my addr 172.21.15.5:0/219497202 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f527596b700 1 -- 172.21.15.5:0/219497202 >> v1:172.21.15.112:6789/0 conn(0x7f52700cd950 legacy=0x7f527015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f527596b700 1 -- 172.21.15.5:0/219497202 >> v1:172.21.15.5:6789/0 conn(0x7f527015e2f0 legacy=0x7f527006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f527596b700 1 -- 172.21.15.5:0/219497202 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527015e920 con 0x7f527006af50 2023-10-16T13:40:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f527596b700 1 --2- 172.21.15.5:0/219497202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f52700cede0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5268009d90 tx=0x7f526800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5c9d54c349bf54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:36.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f5267fff700 1 -- 172.21.15.5:0/219497202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800e070 con 0x7f527006af50 2023-10-16T13:40:36.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f5267fff700 1 -- 172.21.15.5:0/219497202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526800bad0 con 0x7f527006af50 2023-10-16T13:40:36.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.760+0000 7f5267fff700 1 -- 172.21.15.5:0/219497202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800be80 con 0x7f527006af50 2023-10-16T13:40:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 -- 172.21.15.5:0/219497202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 msgr2=0x7f52700cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 --2- 172.21.15.5:0/219497202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f52700cede0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5268009d90 tx=0x7f526800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 -- 172.21.15.5:0/219497202 shutdown_connections 2023-10-16T13:40:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 --2- 172.21.15.5:0/219497202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f52700cede0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 -- 172.21.15.5:0/219497202 >> 172.21.15.5:0/219497202 conn(0x7f527006dae0 msgr2=0x7f527006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 -- 172.21.15.5:0/219497202 shutdown_connections 2023-10-16T13:40:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.761+0000 7f52773ce700 1 -- 172.21.15.5:0/219497202 wait complete. 2023-10-16T13:40:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.762+0000 7f52773ce700 1 Processor -- start 2023-10-16T13:40:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.762+0000 7f52773ce700 1 -- start start 2023-10-16T13:40:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f52773ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f5270153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f52773ce700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52700cd950 0x7f52700b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f52773ce700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f527015e2f0 0x7f52700c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f52773ce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700b4780 con 0x7f527006af50 2023-10-16T13:40:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f52773ce700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700c53f0 con 0x7f52700cd950 2023-10-16T13:40:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f52773ce700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5270153dc0 con 0x7f527015e2f0 2023-10-16T13:40:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f5270153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f5270153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45668/0 (socket says 172.21.15.5:45668) 2023-10-16T13:40:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 -- 172.21.15.5:0/2706026289 learned_addr learned my addr 172.21.15.5:0/2706026289 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f5274969700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52700cd950 0x7f52700b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527596b700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f527015e2f0 0x7f52700c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 -- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f527015e2f0 msgr2=0x7f52700c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f527015e2f0 0x7f52700c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 -- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52700cd950 msgr2=0x7f52700b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52700cd950 0x7f52700b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 -- 172.21.15.5:0/2706026289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268009a70 con 0x7f527006af50 2023-10-16T13:40:36.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.763+0000 7f527516a700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f5270153880 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f526000c4d0 tx=0x7f526000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:36.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.764+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260011790 con 0x7f527006af50 2023-10-16T13:40:36.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.764+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600118f0 con 0x7f527006af50 2023-10-16T13:40:36.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.764+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52700b3ee0 con 0x7f527006af50 2023-10-16T13:40:36.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.764+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260011ca0 con 0x7f527006af50 2023-10-16T13:40:36.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.764+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700b44a0 con 0x7f527006af50 2023-10-16T13:40:36.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.765+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5270074460 con 0x7f527006af50 2023-10-16T13:40:36.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.765+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f526001c460 con 0x7f527006af50 2023-10-16T13:40:36.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.766+0000 7f5265ffb700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f525406af90 0x7f525406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:36.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.766+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5260089050 con 0x7f527006af50 2023-10-16T13:40:36.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.766+0000 7f5274969700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f525406af90 0x7f525406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.766+0000 7f5274969700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f525406af90 0x7f525406d450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f527015dcd0 tx=0x7f526c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.770+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5270074460 con 0x7f527006af50 2023-10-16T13:40:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.973+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5270074460 con 0x7f527006af50 2023-10-16T13:40:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.973+0000 7f5265ffb700 1 -- 172.21.15.5:0/2706026289 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5270074460 con 0x7f527006af50 2023-10-16T13:40:36.976 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:40:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f525406af90 msgr2=0x7f525406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f525406af90 0x7f525406d450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f527015dcd0 tx=0x7f526c009040 comp rx=0 tx=0).stop 2023-10-16T13:40:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 msgr2=0x7f5270153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f5270153880 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f526000c4d0 tx=0x7f526000c7e0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 shutdown_connections 2023-10-16T13:40:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f525406af90 0x7f525406d450 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f527015e2f0 0x7f52700c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527006af50 0x7f5270153880 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 --2- 172.21.15.5:0/2706026289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52700cd950 0x7f52700b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 >> 172.21.15.5:0/2706026289 conn(0x7f527006dae0 msgr2=0x7f52701607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 shutdown_connections 2023-10-16T13:40:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:36.976+0000 7f52773ce700 1 -- 172.21.15.5:0/2706026289 wait complete. 2023-10-16T13:40:36.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:40:37.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.113+0000 7f2ca5106700 1 Processor -- start 2023-10-16T13:40:37.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.113+0000 7f2ca5106700 1 -- start start 2023-10-16T13:40:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2ca5106700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca015ab10 0x7f2ca015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2ca5106700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ca00b1f50 0x7f2ca00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2ca5106700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca015e7a0 con 0x7f2ca00b23d0 2023-10-16T13:40:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2ca5106700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca015f730 con 0x7f2ca00b1f50 2023-10-16T13:40:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2ca5106700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00b29a0 con 0x7f2ca015ab10 2023-10-16T13:40:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ca00b1f50 0x7f2ca00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ca00b1f50 0x7f2ca00cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45680/0 (socket says 172.21.15.5:45680) 2023-10-16T13:40:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9f59e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ca00b23d0 0x7f2ca00cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55686/0 (socket says 172.21.15.5:55686) 2023-10-16T13:40:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 -- 172.21.15.5:0/136123812 learned_addr learned my addr 172.21.15.5:0/136123812 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9ed9d700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca015ab10 0x7f2ca015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 -- 172.21.15.5:0/136123812 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca015ab10 msgr2=0x7f2ca015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca015ab10 0x7f2ca015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 -- 172.21.15.5:0/136123812 >> v1:172.21.15.5:6789/0 conn(0x7f2ca00b23d0 legacy=0x7f2ca00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 -- 172.21.15.5:0/136123812 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00b2c80 con 0x7f2ca00b1f50 2023-10-16T13:40:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9dd9b700 1 -- 172.21.15.5:0/136123812 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123916794 0 0) 0x7f2ca015e7a0 con 0x7f2ca00b23d0 2023-10-16T13:40:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9ed9d700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca015ab10 0x7f2ca015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.114+0000 7f2c9e59c700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b1f50 0x7f2ca00cf720 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2c90006fd0 tx=0x7f2c90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940c5afb1e2320f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2c9dd9b700 1 -- 172.21.15.5:0/136123812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90005e30 con 0x7f2ca00b1f50 2023-10-16T13:40:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2c9dd9b700 1 -- 172.21.15.5:0/136123812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90004030 con 0x7f2ca00b1f50 2023-10-16T13:40:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2c9dd9b700 1 -- 172.21.15.5:0/136123812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900043e0 con 0x7f2ca00b1f50 2023-10-16T13:40:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 -- 172.21.15.5:0/136123812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b1f50 msgr2=0x7f2ca00cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b1f50 0x7f2ca00cf720 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2c90006fd0 tx=0x7f2c90009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 -- 172.21.15.5:0/136123812 shutdown_connections 2023-10-16T13:40:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca015ab10 0x7f2ca015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 --2- 172.21.15.5:0/136123812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b1f50 0x7f2ca00cf720 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 -- 172.21.15.5:0/136123812 >> 172.21.15.5:0/136123812 conn(0x7f2ca006dae0 msgr2=0x7f2ca006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 -- 172.21.15.5:0/136123812 shutdown_connections 2023-10-16T13:40:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.115+0000 7f2ca5106700 1 -- 172.21.15.5:0/136123812 wait complete. 2023-10-16T13:40:37.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 Processor -- start 2023-10-16T13:40:37.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 -- start start 2023-10-16T13:40:37.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca00b1f50 0x7f2ca0147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 0x7f2ca0151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ca015ab10 0x7f2ca0151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00b5ec0 con 0x7f2ca00b23d0 2023-10-16T13:40:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0147f50 con 0x7f2ca015ab10 2023-10-16T13:40:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.117+0000 7f2ca5106700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01523b0 con 0x7f2ca00b1f50 2023-10-16T13:40:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 0x7f2ca0151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 0x7f2ca0151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45688/0 (socket says 172.21.15.5:45688) 2023-10-16T13:40:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 -- 172.21.15.5:0/2772496316 learned_addr learned my addr 172.21.15.5:0/2772496316 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9ed9d700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca00b1f50 0x7f2ca0147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9f59e700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ca015ab10 0x7f2ca0151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 -- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca00b1f50 msgr2=0x7f2ca0147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca00b1f50 0x7f2ca0147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 -- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ca015ab10 msgr2=0x7f2ca0151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ca015ab10 0x7f2ca0151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 -- 172.21.15.5:0/2772496316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90009500 con 0x7f2ca00b23d0 2023-10-16T13:40:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c9e59c700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 0x7f2ca0151680 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009130 tx=0x7f2c90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900045c0 con 0x7f2ca00b23d0 2023-10-16T13:40:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9001d430 con 0x7f2ca00b23d0 2023-10-16T13:40:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9001d7e0 con 0x7f2ca00b23d0 2023-10-16T13:40:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.118+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca0152690 con 0x7f2ca00b23d0 2023-10-16T13:40:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.119+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca0152c50 con 0x7f2ca00b23d0 2023-10-16T13:40:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.119+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0152de0 con 0x7f2ca00b23d0 2023-10-16T13:40:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.120+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f2c9001d940 con 0x7f2ca00b23d0 2023-10-16T13:40:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.120+0000 7f2c877fe700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c8c06af90 0x7f2c8c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.120+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c9008a870 con 0x7f2ca00b23d0 2023-10-16T13:40:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.121+0000 7f2c9ed9d700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c8c06af90 0x7f2c8c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.121+0000 7f2c9ed9d700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c8c06af90 0x7f2c8c06d450 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c94006fd0 tx=0x7f2c94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.125+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c90055c80 con 0x7f2ca00b23d0 2023-10-16T13:40:37.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.329+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ca0067d20 con 0x7f2ca00b23d0 2023-10-16T13:40:37.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.329+0000 7f2c877fe700 1 -- 172.21.15.5:0/2772496316 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2c90016060 con 0x7f2ca00b23d0 2023-10-16T13:40:37.332 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:37.332 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:40:37.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:37.333 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:40:37.333 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:40:37.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:37.333 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:40:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c8c06af90 msgr2=0x7f2c8c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c8c06af90 0x7f2c8c06d450 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c94006fd0 tx=0x7f2c94008040 comp rx=0 tx=0).stop 2023-10-16T13:40:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 msgr2=0x7f2ca0151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 0x7f2ca0151680 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009130 tx=0x7f2c90004750 comp rx=0 tx=0).stop 2023-10-16T13:40:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 shutdown_connections 2023-10-16T13:40:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ca015ab10 0x7f2ca0151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c8c06af90 0x7f2c8c06d450 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ca00b1f50 0x7f2ca0147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 --2- 172.21.15.5:0/2772496316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca00b23d0 0x7f2ca0151680 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 >> 172.21.15.5:0/2772496316 conn(0x7f2ca006dae0 msgr2=0x7f2ca00b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 shutdown_connections 2023-10-16T13:40:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.331+0000 7f2ca5106700 1 -- 172.21.15.5:0/2772496316 wait complete. 2023-10-16T13:40:37.346 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:40:37.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:40:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.473+0000 7f117e5ef700 1 Processor -- start 2023-10-16T13:40:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.473+0000 7f117e5ef700 1 -- start start 2023-10-16T13:40:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117e5ef700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f11780cdf40 0x7f11780d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117e5ef700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11780cf430 0x7f11780ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117e5ef700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11780d05e0 con 0x7f11780cc320 2023-10-16T13:40:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117e5ef700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11780ce860 con 0x7f11780cf430 2023-10-16T13:40:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117e5ef700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11780b08d0 con 0x7f11780cdf40 2023-10-16T13:40:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f11777fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11780cf430 0x7f11780ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117cb8c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f11780cc320 0x7f11780cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55696/0 (socket says 172.21.15.5:55696) 2023-10-16T13:40:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f117cb8c700 1 -- 172.21.15.5:0/3777531721 learned_addr learned my addr 172.21.15.5:0/3777531721 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f1177fff700 1 --2- 172.21.15.5:0/3777531721 >> v2:172.21.15.112:3300/0 conn(0x7f11780cdf40 0x7f11780d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f11777fe700 1 -- 172.21.15.5:0/3777531721 >> v2:172.21.15.112:3300/0 conn(0x7f11780cdf40 msgr2=0x7f11780d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f11777fe700 1 --2- 172.21.15.5:0/3777531721 >> v2:172.21.15.112:3300/0 conn(0x7f11780cdf40 0x7f11780d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f11777fe700 1 -- 172.21.15.5:0/3777531721 >> v1:172.21.15.5:6789/0 conn(0x7f11780cc320 legacy=0x7f11780cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f1176ffd700 1 -- 172.21.15.5:0/3777531721 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155032310 0 0) 0x7f11780d05e0 con 0x7f11780cc320 2023-10-16T13:40:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f11777fe700 1 -- 172.21.15.5:0/3777531721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780cfcb0 con 0x7f11780cf430 2023-10-16T13:40:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.474+0000 7f11777fe700 1 --2- 172.21.15.5:0/3777531721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f11780ce320 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f11780b40f0 tx=0x7f1160009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28472ee691942ebe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f1176ffd700 1 -- 172.21.15.5:0/3777531721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160011830 con 0x7f11780cf430 2023-10-16T13:40:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f1176ffd700 1 -- 172.21.15.5:0/3777531721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160011990 con 0x7f11780cf430 2023-10-16T13:40:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f1176ffd700 1 -- 172.21.15.5:0/3777531721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160011d20 con 0x7f11780cf430 2023-10-16T13:40:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 -- 172.21.15.5:0/3777531721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 msgr2=0x7f11780ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 --2- 172.21.15.5:0/3777531721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f11780ce320 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f11780b40f0 tx=0x7f1160009b20 comp rx=0 tx=0).stop 2023-10-16T13:40:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 -- 172.21.15.5:0/3777531721 shutdown_connections 2023-10-16T13:40:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 --2- 172.21.15.5:0/3777531721 >> v2:172.21.15.112:3300/0 conn(0x7f11780cdf40 0x7f11780d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 --2- 172.21.15.5:0/3777531721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f11780ce320 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 -- 172.21.15.5:0/3777531721 >> 172.21.15.5:0/3777531721 conn(0x7f11780d1530 msgr2=0x7f11780d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 -- 172.21.15.5:0/3777531721 shutdown_connections 2023-10-16T13:40:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.475+0000 7f117e5ef700 1 -- 172.21.15.5:0/3777531721 wait complete. 2023-10-16T13:40:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.476+0000 7f117e5ef700 1 Processor -- start 2023-10-16T13:40:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 -- start start 2023-10-16T13:40:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11780cc320 0x7f1178158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11780cdf40 0x7f11780cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f117806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11780b0c30 con 0x7f11780cf430 2023-10-16T13:40:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11780b2a20 con 0x7f11780cdf40 2023-10-16T13:40:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.477+0000 7f117e5ef700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11780c9360 con 0x7f11780cc320 2023-10-16T13:40:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f117806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f117806fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45700/0 (socket says 172.21.15.5:45700) 2023-10-16T13:40:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 -- 172.21.15.5:0/1748231081 learned_addr learned my addr 172.21.15.5:0/1748231081 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f11777fe700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11780cdf40 0x7f11780cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f1177fff700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11780cc320 0x7f1178158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 -- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11780cc320 msgr2=0x7f1178158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11780cc320 0x7f1178158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 -- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11780cdf40 msgr2=0x7f11780cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11780cdf40 0x7f11780cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 -- 172.21.15.5:0/1748231081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600094a0 con 0x7f11780cf430 2023-10-16T13:40:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f1177fff700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11780cc320 0x7f1178158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117cb8c700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f117806fd20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f117000cb90 tx=0x7f117000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000ab70 con 0x7f11780cf430 2023-10-16T13:40:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000acf0 con 0x7f11780cf430 2023-10-16T13:40:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11780b3560 con 0x7f11780cf430 2023-10-16T13:40:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170007310 con 0x7f11780cf430 2023-10-16T13:40:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.478+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11780b2fa0 con 0x7f11780cf430 2023-10-16T13:40:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.479+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1178067d20 con 0x7f11780cf430 2023-10-16T13:40:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.480+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f1170007470 con 0x7f11780cf430 2023-10-16T13:40:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.480+0000 7f1174ff9700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f115806af90 0x7f115806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.480+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1170089070 con 0x7f11780cf430 2023-10-16T13:40:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.480+0000 7f1177fff700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f115806af90 0x7f115806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.481+0000 7f1177fff700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f115806af90 0x7f115806d450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1168009b40 tx=0x7f1168008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.485+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1170054510 con 0x7f11780cf430 2023-10-16T13:40:37.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.686+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f11780cb960 con 0x7f11780cf430 2023-10-16T13:40:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.794+0000 7f1174ff9700 1 -- 172.21.15.5:0/1748231081 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f11700180b0 con 0x7f11780cf430 2023-10-16T13:40:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f115806af90 msgr2=0x7f115806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f115806af90 0x7f115806d450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1168009b40 tx=0x7f1168008040 comp rx=0 tx=0).stop 2023-10-16T13:40:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 msgr2=0x7f117806fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f117806fd20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f117000cb90 tx=0x7f117000cf50 comp rx=0 tx=0).stop 2023-10-16T13:40:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 shutdown_connections 2023-10-16T13:40:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11780cf430 0x7f117806fd20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f115806af90 0x7f115806d450 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11780cc320 0x7f1178158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 --2- 172.21.15.5:0/1748231081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11780cdf40 0x7f11780cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 >> 172.21.15.5:0/1748231081 conn(0x7f11780d1530 msgr2=0x7f11780c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 shutdown_connections 2023-10-16T13:40:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.797+0000 7f117e5ef700 1 -- 172.21.15.5:0/1748231081 wait complete. 2023-10-16T13:40:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:40:37.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:40:37.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.945+0000 7f5b69f7f700 1 Processor -- start 2023-10-16T13:40:37.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.945+0000 7f5b69f7f700 1 -- start start 2023-10-16T13:40:37.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b69f7f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 0x7f5b640b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b69f7f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b6415e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b69f7f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640b6400 con 0x7f5b6415e860 2023-10-16T13:40:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b69f7f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640b1fc0 con 0x7f5b6415a730 2023-10-16T13:40:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b69f7f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640ce450 con 0x7f5b640cecf0 2023-10-16T13:40:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b6415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b637fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 0x7f5b640b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b6415e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43610/0 (socket says 172.21.15.5:43610) 2023-10-16T13:40:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b63fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5b6415e860 0x7f5b640cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46688/0 (socket says 172.21.15.5:46688) 2023-10-16T13:40:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b637fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 0x7f5b640b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41600/0 (socket says 172.21.15.5:41600) 2023-10-16T13:40:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 -- 172.21.15.5:0/4116012514 learned_addr learned my addr 172.21.15.5:0/4116012514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 -- 172.21.15.5:0/4116012514 >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 msgr2=0x7f5b640b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 --2- 172.21.15.5:0/4116012514 >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 0x7f5b640b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 -- 172.21.15.5:0/4116012514 >> v1:172.21.15.112:6789/0 conn(0x7f5b6415e860 legacy=0x7f5b640cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b62ffd700 1 -- 172.21.15.5:0/4116012514 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640ce730 con 0x7f5b640cecf0 2023-10-16T13:40:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b627fc700 1 -- 172.21.15.5:0/4116012514 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994270182 0 0) 0x7f5b640b6400 con 0x7f5b6415e860 2023-10-16T13:40:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.946+0000 7f5b637fe700 1 --2- 172.21.15.5:0/4116012514 >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 0x7f5b640b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b62ffd700 1 --2- 172.21.15.5:0/4116012514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b6415e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b540098f0 tx=0x7f5b54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487312c653e01025 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b627fc700 1 -- 172.21.15.5:0/4116012514 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011830 con 0x7f5b640cecf0 2023-10-16T13:40:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b627fc700 1 -- 172.21.15.5:0/4116012514 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b54011990 con 0x7f5b640cecf0 2023-10-16T13:40:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b627fc700 1 -- 172.21.15.5:0/4116012514 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011d20 con 0x7f5b640cecf0 2023-10-16T13:40:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 -- 172.21.15.5:0/4116012514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 msgr2=0x7f5b6415e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/4116012514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b6415e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b540098f0 tx=0x7f5b54009c00 comp rx=0 tx=0).stop 2023-10-16T13:40:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 -- 172.21.15.5:0/4116012514 shutdown_connections 2023-10-16T13:40:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/4116012514 >> v2:172.21.15.112:3300/0 conn(0x7f5b6415a730 0x7f5b640b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/4116012514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b6415e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 -- 172.21.15.5:0/4116012514 >> 172.21.15.5:0/4116012514 conn(0x7f5b6406dac0 msgr2=0x7f5b6406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 -- 172.21.15.5:0/4116012514 shutdown_connections 2023-10-16T13:40:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.947+0000 7f5b69f7f700 1 -- 172.21.15.5:0/4116012514 wait complete. 2023-10-16T13:40:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.948+0000 7f5b69f7f700 1 Processor -- start 2023-10-16T13:40:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 -- start start 2023-10-16T13:40:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b641e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 0x7f5b6414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b640c8eb0 0x7f5b640c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640c8a90 con 0x7f5b6415a730 2023-10-16T13:40:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b641e63f0 con 0x7f5b640c8eb0 2023-10-16T13:40:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.949+0000 7f5b69f7f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640c8130 con 0x7f5b640cecf0 2023-10-16T13:40:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 0x7f5b6414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 0x7f5b6414e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45714/0 (socket says 172.21.15.5:45714) 2023-10-16T13:40:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 -- 172.21.15.5:0/3243820137 learned_addr learned my addr 172.21.15.5:0/3243820137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b63fff700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b640c8eb0 0x7f5b640c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b637fe700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b641e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 -- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 msgr2=0x7f5b641e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b641e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 -- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b640c8eb0 msgr2=0x7f5b640c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b640c8eb0 0x7f5b640c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 -- 172.21.15.5:0/3243820137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580094a0 con 0x7f5b6415a730 2023-10-16T13:40:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b62ffd700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 0x7f5b6414e4c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009c40 tx=0x7f5b54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54004300 con 0x7f5b6415a730 2023-10-16T13:40:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5401f070 con 0x7f5b6415a730 2023-10-16T13:40:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b54009550 con 0x7f5b6415a730 2023-10-16T13:40:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540036a0 con 0x7f5b6415a730 2023-10-16T13:40:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.950+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6415ac90 con 0x7f5b6415a730 2023-10-16T13:40:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.951+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b640c8bd0 con 0x7f5b6415a730 2023-10-16T13:40:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.952+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f5b54021030 con 0x7f5b6415a730 2023-10-16T13:40:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.952+0000 7f5b4bfff700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5006af90 0x7f5b5006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.952+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5b5408a880 con 0x7f5b6415a730 2023-10-16T13:40:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.953+0000 7f5b637fe700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5006af90 0x7f5b5006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.953+0000 7f5b637fe700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5006af90 0x7f5b5006d450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009d70 tx=0x7f5b58009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:37.957+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b640c8bd0 con 0x7f5b6415a730 2023-10-16T13:40:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.159+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5b640c8bd0 con 0x7f5b6415a730 2023-10-16T13:40:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.800+0000 7f5b4bfff700 1 -- 172.21.15.5:0/3243820137 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5b640c8bd0 con 0x7f5b6415a730 2023-10-16T13:40:38.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.804+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5006af90 msgr2=0x7f5b5006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.804+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5006af90 0x7f5b5006d450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009d70 tx=0x7f5b58009210 comp rx=0 tx=0).stop 2023-10-16T13:40:38.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.804+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 msgr2=0x7f5b6414e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.804+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 0x7f5b6414e4c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009c40 tx=0x7f5b54004750 comp rx=0 tx=0).stop 2023-10-16T13:40:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.805+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 shutdown_connections 2023-10-16T13:40:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.805+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b640c8eb0 0x7f5b640c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.805+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b5006af90 0x7f5b5006d450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.805+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b640cecf0 0x7f5b641e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.805+0000 7f5b69f7f700 1 --2- 172.21.15.5:0/3243820137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b6415a730 0x7f5b6414e4c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.805+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 >> 172.21.15.5:0/3243820137 conn(0x7f5b6406dac0 msgr2=0x7f5b64159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:38.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.808+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 shutdown_connections 2023-10-16T13:40:38.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.809+0000 7f5b69f7f700 1 -- 172.21.15.5:0/3243820137 wait complete. 2023-10-16T13:40:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:40:38.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:40:38.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.968+0000 7f1c9b362700 1 Processor -- start 2023-10-16T13:40:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.968+0000 7f1c9b362700 1 -- start start 2023-10-16T13:40:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c9b362700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c940cfe30 0x7f1c940cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c9b362700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9415e7a0 con 0x7f1c9415ab10 2023-10-16T13:40:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c9b362700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940b29a0 con 0x7f1c9415f1f0 2023-10-16T13:40:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c9b362700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c940b2c80 con 0x7f1c940cfe30 2023-10-16T13:40:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c990fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c9415ab10 0x7f1c940b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55722/0 (socket says 172.21.15.5:55722) 2023-10-16T13:40:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c990fe700 1 -- 172.21.15.5:0/1279812290 learned_addr learned my addr 172.21.15.5:0/1279812290 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234861803 0 0) 0x7f1c9415e7a0 con 0x7f1c9415ab10 2023-10-16T13:40:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c998ff700 1 --2- 172.21.15.5:0/1279812290 >> v2:172.21.15.112:3300/0 conn(0x7f1c940cfe30 0x7f1c940cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.969+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c800035b0 con 0x7f1c9415ab10 2023-10-16T13:40:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427707551 0 0) 0x7f1c800035b0 con 0x7f1c9415ab10 2023-10-16T13:40:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 >> v2:172.21.15.112:3300/0 conn(0x7f1c940cfe30 msgr2=0x7f1c940cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 --2- 172.21.15.5:0/1279812290 >> v2:172.21.15.112:3300/0 conn(0x7f1c940cfe30 0x7f1c940cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 >> v1:172.21.15.112:6789/0 conn(0x7f1c9415f1f0 legacy=0x7f1c940cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9415e9f0 con 0x7f1c9415ab10 2023-10-16T13:40:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f1c84001670 con 0x7f1c9415ab10 2023-10-16T13:40:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 >> v1:172.21.15.5:6789/0 conn(0x7f1c9415ab10 legacy=0x7f1c940b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c80003a00 0x7f1c80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80004850 0x7f1c80004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c80005210 0x7f1c8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940b2c80 con 0x7f1c80005210 2023-10-16T13:40:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8000c0b0 con 0x7f1c80003a00 2023-10-16T13:40:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8000c270 con 0x7f1c80004850 2023-10-16T13:40:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c80005210 0x7f1c8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c990fe700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c80003a00 0x7f1c80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c988fd700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80004850 0x7f1c80004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 -- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80004850 msgr2=0x7f1c80004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80004850 0x7f1c80004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 -- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c80003a00 msgr2=0x7f1c80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c80003a00 0x7f1c80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 -- 172.21.15.5:0/1279812290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800035b0 con 0x7f1c80005210 2023-10-16T13:40:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c990fe700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c80003a00 0x7f1c80003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 -- 172.21.15.5:0/1279812290 reap_dead start 2023-10-16T13:40:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c998ff700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c80005210 0x7f1c8000ba10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009f90 tx=0x7f1c80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40e0729b9bc9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00ec30 con 0x7f1c80005210 2023-10-16T13:40:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.970+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00f040 con 0x7f1c80005210 2023-10-16T13:40:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c8bfff700 1 -- 172.21.15.5:0/1279812290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c014480 con 0x7f1c80005210 2023-10-16T13:40:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 -- 172.21.15.5:0/1279812290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c80005210 msgr2=0x7f1c8000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c80005210 0x7f1c8000ba10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009f90 tx=0x7f1c80005880 comp rx=0 tx=0).stop 2023-10-16T13:40:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 -- 172.21.15.5:0/1279812290 shutdown_connections 2023-10-16T13:40:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 --2- 172.21.15.5:0/1279812290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c80005210 0x7f1c8000ba10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 -- 172.21.15.5:0/1279812290 >> 172.21.15.5:0/1279812290 conn(0x7f1c9406dae0 msgr2=0x7f1c9406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 -- 172.21.15.5:0/1279812290 shutdown_connections 2023-10-16T13:40:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.971+0000 7f1c9b362700 1 -- 172.21.15.5:0/1279812290 wait complete. 2023-10-16T13:40:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.972+0000 7f1c9b362700 1 Processor -- start 2023-10-16T13:40:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.972+0000 7f1c9b362700 1 -- start start 2023-10-16T13:40:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c9b362700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80005210 0x7f1c94153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c9b362700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c9415aef0 0x7f1c940cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c9b362700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 0x7f1c940cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c9b362700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940c8a80 con 0x7f1c9415b370 2023-10-16T13:40:38.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c9b362700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9415b940 con 0x7f1c9415aef0 2023-10-16T13:40:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c9b362700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9415bc20 con 0x7f1c80005210 2023-10-16T13:40:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c998ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 0x7f1c940cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c998ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 0x7f1c940cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45734/0 (socket says 172.21.15.5:45734) 2023-10-16T13:40:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c998ff700 1 -- 172.21.15.5:0/3103921434 learned_addr learned my addr 172.21.15.5:0/3103921434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c990fe700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80005210 0x7f1c94153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.973+0000 7f1c988fd700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c9415aef0 0x7f1c940cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c998ff700 1 -- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80005210 msgr2=0x7f1c94153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c998ff700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80005210 0x7f1c94153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c998ff700 1 -- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c9415aef0 msgr2=0x7f1c940cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c998ff700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c9415aef0 0x7f1c940cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c998ff700 1 -- 172.21.15.5:0/3103921434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9415bf00 con 0x7f1c9415b370 2023-10-16T13:40:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c988fd700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c9415aef0 0x7f1c940cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c990fe700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80005210 0x7f1c94153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c998ff700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 0x7f1c940cd7a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1c9415e700 tx=0x7f1c8c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:38.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c007000 con 0x7f1c9415b370 2023-10-16T13:40:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c003e30 con 0x7f1c9415b370 2023-10-16T13:40:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9415c1e0 con 0x7f1c9415b370 2023-10-16T13:40:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c015b70 con 0x7f1c9415b370 2023-10-16T13:40:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.974+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c940c6bd0 con 0x7f1c9415b370 2023-10-16T13:40:38.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.975+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c940c8bf0 con 0x7f1c9415b370 2023-10-16T13:40:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.976+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f1c8c024070 con 0x7f1c9415b370 2023-10-16T13:40:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.976+0000 7f1c89ffb700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c7806af90 0x7f1c7806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.976+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1c8c08af20 con 0x7f1c9415b370 2023-10-16T13:40:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.976+0000 7f1c990fe700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c7806af90 0x7f1c7806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.977+0000 7f1c990fe700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c7806af90 0x7f1c7806d450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c9415def0 tx=0x7f1c84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:38.981+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c8c0560d0 con 0x7f1c9415b370 2023-10-16T13:40:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.223+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1c9415c370 con 0x7f1c9415b370 2023-10-16T13:40:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.827+0000 7f1c89ffb700 1 -- 172.21.15.5:0/3103921434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1c8c0596f0 con 0x7f1c9415b370 2023-10-16T13:40:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c7806af90 msgr2=0x7f1c7806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c7806af90 0x7f1c7806d450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c9415def0 tx=0x7f1c84009040 comp rx=0 tx=0).stop 2023-10-16T13:40:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 msgr2=0x7f1c940cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 0x7f1c940cd7a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1c9415e700 tx=0x7f1c8c004b40 comp rx=0 tx=0).stop 2023-10-16T13:40:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 shutdown_connections 2023-10-16T13:40:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9415b370 0x7f1c940cd7a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1c7806af90 0x7f1c7806d450 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c80005210 0x7f1c94153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 --2- 172.21.15.5:0/3103921434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c9415aef0 0x7f1c940cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 >> 172.21.15.5:0/3103921434 conn(0x7f1c9406dae0 msgr2=0x7f1c940b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 shutdown_connections 2023-10-16T13:40:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.831+0000 7f1c9b362700 1 -- 172.21.15.5:0/3103921434 wait complete. 2023-10-16T13:40:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 10 and data pool 11 2023-10-16T13:40:39.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.982+0000 7f48a463a700 1 Processor -- start 2023-10-16T13:40:39.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.982+0000 7f48a463a700 1 -- start start 2023-10-16T13:40:39.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a463a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a463a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c15e4e0 con 0x7f489c0b7050 2023-10-16T13:40:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a463a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c0d28e0 con 0x7f489c15dbc0 2023-10-16T13:40:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a463a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0b7560 con 0x7f489c0d3fc0 2023-10-16T13:40:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a2bd7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f489c0b7050 0x7f489c0d21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55746/0 (socket says 172.21.15.5:55746) 2023-10-16T13:40:39.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a2bd7700 1 -- 172.21.15.5:0/1621106467 learned_addr learned my addr 172.21.15.5:0/1621106467 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a1bd5700 1 --2- 172.21.15.5:0/1621106467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483909881 0 0) 0x7f489c15e4e0 con 0x7f489c0b7050 2023-10-16T13:40:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48880035b0 con 0x7f489c0b7050 2023-10-16T13:40:39.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235259552 0 0) 0x7f489c0d28e0 con 0x7f489c15dbc0 2023-10-16T13:40:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f489c15e4e0 con 0x7f489c15dbc0 2023-10-16T13:40:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a1bd5700 1 -- 172.21.15.5:0/1621106467 >> v1:172.21.15.112:6789/0 conn(0x7f489c15dbc0 legacy=0x7f489c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a1bd5700 1 -- 172.21.15.5:0/1621106467 >> v1:172.21.15.5:6789/0 conn(0x7f489c0b7050 legacy=0x7f489c0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a1bd5700 1 -- 172.21.15.5:0/1621106467 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0b7840 con 0x7f489c0d3fc0 2023-10-16T13:40:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.983+0000 7f48a1bd5700 1 --2- 172.21.15.5:0/1621106467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c15dfa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f488c009870 tx=0x7f488c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bdfb726a9655b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c004230 con 0x7f489c0d3fc0 2023-10-16T13:40:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c004390 con 0x7f489c0d3fc0 2023-10-16T13:40:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a13d4700 1 -- 172.21.15.5:0/1621106467 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c0036a0 con 0x7f489c0d3fc0 2023-10-16T13:40:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 -- 172.21.15.5:0/1621106467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 msgr2=0x7f489c15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 --2- 172.21.15.5:0/1621106467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c15dfa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f488c009870 tx=0x7f488c009b80 comp rx=0 tx=0).stop 2023-10-16T13:40:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 -- 172.21.15.5:0/1621106467 shutdown_connections 2023-10-16T13:40:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 --2- 172.21.15.5:0/1621106467 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c15dfa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 -- 172.21.15.5:0/1621106467 >> 172.21.15.5:0/1621106467 conn(0x7f489c09cb40 msgr2=0x7f489c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 -- 172.21.15.5:0/1621106467 shutdown_connections 2023-10-16T13:40:39.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.984+0000 7f48a463a700 1 -- 172.21.15.5:0/1621106467 wait complete. 2023-10-16T13:40:39.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.985+0000 7f48a463a700 1 Processor -- start 2023-10-16T13:40:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 -- start start 2023-10-16T13:40:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 0x7f489c09dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489c15dbc0 0x7f489c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c155f50 con 0x7f489c0b7050 2023-10-16T13:40:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0ca670 con 0x7f489c15dbc0 2023-10-16T13:40:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a463a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0c9e60 con 0x7f489c0d3fc0 2023-10-16T13:40:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a23d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 0x7f489c09dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a23d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 0x7f489c09dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45744/0 (socket says 172.21.15.5:45744) 2023-10-16T13:40:39.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.986+0000 7f48a23d6700 1 -- 172.21.15.5:0/4243228332 learned_addr learned my addr 172.21.15.5:0/4243228332 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a2bd7700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489c15dbc0 0x7f489c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a1bd5700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a23d6700 1 -- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 msgr2=0x7f489c1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a23d6700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a23d6700 1 -- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489c15dbc0 msgr2=0x7f489c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a23d6700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489c15dbc0 0x7f489c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a23d6700 1 -- 172.21.15.5:0/4243228332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0094a0 con 0x7f489c0b7050 2023-10-16T13:40:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a1bd5700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a23d6700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 0x7f489c09dde0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f489800c490 tx=0x7f489800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980054e0 con 0x7f489c0b7050 2023-10-16T13:40:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48980036d0 con 0x7f489c0b7050 2023-10-16T13:40:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898003a80 con 0x7f489c0b7050 2023-10-16T13:40:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c155790 con 0x7f489c0b7050 2023-10-16T13:40:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.987+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c0ca390 con 0x7f489c0b7050 2023-10-16T13:40:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.988+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c1555f0 con 0x7f489c0b7050 2023-10-16T13:40:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.989+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f4898003be0 con 0x7f489c0b7050 2023-10-16T13:40:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.989+0000 7f4892ffd700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f488006af90 0x7f488006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.989+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4898088950 con 0x7f489c0b7050 2023-10-16T13:40:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.989+0000 7f48a1bd5700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f488006af90 0x7f488006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.990+0000 7f48a1bd5700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f488006af90 0x7f488006d450 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f488c0097c0 tx=0x7f488c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:39.994+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f489c1555f0 con 0x7f489c0b7050 2023-10-16T13:40:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.193+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f489c1555f0 con 0x7f489c0b7050 2023-10-16T13:40:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.195+0000 7f4892ffd700 1 -- 172.21.15.5:0/4243228332 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f489c1555f0 con 0x7f489c0b7050 2023-10-16T13:40:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:40.198 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:39.224790+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f488006af90 msgr2=0x7f488006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f488006af90 0x7f488006d450 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f488c0097c0 tx=0x7f488c01c040 comp rx=0 tx=0).stop 2023-10-16T13:40:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 msgr2=0x7f489c09dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 0x7f489c09dde0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f489800c490 tx=0x7f489800c7a0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 shutdown_connections 2023-10-16T13:40:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489c15dbc0 0x7f489c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489c0b7050 0x7f489c09dde0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f488006af90 0x7f488006d450 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 --2- 172.21.15.5:0/4243228332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f489c0d3fc0 0x7f489c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 >> 172.21.15.5:0/4243228332 conn(0x7f489c09cb40 msgr2=0x7f489c06c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:40.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 shutdown_connections 2023-10-16T13:40:40.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.197+0000 7f48a463a700 1 -- 172.21.15.5:0/4243228332 wait complete. 2023-10-16T13:40:40.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:40.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.334+0000 7f070b00d700 1 Processor -- start 2023-10-16T13:40:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.334+0000 7f070b00d700 1 -- start start 2023-10-16T13:40:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f070b00d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f070415f130 0x7f07040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f070b00d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07040b28b0 0x7f070406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f070b00d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040b3530 con 0x7f070406ad80 2023-10-16T13:40:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f070b00d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040cde00 con 0x7f070415f130 2023-10-16T13:40:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f070b00d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070406b1b0 con 0x7f07040b28b0 2023-10-16T13:40:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0708da9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f070415f130 0x7f07040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f07095aa700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f070406ad80 0x7f0704071af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55760/0 (socket says 172.21.15.5:55760) 2023-10-16T13:40:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f07095aa700 1 -- 172.21.15.5:0/1736555191 learned_addr learned my addr 172.21.15.5:0/1736555191 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0703fff700 1 --2- 172.21.15.5:0/1736555191 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07040b28b0 0x7f070406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0708da9700 1 -- 172.21.15.5:0/1736555191 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07040b28b0 msgr2=0x7f070406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0708da9700 1 --2- 172.21.15.5:0/1736555191 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07040b28b0 0x7f070406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0708da9700 1 -- 172.21.15.5:0/1736555191 >> v1:172.21.15.5:6789/0 conn(0x7f070406ad80 legacy=0x7f0704071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0708da9700 1 -- 172.21.15.5:0/1736555191 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040cd180 con 0x7f070415f130 2023-10-16T13:40:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f07037fe700 1 -- 172.21.15.5:0/1736555191 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397490253 0 0) 0x7f07040b3530 con 0x7f070406ad80 2023-10-16T13:40:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.335+0000 7f0708da9700 1 --2- 172.21.15.5:0/1736555191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cede0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009840 tx=0x7f06f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adc2a272d382c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f07037fe700 1 -- 172.21.15.5:0/1736555191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8011830 con 0x7f070415f130 2023-10-16T13:40:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f07037fe700 1 -- 172.21.15.5:0/1736555191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8011990 con 0x7f070415f130 2023-10-16T13:40:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f07037fe700 1 -- 172.21.15.5:0/1736555191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8011d20 con 0x7f070415f130 2023-10-16T13:40:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 -- 172.21.15.5:0/1736555191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 msgr2=0x7f07040cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 --2- 172.21.15.5:0/1736555191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cede0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009840 tx=0x7f06f8009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 -- 172.21.15.5:0/1736555191 shutdown_connections 2023-10-16T13:40:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 --2- 172.21.15.5:0/1736555191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cede0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 --2- 172.21.15.5:0/1736555191 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07040b28b0 0x7f070406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 -- 172.21.15.5:0/1736555191 >> 172.21.15.5:0/1736555191 conn(0x7f070406dae0 msgr2=0x7f070406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:40.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 -- 172.21.15.5:0/1736555191 shutdown_connections 2023-10-16T13:40:40.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.336+0000 7f070b00d700 1 -- 172.21.15.5:0/1736555191 wait complete. 2023-10-16T13:40:40.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.337+0000 7f070b00d700 1 Processor -- start 2023-10-16T13:40:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.337+0000 7f070b00d700 1 -- start start 2023-10-16T13:40:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f070b00d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f070406ad80 0x7f07040ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f070b00d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07040b28b0 0x7f070415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f070b00d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f070b00d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040cac30 con 0x7f070415f130 2023-10-16T13:40:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f070b00d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040caf10 con 0x7f07040b28b0 2023-10-16T13:40:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f070b00d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040cb1f0 con 0x7f070406ad80 2023-10-16T13:40:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f07095aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f07095aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45762/0 (socket says 172.21.15.5:45762) 2023-10-16T13:40:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f07095aa700 1 -- 172.21.15.5:0/2252622832 learned_addr learned my addr 172.21.15.5:0/2252622832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f0708da9700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f070406ad80 0x7f07040ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.338+0000 7f0703fff700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07040b28b0 0x7f070415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07095aa700 1 -- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f070406ad80 msgr2=0x7f07040ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07095aa700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f070406ad80 0x7f07040ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07095aa700 1 -- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07040b28b0 msgr2=0x7f070415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07095aa700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07040b28b0 0x7f070415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07095aa700 1 -- 172.21.15.5:0/2252622832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80094a0 con 0x7f070415f130 2023-10-16T13:40:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07095aa700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cbcd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00cba0 tx=0x7f06fc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00aaa0 con 0x7f070415f130 2023-10-16T13:40:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00ac20 con 0x7f070415f130 2023-10-16T13:40:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040cb4d0 con 0x7f070415f130 2023-10-16T13:40:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0070d0 con 0x7f070415f130 2023-10-16T13:40:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.339+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040acdf0 con 0x7f070415f130 2023-10-16T13:40:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.340+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07040cb9f0 con 0x7f070415f130 2023-10-16T13:40:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.340+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f06fc007230 con 0x7f070415f130 2023-10-16T13:40:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.341+0000 7f07017fa700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f06e806af90 0x7f06e806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.341+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06fc0892d0 con 0x7f070415f130 2023-10-16T13:40:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.341+0000 7f0708da9700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f06e806af90 0x7f06e806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.342+0000 7f0708da9700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f06e806af90 0x7f06e806d450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06f80090b0 tx=0x7f06f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.346+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07040cb9f0 con 0x7f070415f130 2023-10-16T13:40:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.545+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07040cb9f0 con 0x7f070415f130 2023-10-16T13:40:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.547+0000 7f07017fa700 1 -- 172.21.15.5:0/2252622832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f07040cb9f0 con 0x7f070415f130 2023-10-16T13:40:40.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:40.550 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:39.224790+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f06e806af90 msgr2=0x7f06e806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f06e806af90 0x7f06e806d450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06f80090b0 tx=0x7f06f8008030 comp rx=0 tx=0).stop 2023-10-16T13:40:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 msgr2=0x7f07040cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cbcd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00cba0 tx=0x7f06fc00ceb0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 shutdown_connections 2023-10-16T13:40:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070415f130 0x7f07040cbcd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f06e806af90 0x7f06e806d450 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f070406ad80 0x7f07040ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 --2- 172.21.15.5:0/2252622832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07040b28b0 0x7f070415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 >> 172.21.15.5:0/2252622832 conn(0x7f070406dae0 msgr2=0x7f07040c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 shutdown_connections 2023-10-16T13:40:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.549+0000 7f070b00d700 1 -- 172.21.15.5:0/2252622832 wait complete. 2023-10-16T13:40:40.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:40:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.689+0000 7f1a9048f700 1 Processor -- start 2023-10-16T13:40:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.689+0000 7f1a9048f700 1 -- start start 2023-10-16T13:40:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a9048f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a8815ab10 0x7f1a8815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a9048f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8815e7a0 con 0x7f1a880cfe30 2023-10-16T13:40:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a9048f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8815f730 con 0x7f1a880b1f50 2023-10-16T13:40:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a9048f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a880b29a0 con 0x7f1a8815ab10 2023-10-16T13:40:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a8e22b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a8815ab10 0x7f1a8815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a8ea2c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1a880cfe30 0x7f1a880cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55770/0 (socket says 172.21.15.5:55770) 2023-10-16T13:40:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a8ea2c700 1 -- 172.21.15.5:0/3484854948 learned_addr learned my addr 172.21.15.5:0/3484854948 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a8e22b700 1 -- 172.21.15.5:0/3484854948 >> v1:172.21.15.112:6789/0 conn(0x7f1a880b1f50 legacy=0x7f1a880cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.690+0000 7f1a8e22b700 1 -- 172.21.15.5:0/3484854948 >> v1:172.21.15.5:6789/0 conn(0x7f1a880cfe30 legacy=0x7f1a880cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a8e22b700 1 -- 172.21.15.5:0/3484854948 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880b2c80 con 0x7f1a8815ab10 2023-10-16T13:40:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a8e22b700 1 --2- 172.21.15.5:0/3484854948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a8815ab10 0x7f1a8815f1f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009840 tx=0x7f1a78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7430edaea04da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a8d229700 1 -- 172.21.15.5:0/3484854948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78004230 con 0x7f1a8815ab10 2023-10-16T13:40:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a8d229700 1 -- 172.21.15.5:0/3484854948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a78004390 con 0x7f1a8815ab10 2023-10-16T13:40:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a8d229700 1 -- 172.21.15.5:0/3484854948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780036a0 con 0x7f1a8815ab10 2023-10-16T13:40:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a9048f700 1 -- 172.21.15.5:0/3484854948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a8815ab10 msgr2=0x7f1a8815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a9048f700 1 --2- 172.21.15.5:0/3484854948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a8815ab10 0x7f1a8815f1f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009840 tx=0x7f1a78009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a9048f700 1 -- 172.21.15.5:0/3484854948 shutdown_connections 2023-10-16T13:40:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a9048f700 1 --2- 172.21.15.5:0/3484854948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a8815ab10 0x7f1a8815f1f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.691+0000 7f1a9048f700 1 -- 172.21.15.5:0/3484854948 >> 172.21.15.5:0/3484854948 conn(0x7f1a8806dae0 msgr2=0x7f1a8806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.692+0000 7f1a9048f700 1 -- 172.21.15.5:0/3484854948 shutdown_connections 2023-10-16T13:40:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.692+0000 7f1a9048f700 1 -- 172.21.15.5:0/3484854948 wait complete. 2023-10-16T13:40:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.693+0000 7f1a9048f700 1 Processor -- start 2023-10-16T13:40:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.693+0000 7f1a9048f700 1 -- start start 2023-10-16T13:40:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a9048f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a880b1f50 0x7f1a881f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a9048f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 0x7f1a880c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a9048f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a8815ab10 0x7f1a880b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a9048f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8815d010 con 0x7f1a880cfe30 2023-10-16T13:40:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a9048f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a881f4c10 con 0x7f1a8815ab10 2023-10-16T13:40:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a9048f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880b5b10 con 0x7f1a880b1f50 2023-10-16T13:40:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a8da2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 0x7f1a880c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a8da2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 0x7f1a880c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45774/0 (socket says 172.21.15.5:45774) 2023-10-16T13:40:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a8da2a700 1 -- 172.21.15.5:0/967826126 learned_addr learned my addr 172.21.15.5:0/967826126 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.694+0000 7f1a8ea2c700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a8815ab10 0x7f1a880b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8e22b700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a880b1f50 0x7f1a881f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8da2a700 1 -- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a880b1f50 msgr2=0x7f1a881f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8da2a700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a880b1f50 0x7f1a881f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8da2a700 1 -- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a8815ab10 msgr2=0x7f1a880b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8da2a700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a8815ab10 0x7f1a880b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8da2a700 1 -- 172.21.15.5:0/967826126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780094a0 con 0x7f1a880cfe30 2023-10-16T13:40:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8ea2c700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a8815ab10 0x7f1a880b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a8da2a700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 0x7f1a880c99e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d920 tx=0x7f1a8400dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400ec50 con 0x7f1a880cfe30 2023-10-16T13:40:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8400edd0 con 0x7f1a880cfe30 2023-10-16T13:40:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a880b5df0 con 0x7f1a880cfe30 2023-10-16T13:40:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84016680 con 0x7f1a880cfe30 2023-10-16T13:40:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.695+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8815c9a0 con 0x7f1a880cfe30 2023-10-16T13:40:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.696+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8815d1c0 con 0x7f1a880cfe30 2023-10-16T13:40:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.696+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f1a8401e360 con 0x7f1a880cfe30 2023-10-16T13:40:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.697+0000 7f1a7effd700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a6c06af90 0x7f1a6c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.697+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a8408b1a0 con 0x7f1a880cfe30 2023-10-16T13:40:40.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.697+0000 7f1a8e22b700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a6c06af90 0x7f1a6c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:40.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.697+0000 7f1a8e22b700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a6c06af90 0x7f1a6c06d450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1a880b35f0 tx=0x7f1a78008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:40.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.702+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a8815d1c0 con 0x7f1a880cfe30 2023-10-16T13:40:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:40.953+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1a88067d20 con 0x7f1a880cfe30 2023-10-16T13:40:41.798 INFO:tasks.ceph.mds.b.smithi112.stderr:2023-10-16T13:40:41.795+0000 7f189c35c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:40:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.843+0000 7f1a7effd700 1 -- 172.21.15.5:0/967826126 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a840562f0 con 0x7f1a880cfe30 2023-10-16T13:40:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a6c06af90 msgr2=0x7f1a6c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a6c06af90 0x7f1a6c06d450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1a880b35f0 tx=0x7f1a78008030 comp rx=0 tx=0).stop 2023-10-16T13:40:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 msgr2=0x7f1a880c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 0x7f1a880c99e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d920 tx=0x7f1a8400dce0 comp rx=0 tx=0).stop 2023-10-16T13:40:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 shutdown_connections 2023-10-16T13:40:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a8815ab10 0x7f1a880b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a6c06af90 0x7f1a6c06d450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a880b1f50 0x7f1a881f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 --2- 172.21.15.5:0/967826126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a880cfe30 0x7f1a880c99e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 >> 172.21.15.5:0/967826126 conn(0x7f1a8806dae0 msgr2=0x7f1a8806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 shutdown_connections 2023-10-16T13:40:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.847+0000 7f1a9048f700 1 -- 172.21.15.5:0/967826126 wait complete. 2023-10-16T13:40:41.864 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:40:41.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:40:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.997+0000 7fe029395700 1 Processor -- start 2023-10-16T13:40:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.997+0000 7fe029395700 1 -- start start 2023-10-16T13:40:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe029395700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0240d3fc0 0x7fe02415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe029395700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0240b7050 0x7fe0240d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe029395700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02415e4e0 con 0x7fe02415dbc0 2023-10-16T13:40:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe029395700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0240b7560 con 0x7fe0240d3fc0 2023-10-16T13:40:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe029395700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0240b7840 con 0x7fe0240b7050 2023-10-16T13:40:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0240d3fc0 0x7fe02415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0240d3fc0 0x7fe02415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45782/0 (socket says 172.21.15.5:45782) 2023-10-16T13:40:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 -- 172.21.15.5:0/174300337 learned_addr learned my addr 172.21.15.5:0/174300337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0237fe700 1 --2- 172.21.15.5:0/174300337 >> v2:172.21.15.112:3300/0 conn(0x7fe0240b7050 0x7fe0240d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 -- 172.21.15.5:0/174300337 >> v2:172.21.15.112:3300/0 conn(0x7fe0240b7050 msgr2=0x7fe0240d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 --2- 172.21.15.5:0/174300337 >> v2:172.21.15.112:3300/0 conn(0x7fe0240b7050 0x7fe0240d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 -- 172.21.15.5:0/174300337 >> v1:172.21.15.112:6789/0 conn(0x7fe02415dbc0 legacy=0x7fe0240d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.998+0000 7fe0227fc700 1 -- 172.21.15.5:0/174300337 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240b7b20 con 0x7fe0240d3fc0 2023-10-16T13:40:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe0227fc700 1 --2- 172.21.15.5:0/174300337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe02415dfa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe0240cdea0 tx=0x7fe014009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34225af8a6b6e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe021ffb700 1 -- 172.21.15.5:0/174300337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014004230 con 0x7fe0240d3fc0 2023-10-16T13:40:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe021ffb700 1 -- 172.21.15.5:0/174300337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014004390 con 0x7fe0240d3fc0 2023-10-16T13:40:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe021ffb700 1 -- 172.21.15.5:0/174300337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0140036a0 con 0x7fe0240d3fc0 2023-10-16T13:40:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 -- 172.21.15.5:0/174300337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 msgr2=0x7fe02415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 --2- 172.21.15.5:0/174300337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe02415dfa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe0240cdea0 tx=0x7fe014009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 -- 172.21.15.5:0/174300337 shutdown_connections 2023-10-16T13:40:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 --2- 172.21.15.5:0/174300337 >> v2:172.21.15.112:3300/0 conn(0x7fe0240b7050 0x7fe0240d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 --2- 172.21.15.5:0/174300337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe02415dfa0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 -- 172.21.15.5:0/174300337 >> 172.21.15.5:0/174300337 conn(0x7fe02409cb40 msgr2=0x7fe0240d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 -- 172.21.15.5:0/174300337 shutdown_connections 2023-10-16T13:40:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:41.999+0000 7fe029395700 1 -- 172.21.15.5:0/174300337 wait complete. 2023-10-16T13:40:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.001+0000 7fe029395700 1 Processor -- start 2023-10-16T13:40:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.001+0000 7fe029395700 1 -- start start 2023-10-16T13:40:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0240b7050 0x7fe024155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe0240c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe02415dbc0 0x7fe0240cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0241e6ae0 con 0x7fe0240d3fc0 2023-10-16T13:40:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240a0430 con 0x7fe0240b7050 2023-10-16T13:40:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240a0710 con 0x7fe02415dbc0 2023-10-16T13:40:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe0240c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe0240c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45788/0 (socket says 172.21.15.5:45788) 2023-10-16T13:40:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 -- 172.21.15.5:0/3923230757 learned_addr learned my addr 172.21.15.5:0/3923230757 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe022ffd700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0240b7050 0x7fe024155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0237fe700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe02415dbc0 0x7fe0240cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 -- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe02415dbc0 msgr2=0x7fe0240cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe02415dbc0 0x7fe0240cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 -- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0240b7050 msgr2=0x7fe024155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0240b7050 0x7fe024155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 -- 172.21.15.5:0/3923230757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014009550 con 0x7fe0240d3fc0 2023-10-16T13:40:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe0227fc700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe0240c9e80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe014009130 tx=0x7fe014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014003b90 con 0x7fe0240d3fc0 2023-10-16T13:40:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01401f070 con 0x7fe0240d3fc0 2023-10-16T13:40:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011630 con 0x7fe0240d3fc0 2023-10-16T13:40:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0240a09f0 con 0x7fe0240d3fc0 2023-10-16T13:40:42.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.002+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe024156440 con 0x7fe0240d3fc0 2023-10-16T13:40:42.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.003+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02404ebb0 con 0x7fe0240d3fc0 2023-10-16T13:40:42.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.004+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fe014021030 con 0x7fe0240d3fc0 2023-10-16T13:40:42.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.004+0000 7fe00b7fe700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe01006af90 0x7fe01006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.004+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe01408aa20 con 0x7fe0240d3fc0 2023-10-16T13:40:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.004+0000 7fe022ffd700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe01006af90 0x7fe01006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.005+0000 7fe022ffd700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe01006af90 0x7fe01006d450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe0180090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.009+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe014055af0 con 0x7fe0240d3fc0 2023-10-16T13:40:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.260+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe02408cfa0 con 0x7fe0240d3fc0 2023-10-16T13:40:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.845+0000 7fe00b7fe700 1 -- 172.21.15.5:0/3923230757 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe014059110 con 0x7fe0240d3fc0 2023-10-16T13:40:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe01006af90 msgr2=0x7fe01006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe01006af90 0x7fe01006d450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe0180090e0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 msgr2=0x7fe0240c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe0240c9e80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe014009130 tx=0x7fe014004750 comp rx=0 tx=0).stop 2023-10-16T13:40:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 shutdown_connections 2023-10-16T13:40:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe01006af90 0x7fe01006d450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe02415dbc0 0x7fe0240cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0240b7050 0x7fe024155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 --2- 172.21.15.5:0/3923230757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0240d3fc0 0x7fe0240c9e80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.847+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 >> 172.21.15.5:0/3923230757 conn(0x7fe02409cb40 msgr2=0x7fe0240b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.848+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 shutdown_connections 2023-10-16T13:40:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.848+0000 7fe029395700 1 -- 172.21.15.5:0/3923230757 wait complete. 2023-10-16T13:40:42.865 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:40:42.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.994+0000 7f2583611700 1 Processor -- start 2023-10-16T13:40:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.995+0000 7f2583611700 1 -- start start 2023-10-16T13:40:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.995+0000 7f2583611700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c15e2f0 0x7f257c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.995+0000 7f2583611700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c06a840 0x7f257c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.995+0000 7f2583611700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0b2d60 con 0x7f257c0cd950 2023-10-16T13:40:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2583611700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c1619a0 con 0x7f257c06a840 2023-10-16T13:40:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2583611700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c06b1f0 con 0x7f257c15e2f0 2023-10-16T13:40:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2581bae700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c06a840 0x7f257c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f25813ad700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f257c0cd950 0x7f257c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55798/0 (socket says 172.21.15.5:55798) 2023-10-16T13:40:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f25813ad700 1 -- 172.21.15.5:0/2078809695 learned_addr learned my addr 172.21.15.5:0/2078809695 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2580bac700 1 --2- 172.21.15.5:0/2078809695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c15e2f0 0x7f257c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2581bae700 1 -- 172.21.15.5:0/2078809695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c15e2f0 msgr2=0x7f257c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2581bae700 1 --2- 172.21.15.5:0/2078809695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c15e2f0 0x7f257c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2581bae700 1 -- 172.21.15.5:0/2078809695 >> v1:172.21.15.5:6789/0 conn(0x7f257c0cd950 legacy=0x7f257c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f256ffff700 1 -- 172.21.15.5:0/2078809695 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010941664 0 0) 0x7f257c0b2d60 con 0x7f257c0cd950 2023-10-16T13:40:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2581bae700 1 -- 172.21.15.5:0/2078809695 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0cdd30 con 0x7f257c06a840 2023-10-16T13:40:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f2581bae700 1 --2- 172.21.15.5:0/2078809695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06a840 0x7f257c06acb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2574009d90 tx=0x7f257400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65177b3c3d132c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f256ffff700 1 -- 172.21.15.5:0/2078809695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400e070 con 0x7f257c06a840 2023-10-16T13:40:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f256ffff700 1 -- 172.21.15.5:0/2078809695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400bb20 con 0x7f257c06a840 2023-10-16T13:40:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.996+0000 7f256ffff700 1 -- 172.21.15.5:0/2078809695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574012430 con 0x7f257c06a840 2023-10-16T13:40:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 -- 172.21.15.5:0/2078809695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06a840 msgr2=0x7f257c06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 --2- 172.21.15.5:0/2078809695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06a840 0x7f257c06acb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2574009d90 tx=0x7f257400b330 comp rx=0 tx=0).stop 2023-10-16T13:40:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 -- 172.21.15.5:0/2078809695 shutdown_connections 2023-10-16T13:40:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 --2- 172.21.15.5:0/2078809695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c06a840 0x7f257c06acb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 --2- 172.21.15.5:0/2078809695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c15e2f0 0x7f257c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 -- 172.21.15.5:0/2078809695 >> 172.21.15.5:0/2078809695 conn(0x7f257c06dae0 msgr2=0x7f257c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 -- 172.21.15.5:0/2078809695 shutdown_connections 2023-10-16T13:40:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.997+0000 7f2583611700 1 -- 172.21.15.5:0/2078809695 wait complete. 2023-10-16T13:40:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.999+0000 7f2583611700 1 Processor -- start 2023-10-16T13:40:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:42.999+0000 7f2583611700 1 -- start start 2023-10-16T13:40:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2583611700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f257c06a840 0x7f257c15b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2583611700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c0cd950 0x7f257c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2583611700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 0x7f257c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2583611700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b4750 con 0x7f257c15e2f0 2023-10-16T13:40:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2583611700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b4a30 con 0x7f257c06a840 2023-10-16T13:40:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2583611700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0ac8b0 con 0x7f257c0cd950 2023-10-16T13:40:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 0x7f257c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 0x7f257c0b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45804/0 (socket says 172.21.15.5:45804) 2023-10-16T13:40:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 -- 172.21.15.5:0/1530044251 learned_addr learned my addr 172.21.15.5:0/1530044251 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f25813ad700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f257c06a840 0x7f257c15b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2580bac700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c0cd950 0x7f257c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 -- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c0cd950 msgr2=0x7f257c0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c0cd950 0x7f257c0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 -- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f257c06a840 msgr2=0x7f257c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f257c06a840 0x7f257c15b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 -- 172.21.15.5:0/1530044251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009a70 con 0x7f257c15e2f0 2023-10-16T13:40:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f2581bae700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 0x7f257c0b52f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f257c06d4f0 tx=0x7f2574004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574012430 con 0x7f257c15e2f0 2023-10-16T13:40:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.000+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574020070 con 0x7f257c15e2f0 2023-10-16T13:40:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.001+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574004280 con 0x7f257c15e2f0 2023-10-16T13:40:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.001+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c0acb90 con 0x7f257c15e2f0 2023-10-16T13:40:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.001+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0b3a60 con 0x7f257c15e2f0 2023-10-16T13:40:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.002+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c0ad0b0 con 0x7f257c15e2f0 2023-10-16T13:40:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.002+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f25740043e0 con 0x7f257c15e2f0 2023-10-16T13:40:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.003+0000 7f256dffb700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f256006af90 0x7f256006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.003+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2574022070 con 0x7f257c15e2f0 2023-10-16T13:40:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.003+0000 7f25813ad700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f256006af90 0x7f256006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.003+0000 7f25813ad700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f256006af90 0x7f256006d450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2578007fd0 tx=0x7f2578007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.008+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f257c0ad0b0 con 0x7f257c15e2f0 2023-10-16T13:40:43.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.250+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f257c0ad0b0 con 0x7f257c15e2f0 2023-10-16T13:40:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.250+0000 7f256dffb700 1 -- 172.21.15.5:0/1530044251 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f257c0ad0b0 con 0x7f257c15e2f0 2023-10-16T13:40:43.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:43.254 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:39.225095+0000","modified":"2023-10-16T13:40:42.262157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/2729748635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2729748635},{"type":"v1","addr":"172.21.15.112:6836","nonce":2729748635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-16T13:40:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f256006af90 msgr2=0x7f256006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f256006af90 0x7f256006d450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2578007fd0 tx=0x7f2578007de0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 msgr2=0x7f257c0b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 0x7f257c0b52f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f257c06d4f0 tx=0x7f2574004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 shutdown_connections 2023-10-16T13:40:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c15e2f0 0x7f257c0b52f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f257c06a840 0x7f257c15b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f256006af90 0x7f256006d450 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 --2- 172.21.15.5:0/1530044251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f257c0cd950 0x7f257c0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 >> 172.21.15.5:0/1530044251 conn(0x7f257c06dae0 msgr2=0x7f257c15d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 shutdown_connections 2023-10-16T13:40:43.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.252+0000 7f2583611700 1 -- 172.21.15.5:0/1530044251 wait complete. 2023-10-16T13:40:43.258 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-10-16T13:40:43.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:40:43.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.390+0000 7f2fce1ab700 1 Processor -- start 2023-10-16T13:40:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.390+0000 7f2fce1ab700 1 -- start start 2023-10-16T13:40:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fce1ab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fc806af50 0x7f2fc8168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fce1ab700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc8161390 con 0x7f2fc8160fb0 2023-10-16T13:40:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fce1ab700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80b23f0 con 0x7f2fc80cee40 2023-10-16T13:40:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fce1ab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80cf2f0 con 0x7f2fc806af50 2023-10-16T13:40:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc7fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fc806af50 0x7f2fc8168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2fc8160fb0 0x7f2fc80727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55812/0 (socket says 172.21.15.5:55812) 2023-10-16T13:40:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc77fe700 1 -- 172.21.15.5:0/115452407 learned_addr learned my addr 172.21.15.5:0/115452407 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc7fff700 1 -- 172.21.15.5:0/115452407 >> v1:172.21.15.112:6789/0 conn(0x7f2fc80cee40 legacy=0x7f2fc806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc7fff700 1 -- 172.21.15.5:0/115452407 >> v1:172.21.15.5:6789/0 conn(0x7f2fc8160fb0 legacy=0x7f2fc80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc7fff700 1 -- 172.21.15.5:0/115452407 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80b26b0 con 0x7f2fc806af50 2023-10-16T13:40:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc7fff700 1 --2- 172.21.15.5:0/115452407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc8168930 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009d90 tx=0x7f2fc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9f29e3cc753cc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc67fc700 1 -- 172.21.15.5:0/115452407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000e070 con 0x7f2fc806af50 2023-10-16T13:40:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc67fc700 1 -- 172.21.15.5:0/115452407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000bb90 con 0x7f2fc806af50 2023-10-16T13:40:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.391+0000 7f2fc67fc700 1 -- 172.21.15.5:0/115452407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0003a20 con 0x7f2fc806af50 2023-10-16T13:40:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 -- 172.21.15.5:0/115452407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 msgr2=0x7f2fc8168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/115452407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc8168930 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009d90 tx=0x7f2fc000b330 comp rx=0 tx=0).stop 2023-10-16T13:40:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 -- 172.21.15.5:0/115452407 shutdown_connections 2023-10-16T13:40:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/115452407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc8168930 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 -- 172.21.15.5:0/115452407 >> 172.21.15.5:0/115452407 conn(0x7f2fc80cd270 msgr2=0x7f2fc80cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 -- 172.21.15.5:0/115452407 shutdown_connections 2023-10-16T13:40:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.392+0000 7f2fce1ab700 1 -- 172.21.15.5:0/115452407 wait complete. 2023-10-16T13:40:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.393+0000 7f2fce1ab700 1 Processor -- start 2023-10-16T13:40:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.393+0000 7f2fce1ab700 1 -- start start 2023-10-16T13:40:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fce1ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc81f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fce1ab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fc80cee40 0x7f2fc80c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fce1ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc8160fb0 0x7f2fc815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fce1ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc814c720 con 0x7f2fc806af50 2023-10-16T13:40:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fce1ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc81f6800 con 0x7f2fc8160fb0 2023-10-16T13:40:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fce1ab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc81f6a50 con 0x7f2fc80cee40 2023-10-16T13:40:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc81f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc81f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45816/0 (socket says 172.21.15.5:45816) 2023-10-16T13:40:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 -- 172.21.15.5:0/1924329939 learned_addr learned my addr 172.21.15.5:0/1924329939 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc7fff700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc8160fb0 0x7f2fc815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc6ffd700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fc80cee40 0x7f2fc80c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 -- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fc80cee40 msgr2=0x7f2fc80c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fc80cee40 0x7f2fc80c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 -- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc8160fb0 msgr2=0x7f2fc815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc8160fb0 0x7f2fc815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc77fe700 1 -- 172.21.15.5:0/1924329939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0009a70 con 0x7f2fc806af50 2023-10-16T13:40:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.394+0000 7f2fc7fff700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc8160fb0 0x7f2fc815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.395+0000 7f2fc77fe700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc81f31e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8007fd0 tx=0x7f2fb800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.395+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80074e0 con 0x7f2fc806af50 2023-10-16T13:40:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.395+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb8007640 con 0x7f2fc806af50 2023-10-16T13:40:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.395+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc81f6d30 con 0x7f2fc806af50 2023-10-16T13:40:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.395+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8005a50 con 0x7f2fc806af50 2023-10-16T13:40:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.395+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc81f72f0 con 0x7f2fc806af50 2023-10-16T13:40:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.396+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc814ea60 con 0x7f2fc806af50 2023-10-16T13:40:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.396+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f2fb8005bb0 con 0x7f2fc806af50 2023-10-16T13:40:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.397+0000 7f2faffff700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2fb406af90 0x7f2fb406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.397+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fb8088a20 con 0x7f2fc806af50 2023-10-16T13:40:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.397+0000 7f2fc6ffd700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2fb406af90 0x7f2fb406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.397+0000 7f2fc6ffd700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2fb406af90 0x7f2fb406d450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80acd90 tx=0x7f2fbc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.401+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fb8053ba0 con 0x7f2fc806af50 2023-10-16T13:40:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.604+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc815e360 con 0x7f2fc806af50 2023-10-16T13:40:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.605+0000 7f2faffff700 1 -- 172.21.15.5:0/1924329939 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16496 (secure 0 0 0) 0x7f2fb8017020 con 0x7f2fc806af50 2023-10-16T13:40:43.608 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:43.608 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":62,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:40:40.803021+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:40:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2fb406af90 msgr2=0x7f2fb406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2fb406af90 0x7f2fb406d450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80acd90 tx=0x7f2fbc009040 comp rx=0 tx=0).stop 2023-10-16T13:40:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 msgr2=0x7f2fc81f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc81f31e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8007fd0 tx=0x7f2fb800c790 comp rx=0 tx=0).stop 2023-10-16T13:40:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 shutdown_connections 2023-10-16T13:40:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc8160fb0 0x7f2fc815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fc806af50 0x7f2fc81f31e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2fb406af90 0x7f2fb406d450 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 --2- 172.21.15.5:0/1924329939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fc80cee40 0x7f2fc80c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.607+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 >> 172.21.15.5:0/1924329939 conn(0x7f2fc80cd270 msgr2=0x7f2fc80b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.608+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 shutdown_connections 2023-10-16T13:40:43.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.608+0000 7f2fce1ab700 1 -- 172.21.15.5:0/1924329939 wait complete. 2023-10-16T13:40:43.623 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:40:43.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.745+0000 7ff9440c6700 1 Processor -- start 2023-10-16T13:40:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.746+0000 7ff9440c6700 1 -- start start 2023-10-16T13:40:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.746+0000 7ff9440c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c15f050 0x7ff93c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.746+0000 7ff9440c6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff93c0d0530 0x7ff93c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.746+0000 7ff9440c6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0b0a80 con 0x7ff93c0b0580 2023-10-16T13:40:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.746+0000 7ff9440c6700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0ccee0 con 0x7ff93c0d0530 2023-10-16T13:40:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.746+0000 7ff9440c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0cd1c0 con 0x7ff93c15f050 2023-10-16T13:40:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff941661700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff93c0b0580 0x7ff93c0ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55828/0 (socket says 172.21.15.5:55828) 2023-10-16T13:40:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff941661700 1 -- 172.21.15.5:0/3339890085 learned_addr learned my addr 172.21.15.5:0/3339890085 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff942663700 1 --2- 172.21.15.5:0/3339890085 >> v2:172.21.15.112:3300/0 conn(0x7ff93c0d0530 0x7ff93c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff941e62700 1 --2- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c15f050 0x7ff93c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff940e60700 1 -- 172.21.15.5:0/3339890085 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902267843 0 0) 0x7ff93c0b0a80 con 0x7ff93c0b0580 2023-10-16T13:40:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff940e60700 1 -- 172.21.15.5:0/3339890085 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9280035b0 con 0x7ff93c0b0580 2023-10-16T13:40:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff940e60700 1 -- 172.21.15.5:0/3339890085 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404563554 0 0) 0x7ff9280035b0 con 0x7ff93c0b0580 2023-10-16T13:40:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff942663700 1 -- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c15f050 msgr2=0x7ff93c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff942663700 1 --2- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c15f050 0x7ff93c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff942663700 1 -- 172.21.15.5:0/3339890085 >> v1:172.21.15.5:6789/0 conn(0x7ff93c0b0580 legacy=0x7ff93c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff942663700 1 -- 172.21.15.5:0/3339890085 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0cd4a0 con 0x7ff93c0d0530 2023-10-16T13:40:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff942663700 1 --2- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0530 0x7ff93c06ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff934009d90 tx=0x7ff93400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e931b985da6cda9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.747+0000 7ff940e60700 1 -- 172.21.15.5:0/3339890085 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400e070 con 0x7ff93c0d0530 2023-10-16T13:40:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff940e60700 1 -- 172.21.15.5:0/3339890085 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934003a20 con 0x7ff93c0d0530 2023-10-16T13:40:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff940e60700 1 -- 172.21.15.5:0/3339890085 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938001670 con 0x7ff93c0d0530 2023-10-16T13:40:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 -- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0530 msgr2=0x7ff93c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 --2- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0530 0x7ff93c06ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff934009d90 tx=0x7ff93400b330 comp rx=0 tx=0).stop 2023-10-16T13:40:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 -- 172.21.15.5:0/3339890085 shutdown_connections 2023-10-16T13:40:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 --2- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0530 0x7ff93c06ede0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 --2- 172.21.15.5:0/3339890085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c15f050 0x7ff93c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 -- 172.21.15.5:0/3339890085 >> 172.21.15.5:0/3339890085 conn(0x7ff93c0d1620 msgr2=0x7ff93c0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 -- 172.21.15.5:0/3339890085 shutdown_connections 2023-10-16T13:40:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.748+0000 7ff9440c6700 1 -- 172.21.15.5:0/3339890085 wait complete. 2023-10-16T13:40:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.749+0000 7ff9440c6700 1 Processor -- start 2023-10-16T13:40:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.749+0000 7ff9440c6700 1 -- start start 2023-10-16T13:40:43.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff9440c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 0x7ff93c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff9440c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c15f050 0x7ff93c09e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff9440c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c09e830 0x7ff93c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff9440c6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c09edb0 con 0x7ff93c0b0580 2023-10-16T13:40:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff9440c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c09f090 con 0x7ff93c15f050 2023-10-16T13:40:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff9440c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c09f370 con 0x7ff93c09e830 2023-10-16T13:40:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff941e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 0x7ff93c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff941e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 0x7ff93c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45828/0 (socket says 172.21.15.5:45828) 2023-10-16T13:40:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff941e62700 1 -- 172.21.15.5:0/1514315374 learned_addr learned my addr 172.21.15.5:0/1514315374 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff941661700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c15f050 0x7ff93c09e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.750+0000 7ff942663700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c09e830 0x7ff93c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff941e62700 1 -- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c09e830 msgr2=0x7ff93c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff941e62700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c09e830 0x7ff93c15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff941e62700 1 -- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c15f050 msgr2=0x7ff93c09e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff941e62700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c15f050 0x7ff93c09e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff941e62700 1 -- 172.21.15.5:0/1514315374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009a70 con 0x7ff93c0b0580 2023-10-16T13:40:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff941e62700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 0x7ff93c15ab50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00e9b0 tx=0x7ff92c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c009710 con 0x7ff93c0b0580 2023-10-16T13:40:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c00c850 con 0x7ff93c0b0580 2023-10-16T13:40:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c1f23f0 con 0x7ff93c0b0580 2023-10-16T13:40:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00cbc0 con 0x7ff93c0b0580 2023-10-16T13:40:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.751+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c15b090 con 0x7ff93c0b0580 2023-10-16T13:40:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.752+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c067d20 con 0x7ff93c0b0580 2023-10-16T13:40:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.752+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7ff92c00cd20 con 0x7ff93c0b0580 2023-10-16T13:40:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.753+0000 7ff9327fc700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff92006af90 0x7ff92006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.753+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff92c0896c0 con 0x7ff93c0b0580 2023-10-16T13:40:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.753+0000 7ff941661700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff92006af90 0x7ff92006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.754+0000 7ff941661700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff92006af90 0x7ff92006d450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff938000f60 tx=0x7ff938001e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.758+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff92c054700 con 0x7ff93c0b0580 2023-10-16T13:40:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.954+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff93c09f200 con 0x7ff92006af90 2023-10-16T13:40:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.963+0000 7ff9327fc700 1 -- 172.21.15.5:0/1514315374 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285320 (secure 0 0 0) 0x7ff93c09f200 con 0x7ff92006af90 2023-10-16T13:40:43.969 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.966+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff92006af90 msgr2=0x7ff92006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.966+0000 7ff9440c6700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff92006af90 0x7ff92006d450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff938000f60 tx=0x7ff938001e00 comp rx=0 tx=0).stop 2023-10-16T13:40:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.966+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 msgr2=0x7ff93c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.966+0000 7ff9440c6700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 0x7ff93c15ab50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00e9b0 tx=0x7ff92c00ecc0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 shutdown_connections 2023-10-16T13:40:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff92006af90 0x7ff92006d450 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff93c09e830 0x7ff93c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff93c0b0580 0x7ff93c15ab50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 --2- 172.21.15.5:0/1514315374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c15f050 0x7ff93c09e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 >> 172.21.15.5:0/1514315374 conn(0x7ff93c0d1620 msgr2=0x7ff93c0b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 shutdown_connections 2023-10-16T13:40:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:43.967+0000 7ff9440c6700 1 -- 172.21.15.5:0/1514315374 wait complete. 2023-10-16T13:40:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:43.981 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-10-16T13:40:43.491700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227340,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747380,"statfs":{"total":773094113280,"available":772861317120,"internally_reserved":0,"allocated":7151616,"data_stored":3709662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.695417"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809161+0000","last_change":"2023-10-16T13:40:39.826301+0000","last_active":"2023-10-16T13:40:40.809161+0000","last_peered":"2023-10-16T13:40:40.809161+0000","last_clean":"2023-10-16T13:40:40.809161+0000","last_became_active":"2023-10-16T13:40:39.825972+0000","last_became_peered":"2023-10-16T13:40:39.825972+0000","last_unstale":"2023-10-16T13:40:40.809161+0000","last_undegraded":"2023-10-16T13:40:40.809161+0000","last_fullsized":"2023-10-16T13:40:40.809161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:29.778901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215120+0000","last_change":"2023-10-16T13:40:39.820300+0000","last_active":"2023-10-16T13:40:41.215120+0000","last_peered":"2023-10-16T13:40:41.215120+0000","last_clean":"2023-10-16T13:40:41.215120+0000","last_became_active":"2023-10-16T13:40:39.819046+0000","last_became_peered":"2023-10-16T13:40:39.819046+0000","last_unstale":"2023-10-16T13:40:41.215120+0000","last_undegraded":"2023-10-16T13:40:41.215120+0000","last_fullsized":"2023-10-16T13:40:41.215120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:10.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715864+0000","last_change":"2023-10-16T13:40:39.820789+0000","last_active":"2023-10-16T13:40:41.715864+0000","last_peered":"2023-10-16T13:40:41.715864+0000","last_clean":"2023-10-16T13:40:41.715864+0000","last_became_active":"2023-10-16T13:40:39.820439+0000","last_became_peered":"2023-10-16T13:40:39.820439+0000","last_unstale":"2023-10-16T13:40:41.715864+0000","last_undegraded":"2023-10-16T13:40:41.715864+0000","last_fullsized":"2023-10-16T13:40:41.715864+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.296829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715734+0000","last_change":"2023-10-16T13:40:39.826643+0000","last_active":"2023-10-16T13:40:41.715734+0000","last_peered":"2023-10-16T13:40:41.715734+0000","last_clean":"2023-10-16T13:40:41.715734+0000","last_became_active":"2023-10-16T13:40:39.826372+0000","last_became_peered":"2023-10-16T13:40:39.826372+0000","last_unstale":"2023-10-16T13:40:41.715734+0000","last_undegraded":"2023-10-16T13:40:41.715734+0000","last_fullsized":"2023-10-16T13:40:41.715734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:24:18.733931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809062+0000","last_change":"2023-10-16T13:40:39.825527+0000","last_active":"2023-10-16T13:40:40.809062+0000","last_peered":"2023-10-16T13:40:40.809062+0000","last_clean":"2023-10-16T13:40:40.809062+0000","last_became_active":"2023-10-16T13:40:39.825063+0000","last_became_peered":"2023-10-16T13:40:39.825063+0000","last_unstale":"2023-10-16T13:40:40.809062+0000","last_undegraded":"2023-10-16T13:40:40.809062+0000","last_fullsized":"2023-10-16T13:40:40.809062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:14.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809901+0000","last_change":"2023-10-16T13:40:39.817076+0000","last_active":"2023-10-16T13:40:40.809901+0000","last_peered":"2023-10-16T13:40:40.809901+0000","last_clean":"2023-10-16T13:40:40.809901+0000","last_became_active":"2023-10-16T13:40:39.816711+0000","last_became_peered":"2023-10-16T13:40:39.816711+0000","last_unstale":"2023-10-16T13:40:40.809901+0000","last_undegraded":"2023-10-16T13:40:40.809901+0000","last_fullsized":"2023-10-16T13:40:40.809901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809507+0000","last_change":"2023-10-16T13:40:39.817668+0000","last_active":"2023-10-16T13:40:40.809507+0000","last_peered":"2023-10-16T13:40:40.809507+0000","last_clean":"2023-10-16T13:40:40.809507+0000","last_became_active":"2023-10-16T13:40:39.817379+0000","last_became_peered":"2023-10-16T13:40:39.817379+0000","last_unstale":"2023-10-16T13:40:40.809507+0000","last_undegraded":"2023-10-16T13:40:40.809507+0000","last_fullsized":"2023-10-16T13:40:40.809507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:00:37.091073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715889+0000","last_change":"2023-10-16T13:40:39.822984+0000","last_active":"2023-10-16T13:40:41.715889+0000","last_peered":"2023-10-16T13:40:41.715889+0000","last_clean":"2023-10-16T13:40:41.715889+0000","last_became_active":"2023-10-16T13:40:39.822343+0000","last_became_peered":"2023-10-16T13:40:39.822343+0000","last_unstale":"2023-10-16T13:40:41.715889+0000","last_undegraded":"2023-10-16T13:40:41.715889+0000","last_fullsized":"2023-10-16T13:40:41.715889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:41.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716282+0000","last_change":"2023-10-16T13:40:39.817841+0000","last_active":"2023-10-16T13:40:41.716282+0000","last_peered":"2023-10-16T13:40:41.716282+0000","last_clean":"2023-10-16T13:40:41.716282+0000","last_became_active":"2023-10-16T13:40:39.817542+0000","last_became_peered":"2023-10-16T13:40:39.817542+0000","last_unstale":"2023-10-16T13:40:41.716282+0000","last_undegraded":"2023-10-16T13:40:41.716282+0000","last_fullsized":"2023-10-16T13:40:41.716282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:28.616968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716080+0000","last_change":"2023-10-16T13:40:39.819853+0000","last_active":"2023-10-16T13:40:41.716080+0000","last_peered":"2023-10-16T13:40:41.716080+0000","last_clean":"2023-10-16T13:40:41.716080+0000","last_became_active":"2023-10-16T13:40:39.817614+0000","last_became_peered":"2023-10-16T13:40:39.817614+0000","last_unstale":"2023-10-16T13:40:41.716080+0000","last_undegraded":"2023-10-16T13:40:41.716080+0000","last_fullsized":"2023-10-16T13:40:41.716080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:18.669096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716055+0000","last_change":"2023-10-16T13:40:39.822782+0000","last_active":"2023-10-16T13:40:41.716055+0000","last_peered":"2023-10-16T13:40:41.716055+0000","last_clean":"2023-10-16T13:40:41.716055+0000","last_became_active":"2023-10-16T13:40:39.821980+0000","last_became_peered":"2023-10-16T13:40:39.821980+0000","last_unstale":"2023-10-16T13:40:41.716055+0000","last_undegraded":"2023-10-16T13:40:41.716055+0000","last_fullsized":"2023-10-16T13:40:41.716055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:06.909255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716453+0000","last_change":"2023-10-16T13:40:39.822271+0000","last_active":"2023-10-16T13:40:41.716453+0000","last_peered":"2023-10-16T13:40:41.716453+0000","last_clean":"2023-10-16T13:40:41.716453+0000","last_became_active":"2023-10-16T13:40:39.821902+0000","last_became_peered":"2023-10-16T13:40:39.821902+0000","last_unstale":"2023-10-16T13:40:41.716453+0000","last_undegraded":"2023-10-16T13:40:41.716453+0000","last_fullsized":"2023-10-16T13:40:41.716453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:36.878188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809262+0000","last_change":"2023-10-16T13:40:39.819724+0000","last_active":"2023-10-16T13:40:40.809262+0000","last_peered":"2023-10-16T13:40:40.809262+0000","last_clean":"2023-10-16T13:40:40.809262+0000","last_became_active":"2023-10-16T13:40:39.819422+0000","last_became_peered":"2023-10-16T13:40:39.819422+0000","last_unstale":"2023-10-16T13:40:40.809262+0000","last_undegraded":"2023-10-16T13:40:40.809262+0000","last_fullsized":"2023-10-16T13:40:40.809262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:22.575254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810517+0000","last_change":"2023-10-16T13:40:39.822183+0000","last_active":"2023-10-16T13:40:40.810517+0000","last_peered":"2023-10-16T13:40:40.810517+0000","last_clean":"2023-10-16T13:40:40.810517+0000","last_became_active":"2023-10-16T13:40:39.821886+0000","last_became_peered":"2023-10-16T13:40:39.821886+0000","last_unstale":"2023-10-16T13:40:40.810517+0000","last_undegraded":"2023-10-16T13:40:40.810517+0000","last_fullsized":"2023-10-16T13:40:40.810517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:13:19.191562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215119+0000","last_change":"2023-10-16T13:40:39.825254+0000","last_active":"2023-10-16T13:40:41.215119+0000","last_peered":"2023-10-16T13:40:41.215119+0000","last_clean":"2023-10-16T13:40:41.215119+0000","last_became_active":"2023-10-16T13:40:39.824904+0000","last_became_peered":"2023-10-16T13:40:39.824904+0000","last_unstale":"2023-10-16T13:40:41.215119+0000","last_undegraded":"2023-10-16T13:40:41.215119+0000","last_fullsized":"2023-10-16T13:40:41.215119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:37:09.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214929+0000","last_change":"2023-10-16T13:40:39.823762+0000","last_active":"2023-10-16T13:40:41.214929+0000","last_peered":"2023-10-16T13:40:41.214929+0000","last_clean":"2023-10-16T13:40:41.214929+0000","last_became_active":"2023-10-16T13:40:39.823215+0000","last_became_peered":"2023-10-16T13:40:39.823215+0000","last_unstale":"2023-10-16T13:40:41.214929+0000","last_undegraded":"2023-10-16T13:40:41.214929+0000","last_fullsized":"2023-10-16T13:40:41.214929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:24.798572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810097+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810097+0000","last_peered":"2023-10-16T13:40:40.810097+0000","last_clean":"2023-10-16T13:40:40.810097+0000","last_became_active":"2023-10-16T13:40:39.820879+0000","last_became_peered":"2023-10-16T13:40:39.820879+0000","last_unstale":"2023-10-16T13:40:40.810097+0000","last_undegraded":"2023-10-16T13:40:40.810097+0000","last_fullsized":"2023-10-16T13:40:40.810097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810169+0000","last_change":"2023-10-16T13:40:39.816419+0000","last_active":"2023-10-16T13:40:40.810169+0000","last_peered":"2023-10-16T13:40:40.810169+0000","last_clean":"2023-10-16T13:40:40.810169+0000","last_became_active":"2023-10-16T13:40:39.816092+0000","last_became_peered":"2023-10-16T13:40:39.816092+0000","last_unstale":"2023-10-16T13:40:40.810169+0000","last_undegraded":"2023-10-16T13:40:40.810169+0000","last_fullsized":"2023-10-16T13:40:40.810169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808812+0000","last_change":"2023-10-16T13:40:39.820724+0000","last_active":"2023-10-16T13:40:40.808812+0000","last_peered":"2023-10-16T13:40:40.808812+0000","last_clean":"2023-10-16T13:40:40.808812+0000","last_became_active":"2023-10-16T13:40:39.820464+0000","last_became_peered":"2023-10-16T13:40:39.820464+0000","last_unstale":"2023-10-16T13:40:40.808812+0000","last_undegraded":"2023-10-16T13:40:40.808812+0000","last_fullsized":"2023-10-16T13:40:40.808812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:59.734877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.800334+0000","last_change":"2023-10-16T13:40:37.800334+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.800334+0000","last_undegraded":"2023-10-16T13:40:37.800334+0000","last_fullsized":"2023-10-16T13:40:37.800334+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716115+0000","last_change":"2023-10-16T13:40:39.822604+0000","last_active":"2023-10-16T13:40:41.716115+0000","last_peered":"2023-10-16T13:40:41.716115+0000","last_clean":"2023-10-16T13:40:41.716115+0000","last_became_active":"2023-10-16T13:40:39.821385+0000","last_became_peered":"2023-10-16T13:40:39.821385+0000","last_unstale":"2023-10-16T13:40:41.716115+0000","last_undegraded":"2023-10-16T13:40:41.716115+0000","last_fullsized":"2023-10-16T13:40:41.716115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:41.889159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.801877+0000","last_change":"2023-10-16T13:40:37.801877+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.801877+0000","last_undegraded":"2023-10-16T13:40:37.801877+0000","last_fullsized":"2023-10-16T13:40:37.801877+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809425+0000","last_change":"2023-10-16T13:40:39.827023+0000","last_active":"2023-10-16T13:40:40.809425+0000","last_peered":"2023-10-16T13:40:40.809425+0000","last_clean":"2023-10-16T13:40:40.809425+0000","last_became_active":"2023-10-16T13:40:39.825744+0000","last_became_peered":"2023-10-16T13:40:39.825744+0000","last_unstale":"2023-10-16T13:40:40.809425+0000","last_undegraded":"2023-10-16T13:40:40.809425+0000","last_fullsized":"2023-10-16T13:40:40.809425+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:25.807534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797724+0000","last_change":"2023-10-16T13:40:37.797724+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797724+0000","last_undegraded":"2023-10-16T13:40:37.797724+0000","last_fullsized":"2023-10-16T13:40:37.797724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840162+0000","last_change":"2023-10-16T13:40:38.820937+0000","last_active":"2023-10-16T13:40:39.840162+0000","last_peered":"2023-10-16T13:40:39.840162+0000","last_clean":"2023-10-16T13:40:39.840162+0000","last_became_active":"2023-10-16T13:40:38.820601+0000","last_became_peered":"2023-10-16T13:40:38.820601+0000","last_unstale":"2023-10-16T13:40:39.840162+0000","last_undegraded":"2023-10-16T13:40:39.840162+0000","last_fullsized":"2023-10-16T13:40:39.840162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:05.904450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810245+0000","last_change":"2023-10-16T13:40:39.819143+0000","last_active":"2023-10-16T13:40:40.810245+0000","last_peered":"2023-10-16T13:40:40.810245+0000","last_clean":"2023-10-16T13:40:40.810245+0000","last_became_active":"2023-10-16T13:40:39.818866+0000","last_became_peered":"2023-10-16T13:40:39.818866+0000","last_unstale":"2023-10-16T13:40:40.810245+0000","last_undegraded":"2023-10-16T13:40:40.810245+0000","last_fullsized":"2023-10-16T13:40:40.810245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.845415+0000","last_change":"2023-10-16T13:40:38.815449+0000","last_active":"2023-10-16T13:40:39.845415+0000","last_peered":"2023-10-16T13:40:39.845415+0000","last_clean":"2023-10-16T13:40:39.845415+0000","last_became_active":"2023-10-16T13:40:38.815189+0000","last_became_peered":"2023-10-16T13:40:38.815189+0000","last_unstale":"2023-10-16T13:40:39.845415+0000","last_undegraded":"2023-10-16T13:40:39.845415+0000","last_fullsized":"2023-10-16T13:40:39.845415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:24.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.839986+0000","last_change":"2023-10-16T13:40:38.821853+0000","last_active":"2023-10-16T13:40:39.839986+0000","last_peered":"2023-10-16T13:40:39.839986+0000","last_clean":"2023-10-16T13:40:39.839986+0000","last_became_active":"2023-10-16T13:40:38.821494+0000","last_became_peered":"2023-10-16T13:40:38.821494+0000","last_unstale":"2023-10-16T13:40:39.839986+0000","last_undegraded":"2023-10-16T13:40:39.839986+0000","last_fullsized":"2023-10-16T13:40:39.839986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:11.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715181+0000","last_change":"2023-10-16T13:40:39.827080+0000","last_active":"2023-10-16T13:40:41.715181+0000","last_peered":"2023-10-16T13:40:41.715181+0000","last_clean":"2023-10-16T13:40:41.715181+0000","last_became_active":"2023-10-16T13:40:39.826753+0000","last_became_peered":"2023-10-16T13:40:39.826753+0000","last_unstale":"2023-10-16T13:40:41.715181+0000","last_undegraded":"2023-10-16T13:40:41.715181+0000","last_fullsized":"2023-10-16T13:40:41.715181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:19.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809900+0000","last_change":"2023-10-16T13:40:38.820205+0000","last_active":"2023-10-16T13:40:39.809900+0000","last_peered":"2023-10-16T13:40:39.809900+0000","last_clean":"2023-10-16T13:40:39.809900+0000","last_became_active":"2023-10-16T13:40:38.819870+0000","last_became_peered":"2023-10-16T13:40:38.819870+0000","last_unstale":"2023-10-16T13:40:39.809900+0000","last_undegraded":"2023-10-16T13:40:39.809900+0000","last_fullsized":"2023-10-16T13:40:39.809900+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:54.803860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805349+0000","last_change":"2023-10-16T13:40:38.819977+0000","last_active":"2023-10-16T13:40:39.805349+0000","last_peered":"2023-10-16T13:40:39.805349+0000","last_clean":"2023-10-16T13:40:39.805349+0000","last_became_active":"2023-10-16T13:40:38.819676+0000","last_became_peered":"2023-10-16T13:40:38.819676+0000","last_unstale":"2023-10-16T13:40:39.805349+0000","last_undegraded":"2023-10-16T13:40:39.805349+0000","last_fullsized":"2023-10-16T13:40:39.805349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:53.008354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810642+0000","last_change":"2023-10-16T13:40:39.824725+0000","last_active":"2023-10-16T13:40:40.810642+0000","last_peered":"2023-10-16T13:40:40.810642+0000","last_clean":"2023-10-16T13:40:40.810642+0000","last_became_active":"2023-10-16T13:40:39.824452+0000","last_became_peered":"2023-10-16T13:40:39.824452+0000","last_unstale":"2023-10-16T13:40:40.810642+0000","last_undegraded":"2023-10-16T13:40:40.810642+0000","last_fullsized":"2023-10-16T13:40:40.810642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:27.067030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.798172+0000","last_change":"2023-10-16T13:40:37.798172+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.798172+0000","last_undegraded":"2023-10-16T13:40:37.798172+0000","last_fullsized":"2023-10-16T13:40:37.798172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812283+0000","last_change":"2023-10-16T13:40:38.818983+0000","last_active":"2023-10-16T13:40:39.812283+0000","last_peered":"2023-10-16T13:40:39.812283+0000","last_clean":"2023-10-16T13:40:39.812283+0000","last_became_active":"2023-10-16T13:40:38.818660+0000","last_became_peered":"2023-10-16T13:40:38.818660+0000","last_unstale":"2023-10-16T13:40:39.812283+0000","last_undegraded":"2023-10-16T13:40:39.812283+0000","last_fullsized":"2023-10-16T13:40:39.812283+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:06.070222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809240+0000","last_change":"2023-10-16T13:40:39.824564+0000","last_active":"2023-10-16T13:40:40.809240+0000","last_peered":"2023-10-16T13:40:40.809240+0000","last_clean":"2023-10-16T13:40:40.809240+0000","last_became_active":"2023-10-16T13:40:39.824255+0000","last_became_peered":"2023-10-16T13:40:39.824255+0000","last_unstale":"2023-10-16T13:40:40.809240+0000","last_undegraded":"2023-10-16T13:40:40.809240+0000","last_fullsized":"2023-10-16T13:40:40.809240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:47.276160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842913+0000","last_change":"2023-10-16T13:40:38.817847+0000","last_active":"2023-10-16T13:40:39.842913+0000","last_peered":"2023-10-16T13:40:39.842913+0000","last_clean":"2023-10-16T13:40:39.842913+0000","last_became_active":"2023-10-16T13:40:38.817561+0000","last_became_peered":"2023-10-16T13:40:38.817561+0000","last_unstale":"2023-10-16T13:40:39.842913+0000","last_undegraded":"2023-10-16T13:40:39.842913+0000","last_fullsized":"2023-10-16T13:40:39.842913+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:45.576746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715899+0000","last_change":"2023-10-16T13:40:39.817345+0000","last_active":"2023-10-16T13:40:41.715899+0000","last_peered":"2023-10-16T13:40:41.715899+0000","last_clean":"2023-10-16T13:40:41.715899+0000","last_became_active":"2023-10-16T13:40:39.817042+0000","last_became_peered":"2023-10-16T13:40:39.817042+0000","last_unstale":"2023-10-16T13:40:41.715899+0000","last_undegraded":"2023-10-16T13:40:41.715899+0000","last_fullsized":"2023-10-16T13:40:41.715899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:47.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.847149+0000","last_change":"2023-10-16T13:40:38.816845+0000","last_active":"2023-10-16T13:40:39.847149+0000","last_peered":"2023-10-16T13:40:39.847149+0000","last_clean":"2023-10-16T13:40:39.847149+0000","last_became_active":"2023-10-16T13:40:38.816563+0000","last_became_peered":"2023-10-16T13:40:38.816563+0000","last_unstale":"2023-10-16T13:40:39.847149+0000","last_undegraded":"2023-10-16T13:40:39.847149+0000","last_fullsized":"2023-10-16T13:40:39.847149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:52.412223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843212+0000","last_change":"2023-10-16T13:40:38.818745+0000","last_active":"2023-10-16T13:40:39.843212+0000","last_peered":"2023-10-16T13:40:39.843212+0000","last_clean":"2023-10-16T13:40:39.843212+0000","last_became_active":"2023-10-16T13:40:38.818380+0000","last_became_peered":"2023-10-16T13:40:38.818380+0000","last_unstale":"2023-10-16T13:40:39.843212+0000","last_undegraded":"2023-10-16T13:40:39.843212+0000","last_fullsized":"2023-10-16T13:40:39.843212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810402+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810402+0000","last_peered":"2023-10-16T13:40:40.810402+0000","last_clean":"2023-10-16T13:40:40.810402+0000","last_became_active":"2023-10-16T13:40:39.820851+0000","last_became_peered":"2023-10-16T13:40:39.820851+0000","last_unstale":"2023-10-16T13:40:40.810402+0000","last_undegraded":"2023-10-16T13:40:40.810402+0000","last_fullsized":"2023-10-16T13:40:40.810402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812337+0000","last_change":"2023-10-16T13:40:38.821394+0000","last_active":"2023-10-16T13:40:39.812337+0000","last_peered":"2023-10-16T13:40:39.812337+0000","last_clean":"2023-10-16T13:40:39.812337+0000","last_became_active":"2023-10-16T13:40:38.821071+0000","last_became_peered":"2023-10-16T13:40:38.821071+0000","last_unstale":"2023-10-16T13:40:39.812337+0000","last_undegraded":"2023-10-16T13:40:39.812337+0000","last_fullsized":"2023-10-16T13:40:39.812337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:57:29.111116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809248+0000","last_change":"2023-10-16T13:40:38.815484+0000","last_active":"2023-10-16T13:40:39.809248+0000","last_peered":"2023-10-16T13:40:39.809248+0000","last_clean":"2023-10-16T13:40:39.809248+0000","last_became_active":"2023-10-16T13:40:38.815154+0000","last_became_peered":"2023-10-16T13:40:38.815154+0000","last_unstale":"2023-10-16T13:40:39.809248+0000","last_undegraded":"2023-10-16T13:40:39.809248+0000","last_fullsized":"2023-10-16T13:40:39.809248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:55.109057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715501+0000","last_change":"2023-10-16T13:40:39.821845+0000","last_active":"2023-10-16T13:40:41.715501+0000","last_peered":"2023-10-16T13:40:41.715501+0000","last_clean":"2023-10-16T13:40:41.715501+0000","last_became_active":"2023-10-16T13:40:39.821282+0000","last_became_peered":"2023-10-16T13:40:39.821282+0000","last_unstale":"2023-10-16T13:40:41.715501+0000","last_undegraded":"2023-10-16T13:40:41.715501+0000","last_fullsized":"2023-10-16T13:40:41.715501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:16.745728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797735+0000","last_change":"2023-10-16T13:40:37.797735+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797735+0000","last_undegraded":"2023-10-16T13:40:37.797735+0000","last_fullsized":"2023-10-16T13:40:37.797735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842725+0000","last_change":"2023-10-16T13:40:38.827807+0000","last_active":"2023-10-16T13:40:39.842725+0000","last_peered":"2023-10-16T13:40:39.842725+0000","last_clean":"2023-10-16T13:40:39.842725+0000","last_became_active":"2023-10-16T13:40:38.827562+0000","last_became_peered":"2023-10-16T13:40:38.827562+0000","last_unstale":"2023-10-16T13:40:39.842725+0000","last_undegraded":"2023-10-16T13:40:39.842725+0000","last_fullsized":"2023-10-16T13:40:39.842725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:17.664292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797842+0000","last_change":"2023-10-16T13:40:37.797842+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797842+0000","last_undegraded":"2023-10-16T13:40:37.797842+0000","last_fullsized":"2023-10-16T13:40:37.797842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716385+0000","last_change":"2023-10-16T13:40:39.817797+0000","last_active":"2023-10-16T13:40:41.716385+0000","last_peered":"2023-10-16T13:40:41.716385+0000","last_clean":"2023-10-16T13:40:41.716385+0000","last_became_active":"2023-10-16T13:40:39.817154+0000","last_became_peered":"2023-10-16T13:40:39.817154+0000","last_unstale":"2023-10-16T13:40:41.716385+0000","last_undegraded":"2023-10-16T13:40:41.716385+0000","last_fullsized":"2023-10-16T13:40:41.716385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:56.113861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843250+0000","last_change":"2023-10-16T13:40:38.821194+0000","last_active":"2023-10-16T13:40:39.843250+0000","last_peered":"2023-10-16T13:40:39.843250+0000","last_clean":"2023-10-16T13:40:39.843250+0000","last_became_active":"2023-10-16T13:40:38.820062+0000","last_became_peered":"2023-10-16T13:40:38.820062+0000","last_unstale":"2023-10-16T13:40:39.843250+0000","last_undegraded":"2023-10-16T13:40:39.843250+0000","last_fullsized":"2023-10-16T13:40:39.843250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:32.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715891+0000","last_change":"2023-10-16T13:40:39.826550+0000","last_active":"2023-10-16T13:40:41.715891+0000","last_peered":"2023-10-16T13:40:41.715891+0000","last_clean":"2023-10-16T13:40:41.715891+0000","last_became_active":"2023-10-16T13:40:39.826243+0000","last_became_peered":"2023-10-16T13:40:39.826243+0000","last_unstale":"2023-10-16T13:40:41.715891+0000","last_undegraded":"2023-10-16T13:40:41.715891+0000","last_fullsized":"2023-10-16T13:40:41.715891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:41.376812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.800345+0000","last_change":"2023-10-16T13:40:37.800345+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.800345+0000","last_undegraded":"2023-10-16T13:40:37.800345+0000","last_fullsized":"2023-10-16T13:40:37.800345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214983+0000","last_change":"2023-10-16T13:40:39.820400+0000","last_active":"2023-10-16T13:40:41.214983+0000","last_peered":"2023-10-16T13:40:41.214983+0000","last_clean":"2023-10-16T13:40:41.214983+0000","last_became_active":"2023-10-16T13:40:39.820107+0000","last_became_peered":"2023-10-16T13:40:39.820107+0000","last_unstale":"2023-10-16T13:40:41.214983+0000","last_undegraded":"2023-10-16T13:40:41.214983+0000","last_fullsized":"2023-10-16T13:40:41.214983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:30.379729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812497+0000","last_change":"2023-10-16T13:40:38.819491+0000","last_active":"2023-10-16T13:40:39.812497+0000","last_peered":"2023-10-16T13:40:39.812497+0000","last_clean":"2023-10-16T13:40:39.812497+0000","last_became_active":"2023-10-16T13:40:38.819167+0000","last_became_peered":"2023-10-16T13:40:38.819167+0000","last_unstale":"2023-10-16T13:40:39.812497+0000","last_undegraded":"2023-10-16T13:40:39.812497+0000","last_fullsized":"2023-10-16T13:40:39.812497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:24.574150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215007+0000","last_change":"2023-10-16T13:40:39.822722+0000","last_active":"2023-10-16T13:40:41.215007+0000","last_peered":"2023-10-16T13:40:41.215007+0000","last_clean":"2023-10-16T13:40:41.215007+0000","last_became_active":"2023-10-16T13:40:39.821553+0000","last_became_peered":"2023-10-16T13:40:39.821553+0000","last_unstale":"2023-10-16T13:40:41.215007+0000","last_undegraded":"2023-10-16T13:40:41.215007+0000","last_fullsized":"2023-10-16T13:40:41.215007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:03.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809399+0000","last_change":"2023-10-16T13:40:38.816423+0000","last_active":"2023-10-16T13:40:39.809399+0000","last_peered":"2023-10-16T13:40:39.809399+0000","last_clean":"2023-10-16T13:40:39.809399+0000","last_became_active":"2023-10-16T13:40:38.815912+0000","last_became_peered":"2023-10-16T13:40:38.815912+0000","last_unstale":"2023-10-16T13:40:39.809399+0000","last_undegraded":"2023-10-16T13:40:39.809399+0000","last_fullsized":"2023-10-16T13:40:39.809399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:27.612163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214957+0000","last_change":"2023-10-16T13:40:39.824262+0000","last_active":"2023-10-16T13:40:41.214957+0000","last_peered":"2023-10-16T13:40:41.214957+0000","last_clean":"2023-10-16T13:40:41.214957+0000","last_became_active":"2023-10-16T13:40:39.823930+0000","last_became_peered":"2023-10-16T13:40:39.823930+0000","last_unstale":"2023-10-16T13:40:41.214957+0000","last_undegraded":"2023-10-16T13:40:41.214957+0000","last_fullsized":"2023-10-16T13:40:41.214957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:51.876599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.801838+0000","last_change":"2023-10-16T13:40:37.801838+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.801838+0000","last_undegraded":"2023-10-16T13:40:37.801838+0000","last_fullsized":"2023-10-16T13:40:37.801838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.841270+0000","last_change":"2023-10-16T13:40:38.827775+0000","last_active":"2023-10-16T13:40:39.841270+0000","last_peered":"2023-10-16T13:40:39.841270+0000","last_clean":"2023-10-16T13:40:39.841270+0000","last_became_active":"2023-10-16T13:40:38.827564+0000","last_became_peered":"2023-10-16T13:40:38.827564+0000","last_unstale":"2023-10-16T13:40:39.841270+0000","last_undegraded":"2023-10-16T13:40:39.841270+0000","last_fullsized":"2023-10-16T13:40:39.841270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:54.568956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810404+0000","last_change":"2023-10-16T13:40:39.816893+0000","last_active":"2023-10-16T13:40:40.810404+0000","last_peered":"2023-10-16T13:40:40.810404+0000","last_clean":"2023-10-16T13:40:40.810404+0000","last_became_active":"2023-10-16T13:40:39.816559+0000","last_became_peered":"2023-10-16T13:40:39.816559+0000","last_unstale":"2023-10-16T13:40:40.810404+0000","last_undegraded":"2023-10-16T13:40:40.810404+0000","last_fullsized":"2023-10-16T13:40:40.810404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811471+0000","last_change":"2023-10-16T13:40:38.815314+0000","last_active":"2023-10-16T13:40:39.811471+0000","last_peered":"2023-10-16T13:40:39.811471+0000","last_clean":"2023-10-16T13:40:39.811471+0000","last_became_active":"2023-10-16T13:40:38.814850+0000","last_became_peered":"2023-10-16T13:40:38.814850+0000","last_unstale":"2023-10-16T13:40:39.811471+0000","last_undegraded":"2023-10-16T13:40:39.811471+0000","last_fullsized":"2023-10-16T13:40:39.811471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:01.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.806258+0000","last_change":"2023-10-16T13:40:38.815831+0000","last_active":"2023-10-16T13:40:39.806258+0000","last_peered":"2023-10-16T13:40:39.806258+0000","last_clean":"2023-10-16T13:40:39.806258+0000","last_became_active":"2023-10-16T13:40:38.815540+0000","last_became_peered":"2023-10-16T13:40:38.815540+0000","last_unstale":"2023-10-16T13:40:39.806258+0000","last_undegraded":"2023-10-16T13:40:39.806258+0000","last_fullsized":"2023-10-16T13:40:39.806258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:29:02.491892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.802010+0000","last_change":"2023-10-16T13:40:37.802010+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.802010+0000","last_undegraded":"2023-10-16T13:40:37.802010+0000","last_fullsized":"2023-10-16T13:40:37.802010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716126+0000","last_change":"2023-10-16T13:40:39.821518+0000","last_active":"2023-10-16T13:40:41.716126+0000","last_peered":"2023-10-16T13:40:41.716126+0000","last_clean":"2023-10-16T13:40:41.716126+0000","last_became_active":"2023-10-16T13:40:39.821128+0000","last_became_peered":"2023-10-16T13:40:39.821128+0000","last_unstale":"2023-10-16T13:40:41.716126+0000","last_undegraded":"2023-10-16T13:40:41.716126+0000","last_fullsized":"2023-10-16T13:40:41.716126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:33.784224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805532+0000","last_change":"2023-10-16T13:40:38.819885+0000","last_active":"2023-10-16T13:40:39.805532+0000","last_peered":"2023-10-16T13:40:39.805532+0000","last_clean":"2023-10-16T13:40:39.805532+0000","last_became_active":"2023-10-16T13:40:38.819622+0000","last_became_peered":"2023-10-16T13:40:38.819622+0000","last_unstale":"2023-10-16T13:40:39.805532+0000","last_undegraded":"2023-10-16T13:40:39.805532+0000","last_fullsized":"2023-10-16T13:40:39.805532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:17:33.819262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808911+0000","last_change":"2023-10-16T13:40:39.825984+0000","last_active":"2023-10-16T13:40:40.808911+0000","last_peered":"2023-10-16T13:40:40.808911+0000","last_clean":"2023-10-16T13:40:40.808911+0000","last_became_active":"2023-10-16T13:40:39.825650+0000","last_became_peered":"2023-10-16T13:40:39.825650+0000","last_unstale":"2023-10-16T13:40:40.808911+0000","last_undegraded":"2023-10-16T13:40:40.808911+0000","last_fullsized":"2023-10-16T13:40:40.808911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:36:34.339968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810108+0000","last_change":"2023-10-16T13:40:38.820149+0000","last_active":"2023-10-16T13:40:39.810108+0000","last_peered":"2023-10-16T13:40:39.810108+0000","last_clean":"2023-10-16T13:40:39.810108+0000","last_became_active":"2023-10-16T13:40:38.819853+0000","last_became_peered":"2023-10-16T13:40:38.819853+0000","last_unstale":"2023-10-16T13:40:39.810108+0000","last_undegraded":"2023-10-16T13:40:39.810108+0000","last_fullsized":"2023-10-16T13:40:39.810108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:30.874102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715368+0000","last_change":"2023-10-16T13:40:39.818863+0000","last_active":"2023-10-16T13:40:41.715368+0000","last_peered":"2023-10-16T13:40:41.715368+0000","last_clean":"2023-10-16T13:40:41.715368+0000","last_became_active":"2023-10-16T13:40:39.818500+0000","last_became_peered":"2023-10-16T13:40:39.818500+0000","last_unstale":"2023-10-16T13:40:41.715368+0000","last_undegraded":"2023-10-16T13:40:41.715368+0000","last_fullsized":"2023-10-16T13:40:41.715368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:48.678490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.798474+0000","last_change":"2023-10-16T13:40:37.798474+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.798474+0000","last_undegraded":"2023-10-16T13:40:37.798474+0000","last_fullsized":"2023-10-16T13:40:37.798474+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809466+0000","last_change":"2023-10-16T13:40:39.820186+0000","last_active":"2023-10-16T13:40:40.809466+0000","last_peered":"2023-10-16T13:40:40.809466+0000","last_clean":"2023-10-16T13:40:40.809466+0000","last_became_active":"2023-10-16T13:40:39.819347+0000","last_became_peered":"2023-10-16T13:40:39.819347+0000","last_unstale":"2023-10-16T13:40:40.809466+0000","last_undegraded":"2023-10-16T13:40:40.809466+0000","last_fullsized":"2023-10-16T13:40:40.809466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:04.033107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810851+0000","last_change":"2023-10-16T13:40:38.821117+0000","last_active":"2023-10-16T13:40:39.810851+0000","last_peered":"2023-10-16T13:40:39.810851+0000","last_clean":"2023-10-16T13:40:39.810851+0000","last_became_active":"2023-10-16T13:40:38.820818+0000","last_became_peered":"2023-10-16T13:40:38.820818+0000","last_unstale":"2023-10-16T13:40:39.810851+0000","last_undegraded":"2023-10-16T13:40:39.810851+0000","last_fullsized":"2023-10-16T13:40:39.810851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:46.343827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215042+0000","last_change":"2023-10-16T13:40:39.824316+0000","last_active":"2023-10-16T13:40:41.215042+0000","last_peered":"2023-10-16T13:40:41.215042+0000","last_clean":"2023-10-16T13:40:41.215042+0000","last_became_active":"2023-10-16T13:40:39.824016+0000","last_became_peered":"2023-10-16T13:40:39.824016+0000","last_unstale":"2023-10-16T13:40:41.215042+0000","last_undegraded":"2023-10-16T13:40:41.215042+0000","last_fullsized":"2023-10-16T13:40:41.215042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:13.061966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840115+0000","last_change":"2023-10-16T13:40:38.818953+0000","last_active":"2023-10-16T13:40:39.840115+0000","last_peered":"2023-10-16T13:40:39.840115+0000","last_clean":"2023-10-16T13:40:39.840115+0000","last_became_active":"2023-10-16T13:40:38.818613+0000","last_became_peered":"2023-10-16T13:40:38.818613+0000","last_unstale":"2023-10-16T13:40:39.840115+0000","last_undegraded":"2023-10-16T13:40:39.840115+0000","last_fullsized":"2023-10-16T13:40:39.840115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:40.884355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-16T13:40:36.729188+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:36.729188+0000","last_peered":"2023-10-16T13:40:36.729188+0000","last_clean":"2023-10-16T13:40:36.729188+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:36.729188+0000","last_undegraded":"2023-10-16T13:40:36.729188+0000","last_fullsized":"2023-10-16T13:40:36.729188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":78,"acting":78,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1310720,"data_stored":894128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.499},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.80000000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.873,"15min":0.873},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.0509999999999999,"15min":1.133},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.081,"5min":10.964,"15min":10.964},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67700000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.48799999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":325338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.503,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":0.49199999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.752,"15min":0.752},"last":0.373}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56000000000000005,"5min":0.88,"15min":0.88},"last":0.309},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63500000000000001,"5min":1.002,"15min":1.002},"last":1.4390000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85999999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.131,"15min":1.131},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88800000000000001,"5min":1.034,"15min":1.034},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85099999999999998,"5min":1.085,"15min":1.085},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1306624,"data_stored":893109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.41299999999999998,"15min":0.38400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.42199999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.433,"15min":0.40899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41899999999999998,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.375},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.625,"15min":0.60099999999999998},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0190000000000001,"5min":4.0190000000000001,"15min":4.0190000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.63900000000000001,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.0650000000000004,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.5},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.63,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.64900000000000002,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.69199999999999995,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.46400000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.216},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26900000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63500000000000001,"5min":1.153,"15min":1.153},"last":0.318}]},{"osd":4,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.054,"15min":1.054},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442}]},{"osd":5,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":1.111,"15min":1.111},"last":0.497}]},{"osd":7,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.23,"15min":1.23},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.57299999999999995,"15min":0.61399999999999999},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.623,"5min":2.181,"15min":2.181},"last":0.501}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49299999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56200000000000006,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80700000000000005,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.83899999999999997,"15min":0.88100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.72299999999999998,"15min":0.746},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79400000000000004,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73599999999999999,"15min":0.75900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77800000000000002,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76000000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.84399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.88800000000000001,"15min":0.93600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77900000000000003,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78300000000000003,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":303760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":0.88},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.877,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66700000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.141,"15min":1.141},"last":0.373},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.43099999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:43.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.143+0000 7fc0500d8700 1 Processor -- start 2023-10-16T13:40:44.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.144+0000 7fc0500d8700 1 -- start start 2023-10-16T13:40:44.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.144+0000 7fc0500d8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 0x7fc04815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.144+0000 7fc0500d8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.144+0000 7fc0500d8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04815e7a0 con 0x7fc0480b1f50 2023-10-16T13:40:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.144+0000 7fc0500d8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04815f730 con 0x7fc04815ab10 2023-10-16T13:40:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.144+0000 7fc0500d8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480b29a0 con 0x7fc0480cfe30 2023-10-16T13:40:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04de74700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 0x7fc04815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04d673700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc0480b1f50 0x7fc0480cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46816/0 (socket says 172.21.15.5:46816) 2023-10-16T13:40:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04de74700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 0x7fc04815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:41732/0 (socket says 172.21.15.5:41732) 2023-10-16T13:40:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04d673700 1 -- 172.21.15.5:0/393270247 learned_addr learned my addr 172.21.15.5:0/393270247 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43744/0 (socket says 172.21.15.5:43744) 2023-10-16T13:40:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 -- 172.21.15.5:0/393270247 >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 msgr2=0x7fc04815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 --2- 172.21.15.5:0/393270247 >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 0x7fc04815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 -- 172.21.15.5:0/393270247 >> v1:172.21.15.112:6789/0 conn(0x7fc0480b1f50 legacy=0x7fc0480cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 -- 172.21.15.5:0/393270247 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480b2c80 con 0x7fc0480cfe30 2023-10-16T13:40:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04de74700 1 --2- 172.21.15.5:0/393270247 >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 0x7fc04815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04e675700 1 --2- 172.21.15.5:0/393270247 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480cbf40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc040009d90 tx=0x7fc04000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=456382097a4fc105 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.145+0000 7fc04ce72700 1 -- 172.21.15.5:0/393270247 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04000e070 con 0x7fc0480cfe30 2023-10-16T13:40:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc04ce72700 1 -- 172.21.15.5:0/393270247 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04000bb20 con 0x7fc0480cfe30 2023-10-16T13:40:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc04ce72700 1 -- 172.21.15.5:0/393270247 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040012430 con 0x7fc0480cfe30 2023-10-16T13:40:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 -- 172.21.15.5:0/393270247 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 msgr2=0x7fc0480cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 --2- 172.21.15.5:0/393270247 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480cbf40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc040009d90 tx=0x7fc04000b330 comp rx=0 tx=0).stop 2023-10-16T13:40:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 -- 172.21.15.5:0/393270247 shutdown_connections 2023-10-16T13:40:44.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 --2- 172.21.15.5:0/393270247 >> v2:172.21.15.112:3300/0 conn(0x7fc04815ab10 0x7fc04815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 --2- 172.21.15.5:0/393270247 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480cbf40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 -- 172.21.15.5:0/393270247 >> 172.21.15.5:0/393270247 conn(0x7fc04806dae0 msgr2=0x7fc04806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:44.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 -- 172.21.15.5:0/393270247 shutdown_connections 2023-10-16T13:40:44.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.146+0000 7fc0500d8700 1 -- 172.21.15.5:0/393270247 wait complete. 2023-10-16T13:40:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.147+0000 7fc0500d8700 1 Processor -- start 2023-10-16T13:40:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.147+0000 7fc0500d8700 1 -- start start 2023-10-16T13:40:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc0500d8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0480b1f50 0x7fc048151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc0500d8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc0500d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 0x7fc0480cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc0500d8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480b41b0 con 0x7fc04815ab10 2023-10-16T13:40:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc0500d8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480b4470 con 0x7fc0480b1f50 2023-10-16T13:40:44.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc0500d8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc048155b20 con 0x7fc0480cfe30 2023-10-16T13:40:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc04e675700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 0x7fc0480cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc04e675700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 0x7fc0480cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45846/0 (socket says 172.21.15.5:45846) 2023-10-16T13:40:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.148+0000 7fc04e675700 1 -- 172.21.15.5:0/1871072686 learned_addr learned my addr 172.21.15.5:0/1871072686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04de74700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0480b1f50 0x7fc048151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04d673700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04e675700 1 -- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 msgr2=0x7fc0480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04e675700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04e675700 1 -- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0480b1f50 msgr2=0x7fc048151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04e675700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0480b1f50 0x7fc048151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04e675700 1 -- 172.21.15.5:0/1871072686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0094a0 con 0x7fc04815ab10 2023-10-16T13:40:44.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc04e675700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 0x7fc0480cce20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc040014040 tx=0x7fc040004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040012430 con 0x7fc04815ab10 2023-10-16T13:40:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc040020070 con 0x7fc04815ab10 2023-10-16T13:40:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc040009a70 con 0x7fc04815ab10 2023-10-16T13:40:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040003ea0 con 0x7fc04815ab10 2023-10-16T13:40:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.149+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0480d0a70 con 0x7fc04815ab10 2023-10-16T13:40:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.150+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0480b4620 con 0x7fc04815ab10 2023-10-16T13:40:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.151+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fc040004040 con 0x7fc04815ab10 2023-10-16T13:40:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.151+0000 7fc03a7fc700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc02c06af90 0x7fc02c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.151+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc040022070 con 0x7fc04815ab10 2023-10-16T13:40:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.151+0000 7fc04de74700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc02c06af90 0x7fc02c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.152+0000 7fc04de74700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc02c06af90 0x7fc02c06d450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009d70 tx=0x7fc03c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.156+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0480b4620 con 0x7fc04815ab10 2023-10-16T13:40:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.353+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc04815ecd0 con 0x7fc02c06af90 2023-10-16T13:40:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.362+0000 7fc03a7fc700 1 -- 172.21.15.5:0/1871072686 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285320 (secure 0 0 0) 0x7fc03c0099c0 con 0x7fc02c06af90 2023-10-16T13:40:44.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc02c06af90 msgr2=0x7fc02c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc02c06af90 0x7fc02c06d450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009d70 tx=0x7fc03c009210 comp rx=0 tx=0).stop 2023-10-16T13:40:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 msgr2=0x7fc0480cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 0x7fc0480cce20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc040014040 tx=0x7fc040004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 shutdown_connections 2023-10-16T13:40:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04815ab10 0x7fc0480cce20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0480b1f50 0x7fc048151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc02c06af90 0x7fc02c06d450 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 --2- 172.21.15.5:0/1871072686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0480cfe30 0x7fc0480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 >> 172.21.15.5:0/1871072686 conn(0x7fc04806dae0 msgr2=0x7fc0480cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 shutdown_connections 2023-10-16T13:40:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.365+0000 7fc0500d8700 1 -- 172.21.15.5:0/1871072686 wait complete. 2023-10-16T13:40:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:44.381 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-10-16T13:40:43.491700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227340,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747380,"statfs":{"total":773094113280,"available":772861317120,"internally_reserved":0,"allocated":7151616,"data_stored":3709662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.695417"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809161+0000","last_change":"2023-10-16T13:40:39.826301+0000","last_active":"2023-10-16T13:40:40.809161+0000","last_peered":"2023-10-16T13:40:40.809161+0000","last_clean":"2023-10-16T13:40:40.809161+0000","last_became_active":"2023-10-16T13:40:39.825972+0000","last_became_peered":"2023-10-16T13:40:39.825972+0000","last_unstale":"2023-10-16T13:40:40.809161+0000","last_undegraded":"2023-10-16T13:40:40.809161+0000","last_fullsized":"2023-10-16T13:40:40.809161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:29.778901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215120+0000","last_change":"2023-10-16T13:40:39.820300+0000","last_active":"2023-10-16T13:40:41.215120+0000","last_peered":"2023-10-16T13:40:41.215120+0000","last_clean":"2023-10-16T13:40:41.215120+0000","last_became_active":"2023-10-16T13:40:39.819046+0000","last_became_peered":"2023-10-16T13:40:39.819046+0000","last_unstale":"2023-10-16T13:40:41.215120+0000","last_undegraded":"2023-10-16T13:40:41.215120+0000","last_fullsized":"2023-10-16T13:40:41.215120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:10.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715864+0000","last_change":"2023-10-16T13:40:39.820789+0000","last_active":"2023-10-16T13:40:41.715864+0000","last_peered":"2023-10-16T13:40:41.715864+0000","last_clean":"2023-10-16T13:40:41.715864+0000","last_became_active":"2023-10-16T13:40:39.820439+0000","last_became_peered":"2023-10-16T13:40:39.820439+0000","last_unstale":"2023-10-16T13:40:41.715864+0000","last_undegraded":"2023-10-16T13:40:41.715864+0000","last_fullsized":"2023-10-16T13:40:41.715864+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.296829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715734+0000","last_change":"2023-10-16T13:40:39.826643+0000","last_active":"2023-10-16T13:40:41.715734+0000","last_peered":"2023-10-16T13:40:41.715734+0000","last_clean":"2023-10-16T13:40:41.715734+0000","last_became_active":"2023-10-16T13:40:39.826372+0000","last_became_peered":"2023-10-16T13:40:39.826372+0000","last_unstale":"2023-10-16T13:40:41.715734+0000","last_undegraded":"2023-10-16T13:40:41.715734+0000","last_fullsized":"2023-10-16T13:40:41.715734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:24:18.733931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809062+0000","last_change":"2023-10-16T13:40:39.825527+0000","last_active":"2023-10-16T13:40:40.809062+0000","last_peered":"2023-10-16T13:40:40.809062+0000","last_clean":"2023-10-16T13:40:40.809062+0000","last_became_active":"2023-10-16T13:40:39.825063+0000","last_became_peered":"2023-10-16T13:40:39.825063+0000","last_unstale":"2023-10-16T13:40:40.809062+0000","last_undegraded":"2023-10-16T13:40:40.809062+0000","last_fullsized":"2023-10-16T13:40:40.809062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:14.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809901+0000","last_change":"2023-10-16T13:40:39.817076+0000","last_active":"2023-10-16T13:40:40.809901+0000","last_peered":"2023-10-16T13:40:40.809901+0000","last_clean":"2023-10-16T13:40:40.809901+0000","last_became_active":"2023-10-16T13:40:39.816711+0000","last_became_peered":"2023-10-16T13:40:39.816711+0000","last_unstale":"2023-10-16T13:40:40.809901+0000","last_undegraded":"2023-10-16T13:40:40.809901+0000","last_fullsized":"2023-10-16T13:40:40.809901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809507+0000","last_change":"2023-10-16T13:40:39.817668+0000","last_active":"2023-10-16T13:40:40.809507+0000","last_peered":"2023-10-16T13:40:40.809507+0000","last_clean":"2023-10-16T13:40:40.809507+0000","last_became_active":"2023-10-16T13:40:39.817379+0000","last_became_peered":"2023-10-16T13:40:39.817379+0000","last_unstale":"2023-10-16T13:40:40.809507+0000","last_undegraded":"2023-10-16T13:40:40.809507+0000","last_fullsized":"2023-10-16T13:40:40.809507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:00:37.091073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715889+0000","last_change":"2023-10-16T13:40:39.822984+0000","last_active":"2023-10-16T13:40:41.715889+0000","last_peered":"2023-10-16T13:40:41.715889+0000","last_clean":"2023-10-16T13:40:41.715889+0000","last_became_active":"2023-10-16T13:40:39.822343+0000","last_became_peered":"2023-10-16T13:40:39.822343+0000","last_unstale":"2023-10-16T13:40:41.715889+0000","last_undegraded":"2023-10-16T13:40:41.715889+0000","last_fullsized":"2023-10-16T13:40:41.715889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:41.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716282+0000","last_change":"2023-10-16T13:40:39.817841+0000","last_active":"2023-10-16T13:40:41.716282+0000","last_peered":"2023-10-16T13:40:41.716282+0000","last_clean":"2023-10-16T13:40:41.716282+0000","last_became_active":"2023-10-16T13:40:39.817542+0000","last_became_peered":"2023-10-16T13:40:39.817542+0000","last_unstale":"2023-10-16T13:40:41.716282+0000","last_undegraded":"2023-10-16T13:40:41.716282+0000","last_fullsized":"2023-10-16T13:40:41.716282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:28.616968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716080+0000","last_change":"2023-10-16T13:40:39.819853+0000","last_active":"2023-10-16T13:40:41.716080+0000","last_peered":"2023-10-16T13:40:41.716080+0000","last_clean":"2023-10-16T13:40:41.716080+0000","last_became_active":"2023-10-16T13:40:39.817614+0000","last_became_peered":"2023-10-16T13:40:39.817614+0000","last_unstale":"2023-10-16T13:40:41.716080+0000","last_undegraded":"2023-10-16T13:40:41.716080+0000","last_fullsized":"2023-10-16T13:40:41.716080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:18.669096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716055+0000","last_change":"2023-10-16T13:40:39.822782+0000","last_active":"2023-10-16T13:40:41.716055+0000","last_peered":"2023-10-16T13:40:41.716055+0000","last_clean":"2023-10-16T13:40:41.716055+0000","last_became_active":"2023-10-16T13:40:39.821980+0000","last_became_peered":"2023-10-16T13:40:39.821980+0000","last_unstale":"2023-10-16T13:40:41.716055+0000","last_undegraded":"2023-10-16T13:40:41.716055+0000","last_fullsized":"2023-10-16T13:40:41.716055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:06.909255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716453+0000","last_change":"2023-10-16T13:40:39.822271+0000","last_active":"2023-10-16T13:40:41.716453+0000","last_peered":"2023-10-16T13:40:41.716453+0000","last_clean":"2023-10-16T13:40:41.716453+0000","last_became_active":"2023-10-16T13:40:39.821902+0000","last_became_peered":"2023-10-16T13:40:39.821902+0000","last_unstale":"2023-10-16T13:40:41.716453+0000","last_undegraded":"2023-10-16T13:40:41.716453+0000","last_fullsized":"2023-10-16T13:40:41.716453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:36.878188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809262+0000","last_change":"2023-10-16T13:40:39.819724+0000","last_active":"2023-10-16T13:40:40.809262+0000","last_peered":"2023-10-16T13:40:40.809262+0000","last_clean":"2023-10-16T13:40:40.809262+0000","last_became_active":"2023-10-16T13:40:39.819422+0000","last_became_peered":"2023-10-16T13:40:39.819422+0000","last_unstale":"2023-10-16T13:40:40.809262+0000","last_undegraded":"2023-10-16T13:40:40.809262+0000","last_fullsized":"2023-10-16T13:40:40.809262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:22.575254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810517+0000","last_change":"2023-10-16T13:40:39.822183+0000","last_active":"2023-10-16T13:40:40.810517+0000","last_peered":"2023-10-16T13:40:40.810517+0000","last_clean":"2023-10-16T13:40:40.810517+0000","last_became_active":"2023-10-16T13:40:39.821886+0000","last_became_peered":"2023-10-16T13:40:39.821886+0000","last_unstale":"2023-10-16T13:40:40.810517+0000","last_undegraded":"2023-10-16T13:40:40.810517+0000","last_fullsized":"2023-10-16T13:40:40.810517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:13:19.191562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215119+0000","last_change":"2023-10-16T13:40:39.825254+0000","last_active":"2023-10-16T13:40:41.215119+0000","last_peered":"2023-10-16T13:40:41.215119+0000","last_clean":"2023-10-16T13:40:41.215119+0000","last_became_active":"2023-10-16T13:40:39.824904+0000","last_became_peered":"2023-10-16T13:40:39.824904+0000","last_unstale":"2023-10-16T13:40:41.215119+0000","last_undegraded":"2023-10-16T13:40:41.215119+0000","last_fullsized":"2023-10-16T13:40:41.215119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:37:09.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214929+0000","last_change":"2023-10-16T13:40:39.823762+0000","last_active":"2023-10-16T13:40:41.214929+0000","last_peered":"2023-10-16T13:40:41.214929+0000","last_clean":"2023-10-16T13:40:41.214929+0000","last_became_active":"2023-10-16T13:40:39.823215+0000","last_became_peered":"2023-10-16T13:40:39.823215+0000","last_unstale":"2023-10-16T13:40:41.214929+0000","last_undegraded":"2023-10-16T13:40:41.214929+0000","last_fullsized":"2023-10-16T13:40:41.214929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:24.798572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810097+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810097+0000","last_peered":"2023-10-16T13:40:40.810097+0000","last_clean":"2023-10-16T13:40:40.810097+0000","last_became_active":"2023-10-16T13:40:39.820879+0000","last_became_peered":"2023-10-16T13:40:39.820879+0000","last_unstale":"2023-10-16T13:40:40.810097+0000","last_undegraded":"2023-10-16T13:40:40.810097+0000","last_fullsized":"2023-10-16T13:40:40.810097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810169+0000","last_change":"2023-10-16T13:40:39.816419+0000","last_active":"2023-10-16T13:40:40.810169+0000","last_peered":"2023-10-16T13:40:40.810169+0000","last_clean":"2023-10-16T13:40:40.810169+0000","last_became_active":"2023-10-16T13:40:39.816092+0000","last_became_peered":"2023-10-16T13:40:39.816092+0000","last_unstale":"2023-10-16T13:40:40.810169+0000","last_undegraded":"2023-10-16T13:40:40.810169+0000","last_fullsized":"2023-10-16T13:40:40.810169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808812+0000","last_change":"2023-10-16T13:40:39.820724+0000","last_active":"2023-10-16T13:40:40.808812+0000","last_peered":"2023-10-16T13:40:40.808812+0000","last_clean":"2023-10-16T13:40:40.808812+0000","last_became_active":"2023-10-16T13:40:39.820464+0000","last_became_peered":"2023-10-16T13:40:39.820464+0000","last_unstale":"2023-10-16T13:40:40.808812+0000","last_undegraded":"2023-10-16T13:40:40.808812+0000","last_fullsized":"2023-10-16T13:40:40.808812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:59.734877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.800334+0000","last_change":"2023-10-16T13:40:37.800334+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.800334+0000","last_undegraded":"2023-10-16T13:40:37.800334+0000","last_fullsized":"2023-10-16T13:40:37.800334+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716115+0000","last_change":"2023-10-16T13:40:39.822604+0000","last_active":"2023-10-16T13:40:41.716115+0000","last_peered":"2023-10-16T13:40:41.716115+0000","last_clean":"2023-10-16T13:40:41.716115+0000","last_became_active":"2023-10-16T13:40:39.821385+0000","last_became_peered":"2023-10-16T13:40:39.821385+0000","last_unstale":"2023-10-16T13:40:41.716115+0000","last_undegraded":"2023-10-16T13:40:41.716115+0000","last_fullsized":"2023-10-16T13:40:41.716115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:41.889159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.801877+0000","last_change":"2023-10-16T13:40:37.801877+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.801877+0000","last_undegraded":"2023-10-16T13:40:37.801877+0000","last_fullsized":"2023-10-16T13:40:37.801877+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809425+0000","last_change":"2023-10-16T13:40:39.827023+0000","last_active":"2023-10-16T13:40:40.809425+0000","last_peered":"2023-10-16T13:40:40.809425+0000","last_clean":"2023-10-16T13:40:40.809425+0000","last_became_active":"2023-10-16T13:40:39.825744+0000","last_became_peered":"2023-10-16T13:40:39.825744+0000","last_unstale":"2023-10-16T13:40:40.809425+0000","last_undegraded":"2023-10-16T13:40:40.809425+0000","last_fullsized":"2023-10-16T13:40:40.809425+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:25.807534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797724+0000","last_change":"2023-10-16T13:40:37.797724+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797724+0000","last_undegraded":"2023-10-16T13:40:37.797724+0000","last_fullsized":"2023-10-16T13:40:37.797724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840162+0000","last_change":"2023-10-16T13:40:38.820937+0000","last_active":"2023-10-16T13:40:39.840162+0000","last_peered":"2023-10-16T13:40:39.840162+0000","last_clean":"2023-10-16T13:40:39.840162+0000","last_became_active":"2023-10-16T13:40:38.820601+0000","last_became_peered":"2023-10-16T13:40:38.820601+0000","last_unstale":"2023-10-16T13:40:39.840162+0000","last_undegraded":"2023-10-16T13:40:39.840162+0000","last_fullsized":"2023-10-16T13:40:39.840162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:05.904450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810245+0000","last_change":"2023-10-16T13:40:39.819143+0000","last_active":"2023-10-16T13:40:40.810245+0000","last_peered":"2023-10-16T13:40:40.810245+0000","last_clean":"2023-10-16T13:40:40.810245+0000","last_became_active":"2023-10-16T13:40:39.818866+0000","last_became_peered":"2023-10-16T13:40:39.818866+0000","last_unstale":"2023-10-16T13:40:40.810245+0000","last_undegraded":"2023-10-16T13:40:40.810245+0000","last_fullsized":"2023-10-16T13:40:40.810245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.845415+0000","last_change":"2023-10-16T13:40:38.815449+0000","last_active":"2023-10-16T13:40:39.845415+0000","last_peered":"2023-10-16T13:40:39.845415+0000","last_clean":"2023-10-16T13:40:39.845415+0000","last_became_active":"2023-10-16T13:40:38.815189+0000","last_became_peered":"2023-10-16T13:40:38.815189+0000","last_unstale":"2023-10-16T13:40:39.845415+0000","last_undegraded":"2023-10-16T13:40:39.845415+0000","last_fullsized":"2023-10-16T13:40:39.845415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:24.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.839986+0000","last_change":"2023-10-16T13:40:38.821853+0000","last_active":"2023-10-16T13:40:39.839986+0000","last_peered":"2023-10-16T13:40:39.839986+0000","last_clean":"2023-10-16T13:40:39.839986+0000","last_became_active":"2023-10-16T13:40:38.821494+0000","last_became_peered":"2023-10-16T13:40:38.821494+0000","last_unstale":"2023-10-16T13:40:39.839986+0000","last_undegraded":"2023-10-16T13:40:39.839986+0000","last_fullsized":"2023-10-16T13:40:39.839986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:11.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715181+0000","last_change":"2023-10-16T13:40:39.827080+0000","last_active":"2023-10-16T13:40:41.715181+0000","last_peered":"2023-10-16T13:40:41.715181+0000","last_clean":"2023-10-16T13:40:41.715181+0000","last_became_active":"2023-10-16T13:40:39.826753+0000","last_became_peered":"2023-10-16T13:40:39.826753+0000","last_unstale":"2023-10-16T13:40:41.715181+0000","last_undegraded":"2023-10-16T13:40:41.715181+0000","last_fullsized":"2023-10-16T13:40:41.715181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:19.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809900+0000","last_change":"2023-10-16T13:40:38.820205+0000","last_active":"2023-10-16T13:40:39.809900+0000","last_peered":"2023-10-16T13:40:39.809900+0000","last_clean":"2023-10-16T13:40:39.809900+0000","last_became_active":"2023-10-16T13:40:38.819870+0000","last_became_peered":"2023-10-16T13:40:38.819870+0000","last_unstale":"2023-10-16T13:40:39.809900+0000","last_undegraded":"2023-10-16T13:40:39.809900+0000","last_fullsized":"2023-10-16T13:40:39.809900+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:54.803860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805349+0000","last_change":"2023-10-16T13:40:38.819977+0000","last_active":"2023-10-16T13:40:39.805349+0000","last_peered":"2023-10-16T13:40:39.805349+0000","last_clean":"2023-10-16T13:40:39.805349+0000","last_became_active":"2023-10-16T13:40:38.819676+0000","last_became_peered":"2023-10-16T13:40:38.819676+0000","last_unstale":"2023-10-16T13:40:39.805349+0000","last_undegraded":"2023-10-16T13:40:39.805349+0000","last_fullsized":"2023-10-16T13:40:39.805349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:53.008354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810642+0000","last_change":"2023-10-16T13:40:39.824725+0000","last_active":"2023-10-16T13:40:40.810642+0000","last_peered":"2023-10-16T13:40:40.810642+0000","last_clean":"2023-10-16T13:40:40.810642+0000","last_became_active":"2023-10-16T13:40:39.824452+0000","last_became_peered":"2023-10-16T13:40:39.824452+0000","last_unstale":"2023-10-16T13:40:40.810642+0000","last_undegraded":"2023-10-16T13:40:40.810642+0000","last_fullsized":"2023-10-16T13:40:40.810642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:27.067030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.798172+0000","last_change":"2023-10-16T13:40:37.798172+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.798172+0000","last_undegraded":"2023-10-16T13:40:37.798172+0000","last_fullsized":"2023-10-16T13:40:37.798172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812283+0000","last_change":"2023-10-16T13:40:38.818983+0000","last_active":"2023-10-16T13:40:39.812283+0000","last_peered":"2023-10-16T13:40:39.812283+0000","last_clean":"2023-10-16T13:40:39.812283+0000","last_became_active":"2023-10-16T13:40:38.818660+0000","last_became_peered":"2023-10-16T13:40:38.818660+0000","last_unstale":"2023-10-16T13:40:39.812283+0000","last_undegraded":"2023-10-16T13:40:39.812283+0000","last_fullsized":"2023-10-16T13:40:39.812283+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:06.070222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809240+0000","last_change":"2023-10-16T13:40:39.824564+0000","last_active":"2023-10-16T13:40:40.809240+0000","last_peered":"2023-10-16T13:40:40.809240+0000","last_clean":"2023-10-16T13:40:40.809240+0000","last_became_active":"2023-10-16T13:40:39.824255+0000","last_became_peered":"2023-10-16T13:40:39.824255+0000","last_unstale":"2023-10-16T13:40:40.809240+0000","last_undegraded":"2023-10-16T13:40:40.809240+0000","last_fullsized":"2023-10-16T13:40:40.809240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:47.276160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842913+0000","last_change":"2023-10-16T13:40:38.817847+0000","last_active":"2023-10-16T13:40:39.842913+0000","last_peered":"2023-10-16T13:40:39.842913+0000","last_clean":"2023-10-16T13:40:39.842913+0000","last_became_active":"2023-10-16T13:40:38.817561+0000","last_became_peered":"2023-10-16T13:40:38.817561+0000","last_unstale":"2023-10-16T13:40:39.842913+0000","last_undegraded":"2023-10-16T13:40:39.842913+0000","last_fullsized":"2023-10-16T13:40:39.842913+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:45.576746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715899+0000","last_change":"2023-10-16T13:40:39.817345+0000","last_active":"2023-10-16T13:40:41.715899+0000","last_peered":"2023-10-16T13:40:41.715899+0000","last_clean":"2023-10-16T13:40:41.715899+0000","last_became_active":"2023-10-16T13:40:39.817042+0000","last_became_peered":"2023-10-16T13:40:39.817042+0000","last_unstale":"2023-10-16T13:40:41.715899+0000","last_undegraded":"2023-10-16T13:40:41.715899+0000","last_fullsized":"2023-10-16T13:40:41.715899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:47.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.847149+0000","last_change":"2023-10-16T13:40:38.816845+0000","last_active":"2023-10-16T13:40:39.847149+0000","last_peered":"2023-10-16T13:40:39.847149+0000","last_clean":"2023-10-16T13:40:39.847149+0000","last_became_active":"2023-10-16T13:40:38.816563+0000","last_became_peered":"2023-10-16T13:40:38.816563+0000","last_unstale":"2023-10-16T13:40:39.847149+0000","last_undegraded":"2023-10-16T13:40:39.847149+0000","last_fullsized":"2023-10-16T13:40:39.847149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:52.412223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843212+0000","last_change":"2023-10-16T13:40:38.818745+0000","last_active":"2023-10-16T13:40:39.843212+0000","last_peered":"2023-10-16T13:40:39.843212+0000","last_clean":"2023-10-16T13:40:39.843212+0000","last_became_active":"2023-10-16T13:40:38.818380+0000","last_became_peered":"2023-10-16T13:40:38.818380+0000","last_unstale":"2023-10-16T13:40:39.843212+0000","last_undegraded":"2023-10-16T13:40:39.843212+0000","last_fullsized":"2023-10-16T13:40:39.843212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810402+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810402+0000","last_peered":"2023-10-16T13:40:40.810402+0000","last_clean":"2023-10-16T13:40:40.810402+0000","last_became_active":"2023-10-16T13:40:39.820851+0000","last_became_peered":"2023-10-16T13:40:39.820851+0000","last_unstale":"2023-10-16T13:40:40.810402+0000","last_undegraded":"2023-10-16T13:40:40.810402+0000","last_fullsized":"2023-10-16T13:40:40.810402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812337+0000","last_change":"2023-10-16T13:40:38.821394+0000","last_active":"2023-10-16T13:40:39.812337+0000","last_peered":"2023-10-16T13:40:39.812337+0000","last_clean":"2023-10-16T13:40:39.812337+0000","last_became_active":"2023-10-16T13:40:38.821071+0000","last_became_peered":"2023-10-16T13:40:38.821071+0000","last_unstale":"2023-10-16T13:40:39.812337+0000","last_undegraded":"2023-10-16T13:40:39.812337+0000","last_fullsized":"2023-10-16T13:40:39.812337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:57:29.111116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809248+0000","last_change":"2023-10-16T13:40:38.815484+0000","last_active":"2023-10-16T13:40:39.809248+0000","last_peered":"2023-10-16T13:40:39.809248+0000","last_clean":"2023-10-16T13:40:39.809248+0000","last_became_active":"2023-10-16T13:40:38.815154+0000","last_became_peered":"2023-10-16T13:40:38.815154+0000","last_unstale":"2023-10-16T13:40:39.809248+0000","last_undegraded":"2023-10-16T13:40:39.809248+0000","last_fullsized":"2023-10-16T13:40:39.809248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:55.109057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715501+0000","last_change":"2023-10-16T13:40:39.821845+0000","last_active":"2023-10-16T13:40:41.715501+0000","last_peered":"2023-10-16T13:40:41.715501+0000","last_clean":"2023-10-16T13:40:41.715501+0000","last_became_active":"2023-10-16T13:40:39.821282+0000","last_became_peered":"2023-10-16T13:40:39.821282+0000","last_unstale":"2023-10-16T13:40:41.715501+0000","last_undegraded":"2023-10-16T13:40:41.715501+0000","last_fullsized":"2023-10-16T13:40:41.715501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:16.745728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797735+0000","last_change":"2023-10-16T13:40:37.797735+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797735+0000","last_undegraded":"2023-10-16T13:40:37.797735+0000","last_fullsized":"2023-10-16T13:40:37.797735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842725+0000","last_change":"2023-10-16T13:40:38.827807+0000","last_active":"2023-10-16T13:40:39.842725+0000","last_peered":"2023-10-16T13:40:39.842725+0000","last_clean":"2023-10-16T13:40:39.842725+0000","last_became_active":"2023-10-16T13:40:38.827562+0000","last_became_peered":"2023-10-16T13:40:38.827562+0000","last_unstale":"2023-10-16T13:40:39.842725+0000","last_undegraded":"2023-10-16T13:40:39.842725+0000","last_fullsized":"2023-10-16T13:40:39.842725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:17.664292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797842+0000","last_change":"2023-10-16T13:40:37.797842+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797842+0000","last_undegraded":"2023-10-16T13:40:37.797842+0000","last_fullsized":"2023-10-16T13:40:37.797842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716385+0000","last_change":"2023-10-16T13:40:39.817797+0000","last_active":"2023-10-16T13:40:41.716385+0000","last_peered":"2023-10-16T13:40:41.716385+0000","last_clean":"2023-10-16T13:40:41.716385+0000","last_became_active":"2023-10-16T13:40:39.817154+0000","last_became_peered":"2023-10-16T13:40:39.817154+0000","last_unstale":"2023-10-16T13:40:41.716385+0000","last_undegraded":"2023-10-16T13:40:41.716385+0000","last_fullsized":"2023-10-16T13:40:41.716385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:56.113861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843250+0000","last_change":"2023-10-16T13:40:38.821194+0000","last_active":"2023-10-16T13:40:39.843250+0000","last_peered":"2023-10-16T13:40:39.843250+0000","last_clean":"2023-10-16T13:40:39.843250+0000","last_became_active":"2023-10-16T13:40:38.820062+0000","last_became_peered":"2023-10-16T13:40:38.820062+0000","last_unstale":"2023-10-16T13:40:39.843250+0000","last_undegraded":"2023-10-16T13:40:39.843250+0000","last_fullsized":"2023-10-16T13:40:39.843250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:32.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715891+0000","last_change":"2023-10-16T13:40:39.826550+0000","last_active":"2023-10-16T13:40:41.715891+0000","last_peered":"2023-10-16T13:40:41.715891+0000","last_clean":"2023-10-16T13:40:41.715891+0000","last_became_active":"2023-10-16T13:40:39.826243+0000","last_became_peered":"2023-10-16T13:40:39.826243+0000","last_unstale":"2023-10-16T13:40:41.715891+0000","last_undegraded":"2023-10-16T13:40:41.715891+0000","last_fullsized":"2023-10-16T13:40:41.715891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:41.376812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.800345+0000","last_change":"2023-10-16T13:40:37.800345+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.800345+0000","last_undegraded":"2023-10-16T13:40:37.800345+0000","last_fullsized":"2023-10-16T13:40:37.800345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214983+0000","last_change":"2023-10-16T13:40:39.820400+0000","last_active":"2023-10-16T13:40:41.214983+0000","last_peered":"2023-10-16T13:40:41.214983+0000","last_clean":"2023-10-16T13:40:41.214983+0000","last_became_active":"2023-10-16T13:40:39.820107+0000","last_became_peered":"2023-10-16T13:40:39.820107+0000","last_unstale":"2023-10-16T13:40:41.214983+0000","last_undegraded":"2023-10-16T13:40:41.214983+0000","last_fullsized":"2023-10-16T13:40:41.214983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:30.379729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812497+0000","last_change":"2023-10-16T13:40:38.819491+0000","last_active":"2023-10-16T13:40:39.812497+0000","last_peered":"2023-10-16T13:40:39.812497+0000","last_clean":"2023-10-16T13:40:39.812497+0000","last_became_active":"2023-10-16T13:40:38.819167+0000","last_became_peered":"2023-10-16T13:40:38.819167+0000","last_unstale":"2023-10-16T13:40:39.812497+0000","last_undegraded":"2023-10-16T13:40:39.812497+0000","last_fullsized":"2023-10-16T13:40:39.812497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:24.574150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215007+0000","last_change":"2023-10-16T13:40:39.822722+0000","last_active":"2023-10-16T13:40:41.215007+0000","last_peered":"2023-10-16T13:40:41.215007+0000","last_clean":"2023-10-16T13:40:41.215007+0000","last_became_active":"2023-10-16T13:40:39.821553+0000","last_became_peered":"2023-10-16T13:40:39.821553+0000","last_unstale":"2023-10-16T13:40:41.215007+0000","last_undegraded":"2023-10-16T13:40:41.215007+0000","last_fullsized":"2023-10-16T13:40:41.215007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:03.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809399+0000","last_change":"2023-10-16T13:40:38.816423+0000","last_active":"2023-10-16T13:40:39.809399+0000","last_peered":"2023-10-16T13:40:39.809399+0000","last_clean":"2023-10-16T13:40:39.809399+0000","last_became_active":"2023-10-16T13:40:38.815912+0000","last_became_peered":"2023-10-16T13:40:38.815912+0000","last_unstale":"2023-10-16T13:40:39.809399+0000","last_undegraded":"2023-10-16T13:40:39.809399+0000","last_fullsized":"2023-10-16T13:40:39.809399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:27.612163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214957+0000","last_change":"2023-10-16T13:40:39.824262+0000","last_active":"2023-10-16T13:40:41.214957+0000","last_peered":"2023-10-16T13:40:41.214957+0000","last_clean":"2023-10-16T13:40:41.214957+0000","last_became_active":"2023-10-16T13:40:39.823930+0000","last_became_peered":"2023-10-16T13:40:39.823930+0000","last_unstale":"2023-10-16T13:40:41.214957+0000","last_undegraded":"2023-10-16T13:40:41.214957+0000","last_fullsized":"2023-10-16T13:40:41.214957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:51.876599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.801838+0000","last_change":"2023-10-16T13:40:37.801838+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.801838+0000","last_undegraded":"2023-10-16T13:40:37.801838+0000","last_fullsized":"2023-10-16T13:40:37.801838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.841270+0000","last_change":"2023-10-16T13:40:38.827775+0000","last_active":"2023-10-16T13:40:39.841270+0000","last_peered":"2023-10-16T13:40:39.841270+0000","last_clean":"2023-10-16T13:40:39.841270+0000","last_became_active":"2023-10-16T13:40:38.827564+0000","last_became_peered":"2023-10-16T13:40:38.827564+0000","last_unstale":"2023-10-16T13:40:39.841270+0000","last_undegraded":"2023-10-16T13:40:39.841270+0000","last_fullsized":"2023-10-16T13:40:39.841270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:54.568956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810404+0000","last_change":"2023-10-16T13:40:39.816893+0000","last_active":"2023-10-16T13:40:40.810404+0000","last_peered":"2023-10-16T13:40:40.810404+0000","last_clean":"2023-10-16T13:40:40.810404+0000","last_became_active":"2023-10-16T13:40:39.816559+0000","last_became_peered":"2023-10-16T13:40:39.816559+0000","last_unstale":"2023-10-16T13:40:40.810404+0000","last_undegraded":"2023-10-16T13:40:40.810404+0000","last_fullsized":"2023-10-16T13:40:40.810404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811471+0000","last_change":"2023-10-16T13:40:38.815314+0000","last_active":"2023-10-16T13:40:39.811471+0000","last_peered":"2023-10-16T13:40:39.811471+0000","last_clean":"2023-10-16T13:40:39.811471+0000","last_became_active":"2023-10-16T13:40:38.814850+0000","last_became_peered":"2023-10-16T13:40:38.814850+0000","last_unstale":"2023-10-16T13:40:39.811471+0000","last_undegraded":"2023-10-16T13:40:39.811471+0000","last_fullsized":"2023-10-16T13:40:39.811471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:01.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.806258+0000","last_change":"2023-10-16T13:40:38.815831+0000","last_active":"2023-10-16T13:40:39.806258+0000","last_peered":"2023-10-16T13:40:39.806258+0000","last_clean":"2023-10-16T13:40:39.806258+0000","last_became_active":"2023-10-16T13:40:38.815540+0000","last_became_peered":"2023-10-16T13:40:38.815540+0000","last_unstale":"2023-10-16T13:40:39.806258+0000","last_undegraded":"2023-10-16T13:40:39.806258+0000","last_fullsized":"2023-10-16T13:40:39.806258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:29:02.491892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.802010+0000","last_change":"2023-10-16T13:40:37.802010+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.802010+0000","last_undegraded":"2023-10-16T13:40:37.802010+0000","last_fullsized":"2023-10-16T13:40:37.802010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716126+0000","last_change":"2023-10-16T13:40:39.821518+0000","last_active":"2023-10-16T13:40:41.716126+0000","last_peered":"2023-10-16T13:40:41.716126+0000","last_clean":"2023-10-16T13:40:41.716126+0000","last_became_active":"2023-10-16T13:40:39.821128+0000","last_became_peered":"2023-10-16T13:40:39.821128+0000","last_unstale":"2023-10-16T13:40:41.716126+0000","last_undegraded":"2023-10-16T13:40:41.716126+0000","last_fullsized":"2023-10-16T13:40:41.716126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:33.784224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805532+0000","last_change":"2023-10-16T13:40:38.819885+0000","last_active":"2023-10-16T13:40:39.805532+0000","last_peered":"2023-10-16T13:40:39.805532+0000","last_clean":"2023-10-16T13:40:39.805532+0000","last_became_active":"2023-10-16T13:40:38.819622+0000","last_became_peered":"2023-10-16T13:40:38.819622+0000","last_unstale":"2023-10-16T13:40:39.805532+0000","last_undegraded":"2023-10-16T13:40:39.805532+0000","last_fullsized":"2023-10-16T13:40:39.805532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:17:33.819262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808911+0000","last_change":"2023-10-16T13:40:39.825984+0000","last_active":"2023-10-16T13:40:40.808911+0000","last_peered":"2023-10-16T13:40:40.808911+0000","last_clean":"2023-10-16T13:40:40.808911+0000","last_became_active":"2023-10-16T13:40:39.825650+0000","last_became_peered":"2023-10-16T13:40:39.825650+0000","last_unstale":"2023-10-16T13:40:40.808911+0000","last_undegraded":"2023-10-16T13:40:40.808911+0000","last_fullsized":"2023-10-16T13:40:40.808911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:36:34.339968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810108+0000","last_change":"2023-10-16T13:40:38.820149+0000","last_active":"2023-10-16T13:40:39.810108+0000","last_peered":"2023-10-16T13:40:39.810108+0000","last_clean":"2023-10-16T13:40:39.810108+0000","last_became_active":"2023-10-16T13:40:38.819853+0000","last_became_peered":"2023-10-16T13:40:38.819853+0000","last_unstale":"2023-10-16T13:40:39.810108+0000","last_undegraded":"2023-10-16T13:40:39.810108+0000","last_fullsized":"2023-10-16T13:40:39.810108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:30.874102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715368+0000","last_change":"2023-10-16T13:40:39.818863+0000","last_active":"2023-10-16T13:40:41.715368+0000","last_peered":"2023-10-16T13:40:41.715368+0000","last_clean":"2023-10-16T13:40:41.715368+0000","last_became_active":"2023-10-16T13:40:39.818500+0000","last_became_peered":"2023-10-16T13:40:39.818500+0000","last_unstale":"2023-10-16T13:40:41.715368+0000","last_undegraded":"2023-10-16T13:40:41.715368+0000","last_fullsized":"2023-10-16T13:40:41.715368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:48.678490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.798474+0000","last_change":"2023-10-16T13:40:37.798474+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.798474+0000","last_undegraded":"2023-10-16T13:40:37.798474+0000","last_fullsized":"2023-10-16T13:40:37.798474+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809466+0000","last_change":"2023-10-16T13:40:39.820186+0000","last_active":"2023-10-16T13:40:40.809466+0000","last_peered":"2023-10-16T13:40:40.809466+0000","last_clean":"2023-10-16T13:40:40.809466+0000","last_became_active":"2023-10-16T13:40:39.819347+0000","last_became_peered":"2023-10-16T13:40:39.819347+0000","last_unstale":"2023-10-16T13:40:40.809466+0000","last_undegraded":"2023-10-16T13:40:40.809466+0000","last_fullsized":"2023-10-16T13:40:40.809466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:04.033107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810851+0000","last_change":"2023-10-16T13:40:38.821117+0000","last_active":"2023-10-16T13:40:39.810851+0000","last_peered":"2023-10-16T13:40:39.810851+0000","last_clean":"2023-10-16T13:40:39.810851+0000","last_became_active":"2023-10-16T13:40:38.820818+0000","last_became_peered":"2023-10-16T13:40:38.820818+0000","last_unstale":"2023-10-16T13:40:39.810851+0000","last_undegraded":"2023-10-16T13:40:39.810851+0000","last_fullsized":"2023-10-16T13:40:39.810851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:46.343827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215042+0000","last_change":"2023-10-16T13:40:39.824316+0000","last_active":"2023-10-16T13:40:41.215042+0000","last_peered":"2023-10-16T13:40:41.215042+0000","last_clean":"2023-10-16T13:40:41.215042+0000","last_became_active":"2023-10-16T13:40:39.824016+0000","last_became_peered":"2023-10-16T13:40:39.824016+0000","last_unstale":"2023-10-16T13:40:41.215042+0000","last_undegraded":"2023-10-16T13:40:41.215042+0000","last_fullsized":"2023-10-16T13:40:41.215042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:13.061966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840115+0000","last_change":"2023-10-16T13:40:38.818953+0000","last_active":"2023-10-16T13:40:39.840115+0000","last_peered":"2023-10-16T13:40:39.840115+0000","last_clean":"2023-10-16T13:40:39.840115+0000","last_became_active":"2023-10-16T13:40:38.818613+0000","last_became_peered":"2023-10-16T13:40:38.818613+0000","last_unstale":"2023-10-16T13:40:39.840115+0000","last_undegraded":"2023-10-16T13:40:39.840115+0000","last_fullsized":"2023-10-16T13:40:39.840115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:40.884355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-16T13:40:36.729188+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:36.729188+0000","last_peered":"2023-10-16T13:40:36.729188+0000","last_clean":"2023-10-16T13:40:36.729188+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:36.729188+0000","last_undegraded":"2023-10-16T13:40:36.729188+0000","last_fullsized":"2023-10-16T13:40:36.729188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":78,"acting":78,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1310720,"data_stored":894128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.499},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.80000000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.873,"15min":0.873},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.0509999999999999,"15min":1.133},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.081,"5min":10.964,"15min":10.964},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67700000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.48799999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":325338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.503,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":0.49199999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.752,"15min":0.752},"last":0.373}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56000000000000005,"5min":0.88,"15min":0.88},"last":0.309},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63500000000000001,"5min":1.002,"15min":1.002},"last":1.4390000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85999999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.131,"15min":1.131},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88800000000000001,"5min":1.034,"15min":1.034},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85099999999999998,"5min":1.085,"15min":1.085},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1306624,"data_stored":893109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.41299999999999998,"15min":0.38400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.42199999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.433,"15min":0.40899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41899999999999998,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.375},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.625,"15min":0.60099999999999998},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0190000000000001,"5min":4.0190000000000001,"15min":4.0190000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.63900000000000001,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.0650000000000004,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.5},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.63,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.64900000000000002,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.69199999999999995,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.46400000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.216},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26900000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63500000000000001,"5min":1.153,"15min":1.153},"last":0.318}]},{"osd":4,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.054,"15min":1.054},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442}]},{"osd":5,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":1.111,"15min":1.111},"last":0.497}]},{"osd":7,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.23,"15min":1.23},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.57299999999999995,"15min":0.61399999999999999},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.623,"5min":2.181,"15min":2.181},"last":0.501}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49299999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56200000000000006,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80700000000000005,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.83899999999999997,"15min":0.88100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.72299999999999998,"15min":0.746},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79400000000000004,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73599999999999999,"15min":0.75900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77800000000000002,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76000000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.84399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.88800000000000001,"15min":0.93600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77900000000000003,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78300000000000003,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":303760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":0.88},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.877,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66700000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.141,"15min":1.141},"last":0.373},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.43099999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:44.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 Processor -- start 2023-10-16T13:40:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 -- start start 2023-10-16T13:40:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94300d08a0 0x7f94300d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 0x7f94300ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94300b6610 con 0x7f9430160e30 2023-10-16T13:40:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94300d1da0 con 0x7f94300d08a0 2023-10-16T13:40:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.544+0000 7f943665a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94300d2080 con 0x7f94300b7ab0 2023-10-16T13:40:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 0x7f94300ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f942f7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94300d08a0 0x7f94300d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 0x7f94300ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43758/0 (socket says 172.21.15.5:43758) 2023-10-16T13:40:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 -- 172.21.15.5:0/3334493001 learned_addr learned my addr 172.21.15.5:0/3334493001 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 -- 172.21.15.5:0/3334493001 >> v2:172.21.15.112:3300/0 conn(0x7f94300d08a0 msgr2=0x7f94300d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 --2- 172.21.15.5:0/3334493001 >> v2:172.21.15.112:3300/0 conn(0x7f94300d08a0 0x7f94300d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 -- 172.21.15.5:0/3334493001 >> v1:172.21.15.112:6789/0 conn(0x7f9430160e30 legacy=0x7f94300d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 -- 172.21.15.5:0/3334493001 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300d2360 con 0x7f94300b7ab0 2023-10-16T13:40:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f9434bf7700 1 --2- 172.21.15.5:0/3334493001 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 0x7f94300ce3d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9428009e50 tx=0x7f942800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46539db81de20dec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.545+0000 7f942effd700 1 -- 172.21.15.5:0/3334493001 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800e070 con 0x7f94300b7ab0 2023-10-16T13:40:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f942effd700 1 -- 172.21.15.5:0/3334493001 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800b910 con 0x7f94300b7ab0 2023-10-16T13:40:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f942effd700 1 -- 172.21.15.5:0/3334493001 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800bcc0 con 0x7f94300b7ab0 2023-10-16T13:40:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 -- 172.21.15.5:0/3334493001 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 msgr2=0x7f94300ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 --2- 172.21.15.5:0/3334493001 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 0x7f94300ce3d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9428009e50 tx=0x7f942800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 -- 172.21.15.5:0/3334493001 shutdown_connections 2023-10-16T13:40:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 --2- 172.21.15.5:0/3334493001 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300b7ab0 0x7f94300ce3d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 --2- 172.21.15.5:0/3334493001 >> v2:172.21.15.112:3300/0 conn(0x7f94300d08a0 0x7f94300d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 -- 172.21.15.5:0/3334493001 >> 172.21.15.5:0/3334493001 conn(0x7f943009cb40 msgr2=0x7f94300d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 -- 172.21.15.5:0/3334493001 shutdown_connections 2023-10-16T13:40:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.546+0000 7f943665a700 1 -- 172.21.15.5:0/3334493001 wait complete. 2023-10-16T13:40:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.547+0000 7f943665a700 1 Processor -- start 2023-10-16T13:40:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 -- start start 2023-10-16T13:40:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 0x7f94300cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300d08a0 0x7f9430156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9430160e30 0x7f94300c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430159f20 con 0x7f94300b7ab0 2023-10-16T13:40:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94300ccfd0 con 0x7f9430160e30 2023-10-16T13:40:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f943665a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94301593a0 con 0x7f94300d08a0 2023-10-16T13:40:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.548+0000 7f942ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 0x7f94300cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 0x7f94300cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45858/0 (socket says 172.21.15.5:45858) 2023-10-16T13:40:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 -- 172.21.15.5:0/2241132031 learned_addr learned my addr 172.21.15.5:0/2241132031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f9434bf7700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9430160e30 0x7f94300c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942f7fe700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300d08a0 0x7f9430156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 -- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300d08a0 msgr2=0x7f9430156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300d08a0 0x7f9430156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 -- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9430160e30 msgr2=0x7f94300c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9430160e30 0x7f94300c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 -- 172.21.15.5:0/2241132031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428009b30 con 0x7f94300b7ab0 2023-10-16T13:40:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942ffff700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 0x7f94300cca90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f942000c4d0 tx=0x7f942000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200052d0 con 0x7f94300b7ab0 2023-10-16T13:40:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420005430 con 0x7f94300b7ab0 2023-10-16T13:40:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9430159680 con 0x7f94300b7ab0 2023-10-16T13:40:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200038f0 con 0x7f94300b7ab0 2023-10-16T13:40:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.549+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9430159c40 con 0x7f94300b7ab0 2023-10-16T13:40:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.550+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9430067d20 con 0x7f94300b7ab0 2023-10-16T13:40:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.551+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f9420003a50 con 0x7f94300b7ab0 2023-10-16T13:40:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.551+0000 7f942cff9700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f941c06af90 0x7f941c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.551+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9420088b50 con 0x7f94300b7ab0 2023-10-16T13:40:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.551+0000 7f942f7fe700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f941c06af90 0x7f941c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.552+0000 7f942f7fe700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f941c06af90 0x7f941c06d450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f94300b52e0 tx=0x7f9424008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.556+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9420053ba0 con 0x7f94300b7ab0 2023-10-16T13:40:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.754+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94300d2610 con 0x7f941c06af90 2023-10-16T13:40:44.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.762+0000 7f942cff9700 1 -- 172.21.15.5:0/2241132031 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285320 (secure 0 0 0) 0x7f94300d2610 con 0x7f941c06af90 2023-10-16T13:40:44.768 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f941c06af90 msgr2=0x7f941c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f941c06af90 0x7f941c06d450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f94300b52e0 tx=0x7f9424008040 comp rx=0 tx=0).stop 2023-10-16T13:40:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 msgr2=0x7f94300cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 0x7f94300cca90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f942000c4d0 tx=0x7f942000c890 comp rx=0 tx=0).stop 2023-10-16T13:40:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 shutdown_connections 2023-10-16T13:40:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9430160e30 0x7f94300c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94300b7ab0 0x7f94300cca90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f941c06af90 0x7f941c06d450 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 --2- 172.21.15.5:0/2241132031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94300d08a0 0x7f9430156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 >> 172.21.15.5:0/2241132031 conn(0x7f943009cb40 msgr2=0x7f94300b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.765+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 shutdown_connections 2023-10-16T13:40:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.766+0000 7f943665a700 1 -- 172.21.15.5:0/2241132031 wait complete. 2023-10-16T13:40:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:44.780 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-10-16T13:40:43.491700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227340,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747380,"statfs":{"total":773094113280,"available":772861317120,"internally_reserved":0,"allocated":7151616,"data_stored":3709662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.695417"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809161+0000","last_change":"2023-10-16T13:40:39.826301+0000","last_active":"2023-10-16T13:40:40.809161+0000","last_peered":"2023-10-16T13:40:40.809161+0000","last_clean":"2023-10-16T13:40:40.809161+0000","last_became_active":"2023-10-16T13:40:39.825972+0000","last_became_peered":"2023-10-16T13:40:39.825972+0000","last_unstale":"2023-10-16T13:40:40.809161+0000","last_undegraded":"2023-10-16T13:40:40.809161+0000","last_fullsized":"2023-10-16T13:40:40.809161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:29.778901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215120+0000","last_change":"2023-10-16T13:40:39.820300+0000","last_active":"2023-10-16T13:40:41.215120+0000","last_peered":"2023-10-16T13:40:41.215120+0000","last_clean":"2023-10-16T13:40:41.215120+0000","last_became_active":"2023-10-16T13:40:39.819046+0000","last_became_peered":"2023-10-16T13:40:39.819046+0000","last_unstale":"2023-10-16T13:40:41.215120+0000","last_undegraded":"2023-10-16T13:40:41.215120+0000","last_fullsized":"2023-10-16T13:40:41.215120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:10.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715864+0000","last_change":"2023-10-16T13:40:39.820789+0000","last_active":"2023-10-16T13:40:41.715864+0000","last_peered":"2023-10-16T13:40:41.715864+0000","last_clean":"2023-10-16T13:40:41.715864+0000","last_became_active":"2023-10-16T13:40:39.820439+0000","last_became_peered":"2023-10-16T13:40:39.820439+0000","last_unstale":"2023-10-16T13:40:41.715864+0000","last_undegraded":"2023-10-16T13:40:41.715864+0000","last_fullsized":"2023-10-16T13:40:41.715864+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.296829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715734+0000","last_change":"2023-10-16T13:40:39.826643+0000","last_active":"2023-10-16T13:40:41.715734+0000","last_peered":"2023-10-16T13:40:41.715734+0000","last_clean":"2023-10-16T13:40:41.715734+0000","last_became_active":"2023-10-16T13:40:39.826372+0000","last_became_peered":"2023-10-16T13:40:39.826372+0000","last_unstale":"2023-10-16T13:40:41.715734+0000","last_undegraded":"2023-10-16T13:40:41.715734+0000","last_fullsized":"2023-10-16T13:40:41.715734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:24:18.733931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809062+0000","last_change":"2023-10-16T13:40:39.825527+0000","last_active":"2023-10-16T13:40:40.809062+0000","last_peered":"2023-10-16T13:40:40.809062+0000","last_clean":"2023-10-16T13:40:40.809062+0000","last_became_active":"2023-10-16T13:40:39.825063+0000","last_became_peered":"2023-10-16T13:40:39.825063+0000","last_unstale":"2023-10-16T13:40:40.809062+0000","last_undegraded":"2023-10-16T13:40:40.809062+0000","last_fullsized":"2023-10-16T13:40:40.809062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:14.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809901+0000","last_change":"2023-10-16T13:40:39.817076+0000","last_active":"2023-10-16T13:40:40.809901+0000","last_peered":"2023-10-16T13:40:40.809901+0000","last_clean":"2023-10-16T13:40:40.809901+0000","last_became_active":"2023-10-16T13:40:39.816711+0000","last_became_peered":"2023-10-16T13:40:39.816711+0000","last_unstale":"2023-10-16T13:40:40.809901+0000","last_undegraded":"2023-10-16T13:40:40.809901+0000","last_fullsized":"2023-10-16T13:40:40.809901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809507+0000","last_change":"2023-10-16T13:40:39.817668+0000","last_active":"2023-10-16T13:40:40.809507+0000","last_peered":"2023-10-16T13:40:40.809507+0000","last_clean":"2023-10-16T13:40:40.809507+0000","last_became_active":"2023-10-16T13:40:39.817379+0000","last_became_peered":"2023-10-16T13:40:39.817379+0000","last_unstale":"2023-10-16T13:40:40.809507+0000","last_undegraded":"2023-10-16T13:40:40.809507+0000","last_fullsized":"2023-10-16T13:40:40.809507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:00:37.091073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715889+0000","last_change":"2023-10-16T13:40:39.822984+0000","last_active":"2023-10-16T13:40:41.715889+0000","last_peered":"2023-10-16T13:40:41.715889+0000","last_clean":"2023-10-16T13:40:41.715889+0000","last_became_active":"2023-10-16T13:40:39.822343+0000","last_became_peered":"2023-10-16T13:40:39.822343+0000","last_unstale":"2023-10-16T13:40:41.715889+0000","last_undegraded":"2023-10-16T13:40:41.715889+0000","last_fullsized":"2023-10-16T13:40:41.715889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:41.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716282+0000","last_change":"2023-10-16T13:40:39.817841+0000","last_active":"2023-10-16T13:40:41.716282+0000","last_peered":"2023-10-16T13:40:41.716282+0000","last_clean":"2023-10-16T13:40:41.716282+0000","last_became_active":"2023-10-16T13:40:39.817542+0000","last_became_peered":"2023-10-16T13:40:39.817542+0000","last_unstale":"2023-10-16T13:40:41.716282+0000","last_undegraded":"2023-10-16T13:40:41.716282+0000","last_fullsized":"2023-10-16T13:40:41.716282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:28.616968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716080+0000","last_change":"2023-10-16T13:40:39.819853+0000","last_active":"2023-10-16T13:40:41.716080+0000","last_peered":"2023-10-16T13:40:41.716080+0000","last_clean":"2023-10-16T13:40:41.716080+0000","last_became_active":"2023-10-16T13:40:39.817614+0000","last_became_peered":"2023-10-16T13:40:39.817614+0000","last_unstale":"2023-10-16T13:40:41.716080+0000","last_undegraded":"2023-10-16T13:40:41.716080+0000","last_fullsized":"2023-10-16T13:40:41.716080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:18.669096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716055+0000","last_change":"2023-10-16T13:40:39.822782+0000","last_active":"2023-10-16T13:40:41.716055+0000","last_peered":"2023-10-16T13:40:41.716055+0000","last_clean":"2023-10-16T13:40:41.716055+0000","last_became_active":"2023-10-16T13:40:39.821980+0000","last_became_peered":"2023-10-16T13:40:39.821980+0000","last_unstale":"2023-10-16T13:40:41.716055+0000","last_undegraded":"2023-10-16T13:40:41.716055+0000","last_fullsized":"2023-10-16T13:40:41.716055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:06.909255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716453+0000","last_change":"2023-10-16T13:40:39.822271+0000","last_active":"2023-10-16T13:40:41.716453+0000","last_peered":"2023-10-16T13:40:41.716453+0000","last_clean":"2023-10-16T13:40:41.716453+0000","last_became_active":"2023-10-16T13:40:39.821902+0000","last_became_peered":"2023-10-16T13:40:39.821902+0000","last_unstale":"2023-10-16T13:40:41.716453+0000","last_undegraded":"2023-10-16T13:40:41.716453+0000","last_fullsized":"2023-10-16T13:40:41.716453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:36.878188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809262+0000","last_change":"2023-10-16T13:40:39.819724+0000","last_active":"2023-10-16T13:40:40.809262+0000","last_peered":"2023-10-16T13:40:40.809262+0000","last_clean":"2023-10-16T13:40:40.809262+0000","last_became_active":"2023-10-16T13:40:39.819422+0000","last_became_peered":"2023-10-16T13:40:39.819422+0000","last_unstale":"2023-10-16T13:40:40.809262+0000","last_undegraded":"2023-10-16T13:40:40.809262+0000","last_fullsized":"2023-10-16T13:40:40.809262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:22.575254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810517+0000","last_change":"2023-10-16T13:40:39.822183+0000","last_active":"2023-10-16T13:40:40.810517+0000","last_peered":"2023-10-16T13:40:40.810517+0000","last_clean":"2023-10-16T13:40:40.810517+0000","last_became_active":"2023-10-16T13:40:39.821886+0000","last_became_peered":"2023-10-16T13:40:39.821886+0000","last_unstale":"2023-10-16T13:40:40.810517+0000","last_undegraded":"2023-10-16T13:40:40.810517+0000","last_fullsized":"2023-10-16T13:40:40.810517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:13:19.191562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215119+0000","last_change":"2023-10-16T13:40:39.825254+0000","last_active":"2023-10-16T13:40:41.215119+0000","last_peered":"2023-10-16T13:40:41.215119+0000","last_clean":"2023-10-16T13:40:41.215119+0000","last_became_active":"2023-10-16T13:40:39.824904+0000","last_became_peered":"2023-10-16T13:40:39.824904+0000","last_unstale":"2023-10-16T13:40:41.215119+0000","last_undegraded":"2023-10-16T13:40:41.215119+0000","last_fullsized":"2023-10-16T13:40:41.215119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:37:09.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214929+0000","last_change":"2023-10-16T13:40:39.823762+0000","last_active":"2023-10-16T13:40:41.214929+0000","last_peered":"2023-10-16T13:40:41.214929+0000","last_clean":"2023-10-16T13:40:41.214929+0000","last_became_active":"2023-10-16T13:40:39.823215+0000","last_became_peered":"2023-10-16T13:40:39.823215+0000","last_unstale":"2023-10-16T13:40:41.214929+0000","last_undegraded":"2023-10-16T13:40:41.214929+0000","last_fullsized":"2023-10-16T13:40:41.214929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:24.798572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810097+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810097+0000","last_peered":"2023-10-16T13:40:40.810097+0000","last_clean":"2023-10-16T13:40:40.810097+0000","last_became_active":"2023-10-16T13:40:39.820879+0000","last_became_peered":"2023-10-16T13:40:39.820879+0000","last_unstale":"2023-10-16T13:40:40.810097+0000","last_undegraded":"2023-10-16T13:40:40.810097+0000","last_fullsized":"2023-10-16T13:40:40.810097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810169+0000","last_change":"2023-10-16T13:40:39.816419+0000","last_active":"2023-10-16T13:40:40.810169+0000","last_peered":"2023-10-16T13:40:40.810169+0000","last_clean":"2023-10-16T13:40:40.810169+0000","last_became_active":"2023-10-16T13:40:39.816092+0000","last_became_peered":"2023-10-16T13:40:39.816092+0000","last_unstale":"2023-10-16T13:40:40.810169+0000","last_undegraded":"2023-10-16T13:40:40.810169+0000","last_fullsized":"2023-10-16T13:40:40.810169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808812+0000","last_change":"2023-10-16T13:40:39.820724+0000","last_active":"2023-10-16T13:40:40.808812+0000","last_peered":"2023-10-16T13:40:40.808812+0000","last_clean":"2023-10-16T13:40:40.808812+0000","last_became_active":"2023-10-16T13:40:39.820464+0000","last_became_peered":"2023-10-16T13:40:39.820464+0000","last_unstale":"2023-10-16T13:40:40.808812+0000","last_undegraded":"2023-10-16T13:40:40.808812+0000","last_fullsized":"2023-10-16T13:40:40.808812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:59.734877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.800334+0000","last_change":"2023-10-16T13:40:37.800334+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.800334+0000","last_undegraded":"2023-10-16T13:40:37.800334+0000","last_fullsized":"2023-10-16T13:40:37.800334+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716115+0000","last_change":"2023-10-16T13:40:39.822604+0000","last_active":"2023-10-16T13:40:41.716115+0000","last_peered":"2023-10-16T13:40:41.716115+0000","last_clean":"2023-10-16T13:40:41.716115+0000","last_became_active":"2023-10-16T13:40:39.821385+0000","last_became_peered":"2023-10-16T13:40:39.821385+0000","last_unstale":"2023-10-16T13:40:41.716115+0000","last_undegraded":"2023-10-16T13:40:41.716115+0000","last_fullsized":"2023-10-16T13:40:41.716115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:41.889159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.801877+0000","last_change":"2023-10-16T13:40:37.801877+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.801877+0000","last_undegraded":"2023-10-16T13:40:37.801877+0000","last_fullsized":"2023-10-16T13:40:37.801877+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809425+0000","last_change":"2023-10-16T13:40:39.827023+0000","last_active":"2023-10-16T13:40:40.809425+0000","last_peered":"2023-10-16T13:40:40.809425+0000","last_clean":"2023-10-16T13:40:40.809425+0000","last_became_active":"2023-10-16T13:40:39.825744+0000","last_became_peered":"2023-10-16T13:40:39.825744+0000","last_unstale":"2023-10-16T13:40:40.809425+0000","last_undegraded":"2023-10-16T13:40:40.809425+0000","last_fullsized":"2023-10-16T13:40:40.809425+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:25.807534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797724+0000","last_change":"2023-10-16T13:40:37.797724+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797724+0000","last_undegraded":"2023-10-16T13:40:37.797724+0000","last_fullsized":"2023-10-16T13:40:37.797724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840162+0000","last_change":"2023-10-16T13:40:38.820937+0000","last_active":"2023-10-16T13:40:39.840162+0000","last_peered":"2023-10-16T13:40:39.840162+0000","last_clean":"2023-10-16T13:40:39.840162+0000","last_became_active":"2023-10-16T13:40:38.820601+0000","last_became_peered":"2023-10-16T13:40:38.820601+0000","last_unstale":"2023-10-16T13:40:39.840162+0000","last_undegraded":"2023-10-16T13:40:39.840162+0000","last_fullsized":"2023-10-16T13:40:39.840162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:05.904450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810245+0000","last_change":"2023-10-16T13:40:39.819143+0000","last_active":"2023-10-16T13:40:40.810245+0000","last_peered":"2023-10-16T13:40:40.810245+0000","last_clean":"2023-10-16T13:40:40.810245+0000","last_became_active":"2023-10-16T13:40:39.818866+0000","last_became_peered":"2023-10-16T13:40:39.818866+0000","last_unstale":"2023-10-16T13:40:40.810245+0000","last_undegraded":"2023-10-16T13:40:40.810245+0000","last_fullsized":"2023-10-16T13:40:40.810245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.845415+0000","last_change":"2023-10-16T13:40:38.815449+0000","last_active":"2023-10-16T13:40:39.845415+0000","last_peered":"2023-10-16T13:40:39.845415+0000","last_clean":"2023-10-16T13:40:39.845415+0000","last_became_active":"2023-10-16T13:40:38.815189+0000","last_became_peered":"2023-10-16T13:40:38.815189+0000","last_unstale":"2023-10-16T13:40:39.845415+0000","last_undegraded":"2023-10-16T13:40:39.845415+0000","last_fullsized":"2023-10-16T13:40:39.845415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:24.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.839986+0000","last_change":"2023-10-16T13:40:38.821853+0000","last_active":"2023-10-16T13:40:39.839986+0000","last_peered":"2023-10-16T13:40:39.839986+0000","last_clean":"2023-10-16T13:40:39.839986+0000","last_became_active":"2023-10-16T13:40:38.821494+0000","last_became_peered":"2023-10-16T13:40:38.821494+0000","last_unstale":"2023-10-16T13:40:39.839986+0000","last_undegraded":"2023-10-16T13:40:39.839986+0000","last_fullsized":"2023-10-16T13:40:39.839986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:11.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715181+0000","last_change":"2023-10-16T13:40:39.827080+0000","last_active":"2023-10-16T13:40:41.715181+0000","last_peered":"2023-10-16T13:40:41.715181+0000","last_clean":"2023-10-16T13:40:41.715181+0000","last_became_active":"2023-10-16T13:40:39.826753+0000","last_became_peered":"2023-10-16T13:40:39.826753+0000","last_unstale":"2023-10-16T13:40:41.715181+0000","last_undegraded":"2023-10-16T13:40:41.715181+0000","last_fullsized":"2023-10-16T13:40:41.715181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:19.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809900+0000","last_change":"2023-10-16T13:40:38.820205+0000","last_active":"2023-10-16T13:40:39.809900+0000","last_peered":"2023-10-16T13:40:39.809900+0000","last_clean":"2023-10-16T13:40:39.809900+0000","last_became_active":"2023-10-16T13:40:38.819870+0000","last_became_peered":"2023-10-16T13:40:38.819870+0000","last_unstale":"2023-10-16T13:40:39.809900+0000","last_undegraded":"2023-10-16T13:40:39.809900+0000","last_fullsized":"2023-10-16T13:40:39.809900+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:54.803860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805349+0000","last_change":"2023-10-16T13:40:38.819977+0000","last_active":"2023-10-16T13:40:39.805349+0000","last_peered":"2023-10-16T13:40:39.805349+0000","last_clean":"2023-10-16T13:40:39.805349+0000","last_became_active":"2023-10-16T13:40:38.819676+0000","last_became_peered":"2023-10-16T13:40:38.819676+0000","last_unstale":"2023-10-16T13:40:39.805349+0000","last_undegraded":"2023-10-16T13:40:39.805349+0000","last_fullsized":"2023-10-16T13:40:39.805349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:53.008354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810642+0000","last_change":"2023-10-16T13:40:39.824725+0000","last_active":"2023-10-16T13:40:40.810642+0000","last_peered":"2023-10-16T13:40:40.810642+0000","last_clean":"2023-10-16T13:40:40.810642+0000","last_became_active":"2023-10-16T13:40:39.824452+0000","last_became_peered":"2023-10-16T13:40:39.824452+0000","last_unstale":"2023-10-16T13:40:40.810642+0000","last_undegraded":"2023-10-16T13:40:40.810642+0000","last_fullsized":"2023-10-16T13:40:40.810642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:27.067030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.798172+0000","last_change":"2023-10-16T13:40:37.798172+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.798172+0000","last_undegraded":"2023-10-16T13:40:37.798172+0000","last_fullsized":"2023-10-16T13:40:37.798172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812283+0000","last_change":"2023-10-16T13:40:38.818983+0000","last_active":"2023-10-16T13:40:39.812283+0000","last_peered":"2023-10-16T13:40:39.812283+0000","last_clean":"2023-10-16T13:40:39.812283+0000","last_became_active":"2023-10-16T13:40:38.818660+0000","last_became_peered":"2023-10-16T13:40:38.818660+0000","last_unstale":"2023-10-16T13:40:39.812283+0000","last_undegraded":"2023-10-16T13:40:39.812283+0000","last_fullsized":"2023-10-16T13:40:39.812283+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:06.070222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809240+0000","last_change":"2023-10-16T13:40:39.824564+0000","last_active":"2023-10-16T13:40:40.809240+0000","last_peered":"2023-10-16T13:40:40.809240+0000","last_clean":"2023-10-16T13:40:40.809240+0000","last_became_active":"2023-10-16T13:40:39.824255+0000","last_became_peered":"2023-10-16T13:40:39.824255+0000","last_unstale":"2023-10-16T13:40:40.809240+0000","last_undegraded":"2023-10-16T13:40:40.809240+0000","last_fullsized":"2023-10-16T13:40:40.809240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:47.276160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842913+0000","last_change":"2023-10-16T13:40:38.817847+0000","last_active":"2023-10-16T13:40:39.842913+0000","last_peered":"2023-10-16T13:40:39.842913+0000","last_clean":"2023-10-16T13:40:39.842913+0000","last_became_active":"2023-10-16T13:40:38.817561+0000","last_became_peered":"2023-10-16T13:40:38.817561+0000","last_unstale":"2023-10-16T13:40:39.842913+0000","last_undegraded":"2023-10-16T13:40:39.842913+0000","last_fullsized":"2023-10-16T13:40:39.842913+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:45.576746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715899+0000","last_change":"2023-10-16T13:40:39.817345+0000","last_active":"2023-10-16T13:40:41.715899+0000","last_peered":"2023-10-16T13:40:41.715899+0000","last_clean":"2023-10-16T13:40:41.715899+0000","last_became_active":"2023-10-16T13:40:39.817042+0000","last_became_peered":"2023-10-16T13:40:39.817042+0000","last_unstale":"2023-10-16T13:40:41.715899+0000","last_undegraded":"2023-10-16T13:40:41.715899+0000","last_fullsized":"2023-10-16T13:40:41.715899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:47.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.847149+0000","last_change":"2023-10-16T13:40:38.816845+0000","last_active":"2023-10-16T13:40:39.847149+0000","last_peered":"2023-10-16T13:40:39.847149+0000","last_clean":"2023-10-16T13:40:39.847149+0000","last_became_active":"2023-10-16T13:40:38.816563+0000","last_became_peered":"2023-10-16T13:40:38.816563+0000","last_unstale":"2023-10-16T13:40:39.847149+0000","last_undegraded":"2023-10-16T13:40:39.847149+0000","last_fullsized":"2023-10-16T13:40:39.847149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:52.412223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843212+0000","last_change":"2023-10-16T13:40:38.818745+0000","last_active":"2023-10-16T13:40:39.843212+0000","last_peered":"2023-10-16T13:40:39.843212+0000","last_clean":"2023-10-16T13:40:39.843212+0000","last_became_active":"2023-10-16T13:40:38.818380+0000","last_became_peered":"2023-10-16T13:40:38.818380+0000","last_unstale":"2023-10-16T13:40:39.843212+0000","last_undegraded":"2023-10-16T13:40:39.843212+0000","last_fullsized":"2023-10-16T13:40:39.843212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810402+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810402+0000","last_peered":"2023-10-16T13:40:40.810402+0000","last_clean":"2023-10-16T13:40:40.810402+0000","last_became_active":"2023-10-16T13:40:39.820851+0000","last_became_peered":"2023-10-16T13:40:39.820851+0000","last_unstale":"2023-10-16T13:40:40.810402+0000","last_undegraded":"2023-10-16T13:40:40.810402+0000","last_fullsized":"2023-10-16T13:40:40.810402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812337+0000","last_change":"2023-10-16T13:40:38.821394+0000","last_active":"2023-10-16T13:40:39.812337+0000","last_peered":"2023-10-16T13:40:39.812337+0000","last_clean":"2023-10-16T13:40:39.812337+0000","last_became_active":"2023-10-16T13:40:38.821071+0000","last_became_peered":"2023-10-16T13:40:38.821071+0000","last_unstale":"2023-10-16T13:40:39.812337+0000","last_undegraded":"2023-10-16T13:40:39.812337+0000","last_fullsized":"2023-10-16T13:40:39.812337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:57:29.111116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809248+0000","last_change":"2023-10-16T13:40:38.815484+0000","last_active":"2023-10-16T13:40:39.809248+0000","last_peered":"2023-10-16T13:40:39.809248+0000","last_clean":"2023-10-16T13:40:39.809248+0000","last_became_active":"2023-10-16T13:40:38.815154+0000","last_became_peered":"2023-10-16T13:40:38.815154+0000","last_unstale":"2023-10-16T13:40:39.809248+0000","last_undegraded":"2023-10-16T13:40:39.809248+0000","last_fullsized":"2023-10-16T13:40:39.809248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:55.109057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715501+0000","last_change":"2023-10-16T13:40:39.821845+0000","last_active":"2023-10-16T13:40:41.715501+0000","last_peered":"2023-10-16T13:40:41.715501+0000","last_clean":"2023-10-16T13:40:41.715501+0000","last_became_active":"2023-10-16T13:40:39.821282+0000","last_became_peered":"2023-10-16T13:40:39.821282+0000","last_unstale":"2023-10-16T13:40:41.715501+0000","last_undegraded":"2023-10-16T13:40:41.715501+0000","last_fullsized":"2023-10-16T13:40:41.715501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:16.745728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797735+0000","last_change":"2023-10-16T13:40:37.797735+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797735+0000","last_undegraded":"2023-10-16T13:40:37.797735+0000","last_fullsized":"2023-10-16T13:40:37.797735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842725+0000","last_change":"2023-10-16T13:40:38.827807+0000","last_active":"2023-10-16T13:40:39.842725+0000","last_peered":"2023-10-16T13:40:39.842725+0000","last_clean":"2023-10-16T13:40:39.842725+0000","last_became_active":"2023-10-16T13:40:38.827562+0000","last_became_peered":"2023-10-16T13:40:38.827562+0000","last_unstale":"2023-10-16T13:40:39.842725+0000","last_undegraded":"2023-10-16T13:40:39.842725+0000","last_fullsized":"2023-10-16T13:40:39.842725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:17.664292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.797842+0000","last_change":"2023-10-16T13:40:37.797842+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.797842+0000","last_undegraded":"2023-10-16T13:40:37.797842+0000","last_fullsized":"2023-10-16T13:40:37.797842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716385+0000","last_change":"2023-10-16T13:40:39.817797+0000","last_active":"2023-10-16T13:40:41.716385+0000","last_peered":"2023-10-16T13:40:41.716385+0000","last_clean":"2023-10-16T13:40:41.716385+0000","last_became_active":"2023-10-16T13:40:39.817154+0000","last_became_peered":"2023-10-16T13:40:39.817154+0000","last_unstale":"2023-10-16T13:40:41.716385+0000","last_undegraded":"2023-10-16T13:40:41.716385+0000","last_fullsized":"2023-10-16T13:40:41.716385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:56.113861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843250+0000","last_change":"2023-10-16T13:40:38.821194+0000","last_active":"2023-10-16T13:40:39.843250+0000","last_peered":"2023-10-16T13:40:39.843250+0000","last_clean":"2023-10-16T13:40:39.843250+0000","last_became_active":"2023-10-16T13:40:38.820062+0000","last_became_peered":"2023-10-16T13:40:38.820062+0000","last_unstale":"2023-10-16T13:40:39.843250+0000","last_undegraded":"2023-10-16T13:40:39.843250+0000","last_fullsized":"2023-10-16T13:40:39.843250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:32.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715891+0000","last_change":"2023-10-16T13:40:39.826550+0000","last_active":"2023-10-16T13:40:41.715891+0000","last_peered":"2023-10-16T13:40:41.715891+0000","last_clean":"2023-10-16T13:40:41.715891+0000","last_became_active":"2023-10-16T13:40:39.826243+0000","last_became_peered":"2023-10-16T13:40:39.826243+0000","last_unstale":"2023-10-16T13:40:41.715891+0000","last_undegraded":"2023-10-16T13:40:41.715891+0000","last_fullsized":"2023-10-16T13:40:41.715891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:41.376812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.800345+0000","last_change":"2023-10-16T13:40:37.800345+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.800345+0000","last_undegraded":"2023-10-16T13:40:37.800345+0000","last_fullsized":"2023-10-16T13:40:37.800345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214983+0000","last_change":"2023-10-16T13:40:39.820400+0000","last_active":"2023-10-16T13:40:41.214983+0000","last_peered":"2023-10-16T13:40:41.214983+0000","last_clean":"2023-10-16T13:40:41.214983+0000","last_became_active":"2023-10-16T13:40:39.820107+0000","last_became_peered":"2023-10-16T13:40:39.820107+0000","last_unstale":"2023-10-16T13:40:41.214983+0000","last_undegraded":"2023-10-16T13:40:41.214983+0000","last_fullsized":"2023-10-16T13:40:41.214983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:30.379729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812497+0000","last_change":"2023-10-16T13:40:38.819491+0000","last_active":"2023-10-16T13:40:39.812497+0000","last_peered":"2023-10-16T13:40:39.812497+0000","last_clean":"2023-10-16T13:40:39.812497+0000","last_became_active":"2023-10-16T13:40:38.819167+0000","last_became_peered":"2023-10-16T13:40:38.819167+0000","last_unstale":"2023-10-16T13:40:39.812497+0000","last_undegraded":"2023-10-16T13:40:39.812497+0000","last_fullsized":"2023-10-16T13:40:39.812497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:24.574150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215007+0000","last_change":"2023-10-16T13:40:39.822722+0000","last_active":"2023-10-16T13:40:41.215007+0000","last_peered":"2023-10-16T13:40:41.215007+0000","last_clean":"2023-10-16T13:40:41.215007+0000","last_became_active":"2023-10-16T13:40:39.821553+0000","last_became_peered":"2023-10-16T13:40:39.821553+0000","last_unstale":"2023-10-16T13:40:41.215007+0000","last_undegraded":"2023-10-16T13:40:41.215007+0000","last_fullsized":"2023-10-16T13:40:41.215007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:03.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809399+0000","last_change":"2023-10-16T13:40:38.816423+0000","last_active":"2023-10-16T13:40:39.809399+0000","last_peered":"2023-10-16T13:40:39.809399+0000","last_clean":"2023-10-16T13:40:39.809399+0000","last_became_active":"2023-10-16T13:40:38.815912+0000","last_became_peered":"2023-10-16T13:40:38.815912+0000","last_unstale":"2023-10-16T13:40:39.809399+0000","last_undegraded":"2023-10-16T13:40:39.809399+0000","last_fullsized":"2023-10-16T13:40:39.809399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:27.612163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214957+0000","last_change":"2023-10-16T13:40:39.824262+0000","last_active":"2023-10-16T13:40:41.214957+0000","last_peered":"2023-10-16T13:40:41.214957+0000","last_clean":"2023-10-16T13:40:41.214957+0000","last_became_active":"2023-10-16T13:40:39.823930+0000","last_became_peered":"2023-10-16T13:40:39.823930+0000","last_unstale":"2023-10-16T13:40:41.214957+0000","last_undegraded":"2023-10-16T13:40:41.214957+0000","last_fullsized":"2023-10-16T13:40:41.214957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:51.876599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.801838+0000","last_change":"2023-10-16T13:40:37.801838+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.801838+0000","last_undegraded":"2023-10-16T13:40:37.801838+0000","last_fullsized":"2023-10-16T13:40:37.801838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.841270+0000","last_change":"2023-10-16T13:40:38.827775+0000","last_active":"2023-10-16T13:40:39.841270+0000","last_peered":"2023-10-16T13:40:39.841270+0000","last_clean":"2023-10-16T13:40:39.841270+0000","last_became_active":"2023-10-16T13:40:38.827564+0000","last_became_peered":"2023-10-16T13:40:38.827564+0000","last_unstale":"2023-10-16T13:40:39.841270+0000","last_undegraded":"2023-10-16T13:40:39.841270+0000","last_fullsized":"2023-10-16T13:40:39.841270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:54.568956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810404+0000","last_change":"2023-10-16T13:40:39.816893+0000","last_active":"2023-10-16T13:40:40.810404+0000","last_peered":"2023-10-16T13:40:40.810404+0000","last_clean":"2023-10-16T13:40:40.810404+0000","last_became_active":"2023-10-16T13:40:39.816559+0000","last_became_peered":"2023-10-16T13:40:39.816559+0000","last_unstale":"2023-10-16T13:40:40.810404+0000","last_undegraded":"2023-10-16T13:40:40.810404+0000","last_fullsized":"2023-10-16T13:40:40.810404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811471+0000","last_change":"2023-10-16T13:40:38.815314+0000","last_active":"2023-10-16T13:40:39.811471+0000","last_peered":"2023-10-16T13:40:39.811471+0000","last_clean":"2023-10-16T13:40:39.811471+0000","last_became_active":"2023-10-16T13:40:38.814850+0000","last_became_peered":"2023-10-16T13:40:38.814850+0000","last_unstale":"2023-10-16T13:40:39.811471+0000","last_undegraded":"2023-10-16T13:40:39.811471+0000","last_fullsized":"2023-10-16T13:40:39.811471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:01.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.806258+0000","last_change":"2023-10-16T13:40:38.815831+0000","last_active":"2023-10-16T13:40:39.806258+0000","last_peered":"2023-10-16T13:40:39.806258+0000","last_clean":"2023-10-16T13:40:39.806258+0000","last_became_active":"2023-10-16T13:40:38.815540+0000","last_became_peered":"2023-10-16T13:40:38.815540+0000","last_unstale":"2023-10-16T13:40:39.806258+0000","last_undegraded":"2023-10-16T13:40:39.806258+0000","last_fullsized":"2023-10-16T13:40:39.806258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:29:02.491892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:40:38.795433+0000","last_change":"2023-10-16T13:40:38.795433+0000","last_active":"2023-10-16T13:40:38.795433+0000","last_peered":"2023-10-16T13:40:38.795433+0000","last_clean":"2023-10-16T13:40:38.795433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:38.795433+0000","last_undegraded":"2023-10-16T13:40:38.795433+0000","last_fullsized":"2023-10-16T13:40:38.795433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.802010+0000","last_change":"2023-10-16T13:40:37.802010+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.802010+0000","last_undegraded":"2023-10-16T13:40:37.802010+0000","last_fullsized":"2023-10-16T13:40:37.802010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716126+0000","last_change":"2023-10-16T13:40:39.821518+0000","last_active":"2023-10-16T13:40:41.716126+0000","last_peered":"2023-10-16T13:40:41.716126+0000","last_clean":"2023-10-16T13:40:41.716126+0000","last_became_active":"2023-10-16T13:40:39.821128+0000","last_became_peered":"2023-10-16T13:40:39.821128+0000","last_unstale":"2023-10-16T13:40:41.716126+0000","last_undegraded":"2023-10-16T13:40:41.716126+0000","last_fullsized":"2023-10-16T13:40:41.716126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:33.784224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805532+0000","last_change":"2023-10-16T13:40:38.819885+0000","last_active":"2023-10-16T13:40:39.805532+0000","last_peered":"2023-10-16T13:40:39.805532+0000","last_clean":"2023-10-16T13:40:39.805532+0000","last_became_active":"2023-10-16T13:40:38.819622+0000","last_became_peered":"2023-10-16T13:40:38.819622+0000","last_unstale":"2023-10-16T13:40:39.805532+0000","last_undegraded":"2023-10-16T13:40:39.805532+0000","last_fullsized":"2023-10-16T13:40:39.805532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:17:33.819262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808911+0000","last_change":"2023-10-16T13:40:39.825984+0000","last_active":"2023-10-16T13:40:40.808911+0000","last_peered":"2023-10-16T13:40:40.808911+0000","last_clean":"2023-10-16T13:40:40.808911+0000","last_became_active":"2023-10-16T13:40:39.825650+0000","last_became_peered":"2023-10-16T13:40:39.825650+0000","last_unstale":"2023-10-16T13:40:40.808911+0000","last_undegraded":"2023-10-16T13:40:40.808911+0000","last_fullsized":"2023-10-16T13:40:40.808911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:36:34.339968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810108+0000","last_change":"2023-10-16T13:40:38.820149+0000","last_active":"2023-10-16T13:40:39.810108+0000","last_peered":"2023-10-16T13:40:39.810108+0000","last_clean":"2023-10-16T13:40:39.810108+0000","last_became_active":"2023-10-16T13:40:38.819853+0000","last_became_peered":"2023-10-16T13:40:38.819853+0000","last_unstale":"2023-10-16T13:40:39.810108+0000","last_undegraded":"2023-10-16T13:40:39.810108+0000","last_fullsized":"2023-10-16T13:40:39.810108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:30.874102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715368+0000","last_change":"2023-10-16T13:40:39.818863+0000","last_active":"2023-10-16T13:40:41.715368+0000","last_peered":"2023-10-16T13:40:41.715368+0000","last_clean":"2023-10-16T13:40:41.715368+0000","last_became_active":"2023-10-16T13:40:39.818500+0000","last_became_peered":"2023-10-16T13:40:39.818500+0000","last_unstale":"2023-10-16T13:40:41.715368+0000","last_undegraded":"2023-10-16T13:40:41.715368+0000","last_fullsized":"2023-10-16T13:40:41.715368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:48.678490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-10-16T13:40:37.798474+0000","last_change":"2023-10-16T13:40:37.798474+0000","last_active":"2023-10-16T13:40:37.790629+0000","last_peered":"2023-10-16T13:40:37.790629+0000","last_clean":"2023-10-16T13:40:37.790629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:40:37.798474+0000","last_undegraded":"2023-10-16T13:40:37.798474+0000","last_fullsized":"2023-10-16T13:40:37.798474+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809466+0000","last_change":"2023-10-16T13:40:39.820186+0000","last_active":"2023-10-16T13:40:40.809466+0000","last_peered":"2023-10-16T13:40:40.809466+0000","last_clean":"2023-10-16T13:40:40.809466+0000","last_became_active":"2023-10-16T13:40:39.819347+0000","last_became_peered":"2023-10-16T13:40:39.819347+0000","last_unstale":"2023-10-16T13:40:40.809466+0000","last_undegraded":"2023-10-16T13:40:40.809466+0000","last_fullsized":"2023-10-16T13:40:40.809466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:04.033107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810851+0000","last_change":"2023-10-16T13:40:38.821117+0000","last_active":"2023-10-16T13:40:39.810851+0000","last_peered":"2023-10-16T13:40:39.810851+0000","last_clean":"2023-10-16T13:40:39.810851+0000","last_became_active":"2023-10-16T13:40:38.820818+0000","last_became_peered":"2023-10-16T13:40:38.820818+0000","last_unstale":"2023-10-16T13:40:39.810851+0000","last_undegraded":"2023-10-16T13:40:39.810851+0000","last_fullsized":"2023-10-16T13:40:39.810851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:46.343827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215042+0000","last_change":"2023-10-16T13:40:39.824316+0000","last_active":"2023-10-16T13:40:41.215042+0000","last_peered":"2023-10-16T13:40:41.215042+0000","last_clean":"2023-10-16T13:40:41.215042+0000","last_became_active":"2023-10-16T13:40:39.824016+0000","last_became_peered":"2023-10-16T13:40:39.824016+0000","last_unstale":"2023-10-16T13:40:41.215042+0000","last_undegraded":"2023-10-16T13:40:41.215042+0000","last_fullsized":"2023-10-16T13:40:41.215042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:13.061966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840115+0000","last_change":"2023-10-16T13:40:38.818953+0000","last_active":"2023-10-16T13:40:39.840115+0000","last_peered":"2023-10-16T13:40:39.840115+0000","last_clean":"2023-10-16T13:40:39.840115+0000","last_became_active":"2023-10-16T13:40:38.818613+0000","last_became_peered":"2023-10-16T13:40:38.818613+0000","last_unstale":"2023-10-16T13:40:39.840115+0000","last_undegraded":"2023-10-16T13:40:39.840115+0000","last_fullsized":"2023-10-16T13:40:39.840115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:40.884355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-16T13:40:36.729188+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:36.729188+0000","last_peered":"2023-10-16T13:40:36.729188+0000","last_clean":"2023-10-16T13:40:36.729188+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:36.729188+0000","last_undegraded":"2023-10-16T13:40:36.729188+0000","last_fullsized":"2023-10-16T13:40:36.729188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":78,"acting":78,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1310720,"data_stored":894128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.499},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.80000000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.873,"15min":0.873},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.0509999999999999,"15min":1.133},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.081,"5min":10.964,"15min":10.964},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67700000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.48799999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":325338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.503,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":0.49199999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.752,"15min":0.752},"last":0.373}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56000000000000005,"5min":0.88,"15min":0.88},"last":0.309},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63500000000000001,"5min":1.002,"15min":1.002},"last":1.4390000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85999999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.131,"15min":1.131},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88800000000000001,"5min":1.034,"15min":1.034},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85099999999999998,"5min":1.085,"15min":1.085},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1306624,"data_stored":893109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.41299999999999998,"15min":0.38400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.42199999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.433,"15min":0.40899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41899999999999998,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.375},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.625,"15min":0.60099999999999998},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0190000000000001,"5min":4.0190000000000001,"15min":4.0190000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.63900000000000001,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.0650000000000004,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.5},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.63,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.64900000000000002,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.69199999999999995,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.46400000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.216},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26900000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63500000000000001,"5min":1.153,"15min":1.153},"last":0.318}]},{"osd":4,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.054,"15min":1.054},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442}]},{"osd":5,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":1.111,"15min":1.111},"last":0.497}]},{"osd":7,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.23,"15min":1.23},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.57299999999999995,"15min":0.61399999999999999},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.623,"5min":2.181,"15min":2.181},"last":0.501}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49299999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56200000000000006,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80700000000000005,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.83899999999999997,"15min":0.88100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.72299999999999998,"15min":0.746},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79400000000000004,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73599999999999999,"15min":0.75900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77800000000000002,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76000000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.84399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.88800000000000001,"15min":0.93600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77900000000000003,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78300000000000003,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":303760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":0.88},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.877,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66700000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.141,"15min":1.141},"last":0.373},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.43099999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:44.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-16T13:40:44.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-16T13:40:44.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-16T13:40:44.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-16T13:40:44.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-16T13:40:44.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-16T13:40:44.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-16T13:40:44.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-16T13:40:44.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-16T13:40:44.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-16T13:40:44.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-16T13:40:44.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-16T13:40:44.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-16T13:40:44.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-16T13:40:44.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-16T13:40:44.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.800334+0000', 'last_change': '2023-10-16T13:40:37.800334+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.800334+0000', 'last_undegraded': '2023-10-16T13:40:37.800334+0000', 'last_fullsized': '2023-10-16T13:40:37.800334+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:44.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-16T13:40:44.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.801877+0000', 'last_change': '2023-10-16T13:40:37.801877+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.801877+0000', 'last_undegraded': '2023-10-16T13:40:37.801877+0000', 'last_fullsized': '2023-10-16T13:40:37.801877+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:44.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-16T13:40:44.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.797724+0000', 'last_change': '2023-10-16T13:40:37.797724+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.797724+0000', 'last_undegraded': '2023-10-16T13:40:37.797724+0000', 'last_fullsized': '2023-10-16T13:40:37.797724+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:44.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-16T13:40:44.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-16T13:40:44.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-16T13:40:44.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-16T13:40:44.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.798172+0000', 'last_change': '2023-10-16T13:40:37.798172+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.798172+0000', 'last_undegraded': '2023-10-16T13:40:37.798172+0000', 'last_fullsized': '2023-10-16T13:40:37.798172+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:44.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-16T13:40:44.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-16T13:40:44.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-16T13:40:44.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-16T13:40:44.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.797735+0000', 'last_change': '2023-10-16T13:40:37.797735+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.797735+0000', 'last_undegraded': '2023-10-16T13:40:37.797735+0000', 'last_fullsized': '2023-10-16T13:40:37.797735+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:44.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-16T13:40:44.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-16T13:40:44.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-16T13:40:44.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.797842+0000', 'last_change': '2023-10-16T13:40:37.797842+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.797842+0000', 'last_undegraded': '2023-10-16T13:40:37.797842+0000', 'last_fullsized': '2023-10-16T13:40:37.797842+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:44.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-16T13:40:44.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.800345+0000', 'last_change': '2023-10-16T13:40:37.800345+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.800345+0000', 'last_undegraded': '2023-10-16T13:40:37.800345+0000', 'last_fullsized': '2023-10-16T13:40:37.800345+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:40:44.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-16T13:40:44.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.801838+0000', 'last_change': '2023-10-16T13:40:37.801838+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.801838+0000', 'last_undegraded': '2023-10-16T13:40:37.801838+0000', 'last_fullsized': '2023-10-16T13:40:37.801838+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:44.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-16T13:40:44.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-16T13:40:44.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-16T13:40:44.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:40:38.795433+0000', 'last_change': '2023-10-16T13:40:38.795433+0000', 'last_active': '2023-10-16T13:40:38.795433+0000', 'last_peered': '2023-10-16T13:40:38.795433+0000', 'last_clean': '2023-10-16T13:40:38.795433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:38.795433+0000', 'last_undegraded': '2023-10-16T13:40:38.795433+0000', 'last_fullsized': '2023-10-16T13:40:38.795433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:38.795433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:40:44.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-16T13:40:44.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.802010+0000', 'last_change': '2023-10-16T13:40:37.802010+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.802010+0000', 'last_undegraded': '2023-10-16T13:40:37.802010+0000', 'last_fullsized': '2023-10-16T13:40:37.802010+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:40:44.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-16T13:40:44.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:40:37.798474+0000', 'last_change': '2023-10-16T13:40:37.798474+0000', 'last_active': '2023-10-16T13:40:37.790629+0000', 'last_peered': '2023-10-16T13:40:37.790629+0000', 'last_clean': '2023-10-16T13:40:37.790629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:40:37.798474+0000', 'last_undegraded': '2023-10-16T13:40:37.798474+0000', 'last_fullsized': '2023-10-16T13:40:37.798474+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'last_clean_scrub_stamp': '2023-10-16T13:40:37.790629+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:40:44.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T13:40:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.942+0000 7f3345e4c700 1 Processor -- start 2023-10-16T13:40:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.942+0000 7f3345e4c700 1 -- start start 2023-10-16T13:40:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f3345e4c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33400d0ec0 0x7f33400cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f3345e4c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400ccfb0 con 0x7f33400cc2b0 2023-10-16T13:40:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f3345e4c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400cd570 con 0x7f334015baf0 2023-10-16T13:40:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f3345e4c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400c3f60 con 0x7f33400d0ec0 2023-10-16T13:40:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f333effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33400d0ec0 0x7f33400cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f333effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33400d0ec0 0x7f33400cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45866/0 (socket says 172.21.15.5:45866) 2023-10-16T13:40:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f333ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33400cc2b0 0x7f33400cc700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55872/0 (socket says 172.21.15.5:55872) 2023-10-16T13:40:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.943+0000 7f333effd700 1 -- 172.21.15.5:0/2575392662 learned_addr learned my addr 172.21.15.5:0/2575392662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333effd700 1 -- 172.21.15.5:0/2575392662 >> v1:172.21.15.112:6789/0 conn(0x7f334015baf0 legacy=0x7f334006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333effd700 1 -- 172.21.15.5:0/2575392662 >> v1:172.21.15.5:6789/0 conn(0x7f33400cc2b0 legacy=0x7f33400cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333effd700 1 -- 172.21.15.5:0/2575392662 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334006f1b0 con 0x7f33400d0ec0 2023-10-16T13:40:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333effd700 1 --2- 172.21.15.5:0/2575392662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33400d0ec0 0x7f33400cda00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3334009920 tx=0x7f3334009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ccee17831433cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333e7fc700 1 -- 172.21.15.5:0/2575392662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400ba20 con 0x7f33400d0ec0 2023-10-16T13:40:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333e7fc700 1 -- 172.21.15.5:0/2575392662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400bb80 con 0x7f33400d0ec0 2023-10-16T13:40:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.944+0000 7f333e7fc700 1 -- 172.21.15.5:0/2575392662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334009e70 con 0x7f33400d0ec0 2023-10-16T13:40:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 -- 172.21.15.5:0/2575392662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33400d0ec0 msgr2=0x7f33400cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 --2- 172.21.15.5:0/2575392662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33400d0ec0 0x7f33400cda00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3334009920 tx=0x7f3334009c30 comp rx=0 tx=0).stop 2023-10-16T13:40:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 -- 172.21.15.5:0/2575392662 shutdown_connections 2023-10-16T13:40:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 --2- 172.21.15.5:0/2575392662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33400d0ec0 0x7f33400cda00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 -- 172.21.15.5:0/2575392662 >> 172.21.15.5:0/2575392662 conn(0x7f3340099a30 msgr2=0x7f33400d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 -- 172.21.15.5:0/2575392662 shutdown_connections 2023-10-16T13:40:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.945+0000 7f3345e4c700 1 -- 172.21.15.5:0/2575392662 wait complete. 2023-10-16T13:40:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.946+0000 7f3345e4c700 1 Processor -- start 2023-10-16T13:40:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.946+0000 7f3345e4c700 1 -- start start 2023-10-16T13:40:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f3345e4c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33400cc2b0 0x7f3340155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f3345e4c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33400d0ec0 0x7f33400c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f3345e4c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 0x7f33400c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f3345e4c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400c5930 con 0x7f334015baf0 2023-10-16T13:40:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f3345e4c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401560d0 con 0x7f33400cc2b0 2023-10-16T13:40:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f3345e4c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400b4a10 con 0x7f33400d0ec0 2023-10-16T13:40:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.947+0000 7f333ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 0x7f33400c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 0x7f33400c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45874/0 (socket says 172.21.15.5:45874) 2023-10-16T13:40:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 -- 172.21.15.5:0/1225697342 learned_addr learned my addr 172.21.15.5:0/1225697342 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:44.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333f7fe700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33400cc2b0 0x7f3340155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333effd700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33400d0ec0 0x7f33400c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 -- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33400d0ec0 msgr2=0x7f33400c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33400d0ec0 0x7f33400c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 -- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33400cc2b0 msgr2=0x7f3340155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33400cc2b0 0x7f3340155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 -- 172.21.15.5:0/1225697342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009550 con 0x7f334015baf0 2023-10-16T13:40:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f333ffff700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 0x7f33400c6b30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f333800cbd0 tx=0x7f333800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333800aaa0 con 0x7f334015baf0 2023-10-16T13:40:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333800ac00 con 0x7f334015baf0 2023-10-16T13:40:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33400c4cb0 con 0x7f334015baf0 2023-10-16T13:40:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338007070 con 0x7f334015baf0 2023-10-16T13:40:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.948+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33400c5270 con 0x7f334015baf0 2023-10-16T13:40:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.949+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334004ec20 con 0x7f334015baf0 2023-10-16T13:40:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.950+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f33380071d0 con 0x7f334015baf0 2023-10-16T13:40:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.950+0000 7f3327fff700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f332c06af90 0x7f332c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:44.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.950+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33380891d0 con 0x7f334015baf0 2023-10-16T13:40:44.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.950+0000 7f333f7fe700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f332c06af90 0x7f332c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:44.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.951+0000 7f333f7fe700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f332c06af90 0x7f332c06d450 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f33400c6370 tx=0x7f3330009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:44.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:44.955+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3338054340 con 0x7f334015baf0 2023-10-16T13:40:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.240+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f33400cba00 con 0x7f334015baf0 2023-10-16T13:40:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.241+0000 7f3327fff700 1 -- 172.21.15.5:0/1225697342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1593 (secure 0 0 0) 0x7f3338017650 con 0x7f334015baf0 2023-10-16T13:40:45.244 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:45.244 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":163,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1697463492,"num_in_osds":8,"osd_in_since":1697463484,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":62},{"state_name":"unknown","count":25},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592196,"bytes_used":232796160,"bytes_avail":772861317120,"bytes_total":773094113280,"unknown_pgs_ratio":0.25773194432258606,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":2337,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":41,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6039}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-16T13:39:51.479327+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-16T13:40:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.242+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f332c06af90 msgr2=0x7f332c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.242+0000 7f3345e4c700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f332c06af90 0x7f332c06d450 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f33400c6370 tx=0x7f3330009040 comp rx=0 tx=0).stop 2023-10-16T13:40:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.242+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 msgr2=0x7f33400c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.242+0000 7f3345e4c700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 0x7f33400c6b30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f333800cbd0 tx=0x7f333800cee0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 shutdown_connections 2023-10-16T13:40:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f334015baf0 0x7f33400c6b30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33400cc2b0 0x7f3340155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f332c06af90 0x7f332c06d450 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 --2- 172.21.15.5:0/1225697342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33400d0ec0 0x7f33400c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 >> 172.21.15.5:0/1225697342 conn(0x7f3340099a30 msgr2=0x7f33400aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:45.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 shutdown_connections 2023-10-16T13:40:45.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.243+0000 7f3345e4c700 1 -- 172.21.15.5:0/1225697342 wait complete. 2023-10-16T13:40:45.257 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T13:40:45.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:45.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.381+0000 7fe76e16f700 1 Processor -- start 2023-10-16T13:40:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.381+0000 7fe76e16f700 1 -- start start 2023-10-16T13:40:45.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.381+0000 7fe76e16f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe76815ab10 0x7fe76815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:45.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.381+0000 7fe76e16f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76815e7a0 con 0x7fe7680b1f50 2023-10-16T13:40:45.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.381+0000 7fe76e16f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76815f730 con 0x7fe7680cfe30 2023-10-16T13:40:45.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.381+0000 7fe76e16f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680b29a0 con 0x7fe76815ab10 2023-10-16T13:40:45.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7677fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe76815ab10 0x7fe76815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe766ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe7680b1f50 0x7fe7680cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55882/0 (socket says 172.21.15.5:55882) 2023-10-16T13:40:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe766ffd700 1 -- 172.21.15.5:0/1621597449 learned_addr learned my addr 172.21.15.5:0/1621597449 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7677fe700 1 -- 172.21.15.5:0/1621597449 >> v1:172.21.15.112:6789/0 conn(0x7fe7680cfe30 legacy=0x7fe7680cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7677fe700 1 -- 172.21.15.5:0/1621597449 >> v1:172.21.15.5:6789/0 conn(0x7fe7680b1f50 legacy=0x7fe7680cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7677fe700 1 -- 172.21.15.5:0/1621597449 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680b2c80 con 0x7fe76815ab10 2023-10-16T13:40:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7667fc700 1 -- 172.21.15.5:0/1621597449 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740278313 0 0) 0x7fe76815e7a0 con 0x7fe7680b1f50 2023-10-16T13:40:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7677fe700 1 --2- 172.21.15.5:0/1621597449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe76815ab10 0x7fe76815f1f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe758009840 tx=0x7fe758009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfe68ec5b3d85e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7667fc700 1 -- 172.21.15.5:0/1621597449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004230 con 0x7fe76815ab10 2023-10-16T13:40:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7667fc700 1 -- 172.21.15.5:0/1621597449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758004390 con 0x7fe76815ab10 2023-10-16T13:40:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.382+0000 7fe7667fc700 1 -- 172.21.15.5:0/1621597449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580036a0 con 0x7fe76815ab10 2023-10-16T13:40:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 -- 172.21.15.5:0/1621597449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe76815ab10 msgr2=0x7fe76815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 --2- 172.21.15.5:0/1621597449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe76815ab10 0x7fe76815f1f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe758009840 tx=0x7fe758009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 -- 172.21.15.5:0/1621597449 shutdown_connections 2023-10-16T13:40:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 --2- 172.21.15.5:0/1621597449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe76815ab10 0x7fe76815f1f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 -- 172.21.15.5:0/1621597449 >> 172.21.15.5:0/1621597449 conn(0x7fe76806dae0 msgr2=0x7fe76806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 -- 172.21.15.5:0/1621597449 shutdown_connections 2023-10-16T13:40:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.383+0000 7fe76e16f700 1 -- 172.21.15.5:0/1621597449 wait complete. 2023-10-16T13:40:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.384+0000 7fe76e16f700 1 Processor -- start 2023-10-16T13:40:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.384+0000 7fe76e16f700 1 -- start start 2023-10-16T13:40:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe76e16f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 0x7fe768141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe76e16f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cfe30 0x7fe76815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe76e16f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815ab10 0x7fe76815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe76e16f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680c8a70 con 0x7fe7680b1f50 2023-10-16T13:40:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe76e16f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680c66f0 con 0x7fe76815ab10 2023-10-16T13:40:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe76e16f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe768144a10 con 0x7fe7680cfe30 2023-10-16T13:40:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 0x7fe768141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 0x7fe768141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45884/0 (socket says 172.21.15.5:45884) 2023-10-16T13:40:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 -- 172.21.15.5:0/3221331261 learned_addr learned my addr 172.21.15.5:0/3221331261 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe767fff700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815ab10 0x7fe76815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe766ffd700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cfe30 0x7fe76815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 -- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cfe30 msgr2=0x7fe76815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cfe30 0x7fe76815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 -- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815ab10 msgr2=0x7fe76815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815ab10 0x7fe76815b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe7677fe700 1 -- 172.21.15.5:0/3221331261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580094a0 con 0x7fe7680b1f50 2023-10-16T13:40:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe767fff700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815ab10 0x7fe76815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.385+0000 7fe766ffd700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cfe30 0x7fe76815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.386+0000 7fe7677fe700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 0x7fe768141230 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe758009b90 tx=0x7fe758004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.386+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758011630 con 0x7fe7680b1f50 2023-10-16T13:40:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.386+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75801e070 con 0x7fe7680b1f50 2023-10-16T13:40:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.386+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580119b0 con 0x7fe7680b1f50 2023-10-16T13:40:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.386+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76815dab0 con 0x7fe7680b1f50 2023-10-16T13:40:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.386+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76815e070 con 0x7fe7680b1f50 2023-10-16T13:40:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.387+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680cf9d0 con 0x7fe7680b1f50 2023-10-16T13:40:45.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.387+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fe758011b10 con 0x7fe7680b1f50 2023-10-16T13:40:45.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.388+0000 7fe74ffff700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe75406af90 0x7fe75406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:45.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.388+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe75808a9e0 con 0x7fe7680b1f50 2023-10-16T13:40:45.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.388+0000 7fe766ffd700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe75406af90 0x7fe75406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:45.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.388+0000 7fe766ffd700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe75406af90 0x7fe75406d450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe768144c70 tx=0x7fe75c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.392+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe758055b30 con 0x7fe7680b1f50 2023-10-16T13:40:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.589+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe76815ecd0 con 0x7fe75406af90 2023-10-16T13:40:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.598+0000 7fe74ffff700 1 -- 172.21.15.5:0/3221331261 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289743 (secure 0 0 0) 0x7fe75c0013d0 con 0x7fe75406af90 2023-10-16T13:40:45.604 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe75406af90 msgr2=0x7fe75406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe75406af90 0x7fe75406d450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe768144c70 tx=0x7fe75c009040 comp rx=0 tx=0).stop 2023-10-16T13:40:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 msgr2=0x7fe768141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 0x7fe768141230 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe758009b90 tx=0x7fe758004750 comp rx=0 tx=0).stop 2023-10-16T13:40:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 shutdown_connections 2023-10-16T13:40:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815ab10 0x7fe76815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7680b1f50 0x7fe768141230 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.601+0000 7fe76e16f700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe75406af90 0x7fe75406d450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.602+0000 7fe76e16f700 1 --2- 172.21.15.5:0/3221331261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7680cfe30 0x7fe76815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.602+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 >> 172.21.15.5:0/3221331261 conn(0x7fe76806dae0 msgr2=0x7fe76806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.602+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 shutdown_connections 2023-10-16T13:40:45.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:45.602+0000 7fe76e16f700 1 -- 172.21.15.5:0/3221331261 wait complete. 2023-10-16T13:40:45.609 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:45.616 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-16T13:40:45.492200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227452,"kb_used_data":7104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747268,"statfs":{"total":773094113280,"available":772861202432,"internally_reserved":0,"allocated":7274496,"data_stored":3768398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.690283"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715983+0000","last_change":"2023-10-16T13:40:39.827147+0000","last_active":"2023-10-16T13:40:41.715983+0000","last_peered":"2023-10-16T13:40:41.715983+0000","last_clean":"2023-10-16T13:40:41.715983+0000","last_became_active":"2023-10-16T13:40:39.826821+0000","last_became_peered":"2023-10-16T13:40:39.826821+0000","last_unstale":"2023-10-16T13:40:41.715983+0000","last_undegraded":"2023-10-16T13:40:41.715983+0000","last_fullsized":"2023-10-16T13:40:41.715983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:36.602305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809161+0000","last_change":"2023-10-16T13:40:39.826301+0000","last_active":"2023-10-16T13:40:40.809161+0000","last_peered":"2023-10-16T13:40:40.809161+0000","last_clean":"2023-10-16T13:40:40.809161+0000","last_became_active":"2023-10-16T13:40:39.825972+0000","last_became_peered":"2023-10-16T13:40:39.825972+0000","last_unstale":"2023-10-16T13:40:40.809161+0000","last_undegraded":"2023-10-16T13:40:40.809161+0000","last_fullsized":"2023-10-16T13:40:40.809161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:29.778901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215120+0000","last_change":"2023-10-16T13:40:39.820300+0000","last_active":"2023-10-16T13:40:41.215120+0000","last_peered":"2023-10-16T13:40:41.215120+0000","last_clean":"2023-10-16T13:40:41.215120+0000","last_became_active":"2023-10-16T13:40:39.819046+0000","last_became_peered":"2023-10-16T13:40:39.819046+0000","last_unstale":"2023-10-16T13:40:41.215120+0000","last_undegraded":"2023-10-16T13:40:41.215120+0000","last_fullsized":"2023-10-16T13:40:41.215120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:10.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715864+0000","last_change":"2023-10-16T13:40:39.820789+0000","last_active":"2023-10-16T13:40:41.715864+0000","last_peered":"2023-10-16T13:40:41.715864+0000","last_clean":"2023-10-16T13:40:41.715864+0000","last_became_active":"2023-10-16T13:40:39.820439+0000","last_became_peered":"2023-10-16T13:40:39.820439+0000","last_unstale":"2023-10-16T13:40:41.715864+0000","last_undegraded":"2023-10-16T13:40:41.715864+0000","last_fullsized":"2023-10-16T13:40:41.715864+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.296829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715734+0000","last_change":"2023-10-16T13:40:39.826643+0000","last_active":"2023-10-16T13:40:41.715734+0000","last_peered":"2023-10-16T13:40:41.715734+0000","last_clean":"2023-10-16T13:40:41.715734+0000","last_became_active":"2023-10-16T13:40:39.826372+0000","last_became_peered":"2023-10-16T13:40:39.826372+0000","last_unstale":"2023-10-16T13:40:41.715734+0000","last_undegraded":"2023-10-16T13:40:41.715734+0000","last_fullsized":"2023-10-16T13:40:41.715734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:24:18.733931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809062+0000","last_change":"2023-10-16T13:40:39.825527+0000","last_active":"2023-10-16T13:40:40.809062+0000","last_peered":"2023-10-16T13:40:40.809062+0000","last_clean":"2023-10-16T13:40:40.809062+0000","last_became_active":"2023-10-16T13:40:39.825063+0000","last_became_peered":"2023-10-16T13:40:39.825063+0000","last_unstale":"2023-10-16T13:40:40.809062+0000","last_undegraded":"2023-10-16T13:40:40.809062+0000","last_fullsized":"2023-10-16T13:40:40.809062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:14.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809901+0000","last_change":"2023-10-16T13:40:39.817076+0000","last_active":"2023-10-16T13:40:40.809901+0000","last_peered":"2023-10-16T13:40:40.809901+0000","last_clean":"2023-10-16T13:40:40.809901+0000","last_became_active":"2023-10-16T13:40:39.816711+0000","last_became_peered":"2023-10-16T13:40:39.816711+0000","last_unstale":"2023-10-16T13:40:40.809901+0000","last_undegraded":"2023-10-16T13:40:40.809901+0000","last_fullsized":"2023-10-16T13:40:40.809901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809507+0000","last_change":"2023-10-16T13:40:39.817668+0000","last_active":"2023-10-16T13:40:40.809507+0000","last_peered":"2023-10-16T13:40:40.809507+0000","last_clean":"2023-10-16T13:40:40.809507+0000","last_became_active":"2023-10-16T13:40:39.817379+0000","last_became_peered":"2023-10-16T13:40:39.817379+0000","last_unstale":"2023-10-16T13:40:40.809507+0000","last_undegraded":"2023-10-16T13:40:40.809507+0000","last_fullsized":"2023-10-16T13:40:40.809507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:00:37.091073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715889+0000","last_change":"2023-10-16T13:40:39.822984+0000","last_active":"2023-10-16T13:40:41.715889+0000","last_peered":"2023-10-16T13:40:41.715889+0000","last_clean":"2023-10-16T13:40:41.715889+0000","last_became_active":"2023-10-16T13:40:39.822343+0000","last_became_peered":"2023-10-16T13:40:39.822343+0000","last_unstale":"2023-10-16T13:40:41.715889+0000","last_undegraded":"2023-10-16T13:40:41.715889+0000","last_fullsized":"2023-10-16T13:40:41.715889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:41.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811360+0000","last_change":"2023-10-16T13:40:39.827962+0000","last_active":"2023-10-16T13:40:40.811360+0000","last_peered":"2023-10-16T13:40:40.811360+0000","last_clean":"2023-10-16T13:40:40.811360+0000","last_became_active":"2023-10-16T13:40:39.827568+0000","last_became_peered":"2023-10-16T13:40:39.827568+0000","last_unstale":"2023-10-16T13:40:40.811360+0000","last_undegraded":"2023-10-16T13:40:40.811360+0000","last_fullsized":"2023-10-16T13:40:40.811360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715840+0000","last_change":"2023-10-16T13:40:39.820962+0000","last_active":"2023-10-16T13:40:41.715840+0000","last_peered":"2023-10-16T13:40:41.715840+0000","last_clean":"2023-10-16T13:40:41.715840+0000","last_became_active":"2023-10-16T13:40:39.820517+0000","last_became_peered":"2023-10-16T13:40:39.820517+0000","last_unstale":"2023-10-16T13:40:41.715840+0000","last_undegraded":"2023-10-16T13:40:41.715840+0000","last_fullsized":"2023-10-16T13:40:41.715840+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:21:26.719269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716282+0000","last_change":"2023-10-16T13:40:39.817841+0000","last_active":"2023-10-16T13:40:41.716282+0000","last_peered":"2023-10-16T13:40:41.716282+0000","last_clean":"2023-10-16T13:40:41.716282+0000","last_became_active":"2023-10-16T13:40:39.817542+0000","last_became_peered":"2023-10-16T13:40:39.817542+0000","last_unstale":"2023-10-16T13:40:41.716282+0000","last_undegraded":"2023-10-16T13:40:41.716282+0000","last_fullsized":"2023-10-16T13:40:41.716282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:28.616968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336957+0000","last_change":"2023-10-16T13:40:39.828266+0000","last_active":"2023-10-16T13:40:41.336957+0000","last_peered":"2023-10-16T13:40:41.336957+0000","last_clean":"2023-10-16T13:40:41.336957+0000","last_became_active":"2023-10-16T13:40:39.827976+0000","last_became_peered":"2023-10-16T13:40:39.827976+0000","last_unstale":"2023-10-16T13:40:41.336957+0000","last_undegraded":"2023-10-16T13:40:41.336957+0000","last_fullsized":"2023-10-16T13:40:41.336957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716080+0000","last_change":"2023-10-16T13:40:39.819853+0000","last_active":"2023-10-16T13:40:41.716080+0000","last_peered":"2023-10-16T13:40:41.716080+0000","last_clean":"2023-10-16T13:40:41.716080+0000","last_became_active":"2023-10-16T13:40:39.817614+0000","last_became_peered":"2023-10-16T13:40:39.817614+0000","last_unstale":"2023-10-16T13:40:41.716080+0000","last_undegraded":"2023-10-16T13:40:41.716080+0000","last_fullsized":"2023-10-16T13:40:41.716080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:18.669096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336801+0000","last_change":"2023-10-16T13:40:39.815605+0000","last_active":"2023-10-16T13:40:41.336801+0000","last_peered":"2023-10-16T13:40:41.336801+0000","last_clean":"2023-10-16T13:40:41.336801+0000","last_became_active":"2023-10-16T13:40:39.815330+0000","last_became_peered":"2023-10-16T13:40:39.815330+0000","last_unstale":"2023-10-16T13:40:41.336801+0000","last_undegraded":"2023-10-16T13:40:41.336801+0000","last_fullsized":"2023-10-16T13:40:41.336801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810910+0000","last_change":"2023-10-16T13:40:39.827830+0000","last_active":"2023-10-16T13:40:40.810910+0000","last_peered":"2023-10-16T13:40:40.810910+0000","last_clean":"2023-10-16T13:40:40.810910+0000","last_became_active":"2023-10-16T13:40:39.827492+0000","last_became_peered":"2023-10-16T13:40:39.827492+0000","last_unstale":"2023-10-16T13:40:40.810910+0000","last_undegraded":"2023-10-16T13:40:40.810910+0000","last_fullsized":"2023-10-16T13:40:40.810910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:04.992009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716055+0000","last_change":"2023-10-16T13:40:39.822782+0000","last_active":"2023-10-16T13:40:41.716055+0000","last_peered":"2023-10-16T13:40:41.716055+0000","last_clean":"2023-10-16T13:40:41.716055+0000","last_became_active":"2023-10-16T13:40:39.821980+0000","last_became_peered":"2023-10-16T13:40:39.821980+0000","last_unstale":"2023-10-16T13:40:41.716055+0000","last_undegraded":"2023-10-16T13:40:41.716055+0000","last_fullsized":"2023-10-16T13:40:41.716055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:06.909255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716453+0000","last_change":"2023-10-16T13:40:39.822271+0000","last_active":"2023-10-16T13:40:41.716453+0000","last_peered":"2023-10-16T13:40:41.716453+0000","last_clean":"2023-10-16T13:40:41.716453+0000","last_became_active":"2023-10-16T13:40:39.821902+0000","last_became_peered":"2023-10-16T13:40:39.821902+0000","last_unstale":"2023-10-16T13:40:41.716453+0000","last_undegraded":"2023-10-16T13:40:41.716453+0000","last_fullsized":"2023-10-16T13:40:41.716453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:36.878188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809262+0000","last_change":"2023-10-16T13:40:39.819724+0000","last_active":"2023-10-16T13:40:40.809262+0000","last_peered":"2023-10-16T13:40:40.809262+0000","last_clean":"2023-10-16T13:40:40.809262+0000","last_became_active":"2023-10-16T13:40:39.819422+0000","last_became_peered":"2023-10-16T13:40:39.819422+0000","last_unstale":"2023-10-16T13:40:40.809262+0000","last_undegraded":"2023-10-16T13:40:40.809262+0000","last_fullsized":"2023-10-16T13:40:40.809262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:22.575254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336887+0000","last_change":"2023-10-16T13:40:39.816879+0000","last_active":"2023-10-16T13:40:41.336887+0000","last_peered":"2023-10-16T13:40:41.336887+0000","last_clean":"2023-10-16T13:40:41.336887+0000","last_became_active":"2023-10-16T13:40:39.816471+0000","last_became_peered":"2023-10-16T13:40:39.816471+0000","last_unstale":"2023-10-16T13:40:41.336887+0000","last_undegraded":"2023-10-16T13:40:41.336887+0000","last_fullsized":"2023-10-16T13:40:41.336887+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811115+0000","last_change":"2023-10-16T13:40:39.823342+0000","last_active":"2023-10-16T13:40:40.811115+0000","last_peered":"2023-10-16T13:40:40.811115+0000","last_clean":"2023-10-16T13:40:40.811115+0000","last_became_active":"2023-10-16T13:40:39.823070+0000","last_became_peered":"2023-10-16T13:40:39.823070+0000","last_unstale":"2023-10-16T13:40:40.811115+0000","last_undegraded":"2023-10-16T13:40:40.811115+0000","last_fullsized":"2023-10-16T13:40:40.811115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811070+0000","last_change":"2023-10-16T13:40:39.823310+0000","last_active":"2023-10-16T13:40:40.811070+0000","last_peered":"2023-10-16T13:40:40.811070+0000","last_clean":"2023-10-16T13:40:40.811070+0000","last_became_active":"2023-10-16T13:40:39.822911+0000","last_became_peered":"2023-10-16T13:40:39.822911+0000","last_unstale":"2023-10-16T13:40:40.811070+0000","last_undegraded":"2023-10-16T13:40:40.811070+0000","last_fullsized":"2023-10-16T13:40:40.811070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:02.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715522+0000","last_change":"2023-10-16T13:40:39.823496+0000","last_active":"2023-10-16T13:40:41.715522+0000","last_peered":"2023-10-16T13:40:41.715522+0000","last_clean":"2023-10-16T13:40:41.715522+0000","last_became_active":"2023-10-16T13:40:39.823122+0000","last_became_peered":"2023-10-16T13:40:39.823122+0000","last_unstale":"2023-10-16T13:40:41.715522+0000","last_undegraded":"2023-10-16T13:40:41.715522+0000","last_fullsized":"2023-10-16T13:40:41.715522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:03.540302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715444+0000","last_change":"2023-10-16T13:40:39.828343+0000","last_active":"2023-10-16T13:40:41.715444+0000","last_peered":"2023-10-16T13:40:41.715444+0000","last_clean":"2023-10-16T13:40:41.715444+0000","last_became_active":"2023-10-16T13:40:39.828065+0000","last_became_peered":"2023-10-16T13:40:39.828065+0000","last_unstale":"2023-10-16T13:40:41.715444+0000","last_undegraded":"2023-10-16T13:40:41.715444+0000","last_fullsized":"2023-10-16T13:40:41.715444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:53:56.811517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811597+0000","last_change":"2023-10-16T13:40:39.825969+0000","last_active":"2023-10-16T13:40:40.811597+0000","last_peered":"2023-10-16T13:40:40.811597+0000","last_clean":"2023-10-16T13:40:40.811597+0000","last_became_active":"2023-10-16T13:40:39.825675+0000","last_became_peered":"2023-10-16T13:40:39.825675+0000","last_unstale":"2023-10-16T13:40:40.811597+0000","last_undegraded":"2023-10-16T13:40:40.811597+0000","last_fullsized":"2023-10-16T13:40:40.811597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810517+0000","last_change":"2023-10-16T13:40:39.822183+0000","last_active":"2023-10-16T13:40:40.810517+0000","last_peered":"2023-10-16T13:40:40.810517+0000","last_clean":"2023-10-16T13:40:40.810517+0000","last_became_active":"2023-10-16T13:40:39.821886+0000","last_became_peered":"2023-10-16T13:40:39.821886+0000","last_unstale":"2023-10-16T13:40:40.810517+0000","last_undegraded":"2023-10-16T13:40:40.810517+0000","last_fullsized":"2023-10-16T13:40:40.810517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:13:19.191562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215119+0000","last_change":"2023-10-16T13:40:39.825254+0000","last_active":"2023-10-16T13:40:41.215119+0000","last_peered":"2023-10-16T13:40:41.215119+0000","last_clean":"2023-10-16T13:40:41.215119+0000","last_became_active":"2023-10-16T13:40:39.824904+0000","last_became_peered":"2023-10-16T13:40:39.824904+0000","last_unstale":"2023-10-16T13:40:41.215119+0000","last_undegraded":"2023-10-16T13:40:41.215119+0000","last_fullsized":"2023-10-16T13:40:41.215119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:37:09.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811326+0000","last_change":"2023-10-16T13:40:39.821816+0000","last_active":"2023-10-16T13:40:40.811326+0000","last_peered":"2023-10-16T13:40:40.811326+0000","last_clean":"2023-10-16T13:40:40.811326+0000","last_became_active":"2023-10-16T13:40:39.821547+0000","last_became_peered":"2023-10-16T13:40:39.821547+0000","last_unstale":"2023-10-16T13:40:40.811326+0000","last_undegraded":"2023-10-16T13:40:40.811326+0000","last_fullsized":"2023-10-16T13:40:40.811326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214929+0000","last_change":"2023-10-16T13:40:39.823762+0000","last_active":"2023-10-16T13:40:41.214929+0000","last_peered":"2023-10-16T13:40:41.214929+0000","last_clean":"2023-10-16T13:40:41.214929+0000","last_became_active":"2023-10-16T13:40:39.823215+0000","last_became_peered":"2023-10-16T13:40:39.823215+0000","last_unstale":"2023-10-16T13:40:41.214929+0000","last_undegraded":"2023-10-16T13:40:41.214929+0000","last_fullsized":"2023-10-16T13:40:41.214929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:24.798572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810097+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810097+0000","last_peered":"2023-10-16T13:40:40.810097+0000","last_clean":"2023-10-16T13:40:40.810097+0000","last_became_active":"2023-10-16T13:40:39.820879+0000","last_became_peered":"2023-10-16T13:40:39.820879+0000","last_unstale":"2023-10-16T13:40:40.810097+0000","last_undegraded":"2023-10-16T13:40:40.810097+0000","last_fullsized":"2023-10-16T13:40:40.810097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810169+0000","last_change":"2023-10-16T13:40:39.816419+0000","last_active":"2023-10-16T13:40:40.810169+0000","last_peered":"2023-10-16T13:40:40.810169+0000","last_clean":"2023-10-16T13:40:40.810169+0000","last_became_active":"2023-10-16T13:40:39.816092+0000","last_became_peered":"2023-10-16T13:40:39.816092+0000","last_unstale":"2023-10-16T13:40:40.810169+0000","last_undegraded":"2023-10-16T13:40:40.810169+0000","last_fullsized":"2023-10-16T13:40:40.810169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808812+0000","last_change":"2023-10-16T13:40:39.820724+0000","last_active":"2023-10-16T13:40:40.808812+0000","last_peered":"2023-10-16T13:40:40.808812+0000","last_clean":"2023-10-16T13:40:40.808812+0000","last_became_active":"2023-10-16T13:40:39.820464+0000","last_became_peered":"2023-10-16T13:40:39.820464+0000","last_unstale":"2023-10-16T13:40:40.808812+0000","last_undegraded":"2023-10-16T13:40:40.808812+0000","last_fullsized":"2023-10-16T13:40:40.808812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:59.734877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715936+0000","last_change":"2023-10-16T13:40:39.825976+0000","last_active":"2023-10-16T13:40:41.715936+0000","last_peered":"2023-10-16T13:40:41.715936+0000","last_clean":"2023-10-16T13:40:41.715936+0000","last_became_active":"2023-10-16T13:40:39.825699+0000","last_became_peered":"2023-10-16T13:40:39.825699+0000","last_unstale":"2023-10-16T13:40:41.715936+0000","last_undegraded":"2023-10-16T13:40:41.715936+0000","last_fullsized":"2023-10-16T13:40:41.715936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:32.095873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843040+0000","last_change":"2023-10-16T13:40:38.820699+0000","last_active":"2023-10-16T13:40:39.843040+0000","last_peered":"2023-10-16T13:40:39.843040+0000","last_clean":"2023-10-16T13:40:39.843040+0000","last_became_active":"2023-10-16T13:40:38.820285+0000","last_became_peered":"2023-10-16T13:40:38.820285+0000","last_unstale":"2023-10-16T13:40:39.843040+0000","last_undegraded":"2023-10-16T13:40:39.843040+0000","last_fullsized":"2023-10-16T13:40:39.843040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:04.057774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716115+0000","last_change":"2023-10-16T13:40:39.822604+0000","last_active":"2023-10-16T13:40:41.716115+0000","last_peered":"2023-10-16T13:40:41.716115+0000","last_clean":"2023-10-16T13:40:41.716115+0000","last_became_active":"2023-10-16T13:40:39.821385+0000","last_became_peered":"2023-10-16T13:40:39.821385+0000","last_unstale":"2023-10-16T13:40:41.716115+0000","last_undegraded":"2023-10-16T13:40:41.716115+0000","last_fullsized":"2023-10-16T13:40:41.716115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:41.889159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840696+0000","last_change":"2023-10-16T13:40:38.817456+0000","last_active":"2023-10-16T13:40:39.840696+0000","last_peered":"2023-10-16T13:40:39.840696+0000","last_clean":"2023-10-16T13:40:39.840696+0000","last_became_active":"2023-10-16T13:40:38.817152+0000","last_became_peered":"2023-10-16T13:40:38.817152+0000","last_unstale":"2023-10-16T13:40:39.840696+0000","last_undegraded":"2023-10-16T13:40:39.840696+0000","last_fullsized":"2023-10-16T13:40:39.840696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:03.987205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809425+0000","last_change":"2023-10-16T13:40:39.827023+0000","last_active":"2023-10-16T13:40:40.809425+0000","last_peered":"2023-10-16T13:40:40.809425+0000","last_clean":"2023-10-16T13:40:40.809425+0000","last_became_active":"2023-10-16T13:40:39.825744+0000","last_became_peered":"2023-10-16T13:40:39.825744+0000","last_unstale":"2023-10-16T13:40:40.809425+0000","last_undegraded":"2023-10-16T13:40:40.809425+0000","last_fullsized":"2023-10-16T13:40:40.809425+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:25.807534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840503+0000","last_change":"2023-10-16T13:40:38.821926+0000","last_active":"2023-10-16T13:40:39.840503+0000","last_peered":"2023-10-16T13:40:39.840503+0000","last_clean":"2023-10-16T13:40:39.840503+0000","last_became_active":"2023-10-16T13:40:38.821575+0000","last_became_peered":"2023-10-16T13:40:38.821575+0000","last_unstale":"2023-10-16T13:40:39.840503+0000","last_undegraded":"2023-10-16T13:40:39.840503+0000","last_fullsized":"2023-10-16T13:40:39.840503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:33.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715977+0000","last_change":"2023-10-16T13:40:39.824618+0000","last_active":"2023-10-16T13:40:41.715977+0000","last_peered":"2023-10-16T13:40:41.715977+0000","last_clean":"2023-10-16T13:40:41.715977+0000","last_became_active":"2023-10-16T13:40:39.824029+0000","last_became_peered":"2023-10-16T13:40:39.824029+0000","last_unstale":"2023-10-16T13:40:41.715977+0000","last_undegraded":"2023-10-16T13:40:41.715977+0000","last_fullsized":"2023-10-16T13:40:41.715977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.263123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840162+0000","last_change":"2023-10-16T13:40:38.820937+0000","last_active":"2023-10-16T13:40:39.840162+0000","last_peered":"2023-10-16T13:40:39.840162+0000","last_clean":"2023-10-16T13:40:39.840162+0000","last_became_active":"2023-10-16T13:40:38.820601+0000","last_became_peered":"2023-10-16T13:40:38.820601+0000","last_unstale":"2023-10-16T13:40:39.840162+0000","last_undegraded":"2023-10-16T13:40:39.840162+0000","last_fullsized":"2023-10-16T13:40:39.840162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:05.904450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810245+0000","last_change":"2023-10-16T13:40:39.819143+0000","last_active":"2023-10-16T13:40:40.810245+0000","last_peered":"2023-10-16T13:40:40.810245+0000","last_clean":"2023-10-16T13:40:40.810245+0000","last_became_active":"2023-10-16T13:40:39.818866+0000","last_became_peered":"2023-10-16T13:40:39.818866+0000","last_unstale":"2023-10-16T13:40:40.810245+0000","last_undegraded":"2023-10-16T13:40:40.810245+0000","last_fullsized":"2023-10-16T13:40:40.810245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.845415+0000","last_change":"2023-10-16T13:40:38.815449+0000","last_active":"2023-10-16T13:40:39.845415+0000","last_peered":"2023-10-16T13:40:39.845415+0000","last_clean":"2023-10-16T13:40:39.845415+0000","last_became_active":"2023-10-16T13:40:38.815189+0000","last_became_peered":"2023-10-16T13:40:38.815189+0000","last_unstale":"2023-10-16T13:40:39.845415+0000","last_undegraded":"2023-10-16T13:40:39.845415+0000","last_fullsized":"2023-10-16T13:40:39.845415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:24.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811121+0000","last_change":"2023-10-16T13:40:39.826787+0000","last_active":"2023-10-16T13:40:40.811121+0000","last_peered":"2023-10-16T13:40:40.811121+0000","last_clean":"2023-10-16T13:40:40.811121+0000","last_became_active":"2023-10-16T13:40:39.826506+0000","last_became_peered":"2023-10-16T13:40:39.826506+0000","last_unstale":"2023-10-16T13:40:40.811121+0000","last_undegraded":"2023-10-16T13:40:40.811121+0000","last_fullsized":"2023-10-16T13:40:40.811121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.839986+0000","last_change":"2023-10-16T13:40:38.821853+0000","last_active":"2023-10-16T13:40:39.839986+0000","last_peered":"2023-10-16T13:40:39.839986+0000","last_clean":"2023-10-16T13:40:39.839986+0000","last_became_active":"2023-10-16T13:40:38.821494+0000","last_became_peered":"2023-10-16T13:40:38.821494+0000","last_unstale":"2023-10-16T13:40:39.839986+0000","last_undegraded":"2023-10-16T13:40:39.839986+0000","last_fullsized":"2023-10-16T13:40:39.839986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:11.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715181+0000","last_change":"2023-10-16T13:40:39.827080+0000","last_active":"2023-10-16T13:40:41.715181+0000","last_peered":"2023-10-16T13:40:41.715181+0000","last_clean":"2023-10-16T13:40:41.715181+0000","last_became_active":"2023-10-16T13:40:39.826753+0000","last_became_peered":"2023-10-16T13:40:39.826753+0000","last_unstale":"2023-10-16T13:40:41.715181+0000","last_undegraded":"2023-10-16T13:40:41.715181+0000","last_fullsized":"2023-10-16T13:40:41.715181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:19.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809900+0000","last_change":"2023-10-16T13:40:38.820205+0000","last_active":"2023-10-16T13:40:39.809900+0000","last_peered":"2023-10-16T13:40:39.809900+0000","last_clean":"2023-10-16T13:40:39.809900+0000","last_became_active":"2023-10-16T13:40:38.819870+0000","last_became_peered":"2023-10-16T13:40:38.819870+0000","last_unstale":"2023-10-16T13:40:39.809900+0000","last_undegraded":"2023-10-16T13:40:39.809900+0000","last_fullsized":"2023-10-16T13:40:39.809900+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:54.803860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336849+0000","last_change":"2023-10-16T13:40:39.822849+0000","last_active":"2023-10-16T13:40:41.336849+0000","last_peered":"2023-10-16T13:40:41.336849+0000","last_clean":"2023-10-16T13:40:41.336849+0000","last_became_active":"2023-10-16T13:40:39.822537+0000","last_became_peered":"2023-10-16T13:40:39.822537+0000","last_unstale":"2023-10-16T13:40:41.336849+0000","last_undegraded":"2023-10-16T13:40:41.336849+0000","last_fullsized":"2023-10-16T13:40:41.336849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805349+0000","last_change":"2023-10-16T13:40:38.819977+0000","last_active":"2023-10-16T13:40:39.805349+0000","last_peered":"2023-10-16T13:40:39.805349+0000","last_clean":"2023-10-16T13:40:39.805349+0000","last_became_active":"2023-10-16T13:40:38.819676+0000","last_became_peered":"2023-10-16T13:40:38.819676+0000","last_unstale":"2023-10-16T13:40:39.805349+0000","last_undegraded":"2023-10-16T13:40:39.805349+0000","last_fullsized":"2023-10-16T13:40:39.805349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:53.008354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810642+0000","last_change":"2023-10-16T13:40:39.824725+0000","last_active":"2023-10-16T13:40:40.810642+0000","last_peered":"2023-10-16T13:40:40.810642+0000","last_clean":"2023-10-16T13:40:40.810642+0000","last_became_active":"2023-10-16T13:40:39.824452+0000","last_became_peered":"2023-10-16T13:40:39.824452+0000","last_unstale":"2023-10-16T13:40:40.810642+0000","last_undegraded":"2023-10-16T13:40:40.810642+0000","last_fullsized":"2023-10-16T13:40:40.810642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:27.067030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.814180+0000","last_change":"2023-10-16T13:40:38.815657+0000","last_active":"2023-10-16T13:40:39.814180+0000","last_peered":"2023-10-16T13:40:39.814180+0000","last_clean":"2023-10-16T13:40:39.814180+0000","last_became_active":"2023-10-16T13:40:38.815356+0000","last_became_peered":"2023-10-16T13:40:38.815356+0000","last_unstale":"2023-10-16T13:40:39.814180+0000","last_undegraded":"2023-10-16T13:40:39.814180+0000","last_fullsized":"2023-10-16T13:40:39.814180+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:00.969615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716040+0000","last_change":"2023-10-16T13:40:39.824506+0000","last_active":"2023-10-16T13:40:41.716040+0000","last_peered":"2023-10-16T13:40:41.716040+0000","last_clean":"2023-10-16T13:40:41.716040+0000","last_became_active":"2023-10-16T13:40:39.824228+0000","last_became_peered":"2023-10-16T13:40:39.824228+0000","last_unstale":"2023-10-16T13:40:41.716040+0000","last_undegraded":"2023-10-16T13:40:41.716040+0000","last_fullsized":"2023-10-16T13:40:41.716040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:46.581551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812283+0000","last_change":"2023-10-16T13:40:38.818983+0000","last_active":"2023-10-16T13:40:39.812283+0000","last_peered":"2023-10-16T13:40:39.812283+0000","last_clean":"2023-10-16T13:40:39.812283+0000","last_became_active":"2023-10-16T13:40:38.818660+0000","last_became_peered":"2023-10-16T13:40:38.818660+0000","last_unstale":"2023-10-16T13:40:39.812283+0000","last_undegraded":"2023-10-16T13:40:39.812283+0000","last_fullsized":"2023-10-16T13:40:39.812283+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:06.070222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809240+0000","last_change":"2023-10-16T13:40:39.824564+0000","last_active":"2023-10-16T13:40:40.809240+0000","last_peered":"2023-10-16T13:40:40.809240+0000","last_clean":"2023-10-16T13:40:40.809240+0000","last_became_active":"2023-10-16T13:40:39.824255+0000","last_became_peered":"2023-10-16T13:40:39.824255+0000","last_unstale":"2023-10-16T13:40:40.809240+0000","last_undegraded":"2023-10-16T13:40:40.809240+0000","last_fullsized":"2023-10-16T13:40:40.809240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:47.276160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842913+0000","last_change":"2023-10-16T13:40:38.817847+0000","last_active":"2023-10-16T13:40:39.842913+0000","last_peered":"2023-10-16T13:40:39.842913+0000","last_clean":"2023-10-16T13:40:39.842913+0000","last_became_active":"2023-10-16T13:40:38.817561+0000","last_became_peered":"2023-10-16T13:40:38.817561+0000","last_unstale":"2023-10-16T13:40:39.842913+0000","last_undegraded":"2023-10-16T13:40:39.842913+0000","last_fullsized":"2023-10-16T13:40:39.842913+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:45.576746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715899+0000","last_change":"2023-10-16T13:40:39.817345+0000","last_active":"2023-10-16T13:40:41.715899+0000","last_peered":"2023-10-16T13:40:41.715899+0000","last_clean":"2023-10-16T13:40:41.715899+0000","last_became_active":"2023-10-16T13:40:39.817042+0000","last_became_peered":"2023-10-16T13:40:39.817042+0000","last_unstale":"2023-10-16T13:40:41.715899+0000","last_undegraded":"2023-10-16T13:40:41.715899+0000","last_fullsized":"2023-10-16T13:40:41.715899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:47.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.847149+0000","last_change":"2023-10-16T13:40:38.816845+0000","last_active":"2023-10-16T13:40:39.847149+0000","last_peered":"2023-10-16T13:40:39.847149+0000","last_clean":"2023-10-16T13:40:39.847149+0000","last_became_active":"2023-10-16T13:40:38.816563+0000","last_became_peered":"2023-10-16T13:40:38.816563+0000","last_unstale":"2023-10-16T13:40:39.847149+0000","last_undegraded":"2023-10-16T13:40:39.847149+0000","last_fullsized":"2023-10-16T13:40:39.847149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:52.412223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715541+0000","last_change":"2023-10-16T13:40:39.821790+0000","last_active":"2023-10-16T13:40:41.715541+0000","last_peered":"2023-10-16T13:40:41.715541+0000","last_clean":"2023-10-16T13:40:41.715541+0000","last_became_active":"2023-10-16T13:40:39.821440+0000","last_became_peered":"2023-10-16T13:40:39.821440+0000","last_unstale":"2023-10-16T13:40:41.715541+0000","last_undegraded":"2023-10-16T13:40:41.715541+0000","last_fullsized":"2023-10-16T13:40:41.715541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:17.474278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843212+0000","last_change":"2023-10-16T13:40:38.818745+0000","last_active":"2023-10-16T13:40:39.843212+0000","last_peered":"2023-10-16T13:40:39.843212+0000","last_clean":"2023-10-16T13:40:39.843212+0000","last_became_active":"2023-10-16T13:40:38.818380+0000","last_became_peered":"2023-10-16T13:40:38.818380+0000","last_unstale":"2023-10-16T13:40:39.843212+0000","last_undegraded":"2023-10-16T13:40:39.843212+0000","last_fullsized":"2023-10-16T13:40:39.843212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810402+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810402+0000","last_peered":"2023-10-16T13:40:40.810402+0000","last_clean":"2023-10-16T13:40:40.810402+0000","last_became_active":"2023-10-16T13:40:39.820851+0000","last_became_peered":"2023-10-16T13:40:39.820851+0000","last_unstale":"2023-10-16T13:40:40.810402+0000","last_undegraded":"2023-10-16T13:40:40.810402+0000","last_fullsized":"2023-10-16T13:40:40.810402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812337+0000","last_change":"2023-10-16T13:40:38.821394+0000","last_active":"2023-10-16T13:40:39.812337+0000","last_peered":"2023-10-16T13:40:39.812337+0000","last_clean":"2023-10-16T13:40:39.812337+0000","last_became_active":"2023-10-16T13:40:38.821071+0000","last_became_peered":"2023-10-16T13:40:38.821071+0000","last_unstale":"2023-10-16T13:40:39.812337+0000","last_undegraded":"2023-10-16T13:40:39.812337+0000","last_fullsized":"2023-10-16T13:40:39.812337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:57:29.111116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336749+0000","last_change":"2023-10-16T13:40:39.828347+0000","last_active":"2023-10-16T13:40:41.336749+0000","last_peered":"2023-10-16T13:40:41.336749+0000","last_clean":"2023-10-16T13:40:41.336749+0000","last_became_active":"2023-10-16T13:40:39.828013+0000","last_became_peered":"2023-10-16T13:40:39.828013+0000","last_unstale":"2023-10-16T13:40:41.336749+0000","last_undegraded":"2023-10-16T13:40:41.336749+0000","last_fullsized":"2023-10-16T13:40:41.336749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809248+0000","last_change":"2023-10-16T13:40:38.815484+0000","last_active":"2023-10-16T13:40:39.809248+0000","last_peered":"2023-10-16T13:40:39.809248+0000","last_clean":"2023-10-16T13:40:39.809248+0000","last_became_active":"2023-10-16T13:40:38.815154+0000","last_became_peered":"2023-10-16T13:40:38.815154+0000","last_unstale":"2023-10-16T13:40:39.809248+0000","last_undegraded":"2023-10-16T13:40:39.809248+0000","last_fullsized":"2023-10-16T13:40:39.809248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:55.109057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715501+0000","last_change":"2023-10-16T13:40:39.821845+0000","last_active":"2023-10-16T13:40:41.715501+0000","last_peered":"2023-10-16T13:40:41.715501+0000","last_clean":"2023-10-16T13:40:41.715501+0000","last_became_active":"2023-10-16T13:40:39.821282+0000","last_became_peered":"2023-10-16T13:40:39.821282+0000","last_unstale":"2023-10-16T13:40:41.715501+0000","last_undegraded":"2023-10-16T13:40:41.715501+0000","last_fullsized":"2023-10-16T13:40:41.715501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:16.745728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843953+0000","last_change":"2023-10-16T13:40:38.818696+0000","last_active":"2023-10-16T13:40:39.843953+0000","last_peered":"2023-10-16T13:40:39.843953+0000","last_clean":"2023-10-16T13:40:39.843953+0000","last_became_active":"2023-10-16T13:40:38.818334+0000","last_became_peered":"2023-10-16T13:40:38.818334+0000","last_unstale":"2023-10-16T13:40:39.843953+0000","last_undegraded":"2023-10-16T13:40:39.843953+0000","last_fullsized":"2023-10-16T13:40:39.843953+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:46:36.165362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811445+0000","last_change":"2023-10-16T13:40:39.824636+0000","last_active":"2023-10-16T13:40:40.811445+0000","last_peered":"2023-10-16T13:40:40.811445+0000","last_clean":"2023-10-16T13:40:40.811445+0000","last_became_active":"2023-10-16T13:40:39.824349+0000","last_became_peered":"2023-10-16T13:40:39.824349+0000","last_unstale":"2023-10-16T13:40:40.811445+0000","last_undegraded":"2023-10-16T13:40:40.811445+0000","last_fullsized":"2023-10-16T13:40:40.811445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842725+0000","last_change":"2023-10-16T13:40:38.827807+0000","last_active":"2023-10-16T13:40:39.842725+0000","last_peered":"2023-10-16T13:40:39.842725+0000","last_clean":"2023-10-16T13:40:39.842725+0000","last_became_active":"2023-10-16T13:40:38.827562+0000","last_became_peered":"2023-10-16T13:40:38.827562+0000","last_unstale":"2023-10-16T13:40:39.842725+0000","last_undegraded":"2023-10-16T13:40:39.842725+0000","last_fullsized":"2023-10-16T13:40:39.842725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:17.664292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716090+0000","last_change":"2023-10-16T13:40:39.825085+0000","last_active":"2023-10-16T13:40:41.716090+0000","last_peered":"2023-10-16T13:40:41.716090+0000","last_clean":"2023-10-16T13:40:41.716090+0000","last_became_active":"2023-10-16T13:40:39.824627+0000","last_became_peered":"2023-10-16T13:40:39.824627+0000","last_unstale":"2023-10-16T13:40:41.716090+0000","last_undegraded":"2023-10-16T13:40:41.716090+0000","last_fullsized":"2023-10-16T13:40:41.716090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:26.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840339+0000","last_change":"2023-10-16T13:40:38.822365+0000","last_active":"2023-10-16T13:40:39.840339+0000","last_peered":"2023-10-16T13:40:39.840339+0000","last_clean":"2023-10-16T13:40:39.840339+0000","last_became_active":"2023-10-16T13:40:38.822053+0000","last_became_peered":"2023-10-16T13:40:38.822053+0000","last_unstale":"2023-10-16T13:40:39.840339+0000","last_undegraded":"2023-10-16T13:40:39.840339+0000","last_fullsized":"2023-10-16T13:40:39.840339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:35.873383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716385+0000","last_change":"2023-10-16T13:40:39.817797+0000","last_active":"2023-10-16T13:40:41.716385+0000","last_peered":"2023-10-16T13:40:41.716385+0000","last_clean":"2023-10-16T13:40:41.716385+0000","last_became_active":"2023-10-16T13:40:39.817154+0000","last_became_peered":"2023-10-16T13:40:39.817154+0000","last_unstale":"2023-10-16T13:40:41.716385+0000","last_undegraded":"2023-10-16T13:40:41.716385+0000","last_fullsized":"2023-10-16T13:40:41.716385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:56.113861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843250+0000","last_change":"2023-10-16T13:40:38.821194+0000","last_active":"2023-10-16T13:40:39.843250+0000","last_peered":"2023-10-16T13:40:39.843250+0000","last_clean":"2023-10-16T13:40:39.843250+0000","last_became_active":"2023-10-16T13:40:38.820062+0000","last_became_peered":"2023-10-16T13:40:38.820062+0000","last_unstale":"2023-10-16T13:40:39.843250+0000","last_undegraded":"2023-10-16T13:40:39.843250+0000","last_fullsized":"2023-10-16T13:40:39.843250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:32.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715891+0000","last_change":"2023-10-16T13:40:39.826550+0000","last_active":"2023-10-16T13:40:41.715891+0000","last_peered":"2023-10-16T13:40:41.715891+0000","last_clean":"2023-10-16T13:40:41.715891+0000","last_became_active":"2023-10-16T13:40:39.826243+0000","last_became_peered":"2023-10-16T13:40:39.826243+0000","last_unstale":"2023-10-16T13:40:41.715891+0000","last_undegraded":"2023-10-16T13:40:41.715891+0000","last_fullsized":"2023-10-16T13:40:41.715891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:41.376812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.813507+0000","last_change":"2023-10-16T13:40:38.820616+0000","last_active":"2023-10-16T13:40:39.813507+0000","last_peered":"2023-10-16T13:40:39.813507+0000","last_clean":"2023-10-16T13:40:39.813507+0000","last_became_active":"2023-10-16T13:40:38.820060+0000","last_became_peered":"2023-10-16T13:40:38.820060+0000","last_unstale":"2023-10-16T13:40:39.813507+0000","last_undegraded":"2023-10-16T13:40:39.813507+0000","last_fullsized":"2023-10-16T13:40:39.813507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:26.062225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214983+0000","last_change":"2023-10-16T13:40:39.820400+0000","last_active":"2023-10-16T13:40:41.214983+0000","last_peered":"2023-10-16T13:40:41.214983+0000","last_clean":"2023-10-16T13:40:41.214983+0000","last_became_active":"2023-10-16T13:40:39.820107+0000","last_became_peered":"2023-10-16T13:40:39.820107+0000","last_unstale":"2023-10-16T13:40:41.214983+0000","last_undegraded":"2023-10-16T13:40:41.214983+0000","last_fullsized":"2023-10-16T13:40:41.214983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:30.379729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812497+0000","last_change":"2023-10-16T13:40:38.819491+0000","last_active":"2023-10-16T13:40:39.812497+0000","last_peered":"2023-10-16T13:40:39.812497+0000","last_clean":"2023-10-16T13:40:39.812497+0000","last_became_active":"2023-10-16T13:40:38.819167+0000","last_became_peered":"2023-10-16T13:40:38.819167+0000","last_unstale":"2023-10-16T13:40:39.812497+0000","last_undegraded":"2023-10-16T13:40:39.812497+0000","last_fullsized":"2023-10-16T13:40:39.812497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:24.574150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215007+0000","last_change":"2023-10-16T13:40:39.822722+0000","last_active":"2023-10-16T13:40:41.215007+0000","last_peered":"2023-10-16T13:40:41.215007+0000","last_clean":"2023-10-16T13:40:41.215007+0000","last_became_active":"2023-10-16T13:40:39.821553+0000","last_became_peered":"2023-10-16T13:40:39.821553+0000","last_unstale":"2023-10-16T13:40:41.215007+0000","last_undegraded":"2023-10-16T13:40:41.215007+0000","last_fullsized":"2023-10-16T13:40:41.215007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:03.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809399+0000","last_change":"2023-10-16T13:40:38.816423+0000","last_active":"2023-10-16T13:40:39.809399+0000","last_peered":"2023-10-16T13:40:39.809399+0000","last_clean":"2023-10-16T13:40:39.809399+0000","last_became_active":"2023-10-16T13:40:38.815912+0000","last_became_peered":"2023-10-16T13:40:38.815912+0000","last_unstale":"2023-10-16T13:40:39.809399+0000","last_undegraded":"2023-10-16T13:40:39.809399+0000","last_fullsized":"2023-10-16T13:40:39.809399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:27.612163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214957+0000","last_change":"2023-10-16T13:40:39.824262+0000","last_active":"2023-10-16T13:40:41.214957+0000","last_peered":"2023-10-16T13:40:41.214957+0000","last_clean":"2023-10-16T13:40:41.214957+0000","last_became_active":"2023-10-16T13:40:39.823930+0000","last_became_peered":"2023-10-16T13:40:39.823930+0000","last_unstale":"2023-10-16T13:40:41.214957+0000","last_undegraded":"2023-10-16T13:40:41.214957+0000","last_fullsized":"2023-10-16T13:40:41.214957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:51.876599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811990+0000","last_change":"2023-10-16T13:40:38.817029+0000","last_active":"2023-10-16T13:40:39.811990+0000","last_peered":"2023-10-16T13:40:39.811990+0000","last_clean":"2023-10-16T13:40:39.811990+0000","last_became_active":"2023-10-16T13:40:38.816709+0000","last_became_peered":"2023-10-16T13:40:38.816709+0000","last_unstale":"2023-10-16T13:40:39.811990+0000","last_undegraded":"2023-10-16T13:40:39.811990+0000","last_fullsized":"2023-10-16T13:40:39.811990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:35.873383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.337018+0000","last_change":"2023-10-16T13:40:39.816164+0000","last_active":"2023-10-16T13:40:41.337018+0000","last_peered":"2023-10-16T13:40:41.337018+0000","last_clean":"2023-10-16T13:40:41.337018+0000","last_became_active":"2023-10-16T13:40:39.815367+0000","last_became_peered":"2023-10-16T13:40:39.815367+0000","last_unstale":"2023-10-16T13:40:41.337018+0000","last_undegraded":"2023-10-16T13:40:41.337018+0000","last_fullsized":"2023-10-16T13:40:41.337018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.841270+0000","last_change":"2023-10-16T13:40:38.827775+0000","last_active":"2023-10-16T13:40:39.841270+0000","last_peered":"2023-10-16T13:40:39.841270+0000","last_clean":"2023-10-16T13:40:39.841270+0000","last_became_active":"2023-10-16T13:40:38.827564+0000","last_became_peered":"2023-10-16T13:40:38.827564+0000","last_unstale":"2023-10-16T13:40:39.841270+0000","last_undegraded":"2023-10-16T13:40:39.841270+0000","last_fullsized":"2023-10-16T13:40:39.841270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:54.568956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810404+0000","last_change":"2023-10-16T13:40:39.816893+0000","last_active":"2023-10-16T13:40:40.810404+0000","last_peered":"2023-10-16T13:40:40.810404+0000","last_clean":"2023-10-16T13:40:40.810404+0000","last_became_active":"2023-10-16T13:40:39.816559+0000","last_became_peered":"2023-10-16T13:40:39.816559+0000","last_unstale":"2023-10-16T13:40:40.810404+0000","last_undegraded":"2023-10-16T13:40:40.810404+0000","last_fullsized":"2023-10-16T13:40:40.810404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811471+0000","last_change":"2023-10-16T13:40:38.815314+0000","last_active":"2023-10-16T13:40:39.811471+0000","last_peered":"2023-10-16T13:40:39.811471+0000","last_clean":"2023-10-16T13:40:39.811471+0000","last_became_active":"2023-10-16T13:40:38.814850+0000","last_became_peered":"2023-10-16T13:40:38.814850+0000","last_unstale":"2023-10-16T13:40:39.811471+0000","last_undegraded":"2023-10-16T13:40:39.811471+0000","last_fullsized":"2023-10-16T13:40:39.811471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:01.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715757+0000","last_change":"2023-10-16T13:40:39.828351+0000","last_active":"2023-10-16T13:40:41.715757+0000","last_peered":"2023-10-16T13:40:41.715757+0000","last_clean":"2023-10-16T13:40:41.715757+0000","last_became_active":"2023-10-16T13:40:39.828110+0000","last_became_peered":"2023-10-16T13:40:39.828110+0000","last_unstale":"2023-10-16T13:40:41.715757+0000","last_undegraded":"2023-10-16T13:40:41.715757+0000","last_fullsized":"2023-10-16T13:40:41.715757+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:49.894970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.806258+0000","last_change":"2023-10-16T13:40:38.815831+0000","last_active":"2023-10-16T13:40:39.806258+0000","last_peered":"2023-10-16T13:40:39.806258+0000","last_clean":"2023-10-16T13:40:39.806258+0000","last_became_active":"2023-10-16T13:40:38.815540+0000","last_became_peered":"2023-10-16T13:40:38.815540+0000","last_unstale":"2023-10-16T13:40:39.806258+0000","last_undegraded":"2023-10-16T13:40:39.806258+0000","last_fullsized":"2023-10-16T13:40:39.806258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:29:02.491892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716013+0000","last_change":"2023-10-16T13:40:39.824811+0000","last_active":"2023-10-16T13:40:41.716013+0000","last_peered":"2023-10-16T13:40:41.716013+0000","last_clean":"2023-10-16T13:40:41.716013+0000","last_became_active":"2023-10-16T13:40:39.824331+0000","last_became_peered":"2023-10-16T13:40:39.824331+0000","last_unstale":"2023-10-16T13:40:41.716013+0000","last_undegraded":"2023-10-16T13:40:41.716013+0000","last_fullsized":"2023-10-16T13:40:41.716013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:27.597269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812435+0000","last_change":"2023-10-16T13:40:38.813968+0000","last_active":"2023-10-16T13:40:39.812435+0000","last_peered":"2023-10-16T13:40:39.812435+0000","last_clean":"2023-10-16T13:40:39.812435+0000","last_became_active":"2023-10-16T13:40:38.813655+0000","last_became_peered":"2023-10-16T13:40:38.813655+0000","last_unstale":"2023-10-16T13:40:39.812435+0000","last_undegraded":"2023-10-16T13:40:39.812435+0000","last_fullsized":"2023-10-16T13:40:39.812435+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:46:36.165362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716126+0000","last_change":"2023-10-16T13:40:39.821518+0000","last_active":"2023-10-16T13:40:41.716126+0000","last_peered":"2023-10-16T13:40:41.716126+0000","last_clean":"2023-10-16T13:40:41.716126+0000","last_became_active":"2023-10-16T13:40:39.821128+0000","last_became_peered":"2023-10-16T13:40:39.821128+0000","last_unstale":"2023-10-16T13:40:41.716126+0000","last_undegraded":"2023-10-16T13:40:41.716126+0000","last_fullsized":"2023-10-16T13:40:41.716126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:33.784224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805532+0000","last_change":"2023-10-16T13:40:38.819885+0000","last_active":"2023-10-16T13:40:39.805532+0000","last_peered":"2023-10-16T13:40:39.805532+0000","last_clean":"2023-10-16T13:40:39.805532+0000","last_became_active":"2023-10-16T13:40:38.819622+0000","last_became_peered":"2023-10-16T13:40:38.819622+0000","last_unstale":"2023-10-16T13:40:39.805532+0000","last_undegraded":"2023-10-16T13:40:39.805532+0000","last_fullsized":"2023-10-16T13:40:39.805532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:17:33.819262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808911+0000","last_change":"2023-10-16T13:40:39.825984+0000","last_active":"2023-10-16T13:40:40.808911+0000","last_peered":"2023-10-16T13:40:40.808911+0000","last_clean":"2023-10-16T13:40:40.808911+0000","last_became_active":"2023-10-16T13:40:39.825650+0000","last_became_peered":"2023-10-16T13:40:39.825650+0000","last_unstale":"2023-10-16T13:40:40.808911+0000","last_undegraded":"2023-10-16T13:40:40.808911+0000","last_fullsized":"2023-10-16T13:40:40.808911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:36:34.339968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810108+0000","last_change":"2023-10-16T13:40:38.820149+0000","last_active":"2023-10-16T13:40:39.810108+0000","last_peered":"2023-10-16T13:40:39.810108+0000","last_clean":"2023-10-16T13:40:39.810108+0000","last_became_active":"2023-10-16T13:40:38.819853+0000","last_became_peered":"2023-10-16T13:40:38.819853+0000","last_unstale":"2023-10-16T13:40:39.810108+0000","last_undegraded":"2023-10-16T13:40:39.810108+0000","last_fullsized":"2023-10-16T13:40:39.810108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:30.874102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715368+0000","last_change":"2023-10-16T13:40:39.818863+0000","last_active":"2023-10-16T13:40:41.715368+0000","last_peered":"2023-10-16T13:40:41.715368+0000","last_clean":"2023-10-16T13:40:41.715368+0000","last_became_active":"2023-10-16T13:40:39.818500+0000","last_became_peered":"2023-10-16T13:40:39.818500+0000","last_unstale":"2023-10-16T13:40:41.715368+0000","last_undegraded":"2023-10-16T13:40:41.715368+0000","last_fullsized":"2023-10-16T13:40:41.715368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:48.678490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.813723+0000","last_change":"2023-10-16T13:40:38.821873+0000","last_active":"2023-10-16T13:40:39.813723+0000","last_peered":"2023-10-16T13:40:39.813723+0000","last_clean":"2023-10-16T13:40:39.813723+0000","last_became_active":"2023-10-16T13:40:38.821298+0000","last_became_peered":"2023-10-16T13:40:38.821298+0000","last_unstale":"2023-10-16T13:40:39.813723+0000","last_undegraded":"2023-10-16T13:40:39.813723+0000","last_fullsized":"2023-10-16T13:40:39.813723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809466+0000","last_change":"2023-10-16T13:40:39.820186+0000","last_active":"2023-10-16T13:40:40.809466+0000","last_peered":"2023-10-16T13:40:40.809466+0000","last_clean":"2023-10-16T13:40:40.809466+0000","last_became_active":"2023-10-16T13:40:39.819347+0000","last_became_peered":"2023-10-16T13:40:39.819347+0000","last_unstale":"2023-10-16T13:40:40.809466+0000","last_undegraded":"2023-10-16T13:40:40.809466+0000","last_fullsized":"2023-10-16T13:40:40.809466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:04.033107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810851+0000","last_change":"2023-10-16T13:40:38.821117+0000","last_active":"2023-10-16T13:40:39.810851+0000","last_peered":"2023-10-16T13:40:39.810851+0000","last_clean":"2023-10-16T13:40:39.810851+0000","last_became_active":"2023-10-16T13:40:38.820818+0000","last_became_peered":"2023-10-16T13:40:38.820818+0000","last_unstale":"2023-10-16T13:40:39.810851+0000","last_undegraded":"2023-10-16T13:40:39.810851+0000","last_fullsized":"2023-10-16T13:40:39.810851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:46.343827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215042+0000","last_change":"2023-10-16T13:40:39.824316+0000","last_active":"2023-10-16T13:40:41.215042+0000","last_peered":"2023-10-16T13:40:41.215042+0000","last_clean":"2023-10-16T13:40:41.215042+0000","last_became_active":"2023-10-16T13:40:39.824016+0000","last_became_peered":"2023-10-16T13:40:39.824016+0000","last_unstale":"2023-10-16T13:40:41.215042+0000","last_undegraded":"2023-10-16T13:40:41.215042+0000","last_fullsized":"2023-10-16T13:40:41.215042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:13.061966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840115+0000","last_change":"2023-10-16T13:40:38.818953+0000","last_active":"2023-10-16T13:40:39.840115+0000","last_peered":"2023-10-16T13:40:39.840115+0000","last_clean":"2023-10-16T13:40:39.840115+0000","last_became_active":"2023-10-16T13:40:38.818613+0000","last_became_peered":"2023-10-16T13:40:38.818613+0000","last_unstale":"2023-10-16T13:40:39.840115+0000","last_undegraded":"2023-10-16T13:40:39.840115+0000","last_fullsized":"2023-10-16T13:40:39.840115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:40.884355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812889+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:39.812889+0000","last_peered":"2023-10-16T13:40:39.812889+0000","last_clean":"2023-10-16T13:40:39.812889+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:39.812889+0000","last_undegraded":"2023-10-16T13:40:39.812889+0000","last_fullsized":"2023-10-16T13:40:39.812889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":914094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72999999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.62},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.80000000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.873,"15min":0.873},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.0509999999999999,"15min":1.133},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.081,"5min":10.964,"15min":10.964},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67700000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.48799999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":325338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.503,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":0.49199999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.752,"15min":0.752},"last":0.373}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56000000000000005,"5min":0.88,"15min":0.88},"last":0.309},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63500000000000001,"5min":1.002,"15min":1.002},"last":1.4390000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85999999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.131,"15min":1.131},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88800000000000001,"5min":1.034,"15min":1.034},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85099999999999998,"5min":1.085,"15min":1.085},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1343488,"data_stored":912459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.41299999999999998,"15min":0.38400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.433,"15min":0.40899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41899999999999998,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.317},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.435}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.625,"15min":0.60099999999999998},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0190000000000001,"5min":4.0190000000000001,"15min":4.0190000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.63900000000000001,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.0650000000000004,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.63,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.64900000000000002,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.69199999999999995,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.59299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.216},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26900000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63500000000000001,"5min":1.153,"15min":1.153},"last":0.318}]},{"osd":4,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.054,"15min":1.054},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442}]},{"osd":5,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":1.111,"15min":1.111},"last":0.497}]},{"osd":7,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.23,"15min":1.23},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.57299999999999995,"15min":0.61399999999999999},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.623,"5min":2.181,"15min":2.181},"last":0.501}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49299999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56200000000000006,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80700000000000005,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.83899999999999997,"15min":0.88100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.72299999999999998,"15min":0.746},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79400000000000004,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73599999999999999,"15min":0.75900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77800000000000002,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76000000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.84399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.88800000000000001,"15min":0.93600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77900000000000003,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78300000000000003,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.437},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67200000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.498},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":0.88},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.877,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66700000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.141,"15min":1.141},"last":0.373},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.43099999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:48.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:40:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 Processor -- start 2023-10-16T13:40:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 -- start start 2023-10-16T13:40:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c015b740 0x7f95c00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95c00ce6e0 0x7f95c00cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00cf190 con 0x7f95c00d0c70 2023-10-16T13:40:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c015bb20 con 0x7f95c00ce6e0 2023-10-16T13:40:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.761+0000 7f95c5c25700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00cbd40 con 0x7f95c015b740 2023-10-16T13:40:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95c00ce6e0 0x7f95c00cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95c00ce6e0 0x7f95c00cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45896/0 (socket says 172.21.15.5:45896) 2023-10-16T13:40:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 -- 172.21.15.5:0/3262655770 learned_addr learned my addr 172.21.15.5:0/3262655770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bf7fe700 1 --2- 172.21.15.5:0/3262655770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c015b740 0x7f95c00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 -- 172.21.15.5:0/3262655770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c015b740 msgr2=0x7f95c00d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 --2- 172.21.15.5:0/3262655770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c015b740 0x7f95c00d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 -- 172.21.15.5:0/3262655770 >> v1:172.21.15.112:6789/0 conn(0x7f95c00d0c70 legacy=0x7f95c00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 -- 172.21.15.5:0/3262655770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00cc020 con 0x7f95c00ce6e0 2023-10-16T13:40:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95bffff700 1 --2- 172.21.15.5:0/3262655770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c00ce6e0 0x7f95c00cf690 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009e50 tx=0x7f95b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8170ba2799da563c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95be7fc700 1 -- 172.21.15.5:0/3262655770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800e070 con 0x7f95c00ce6e0 2023-10-16T13:40:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95be7fc700 1 -- 172.21.15.5:0/3262655770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b800b9c0 con 0x7f95c00ce6e0 2023-10-16T13:40:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.762+0000 7f95be7fc700 1 -- 172.21.15.5:0/3262655770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800bd70 con 0x7f95c00ce6e0 2023-10-16T13:40:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 -- 172.21.15.5:0/3262655770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c00ce6e0 msgr2=0x7f95c00cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 --2- 172.21.15.5:0/3262655770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c00ce6e0 0x7f95c00cf690 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009e50 tx=0x7f95b800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 -- 172.21.15.5:0/3262655770 shutdown_connections 2023-10-16T13:40:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 --2- 172.21.15.5:0/3262655770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c00ce6e0 0x7f95c00cf690 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 --2- 172.21.15.5:0/3262655770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c015b740 0x7f95c00d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 -- 172.21.15.5:0/3262655770 >> 172.21.15.5:0/3262655770 conn(0x7f95c00665a0 msgr2=0x7f95c0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 -- 172.21.15.5:0/3262655770 shutdown_connections 2023-10-16T13:40:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.763+0000 7f95c5c25700 1 -- 172.21.15.5:0/3262655770 wait complete. 2023-10-16T13:40:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.765+0000 7f95c5c25700 1 Processor -- start 2023-10-16T13:40:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.765+0000 7f95c5c25700 1 -- start start 2023-10-16T13:40:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95c5c25700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c00ce6e0 0x7f95c01f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95c5c25700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95c00d0c70 0x7f95c00a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95c5c25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 0x7f95c00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95c5c25700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01f1190 con 0x7f95c015b740 2023-10-16T13:40:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95c5c25700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01f1470 con 0x7f95c00d0c70 2023-10-16T13:40:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95c5c25700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01f1750 con 0x7f95c00ce6e0 2023-10-16T13:40:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 0x7f95c00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 0x7f95c00b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45902/0 (socket says 172.21.15.5:45902) 2023-10-16T13:40:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 -- 172.21.15.5:0/4274943472 learned_addr learned my addr 172.21.15.5:0/4274943472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bf7fe700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c00ce6e0 0x7f95c01f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95beffd700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95c00d0c70 0x7f95c00a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 -- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c00ce6e0 msgr2=0x7f95c01f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c00ce6e0 0x7f95c01f0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 -- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95c00d0c70 msgr2=0x7f95c00a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95c00d0c70 0x7f95c00a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 -- 172.21.15.5:0/4274943472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009b30 con 0x7f95c015b740 2023-10-16T13:40:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95bffff700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 0x7f95c00b6130 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f95b8012000 tx=0x7f95b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8003ea0 con 0x7f95c015b740 2023-10-16T13:40:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.766+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b80048e0 con 0x7f95c015b740 2023-10-16T13:40:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.767+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c01f1a30 con 0x7f95c015b740 2023-10-16T13:40:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.767+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b801c680 con 0x7f95c015b740 2023-10-16T13:40:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.767+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c00aa2d0 con 0x7f95c015b740 2023-10-16T13:40:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.767+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c00cc2e0 con 0x7f95c015b740 2023-10-16T13:40:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.768+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f95b801c7e0 con 0x7f95c015b740 2023-10-16T13:40:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.768+0000 7f95b7fff700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f95a006af90 0x7f95a006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.768+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95b808afa0 con 0x7f95c015b740 2023-10-16T13:40:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.769+0000 7f95bf7fe700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f95a006af90 0x7f95a006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.769+0000 7f95bf7fe700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f95a006af90 0x7f95a006d450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f95b0006b20 tx=0x7f95b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.773+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95c00cc2e0 con 0x7f95c015b740 2023-10-16T13:40:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.972+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95c00cc5e0 con 0x7f95a006af90 2023-10-16T13:40:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.981+0000 7f95b7fff700 1 -- 172.21.15.5:0/4274943472 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289743 (secure 0 0 0) 0x7f95b00076b0 con 0x7f95a006af90 2023-10-16T13:40:48.987 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:48.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f95a006af90 msgr2=0x7f95a006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f95a006af90 0x7f95a006d450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f95b0006b20 tx=0x7f95b0008040 comp rx=0 tx=0).stop 2023-10-16T13:40:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 msgr2=0x7f95c00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 0x7f95c00b6130 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f95b8012000 tx=0x7f95b8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 shutdown_connections 2023-10-16T13:40:48.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95c015b740 0x7f95c00b6130 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f95a006af90 0x7f95a006d450 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95c00ce6e0 0x7f95c01f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 --2- 172.21.15.5:0/4274943472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95c00d0c70 0x7f95c00a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:48.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 >> 172.21.15.5:0/4274943472 conn(0x7f95c00665a0 msgr2=0x7f95c00cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 shutdown_connections 2023-10-16T13:40:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:48.984+0000 7f95c5c25700 1 -- 172.21.15.5:0/4274943472 wait complete. 2023-10-16T13:40:48.992 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:40:48.999 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-10-16T13:40:47.492753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227452,"kb_used_data":7104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747268,"statfs":{"total":773094113280,"available":772861202432,"internally_reserved":0,"allocated":7274496,"data_stored":3768398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001922"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715983+0000","last_change":"2023-10-16T13:40:39.827147+0000","last_active":"2023-10-16T13:40:41.715983+0000","last_peered":"2023-10-16T13:40:41.715983+0000","last_clean":"2023-10-16T13:40:41.715983+0000","last_became_active":"2023-10-16T13:40:39.826821+0000","last_became_peered":"2023-10-16T13:40:39.826821+0000","last_unstale":"2023-10-16T13:40:41.715983+0000","last_undegraded":"2023-10-16T13:40:41.715983+0000","last_fullsized":"2023-10-16T13:40:41.715983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:36.602305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809161+0000","last_change":"2023-10-16T13:40:39.826301+0000","last_active":"2023-10-16T13:40:40.809161+0000","last_peered":"2023-10-16T13:40:40.809161+0000","last_clean":"2023-10-16T13:40:40.809161+0000","last_became_active":"2023-10-16T13:40:39.825972+0000","last_became_peered":"2023-10-16T13:40:39.825972+0000","last_unstale":"2023-10-16T13:40:40.809161+0000","last_undegraded":"2023-10-16T13:40:40.809161+0000","last_fullsized":"2023-10-16T13:40:40.809161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:58:29.778901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215120+0000","last_change":"2023-10-16T13:40:39.820300+0000","last_active":"2023-10-16T13:40:41.215120+0000","last_peered":"2023-10-16T13:40:41.215120+0000","last_clean":"2023-10-16T13:40:41.215120+0000","last_became_active":"2023-10-16T13:40:39.819046+0000","last_became_peered":"2023-10-16T13:40:39.819046+0000","last_unstale":"2023-10-16T13:40:41.215120+0000","last_undegraded":"2023-10-16T13:40:41.215120+0000","last_fullsized":"2023-10-16T13:40:41.215120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:10.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715864+0000","last_change":"2023-10-16T13:40:39.820789+0000","last_active":"2023-10-16T13:40:41.715864+0000","last_peered":"2023-10-16T13:40:41.715864+0000","last_clean":"2023-10-16T13:40:41.715864+0000","last_became_active":"2023-10-16T13:40:39.820439+0000","last_became_peered":"2023-10-16T13:40:39.820439+0000","last_unstale":"2023-10-16T13:40:41.715864+0000","last_undegraded":"2023-10-16T13:40:41.715864+0000","last_fullsized":"2023-10-16T13:40:41.715864+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.296829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715734+0000","last_change":"2023-10-16T13:40:39.826643+0000","last_active":"2023-10-16T13:40:41.715734+0000","last_peered":"2023-10-16T13:40:41.715734+0000","last_clean":"2023-10-16T13:40:41.715734+0000","last_became_active":"2023-10-16T13:40:39.826372+0000","last_became_peered":"2023-10-16T13:40:39.826372+0000","last_unstale":"2023-10-16T13:40:41.715734+0000","last_undegraded":"2023-10-16T13:40:41.715734+0000","last_fullsized":"2023-10-16T13:40:41.715734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:24:18.733931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809062+0000","last_change":"2023-10-16T13:40:39.825527+0000","last_active":"2023-10-16T13:40:40.809062+0000","last_peered":"2023-10-16T13:40:40.809062+0000","last_clean":"2023-10-16T13:40:40.809062+0000","last_became_active":"2023-10-16T13:40:39.825063+0000","last_became_peered":"2023-10-16T13:40:39.825063+0000","last_unstale":"2023-10-16T13:40:40.809062+0000","last_undegraded":"2023-10-16T13:40:40.809062+0000","last_fullsized":"2023-10-16T13:40:40.809062+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:14.561196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809901+0000","last_change":"2023-10-16T13:40:39.817076+0000","last_active":"2023-10-16T13:40:40.809901+0000","last_peered":"2023-10-16T13:40:40.809901+0000","last_clean":"2023-10-16T13:40:40.809901+0000","last_became_active":"2023-10-16T13:40:39.816711+0000","last_became_peered":"2023-10-16T13:40:39.816711+0000","last_unstale":"2023-10-16T13:40:40.809901+0000","last_undegraded":"2023-10-16T13:40:40.809901+0000","last_fullsized":"2023-10-16T13:40:40.809901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809507+0000","last_change":"2023-10-16T13:40:39.817668+0000","last_active":"2023-10-16T13:40:40.809507+0000","last_peered":"2023-10-16T13:40:40.809507+0000","last_clean":"2023-10-16T13:40:40.809507+0000","last_became_active":"2023-10-16T13:40:39.817379+0000","last_became_peered":"2023-10-16T13:40:39.817379+0000","last_unstale":"2023-10-16T13:40:40.809507+0000","last_undegraded":"2023-10-16T13:40:40.809507+0000","last_fullsized":"2023-10-16T13:40:40.809507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:00:37.091073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715889+0000","last_change":"2023-10-16T13:40:39.822984+0000","last_active":"2023-10-16T13:40:41.715889+0000","last_peered":"2023-10-16T13:40:41.715889+0000","last_clean":"2023-10-16T13:40:41.715889+0000","last_became_active":"2023-10-16T13:40:39.822343+0000","last_became_peered":"2023-10-16T13:40:39.822343+0000","last_unstale":"2023-10-16T13:40:41.715889+0000","last_undegraded":"2023-10-16T13:40:41.715889+0000","last_fullsized":"2023-10-16T13:40:41.715889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:41.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811360+0000","last_change":"2023-10-16T13:40:39.827962+0000","last_active":"2023-10-16T13:40:40.811360+0000","last_peered":"2023-10-16T13:40:40.811360+0000","last_clean":"2023-10-16T13:40:40.811360+0000","last_became_active":"2023-10-16T13:40:39.827568+0000","last_became_peered":"2023-10-16T13:40:39.827568+0000","last_unstale":"2023-10-16T13:40:40.811360+0000","last_undegraded":"2023-10-16T13:40:40.811360+0000","last_fullsized":"2023-10-16T13:40:40.811360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715840+0000","last_change":"2023-10-16T13:40:39.820962+0000","last_active":"2023-10-16T13:40:41.715840+0000","last_peered":"2023-10-16T13:40:41.715840+0000","last_clean":"2023-10-16T13:40:41.715840+0000","last_became_active":"2023-10-16T13:40:39.820517+0000","last_became_peered":"2023-10-16T13:40:39.820517+0000","last_unstale":"2023-10-16T13:40:41.715840+0000","last_undegraded":"2023-10-16T13:40:41.715840+0000","last_fullsized":"2023-10-16T13:40:41.715840+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:21:26.719269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716282+0000","last_change":"2023-10-16T13:40:39.817841+0000","last_active":"2023-10-16T13:40:41.716282+0000","last_peered":"2023-10-16T13:40:41.716282+0000","last_clean":"2023-10-16T13:40:41.716282+0000","last_became_active":"2023-10-16T13:40:39.817542+0000","last_became_peered":"2023-10-16T13:40:39.817542+0000","last_unstale":"2023-10-16T13:40:41.716282+0000","last_undegraded":"2023-10-16T13:40:41.716282+0000","last_fullsized":"2023-10-16T13:40:41.716282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:28.616968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336957+0000","last_change":"2023-10-16T13:40:39.828266+0000","last_active":"2023-10-16T13:40:41.336957+0000","last_peered":"2023-10-16T13:40:41.336957+0000","last_clean":"2023-10-16T13:40:41.336957+0000","last_became_active":"2023-10-16T13:40:39.827976+0000","last_became_peered":"2023-10-16T13:40:39.827976+0000","last_unstale":"2023-10-16T13:40:41.336957+0000","last_undegraded":"2023-10-16T13:40:41.336957+0000","last_fullsized":"2023-10-16T13:40:41.336957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716080+0000","last_change":"2023-10-16T13:40:39.819853+0000","last_active":"2023-10-16T13:40:41.716080+0000","last_peered":"2023-10-16T13:40:41.716080+0000","last_clean":"2023-10-16T13:40:41.716080+0000","last_became_active":"2023-10-16T13:40:39.817614+0000","last_became_peered":"2023-10-16T13:40:39.817614+0000","last_unstale":"2023-10-16T13:40:41.716080+0000","last_undegraded":"2023-10-16T13:40:41.716080+0000","last_fullsized":"2023-10-16T13:40:41.716080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:18.669096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336801+0000","last_change":"2023-10-16T13:40:39.815605+0000","last_active":"2023-10-16T13:40:41.336801+0000","last_peered":"2023-10-16T13:40:41.336801+0000","last_clean":"2023-10-16T13:40:41.336801+0000","last_became_active":"2023-10-16T13:40:39.815330+0000","last_became_peered":"2023-10-16T13:40:39.815330+0000","last_unstale":"2023-10-16T13:40:41.336801+0000","last_undegraded":"2023-10-16T13:40:41.336801+0000","last_fullsized":"2023-10-16T13:40:41.336801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810910+0000","last_change":"2023-10-16T13:40:39.827830+0000","last_active":"2023-10-16T13:40:40.810910+0000","last_peered":"2023-10-16T13:40:40.810910+0000","last_clean":"2023-10-16T13:40:40.810910+0000","last_became_active":"2023-10-16T13:40:39.827492+0000","last_became_peered":"2023-10-16T13:40:39.827492+0000","last_unstale":"2023-10-16T13:40:40.810910+0000","last_undegraded":"2023-10-16T13:40:40.810910+0000","last_fullsized":"2023-10-16T13:40:40.810910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:04.992009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716055+0000","last_change":"2023-10-16T13:40:39.822782+0000","last_active":"2023-10-16T13:40:41.716055+0000","last_peered":"2023-10-16T13:40:41.716055+0000","last_clean":"2023-10-16T13:40:41.716055+0000","last_became_active":"2023-10-16T13:40:39.821980+0000","last_became_peered":"2023-10-16T13:40:39.821980+0000","last_unstale":"2023-10-16T13:40:41.716055+0000","last_undegraded":"2023-10-16T13:40:41.716055+0000","last_fullsized":"2023-10-16T13:40:41.716055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:06.909255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716453+0000","last_change":"2023-10-16T13:40:39.822271+0000","last_active":"2023-10-16T13:40:41.716453+0000","last_peered":"2023-10-16T13:40:41.716453+0000","last_clean":"2023-10-16T13:40:41.716453+0000","last_became_active":"2023-10-16T13:40:39.821902+0000","last_became_peered":"2023-10-16T13:40:39.821902+0000","last_unstale":"2023-10-16T13:40:41.716453+0000","last_undegraded":"2023-10-16T13:40:41.716453+0000","last_fullsized":"2023-10-16T13:40:41.716453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:36.878188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809262+0000","last_change":"2023-10-16T13:40:39.819724+0000","last_active":"2023-10-16T13:40:40.809262+0000","last_peered":"2023-10-16T13:40:40.809262+0000","last_clean":"2023-10-16T13:40:40.809262+0000","last_became_active":"2023-10-16T13:40:39.819422+0000","last_became_peered":"2023-10-16T13:40:39.819422+0000","last_unstale":"2023-10-16T13:40:40.809262+0000","last_undegraded":"2023-10-16T13:40:40.809262+0000","last_fullsized":"2023-10-16T13:40:40.809262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:22.575254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336887+0000","last_change":"2023-10-16T13:40:39.816879+0000","last_active":"2023-10-16T13:40:41.336887+0000","last_peered":"2023-10-16T13:40:41.336887+0000","last_clean":"2023-10-16T13:40:41.336887+0000","last_became_active":"2023-10-16T13:40:39.816471+0000","last_became_peered":"2023-10-16T13:40:39.816471+0000","last_unstale":"2023-10-16T13:40:41.336887+0000","last_undegraded":"2023-10-16T13:40:41.336887+0000","last_fullsized":"2023-10-16T13:40:41.336887+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811115+0000","last_change":"2023-10-16T13:40:39.823342+0000","last_active":"2023-10-16T13:40:40.811115+0000","last_peered":"2023-10-16T13:40:40.811115+0000","last_clean":"2023-10-16T13:40:40.811115+0000","last_became_active":"2023-10-16T13:40:39.823070+0000","last_became_peered":"2023-10-16T13:40:39.823070+0000","last_unstale":"2023-10-16T13:40:40.811115+0000","last_undegraded":"2023-10-16T13:40:40.811115+0000","last_fullsized":"2023-10-16T13:40:40.811115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811070+0000","last_change":"2023-10-16T13:40:39.823310+0000","last_active":"2023-10-16T13:40:40.811070+0000","last_peered":"2023-10-16T13:40:40.811070+0000","last_clean":"2023-10-16T13:40:40.811070+0000","last_became_active":"2023-10-16T13:40:39.822911+0000","last_became_peered":"2023-10-16T13:40:39.822911+0000","last_unstale":"2023-10-16T13:40:40.811070+0000","last_undegraded":"2023-10-16T13:40:40.811070+0000","last_fullsized":"2023-10-16T13:40:40.811070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:02.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715522+0000","last_change":"2023-10-16T13:40:39.823496+0000","last_active":"2023-10-16T13:40:41.715522+0000","last_peered":"2023-10-16T13:40:41.715522+0000","last_clean":"2023-10-16T13:40:41.715522+0000","last_became_active":"2023-10-16T13:40:39.823122+0000","last_became_peered":"2023-10-16T13:40:39.823122+0000","last_unstale":"2023-10-16T13:40:41.715522+0000","last_undegraded":"2023-10-16T13:40:41.715522+0000","last_fullsized":"2023-10-16T13:40:41.715522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:03.540302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715444+0000","last_change":"2023-10-16T13:40:39.828343+0000","last_active":"2023-10-16T13:40:41.715444+0000","last_peered":"2023-10-16T13:40:41.715444+0000","last_clean":"2023-10-16T13:40:41.715444+0000","last_became_active":"2023-10-16T13:40:39.828065+0000","last_became_peered":"2023-10-16T13:40:39.828065+0000","last_unstale":"2023-10-16T13:40:41.715444+0000","last_undegraded":"2023-10-16T13:40:41.715444+0000","last_fullsized":"2023-10-16T13:40:41.715444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:53:56.811517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811597+0000","last_change":"2023-10-16T13:40:39.825969+0000","last_active":"2023-10-16T13:40:40.811597+0000","last_peered":"2023-10-16T13:40:40.811597+0000","last_clean":"2023-10-16T13:40:40.811597+0000","last_became_active":"2023-10-16T13:40:39.825675+0000","last_became_peered":"2023-10-16T13:40:39.825675+0000","last_unstale":"2023-10-16T13:40:40.811597+0000","last_undegraded":"2023-10-16T13:40:40.811597+0000","last_fullsized":"2023-10-16T13:40:40.811597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810517+0000","last_change":"2023-10-16T13:40:39.822183+0000","last_active":"2023-10-16T13:40:40.810517+0000","last_peered":"2023-10-16T13:40:40.810517+0000","last_clean":"2023-10-16T13:40:40.810517+0000","last_became_active":"2023-10-16T13:40:39.821886+0000","last_became_peered":"2023-10-16T13:40:39.821886+0000","last_unstale":"2023-10-16T13:40:40.810517+0000","last_undegraded":"2023-10-16T13:40:40.810517+0000","last_fullsized":"2023-10-16T13:40:40.810517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:13:19.191562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215119+0000","last_change":"2023-10-16T13:40:39.825254+0000","last_active":"2023-10-16T13:40:41.215119+0000","last_peered":"2023-10-16T13:40:41.215119+0000","last_clean":"2023-10-16T13:40:41.215119+0000","last_became_active":"2023-10-16T13:40:39.824904+0000","last_became_peered":"2023-10-16T13:40:39.824904+0000","last_unstale":"2023-10-16T13:40:41.215119+0000","last_undegraded":"2023-10-16T13:40:41.215119+0000","last_fullsized":"2023-10-16T13:40:41.215119+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:37:09.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811326+0000","last_change":"2023-10-16T13:40:39.821816+0000","last_active":"2023-10-16T13:40:40.811326+0000","last_peered":"2023-10-16T13:40:40.811326+0000","last_clean":"2023-10-16T13:40:40.811326+0000","last_became_active":"2023-10-16T13:40:39.821547+0000","last_became_peered":"2023-10-16T13:40:39.821547+0000","last_unstale":"2023-10-16T13:40:40.811326+0000","last_undegraded":"2023-10-16T13:40:40.811326+0000","last_fullsized":"2023-10-16T13:40:40.811326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214929+0000","last_change":"2023-10-16T13:40:39.823762+0000","last_active":"2023-10-16T13:40:41.214929+0000","last_peered":"2023-10-16T13:40:41.214929+0000","last_clean":"2023-10-16T13:40:41.214929+0000","last_became_active":"2023-10-16T13:40:39.823215+0000","last_became_peered":"2023-10-16T13:40:39.823215+0000","last_unstale":"2023-10-16T13:40:41.214929+0000","last_undegraded":"2023-10-16T13:40:41.214929+0000","last_fullsized":"2023-10-16T13:40:41.214929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:24.798572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810097+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810097+0000","last_peered":"2023-10-16T13:40:40.810097+0000","last_clean":"2023-10-16T13:40:40.810097+0000","last_became_active":"2023-10-16T13:40:39.820879+0000","last_became_peered":"2023-10-16T13:40:39.820879+0000","last_unstale":"2023-10-16T13:40:40.810097+0000","last_undegraded":"2023-10-16T13:40:40.810097+0000","last_fullsized":"2023-10-16T13:40:40.810097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810169+0000","last_change":"2023-10-16T13:40:39.816419+0000","last_active":"2023-10-16T13:40:40.810169+0000","last_peered":"2023-10-16T13:40:40.810169+0000","last_clean":"2023-10-16T13:40:40.810169+0000","last_became_active":"2023-10-16T13:40:39.816092+0000","last_became_peered":"2023-10-16T13:40:39.816092+0000","last_unstale":"2023-10-16T13:40:40.810169+0000","last_undegraded":"2023-10-16T13:40:40.810169+0000","last_fullsized":"2023-10-16T13:40:40.810169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808812+0000","last_change":"2023-10-16T13:40:39.820724+0000","last_active":"2023-10-16T13:40:40.808812+0000","last_peered":"2023-10-16T13:40:40.808812+0000","last_clean":"2023-10-16T13:40:40.808812+0000","last_became_active":"2023-10-16T13:40:39.820464+0000","last_became_peered":"2023-10-16T13:40:39.820464+0000","last_unstale":"2023-10-16T13:40:40.808812+0000","last_undegraded":"2023-10-16T13:40:40.808812+0000","last_fullsized":"2023-10-16T13:40:40.808812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:59.734877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715936+0000","last_change":"2023-10-16T13:40:39.825976+0000","last_active":"2023-10-16T13:40:41.715936+0000","last_peered":"2023-10-16T13:40:41.715936+0000","last_clean":"2023-10-16T13:40:41.715936+0000","last_became_active":"2023-10-16T13:40:39.825699+0000","last_became_peered":"2023-10-16T13:40:39.825699+0000","last_unstale":"2023-10-16T13:40:41.715936+0000","last_undegraded":"2023-10-16T13:40:41.715936+0000","last_fullsized":"2023-10-16T13:40:41.715936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:32.095873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843040+0000","last_change":"2023-10-16T13:40:38.820699+0000","last_active":"2023-10-16T13:40:39.843040+0000","last_peered":"2023-10-16T13:40:39.843040+0000","last_clean":"2023-10-16T13:40:39.843040+0000","last_became_active":"2023-10-16T13:40:38.820285+0000","last_became_peered":"2023-10-16T13:40:38.820285+0000","last_unstale":"2023-10-16T13:40:39.843040+0000","last_undegraded":"2023-10-16T13:40:39.843040+0000","last_fullsized":"2023-10-16T13:40:39.843040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:04.057774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716115+0000","last_change":"2023-10-16T13:40:39.822604+0000","last_active":"2023-10-16T13:40:41.716115+0000","last_peered":"2023-10-16T13:40:41.716115+0000","last_clean":"2023-10-16T13:40:41.716115+0000","last_became_active":"2023-10-16T13:40:39.821385+0000","last_became_peered":"2023-10-16T13:40:39.821385+0000","last_unstale":"2023-10-16T13:40:41.716115+0000","last_undegraded":"2023-10-16T13:40:41.716115+0000","last_fullsized":"2023-10-16T13:40:41.716115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:41.889159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840696+0000","last_change":"2023-10-16T13:40:38.817456+0000","last_active":"2023-10-16T13:40:39.840696+0000","last_peered":"2023-10-16T13:40:39.840696+0000","last_clean":"2023-10-16T13:40:39.840696+0000","last_became_active":"2023-10-16T13:40:38.817152+0000","last_became_peered":"2023-10-16T13:40:38.817152+0000","last_unstale":"2023-10-16T13:40:39.840696+0000","last_undegraded":"2023-10-16T13:40:39.840696+0000","last_fullsized":"2023-10-16T13:40:39.840696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:30:03.987205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809425+0000","last_change":"2023-10-16T13:40:39.827023+0000","last_active":"2023-10-16T13:40:40.809425+0000","last_peered":"2023-10-16T13:40:40.809425+0000","last_clean":"2023-10-16T13:40:40.809425+0000","last_became_active":"2023-10-16T13:40:39.825744+0000","last_became_peered":"2023-10-16T13:40:39.825744+0000","last_unstale":"2023-10-16T13:40:40.809425+0000","last_undegraded":"2023-10-16T13:40:40.809425+0000","last_fullsized":"2023-10-16T13:40:40.809425+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:25.807534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840503+0000","last_change":"2023-10-16T13:40:38.821926+0000","last_active":"2023-10-16T13:40:39.840503+0000","last_peered":"2023-10-16T13:40:39.840503+0000","last_clean":"2023-10-16T13:40:39.840503+0000","last_became_active":"2023-10-16T13:40:38.821575+0000","last_became_peered":"2023-10-16T13:40:38.821575+0000","last_unstale":"2023-10-16T13:40:39.840503+0000","last_undegraded":"2023-10-16T13:40:39.840503+0000","last_fullsized":"2023-10-16T13:40:39.840503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:33.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715977+0000","last_change":"2023-10-16T13:40:39.824618+0000","last_active":"2023-10-16T13:40:41.715977+0000","last_peered":"2023-10-16T13:40:41.715977+0000","last_clean":"2023-10-16T13:40:41.715977+0000","last_became_active":"2023-10-16T13:40:39.824029+0000","last_became_peered":"2023-10-16T13:40:39.824029+0000","last_unstale":"2023-10-16T13:40:41.715977+0000","last_undegraded":"2023-10-16T13:40:41.715977+0000","last_fullsized":"2023-10-16T13:40:41.715977+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:28:29.263123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840162+0000","last_change":"2023-10-16T13:40:38.820937+0000","last_active":"2023-10-16T13:40:39.840162+0000","last_peered":"2023-10-16T13:40:39.840162+0000","last_clean":"2023-10-16T13:40:39.840162+0000","last_became_active":"2023-10-16T13:40:38.820601+0000","last_became_peered":"2023-10-16T13:40:38.820601+0000","last_unstale":"2023-10-16T13:40:39.840162+0000","last_undegraded":"2023-10-16T13:40:39.840162+0000","last_fullsized":"2023-10-16T13:40:39.840162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:05.904450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810245+0000","last_change":"2023-10-16T13:40:39.819143+0000","last_active":"2023-10-16T13:40:40.810245+0000","last_peered":"2023-10-16T13:40:40.810245+0000","last_clean":"2023-10-16T13:40:40.810245+0000","last_became_active":"2023-10-16T13:40:39.818866+0000","last_became_peered":"2023-10-16T13:40:39.818866+0000","last_unstale":"2023-10-16T13:40:40.810245+0000","last_undegraded":"2023-10-16T13:40:40.810245+0000","last_fullsized":"2023-10-16T13:40:40.810245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:45.323442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.845415+0000","last_change":"2023-10-16T13:40:38.815449+0000","last_active":"2023-10-16T13:40:39.845415+0000","last_peered":"2023-10-16T13:40:39.845415+0000","last_clean":"2023-10-16T13:40:39.845415+0000","last_became_active":"2023-10-16T13:40:38.815189+0000","last_became_peered":"2023-10-16T13:40:38.815189+0000","last_unstale":"2023-10-16T13:40:39.845415+0000","last_undegraded":"2023-10-16T13:40:39.845415+0000","last_fullsized":"2023-10-16T13:40:39.845415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:24.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811121+0000","last_change":"2023-10-16T13:40:39.826787+0000","last_active":"2023-10-16T13:40:40.811121+0000","last_peered":"2023-10-16T13:40:40.811121+0000","last_clean":"2023-10-16T13:40:40.811121+0000","last_became_active":"2023-10-16T13:40:39.826506+0000","last_became_peered":"2023-10-16T13:40:39.826506+0000","last_unstale":"2023-10-16T13:40:40.811121+0000","last_undegraded":"2023-10-16T13:40:40.811121+0000","last_fullsized":"2023-10-16T13:40:40.811121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:59.980820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.839986+0000","last_change":"2023-10-16T13:40:38.821853+0000","last_active":"2023-10-16T13:40:39.839986+0000","last_peered":"2023-10-16T13:40:39.839986+0000","last_clean":"2023-10-16T13:40:39.839986+0000","last_became_active":"2023-10-16T13:40:38.821494+0000","last_became_peered":"2023-10-16T13:40:38.821494+0000","last_unstale":"2023-10-16T13:40:39.839986+0000","last_undegraded":"2023-10-16T13:40:39.839986+0000","last_fullsized":"2023-10-16T13:40:39.839986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:11.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715181+0000","last_change":"2023-10-16T13:40:39.827080+0000","last_active":"2023-10-16T13:40:41.715181+0000","last_peered":"2023-10-16T13:40:41.715181+0000","last_clean":"2023-10-16T13:40:41.715181+0000","last_became_active":"2023-10-16T13:40:39.826753+0000","last_became_peered":"2023-10-16T13:40:39.826753+0000","last_unstale":"2023-10-16T13:40:41.715181+0000","last_undegraded":"2023-10-16T13:40:41.715181+0000","last_fullsized":"2023-10-16T13:40:41.715181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:19.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809900+0000","last_change":"2023-10-16T13:40:38.820205+0000","last_active":"2023-10-16T13:40:39.809900+0000","last_peered":"2023-10-16T13:40:39.809900+0000","last_clean":"2023-10-16T13:40:39.809900+0000","last_became_active":"2023-10-16T13:40:38.819870+0000","last_became_peered":"2023-10-16T13:40:38.819870+0000","last_unstale":"2023-10-16T13:40:39.809900+0000","last_undegraded":"2023-10-16T13:40:39.809900+0000","last_fullsized":"2023-10-16T13:40:39.809900+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:54.803860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336849+0000","last_change":"2023-10-16T13:40:39.822849+0000","last_active":"2023-10-16T13:40:41.336849+0000","last_peered":"2023-10-16T13:40:41.336849+0000","last_clean":"2023-10-16T13:40:41.336849+0000","last_became_active":"2023-10-16T13:40:39.822537+0000","last_became_peered":"2023-10-16T13:40:39.822537+0000","last_unstale":"2023-10-16T13:40:41.336849+0000","last_undegraded":"2023-10-16T13:40:41.336849+0000","last_fullsized":"2023-10-16T13:40:41.336849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:19.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805349+0000","last_change":"2023-10-16T13:40:38.819977+0000","last_active":"2023-10-16T13:40:39.805349+0000","last_peered":"2023-10-16T13:40:39.805349+0000","last_clean":"2023-10-16T13:40:39.805349+0000","last_became_active":"2023-10-16T13:40:38.819676+0000","last_became_peered":"2023-10-16T13:40:38.819676+0000","last_unstale":"2023-10-16T13:40:39.805349+0000","last_undegraded":"2023-10-16T13:40:39.805349+0000","last_fullsized":"2023-10-16T13:40:39.805349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:18:53.008354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810642+0000","last_change":"2023-10-16T13:40:39.824725+0000","last_active":"2023-10-16T13:40:40.810642+0000","last_peered":"2023-10-16T13:40:40.810642+0000","last_clean":"2023-10-16T13:40:40.810642+0000","last_became_active":"2023-10-16T13:40:39.824452+0000","last_became_peered":"2023-10-16T13:40:39.824452+0000","last_unstale":"2023-10-16T13:40:40.810642+0000","last_undegraded":"2023-10-16T13:40:40.810642+0000","last_fullsized":"2023-10-16T13:40:40.810642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:27.067030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.814180+0000","last_change":"2023-10-16T13:40:38.815657+0000","last_active":"2023-10-16T13:40:39.814180+0000","last_peered":"2023-10-16T13:40:39.814180+0000","last_clean":"2023-10-16T13:40:39.814180+0000","last_became_active":"2023-10-16T13:40:38.815356+0000","last_became_peered":"2023-10-16T13:40:38.815356+0000","last_unstale":"2023-10-16T13:40:39.814180+0000","last_undegraded":"2023-10-16T13:40:39.814180+0000","last_fullsized":"2023-10-16T13:40:39.814180+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:00.969615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716040+0000","last_change":"2023-10-16T13:40:39.824506+0000","last_active":"2023-10-16T13:40:41.716040+0000","last_peered":"2023-10-16T13:40:41.716040+0000","last_clean":"2023-10-16T13:40:41.716040+0000","last_became_active":"2023-10-16T13:40:39.824228+0000","last_became_peered":"2023-10-16T13:40:39.824228+0000","last_unstale":"2023-10-16T13:40:41.716040+0000","last_undegraded":"2023-10-16T13:40:41.716040+0000","last_fullsized":"2023-10-16T13:40:41.716040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:46.581551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812283+0000","last_change":"2023-10-16T13:40:38.818983+0000","last_active":"2023-10-16T13:40:39.812283+0000","last_peered":"2023-10-16T13:40:39.812283+0000","last_clean":"2023-10-16T13:40:39.812283+0000","last_became_active":"2023-10-16T13:40:38.818660+0000","last_became_peered":"2023-10-16T13:40:38.818660+0000","last_unstale":"2023-10-16T13:40:39.812283+0000","last_undegraded":"2023-10-16T13:40:39.812283+0000","last_fullsized":"2023-10-16T13:40:39.812283+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:06.070222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809240+0000","last_change":"2023-10-16T13:40:39.824564+0000","last_active":"2023-10-16T13:40:40.809240+0000","last_peered":"2023-10-16T13:40:40.809240+0000","last_clean":"2023-10-16T13:40:40.809240+0000","last_became_active":"2023-10-16T13:40:39.824255+0000","last_became_peered":"2023-10-16T13:40:39.824255+0000","last_unstale":"2023-10-16T13:40:40.809240+0000","last_undegraded":"2023-10-16T13:40:40.809240+0000","last_fullsized":"2023-10-16T13:40:40.809240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:54:47.276160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842913+0000","last_change":"2023-10-16T13:40:38.817847+0000","last_active":"2023-10-16T13:40:39.842913+0000","last_peered":"2023-10-16T13:40:39.842913+0000","last_clean":"2023-10-16T13:40:39.842913+0000","last_became_active":"2023-10-16T13:40:38.817561+0000","last_became_peered":"2023-10-16T13:40:38.817561+0000","last_unstale":"2023-10-16T13:40:39.842913+0000","last_undegraded":"2023-10-16T13:40:39.842913+0000","last_fullsized":"2023-10-16T13:40:39.842913+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:23:45.576746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715899+0000","last_change":"2023-10-16T13:40:39.817345+0000","last_active":"2023-10-16T13:40:41.715899+0000","last_peered":"2023-10-16T13:40:41.715899+0000","last_clean":"2023-10-16T13:40:41.715899+0000","last_became_active":"2023-10-16T13:40:39.817042+0000","last_became_peered":"2023-10-16T13:40:39.817042+0000","last_unstale":"2023-10-16T13:40:41.715899+0000","last_undegraded":"2023-10-16T13:40:41.715899+0000","last_fullsized":"2023-10-16T13:40:41.715899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:47.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.847149+0000","last_change":"2023-10-16T13:40:38.816845+0000","last_active":"2023-10-16T13:40:39.847149+0000","last_peered":"2023-10-16T13:40:39.847149+0000","last_clean":"2023-10-16T13:40:39.847149+0000","last_became_active":"2023-10-16T13:40:38.816563+0000","last_became_peered":"2023-10-16T13:40:38.816563+0000","last_unstale":"2023-10-16T13:40:39.847149+0000","last_undegraded":"2023-10-16T13:40:39.847149+0000","last_fullsized":"2023-10-16T13:40:39.847149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:52.412223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715541+0000","last_change":"2023-10-16T13:40:39.821790+0000","last_active":"2023-10-16T13:40:41.715541+0000","last_peered":"2023-10-16T13:40:41.715541+0000","last_clean":"2023-10-16T13:40:41.715541+0000","last_became_active":"2023-10-16T13:40:39.821440+0000","last_became_peered":"2023-10-16T13:40:39.821440+0000","last_unstale":"2023-10-16T13:40:41.715541+0000","last_undegraded":"2023-10-16T13:40:41.715541+0000","last_fullsized":"2023-10-16T13:40:41.715541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:33:17.474278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843212+0000","last_change":"2023-10-16T13:40:38.818745+0000","last_active":"2023-10-16T13:40:39.843212+0000","last_peered":"2023-10-16T13:40:39.843212+0000","last_clean":"2023-10-16T13:40:39.843212+0000","last_became_active":"2023-10-16T13:40:38.818380+0000","last_became_peered":"2023-10-16T13:40:38.818380+0000","last_unstale":"2023-10-16T13:40:39.843212+0000","last_undegraded":"2023-10-16T13:40:39.843212+0000","last_fullsized":"2023-10-16T13:40:39.843212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810402+0000","last_change":"2023-10-16T13:40:39.821144+0000","last_active":"2023-10-16T13:40:40.810402+0000","last_peered":"2023-10-16T13:40:40.810402+0000","last_clean":"2023-10-16T13:40:40.810402+0000","last_became_active":"2023-10-16T13:40:39.820851+0000","last_became_peered":"2023-10-16T13:40:39.820851+0000","last_unstale":"2023-10-16T13:40:40.810402+0000","last_undegraded":"2023-10-16T13:40:40.810402+0000","last_fullsized":"2023-10-16T13:40:40.810402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812337+0000","last_change":"2023-10-16T13:40:38.821394+0000","last_active":"2023-10-16T13:40:39.812337+0000","last_peered":"2023-10-16T13:40:39.812337+0000","last_clean":"2023-10-16T13:40:39.812337+0000","last_became_active":"2023-10-16T13:40:38.821071+0000","last_became_peered":"2023-10-16T13:40:38.821071+0000","last_unstale":"2023-10-16T13:40:39.812337+0000","last_undegraded":"2023-10-16T13:40:39.812337+0000","last_fullsized":"2023-10-16T13:40:39.812337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:57:29.111116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.336749+0000","last_change":"2023-10-16T13:40:39.828347+0000","last_active":"2023-10-16T13:40:41.336749+0000","last_peered":"2023-10-16T13:40:41.336749+0000","last_clean":"2023-10-16T13:40:41.336749+0000","last_became_active":"2023-10-16T13:40:39.828013+0000","last_became_peered":"2023-10-16T13:40:39.828013+0000","last_unstale":"2023-10-16T13:40:41.336749+0000","last_undegraded":"2023-10-16T13:40:41.336749+0000","last_fullsized":"2023-10-16T13:40:41.336749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:17.043849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809248+0000","last_change":"2023-10-16T13:40:38.815484+0000","last_active":"2023-10-16T13:40:39.809248+0000","last_peered":"2023-10-16T13:40:39.809248+0000","last_clean":"2023-10-16T13:40:39.809248+0000","last_became_active":"2023-10-16T13:40:38.815154+0000","last_became_peered":"2023-10-16T13:40:38.815154+0000","last_unstale":"2023-10-16T13:40:39.809248+0000","last_undegraded":"2023-10-16T13:40:39.809248+0000","last_fullsized":"2023-10-16T13:40:39.809248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:55.109057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715501+0000","last_change":"2023-10-16T13:40:39.821845+0000","last_active":"2023-10-16T13:40:41.715501+0000","last_peered":"2023-10-16T13:40:41.715501+0000","last_clean":"2023-10-16T13:40:41.715501+0000","last_became_active":"2023-10-16T13:40:39.821282+0000","last_became_peered":"2023-10-16T13:40:39.821282+0000","last_unstale":"2023-10-16T13:40:41.715501+0000","last_undegraded":"2023-10-16T13:40:41.715501+0000","last_fullsized":"2023-10-16T13:40:41.715501+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:16.745728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843953+0000","last_change":"2023-10-16T13:40:38.818696+0000","last_active":"2023-10-16T13:40:39.843953+0000","last_peered":"2023-10-16T13:40:39.843953+0000","last_clean":"2023-10-16T13:40:39.843953+0000","last_became_active":"2023-10-16T13:40:38.818334+0000","last_became_peered":"2023-10-16T13:40:38.818334+0000","last_unstale":"2023-10-16T13:40:39.843953+0000","last_undegraded":"2023-10-16T13:40:39.843953+0000","last_fullsized":"2023-10-16T13:40:39.843953+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:46:36.165362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.811445+0000","last_change":"2023-10-16T13:40:39.824636+0000","last_active":"2023-10-16T13:40:40.811445+0000","last_peered":"2023-10-16T13:40:40.811445+0000","last_clean":"2023-10-16T13:40:40.811445+0000","last_became_active":"2023-10-16T13:40:39.824349+0000","last_became_peered":"2023-10-16T13:40:39.824349+0000","last_unstale":"2023-10-16T13:40:40.811445+0000","last_undegraded":"2023-10-16T13:40:40.811445+0000","last_fullsized":"2023-10-16T13:40:40.811445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:51.301287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.842725+0000","last_change":"2023-10-16T13:40:38.827807+0000","last_active":"2023-10-16T13:40:39.842725+0000","last_peered":"2023-10-16T13:40:39.842725+0000","last_clean":"2023-10-16T13:40:39.842725+0000","last_became_active":"2023-10-16T13:40:38.827562+0000","last_became_peered":"2023-10-16T13:40:38.827562+0000","last_unstale":"2023-10-16T13:40:39.842725+0000","last_undegraded":"2023-10-16T13:40:39.842725+0000","last_fullsized":"2023-10-16T13:40:39.842725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:17.664292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716090+0000","last_change":"2023-10-16T13:40:39.825085+0000","last_active":"2023-10-16T13:40:41.716090+0000","last_peered":"2023-10-16T13:40:41.716090+0000","last_clean":"2023-10-16T13:40:41.716090+0000","last_became_active":"2023-10-16T13:40:39.824627+0000","last_became_peered":"2023-10-16T13:40:39.824627+0000","last_unstale":"2023-10-16T13:40:41.716090+0000","last_undegraded":"2023-10-16T13:40:41.716090+0000","last_fullsized":"2023-10-16T13:40:41.716090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:59:26.423859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840339+0000","last_change":"2023-10-16T13:40:38.822365+0000","last_active":"2023-10-16T13:40:39.840339+0000","last_peered":"2023-10-16T13:40:39.840339+0000","last_clean":"2023-10-16T13:40:39.840339+0000","last_became_active":"2023-10-16T13:40:38.822053+0000","last_became_peered":"2023-10-16T13:40:38.822053+0000","last_unstale":"2023-10-16T13:40:39.840339+0000","last_undegraded":"2023-10-16T13:40:39.840339+0000","last_fullsized":"2023-10-16T13:40:39.840339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:35.873383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716385+0000","last_change":"2023-10-16T13:40:39.817797+0000","last_active":"2023-10-16T13:40:41.716385+0000","last_peered":"2023-10-16T13:40:41.716385+0000","last_clean":"2023-10-16T13:40:41.716385+0000","last_became_active":"2023-10-16T13:40:39.817154+0000","last_became_peered":"2023-10-16T13:40:39.817154+0000","last_unstale":"2023-10-16T13:40:41.716385+0000","last_undegraded":"2023-10-16T13:40:41.716385+0000","last_fullsized":"2023-10-16T13:40:41.716385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:56.113861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.843250+0000","last_change":"2023-10-16T13:40:38.821194+0000","last_active":"2023-10-16T13:40:39.843250+0000","last_peered":"2023-10-16T13:40:39.843250+0000","last_clean":"2023-10-16T13:40:39.843250+0000","last_became_active":"2023-10-16T13:40:38.820062+0000","last_became_peered":"2023-10-16T13:40:38.820062+0000","last_unstale":"2023-10-16T13:40:39.843250+0000","last_undegraded":"2023-10-16T13:40:39.843250+0000","last_fullsized":"2023-10-16T13:40:39.843250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:32.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715891+0000","last_change":"2023-10-16T13:40:39.826550+0000","last_active":"2023-10-16T13:40:41.715891+0000","last_peered":"2023-10-16T13:40:41.715891+0000","last_clean":"2023-10-16T13:40:41.715891+0000","last_became_active":"2023-10-16T13:40:39.826243+0000","last_became_peered":"2023-10-16T13:40:39.826243+0000","last_unstale":"2023-10-16T13:40:41.715891+0000","last_undegraded":"2023-10-16T13:40:41.715891+0000","last_fullsized":"2023-10-16T13:40:41.715891+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:41.376812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.813507+0000","last_change":"2023-10-16T13:40:38.820616+0000","last_active":"2023-10-16T13:40:39.813507+0000","last_peered":"2023-10-16T13:40:39.813507+0000","last_clean":"2023-10-16T13:40:39.813507+0000","last_became_active":"2023-10-16T13:40:38.820060+0000","last_became_peered":"2023-10-16T13:40:38.820060+0000","last_unstale":"2023-10-16T13:40:39.813507+0000","last_undegraded":"2023-10-16T13:40:39.813507+0000","last_fullsized":"2023-10-16T13:40:39.813507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:24:26.062225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214983+0000","last_change":"2023-10-16T13:40:39.820400+0000","last_active":"2023-10-16T13:40:41.214983+0000","last_peered":"2023-10-16T13:40:41.214983+0000","last_clean":"2023-10-16T13:40:41.214983+0000","last_became_active":"2023-10-16T13:40:39.820107+0000","last_became_peered":"2023-10-16T13:40:39.820107+0000","last_unstale":"2023-10-16T13:40:41.214983+0000","last_undegraded":"2023-10-16T13:40:41.214983+0000","last_fullsized":"2023-10-16T13:40:41.214983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:17:30.379729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812497+0000","last_change":"2023-10-16T13:40:38.819491+0000","last_active":"2023-10-16T13:40:39.812497+0000","last_peered":"2023-10-16T13:40:39.812497+0000","last_clean":"2023-10-16T13:40:39.812497+0000","last_became_active":"2023-10-16T13:40:38.819167+0000","last_became_peered":"2023-10-16T13:40:38.819167+0000","last_unstale":"2023-10-16T13:40:39.812497+0000","last_undegraded":"2023-10-16T13:40:39.812497+0000","last_fullsized":"2023-10-16T13:40:39.812497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:24.574150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215007+0000","last_change":"2023-10-16T13:40:39.822722+0000","last_active":"2023-10-16T13:40:41.215007+0000","last_peered":"2023-10-16T13:40:41.215007+0000","last_clean":"2023-10-16T13:40:41.215007+0000","last_became_active":"2023-10-16T13:40:39.821553+0000","last_became_peered":"2023-10-16T13:40:39.821553+0000","last_unstale":"2023-10-16T13:40:41.215007+0000","last_undegraded":"2023-10-16T13:40:41.215007+0000","last_fullsized":"2023-10-16T13:40:41.215007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:03.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.809399+0000","last_change":"2023-10-16T13:40:38.816423+0000","last_active":"2023-10-16T13:40:39.809399+0000","last_peered":"2023-10-16T13:40:39.809399+0000","last_clean":"2023-10-16T13:40:39.809399+0000","last_became_active":"2023-10-16T13:40:38.815912+0000","last_became_peered":"2023-10-16T13:40:38.815912+0000","last_unstale":"2023-10-16T13:40:39.809399+0000","last_undegraded":"2023-10-16T13:40:39.809399+0000","last_fullsized":"2023-10-16T13:40:39.809399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:51:27.612163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.214957+0000","last_change":"2023-10-16T13:40:39.824262+0000","last_active":"2023-10-16T13:40:41.214957+0000","last_peered":"2023-10-16T13:40:41.214957+0000","last_clean":"2023-10-16T13:40:41.214957+0000","last_became_active":"2023-10-16T13:40:39.823930+0000","last_became_peered":"2023-10-16T13:40:39.823930+0000","last_unstale":"2023-10-16T13:40:41.214957+0000","last_undegraded":"2023-10-16T13:40:41.214957+0000","last_fullsized":"2023-10-16T13:40:41.214957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:51.876599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811990+0000","last_change":"2023-10-16T13:40:38.817029+0000","last_active":"2023-10-16T13:40:39.811990+0000","last_peered":"2023-10-16T13:40:39.811990+0000","last_clean":"2023-10-16T13:40:39.811990+0000","last_became_active":"2023-10-16T13:40:38.816709+0000","last_became_peered":"2023-10-16T13:40:38.816709+0000","last_unstale":"2023-10-16T13:40:39.811990+0000","last_undegraded":"2023-10-16T13:40:39.811990+0000","last_fullsized":"2023-10-16T13:40:39.811990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:10:35.873383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.337018+0000","last_change":"2023-10-16T13:40:39.816164+0000","last_active":"2023-10-16T13:40:41.337018+0000","last_peered":"2023-10-16T13:40:41.337018+0000","last_clean":"2023-10-16T13:40:41.337018+0000","last_became_active":"2023-10-16T13:40:39.815367+0000","last_became_peered":"2023-10-16T13:40:39.815367+0000","last_unstale":"2023-10-16T13:40:41.337018+0000","last_undegraded":"2023-10-16T13:40:41.337018+0000","last_fullsized":"2023-10-16T13:40:41.337018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.841270+0000","last_change":"2023-10-16T13:40:38.827775+0000","last_active":"2023-10-16T13:40:39.841270+0000","last_peered":"2023-10-16T13:40:39.841270+0000","last_clean":"2023-10-16T13:40:39.841270+0000","last_became_active":"2023-10-16T13:40:38.827564+0000","last_became_peered":"2023-10-16T13:40:38.827564+0000","last_unstale":"2023-10-16T13:40:39.841270+0000","last_undegraded":"2023-10-16T13:40:39.841270+0000","last_fullsized":"2023-10-16T13:40:39.841270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:54.568956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.810404+0000","last_change":"2023-10-16T13:40:39.816893+0000","last_active":"2023-10-16T13:40:40.810404+0000","last_peered":"2023-10-16T13:40:40.810404+0000","last_clean":"2023-10-16T13:40:40.810404+0000","last_became_active":"2023-10-16T13:40:39.816559+0000","last_became_peered":"2023-10-16T13:40:39.816559+0000","last_unstale":"2023-10-16T13:40:40.810404+0000","last_undegraded":"2023-10-16T13:40:40.810404+0000","last_fullsized":"2023-10-16T13:40:40.810404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:45:05.803224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.811471+0000","last_change":"2023-10-16T13:40:38.815314+0000","last_active":"2023-10-16T13:40:39.811471+0000","last_peered":"2023-10-16T13:40:39.811471+0000","last_clean":"2023-10-16T13:40:39.811471+0000","last_became_active":"2023-10-16T13:40:38.814850+0000","last_became_peered":"2023-10-16T13:40:38.814850+0000","last_unstale":"2023-10-16T13:40:39.811471+0000","last_undegraded":"2023-10-16T13:40:39.811471+0000","last_fullsized":"2023-10-16T13:40:39.811471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:01.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715757+0000","last_change":"2023-10-16T13:40:39.828351+0000","last_active":"2023-10-16T13:40:41.715757+0000","last_peered":"2023-10-16T13:40:41.715757+0000","last_clean":"2023-10-16T13:40:41.715757+0000","last_became_active":"2023-10-16T13:40:39.828110+0000","last_became_peered":"2023-10-16T13:40:39.828110+0000","last_unstale":"2023-10-16T13:40:41.715757+0000","last_undegraded":"2023-10-16T13:40:41.715757+0000","last_fullsized":"2023-10-16T13:40:41.715757+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:49.894970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.806258+0000","last_change":"2023-10-16T13:40:38.815831+0000","last_active":"2023-10-16T13:40:39.806258+0000","last_peered":"2023-10-16T13:40:39.806258+0000","last_clean":"2023-10-16T13:40:39.806258+0000","last_became_active":"2023-10-16T13:40:38.815540+0000","last_became_peered":"2023-10-16T13:40:38.815540+0000","last_unstale":"2023-10-16T13:40:39.806258+0000","last_undegraded":"2023-10-16T13:40:39.806258+0000","last_fullsized":"2023-10-16T13:40:39.806258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:29:02.491892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716013+0000","last_change":"2023-10-16T13:40:39.824811+0000","last_active":"2023-10-16T13:40:41.716013+0000","last_peered":"2023-10-16T13:40:41.716013+0000","last_clean":"2023-10-16T13:40:41.716013+0000","last_became_active":"2023-10-16T13:40:39.824331+0000","last_became_peered":"2023-10-16T13:40:39.824331+0000","last_unstale":"2023-10-16T13:40:41.716013+0000","last_undegraded":"2023-10-16T13:40:41.716013+0000","last_fullsized":"2023-10-16T13:40:41.716013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:27.597269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812435+0000","last_change":"2023-10-16T13:40:38.813968+0000","last_active":"2023-10-16T13:40:39.812435+0000","last_peered":"2023-10-16T13:40:39.812435+0000","last_clean":"2023-10-16T13:40:39.812435+0000","last_became_active":"2023-10-16T13:40:38.813655+0000","last_became_peered":"2023-10-16T13:40:38.813655+0000","last_unstale":"2023-10-16T13:40:39.812435+0000","last_undegraded":"2023-10-16T13:40:39.812435+0000","last_fullsized":"2023-10-16T13:40:39.812435+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:46:36.165362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.716126+0000","last_change":"2023-10-16T13:40:39.821518+0000","last_active":"2023-10-16T13:40:41.716126+0000","last_peered":"2023-10-16T13:40:41.716126+0000","last_clean":"2023-10-16T13:40:41.716126+0000","last_became_active":"2023-10-16T13:40:39.821128+0000","last_became_peered":"2023-10-16T13:40:39.821128+0000","last_unstale":"2023-10-16T13:40:41.716126+0000","last_undegraded":"2023-10-16T13:40:41.716126+0000","last_fullsized":"2023-10-16T13:40:41.716126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:38:33.784224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.805532+0000","last_change":"2023-10-16T13:40:38.819885+0000","last_active":"2023-10-16T13:40:39.805532+0000","last_peered":"2023-10-16T13:40:39.805532+0000","last_clean":"2023-10-16T13:40:39.805532+0000","last_became_active":"2023-10-16T13:40:38.819622+0000","last_became_peered":"2023-10-16T13:40:38.819622+0000","last_unstale":"2023-10-16T13:40:39.805532+0000","last_undegraded":"2023-10-16T13:40:39.805532+0000","last_fullsized":"2023-10-16T13:40:39.805532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:17:33.819262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.808911+0000","last_change":"2023-10-16T13:40:39.825984+0000","last_active":"2023-10-16T13:40:40.808911+0000","last_peered":"2023-10-16T13:40:40.808911+0000","last_clean":"2023-10-16T13:40:40.808911+0000","last_became_active":"2023-10-16T13:40:39.825650+0000","last_became_peered":"2023-10-16T13:40:39.825650+0000","last_unstale":"2023-10-16T13:40:40.808911+0000","last_undegraded":"2023-10-16T13:40:40.808911+0000","last_fullsized":"2023-10-16T13:40:40.808911+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:36:34.339968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810108+0000","last_change":"2023-10-16T13:40:38.820149+0000","last_active":"2023-10-16T13:40:39.810108+0000","last_peered":"2023-10-16T13:40:39.810108+0000","last_clean":"2023-10-16T13:40:39.810108+0000","last_became_active":"2023-10-16T13:40:38.819853+0000","last_became_peered":"2023-10-16T13:40:38.819853+0000","last_unstale":"2023-10-16T13:40:39.810108+0000","last_undegraded":"2023-10-16T13:40:39.810108+0000","last_fullsized":"2023-10-16T13:40:39.810108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:30.874102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.715368+0000","last_change":"2023-10-16T13:40:39.818863+0000","last_active":"2023-10-16T13:40:41.715368+0000","last_peered":"2023-10-16T13:40:41.715368+0000","last_clean":"2023-10-16T13:40:41.715368+0000","last_became_active":"2023-10-16T13:40:39.818500+0000","last_became_peered":"2023-10-16T13:40:39.818500+0000","last_unstale":"2023-10-16T13:40:41.715368+0000","last_undegraded":"2023-10-16T13:40:41.715368+0000","last_fullsized":"2023-10-16T13:40:41.715368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:07:48.678490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.813723+0000","last_change":"2023-10-16T13:40:38.821873+0000","last_active":"2023-10-16T13:40:39.813723+0000","last_peered":"2023-10-16T13:40:39.813723+0000","last_clean":"2023-10-16T13:40:39.813723+0000","last_became_active":"2023-10-16T13:40:38.821298+0000","last_became_peered":"2023-10-16T13:40:38.821298+0000","last_unstale":"2023-10-16T13:40:39.813723+0000","last_undegraded":"2023-10-16T13:40:39.813723+0000","last_fullsized":"2023-10-16T13:40:39.813723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:36.268372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:40.809466+0000","last_change":"2023-10-16T13:40:39.820186+0000","last_active":"2023-10-16T13:40:40.809466+0000","last_peered":"2023-10-16T13:40:40.809466+0000","last_clean":"2023-10-16T13:40:40.809466+0000","last_became_active":"2023-10-16T13:40:39.819347+0000","last_became_peered":"2023-10-16T13:40:39.819347+0000","last_unstale":"2023-10-16T13:40:40.809466+0000","last_undegraded":"2023-10-16T13:40:40.809466+0000","last_fullsized":"2023-10-16T13:40:40.809466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:04.033107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.810851+0000","last_change":"2023-10-16T13:40:38.821117+0000","last_active":"2023-10-16T13:40:39.810851+0000","last_peered":"2023-10-16T13:40:39.810851+0000","last_clean":"2023-10-16T13:40:39.810851+0000","last_became_active":"2023-10-16T13:40:38.820818+0000","last_became_peered":"2023-10-16T13:40:38.820818+0000","last_unstale":"2023-10-16T13:40:39.810851+0000","last_undegraded":"2023-10-16T13:40:39.810851+0000","last_fullsized":"2023-10-16T13:40:39.810851+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:46.343827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-16T13:40:41.215042+0000","last_change":"2023-10-16T13:40:39.824316+0000","last_active":"2023-10-16T13:40:41.215042+0000","last_peered":"2023-10-16T13:40:41.215042+0000","last_clean":"2023-10-16T13:40:41.215042+0000","last_became_active":"2023-10-16T13:40:39.824016+0000","last_became_peered":"2023-10-16T13:40:39.824016+0000","last_unstale":"2023-10-16T13:40:41.215042+0000","last_undegraded":"2023-10-16T13:40:41.215042+0000","last_fullsized":"2023-10-16T13:40:41.215042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:38.795433+0000","last_clean_scrub_stamp":"2023-10-16T13:40:38.795433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:13.061966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.840115+0000","last_change":"2023-10-16T13:40:38.818953+0000","last_active":"2023-10-16T13:40:39.840115+0000","last_peered":"2023-10-16T13:40:39.840115+0000","last_clean":"2023-10-16T13:40:39.840115+0000","last_became_active":"2023-10-16T13:40:38.818613+0000","last_became_peered":"2023-10-16T13:40:38.818613+0000","last_unstale":"2023-10-16T13:40:39.840115+0000","last_undegraded":"2023-10-16T13:40:39.840115+0000","last_fullsized":"2023-10-16T13:40:39.840115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:40:37.790629+0000","last_clean_scrub_stamp":"2023-10-16T13:40:37.790629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:40.884355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-16T13:40:39.812889+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:40:39.812889+0000","last_peered":"2023-10-16T13:40:39.812889+0000","last_clean":"2023-10-16T13:40:39.812889+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:40:39.812889+0000","last_undegraded":"2023-10-16T13:40:39.812889+0000","last_fullsized":"2023-10-16T13:40:39.812889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":914094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.36699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72999999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.62},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75700000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.80000000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74399999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.32800000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.64200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70099999999999996,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.873,"15min":0.873},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":1.0509999999999999,"15min":1.133},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.081,"5min":10.964,"15min":10.964},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67700000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.48799999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":325338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.503,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.254,"5min":0.247,"15min":0.247},"max":{"1min":0.49199999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.59599999999999997,"5min":0.752,"15min":0.752},"last":0.373}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56000000000000005,"5min":0.88,"15min":0.88},"last":0.309},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42299999999999999,"15min":0.42699999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63500000000000001,"5min":1.002,"15min":1.002},"last":1.4390000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85999999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.502}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.131,"15min":1.131},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88800000000000001,"5min":1.034,"15min":1.034},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85099999999999998,"5min":1.085,"15min":1.085},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1343488,"data_stored":912459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.41299999999999998,"15min":0.38400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.433,"15min":0.40899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.9169999999999998,"5min":3.9169999999999998,"15min":3.9169999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.435,"15min":0.41099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41899999999999998,"15min":0.38500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.317},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.435}]},{"osd":4,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.625,"15min":0.60099999999999998},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0190000000000001,"5min":4.0190000000000001,"15min":4.0190000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.63900000000000001,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.0650000000000004,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.63,"15min":0.60299999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.64900000000000002,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.69199999999999995,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.2119999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.59299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.216},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.26900000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.376,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63500000000000001,"5min":1.153,"15min":1.153},"last":0.318}]},{"osd":4,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.054,"15min":1.054},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.442}]},{"osd":5,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":1.111,"15min":1.111},"last":0.497}]},{"osd":7,"last update":"Mon Oct 16 13:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.23,"15min":1.23},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":323222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.57299999999999995,"15min":0.61399999999999999},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.623,"5min":2.181,"15min":2.181},"last":0.501}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.49299999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56200000000000006,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80700000000000005,"5min":5.7560000000000002,"15min":5.7560000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.83899999999999997,"15min":0.88100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":5.8559999999999999,"15min":5.8559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.72299999999999998,"15min":0.746},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79400000000000004,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.80000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73599999999999999,"15min":0.75900000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77800000000000002,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76000000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.84399999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.88800000000000001,"15min":0.93600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77900000000000003,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78300000000000003,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.437},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67200000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.498},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":0.88},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.877,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":323200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66700000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.141,"15min":1.141},"last":0.373},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.43099999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.498},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:40:49.005 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:40:49.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:40:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.168+0000 7f12f08db700 1 Processor -- start 2023-10-16T13:40:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.168+0000 7f12f08db700 1 -- start start 2023-10-16T13:40:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12f08db700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 0x7f12ec0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12f08db700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0721e0 con 0x7f12ec0ce550 2023-10-16T13:40:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12f08db700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0715d0 con 0x7f12ec06d390 2023-10-16T13:40:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12f08db700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0718b0 con 0x7f12ec06ba60 2023-10-16T13:40:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12ead9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12ec0ce550 0x7f12ec0b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55914/0 (socket says 172.21.15.5:55914) 2023-10-16T13:40:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12ead9d700 1 -- 172.21.15.5:0/3810726667 learned_addr learned my addr 172.21.15.5:0/3810726667 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.169+0000 7f12e9d9b700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 0x7f12ec0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179866649 0 0) 0x7f12ec0721e0 con 0x7f12ec0ce550 2023-10-16T13:40:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d40035b0 con 0x7f12ec0ce550 2023-10-16T13:40:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871323453 0 0) 0x7f12ec0715d0 con 0x7f12ec06d390 2023-10-16T13:40:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec0721e0 con 0x7f12ec06d390 2023-10-16T13:40:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1217037572 0 0) 0x7f12d40035b0 con 0x7f12ec0ce550 2023-10-16T13:40:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 msgr2=0x7f12ec0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 0x7f12ec0b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 >> v1:172.21.15.112:6789/0 conn(0x7f12ec06d390 legacy=0x7f12ec06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec071b90 con 0x7f12ec0ce550 2023-10-16T13:40:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f12e40019f0 con 0x7f12ec0ce550 2023-10-16T13:40:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 >> v1:172.21.15.5:6789/0 conn(0x7f12ec0ce550 legacy=0x7f12ec0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d4003bc0 0x7f12d4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 0x7f12d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0718b0 con 0x7f12d4003bc0 2023-10-16T13:40:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400bac0 con 0x7f12d4004850 2023-10-16T13:40:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400bc50 con 0x7f12ec06ba60 2023-10-16T13:40:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ea59c700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d4003bc0 0x7f12d4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12e9d9b700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ead9d700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 0x7f12d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ea59c700 1 -- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 msgr2=0x7f12d4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ea59c700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12ec06ba60 0x7f12d4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ea59c700 1 -- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d4004850 msgr2=0x7f12d4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ea59c700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d4004850 0x7f12d4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.170+0000 7f12ea59c700 1 -- 172.21.15.5:0/3810726667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40035b0 con 0x7f12d4003bc0 2023-10-16T13:40:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12ea59c700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d4003bc0 0x7f12d4003fc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f12e0001940 tx=0x7f12d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac66baa66740df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0001430 con 0x7f12d4003bc0 2023-10-16T13:40:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0001d70 con 0x7f12d4003bc0 2023-10-16T13:40:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12e959a700 1 -- 172.21.15.5:0/3810726667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0005510 con 0x7f12d4003bc0 2023-10-16T13:40:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12f08db700 1 -- 172.21.15.5:0/3810726667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d4003bc0 msgr2=0x7f12d4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12f08db700 1 --2- 172.21.15.5:0/3810726667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d4003bc0 0x7f12d4003fc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f12e0001940 tx=0x7f12d4005880 comp rx=0 tx=0).stop 2023-10-16T13:40:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12ead9d700 1 -- 172.21.15.5:0/3810726667 reap_dead start 2023-10-16T13:40:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12f08db700 1 -- 172.21.15.5:0/3810726667 shutdown_connections 2023-10-16T13:40:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12f08db700 1 -- 172.21.15.5:0/3810726667 >> 172.21.15.5:0/3810726667 conn(0x7f12ec0cfc40 msgr2=0x7f12ec0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.171+0000 7f12f08db700 1 -- 172.21.15.5:0/3810726667 shutdown_connections 2023-10-16T13:40:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.172+0000 7f12f08db700 1 -- 172.21.15.5:0/3810726667 wait complete. 2023-10-16T13:40:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.173+0000 7f12f08db700 1 Processor -- start 2023-10-16T13:40:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.173+0000 7f12f08db700 1 -- start start 2023-10-16T13:40:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d4003bc0 0x7f12ec0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 0x7f12ec0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12ec0c82f0 0x7f12ec0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0c58c0 con 0x7f12ec0c5440 2023-10-16T13:40:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0c6d10 con 0x7f12ec0c82f0 2023-10-16T13:40:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0c6ff0 con 0x7f12d4003bc0 2023-10-16T13:40:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 0x7f12ec0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 0x7f12ec0c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45920/0 (socket says 172.21.15.5:45920) 2023-10-16T13:40:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 -- 172.21.15.5:0/2036837203 learned_addr learned my addr 172.21.15.5:0/2036837203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12ead9d700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12ec0c82f0 0x7f12ec0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12ea59c700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d4003bc0 0x7f12ec0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 -- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d4003bc0 msgr2=0x7f12ec0c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d4003bc0 0x7f12ec0c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 -- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12ec0c82f0 msgr2=0x7f12ec0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12ec0c82f0 0x7f12ec0c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 -- 172.21.15.5:0/2036837203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0c72d0 con 0x7f12ec0c5440 2023-10-16T13:40:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12ead9d700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12ec0c82f0 0x7f12ec0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12e9d9b700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 0x7f12ec0c7db0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f12dc011aa0 tx=0x7f12dc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00f980 con 0x7f12ec0c5440 2023-10-16T13:40:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00fae0 con 0x7f12ec0c5440 2023-10-16T13:40:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.174+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec0c75b0 con 0x7f12ec0c5440 2023-10-16T13:40:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.175+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00fe90 con 0x7f12ec0c5440 2023-10-16T13:40:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.175+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0c87a0 con 0x7f12ec0c5440 2023-10-16T13:40:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.175+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0c7c00 con 0x7f12ec0c5440 2023-10-16T13:40:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.176+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f12dc014440 con 0x7f12ec0c5440 2023-10-16T13:40:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.176+0000 7f12daffd700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af90 0x7f12cc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.176+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12dc089db0 con 0x7f12ec0c5440 2023-10-16T13:40:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.177+0000 7f12ea59c700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af90 0x7f12cc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.177+0000 7f12ea59c700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af90 0x7f12cc06d450 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.181+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12dc054f30 con 0x7f12ec0c5440 2023-10-16T13:40:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.460+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f12ec067d20 con 0x7f12ec0c5440 2023-10-16T13:40:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.462+0000 7f12daffd700 1 -- 172.21.15.5:0/2036837203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f12dc058550 con 0x7f12ec0c5440 2023-10-16T13:40:49.465 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:40:49.465 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:40:49.465 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:40:49.465 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:40:49.466 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:40:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af90 msgr2=0x7f12cc06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af90 0x7f12cc06d450 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e000a000 comp rx=0 tx=0).stop 2023-10-16T13:40:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 msgr2=0x7f12ec0c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 0x7f12ec0c7db0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f12dc011aa0 tx=0x7f12dc011e60 comp rx=0 tx=0).stop 2023-10-16T13:40:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 shutdown_connections 2023-10-16T13:40:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12ec0c82f0 0x7f12ec0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12cc06af90 0x7f12cc06d450 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d4003bc0 0x7f12ec0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 --2- 172.21.15.5:0/2036837203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0c5440 0x7f12ec0c7db0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 >> 172.21.15.5:0/2036837203 conn(0x7f12ec0cfc40 msgr2=0x7f12ec0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 shutdown_connections 2023-10-16T13:40:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.464+0000 7f12f08db700 1 -- 172.21.15.5:0/2036837203 wait complete. 2023-10-16T13:40:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:40:49.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:40:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.605+0000 7f1ff86b7700 1 Processor -- start 2023-10-16T13:40:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.605+0000 7f1ff86b7700 1 -- start start 2023-10-16T13:40:49.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff86b7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ff00d0c70 0x7f1ff00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff86b7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ff00c5110 0x7f1ff00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff86b7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff00d23e0 con 0x7f1ff015b740 2023-10-16T13:40:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff86b7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff015bb20 con 0x7f1ff00c5110 2023-10-16T13:40:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff86b7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00cf190 con 0x7f1ff00d0c70 2023-10-16T13:40:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ff00c5110 0x7f1ff00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ff00c5110 0x7f1ff00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45930/0 (socket says 172.21.15.5:45930) 2023-10-16T13:40:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 -- 172.21.15.5:0/2220154503 learned_addr learned my addr 172.21.15.5:0/2220154503 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff5c52700 1 --2- 172.21.15.5:0/2220154503 >> v2:172.21.15.112:3300/0 conn(0x7f1ff00d0c70 0x7f1ff00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 -- 172.21.15.5:0/2220154503 >> v2:172.21.15.112:3300/0 conn(0x7f1ff00d0c70 msgr2=0x7f1ff00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 --2- 172.21.15.5:0/2220154503 >> v2:172.21.15.112:3300/0 conn(0x7f1ff00d0c70 0x7f1ff00cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 -- 172.21.15.5:0/2220154503 >> v1:172.21.15.112:6789/0 conn(0x7f1ff015b740 legacy=0x7f1ff00d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.606+0000 7f1ff6c54700 1 -- 172.21.15.5:0/2220154503 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00cbd40 con 0x7f1ff00c5110 2023-10-16T13:40:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff6c54700 1 --2- 172.21.15.5:0/2220154503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff00c5110 0x7f1ff00ce510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00cec30 tx=0x7f1fe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109be21f91c5ce4b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff5451700 1 -- 172.21.15.5:0/2220154503 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800e070 con 0x7f1ff00c5110 2023-10-16T13:40:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff5451700 1 -- 172.21.15.5:0/2220154503 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8003a20 con 0x7f1ff00c5110 2023-10-16T13:40:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff5451700 1 -- 172.21.15.5:0/2220154503 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8003dd0 con 0x7f1ff00c5110 2023-10-16T13:40:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 -- 172.21.15.5:0/2220154503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff00c5110 msgr2=0x7f1ff00ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/2220154503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff00c5110 0x7f1ff00ce510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00cec30 tx=0x7f1fe800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 -- 172.21.15.5:0/2220154503 shutdown_connections 2023-10-16T13:40:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/2220154503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff00c5110 0x7f1ff00ce510 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/2220154503 >> v2:172.21.15.112:3300/0 conn(0x7f1ff00d0c70 0x7f1ff00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 -- 172.21.15.5:0/2220154503 >> 172.21.15.5:0/2220154503 conn(0x7f1ff00665a0 msgr2=0x7f1ff0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.607+0000 7f1ff86b7700 1 -- 172.21.15.5:0/2220154503 shutdown_connections 2023-10-16T13:40:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.608+0000 7f1ff86b7700 1 -- 172.21.15.5:0/2220154503 wait complete. 2023-10-16T13:40:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.609+0000 7f1ff86b7700 1 Processor -- start 2023-10-16T13:40:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.609+0000 7f1ff86b7700 1 -- start start 2023-10-16T13:40:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.609+0000 7f1ff86b7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff00c5110 0x7f1ff0157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.609+0000 7f1ff86b7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff00d0c70 0x7f1ff00b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.609+0000 7f1ff86b7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 0x7f1ff015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff86b7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00b3f80 con 0x7f1ff015b740 2023-10-16T13:40:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff86b7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00b4820 con 0x7f1ff00d0c70 2023-10-16T13:40:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff86b7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff006d7e0 con 0x7f1ff00c5110 2023-10-16T13:40:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 0x7f1ff015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 0x7f1ff015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45936/0 (socket says 172.21.15.5:45936) 2023-10-16T13:40:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 -- 172.21.15.5:0/489602717 learned_addr learned my addr 172.21.15.5:0/489602717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff5c52700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff00d0c70 0x7f1ff00b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6453700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff00c5110 0x7f1ff0157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 -- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff00c5110 msgr2=0x7f1ff0157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff00c5110 0x7f1ff0157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 -- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff00d0c70 msgr2=0x7f1ff00b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff00d0c70 0x7f1ff00b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 -- 172.21.15.5:0/489602717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009b30 con 0x7f1ff015b740 2023-10-16T13:40:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff5c52700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff00d0c70 0x7f1ff00b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff6c54700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 0x7f1ff015d020 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800cd50 tx=0x7f1fe8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8004440 con 0x7f1ff015b740 2023-10-16T13:40:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80045c0 con 0x7f1ff015b740 2023-10-16T13:40:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff00b41d0 con 0x7f1ff015b740 2023-10-16T13:40:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8004970 con 0x7f1ff015b740 2023-10-16T13:40:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.610+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00b21b0 con 0x7f1ff015b740 2023-10-16T13:40:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.611+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff0067d20 con 0x7f1ff015b740 2023-10-16T13:40:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.612+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f1fe8019040 con 0x7f1ff015b740 2023-10-16T13:40:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.612+0000 7f1fe2ffd700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406af90 0x7f1fd406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.612+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fe808a310 con 0x7f1ff015b740 2023-10-16T13:40:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.612+0000 7f1ff6453700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406af90 0x7f1fd406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.613+0000 7f1ff6453700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406af90 0x7f1fd406d450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1fec007fd0 tx=0x7f1fec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.617+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fe8055350 con 0x7f1ff015b740 2023-10-16T13:40:49.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.862+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff00b4960 con 0x7f1ff015b740 2023-10-16T13:40:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.862+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/489602717 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f1fe8058970 con 0x7f1ff015b740 2023-10-16T13:40:49.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:40:49.866 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:39.225095+0000","modified":"2023-10-16T13:40:42.262157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/2729748635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2729748635},{"type":"v1","addr":"172.21.15.112:6836","nonce":2729748635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-16T13:40:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.864+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406af90 msgr2=0x7f1fd406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.864+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406af90 0x7f1fd406d450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1fec007fd0 tx=0x7f1fec009040 comp rx=0 tx=0).stop 2023-10-16T13:40:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.864+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 msgr2=0x7f1ff015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.864+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 0x7f1ff015d020 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800cd50 tx=0x7f1fe8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.864+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 shutdown_connections 2023-10-16T13:40:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015b740 0x7f1ff015d020 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406af90 0x7f1fd406d450 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff00c5110 0x7f1ff0157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 --2- 172.21.15.5:0/489602717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff00d0c70 0x7f1ff00b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 >> 172.21.15.5:0/489602717 conn(0x7f1ff00665a0 msgr2=0x7f1ff00cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 shutdown_connections 2023-10-16T13:40:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:49.865+0000 7f1ff86b7700 1 -- 172.21.15.5:0/489602717 wait complete. 2023-10-16T13:40:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-10-16T13:40:50.282 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:40:39.225095+0000', 'modified': '2023-10-16T13:40:42.262157+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6039}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6039': {'gid': 6039, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6836/2729748635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 2729748635}, {'type': 'v1', 'addr': '172.21.15.112:6836', 'nonce': 2729748635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:40:50.282 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:40:50.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T13:40:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.413+0000 7fc0bd53d700 1 Processor -- start 2023-10-16T13:40:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.413+0000 7fc0bd53d700 1 -- start start 2023-10-16T13:40:50.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0bd53d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0b815dbc0 0x7fc0b815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0bd53d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc0b80d3fc0 0x7fc0b80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0bd53d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b815e4e0 con 0x7fc0b80b7050 2023-10-16T13:40:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0bd53d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b80b7560 con 0x7fc0b815dbc0 2023-10-16T13:40:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0bd53d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b80b7840 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0b6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0b815dbc0 0x7fc0b815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0b6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0b815dbc0 0x7fc0b815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45940/0 (socket says 172.21.15.5:45940) 2023-10-16T13:40:50.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0b77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0b80b7050 0x7fc0b80d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55948/0 (socket says 172.21.15.5:55948) 2023-10-16T13:40:50.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/4287677638 learned_addr learned my addr 172.21.15.5:0/4287677638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.414+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/4287677638 >> v2:172.21.15.112:3300/0 conn(0x7fc0b80d3fc0 0x7fc0b80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/4287677638 >> v2:172.21.15.112:3300/0 conn(0x7fc0b80d3fc0 msgr2=0x7fc0b80d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/4287677638 >> v2:172.21.15.112:3300/0 conn(0x7fc0b80d3fc0 0x7fc0b80d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/4287677638 >> v1:172.21.15.5:6789/0 conn(0x7fc0b80b7050 legacy=0x7fc0b80d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/4287677638 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80b7b20 con 0x7fc0b815dbc0 2023-10-16T13:40:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b5ffb700 1 -- 172.21.15.5:0/4287677638 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107784544 0 0) 0x7fc0b815e4e0 con 0x7fc0b80b7050 2023-10-16T13:40:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/4287677638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b815dbc0 0x7fc0b815dfa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80d14e0 tx=0x7fc0ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ee6df66736a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b5ffb700 1 -- 172.21.15.5:0/4287677638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac005e30 con 0x7fc0b815dbc0 2023-10-16T13:40:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b5ffb700 1 -- 172.21.15.5:0/4287677638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac004030 con 0x7fc0b815dbc0 2023-10-16T13:40:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0b5ffb700 1 -- 172.21.15.5:0/4287677638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0043e0 con 0x7fc0b815dbc0 2023-10-16T13:40:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0bd53d700 1 -- 172.21.15.5:0/4287677638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b815dbc0 msgr2=0x7fc0b815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/4287677638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b815dbc0 0x7fc0b815dfa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80d14e0 tx=0x7fc0ac009bd0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0bd53d700 1 -- 172.21.15.5:0/4287677638 shutdown_connections 2023-10-16T13:40:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/4287677638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b815dbc0 0x7fc0b815dfa0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/4287677638 >> v2:172.21.15.112:3300/0 conn(0x7fc0b80d3fc0 0x7fc0b80d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.415+0000 7fc0bd53d700 1 -- 172.21.15.5:0/4287677638 >> 172.21.15.5:0/4287677638 conn(0x7fc0b809cb40 msgr2=0x7fc0b80d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.416+0000 7fc0bd53d700 1 -- 172.21.15.5:0/4287677638 shutdown_connections 2023-10-16T13:40:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.416+0000 7fc0bd53d700 1 -- 172.21.15.5:0/4287677638 wait complete. 2023-10-16T13:40:50.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.417+0000 7fc0bd53d700 1 Processor -- start 2023-10-16T13:40:50.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.417+0000 7fc0bd53d700 1 -- start start 2023-10-16T13:40:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80b7050 0x7fc0b815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 0x7fc0b81e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b815dbc0 0x7fc0b80a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81e2ec0 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f3b40 con 0x7fc0b80b7050 2023-10-16T13:40:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f3e20 con 0x7fc0b815dbc0 2023-10-16T13:40:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 0x7fc0b81e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 0x7fc0b81e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45948/0 (socket says 172.21.15.5:45948) 2023-10-16T13:40:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 -- 172.21.15.5:0/181648064 learned_addr learned my addr 172.21.15.5:0/181648064 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80b7050 0x7fc0b815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b815dbc0 0x7fc0b80a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 -- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b815dbc0 msgr2=0x7fc0b80a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b815dbc0 0x7fc0b80a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 -- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80b7050 msgr2=0x7fc0b815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80b7050 0x7fc0b815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 -- 172.21.15.5:0/181648064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac009500 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b815dbc0 0x7fc0b80a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:40:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80b7050 0x7fc0b815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 0x7fc0b81e6550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e9b0 tx=0x7fc0a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc09f7fe700 1 -- 172.21.15.5:0/181648064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8009710 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc09f7fe700 1 -- 172.21.15.5:0/181648064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800c850 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b81f4100 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc09f7fe700 1 -- 172.21.15.5:0/181648064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800cbc0 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.418+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b80a0a90 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.420+0000 7fc09f7fe700 1 -- 172.21.15.5:0/181648064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fc0a800cd20 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.420+0000 7fc09f7fe700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc0a406af90 0x7fc0a406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.420+0000 7fc09f7fe700 1 -- 172.21.15.5:0/181648064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0a8089640 con 0x7fc0b80d3fc0 2023-10-16T13:40:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.421+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc0a406af90 0x7fc0a406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.421+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc0a406af90 0x7fc0a406d450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009c10 tx=0x7fc0ac008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.422+0000 7fc0c9727b80 1 Processor -- start 2023-10-16T13:40:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 -- start start 2023-10-16T13:40:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334ddf220 0x557334de6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334de4630 0x557334de6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334dba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334d30c20 con 0x557334dba010 2023-10-16T13:40:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334d15c10 con 0x557334ddf220 2023-10-16T13:40:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x557334d13530 con 0x557334de4630 2023-10-16T13:40:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334dba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334dba6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45958/0 (socket says 172.21.15.5:45958) 2023-10-16T13:40:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.423+0000 7fc0b77fe700 1 -- 172.21.15.5:0/204182427 learned_addr learned my addr 172.21.15.5:0/204182427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334ddf220 0x557334de6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334de4630 0x557334de6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b77fe700 1 -- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334de4630 msgr2=0x557334de6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334de4630 0x557334de6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b77fe700 1 -- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334ddf220 msgr2=0x557334de6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334ddf220 0x557334de6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b77fe700 1 -- 172.21.15.5:0/204182427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557334ccc3a0 con 0x557334dba010 2023-10-16T13:40:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334ddf220 0x557334de6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334dba6c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000d250 tx=0x7fc0b000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5462aa7061be332d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc09cff9700 1 -- 172.21.15.5:0/204182427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00070d0 con 0x557334dba010 2023-10-16T13:40:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc09cff9700 1 -- 172.21.15.5:0/204182427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0007230 con 0x557334dba010 2023-10-16T13:40:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.424+0000 7fc09cff9700 1 -- 172.21.15.5:0/204182427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00075a0 con 0x557334dba010 2023-10-16T13:40:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 -- 172.21.15.5:0/204182427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 msgr2=0x557334dba6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334dba6c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000d250 tx=0x7fc0b000d560 comp rx=0 tx=0).stop 2023-10-16T13:40:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 -- 172.21.15.5:0/204182427 shutdown_connections 2023-10-16T13:40:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334dba6c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334ddf220 0x557334de6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/204182427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334de4630 0x557334de6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 -- 172.21.15.5:0/204182427 >> 172.21.15.5:0/204182427 conn(0x557334ce9d80 msgr2=0x557334e04ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 -- 172.21.15.5:0/204182427 shutdown_connections 2023-10-16T13:40:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 -- 172.21.15.5:0/204182427 wait complete. 2023-10-16T13:40:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.425+0000 7fc0c9727b80 1 -- start start 2023-10-16T13:40:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 Processor -- start 2023-10-16T13:40:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334de0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334ddf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334d0ee20 con 0x557334ddf220 2023-10-16T13:40:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334cab6c0 con 0x557334de4630 2023-10-16T13:40:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x557334cab360 con 0x557334dba010 2023-10-16T13:40:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0c9727b80 10 client.0 _ll_register_callbacks cb 0x557334b087b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:40:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334ddf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334ddf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45962/0 (socket says 172.21.15.5:45962) 2023-10-16T13:40:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.426+0000 7fc0b67fc700 1 -- 172.21.15.5:0/4212126712 learned_addr learned my addr 172.21.15.5:0/4212126712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334de0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b67fc700 1 -- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 msgr2=0x557334de0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334de0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b67fc700 1 -- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 msgr2=0x557334de5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b67fc700 1 -- 172.21.15.5:0/4212126712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b0001f50 con 0x557334ddf220 2023-10-16T13:40:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334ddf6b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8087c70 tx=0x7fc0a805c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1a5d2a734d63e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc095ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:40:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc095ffb700 1 -- 172.21.15.5:0/4212126712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8058980 con 0x557334ddf220 2023-10-16T13:40:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc095ffb700 1 -- 172.21.15.5:0/4212126712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0a805c370 con 0x557334ddf220 2023-10-16T13:40:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557334daf5b0 con 0x557334ddf220 2023-10-16T13:40:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc095ffb700 1 -- 172.21.15.5:0/4212126712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0a8057940 con 0x557334ddf220 2023-10-16T13:40:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 10 client.6207 fetch_fsmap learned FSMap version 41 2023-10-16T13:40:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x557334b39d90 con 0x557334ddf220 2023-10-16T13:40:50.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc095ffb700 1 -- 172.21.15.5:0/4212126712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557334daf5b0 con 0x557334ddf220 2023-10-16T13:40:50.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc095ffb700 1 -- 172.21.15.5:0/4212126712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc0a80602c0 con 0x557334ddf220 2023-10-16T13:40:50.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 10 client.6207 fetch_fsmap finished waiting for FSMap version 41 2023-10-16T13:40:50.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 10 client.6207 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:40:50.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 20 client.6207 populate_metadata read hostname 'smithi005' 2023-10-16T13:40:50.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.427+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334e14aa0 0x557334ddd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.428+0000 7fc0c9727b80 4 client.6207 mds_command: new command op to 6039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:40:50.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.428+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 --> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557334d07e00 con 0x557334e14aa0 2023-10-16T13:40:50.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.428+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334e14aa0 0x557334ddd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.428+0000 7fc095ffb700 10 client.6207 ms_handle_connect on v2:172.21.15.112:6834/2729748635 2023-10-16T13:40:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.428+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334e14aa0 0x557334ddd8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8be1df1104abb89 server_cookie=553d2b18f0bd9e42 in_seq=0 out_seq=0 2023-10-16T13:40:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc095ffb700 1 -- 172.21.15.5:0/4212126712 <== mds.0 v2:172.21.15.112:6834/2729748635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557334d07e00 con 0x557334e14aa0 2023-10-16T13:40:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc095ffb700 10 client.6207 handle_command_reply: tid=0 2023-10-16T13:40:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 client.6207 shutdown 2023-10-16T13:40:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 msgr2=0x557334ddf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334ddf6b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8087c70 tx=0x7fc0a805c650 comp rx=0 tx=0).stop 2023-10-16T13:40:50.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 shutdown_connections 2023-10-16T13:40:50.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334e14aa0 0x557334ddd8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334de0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc095ffb700 0 client.6207 ms_handle_reset on v2:172.21.15.112:6834/2729748635 2023-10-16T13:40:50.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/4212126712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334ddf6b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 >> 172.21.15.5:0/4212126712 conn(0x557334ce9d80 msgr2=0x557334e02450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 shutdown_connections 2023-10-16T13:40:50.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 1 -- 172.21.15.5:0/4212126712 wait complete. 2023-10-16T13:40:50.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.429+0000 7fc0c9727b80 20 client.6207 trim_cache size 0 max 16384 2023-10-16T13:40:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.447+0000 7fc0c9727b80 1 Processor -- start 2023-10-16T13:40:50.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.447+0000 7fc0c9727b80 1 -- start start 2023-10-16T13:40:50.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334db8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334ddf220 0x557334e01860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334b8f8d0 con 0x557334dba010 2023-10-16T13:40:50.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334e13e10 con 0x557334de4630 2023-10-16T13:40:50.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x557334dfbb90 con 0x557334ddf220 2023-10-16T13:40:50.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334db8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334db8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45968/0 (socket says 172.21.15.5:45968) 2023-10-16T13:40:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.448+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/27887437 learned_addr learned my addr 172.21.15.5:0/27887437 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/27887437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334ddf220 msgr2=0x557334e01860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334ddf220 0x557334e01860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/27887437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 msgr2=0x557334de2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0b6ffd700 1 -- 172.21.15.5:0/27887437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557334b22c10 con 0x557334dba010 2023-10-16T13:40:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334db8850 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac006df0 tx=0x7fc0ac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c85eda9e7593ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc09d7fa700 1 -- 172.21.15.5:0/27887437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0313e0 con 0x557334dba010 2023-10-16T13:40:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc09d7fa700 1 -- 172.21.15.5:0/27887437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac031540 con 0x557334dba010 2023-10-16T13:40:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc09d7fa700 1 -- 172.21.15.5:0/27887437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0319a0 con 0x557334dba010 2023-10-16T13:40:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0c9727b80 1 -- 172.21.15.5:0/27887437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 msgr2=0x557334db8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.449+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334db8850 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac006df0 tx=0x7fc0ac010000 comp rx=0 tx=0).stop 2023-10-16T13:40:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 -- 172.21.15.5:0/27887437 shutdown_connections 2023-10-16T13:40:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334dba010 0x557334db8850 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/27887437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334ddf220 0x557334e01860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 -- 172.21.15.5:0/27887437 >> 172.21.15.5:0/27887437 conn(0x557334ce9d80 msgr2=0x557334e24740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 -- 172.21.15.5:0/27887437 shutdown_connections 2023-10-16T13:40:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 -- 172.21.15.5:0/27887437 wait complete. 2023-10-16T13:40:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 -- start start 2023-10-16T13:40:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.450+0000 7fc0c9727b80 1 Processor -- start 2023-10-16T13:40:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334dfdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334de5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334dfe700 con 0x557334ddf220 2023-10-16T13:40:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x557334e000b0 con 0x557334de4630 2023-10-16T13:40:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x557334e028a0 con 0x557334dba010 2023-10-16T13:40:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0c9727b80 10 client.0 _ll_register_callbacks cb 0x7fc0a8058c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:40:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334de5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334de5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45976/0 (socket says 172.21.15.5:45976) 2023-10-16T13:40:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 -- 172.21.15.5:0/614065995 learned_addr learned my addr 172.21.15.5:0/614065995 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b77fe700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334dfdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 -- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 msgr2=0x557334dfdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334dfdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 -- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 msgr2=0x557334de2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 -- 172.21.15.5:0/614065995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b80b7b20 con 0x557334ddf220 2023-10-16T13:40:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc0b67fc700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334de5690 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80567a0 tx=0x7fc0a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16563c2a95e20e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.451+0000 7fc095ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:40:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc095ffb700 1 -- 172.21.15.5:0/614065995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8058980 con 0x557334ddf220 2023-10-16T13:40:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc095ffb700 1 -- 172.21.15.5:0/614065995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0a8060750 con 0x557334ddf220 2023-10-16T13:40:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0b0007230 con 0x557334ddf220 2023-10-16T13:40:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc095ffb700 1 -- 172.21.15.5:0/614065995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0a8081b30 con 0x557334ddf220 2023-10-16T13:40:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 10 client.6213 fetch_fsmap learned FSMap version 41 2023-10-16T13:40:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x557334b60200 con 0x557334ddf220 2023-10-16T13:40:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc095ffb700 1 -- 172.21.15.5:0/614065995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0007230 con 0x557334ddf220 2023-10-16T13:40:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc095ffb700 1 -- 172.21.15.5:0/614065995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc0a807c070 con 0x557334ddf220 2023-10-16T13:40:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 10 client.6213 fetch_fsmap finished waiting for FSMap version 41 2023-10-16T13:40:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 10 client.6213 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T13:40:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 20 client.6213 populate_metadata read hostname 'smithi005' 2023-10-16T13:40:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334de2cc0 0x557334e0f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 4 client.6213 mds_command: new command op to 6039 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:40:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 --> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557334d07b20 con 0x557334de2cc0 2023-10-16T13:40:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.452+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334de2cc0 0x557334e0f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc095ffb700 10 client.6213 ms_handle_connect on v2:172.21.15.112:6834/2729748635 2023-10-16T13:40:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0b6ffd700 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334de2cc0 0x557334e0f9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f5783ff77d9a0cf server_cookie=8a84dec18867c210 in_seq=0 out_seq=0 2023-10-16T13:40:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc095ffb700 1 -- 172.21.15.5:0/614065995 <== mds.0 v2:172.21.15.112:6834/2729748635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557334d07b20 con 0x557334de2cc0 2023-10-16T13:40:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc095ffb700 10 client.6213 handle_command_reply: tid=0 2023-10-16T13:40:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 client.6213 shutdown 2023-10-16T13:40:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 msgr2=0x557334de5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334de5690 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80567a0 tx=0x7fc0a8000bc0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 shutdown_connections 2023-10-16T13:40:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:6834/2729748635,v1:172.21.15.112:6836/2729748635] conn(0x557334de2cc0 0x557334e0f9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557334de4630 0x557334de2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x557334dba010 0x557334dfdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc095ffb700 0 client.6213 ms_handle_reset on v2:172.21.15.112:6834/2729748635 2023-10-16T13:40:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 --2- 172.21.15.5:0/614065995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557334ddf220 0x557334de5690 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 >> 172.21.15.5:0/614065995 conn(0x557334ce9d80 msgr2=0x557334db0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 shutdown_connections 2023-10-16T13:40:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 1 -- 172.21.15.5:0/614065995 wait complete. 2023-10-16T13:40:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.453+0000 7fc0c9727b80 20 client.6213 trim_cache size 0 max 16384 2023-10-16T13:40:50.475 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:40:50.476 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:40:50.476 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:40:50.476 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6039, 2023-10-16T13:40:50.476 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:40:50.476 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:40:50.477 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:40:50.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.62570597, 2023-10-16T13:40:50.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 41, 2023-10-16T13:40:50.477 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 62, 2023-10-16T13:40:50.477 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 62, 2023-10-16T13:40:50.478 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.541164350000001 2023-10-16T13:40:50.478 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:40:50.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc0a406af90 msgr2=0x7fc0a406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc0a406af90 0x7fc0a406d450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009c10 tx=0x7fc0ac008070 comp rx=0 tx=0).stop 2023-10-16T13:40:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 msgr2=0x7fc0b81e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 0x7fc0b81e6550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e9b0 tx=0x7fc0a800ed70 comp rx=0 tx=0).stop 2023-10-16T13:40:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 shutdown_connections 2023-10-16T13:40:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc0a406af90 0x7fc0a406d450 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc0b815dbc0 0x7fc0b80a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80b7050 0x7fc0b815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 --2- 172.21.15.5:0/181648064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b80d3fc0 0x7fc0b81e6550 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 >> 172.21.15.5:0/181648064 conn(0x7fc0b809cb40 msgr2=0x7fc0b80ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 shutdown_connections 2023-10-16T13:40:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.454+0000 7fc0bd53d700 1 -- 172.21.15.5:0/181648064 wait complete. 2023-10-16T13:40:50.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:40:50.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.604+0000 7f7f9a278700 1 Processor -- start 2023-10-16T13:40:50.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f9a278700 1 -- start start 2023-10-16T13:40:50.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f9a278700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f9406af50 0x7f7f940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f9a278700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7f940b28b0 0x7f7f940b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f9a278700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f940b3530 con 0x7f7f9415f130 2023-10-16T13:40:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f9a278700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f940cde00 con 0x7f7f9406af50 2023-10-16T13:40:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f9a278700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f940cd180 con 0x7f7f940b28b0 2023-10-16T13:40:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f937fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f9406af50 0x7f7f940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f93fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7f9415f130 0x7f7f9406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55986/0 (socket says 172.21.15.5:55986) 2023-10-16T13:40:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.605+0000 7f7f93fff700 1 -- 172.21.15.5:0/74971211 learned_addr learned my addr 172.21.15.5:0/74971211 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f98815700 1 --2- 172.21.15.5:0/74971211 >> v2:172.21.15.112:3300/0 conn(0x7f7f940b28b0 0x7f7f940b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f937fe700 1 -- 172.21.15.5:0/74971211 >> v2:172.21.15.112:3300/0 conn(0x7f7f940b28b0 msgr2=0x7f7f940b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f937fe700 1 --2- 172.21.15.5:0/74971211 >> v2:172.21.15.112:3300/0 conn(0x7f7f940b28b0 0x7f7f940b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f937fe700 1 -- 172.21.15.5:0/74971211 >> v1:172.21.15.5:6789/0 conn(0x7f7f9415f130 legacy=0x7f7f9406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f92ffd700 1 -- 172.21.15.5:0/74971211 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090958440 0 0) 0x7f7f940b3530 con 0x7f7f9415f130 2023-10-16T13:40:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f937fe700 1 -- 172.21.15.5:0/74971211 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f940cd460 con 0x7f7f9406af50 2023-10-16T13:40:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f937fe700 1 --2- 172.21.15.5:0/74971211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9406af50 0x7f7f940cede0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7f940d02d0 tx=0x7f7f7c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7386f6e77591e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f92ffd700 1 -- 172.21.15.5:0/74971211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c005e30 con 0x7f7f9406af50 2023-10-16T13:40:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f92ffd700 1 -- 172.21.15.5:0/74971211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c006030 con 0x7f7f9406af50 2023-10-16T13:40:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.606+0000 7f7f92ffd700 1 -- 172.21.15.5:0/74971211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0063c0 con 0x7f7f9406af50 2023-10-16T13:40:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 -- 172.21.15.5:0/74971211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9406af50 msgr2=0x7f7f940cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 --2- 172.21.15.5:0/74971211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9406af50 0x7f7f940cede0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7f940d02d0 tx=0x7f7f7c009b00 comp rx=0 tx=0).stop 2023-10-16T13:40:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 -- 172.21.15.5:0/74971211 shutdown_connections 2023-10-16T13:40:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 --2- 172.21.15.5:0/74971211 >> v2:172.21.15.112:3300/0 conn(0x7f7f940b28b0 0x7f7f940b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 --2- 172.21.15.5:0/74971211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9406af50 0x7f7f940cede0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 -- 172.21.15.5:0/74971211 >> 172.21.15.5:0/74971211 conn(0x7f7f9406dae0 msgr2=0x7f7f9406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 -- 172.21.15.5:0/74971211 shutdown_connections 2023-10-16T13:40:50.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.607+0000 7f7f9a278700 1 -- 172.21.15.5:0/74971211 wait complete. 2023-10-16T13:40:50.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.608+0000 7f7f9a278700 1 Processor -- start 2023-10-16T13:40:50.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.608+0000 7f7f9a278700 1 -- start start 2023-10-16T13:40:50.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f9a278700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7f940b28b0 0x7f7f940c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f9a278700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 0x7f7f940b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f9a278700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f94156580 0x7f7f940c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f9a278700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c7c10 con 0x7f7f9415f130 2023-10-16T13:40:50.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f9a278700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c7ef0 con 0x7f7f94156580 2023-10-16T13:40:50.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f9a278700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c81d0 con 0x7f7f940b28b0 2023-10-16T13:40:50.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 0x7f7f940b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 0x7f7f940b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45988/0 (socket says 172.21.15.5:45988) 2023-10-16T13:40:50.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 -- 172.21.15.5:0/2523314110 learned_addr learned my addr 172.21.15.5:0/2523314110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:50.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f93fff700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7f940b28b0 0x7f7f940c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f98815700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f94156580 0x7f7f940c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 -- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7f940b28b0 msgr2=0x7f7f940c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7f940b28b0 0x7f7f940c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 -- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f94156580 msgr2=0x7f7f940c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f94156580 0x7f7f940c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.609+0000 7f7f937fe700 1 -- 172.21.15.5:0/2523314110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009430 con 0x7f7f9415f130 2023-10-16T13:40:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.610+0000 7f7f937fe700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 0x7f7f940b1b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c012000 tx=0x7f7f7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.610+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c004040 con 0x7f7f9415f130 2023-10-16T13:40:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.610+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c0041a0 con 0x7f7f9415f130 2023-10-16T13:40:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.610+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c004550 con 0x7f7f9415f130 2023-10-16T13:40:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.610+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f940c84b0 con 0x7f7f9415f130 2023-10-16T13:40:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.610+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f94156a30 con 0x7f7f9415f130 2023-10-16T13:40:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.611+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f940c89d0 con 0x7f7f9415f130 2023-10-16T13:40:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.611+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f7f7c022070 con 0x7f7f9415f130 2023-10-16T13:40:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.612+0000 7f7f90ff9700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7f7406af90 0x7f7f7406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.612+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f7c08ac70 con 0x7f7f9415f130 2023-10-16T13:40:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.612+0000 7f7f93fff700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7f7406af90 0x7f7f7406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.613+0000 7f7f93fff700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7f7406af90 0x7f7f7406d450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000f60 tx=0x7f7f84007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:50.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.617+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f940c89d0 con 0x7f7f9415f130 2023-10-16T13:40:50.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.862+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f940c89d0 con 0x7f7f9415f130 2023-10-16T13:40:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.863+0000 7f7f90ff9700 1 -- 172.21.15.5:0/2523314110 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f940c89d0 con 0x7f7f9415f130 2023-10-16T13:40:50.866 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:40:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7f7406af90 msgr2=0x7f7f7406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7f7406af90 0x7f7f7406d450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000f60 tx=0x7f7f84007be0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 msgr2=0x7f7f940b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 0x7f7f940b1b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c012000 tx=0x7f7f7c004750 comp rx=0 tx=0).stop 2023-10-16T13:40:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 shutdown_connections 2023-10-16T13:40:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f94156580 0x7f7f940c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7f7406af90 0x7f7f7406d450 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7f940b28b0 0x7f7f940c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 --2- 172.21.15.5:0/2523314110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9415f130 0x7f7f940b1b00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.865+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 >> 172.21.15.5:0/2523314110 conn(0x7f7f9406dae0 msgr2=0x7f7f940aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.866+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 shutdown_connections 2023-10-16T13:40:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:50.866+0000 7f7f9a278700 1 -- 172.21.15.5:0/2523314110 wait complete. 2023-10-16T13:40:50.880 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:40:50.880 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:40:50.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:40:50.881 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:40:50.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:50.882 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:40:50.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:40:50.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:40:50.883 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:40:50.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:50.884 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:40:50.901 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:40:50.902 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:40:50.902 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:40:50.902 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.902 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:40:50.902 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.903 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:50.903 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:50.903 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:50.903 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:50.903 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:40:50.903 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:50.904 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:40:50.904 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42251sec preferred_lft 42251sec 2023-10-16T13:40:50.904 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:40:50.904 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.904 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:50.905 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:50.905 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:40:50.905 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:50.905 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:40:50.905 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.905 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:40:50.906 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.906 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:50.906 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:40:50.906 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:40:50.906 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.907 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:50.907 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:40:50.907 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:40:50.907 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:50.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:50.908 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:40:50.968 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:40:50.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:50.970 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:40:51.028 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:40:51.028 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:40:51.028 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:40:51.029 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:40:51.029 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:40:51.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:51.029 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:40:51.030 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:40:51.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:40:51.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:40:51.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:40:51.031 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:40:51.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:51.136 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:40:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:40:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:40:51.153 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:40:51.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:51.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:40:51.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:51.221 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:40:51.279 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:51.279 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:51.335 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:40:51.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:51.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:51.422 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:51.422 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:51.454 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:51.454 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:51.455 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:51.455 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:51.455 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:51.456 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:51.456 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:51.456 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:51.527 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:51.528 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:51.528 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:51.528 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:51.529 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:51.529 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:51.529 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:51.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:51.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:40:51.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:40:51.531 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:40:51.532 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:40:51.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:51.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:40:51.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:51.562 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:40:51.650 INFO:teuthology.orchestra.run.smithi005.stdout:client5441 2023-10-16T13:40:51.650 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:51.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:51.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:40:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.830+0000 7f9506b7e700 1 Processor -- start 2023-10-16T13:40:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.830+0000 7f9506b7e700 1 -- start start 2023-10-16T13:40:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f9506b7e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f9506b7e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95000cfc60 0x7f95000cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f9506b7e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950015e7a0 con 0x7f950015ab10 2023-10-16T13:40:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f9506b7e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000d00d0 con 0x7f95000cfc60 2023-10-16T13:40:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f9506b7e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000b29a0 con 0x7f950015f1f0 2023-10-16T13:40:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950511b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95000cfc60 0x7f95000cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950491a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f950015ab10 0x7f95000b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56002/0 (socket says 172.21.15.5:56002) 2023-10-16T13:40:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950491a700 1 -- 172.21.15.5:0/4250275398 learned_addr learned my addr 172.21.15.5:0/4250275398 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f94fffff700 1 --2- 172.21.15.5:0/4250275398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950511b700 1 -- 172.21.15.5:0/4250275398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 msgr2=0x7f95000cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950511b700 1 --2- 172.21.15.5:0/4250275398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950511b700 1 -- 172.21.15.5:0/4250275398 >> v1:172.21.15.5:6789/0 conn(0x7f950015ab10 legacy=0x7f95000b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950511b700 1 -- 172.21.15.5:0/4250275398 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000b2c80 con 0x7f95000cfc60 2023-10-16T13:40:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f94ff7fe700 1 -- 172.21.15.5:0/4250275398 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032372952 0 0) 0x7f950015e7a0 con 0x7f950015ab10 2023-10-16T13:40:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.831+0000 7f950511b700 1 --2- 172.21.15.5:0/4250275398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95000cfc60 0x7f95000cbf40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009d90 tx=0x7f94f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5460f6ef02650b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f94ff7fe700 1 -- 172.21.15.5:0/4250275398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800e070 con 0x7f95000cfc60 2023-10-16T13:40:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f94ff7fe700 1 -- 172.21.15.5:0/4250275398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f800bbd0 con 0x7f95000cfc60 2023-10-16T13:40:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f94ff7fe700 1 -- 172.21.15.5:0/4250275398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8012430 con 0x7f95000cfc60 2023-10-16T13:40:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 -- 172.21.15.5:0/4250275398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95000cfc60 msgr2=0x7f95000cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 --2- 172.21.15.5:0/4250275398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95000cfc60 0x7f95000cbf40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009d90 tx=0x7f94f800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 -- 172.21.15.5:0/4250275398 shutdown_connections 2023-10-16T13:40:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 --2- 172.21.15.5:0/4250275398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95000cfc60 0x7f95000cbf40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 --2- 172.21.15.5:0/4250275398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 -- 172.21.15.5:0/4250275398 >> 172.21.15.5:0/4250275398 conn(0x7f950006dae0 msgr2=0x7f950006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 -- 172.21.15.5:0/4250275398 shutdown_connections 2023-10-16T13:40:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.832+0000 7f9506b7e700 1 -- 172.21.15.5:0/4250275398 wait complete. 2023-10-16T13:40:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.834+0000 7f9506b7e700 1 Processor -- start 2023-10-16T13:40:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.834+0000 7f9506b7e700 1 -- start start 2023-10-16T13:40:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f9506b7e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95000cfc60 0x7f95000c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f9506b7e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 0x7f950015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f9506b7e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f9506b7e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95001f4550 con 0x7f950015ab10 2023-10-16T13:40:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f9506b7e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c6430 con 0x7f95000cfc60 2023-10-16T13:40:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f9506b7e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950015bb90 con 0x7f950015f1f0 2023-10-16T13:40:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 0x7f950015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 0x7f950015aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46006/0 (socket says 172.21.15.5:46006) 2023-10-16T13:40:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 -- 172.21.15.5:0/3127056641 learned_addr learned my addr 172.21.15.5:0/3127056641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f950511b700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f950491a700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95000cfc60 0x7f95000c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 -- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 msgr2=0x7f95000c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 -- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95000cfc60 msgr2=0x7f95000c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95000cfc60 0x7f95000c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f94fffff700 1 -- 172.21.15.5:0/3127056641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009a70 con 0x7f950015ab10 2023-10-16T13:40:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f950491a700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95000cfc60 0x7f95000c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.835+0000 7f950511b700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.836+0000 7f94fffff700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 0x7f950015aef0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e760 tx=0x7f94ec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.836+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec013610 con 0x7f950015ab10 2023-10-16T13:40:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.836+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec013770 con 0x7f950015ab10 2023-10-16T13:40:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.836+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950015d6c0 con 0x7f950015ab10 2023-10-16T13:40:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.836+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec013b20 con 0x7f950015ab10 2023-10-16T13:40:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.836+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950015dc80 con 0x7f950015ab10 2023-10-16T13:40:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.837+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9500067d20 con 0x7f950015ab10 2023-10-16T13:40:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.837+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f94ec013c80 con 0x7f950015ab10 2023-10-16T13:40:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.838+0000 7f94fd7fa700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f94e406af90 0x7f94e406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.838+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94ec088ff0 con 0x7f950015ab10 2023-10-16T13:40:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.838+0000 7f950491a700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f94e406af90 0x7f94e406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.838+0000 7f950491a700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f94e406af90 0x7f94e406d450 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94f4000f60 tx=0x7f94f4007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:51.843+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94ec054030 con 0x7f950015ab10 2023-10-16T13:40:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.090+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95000d0fe0 con 0x7f950015ab10 2023-10-16T13:40:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.090+0000 7f94fd7fa700 1 -- 172.21.15.5:0/3127056641 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94ec057650 con 0x7f950015ab10 2023-10-16T13:40:52.093 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:40:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f94e406af90 msgr2=0x7f94e406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f94e406af90 0x7f94e406d450 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94f4000f60 tx=0x7f94f4007d30 comp rx=0 tx=0).stop 2023-10-16T13:40:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 msgr2=0x7f950015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 0x7f950015aef0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e760 tx=0x7f94ec00eb20 comp rx=0 tx=0).stop 2023-10-16T13:40:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 shutdown_connections 2023-10-16T13:40:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f94e406af90 0x7f94e406d450 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f950015f1f0 0x7f95000c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95000cfc60 0x7f95000c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 --2- 172.21.15.5:0/3127056641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f950015ab10 0x7f950015aef0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 >> 172.21.15.5:0/3127056641 conn(0x7f950006dae0 msgr2=0x7f9500159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 shutdown_connections 2023-10-16T13:40:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:52.093+0000 7f9506b7e700 1 -- 172.21.15.5:0/3127056641 wait complete. 2023-10-16T13:40:52.107 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:40:52.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:40:52.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:40:52.108 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:40:52.109 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:52.109 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:40:52.109 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:40:52.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:40:52.110 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:40:52.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.111 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:40:52.132 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:40:52.132 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:40:52.133 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:40:52.133 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.133 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:40:52.133 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.133 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:52.134 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:52.134 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:52.134 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:52.134 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:40:52.134 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:52.135 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:40:52.135 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:52.135 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:40:52.135 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42266sec preferred_lft 42266sec 2023-10-16T13:40:52.135 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:40:52.135 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.136 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:40:52.136 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:40:52.136 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:40:52.136 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.136 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:40:52.136 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.137 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:52.137 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:40:52.137 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:40:52.137 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.137 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:40:52.138 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:40:52.138 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:40:52.138 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:40:52.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.139 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:40:52.202 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:40:52.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.204 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:40:52.266 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:40:52.266 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:40:52.266 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:40:52.266 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:40:52.267 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:40:52.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.267 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:40:52.268 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:40:52.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:40:52.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:40:52.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:40:52.269 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:40:52.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.377 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:40:52.394 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:40:52.394 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:40:52.394 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:40:52.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.395 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:40:52.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:52.462 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:52.518 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:40:52.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:40:52.519 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:52.575 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:40:52.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:52.661 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:52.661 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:52.688 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:52.689 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:52.689 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:52.689 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:52.689 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:52.690 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:52.690 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:52.690 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:52.719 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:40:52.719 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:40:52.720 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:40:52.720 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:40:52.720 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:40:52.720 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:40:52.721 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:40:52.721 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:40:52.721 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:40:52.721 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:40:52.721 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:40:52.722 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:40:52.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:40:52.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:52.759 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:40:52.830 INFO:teuthology.orchestra.run.smithi112.stdout:client5450 2023-10-16T13:40:52.830 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:40:52.831 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:52.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:40:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.027+0000 7f5d07e8b700 1 Processor -- start 2023-10-16T13:40:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.027+0000 7f5d07e8b700 1 -- start start 2023-10-16T13:40:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d07e8b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d00151680 0x7f5d0015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d07e8b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 0x7f5d0006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d07e8b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000b2e40 con 0x7f5d000727e0 2023-10-16T13:40:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d07e8b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0006e400 con 0x7f5d0006da30 2023-10-16T13:40:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d07e8b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0015e7c0 con 0x7f5d00151680 2023-10-16T13:40:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d06428700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 0x7f5d0006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d05426700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5d000727e0 0x7f5d000b1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:46994/0 (socket says 172.21.15.5:46994) 2023-10-16T13:40:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d05426700 1 -- 172.21.15.5:0/2366141407 learned_addr learned my addr 172.21.15.5:0/2366141407 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d05c27700 1 --2- 172.21.15.5:0/2366141407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d00151680 0x7f5d0015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.028+0000 7f5d06428700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 0x7f5d0006dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46016/0 (socket says 172.21.15.5:46016) 2023-10-16T13:40:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d04c25700 1 -- 172.21.15.5:0/2366141407 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363183684 0 0) 0x7f5cfc001110 con 0x7f5d000727e0 2023-10-16T13:40:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d04c25700 1 -- 172.21.15.5:0/2366141407 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cec0035b0 con 0x7f5d000727e0 2023-10-16T13:40:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d05c27700 1 -- 172.21.15.5:0/2366141407 >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 msgr2=0x7f5d0006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d05c27700 1 --2- 172.21.15.5:0/2366141407 >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 0x7f5d0006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d05c27700 1 -- 172.21.15.5:0/2366141407 >> v1:172.21.15.112:6789/0 conn(0x7f5d000727e0 legacy=0x7f5d000b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d05c27700 1 -- 172.21.15.5:0/2366141407 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000b2620 con 0x7f5d00151680 2023-10-16T13:40:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d06428700 1 --2- 172.21.15.5:0/2366141407 >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 0x7f5d0006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d05c27700 1 --2- 172.21.15.5:0/2366141407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d00151680 0x7f5d0015ec50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009840 tx=0x7f5cf0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d2dc4af3af5ffa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d04c25700 1 -- 172.21.15.5:0/2366141407 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011830 con 0x7f5d00151680 2023-10-16T13:40:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d04c25700 1 -- 172.21.15.5:0/2366141407 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf0011990 con 0x7f5d00151680 2023-10-16T13:40:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.029+0000 7f5d04c25700 1 -- 172.21.15.5:0/2366141407 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011d20 con 0x7f5d00151680 2023-10-16T13:40:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 -- 172.21.15.5:0/2366141407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d00151680 msgr2=0x7f5d0015ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/2366141407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d00151680 0x7f5d0015ec50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009840 tx=0x7f5cf0009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 -- 172.21.15.5:0/2366141407 shutdown_connections 2023-10-16T13:40:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/2366141407 >> v2:172.21.15.5:3300/0 conn(0x7f5d0006da30 0x7f5d0006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/2366141407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d00151680 0x7f5d0015ec50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 -- 172.21.15.5:0/2366141407 >> 172.21.15.5:0/2366141407 conn(0x7f5d0006bd70 msgr2=0x7f5d0006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 -- 172.21.15.5:0/2366141407 shutdown_connections 2023-10-16T13:40:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.030+0000 7f5d07e8b700 1 -- 172.21.15.5:0/2366141407 wait complete. 2023-10-16T13:40:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.031+0000 7f5d07e8b700 1 Processor -- start 2023-10-16T13:40:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.031+0000 7f5d07e8b700 1 -- start start 2023-10-16T13:40:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d07e8b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d0006da30 0x7f5d000c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d07e8b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000727e0 0x7f5d000c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d07e8b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 0x7f5d000b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d07e8b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001f69e0 con 0x7f5d00151680 2023-10-16T13:40:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d07e8b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001f7560 con 0x7f5d000727e0 2023-10-16T13:40:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d07e8b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001f6c30 con 0x7f5d0006da30 2023-10-16T13:40:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 0x7f5d000b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 0x7f5d000b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46022/0 (socket says 172.21.15.5:46022) 2023-10-16T13:40:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 -- 172.21.15.5:0/3616434641 learned_addr learned my addr 172.21.15.5:0/3616434641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d05426700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000727e0 0x7f5d000c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d05c27700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d0006da30 0x7f5d000c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 -- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d0006da30 msgr2=0x7f5d000c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d0006da30 0x7f5d000c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 -- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000727e0 msgr2=0x7f5d000c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000727e0 0x7f5d000c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 -- 172.21.15.5:0/3616434641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8009a70 con 0x7f5d00151680 2023-10-16T13:40:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.032+0000 7f5d06428700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 0x7f5d000b5830 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800efc0 tx=0x7f5cf800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.033+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800ca90 con 0x7f5d00151680 2023-10-16T13:40:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.033+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf800f040 con 0x7f5d00151680 2023-10-16T13:40:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.033+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf00094a0 con 0x7f5d00151680 2023-10-16T13:40:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.033+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800ce10 con 0x7f5d00151680 2023-10-16T13:40:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.033+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d001f71f0 con 0x7f5d00151680 2023-10-16T13:40:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.034+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d00072e10 con 0x7f5d00151680 2023-10-16T13:40:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.034+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f5cf8014480 con 0x7f5d00151680 2023-10-16T13:40:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.035+0000 7f5cf67fc700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406af90 0x7f5ce406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.035+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cf8089d10 con 0x7f5d00151680 2023-10-16T13:40:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.035+0000 7f5d05c27700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406af90 0x7f5ce406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.035+0000 7f5d05c27700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406af90 0x7f5ce406d450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0000c00 tx=0x7f5cf001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.039+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cf8054cc0 con 0x7f5d00151680 2023-10-16T13:40:53.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.286+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d00067d20 con 0x7f5d00151680 2023-10-16T13:40:53.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.871+0000 7f5cf67fc700 1 -- 172.21.15.5:0/3616434641 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5cf8009d70 con 0x7f5d00151680 2023-10-16T13:40:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406af90 msgr2=0x7f5ce406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406af90 0x7f5ce406d450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0000c00 tx=0x7f5cf001c040 comp rx=0 tx=0).stop 2023-10-16T13:40:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 msgr2=0x7f5d000b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 0x7f5d000b5830 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800efc0 tx=0x7f5cf800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 shutdown_connections 2023-10-16T13:40:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d00151680 0x7f5d000b5830 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406af90 0x7f5ce406d450 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d0006da30 0x7f5d000c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 --2- 172.21.15.5:0/3616434641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000727e0 0x7f5d000c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 >> 172.21.15.5:0/3616434641 conn(0x7f5d0006bd70 msgr2=0x7f5d0006af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 shutdown_connections 2023-10-16T13:40:53.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:53.874+0000 7f5d07e8b700 1 -- 172.21.15.5:0/3616434641 wait complete. 2023-10-16T13:40:53.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:40:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.021+0000 7fc1dc886700 1 Processor -- start 2023-10-16T13:40:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.021+0000 7fc1dc886700 1 -- start start 2023-10-16T13:40:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.022+0000 7fc1dc886700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1d815b8b0 0x7fc1d80b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.022+0000 7fc1dc886700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d8072a10 con 0x7fc1d80b4640 2023-10-16T13:40:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.022+0000 7fc1dc886700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d80cdce0 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.022+0000 7fc1dc886700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80b2230 con 0x7fc1d815b8b0 2023-10-16T13:40:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d6d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1d80b4640 0x7fc1d80cd5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56034/0 (socket says 172.21.15.5:56034) 2023-10-16T13:40:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d6d9d700 1 -- 172.21.15.5:0/162966683 learned_addr learned my addr 172.21.15.5:0/162966683 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d659c700 1 --2- 172.21.15.5:0/162966683 >> v2:172.21.15.112:3300/0 conn(0x7fc1d815b8b0 0x7fc1d80b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d559a700 1 -- 172.21.15.5:0/162966683 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617355204 0 0) 0x7fc1d8072a10 con 0x7fc1d80b4640 2023-10-16T13:40:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d559a700 1 -- 172.21.15.5:0/162966683 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c40035b0 con 0x7fc1d80b4640 2023-10-16T13:40:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d659c700 1 -- 172.21.15.5:0/162966683 >> v1:172.21.15.112:6789/0 conn(0x7fc1d80ce3b0 legacy=0x7fc1d80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d659c700 1 -- 172.21.15.5:0/162966683 >> v1:172.21.15.5:6789/0 conn(0x7fc1d80b4640 legacy=0x7fc1d80cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d659c700 1 -- 172.21.15.5:0/162966683 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80b2e90 con 0x7fc1d815b8b0 2023-10-16T13:40:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d659c700 1 --2- 172.21.15.5:0/162966683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815b8b0 0x7fc1d80b2950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009840 tx=0x7fc1c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e4d00d229b06245 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d559a700 1 -- 172.21.15.5:0/162966683 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8011830 con 0x7fc1d815b8b0 2023-10-16T13:40:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d559a700 1 -- 172.21.15.5:0/162966683 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8011990 con 0x7fc1d815b8b0 2023-10-16T13:40:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.023+0000 7fc1d559a700 1 -- 172.21.15.5:0/162966683 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8011d00 con 0x7fc1d815b8b0 2023-10-16T13:40:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 -- 172.21.15.5:0/162966683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815b8b0 msgr2=0x7fc1d80b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 --2- 172.21.15.5:0/162966683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815b8b0 0x7fc1d80b2950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009840 tx=0x7fc1c8009b50 comp rx=0 tx=0).stop 2023-10-16T13:40:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 -- 172.21.15.5:0/162966683 shutdown_connections 2023-10-16T13:40:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 --2- 172.21.15.5:0/162966683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d815b8b0 0x7fc1d80b2950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 -- 172.21.15.5:0/162966683 >> 172.21.15.5:0/162966683 conn(0x7fc1d806dac0 msgr2=0x7fc1d806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 -- 172.21.15.5:0/162966683 shutdown_connections 2023-10-16T13:40:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.024+0000 7fc1dc886700 1 -- 172.21.15.5:0/162966683 wait complete. 2023-10-16T13:40:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.026+0000 7fc1dc886700 1 Processor -- start 2023-10-16T13:40:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.026+0000 7fc1dc886700 1 -- start start 2023-10-16T13:40:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1dc886700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80b4640 0x7fc1d814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1dc886700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 0x7fc1d814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1dc886700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1d815b8b0 0x7fc1d80b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1dc886700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81f1370 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1dc886700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8150560 con 0x7fc1d80b4640 2023-10-16T13:40:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1dc886700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8150840 con 0x7fc1d815b8b0 2023-10-16T13:40:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 0x7fc1d814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 0x7fc1d814fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46034/0 (socket says 172.21.15.5:46034) 2023-10-16T13:40:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 -- 172.21.15.5:0/2500663851 learned_addr learned my addr 172.21.15.5:0/2500663851 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d659c700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80b4640 0x7fc1d814f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d6d9d700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1d815b8b0 0x7fc1d80b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 -- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1d815b8b0 msgr2=0x7fc1d80b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1d815b8b0 0x7fc1d80b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 -- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80b4640 msgr2=0x7fc1d814f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80b4640 0x7fc1d814f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 -- 172.21.15.5:0/2500663851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80094a0 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d659c700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80b4640 0x7fc1d814f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.027+0000 7fc1d5d9b700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 0x7fc1d814fbf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c4e0 tx=0x7fc1c000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.028+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00052d0 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.028+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0005430 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.028+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d8150b20 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.028+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00038c0 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.028+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8150e00 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.029+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d8067d20 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.029+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fc1c0003a20 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.030+0000 7fc1ceffd700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc1b806af90 0x7fc1b806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.030+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1c0088ad0 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.030+0000 7fc1d659c700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc1b806af90 0x7fc1b806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.030+0000 7fc1d659c700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc1b806af90 0x7fc1b806d450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000c00 tx=0x7fc1c8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.034+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1c0053b90 con 0x7fc1d80ce3b0 2023-10-16T13:40:54.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.263+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1d8072170 con 0x7fc1b806af90 2023-10-16T13:40:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.265+0000 7fc1ceffd700 1 -- 172.21.15.5:0/2500663851 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc1c8011730 con 0x7fc1b806af90 2023-10-16T13:40:54.268 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:40:54.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:40:54.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:40:54.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:40:54.269 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:40:54.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.266+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc1b806af90 msgr2=0x7fc1b806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.266+0000 7fc1dc886700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc1b806af90 0x7fc1b806d450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000c00 tx=0x7fc1c8008030 comp rx=0 tx=0).stop 2023-10-16T13:40:54.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.266+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 msgr2=0x7fc1d814fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.266+0000 7fc1dc886700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 0x7fc1d814fbf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c4e0 tx=0x7fc1c000c8a0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 shutdown_connections 2023-10-16T13:40:54.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc1b806af90 0x7fc1b806d450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1d815b8b0 0x7fc1d80b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d80b4640 0x7fc1d814f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 --2- 172.21.15.5:0/2500663851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1d80ce3b0 0x7fc1d814fbf0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 >> 172.21.15.5:0/2500663851 conn(0x7fc1d806dac0 msgr2=0x7fc1d80b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:54.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 shutdown_connections 2023-10-16T13:40:54.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.267+0000 7fc1dc886700 1 -- 172.21.15.5:0/2500663851 wait complete. 2023-10-16T13:40:54.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:40:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.407+0000 7fc90ce8f700 1 Processor -- start 2023-10-16T13:40:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.407+0000 7fc90ce8f700 1 -- start start 2023-10-16T13:40:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90ce8f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc90815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90ce8f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc9080b1f50 0x7fc9080cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90ce8f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90815e7a0 con 0x7fc9080b23d0 2023-10-16T13:40:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90ce8f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90815f730 con 0x7fc9080b1f50 2023-10-16T13:40:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90ce8f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9080b29a0 con 0x7fc90815ab10 2023-10-16T13:40:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc905d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc9080b1f50 0x7fc9080cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90659c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc90815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc906d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc9080b23d0 0x7fc9080cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47022/0 (socket says 172.21.15.5:47022) 2023-10-16T13:40:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc906d9d700 1 -- 172.21.15.5:0/3357305078 learned_addr learned my addr 172.21.15.5:0/3357305078 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90559a700 1 -- 172.21.15.5:0/3357305078 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790000820 0 0) 0x7fc90815e7a0 con 0x7fc9080b23d0 2023-10-16T13:40:54.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90559a700 1 -- 172.21.15.5:0/3357305078 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f00035b0 con 0x7fc9080b23d0 2023-10-16T13:40:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc905d9b700 1 -- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 msgr2=0x7fc90815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc905d9b700 1 --2- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc90815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc905d9b700 1 -- 172.21.15.5:0/3357305078 >> v1:172.21.15.112:6789/0 conn(0x7fc9080b23d0 legacy=0x7fc9080cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc905d9b700 1 -- 172.21.15.5:0/3357305078 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9080b2c80 con 0x7fc9080b1f50 2023-10-16T13:40:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.408+0000 7fc90659c700 1 --2- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc90815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:40:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc905d9b700 1 --2- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc9080cf720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009820 tx=0x7fc8fc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e099e28dadb5ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90559a700 1 -- 172.21.15.5:0/3357305078 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc005e30 con 0x7fc9080b1f50 2023-10-16T13:40:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90559a700 1 -- 172.21.15.5:0/3357305078 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc006030 con 0x7fc9080b1f50 2023-10-16T13:40:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90559a700 1 -- 172.21.15.5:0/3357305078 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0063a0 con 0x7fc9080b1f50 2023-10-16T13:40:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 -- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 msgr2=0x7fc9080cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc9080cf720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009820 tx=0x7fc8fc009b30 comp rx=0 tx=0).stop 2023-10-16T13:40:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 -- 172.21.15.5:0/3357305078 shutdown_connections 2023-10-16T13:40:54.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc90815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/3357305078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc9080cf720 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 -- 172.21.15.5:0/3357305078 >> 172.21.15.5:0/3357305078 conn(0x7fc90806dae0 msgr2=0x7fc90806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:54.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 -- 172.21.15.5:0/3357305078 shutdown_connections 2023-10-16T13:40:54.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.409+0000 7fc90ce8f700 1 -- 172.21.15.5:0/3357305078 wait complete. 2023-10-16T13:40:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.411+0000 7fc90ce8f700 1 Processor -- start 2023-10-16T13:40:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.411+0000 7fc90ce8f700 1 -- start start 2023-10-16T13:40:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.411+0000 7fc90ce8f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc90815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 0x7fc9080ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc908157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9080ae5e0 con 0x7fc9080b23d0 2023-10-16T13:40:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9080ad9d0 con 0x7fc9080b1f50 2023-10-16T13:40:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9080adcb0 con 0x7fc90815ab10 2023-10-16T13:40:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 0x7fc9080ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 0x7fc9080ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2023-10-16T13:40:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 -- 172.21.15.5:0/1841580222 learned_addr learned my addr 172.21.15.5:0/1841580222 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90659c700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc90815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc906d9d700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc908157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 -- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 msgr2=0x7fc908157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc908157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 -- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 msgr2=0x7fc90815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc90815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 -- 172.21.15.5:0/1841580222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80094a0 con 0x7fc9080b23d0 2023-10-16T13:40:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc905d9b700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 0x7fc9080ad2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009b70 tx=0x7fc8fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0063a0 con 0x7fc9080b23d0 2023-10-16T13:40:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc020070 con 0x7fc9080b23d0 2023-10-16T13:40:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc009430 con 0x7fc9080b23d0 2023-10-16T13:40:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc006700 con 0x7fc9080b23d0 2023-10-16T13:40:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.412+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9080ae270 con 0x7fc9080b23d0 2023-10-16T13:40:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.413+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90815e9d0 con 0x7fc9080b23d0 2023-10-16T13:40:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.414+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fc8fc022030 con 0x7fc9080b23d0 2023-10-16T13:40:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.414+0000 7fc8f6ffd700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8e806afc0 0x7fc8e806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.414+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8fc08aac0 con 0x7fc9080b23d0 2023-10-16T13:40:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.414+0000 7fc90659c700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8e806afc0 0x7fc8e806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.415+0000 7fc90659c700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8e806afc0 0x7fc8e806d480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8009d00 tx=0x7fc8f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.419+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc90815e9d0 con 0x7fc9080b23d0 2023-10-16T13:40:54.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.621+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc90815e9d0 con 0x7fc9080b23d0 2023-10-16T13:40:54.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.621+0000 7fc8f6ffd700 1 -- 172.21.15.5:0/1841580222 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc90815e9d0 con 0x7fc9080b23d0 2023-10-16T13:40:54.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.623+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8e806afc0 msgr2=0x7fc8e806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.623+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8e806afc0 0x7fc8e806d480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8009d00 tx=0x7fc8f8008040 comp rx=0 tx=0).stop 2023-10-16T13:40:54.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.623+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 msgr2=0x7fc9080ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.623+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 0x7fc9080ad2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009b70 tx=0x7fc8fc004750 comp rx=0 tx=0).stop 2023-10-16T13:40:54.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 shutdown_connections 2023-10-16T13:40:54.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8e806afc0 0x7fc8e806d480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc90815ab10 0x7fc908157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9080b1f50 0x7fc90815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 --2- 172.21.15.5:0/1841580222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9080b23d0 0x7fc9080ad2c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 >> 172.21.15.5:0/1841580222 conn(0x7fc90806dae0 msgr2=0x7fc9080b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:54.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 shutdown_connections 2023-10-16T13:40:54.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.624+0000 7fc90ce8f700 1 -- 172.21.15.5:0/1841580222 wait complete. 2023-10-16T13:40:54.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000238131 --mode=777 2023-10-16T13:40:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.766+0000 7f2b051d3700 1 Processor -- start 2023-10-16T13:40:54.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.766+0000 7f2b051d3700 1 -- start start 2023-10-16T13:40:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2b051d3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b000727e0 0x7f2b000b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2b051d3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 0x7f2b0006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2b051d3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b000b2e40 con 0x7f2b00151680 2023-10-16T13:40:54.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2b051d3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0006e420 con 0x7f2b000727e0 2023-10-16T13:40:54.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2b051d3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0015e7c0 con 0x7f2b0006da30 2023-10-16T13:40:54.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 0x7f2b0006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 0x7f2b0006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:43960/0 (socket says 172.21.15.5:43960) 2023-10-16T13:40:54.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2afe59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b000727e0 0x7f2b000b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 -- 172.21.15.5:0/535225513 learned_addr learned my addr 172.21.15.5:0/535225513 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2afed9d700 1 --1- 172.21.15.5:0/535225513 >> v1:172.21.15.112:6789/0 conn(0x7f2b00151680 0x7f2b0015ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47032/0 (socket says 172.21.15.5:47032) 2023-10-16T13:40:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2afdd9b700 1 -- 172.21.15.5:0/535225513 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816005899 0 0) 0x7f2af0001110 con 0x7f2b00151680 2023-10-16T13:40:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 -- 172.21.15.5:0/535225513 >> v2:172.21.15.112:3300/0 conn(0x7f2b000727e0 msgr2=0x7f2b000b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 --2- 172.21.15.5:0/535225513 >> v2:172.21.15.112:3300/0 conn(0x7f2b000727e0 0x7f2b000b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 -- 172.21.15.5:0/535225513 >> v1:172.21.15.112:6789/0 conn(0x7f2b00151680 legacy=0x7f2b0015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 -- 172.21.15.5:0/535225513 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000b2880 con 0x7f2b0006da30 2023-10-16T13:40:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.767+0000 7f2aff59e700 1 --2- 172.21.15.5:0/535225513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 0x7f2b0006dee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f302d1412fe88b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2afdd9b700 1 -- 172.21.15.5:0/535225513 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800e070 con 0x7f2b0006da30 2023-10-16T13:40:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2afdd9b700 1 -- 172.21.15.5:0/535225513 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800b910 con 0x7f2b0006da30 2023-10-16T13:40:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2afdd9b700 1 -- 172.21.15.5:0/535225513 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800bcc0 con 0x7f2b0006da30 2023-10-16T13:40:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 -- 172.21.15.5:0/535225513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 msgr2=0x7f2b0006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 --2- 172.21.15.5:0/535225513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 0x7f2b0006dee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af800b330 comp rx=0 tx=0).stop 2023-10-16T13:40:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 -- 172.21.15.5:0/535225513 shutdown_connections 2023-10-16T13:40:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 --2- 172.21.15.5:0/535225513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b0006da30 0x7f2b0006dee0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 --2- 172.21.15.5:0/535225513 >> v2:172.21.15.112:3300/0 conn(0x7f2b000727e0 0x7f2b000b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 -- 172.21.15.5:0/535225513 >> 172.21.15.5:0/535225513 conn(0x7f2b0006bd70 msgr2=0x7f2b0006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:54.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 -- 172.21.15.5:0/535225513 shutdown_connections 2023-10-16T13:40:54.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.768+0000 7f2b051d3700 1 -- 172.21.15.5:0/535225513 wait complete. 2023-10-16T13:40:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.770+0000 7f2b051d3700 1 Processor -- start 2023-10-16T13:40:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.770+0000 7f2b051d3700 1 -- start start 2023-10-16T13:40:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.770+0000 7f2b051d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b0006da30 0x7f2b0014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.770+0000 7f2b051d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 0x7f2b0014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2b051d3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b00151680 0x7f2b000aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2b051d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0014e560 con 0x7f2b000727e0 2023-10-16T13:40:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2b051d3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001f6690 con 0x7f2b0006da30 2023-10-16T13:40:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2b051d3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001f6970 con 0x7f2b00151680 2023-10-16T13:40:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 0x7f2b0014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 0x7f2b0014e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46062/0 (socket says 172.21.15.5:46062) 2023-10-16T13:40:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 -- 172.21.15.5:0/3048010163 learned_addr learned my addr 172.21.15.5:0/3048010163 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afed9d700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b0006da30 0x7f2b0014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2aff59e700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b00151680 0x7f2b000aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 -- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b00151680 msgr2=0x7f2b000aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b00151680 0x7f2b000aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 -- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b0006da30 msgr2=0x7f2b0014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:54.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b0006da30 0x7f2b0014ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:54.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 -- 172.21.15.5:0/3048010163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009b30 con 0x7f2b000727e0 2023-10-16T13:40:54.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2afe59c700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 0x7f2b0014e020 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2af400e9b0 tx=0x7f2af400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4009710 con 0x7f2b000727e0 2023-10-16T13:40:54.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400ee50 con 0x7f2b000727e0 2023-10-16T13:40:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b001f6c50 con 0x7f2b000727e0 2023-10-16T13:40:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400ca50 con 0x7f2b000727e0 2023-10-16T13:40:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.771+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b001f7210 con 0x7f2b000727e0 2023-10-16T13:40:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.773+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b00072e10 con 0x7f2b000727e0 2023-10-16T13:40:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.773+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7f2af400cbb0 con 0x7f2b000727e0 2023-10-16T13:40:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.773+0000 7f2ae77fe700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2aec06af90 0x7f2aec06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.773+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2af40895d0 con 0x7f2b000727e0 2023-10-16T13:40:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.774+0000 7f2afed9d700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2aec06af90 0x7f2aec06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.774+0000 7f2afed9d700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2aec06af90 0x7f2aec06d450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000f60 tx=0x7f2af0007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:54.778+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2af4054610 con 0x7f2b000727e0 2023-10-16T13:40:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.013+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000238131", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b0015e450 con 0x7f2aec06af90 2023-10-16T13:40:55.023 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:55.021+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:55.023 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:55.021+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:55.023 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:55.021+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:55.023 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:55.021+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:55.024 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:40:55.021+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:40:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.055+0000 7f2ae77fe700 1 -- 172.21.15.5:0/3048010163 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2af00049d0 con 0x7f2aec06af90 2023-10-16T13:40:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2aec06af90 msgr2=0x7f2aec06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2aec06af90 0x7f2aec06d450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000f60 tx=0x7f2af0007c20 comp rx=0 tx=0).stop 2023-10-16T13:40:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 msgr2=0x7f2b0014e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 0x7f2b0014e020 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2af400e9b0 tx=0x7f2af400ecc0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 shutdown_connections 2023-10-16T13:40:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2aec06af90 0x7f2aec06d450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b00151680 0x7f2b000aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b0006da30 0x7f2b0014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 --2- 172.21.15.5:0/3048010163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b000727e0 0x7f2b0014e020 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 >> 172.21.15.5:0/3048010163 conn(0x7f2b0006bd70 msgr2=0x7f2b00150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 shutdown_connections 2023-10-16T13:40:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.056+0000 7f2b051d3700 1 -- 172.21.15.5:0/3048010163 wait complete. 2023-10-16T13:40:55.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000238131 2023-10-16T13:40:55.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.196+0000 7fdf93c86700 1 Processor -- start 2023-10-16T13:40:55.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.196+0000 7fdf93c86700 1 -- start start 2023-10-16T13:40:55.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.197+0000 7fdf93c86700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf8c06e750 0x7fdf8c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.197+0000 7fdf93c86700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0b5c70 con 0x7fdf8c0b54f0 2023-10-16T13:40:55.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.197+0000 7fdf93c86700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0b5990 con 0x7fdf8c06eb30 2023-10-16T13:40:55.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.197+0000 7fdf93c86700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c15b2b0 con 0x7fdf8c06e750 2023-10-16T13:40:55.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.197+0000 7fdf92223700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf8c0b54f0 0x7fdf8c15ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56074/0 (socket says 172.21.15.5:56074) 2023-10-16T13:40:55.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.197+0000 7fdf92223700 1 -- 172.21.15.5:0/756418670 learned_addr learned my addr 172.21.15.5:0/756418670 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:40:55.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf91a22700 1 --2- 172.21.15.5:0/756418670 >> v2:172.21.15.112:3300/0 conn(0x7fdf8c06e750 0x7fdf8c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913175368 0 0) 0x7fdf8c0b5c70 con 0x7fdf8c0b54f0 2023-10-16T13:40:55.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf780035b0 con 0x7fdf8c0b54f0 2023-10-16T13:40:55.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798666291 0 0) 0x7fdf780035b0 con 0x7fdf8c0b54f0 2023-10-16T13:40:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 >> v2:172.21.15.112:3300/0 conn(0x7fdf8c06e750 msgr2=0x7fdf8c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 --2- 172.21.15.5:0/756418670 >> v2:172.21.15.112:3300/0 conn(0x7fdf8c06e750 0x7fdf8c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 >> v1:172.21.15.112:6789/0 conn(0x7fdf8c06eb30 legacy=0x7fdf8c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c15b590 con 0x7fdf8c0b54f0 2023-10-16T13:40:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fdf840019f0 con 0x7fdf8c0b54f0 2023-10-16T13:40:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 >> v1:172.21.15.5:6789/0 conn(0x7fdf8c0b54f0 legacy=0x7fdf8c15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78003a00 0x7fdf78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf78004850 0x7fdf78004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf78005210 0x7fdf7800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c15b2b0 con 0x7fdf78005210 2023-10-16T13:40:55.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7800c1b0 con 0x7fdf78004850 2023-10-16T13:40:55.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7800c370 con 0x7fdf78003a00 2023-10-16T13:40:55.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf92223700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf78005210 0x7fdf7800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf91221700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf78004850 0x7fdf78004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf91a22700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78003a00 0x7fdf78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf92223700 1 -- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78003a00 msgr2=0x7fdf78003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:55.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf92223700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78003a00 0x7fdf78003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf92223700 1 -- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf78004850 msgr2=0x7fdf78004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:40:55.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.198+0000 7fdf92223700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf78004850 0x7fdf78004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf92223700 1 -- 172.21.15.5:0/756418670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780035b0 con 0x7fdf78005210 2023-10-16T13:40:55.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf91a22700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78003a00 0x7fdf78003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:40:55.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf92223700 1 -- 172.21.15.5:0/756418670 reap_dead start 2023-10-16T13:40:55.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf92223700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf78005210 0x7fdf7800ba10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400a7f0 tx=0x7fdf78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e639215dc8a2f3e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:55.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400a2f0 con 0x7fdf78005210 2023-10-16T13:40:55.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84012600 con 0x7fdf78005210 2023-10-16T13:40:55.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf90a20700 1 -- 172.21.15.5:0/756418670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840129b0 con 0x7fdf78005210 2023-10-16T13:40:55.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf93c86700 1 -- 172.21.15.5:0/756418670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf78005210 msgr2=0x7fdf7800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf93c86700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf78005210 0x7fdf7800ba10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400a7f0 tx=0x7fdf78005880 comp rx=0 tx=0).stop 2023-10-16T13:40:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf93c86700 1 -- 172.21.15.5:0/756418670 shutdown_connections 2023-10-16T13:40:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf93c86700 1 --2- 172.21.15.5:0/756418670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf78005210 0x7fdf7800ba10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.199+0000 7fdf93c86700 1 -- 172.21.15.5:0/756418670 >> 172.21.15.5:0/756418670 conn(0x7fdf8c0cc6f0 msgr2=0x7fdf8c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.200+0000 7fdf93c86700 1 -- 172.21.15.5:0/756418670 shutdown_connections 2023-10-16T13:40:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.200+0000 7fdf93c86700 1 -- 172.21.15.5:0/756418670 wait complete. 2023-10-16T13:40:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 Processor -- start 2023-10-16T13:40:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 -- start start 2023-10-16T13:40:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78005210 0x7fdf8c0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 0x7fdf8c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf8c15a8d0 0x7fdf8c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0c93d0 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0c7320 con 0x7fdf8c15a8d0 2023-10-16T13:40:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.201+0000 7fdf93c86700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0c7600 con 0x7fdf78005210 2023-10-16T13:40:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 0x7fdf8c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 0x7fdf8c155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46080/0 (socket says 172.21.15.5:46080) 2023-10-16T13:40:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 -- 172.21.15.5:0/4179612775 learned_addr learned my addr 172.21.15.5:0/4179612775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:40:55.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf92223700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf8c15a8d0 0x7fdf8c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91a22700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78005210 0x7fdf8c0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 -- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78005210 msgr2=0x7fdf8c0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78005210 0x7fdf8c0c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 -- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf8c15a8d0 msgr2=0x7fdf8c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf8c15a8d0 0x7fdf8c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 -- 172.21.15.5:0/4179612775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0c8ff0 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf91221700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 0x7fdf8c155e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800f5e0 tx=0x7fdf8800f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880052e0 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88005440 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c15ad50 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880038c0 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.202+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c06dc40 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.203+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c0c9640 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.204+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fdf88003a20 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.204+0000 7fdf827fc700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7006af90 0x7fdf7006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:40:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.204+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf88089130 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.204+0000 7fdf91a22700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7006af90 0x7fdf7006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:40:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.205+0000 7fdf91a22700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7006af90 0x7fdf7006d450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009b40 tx=0x7fdf7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:40:55.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.210+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf88054330 con 0x7fdf8c0c97f0 2023-10-16T13:40:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.443+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000238131", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf8c15b870 con 0x7fdf7006af90 2023-10-16T13:40:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.450+0000 7fdf827fc700 1 -- 172.21.15.5:0/4179612775 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fdf7c013890 con 0x7fdf7006af90 2023-10-16T13:40:55.453 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1 2023-10-16T13:40:55.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7006af90 msgr2=0x7fdf7006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7006af90 0x7fdf7006d450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009b40 tx=0x7fdf7c008040 comp rx=0 tx=0).stop 2023-10-16T13:40:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 msgr2=0x7fdf8c155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:40:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 0x7fdf8c155e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800f5e0 tx=0x7fdf8800f8f0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 shutdown_connections 2023-10-16T13:40:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf8c15a8d0 0x7fdf8c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7006af90 0x7fdf7006d450 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf78005210 0x7fdf8c0c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 --2- 172.21.15.5:0/4179612775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf8c0c97f0 0x7fdf8c155e40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:40:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.451+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 >> 172.21.15.5:0/4179612775 conn(0x7fdf8c0cc6f0 msgr2=0x7fdf8c072150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:40:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.452+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 shutdown_connections 2023-10-16T13:40:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:40:55.452+0000 7fdf93c86700 1 -- 172.21.15.5:0/4179612775 wait complete. 2023-10-16T13:40:55.467 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000238131 with 3000 files each 0MB size under directory volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1 2023-10-16T13:40:55.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:55.468 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:55.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:55.486 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:55.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:55.552 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4885e-05 s, 0.0 kB/s 2023-10-16T13:40:55.552 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:55.552 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:55.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:55.609 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.102e-05 s, 0.0 kB/s 2023-10-16T13:40:55.668 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:55.668 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:55.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:55.725 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3758e-05 s, 0.0 kB/s 2023-10-16T13:40:55.783 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:55.783 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:55.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:55.842 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6551e-05 s, 0.0 kB/s 2023-10-16T13:40:55.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:55.902 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:55.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:55.959 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.017 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8261e-05 s, 0.0 kB/s 2023-10-16T13:40:56.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.074 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3613e-05 s, 0.0 kB/s 2023-10-16T13:40:56.132 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.133 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.190 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0608e-05 s, 0.0 kB/s 2023-10-16T13:40:56.248 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.248 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.305 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3671e-05 s, 0.0 kB/s 2023-10-16T13:40:56.364 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.364 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.421 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.479 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.479 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2838e-05 s, 0.0 kB/s 2023-10-16T13:40:56.479 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.537 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3565e-05 s, 0.0 kB/s 2023-10-16T13:40:56.595 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.596 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.652 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.711 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.2295e-05 s, 0.0 kB/s 2023-10-16T13:40:56.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4766e-05 s, 0.0 kB/s 2023-10-16T13:40:56.827 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.828 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:56.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:56.884 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9597e-05 s, 0.0 kB/s 2023-10-16T13:40:56.944 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:56.944 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.001 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0979e-05 s, 0.0 kB/s 2023-10-16T13:40:57.060 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.060 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.117 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3564e-05 s, 0.0 kB/s 2023-10-16T13:40:57.176 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.176 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.235 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.339e-05 s, 0.0 kB/s 2023-10-16T13:40:57.293 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.293 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.351 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.408 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.408 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.409 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8156e-05 s, 0.0 kB/s 2023-10-16T13:40:57.409 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.409 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.466 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.523 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.523 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.523 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9455e-05 s, 0.0 kB/s 2023-10-16T13:40:57.523 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.524 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:40:57.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:40:57.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.581 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3617e-05 s, 0.0 kB/s 2023-10-16T13:40:57.674 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.674 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.732 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4561e-05 s, 0.0 kB/s 2023-10-16T13:40:57.791 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.792 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.849 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9305e-05 s, 0.0 kB/s 2023-10-16T13:40:57.908 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:57.909 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:57.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:57.966 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8243e-05 s, 0.0 kB/s 2023-10-16T13:40:58.024 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.025 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4655e-05 s, 0.0 kB/s 2023-10-16T13:40:58.141 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.142 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.198 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7252e-05 s, 0.0 kB/s 2023-10-16T13:40:58.258 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.258 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.407 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.407 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4498e-05 s, 0.0 kB/s 2023-10-16T13:40:58.408 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.408 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.466 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.525 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8132e-05 s, 0.0 kB/s 2023-10-16T13:40:58.525 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.525 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.582 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6886e-05 s, 0.0 kB/s 2023-10-16T13:40:58.641 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.641 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8888e-05 s, 0.0 kB/s 2023-10-16T13:40:58.756 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.757 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.813 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0773e-05 s, 0.0 kB/s 2023-10-16T13:40:58.871 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:58.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:58.928 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6192e-05 s, 0.0 kB/s 2023-10-16T13:40:58.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:58.988 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.045 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9375e-05 s, 0.0 kB/s 2023-10-16T13:40:59.104 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.104 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.161 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.219 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3396e-05 s, 0.0 kB/s 2023-10-16T13:40:59.220 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.220 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.277 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.173e-05 s, 0.0 kB/s 2023-10-16T13:40:59.336 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.336 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.393 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9962e-05 s, 0.0 kB/s 2023-10-16T13:40:59.451 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.452 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.508 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0273e-05 s, 0.0 kB/s 2023-10-16T13:40:59.566 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.566 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.623 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.682 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000110524 s, 0.0 kB/s 2023-10-16T13:40:59.683 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.683 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.740 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2856e-05 s, 0.0 kB/s 2023-10-16T13:40:59.800 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.800 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.857 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:40:59.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:40:59.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:40:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1617e-05 s, 0.0 kB/s 2023-10-16T13:40:59.916 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:40:59.916 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:40:59.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:40:59.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9432e-05 s, 0.0 kB/s 2023-10-16T13:41:00.032 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.033 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.090 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.149 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1132e-05 s, 0.0 kB/s 2023-10-16T13:41:00.150 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.150 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.207 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0824e-05 s, 0.0 kB/s 2023-10-16T13:41:00.265 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.266 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.323 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3471e-05 s, 0.0 kB/s 2023-10-16T13:41:00.382 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.382 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9547e-05 s, 0.0 kB/s 2023-10-16T13:41:00.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.498 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.612 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2708e-05 s, 0.0 kB/s 2023-10-16T13:41:00.613 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.613 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3668e-05 s, 0.0 kB/s 2023-10-16T13:41:00.728 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.728 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.785 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0933e-05 s, 0.0 kB/s 2023-10-16T13:41:00.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:00.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:00.901 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3611e-05 s, 0.0 kB/s 2023-10-16T13:41:00.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:00.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.018 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3286e-05 s, 0.0 kB/s 2023-10-16T13:41:01.077 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.134 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.191 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2892e-05 s, 0.0 kB/s 2023-10-16T13:41:01.192 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.192 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.249 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.306 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8305e-05 s, 0.0 kB/s 2023-10-16T13:41:01.307 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.307 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9458e-05 s, 0.0 kB/s 2023-10-16T13:41:01.423 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.424 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.480 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.25e-05 s, 0.0 kB/s 2023-10-16T13:41:01.539 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.539 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.597 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3844e-05 s, 0.0 kB/s 2023-10-16T13:41:01.656 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.656 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.713 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3443e-05 s, 0.0 kB/s 2023-10-16T13:41:01.771 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.772 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.829 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0871e-05 s, 0.0 kB/s 2023-10-16T13:41:01.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:01.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:01.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:01.944 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1778e-05 s, 0.0 kB/s 2023-10-16T13:41:02.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.060 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.118 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.118 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.119 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3453e-05 s, 0.0 kB/s 2023-10-16T13:41:02.119 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.119 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.178 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4255e-05 s, 0.0 kB/s 2023-10-16T13:41:02.234 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.235 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.291 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3245e-05 s, 0.0 kB/s 2023-10-16T13:41:02.351 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.351 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.408 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.484e-05 s, 0.0 kB/s 2023-10-16T13:41:02.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.468 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.527 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.586 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.586 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.586 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9781e-05 s, 0.0 kB/s 2023-10-16T13:41:02.587 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.587 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.644 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3918e-05 s, 0.0 kB/s 2023-10-16T13:41:02.703 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.704 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.761 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0583e-05 s, 0.0 kB/s 2023-10-16T13:41:02.820 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.820 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.877 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3919e-05 s, 0.0 kB/s 2023-10-16T13:41:02.935 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:02.935 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:02.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:02.992 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9845e-05 s, 0.0 kB/s 2023-10-16T13:41:03.050 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.050 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0805e-05 s, 0.0 kB/s 2023-10-16T13:41:03.167 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.168 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.225 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3049e-05 s, 0.0 kB/s 2023-10-16T13:41:03.284 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.284 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.342 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.00012233 s, 0.0 kB/s 2023-10-16T13:41:03.400 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.401 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.456 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2172e-05 s, 0.0 kB/s 2023-10-16T13:41:03.515 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.516 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.573 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.631 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3846e-05 s, 0.0 kB/s 2023-10-16T13:41:03.632 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.633 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.690 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9747e-05 s, 0.0 kB/s 2023-10-16T13:41:03.748 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.748 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.805 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.862 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.863 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.863 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4068e-05 s, 0.0 kB/s 2023-10-16T13:41:03.863 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.864 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:03.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:03.921 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:03.978 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7828e-05 s, 0.0 kB/s 2023-10-16T13:41:03.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:03.980 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.094 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1069e-05 s, 0.0 kB/s 2023-10-16T13:41:04.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.151 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3482e-05 s, 0.0 kB/s 2023-10-16T13:41:04.211 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.211 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.268 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1779e-05 s, 0.0 kB/s 2023-10-16T13:41:04.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.326 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.3871e-05 s, 0.0 kB/s 2023-10-16T13:41:04.444 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.444 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.501 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1442e-05 s, 0.0 kB/s 2023-10-16T13:41:04.561 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.562 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.676 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.676 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.676 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1085e-05 s, 0.0 kB/s 2023-10-16T13:41:04.677 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.677 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.734 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1985e-05 s, 0.0 kB/s 2023-10-16T13:41:04.793 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.850 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:04.908 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000105122 s, 0.0 kB/s 2023-10-16T13:41:04.908 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:04.908 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:04.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:04.965 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1796e-05 s, 0.0 kB/s 2023-10-16T13:41:05.024 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.024 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.081 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9173e-05 s, 0.0 kB/s 2023-10-16T13:41:05.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.140 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.197 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.257 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4445e-05 s, 0.0 kB/s 2023-10-16T13:41:05.257 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.257 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.314 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1245e-05 s, 0.0 kB/s 2023-10-16T13:41:05.373 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.374 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.431 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.490 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.490 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4375e-05 s, 0.0 kB/s 2023-10-16T13:41:05.490 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.491 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.548 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2262e-05 s, 0.0 kB/s 2023-10-16T13:41:05.607 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.608 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.666 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1853e-05 s, 0.0 kB/s 2023-10-16T13:41:05.724 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.725 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.782 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.839 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.839 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.840 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1548e-05 s, 0.0 kB/s 2023-10-16T13:41:05.840 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.840 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:05.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:05.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:05.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:05.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:05.954 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2067e-05 s, 0.0 kB/s 2023-10-16T13:41:05.955 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:05.956 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.013 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0738e-05 s, 0.0 kB/s 2023-10-16T13:41:06.072 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.073 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.130 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.188 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8595e-05 s, 0.0 kB/s 2023-10-16T13:41:06.189 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.189 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.247 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.306 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0597e-05 s, 0.0 kB/s 2023-10-16T13:41:06.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.307 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8635e-05 s, 0.0 kB/s 2023-10-16T13:41:06.422 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.422 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.479 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3795e-05 s, 0.0 kB/s 2023-10-16T13:41:06.537 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.537 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4586e-05 s, 0.0 kB/s 2023-10-16T13:41:06.652 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5395e-05 s, 0.0 kB/s 2023-10-16T13:41:06.768 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.769 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.826 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:06.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:06.884 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7128e-05 s, 0.0 kB/s 2023-10-16T13:41:06.884 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:06.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:06.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:06.941 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.000 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.000 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.000 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2109e-05 s, 0.0 kB/s 2023-10-16T13:41:07.001 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.001 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.116 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.117 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3585e-05 s, 0.0 kB/s 2023-10-16T13:41:07.117 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.174 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.233 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1463e-05 s, 0.0 kB/s 2023-10-16T13:41:07.233 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.233 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.291 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.351 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4111e-05 s, 0.0 kB/s 2023-10-16T13:41:07.351 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.351 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.409 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3209e-05 s, 0.0 kB/s 2023-10-16T13:41:07.467 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.467 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.524 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.034e-05 s, 0.0 kB/s 2023-10-16T13:41:07.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.583 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.699 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2996e-05 s, 0.0 kB/s 2023-10-16T13:41:07.699 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4477e-05 s, 0.0 kB/s 2023-10-16T13:41:07.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.816 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2116e-05 s, 0.0 kB/s 2023-10-16T13:41:07.931 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:07.932 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:07.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:07.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.047 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1832e-05 s, 0.0 kB/s 2023-10-16T13:41:08.047 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.047 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.106 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0751e-05 s, 0.0 kB/s 2023-10-16T13:41:08.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.165 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1361e-05 s, 0.0 kB/s 2023-10-16T13:41:08.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.337 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.395 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0693e-05 s, 0.0 kB/s 2023-10-16T13:41:08.396 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.397 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0969e-05 s, 0.0 kB/s 2023-10-16T13:41:08.513 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.513 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.571 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.629 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.630 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.630 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.6273e-05 s, 0.0 kB/s 2023-10-16T13:41:08.630 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.631 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.688 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.222e-05 s, 0.0 kB/s 2023-10-16T13:41:08.746 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.747 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4967e-05 s, 0.0 kB/s 2023-10-16T13:41:08.861 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.861 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:08.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:08.918 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5328e-05 s, 0.0 kB/s 2023-10-16T13:41:08.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:08.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.035 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.092 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.093 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0403e-05 s, 0.0 kB/s 2023-10-16T13:41:09.093 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.151 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2946e-05 s, 0.0 kB/s 2023-10-16T13:41:09.210 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.210 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.267 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3297e-05 s, 0.0 kB/s 2023-10-16T13:41:09.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.383 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1843e-05 s, 0.0 kB/s 2023-10-16T13:41:09.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.443 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.559 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.559 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7743e-05 s, 0.0 kB/s 2023-10-16T13:41:09.559 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.560 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.617 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.676 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.676 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.676 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.589e-05 s, 0.0 kB/s 2023-10-16T13:41:09.677 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.677 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.734 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4802e-05 s, 0.0 kB/s 2023-10-16T13:41:09.793 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.794 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.851 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3963e-05 s, 0.0 kB/s 2023-10-16T13:41:09.910 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:09.910 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:09.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:09.968 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2115e-05 s, 0.0 kB/s 2023-10-16T13:41:10.027 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.027 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.084 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.143 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2325e-05 s, 0.0 kB/s 2023-10-16T13:41:10.144 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.144 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.201 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7559e-05 s, 0.0 kB/s 2023-10-16T13:41:10.260 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.317 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.376 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2667e-05 s, 0.0 kB/s 2023-10-16T13:41:10.376 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.377 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.433 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.492 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2255e-05 s, 0.0 kB/s 2023-10-16T13:41:10.492 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.493 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.550 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-16T13:41:10.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.671 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1272e-05 s, 0.0 kB/s 2023-10-16T13:41:10.729 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.730 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.845 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.845 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5438e-05 s, 0.0 kB/s 2023-10-16T13:41:10.847 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.847 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:10.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:10.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0311e-05 s, 0.0 kB/s 2023-10-16T13:41:10.964 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:10.964 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.022 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2298e-05 s, 0.0 kB/s 2023-10-16T13:41:11.080 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.081 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3953e-05 s, 0.0 kB/s 2023-10-16T13:41:11.197 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.197 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.254 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5325e-05 s, 0.0 kB/s 2023-10-16T13:41:11.313 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.314 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.429 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.429 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.430 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0934e-05 s, 0.0 kB/s 2023-10-16T13:41:11.430 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.430 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.487 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2478e-05 s, 0.0 kB/s 2023-10-16T13:41:11.547 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.607 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0346e-05 s, 0.0 kB/s 2023-10-16T13:41:11.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.666 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.606e-05 s, 0.0 kB/s 2023-10-16T13:41:11.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.783 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.840 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:11.897 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4692e-05 s, 0.0 kB/s 2023-10-16T13:41:11.898 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:11.899 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:11.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:11.956 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0909e-05 s, 0.0 kB/s 2023-10-16T13:41:12.015 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.016 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.073 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1883e-05 s, 0.0 kB/s 2023-10-16T13:41:12.131 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.131 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.188 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9644e-05 s, 0.0 kB/s 2023-10-16T13:41:12.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.303 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-16T13:41:12.362 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.362 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9596e-05 s, 0.0 kB/s 2023-10-16T13:41:12.477 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.534 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5222e-05 s, 0.0 kB/s 2023-10-16T13:41:12.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.593 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2473e-05 s, 0.0 kB/s 2023-10-16T13:41:12.708 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.709 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.766 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.4937e-05 s, 0.0 kB/s 2023-10-16T13:41:12.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2398e-05 s, 0.0 kB/s 2023-10-16T13:41:12.941 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:12.941 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:12.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:12.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6885e-05 s, 0.0 kB/s 2023-10-16T13:41:13.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.057 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.1832e-05 s, 0.0 kB/s 2023-10-16T13:41:13.172 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.173 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.231 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1697e-05 s, 0.0 kB/s 2023-10-16T13:41:13.289 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.290 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.347 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.405 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.405 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8815e-05 s, 0.0 kB/s 2023-10-16T13:41:13.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.462 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.519 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0771e-05 s, 0.0 kB/s 2023-10-16T13:41:13.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.521 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.578 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4072e-05 s, 0.0 kB/s 2023-10-16T13:41:13.636 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.636 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.752 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.752 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102437 s, 0.0 kB/s 2023-10-16T13:41:13.752 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.752 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.866 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4372e-05 s, 0.0 kB/s 2023-10-16T13:41:13.867 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.868 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:13.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:13.924 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:13.982 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4908e-05 s, 0.0 kB/s 2023-10-16T13:41:13.983 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:13.983 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.041 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2941e-05 s, 0.0 kB/s 2023-10-16T13:41:14.100 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.101 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.157 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.5779e-05 s, 0.0 kB/s 2023-10-16T13:41:14.216 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.217 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.274 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5693e-05 s, 0.0 kB/s 2023-10-16T13:41:14.333 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.333 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.390 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000105241 s, 0.0 kB/s 2023-10-16T13:41:14.449 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.450 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.506 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7605e-05 s, 0.0 kB/s 2023-10-16T13:41:14.564 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.564 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.621 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4332e-05 s, 0.0 kB/s 2023-10-16T13:41:14.681 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.681 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.739 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0152e-05 s, 0.0 kB/s 2023-10-16T13:41:14.797 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.798 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.854 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3729e-05 s, 0.0 kB/s 2023-10-16T13:41:14.913 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:14.914 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:14.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:14.971 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.1199e-05 s, 0.0 kB/s 2023-10-16T13:41:15.030 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.030 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.087 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4158e-05 s, 0.0 kB/s 2023-10-16T13:41:15.146 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.147 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.203 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1738e-05 s, 0.0 kB/s 2023-10-16T13:41:15.262 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.262 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5441e-05 s, 0.0 kB/s 2023-10-16T13:41:15.379 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.380 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000104261 s, 0.0 kB/s 2023-10-16T13:41:15.495 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.496 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.554 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0111e-05 s, 0.0 kB/s 2023-10-16T13:41:15.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.613 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2075e-05 s, 0.0 kB/s 2023-10-16T13:41:15.727 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.728 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1039e-05 s, 0.0 kB/s 2023-10-16T13:41:15.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:15.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:15.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.9107e-05 s, 0.0 kB/s 2023-10-16T13:41:15.958 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:15.959 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.015 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2908e-05 s, 0.0 kB/s 2023-10-16T13:41:16.074 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.075 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2565e-05 s, 0.0 kB/s 2023-10-16T13:41:16.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.190 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.247 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0484e-05 s, 0.0 kB/s 2023-10-16T13:41:16.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.306 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.363 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9892e-05 s, 0.0 kB/s 2023-10-16T13:41:16.421 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.421 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2153e-05 s, 0.0 kB/s 2023-10-16T13:41:16.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.536 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.593 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.651 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5718e-05 s, 0.0 kB/s 2023-10-16T13:41:16.651 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.708 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3741e-05 s, 0.0 kB/s 2023-10-16T13:41:16.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.826 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:16.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:16.884 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3025e-05 s, 0.0 kB/s 2023-10-16T13:41:16.884 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:16.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:16.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:16.942 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4055e-05 s, 0.0 kB/s 2023-10-16T13:41:17.000 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.000 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.057 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.115 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7835e-05 s, 0.0 kB/s 2023-10-16T13:41:17.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.115 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5312e-05 s, 0.0 kB/s 2023-10-16T13:41:17.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.230 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4031e-05 s, 0.0 kB/s 2023-10-16T13:41:17.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.345 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8918e-05 s, 0.0 kB/s 2023-10-16T13:41:17.460 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.460 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.575 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0558e-05 s, 0.0 kB/s 2023-10-16T13:41:17.575 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.575 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.632 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2307e-05 s, 0.0 kB/s 2023-10-16T13:41:17.691 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.691 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.748 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2292e-05 s, 0.0 kB/s 2023-10-16T13:41:17.807 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.808 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.865 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:17.922 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:17.923 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:17.923 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.835e-05 s, 0.0 kB/s 2023-10-16T13:41:17.923 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:17.924 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:17.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:17.980 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.038 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3774e-05 s, 0.0 kB/s 2023-10-16T13:41:18.038 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.039 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.096 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.154 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2551e-05 s, 0.0 kB/s 2023-10-16T13:41:18.154 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.154 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.211 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0877e-05 s, 0.0 kB/s 2023-10-16T13:41:18.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.271 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.385 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.385 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.385 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4599e-05 s, 0.0 kB/s 2023-10-16T13:41:18.386 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.386 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.443 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1706e-05 s, 0.0 kB/s 2023-10-16T13:41:18.502 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.502 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.560 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5559e-05 s, 0.0 kB/s 2023-10-16T13:41:18.619 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.619 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.676 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9835e-05 s, 0.0 kB/s 2023-10-16T13:41:18.735 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.735 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.792 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2271e-05 s, 0.0 kB/s 2023-10-16T13:41:18.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:18.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:18.909 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:18.967 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:18.968 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:18.968 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7818e-05 s, 0.0 kB/s 2023-10-16T13:41:18.968 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:18.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.025 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0231e-05 s, 0.0 kB/s 2023-10-16T13:41:19.084 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.085 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.143 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.200 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2721e-05 s, 0.0 kB/s 2023-10-16T13:41:19.201 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.201 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.258 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3348e-05 s, 0.0 kB/s 2023-10-16T13:41:19.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.317 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.373 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.432 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3238e-05 s, 0.0 kB/s 2023-10-16T13:41:19.432 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.433 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.489 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3275e-05 s, 0.0 kB/s 2023-10-16T13:41:19.547 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2317e-05 s, 0.0 kB/s 2023-10-16T13:41:19.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.662 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.719 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0762e-05 s, 0.0 kB/s 2023-10-16T13:41:19.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.778 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2413e-05 s, 0.0 kB/s 2023-10-16T13:41:19.894 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:19.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:19.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:19.951 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.095e-05 s, 0.0 kB/s 2023-10-16T13:41:20.010 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.011 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.068 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8582e-05 s, 0.0 kB/s 2023-10-16T13:41:20.126 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.127 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.184 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.243 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6571e-05 s, 0.0 kB/s 2023-10-16T13:41:20.244 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.244 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8435e-05 s, 0.0 kB/s 2023-10-16T13:41:20.362 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.362 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0882e-05 s, 0.0 kB/s 2023-10-16T13:41:20.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.478 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.593 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-16T13:41:20.593 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.594 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6695e-05 s, 0.0 kB/s 2023-10-16T13:41:20.709 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.709 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.766 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0775e-05 s, 0.0 kB/s 2023-10-16T13:41:20.824 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.824 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.882 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8871e-05 s, 0.0 kB/s 2023-10-16T13:41:20.942 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:20.942 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:20.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:20.999 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000137197 s, 0.0 kB/s 2023-10-16T13:41:21.058 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.059 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4217e-05 s, 0.0 kB/s 2023-10-16T13:41:21.173 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.174 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.230 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1599e-05 s, 0.0 kB/s 2023-10-16T13:41:21.289 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.289 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.346 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.405 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.181e-05 s, 0.0 kB/s 2023-10-16T13:41:21.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.462 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7465e-05 s, 0.0 kB/s 2023-10-16T13:41:21.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.521 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6166e-05 s, 0.0 kB/s 2023-10-16T13:41:21.636 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.637 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0366e-05 s, 0.0 kB/s 2023-10-16T13:41:21.752 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.753 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3689e-05 s, 0.0 kB/s 2023-10-16T13:41:21.868 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.868 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:21.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:21.925 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7197e-05 s, 0.0 kB/s 2023-10-16T13:41:21.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:21.986 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.043 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6262e-05 s, 0.0 kB/s 2023-10-16T13:41:22.101 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.101 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.158 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3853e-05 s, 0.0 kB/s 2023-10-16T13:41:22.217 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.217 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.274 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.332 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0868e-05 s, 0.0 kB/s 2023-10-16T13:41:22.332 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.333 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.389 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3923e-05 s, 0.0 kB/s 2023-10-16T13:41:22.448 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.449 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.505 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2621e-05 s, 0.0 kB/s 2023-10-16T13:41:22.563 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.564 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3885e-05 s, 0.0 kB/s 2023-10-16T13:41:22.678 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.735 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.793 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.793 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.794 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3867e-05 s, 0.0 kB/s 2023-10-16T13:41:22.794 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.794 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.852 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8322e-05 s, 0.0 kB/s 2023-10-16T13:41:22.910 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:22.910 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:22.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:22.968 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.025 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.026 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.026 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2672e-05 s, 0.0 kB/s 2023-10-16T13:41:23.026 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.027 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.083 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5949e-05 s, 0.0 kB/s 2023-10-16T13:41:23.142 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.143 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.200 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1119e-05 s, 0.0 kB/s 2023-10-16T13:41:23.258 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.259 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.123e-05 s, 0.0 kB/s 2023-10-16T13:41:23.375 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.376 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.431 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9811e-05 s, 0.0 kB/s 2023-10-16T13:41:23.490 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.490 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.547 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-16T13:41:23.606 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.606 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.664 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.723 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.723 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.723 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.1649e-05 s, 0.0 kB/s 2023-10-16T13:41:23.724 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.724 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.1475e-05 s, 0.0 kB/s 2023-10-16T13:41:23.840 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.840 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:23.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:23.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6008e-05 s, 0.0 kB/s 2023-10-16T13:41:23.957 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:23.957 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.015 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.073 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.074 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.074 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5535e-05 s, 0.0 kB/s 2023-10-16T13:41:24.074 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.075 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6935e-05 s, 0.0 kB/s 2023-10-16T13:41:24.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.191 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.248 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3471e-05 s, 0.0 kB/s 2023-10-16T13:41:24.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.306 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.363 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7091e-05 s, 0.0 kB/s 2023-10-16T13:41:24.422 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.422 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.480 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0678e-05 s, 0.0 kB/s 2023-10-16T13:41:24.538 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.538 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.595 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3824e-05 s, 0.0 kB/s 2023-10-16T13:41:24.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.654 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.710 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.769 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.21e-05 s, 0.0 kB/s 2023-10-16T13:41:24.769 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.770 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.826 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6545e-05 s, 0.0 kB/s 2023-10-16T13:41:24.884 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:24.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:24.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:24.943 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6609e-05 s, 0.0 kB/s 2023-10-16T13:41:25.002 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.002 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.060 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1353e-05 s, 0.0 kB/s 2023-10-16T13:41:25.119 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.119 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.176 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-16T13:41:25.234 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.234 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.291 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.348 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7538e-05 s, 0.0 kB/s 2023-10-16T13:41:25.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.407 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3832e-05 s, 0.0 kB/s 2023-10-16T13:41:25.466 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.467 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.525 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.487e-05 s, 0.0 kB/s 2023-10-16T13:41:25.583 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.584 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.640 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0942e-05 s, 0.0 kB/s 2023-10-16T13:41:25.700 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.700 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.757 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.816 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8336e-05 s, 0.0 kB/s 2023-10-16T13:41:25.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4705e-05 s, 0.0 kB/s 2023-10-16T13:41:25.932 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:25.932 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:25.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:25.990 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9281e-05 s, 0.0 kB/s 2023-10-16T13:41:26.048 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.048 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.105 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.3078e-05 s, 0.0 kB/s 2023-10-16T13:41:26.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4138e-05 s, 0.0 kB/s 2023-10-16T13:41:26.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.395 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.395 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.395 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2128e-05 s, 0.0 kB/s 2023-10-16T13:41:26.396 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.396 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.452 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2872e-05 s, 0.0 kB/s 2023-10-16T13:41:26.511 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.511 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1693e-05 s, 0.0 kB/s 2023-10-16T13:41:26.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.684 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8708e-05 s, 0.0 kB/s 2023-10-16T13:41:26.742 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.800 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7355e-05 s, 0.0 kB/s 2023-10-16T13:41:26.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:26.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:26.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:26.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3998e-05 s, 0.0 kB/s 2023-10-16T13:41:26.977 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:26.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.034 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4439e-05 s, 0.0 kB/s 2023-10-16T13:41:27.092 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.093 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.149 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3688e-05 s, 0.0 kB/s 2023-10-16T13:41:27.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.210 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.268 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5966e-05 s, 0.0 kB/s 2023-10-16T13:41:27.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1018e-05 s, 0.0 kB/s 2023-10-16T13:41:27.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.443 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.501 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1645e-05 s, 0.0 kB/s 2023-10-16T13:41:27.560 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.560 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.617 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:27.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5952e-05 s, 0.0 kB/s 2023-10-16T13:41:27.676 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.676 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.774 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2755e-05 s, 0.0 kB/s 2023-10-16T13:41:27.834 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.835 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:27.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:27.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:27.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:27.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:27.951 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7385e-05 s, 0.0 kB/s 2023-10-16T13:41:27.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:27.952 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.009 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.067 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.067 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.067 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8739e-05 s, 0.0 kB/s 2023-10-16T13:41:28.068 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.068 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.126 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8083e-05 s, 0.0 kB/s 2023-10-16T13:41:28.184 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.185 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1323e-05 s, 0.0 kB/s 2023-10-16T13:41:28.303 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.303 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.360 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.418 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9485e-05 s, 0.0 kB/s 2023-10-16T13:41:28.419 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.420 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.477 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5059e-05 s, 0.0 kB/s 2023-10-16T13:41:28.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.537 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3721e-05 s, 0.0 kB/s 2023-10-16T13:41:28.652 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.652 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.468e-05 s, 0.0 kB/s 2023-10-16T13:41:28.768 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.882 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.4831e-05 s, 0.0 kB/s 2023-10-16T13:41:28.883 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:28.884 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:28.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:28.940 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:28.998 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:28.998 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:28.999 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1087e-05 s, 0.0 kB/s 2023-10-16T13:41:28.999 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.000 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.057 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.115 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.116 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.116 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8744e-05 s, 0.0 kB/s 2023-10-16T13:41:29.116 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.174 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4248e-05 s, 0.0 kB/s 2023-10-16T13:41:29.232 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.233 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1736e-05 s, 0.0 kB/s 2023-10-16T13:41:29.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.407 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3334e-05 s, 0.0 kB/s 2023-10-16T13:41:29.466 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.582 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3883e-05 s, 0.0 kB/s 2023-10-16T13:41:29.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.582 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4965e-05 s, 0.0 kB/s 2023-10-16T13:41:29.699 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3601e-05 s, 0.0 kB/s 2023-10-16T13:41:29.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.816 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.872 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:29.930 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3705e-05 s, 0.0 kB/s 2023-10-16T13:41:29.931 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:29.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:29.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:29.989 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.048 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3311e-05 s, 0.0 kB/s 2023-10-16T13:41:30.048 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.048 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.105 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.164 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0871e-05 s, 0.0 kB/s 2023-10-16T13:41:30.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.165 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.278 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4275e-05 s, 0.0 kB/s 2023-10-16T13:41:30.279 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.279 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1908e-05 s, 0.0 kB/s 2023-10-16T13:41:30.394 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.395 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.510 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2318e-05 s, 0.0 kB/s 2023-10-16T13:41:30.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.511 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3811e-05 s, 0.0 kB/s 2023-10-16T13:41:30.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.626 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5412e-05 s, 0.0 kB/s 2023-10-16T13:41:30.743 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.800 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4651e-05 s, 0.0 kB/s 2023-10-16T13:41:30.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:30.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:30.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-16T13:41:30.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:30.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3882e-05 s, 0.0 kB/s 2023-10-16T13:41:31.092 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.092 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.149 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6551e-05 s, 0.0 kB/s 2023-10-16T13:41:31.208 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.267 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3858e-05 s, 0.0 kB/s 2023-10-16T13:41:31.325 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.325 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.382 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1759e-05 s, 0.0 kB/s 2023-10-16T13:41:31.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6669e-05 s, 0.0 kB/s 2023-10-16T13:41:31.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.559 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.673 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.293e-05 s, 0.0 kB/s 2023-10-16T13:41:31.674 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.675 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.732 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4362e-05 s, 0.0 kB/s 2023-10-16T13:41:31.791 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.792 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.849 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3388e-05 s, 0.0 kB/s 2023-10-16T13:41:31.908 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:31.908 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:31.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:31.966 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.024 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2604e-05 s, 0.0 kB/s 2023-10-16T13:41:32.024 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.024 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.081 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3935e-05 s, 0.0 kB/s 2023-10-16T13:41:32.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.139 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.196 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8908e-05 s, 0.0 kB/s 2023-10-16T13:41:32.254 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.312 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.371 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2091e-05 s, 0.0 kB/s 2023-10-16T13:41:32.371 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.372 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.428 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.486 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.486 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.486 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7093e-05 s, 0.0 kB/s 2023-10-16T13:41:32.487 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.487 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.544 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2719e-05 s, 0.0 kB/s 2023-10-16T13:41:32.603 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.604 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.661 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4432e-05 s, 0.0 kB/s 2023-10-16T13:41:32.720 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4597e-05 s, 0.0 kB/s 2023-10-16T13:41:32.836 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.836 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:32.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:32.893 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:32.952 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:32.952 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7031e-05 s, 0.0 kB/s 2023-10-16T13:41:32.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:32.953 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.010 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3555e-05 s, 0.0 kB/s 2023-10-16T13:41:33.068 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.069 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.125 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1793e-05 s, 0.0 kB/s 2023-10-16T13:41:33.184 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.184 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.241 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.299 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5768e-05 s, 0.0 kB/s 2023-10-16T13:41:33.299 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.299 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.356 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0048e-05 s, 0.0 kB/s 2023-10-16T13:41:33.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.363e-05 s, 0.0 kB/s 2023-10-16T13:41:33.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.531 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.588 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.0243e-05 s, 0.0 kB/s 2023-10-16T13:41:33.646 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0995e-05 s, 0.0 kB/s 2023-10-16T13:41:33.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.763 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7992e-05 s, 0.0 kB/s 2023-10-16T13:41:33.879 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.879 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:33.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:33.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:33.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:33.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:33.994 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000146984 s, 0.0 kB/s 2023-10-16T13:41:33.995 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:33.995 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.053 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.111 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1786e-05 s, 0.0 kB/s 2023-10-16T13:41:34.112 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.112 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.169 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.226 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.226 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.227 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3573e-05 s, 0.0 kB/s 2023-10-16T13:41:34.227 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.227 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.284 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.342 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5082e-05 s, 0.0 kB/s 2023-10-16T13:41:34.343 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.343 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.458 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-16T13:41:34.458 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.458 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-16T13:41:34.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.692 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1176e-05 s, 0.0 kB/s 2023-10-16T13:41:34.692 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.749 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.794e-05 s, 0.0 kB/s 2023-10-16T13:41:34.808 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.865 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9068e-05 s, 0.0 kB/s 2023-10-16T13:41:34.925 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:34.925 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:34.982 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8845e-05 s, 0.0 kB/s 2023-10-16T13:41:35.041 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.042 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.098 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2182e-05 s, 0.0 kB/s 2023-10-16T13:41:35.157 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.158 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3524e-05 s, 0.0 kB/s 2023-10-16T13:41:35.274 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.275 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.332 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0125e-05 s, 0.0 kB/s 2023-10-16T13:41:35.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.391 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5198e-05 s, 0.0 kB/s 2023-10-16T13:41:35.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1741e-05 s, 0.0 kB/s 2023-10-16T13:41:35.624 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8973e-05 s, 0.0 kB/s 2023-10-16T13:41:35.741 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.742 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.799 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.857 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1369e-05 s, 0.0 kB/s 2023-10-16T13:41:35.857 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.858 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:35.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:35.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5791e-05 s, 0.0 kB/s 2023-10-16T13:41:35.973 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:35.974 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.032 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-16T13:41:36.091 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.148 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4303e-05 s, 0.0 kB/s 2023-10-16T13:41:36.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.208 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.265 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5123e-05 s, 0.0 kB/s 2023-10-16T13:41:36.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.324 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.381 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.438 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.439 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9215e-05 s, 0.0 kB/s 2023-10-16T13:41:36.440 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.441 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0903e-05 s, 0.0 kB/s 2023-10-16T13:41:36.556 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.613 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0399e-05 s, 0.0 kB/s 2023-10-16T13:41:36.672 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.730 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2606e-05 s, 0.0 kB/s 2023-10-16T13:41:36.788 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.789 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0489e-05 s, 0.0 kB/s 2023-10-16T13:41:36.905 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:36.905 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:36.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:36.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.021 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3718e-05 s, 0.0 kB/s 2023-10-16T13:41:37.022 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2617e-05 s, 0.0 kB/s 2023-10-16T13:41:37.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.140 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.196 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1436e-05 s, 0.0 kB/s 2023-10-16T13:41:37.255 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.312 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1225e-05 s, 0.0 kB/s 2023-10-16T13:41:37.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.371 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3528e-05 s, 0.0 kB/s 2023-10-16T13:41:37.486 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.486 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.543 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4298e-05 s, 0.0 kB/s 2023-10-16T13:41:37.602 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.603 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.660 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.721 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.721 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101334 s, 0.0 kB/s 2023-10-16T13:41:37.722 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.722 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.778 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.837 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5041e-05 s, 0.0 kB/s 2023-10-16T13:41:37.837 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:37.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:37.895 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-16T13:41:37.954 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:37.955 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.012 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.389e-05 s, 0.0 kB/s 2023-10-16T13:41:38.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3322e-05 s, 0.0 kB/s 2023-10-16T13:41:38.186 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.186 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.243 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-16T13:41:38.301 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.301 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.358 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4316e-05 s, 0.0 kB/s 2023-10-16T13:41:38.416 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.417 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.474 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.533 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.2843e-05 s, 0.0 kB/s 2023-10-16T13:41:38.533 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.533 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.590 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6445e-05 s, 0.0 kB/s 2023-10-16T13:41:38.649 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.649 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.708 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0199e-05 s, 0.0 kB/s 2023-10-16T13:41:38.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.824 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.882 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.882 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2319e-05 s, 0.0 kB/s 2023-10-16T13:41:38.882 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.883 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:38.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:38.939 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2929e-05 s, 0.0 kB/s 2023-10-16T13:41:38.998 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:38.999 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.056 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0968e-05 s, 0.0 kB/s 2023-10-16T13:41:39.114 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.115 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.171 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4597e-05 s, 0.0 kB/s 2023-10-16T13:41:39.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.230 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6635e-05 s, 0.0 kB/s 2023-10-16T13:41:39.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.346 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3794e-05 s, 0.0 kB/s 2023-10-16T13:41:39.461 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.461 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.518 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101838 s, 0.0 kB/s 2023-10-16T13:41:39.577 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.578 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9404e-05 s, 0.0 kB/s 2023-10-16T13:41:39.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.694 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.751 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0892e-05 s, 0.0 kB/s 2023-10-16T13:41:39.810 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.811 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.868 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3541e-05 s, 0.0 kB/s 2023-10-16T13:41:39.927 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:39.927 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:39.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:39.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3502e-05 s, 0.0 kB/s 2023-10-16T13:41:40.044 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.045 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.160 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2741e-05 s, 0.0 kB/s 2023-10-16T13:41:40.160 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.160 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.276 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5369e-05 s, 0.0 kB/s 2023-10-16T13:41:40.276 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.277 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.334 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4549e-05 s, 0.0 kB/s 2023-10-16T13:41:40.393 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.393 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.450 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0232e-05 s, 0.0 kB/s 2023-10-16T13:41:40.508 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.566 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7415e-05 s, 0.0 kB/s 2023-10-16T13:41:40.624 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.682 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4289e-05 s, 0.0 kB/s 2023-10-16T13:41:40.741 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.741 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3746e-05 s, 0.0 kB/s 2023-10-16T13:41:40.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:40.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:40.913 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6158e-05 s, 0.0 kB/s 2023-10-16T13:41:40.972 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:40.973 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.030 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.088 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.088 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.089 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8351e-05 s, 0.0 kB/s 2023-10-16T13:41:41.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.090 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.148 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5164e-05 s, 0.0 kB/s 2023-10-16T13:41:41.206 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.263 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.322 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.322 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101975 s, 0.0 kB/s 2023-10-16T13:41:41.322 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.323 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.439 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5795e-05 s, 0.0 kB/s 2023-10-16T13:41:41.439 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.439 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.496 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6332e-05 s, 0.0 kB/s 2023-10-16T13:41:41.556 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.613 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3374e-05 s, 0.0 kB/s 2023-10-16T13:41:41.672 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.730 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8082e-05 s, 0.0 kB/s 2023-10-16T13:41:41.788 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.788 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.845 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2595e-05 s, 0.0 kB/s 2023-10-16T13:41:41.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:41.904 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:41.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:41.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.020 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.020 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4968e-05 s, 0.0 kB/s 2023-10-16T13:41:42.021 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.021 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.077 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4399e-05 s, 0.0 kB/s 2023-10-16T13:41:42.135 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.135 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.192 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102548 s, 0.0 kB/s 2023-10-16T13:41:42.250 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.251 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.308 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9654e-05 s, 0.0 kB/s 2023-10-16T13:41:42.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.366 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.423 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4505e-05 s, 0.0 kB/s 2023-10-16T13:41:42.481 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.481 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.538 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.595 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3737e-05 s, 0.0 kB/s 2023-10-16T13:41:42.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.596 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.653 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.710 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8368e-05 s, 0.0 kB/s 2023-10-16T13:41:42.711 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.768 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.826 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9447e-05 s, 0.0 kB/s 2023-10-16T13:41:42.826 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.826 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:42.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:42.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:42.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:42.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:42.942 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4065e-05 s, 0.0 kB/s 2023-10-16T13:41:42.943 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:42.943 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.000 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9286e-05 s, 0.0 kB/s 2023-10-16T13:41:43.059 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.060 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.116 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5309e-05 s, 0.0 kB/s 2023-10-16T13:41:43.174 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.174 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.231 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.154e-05 s, 0.0 kB/s 2023-10-16T13:41:43.290 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.291 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.347 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-16T13:41:43.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.462 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1482e-05 s, 0.0 kB/s 2023-10-16T13:41:43.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.520 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3481e-05 s, 0.0 kB/s 2023-10-16T13:41:43.636 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.637 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.694 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.752 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.6043e-05 s, 0.0 kB/s 2023-10-16T13:41:43.752 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.753 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.810 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.301e-05 s, 0.0 kB/s 2023-10-16T13:41:43.869 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.870 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:43.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:43.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:43.985 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4532e-05 s, 0.0 kB/s 2023-10-16T13:41:43.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:43.986 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.043 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4832e-05 s, 0.0 kB/s 2023-10-16T13:41:44.101 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.102 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.158 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6552e-05 s, 0.0 kB/s 2023-10-16T13:41:44.217 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.217 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.274 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3344e-05 s, 0.0 kB/s 2023-10-16T13:41:44.333 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.333 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.390 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.447 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.448 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7711e-05 s, 0.0 kB/s 2023-10-16T13:41:44.448 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.449 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.505 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-16T13:41:44.565 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.565 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.623 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100475 s, 0.0 kB/s 2023-10-16T13:41:44.682 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.682 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.740 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.797 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.797 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5558e-05 s, 0.0 kB/s 2023-10-16T13:41:44.799 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.799 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.857 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.327e-05 s, 0.0 kB/s 2023-10-16T13:41:44.916 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:44.916 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:44.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:44.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7902e-05 s, 0.0 kB/s 2023-10-16T13:41:45.033 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.034 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.092 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.150 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6666e-05 s, 0.0 kB/s 2023-10-16T13:41:45.150 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.151 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.207 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1789e-05 s, 0.0 kB/s 2023-10-16T13:41:45.266 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.267 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.383 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.383 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1152e-05 s, 0.0 kB/s 2023-10-16T13:41:45.383 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.384 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.440 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.1128e-05 s, 0.0 kB/s 2023-10-16T13:41:45.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.499 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.556 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5572e-05 s, 0.0 kB/s 2023-10-16T13:41:45.615 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.616 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.672 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9523e-05 s, 0.0 kB/s 2023-10-16T13:41:45.732 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.732 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.789 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.848 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.848 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6132e-05 s, 0.0 kB/s 2023-10-16T13:41:45.848 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.849 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:45.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:45.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5508e-05 s, 0.0 kB/s 2023-10-16T13:41:45.964 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:45.965 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.021 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.080 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2382e-05 s, 0.0 kB/s 2023-10-16T13:41:46.081 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.081 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.361e-05 s, 0.0 kB/s 2023-10-16T13:41:46.196 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.197 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.253 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.058e-05 s, 0.0 kB/s 2023-10-16T13:41:46.312 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.313 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2662e-05 s, 0.0 kB/s 2023-10-16T13:41:46.427 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.428 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.484 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2276e-05 s, 0.0 kB/s 2023-10-16T13:41:46.543 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.603 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5896e-05 s, 0.0 kB/s 2023-10-16T13:41:46.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.662 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.719 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1948e-05 s, 0.0 kB/s 2023-10-16T13:41:46.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.778 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.835 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5908e-05 s, 0.0 kB/s 2023-10-16T13:41:46.894 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:46.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:46.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:46.952 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2165e-05 s, 0.0 kB/s 2023-10-16T13:41:47.011 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.012 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.068 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2825e-05 s, 0.0 kB/s 2023-10-16T13:41:47.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.128 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.186 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1116e-05 s, 0.0 kB/s 2023-10-16T13:41:47.244 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.244 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.301 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.360 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8101e-05 s, 0.0 kB/s 2023-10-16T13:41:47.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.360 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.417 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4579e-05 s, 0.0 kB/s 2023-10-16T13:41:47.475 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.476 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.532 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1344e-05 s, 0.0 kB/s 2023-10-16T13:41:47.590 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.590 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.648 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9082e-05 s, 0.0 kB/s 2023-10-16T13:41:47.707 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.707 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.764 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1928e-05 s, 0.0 kB/s 2023-10-16T13:41:47.823 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.824 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2746e-05 s, 0.0 kB/s 2023-10-16T13:41:47.939 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:47.940 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:47.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:47.996 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-16T13:41:48.055 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.112 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3622e-05 s, 0.0 kB/s 2023-10-16T13:41:48.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.229 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3128e-05 s, 0.0 kB/s 2023-10-16T13:41:48.288 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.288 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.346 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5006e-05 s, 0.0 kB/s 2023-10-16T13:41:48.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.463 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.521 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.521 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0215e-05 s, 0.0 kB/s 2023-10-16T13:41:48.521 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.522 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.579 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6079e-05 s, 0.0 kB/s 2023-10-16T13:41:48.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.638 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.694 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.752 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.753 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.753 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0788e-05 s, 0.0 kB/s 2023-10-16T13:41:48.753 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.753 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.810 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.9204e-05 s, 0.0 kB/s 2023-10-16T13:41:48.869 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.869 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:48.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:48.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2119e-05 s, 0.0 kB/s 2023-10-16T13:41:48.984 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:48.984 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.042 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.100 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.8628e-05 s, 0.0 kB/s 2023-10-16T13:41:49.100 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.157 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.214 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.215 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2874e-05 s, 0.0 kB/s 2023-10-16T13:41:49.215 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.216 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.273 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2555e-05 s, 0.0 kB/s 2023-10-16T13:41:49.333 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.333 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.390 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.448 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0106e-05 s, 0.0 kB/s 2023-10-16T13:41:49.448 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.448 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.505 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1451e-05 s, 0.0 kB/s 2023-10-16T13:41:49.564 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.565 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.621 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2469e-05 s, 0.0 kB/s 2023-10-16T13:41:49.681 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.681 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.739 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0472e-05 s, 0.0 kB/s 2023-10-16T13:41:49.797 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.797 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.854 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.464e-05 s, 0.0 kB/s 2023-10-16T13:41:49.913 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:49.914 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:49.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:49.971 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.029 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.029 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1156e-05 s, 0.0 kB/s 2023-10-16T13:41:50.029 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.030 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.086 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1414e-05 s, 0.0 kB/s 2023-10-16T13:41:50.143 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.144 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.201 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.258 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.259 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1508e-05 s, 0.0 kB/s 2023-10-16T13:41:50.259 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.316 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.374 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.375 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3238e-05 s, 0.0 kB/s 2023-10-16T13:41:50.375 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.376 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.432 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2916e-05 s, 0.0 kB/s 2023-10-16T13:41:50.490 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.490 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.547 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2551e-05 s, 0.0 kB/s 2023-10-16T13:41:50.605 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.606 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.662 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8919e-05 s, 0.0 kB/s 2023-10-16T13:41:50.720 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.835 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4127e-05 s, 0.0 kB/s 2023-10-16T13:41:50.835 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.836 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:50.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:50.894 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4808e-05 s, 0.0 kB/s 2023-10-16T13:41:50.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:50.952 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.011 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.068 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8645e-05 s, 0.0 kB/s 2023-10-16T13:41:51.069 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.070 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.185 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3869e-05 s, 0.0 kB/s 2023-10-16T13:41:51.185 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.186 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.242 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.301 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9818e-05 s, 0.0 kB/s 2023-10-16T13:41:51.302 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.302 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.359 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.417 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3376e-05 s, 0.0 kB/s 2023-10-16T13:41:51.418 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.419 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.475 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.534 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.534 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5526e-05 s, 0.0 kB/s 2023-10-16T13:41:51.534 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.535 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.591 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2347e-05 s, 0.0 kB/s 2023-10-16T13:41:51.651 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.708 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5099e-05 s, 0.0 kB/s 2023-10-16T13:41:51.768 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.828 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:51.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:51.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:51.886 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-16T13:41:51.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:51.887 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:51.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:51.944 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7459e-05 s, 0.0 kB/s 2023-10-16T13:41:52.004 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9485e-05 s, 0.0 kB/s 2023-10-16T13:41:52.120 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.120 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.177 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4296e-05 s, 0.0 kB/s 2023-10-16T13:41:52.236 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.237 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.293 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.351 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.351 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.351 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-16T13:41:52.351 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.352 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.409 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1599e-05 s, 0.0 kB/s 2023-10-16T13:41:52.467 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.467 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.524 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.583 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.583 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0139e-05 s, 0.0 kB/s 2023-10-16T13:41:52.583 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.584 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.640 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.699 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2858e-05 s, 0.0 kB/s 2023-10-16T13:41:52.699 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.757 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.816 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5479e-05 s, 0.0 kB/s 2023-10-16T13:41:52.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1795e-05 s, 0.0 kB/s 2023-10-16T13:41:52.932 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:52.933 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:52.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:52.990 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2082e-05 s, 0.0 kB/s 2023-10-16T13:41:53.048 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.049 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.105 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4658e-05 s, 0.0 kB/s 2023-10-16T13:41:53.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1423e-05 s, 0.0 kB/s 2023-10-16T13:41:53.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6559e-05 s, 0.0 kB/s 2023-10-16T13:41:53.397 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.397 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.513 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.2968e-05 s, 0.0 kB/s 2023-10-16T13:41:53.513 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.513 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.571 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.629 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.629 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5857e-05 s, 0.0 kB/s 2023-10-16T13:41:53.629 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.630 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.686 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2505e-05 s, 0.0 kB/s 2023-10-16T13:41:53.746 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.746 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.862 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.862 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9511e-05 s, 0.0 kB/s 2023-10-16T13:41:53.862 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.863 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:53.920 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:53.978 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:53.978 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:53.978 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1989e-05 s, 0.0 kB/s 2023-10-16T13:41:53.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:53.979 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000108281 s, 0.0 kB/s 2023-10-16T13:41:54.095 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.095 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.152 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.0883e-05 s, 0.0 kB/s 2023-10-16T13:41:54.210 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.211 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.267 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8961e-05 s, 0.0 kB/s 2023-10-16T13:41:54.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.383 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.273e-05 s, 0.0 kB/s 2023-10-16T13:41:54.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.443 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0988e-05 s, 0.0 kB/s 2023-10-16T13:41:54.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.558 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.674 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1835e-05 s, 0.0 kB/s 2023-10-16T13:41:54.674 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.675 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.731 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.789 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8929e-05 s, 0.0 kB/s 2023-10-16T13:41:54.790 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.847 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:54.905 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:54.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:54.906 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2026e-05 s, 0.0 kB/s 2023-10-16T13:41:54.907 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:54.907 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:54.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:54.963 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2481e-05 s, 0.0 kB/s 2023-10-16T13:41:55.022 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.079 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.137 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.137 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0304e-05 s, 0.0 kB/s 2023-10-16T13:41:55.138 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.138 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.195 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.253 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0877e-05 s, 0.0 kB/s 2023-10-16T13:41:55.254 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4968e-05 s, 0.0 kB/s 2023-10-16T13:41:55.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.370 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0153e-05 s, 0.0 kB/s 2023-10-16T13:41:55.485 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.486 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.543 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1708e-05 s, 0.0 kB/s 2023-10-16T13:41:55.601 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.659 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1616e-05 s, 0.0 kB/s 2023-10-16T13:41:55.717 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.718 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.775 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0008e-05 s, 0.0 kB/s 2023-10-16T13:41:55.834 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.835 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:55.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:55.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5878e-05 s, 0.0 kB/s 2023-10-16T13:41:55.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:55.952 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.009 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.24e-05 s, 0.0 kB/s 2023-10-16T13:41:56.068 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.069 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.125 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2011e-05 s, 0.0 kB/s 2023-10-16T13:41:56.184 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.185 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.241 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.299 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0984e-05 s, 0.0 kB/s 2023-10-16T13:41:56.299 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.299 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.356 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2038e-05 s, 0.0 kB/s 2023-10-16T13:41:56.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.414 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.530 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3828e-05 s, 0.0 kB/s 2023-10-16T13:41:56.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.531 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.591 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.649 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.649 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7457e-05 s, 0.0 kB/s 2023-10-16T13:41:56.649 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.650 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.707 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4761e-05 s, 0.0 kB/s 2023-10-16T13:41:56.766 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.767 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.824 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4918e-05 s, 0.0 kB/s 2023-10-16T13:41:56.883 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:56.884 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:56.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:56.940 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:56.998 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:56.999 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:56.999 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1288e-05 s, 0.0 kB/s 2023-10-16T13:41:56.999 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.000 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.056 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2193e-05 s, 0.0 kB/s 2023-10-16T13:41:57.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.115 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.230 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6032e-05 s, 0.0 kB/s 2023-10-16T13:41:57.233 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.233 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.288 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4714e-05 s, 0.0 kB/s 2023-10-16T13:41:57.346 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.346 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2302e-05 s, 0.0 kB/s 2023-10-16T13:41:57.462 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.520 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1568e-05 s, 0.0 kB/s 2023-10-16T13:41:57.578 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.579 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1783e-05 s, 0.0 kB/s 2023-10-16T13:41:57.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.695 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:57.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:57.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.753 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.789e-05 s, 0.0 kB/s 2023-10-16T13:41:57.811 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.812 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.882 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:57.939 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:57.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:57.940 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1856e-05 s, 0.0 kB/s 2023-10-16T13:41:57.940 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:57.941 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:57.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:57.997 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1647e-05 s, 0.0 kB/s 2023-10-16T13:41:58.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8439e-05 s, 0.0 kB/s 2023-10-16T13:41:58.172 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.229 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.288 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4536e-05 s, 0.0 kB/s 2023-10-16T13:41:58.288 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.288 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.345 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4554e-05 s, 0.0 kB/s 2023-10-16T13:41:58.404 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.404 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.462 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-16T13:41:58.521 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.521 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.578 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1786e-05 s, 0.0 kB/s 2023-10-16T13:41:58.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.638 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.753 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.754 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7273e-05 s, 0.0 kB/s 2023-10-16T13:41:58.754 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.754 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.811 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.1435e-05 s, 0.0 kB/s 2023-10-16T13:41:58.870 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:58.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:58.928 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4072e-05 s, 0.0 kB/s 2023-10-16T13:41:58.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:58.987 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.044 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5344e-05 s, 0.0 kB/s 2023-10-16T13:41:59.103 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.103 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.160 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8078e-05 s, 0.0 kB/s 2023-10-16T13:41:59.219 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.219 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.277 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9859e-05 s, 0.0 kB/s 2023-10-16T13:41:59.337 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.337 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.394 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3358e-05 s, 0.0 kB/s 2023-10-16T13:41:59.452 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.452 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.510 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9814e-05 s, 0.0 kB/s 2023-10-16T13:41:59.568 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.568 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.625 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1429e-05 s, 0.0 kB/s 2023-10-16T13:41:59.684 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.685 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.742 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4452e-05 s, 0.0 kB/s 2023-10-16T13:41:59.801 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.801 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.859 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:41:59.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:41:59.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:41:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.112e-05 s, 0.0 kB/s 2023-10-16T13:41:59.919 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:41:59.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:41:59.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:41:59.977 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.034 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1075e-05 s, 0.0 kB/s 2023-10-16T13:42:00.035 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.035 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.092 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3675e-05 s, 0.0 kB/s 2023-10-16T13:42:00.151 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.210 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.268 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.268 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.268 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5629e-05 s, 0.0 kB/s 2023-10-16T13:42:00.269 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.269 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.326 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.387e-05 s, 0.0 kB/s 2023-10-16T13:42:00.385 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.386 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.444 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.501 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4073e-05 s, 0.0 kB/s 2023-10-16T13:42:00.502 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.502 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.559 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3955e-05 s, 0.0 kB/s 2023-10-16T13:42:00.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.619 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.676 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1925e-05 s, 0.0 kB/s 2023-10-16T13:42:00.735 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.735 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.792 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.850 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1472e-05 s, 0.0 kB/s 2023-10-16T13:42:00.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:00.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:00.908 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-16T13:42:00.967 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:00.968 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.025 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4188e-05 s, 0.0 kB/s 2023-10-16T13:42:01.083 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.084 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.140 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9182e-05 s, 0.0 kB/s 2023-10-16T13:42:01.199 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.199 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.182e-05 s, 0.0 kB/s 2023-10-16T13:42:01.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.317 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.374 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3685e-05 s, 0.0 kB/s 2023-10-16T13:42:01.432 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.432 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.489 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000114041 s, 0.0 kB/s 2023-10-16T13:42:01.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.548 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.608 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.666 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7426e-05 s, 0.0 kB/s 2023-10-16T13:42:01.667 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.667 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.725 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3571e-05 s, 0.0 kB/s 2023-10-16T13:42:01.786 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.786 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.843 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2251e-05 s, 0.0 kB/s 2023-10-16T13:42:01.902 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:01.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:01.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:01.959 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2643e-05 s, 0.0 kB/s 2023-10-16T13:42:02.018 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.019 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3869e-05 s, 0.0 kB/s 2023-10-16T13:42:02.134 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.135 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.192 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2247e-05 s, 0.0 kB/s 2023-10-16T13:42:02.252 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.252 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.308 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1229e-05 s, 0.0 kB/s 2023-10-16T13:42:02.367 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.482 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6104e-05 s, 0.0 kB/s 2023-10-16T13:42:02.483 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.541 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1408e-05 s, 0.0 kB/s 2023-10-16T13:42:02.599 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.599 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.656 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3914e-05 s, 0.0 kB/s 2023-10-16T13:42:02.715 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.716 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.774 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1207e-05 s, 0.0 kB/s 2023-10-16T13:42:02.833 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.833 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:02.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:02.890 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:02.948 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.146e-05 s, 0.0 kB/s 2023-10-16T13:42:02.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:02.948 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.005 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.064 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3472e-05 s, 0.0 kB/s 2023-10-16T13:42:03.065 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.065 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.122 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.180 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2451e-05 s, 0.0 kB/s 2023-10-16T13:42:03.181 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.182 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.238 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5425e-05 s, 0.0 kB/s 2023-10-16T13:42:03.297 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.298 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4024e-05 s, 0.0 kB/s 2023-10-16T13:42:03.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5572e-05 s, 0.0 kB/s 2023-10-16T13:42:03.530 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.531 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.587 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1953e-05 s, 0.0 kB/s 2023-10-16T13:42:03.645 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.646 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.702 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2375e-05 s, 0.0 kB/s 2023-10-16T13:42:03.762 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.762 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.819 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.878 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4631e-05 s, 0.0 kB/s 2023-10-16T13:42:03.878 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.879 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:03.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:03.935 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2145e-05 s, 0.0 kB/s 2023-10-16T13:42:03.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:03.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.051 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4858e-05 s, 0.0 kB/s 2023-10-16T13:42:04.110 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.111 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.168 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2884e-05 s, 0.0 kB/s 2023-10-16T13:42:04.226 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.226 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.283 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0958e-05 s, 0.0 kB/s 2023-10-16T13:42:04.342 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.343 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.399 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5701e-05 s, 0.0 kB/s 2023-10-16T13:42:04.457 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.458 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.514 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-16T13:42:04.572 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.573 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.629 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0681e-05 s, 0.0 kB/s 2023-10-16T13:42:04.687 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.687 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.744 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.802 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.803 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.803 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9891e-05 s, 0.0 kB/s 2023-10-16T13:42:04.803 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.804 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.860 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:04.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:04.918 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4002e-05 s, 0.0 kB/s 2023-10-16T13:42:04.919 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:04.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:04.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:04.977 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1919e-05 s, 0.0 kB/s 2023-10-16T13:42:05.036 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.037 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.093 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8741e-05 s, 0.0 kB/s 2023-10-16T13:42:05.152 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.209 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1195e-05 s, 0.0 kB/s 2023-10-16T13:42:05.267 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.268 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.325 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3969e-05 s, 0.0 kB/s 2023-10-16T13:42:05.384 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.384 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.441 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1528e-05 s, 0.0 kB/s 2023-10-16T13:42:05.499 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.500 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.557 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3238e-05 s, 0.0 kB/s 2023-10-16T13:42:05.617 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.617 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.675 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.505e-05 s, 0.0 kB/s 2023-10-16T13:42:05.734 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.735 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.791 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2029e-05 s, 0.0 kB/s 2023-10-16T13:42:05.850 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.851 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:05.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:05.907 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5952e-05 s, 0.0 kB/s 2023-10-16T13:42:05.965 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:05.966 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.642e-05 s, 0.0 kB/s 2023-10-16T13:42:06.082 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.082 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.139 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100688 s, 0.0 kB/s 2023-10-16T13:42:06.198 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.199 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3769e-05 s, 0.0 kB/s 2023-10-16T13:42:06.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.315 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8664e-05 s, 0.0 kB/s 2023-10-16T13:42:06.430 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.431 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1184e-05 s, 0.0 kB/s 2023-10-16T13:42:06.546 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.603 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4962e-05 s, 0.0 kB/s 2023-10-16T13:42:06.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.663 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.720 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2603e-05 s, 0.0 kB/s 2023-10-16T13:42:06.779 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.779 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:06.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:06.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:06.895 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2849e-05 s, 0.0 kB/s 2023-10-16T13:42:06.895 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:06.896 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:06.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:06.952 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.011 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.011 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.011 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2789e-05 s, 0.0 kB/s 2023-10-16T13:42:07.012 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.012 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.069 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.127 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.128 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2362e-05 s, 0.0 kB/s 2023-10-16T13:42:07.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.129 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.185 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.243 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.243 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3144e-05 s, 0.0 kB/s 2023-10-16T13:42:07.243 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.244 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.301 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9007e-05 s, 0.0 kB/s 2023-10-16T13:42:07.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.360 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.416 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4772e-05 s, 0.0 kB/s 2023-10-16T13:42:07.475 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.475 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.546 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0602e-05 s, 0.0 kB/s 2023-10-16T13:42:07.605 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.606 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.662 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5335e-05 s, 0.0 kB/s 2023-10-16T13:42:07.720 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.778 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9505e-05 s, 0.0 kB/s 2023-10-16T13:42:07.837 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:07.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:07.895 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6345e-05 s, 0.0 kB/s 2023-10-16T13:42:07.954 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:07.955 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.011 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1771e-05 s, 0.0 kB/s 2023-10-16T13:42:08.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.070 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.185 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1771e-05 s, 0.0 kB/s 2023-10-16T13:42:08.185 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.185 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.242 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9228e-05 s, 0.0 kB/s 2023-10-16T13:42:08.301 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.301 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.358 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.1057e-05 s, 0.0 kB/s 2023-10-16T13:42:08.416 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.417 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.473 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2088e-05 s, 0.0 kB/s 2023-10-16T13:42:08.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.531 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.588 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.647 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4059e-05 s, 0.0 kB/s 2023-10-16T13:42:08.647 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1583e-05 s, 0.0 kB/s 2023-10-16T13:42:08.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.764 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1609e-05 s, 0.0 kB/s 2023-10-16T13:42:08.879 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.879 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:08.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:08.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:08.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:08.995 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.5766e-05 s, 0.0 kB/s 2023-10-16T13:42:08.995 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:08.996 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.055 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4619e-05 s, 0.0 kB/s 2023-10-16T13:42:09.114 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.114 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4084e-05 s, 0.0 kB/s 2023-10-16T13:42:09.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.231 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.346 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9985e-05 s, 0.0 kB/s 2023-10-16T13:42:09.346 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.347 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.462 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8337e-05 s, 0.0 kB/s 2023-10-16T13:42:09.462 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.519 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6801e-05 s, 0.0 kB/s 2023-10-16T13:42:09.578 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.579 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.636 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6909e-05 s, 0.0 kB/s 2023-10-16T13:42:09.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.695 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.752 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.810 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4867e-05 s, 0.0 kB/s 2023-10-16T13:42:09.810 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.810 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.867 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:09.925 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:09.925 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:09.925 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3895e-05 s, 0.0 kB/s 2023-10-16T13:42:09.926 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:09.926 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:09.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:09.983 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.042 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.042 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2023e-05 s, 0.0 kB/s 2023-10-16T13:42:10.042 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.043 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.099 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1588e-05 s, 0.0 kB/s 2023-10-16T13:42:10.159 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.159 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.369e-05 s, 0.0 kB/s 2023-10-16T13:42:10.274 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.274 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.331 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4334e-05 s, 0.0 kB/s 2023-10-16T13:42:10.389 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.389 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.446 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.503 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.503 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4565e-05 s, 0.0 kB/s 2023-10-16T13:42:10.504 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.504 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.561 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3978e-05 s, 0.0 kB/s 2023-10-16T13:42:10.620 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.620 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.677 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5099e-05 s, 0.0 kB/s 2023-10-16T13:42:10.736 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.736 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7234e-05 s, 0.0 kB/s 2023-10-16T13:42:10.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.851 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:10.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:10.908 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9611e-05 s, 0.0 kB/s 2023-10-16T13:42:10.966 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:10.966 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.082 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2996e-05 s, 0.0 kB/s 2023-10-16T13:42:11.082 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.082 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.139 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1235e-05 s, 0.0 kB/s 2023-10-16T13:42:11.198 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.199 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4015e-05 s, 0.0 kB/s 2023-10-16T13:42:11.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.314 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.428 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1975e-05 s, 0.0 kB/s 2023-10-16T13:42:11.429 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.429 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.486 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.543 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7858e-05 s, 0.0 kB/s 2023-10-16T13:42:11.544 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.602 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5362e-05 s, 0.0 kB/s 2023-10-16T13:42:11.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.663 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.720 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2569e-05 s, 0.0 kB/s 2023-10-16T13:42:11.779 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.780 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.837 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:11.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:11.896 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.357e-05 s, 0.0 kB/s 2023-10-16T13:42:11.896 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:11.896 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:11.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:11.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0874e-05 s, 0.0 kB/s 2023-10-16T13:42:12.014 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.014 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.071 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0624e-05 s, 0.0 kB/s 2023-10-16T13:42:12.130 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.130 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.187 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1813e-05 s, 0.0 kB/s 2023-10-16T13:42:12.245 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.245 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1017e-05 s, 0.0 kB/s 2023-10-16T13:42:12.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.360 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.417 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1247e-05 s, 0.0 kB/s 2023-10-16T13:42:12.475 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.475 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.532 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4112e-05 s, 0.0 kB/s 2023-10-16T13:42:12.591 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.591 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.647 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.15e-05 s, 0.0 kB/s 2023-10-16T13:42:12.705 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.706 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.764 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3279e-05 s, 0.0 kB/s 2023-10-16T13:42:12.823 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.824 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.880 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5345e-05 s, 0.0 kB/s 2023-10-16T13:42:12.938 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:12.938 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:12.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:12.996 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1357e-05 s, 0.0 kB/s 2023-10-16T13:42:13.054 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.055 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.111 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6215e-05 s, 0.0 kB/s 2023-10-16T13:42:13.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.171 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.228 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4645e-05 s, 0.0 kB/s 2023-10-16T13:42:13.289 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.289 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.347 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.406 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4222e-05 s, 0.0 kB/s 2023-10-16T13:42:13.407 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.408 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.465 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7591e-05 s, 0.0 kB/s 2023-10-16T13:42:13.524 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.525 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.583 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4036e-05 s, 0.0 kB/s 2023-10-16T13:42:13.643 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.700 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.759 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.759 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.760 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5132e-05 s, 0.0 kB/s 2023-10-16T13:42:13.760 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.760 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.818 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.875 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.875 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.875 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6536e-05 s, 0.0 kB/s 2023-10-16T13:42:13.876 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.877 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:13.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:13.935 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2845e-05 s, 0.0 kB/s 2023-10-16T13:42:13.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:13.995 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.054 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3216e-05 s, 0.0 kB/s 2023-10-16T13:42:14.112 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.112 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.169 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.227 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3099e-05 s, 0.0 kB/s 2023-10-16T13:42:14.228 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.229 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.286 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-16T13:42:14.346 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.346 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3936e-05 s, 0.0 kB/s 2023-10-16T13:42:14.462 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.519 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0579e-05 s, 0.0 kB/s 2023-10-16T13:42:14.578 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.578 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9819e-05 s, 0.0 kB/s 2023-10-16T13:42:14.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.694 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.752 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2553e-05 s, 0.0 kB/s 2023-10-16T13:42:14.810 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.811 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.868 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0626e-05 s, 0.0 kB/s 2023-10-16T13:42:14.927 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:14.928 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:14.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:14.986 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3676e-05 s, 0.0 kB/s 2023-10-16T13:42:15.044 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.045 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0083e-05 s, 0.0 kB/s 2023-10-16T13:42:15.160 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.161 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.220 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.367e-05 s, 0.0 kB/s 2023-10-16T13:42:15.284 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.284 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.8792e-05 s, 0.0 kB/s 2023-10-16T13:42:15.406 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.406 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.537 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0755e-05 s, 0.0 kB/s 2023-10-16T13:42:15.538 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.539 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4256e-05 s, 0.0 kB/s 2023-10-16T13:42:15.624 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.624 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.686 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3759e-05 s, 0.0 kB/s 2023-10-16T13:42:15.749 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.750 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.810 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106417 s, 0.0 kB/s 2023-10-16T13:42:15.872 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.873 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:15.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:15.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2774e-05 s, 0.0 kB/s 2023-10-16T13:42:15.991 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:15.992 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.052 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3965e-05 s, 0.0 kB/s 2023-10-16T13:42:16.110 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.111 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.169 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4768e-05 s, 0.0 kB/s 2023-10-16T13:42:16.227 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.228 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.284 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2814e-05 s, 0.0 kB/s 2023-10-16T13:42:16.343 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.343 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2268e-05 s, 0.0 kB/s 2023-10-16T13:42:16.460 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.460 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.576 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-16T13:42:16.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.633 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7888e-05 s, 0.0 kB/s 2023-10-16T13:42:16.692 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.692 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.749 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.808 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.808 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.808 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4163e-05 s, 0.0 kB/s 2023-10-16T13:42:16.808 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:16.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:16.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:16.924 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5888e-05 s, 0.0 kB/s 2023-10-16T13:42:16.925 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:16.926 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:16.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:16.983 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1747e-05 s, 0.0 kB/s 2023-10-16T13:42:17.042 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.043 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.159 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1734e-05 s, 0.0 kB/s 2023-10-16T13:42:17.159 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.160 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.216 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.274 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7695e-05 s, 0.0 kB/s 2023-10-16T13:42:17.275 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.276 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.333 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2395e-05 s, 0.0 kB/s 2023-10-16T13:42:17.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.391 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.448 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8805e-05 s, 0.0 kB/s 2023-10-16T13:42:17.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.507 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5918e-05 s, 0.0 kB/s 2023-10-16T13:42:17.624 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.624 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.682 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0773e-05 s, 0.0 kB/s 2023-10-16T13:42:17.740 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.740 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.797 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2801e-05 s, 0.0 kB/s 2023-10-16T13:42:17.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:17.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:17.913 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2198e-05 s, 0.0 kB/s 2023-10-16T13:42:17.972 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:17.972 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.029 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9494e-05 s, 0.0 kB/s 2023-10-16T13:42:18.087 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.087 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.144 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.203 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3872e-05 s, 0.0 kB/s 2023-10-16T13:42:18.203 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.203 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.260 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3633e-05 s, 0.0 kB/s 2023-10-16T13:42:18.318 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.319 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.375 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.432 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.433 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.433 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5818e-05 s, 0.0 kB/s 2023-10-16T13:42:18.433 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.434 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.490 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.548 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.548 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9909e-05 s, 0.0 kB/s 2023-10-16T13:42:18.549 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.549 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.607 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1869e-05 s, 0.0 kB/s 2023-10-16T13:42:18.667 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.667 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.783 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.783 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.783 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4506e-05 s, 0.0 kB/s 2023-10-16T13:42:18.784 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.784 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.842 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:18.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:18.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:18.901 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5788e-05 s, 0.0 kB/s 2023-10-16T13:42:18.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:18.902 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:18.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:18.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3586e-05 s, 0.0 kB/s 2023-10-16T13:42:19.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.018 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.076 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5792e-05 s, 0.0 kB/s 2023-10-16T13:42:19.136 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.136 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.194 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3357e-05 s, 0.0 kB/s 2023-10-16T13:42:19.252 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.253 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.309 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3749e-05 s, 0.0 kB/s 2023-10-16T13:42:19.368 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.369 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.425 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.483 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3314e-05 s, 0.0 kB/s 2023-10-16T13:42:19.483 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.540 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4999e-05 s, 0.0 kB/s 2023-10-16T13:42:19.600 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.600 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1007e-05 s, 0.0 kB/s 2023-10-16T13:42:19.715 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.772 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2495e-05 s, 0.0 kB/s 2023-10-16T13:42:19.832 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.832 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:19.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:19.889 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1522e-05 s, 0.0 kB/s 2023-10-16T13:42:19.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:19.948 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.005 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4978e-05 s, 0.0 kB/s 2023-10-16T13:42:20.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.064 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.121 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.179 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.180 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.180 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2135e-05 s, 0.0 kB/s 2023-10-16T13:42:20.180 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.181 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0425e-05 s, 0.0 kB/s 2023-10-16T13:42:20.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.297 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3384e-05 s, 0.0 kB/s 2023-10-16T13:42:20.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.527 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.528 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2338e-05 s, 0.0 kB/s 2023-10-16T13:42:20.528 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.529 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.585 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.644 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.311e-05 s, 0.0 kB/s 2023-10-16T13:42:20.645 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.645 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.702 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.759 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.759 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.759 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5678e-05 s, 0.0 kB/s 2023-10-16T13:42:20.760 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.761 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.818 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3092e-05 s, 0.0 kB/s 2023-10-16T13:42:20.877 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.878 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:20.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:20.935 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:20.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:20.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1369e-05 s, 0.0 kB/s 2023-10-16T13:42:20.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:20.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.051 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.07e-05 s, 0.0 kB/s 2023-10-16T13:42:21.109 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.110 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.167 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.226 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3967e-05 s, 0.0 kB/s 2023-10-16T13:42:21.227 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.227 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.284 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1576e-05 s, 0.0 kB/s 2023-10-16T13:42:21.343 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.344 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5901e-05 s, 0.0 kB/s 2023-10-16T13:42:21.459 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.460 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.579 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2931e-05 s, 0.0 kB/s 2023-10-16T13:42:21.580 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.580 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.637 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.696 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.696 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.696 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3558e-05 s, 0.0 kB/s 2023-10-16T13:42:21.696 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.697 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.754 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-16T13:42:21.813 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.813 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.870 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:21.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:21.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:21.928 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9196e-05 s, 0.0 kB/s 2023-10-16T13:42:21.928 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:21.929 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:21.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:21.987 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8655e-05 s, 0.0 kB/s 2023-10-16T13:42:22.046 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.047 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.057e-05 s, 0.0 kB/s 2023-10-16T13:42:22.162 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.163 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.219 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2365e-05 s, 0.0 kB/s 2023-10-16T13:42:22.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0405e-05 s, 0.0 kB/s 2023-10-16T13:42:22.395 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.395 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.452 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.510 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8392e-05 s, 0.0 kB/s 2023-10-16T13:42:22.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.510 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9252e-05 s, 0.0 kB/s 2023-10-16T13:42:22.627 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.685 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4428e-05 s, 0.0 kB/s 2023-10-16T13:42:22.746 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.747 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.804 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2555e-05 s, 0.0 kB/s 2023-10-16T13:42:22.862 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.862 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:22.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:22.920 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0359e-05 s, 0.0 kB/s 2023-10-16T13:42:22.978 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:22.978 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.092e-05 s, 0.0 kB/s 2023-10-16T13:42:23.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.151 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.208 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0265e-05 s, 0.0 kB/s 2023-10-16T13:42:23.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.267 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8395e-05 s, 0.0 kB/s 2023-10-16T13:42:23.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.326 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.383 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0815e-05 s, 0.0 kB/s 2023-10-16T13:42:23.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101028 s, 0.0 kB/s 2023-10-16T13:42:23.559 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.560 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.678 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000104851 s, 0.0 kB/s 2023-10-16T13:42:23.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.736 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7956e-05 s, 0.0 kB/s 2023-10-16T13:42:23.796 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.796 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.853 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-16T13:42:23.911 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:23.912 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:23.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:23.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5376e-05 s, 0.0 kB/s 2023-10-16T13:42:24.031 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.032 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.088 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3631e-05 s, 0.0 kB/s 2023-10-16T13:42:24.146 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.147 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.203 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4289e-05 s, 0.0 kB/s 2023-10-16T13:42:24.261 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.262 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.377 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.378 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.378 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3151e-05 s, 0.0 kB/s 2023-10-16T13:42:24.379 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.379 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.435 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6036e-05 s, 0.0 kB/s 2023-10-16T13:42:24.494 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.495 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.551 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7042e-05 s, 0.0 kB/s 2023-10-16T13:42:24.610 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.611 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.667 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2279e-05 s, 0.0 kB/s 2023-10-16T13:42:24.726 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.726 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5479e-05 s, 0.0 kB/s 2023-10-16T13:42:24.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:24.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:24.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:24.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:24.959 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.00012528 s, 0.0 kB/s 2023-10-16T13:42:24.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:24.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.017 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0308e-05 s, 0.0 kB/s 2023-10-16T13:42:25.076 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.135 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1268e-05 s, 0.0 kB/s 2023-10-16T13:42:25.193 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.193 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2298e-05 s, 0.0 kB/s 2023-10-16T13:42:25.310 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.310 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.367 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.425 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4095e-05 s, 0.0 kB/s 2023-10-16T13:42:25.425 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.425 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.482 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.540 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.540 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3732e-05 s, 0.0 kB/s 2023-10-16T13:42:25.540 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.540 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.597 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4543e-05 s, 0.0 kB/s 2023-10-16T13:42:25.656 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.656 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.713 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.770 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9625e-05 s, 0.0 kB/s 2023-10-16T13:42:25.771 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.772 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.829 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:25.888 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:25.888 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9538e-05 s, 0.0 kB/s 2023-10-16T13:42:25.889 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:25.889 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:25.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:25.948 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4468e-05 s, 0.0 kB/s 2023-10-16T13:42:26.007 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.007 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.064 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-16T13:42:26.122 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.122 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.179 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3247e-05 s, 0.0 kB/s 2023-10-16T13:42:26.238 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.238 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.295 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.401e-05 s, 0.0 kB/s 2023-10-16T13:42:26.354 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.355 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.411 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2548e-05 s, 0.0 kB/s 2023-10-16T13:42:26.470 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.471 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.527 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.585 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.586 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.586 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3665e-05 s, 0.0 kB/s 2023-10-16T13:42:26.586 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.587 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.643 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8502e-05 s, 0.0 kB/s 2023-10-16T13:42:26.701 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.701 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.758 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.816 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1231e-05 s, 0.0 kB/s 2023-10-16T13:42:26.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.874 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3872e-05 s, 0.0 kB/s 2023-10-16T13:42:26.934 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:26.934 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:26.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:26.991 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0273e-05 s, 0.0 kB/s 2023-10-16T13:42:27.050 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.051 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.165 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3894e-05 s, 0.0 kB/s 2023-10-16T13:42:27.165 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.165 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1263e-05 s, 0.0 kB/s 2023-10-16T13:42:27.281 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.1048e-05 s, 0.0 kB/s 2023-10-16T13:42:27.397 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.398 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-16T13:42:27.512 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.513 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-16T13:42:27.630 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.630 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.687 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5639e-05 s, 0.0 kB/s 2023-10-16T13:42:27.746 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.746 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:27.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3718e-05 s, 0.0 kB/s 2023-10-16T13:42:27.862 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.862 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:27.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:27.920 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1788e-05 s, 0.0 kB/s 2023-10-16T13:42:27.992 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:27.993 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.050 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3823e-05 s, 0.0 kB/s 2023-10-16T13:42:28.109 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.109 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.166 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.225 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2009e-05 s, 0.0 kB/s 2023-10-16T13:42:28.225 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.225 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.282 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6535e-05 s, 0.0 kB/s 2023-10-16T13:42:28.341 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.342 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.458 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6164e-05 s, 0.0 kB/s 2023-10-16T13:42:28.459 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.459 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.575 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3156e-05 s, 0.0 kB/s 2023-10-16T13:42:28.575 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.632 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.691 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0092e-05 s, 0.0 kB/s 2023-10-16T13:42:28.691 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.692 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.748 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.806 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1871e-05 s, 0.0 kB/s 2023-10-16T13:42:28.806 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.806 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.863 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:28.921 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:28.921 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:28.922 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1261e-05 s, 0.0 kB/s 2023-10-16T13:42:28.922 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:28.922 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:28.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:28.980 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.039 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5495e-05 s, 0.0 kB/s 2023-10-16T13:42:29.039 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.039 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.096 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.155 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.155 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3525e-05 s, 0.0 kB/s 2023-10-16T13:42:29.155 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.155 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.275 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-16T13:42:29.276 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.277 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.334 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4928e-05 s, 0.0 kB/s 2023-10-16T13:42:29.392 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.392 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-16T13:42:29.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.507 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2702e-05 s, 0.0 kB/s 2023-10-16T13:42:29.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.680 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.738 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.738 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3005e-05 s, 0.0 kB/s 2023-10-16T13:42:29.738 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.738 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.795 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5658e-05 s, 0.0 kB/s 2023-10-16T13:42:29.855 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.855 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:29.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:29.912 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1141e-05 s, 0.0 kB/s 2023-10-16T13:42:29.970 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:29.971 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4427e-05 s, 0.0 kB/s 2023-10-16T13:42:30.086 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.087 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.144 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.201 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4002e-05 s, 0.0 kB/s 2023-10-16T13:42:30.201 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.202 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.259 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.316 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.316 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.317 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3933e-05 s, 0.0 kB/s 2023-10-16T13:42:30.317 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.317 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.374 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4234e-05 s, 0.0 kB/s 2023-10-16T13:42:30.432 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.433 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.490 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2483e-05 s, 0.0 kB/s 2023-10-16T13:42:30.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.548 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.606 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.4379e-05 s, 0.0 kB/s 2023-10-16T13:42:30.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.665 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.722 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.885 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4065e-05 s, 0.0 kB/s 2023-10-16T13:42:30.885 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:30.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:30.904 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7769e-05 s, 0.0 kB/s 2023-10-16T13:42:30.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:30.963 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.020 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5419e-05 s, 0.0 kB/s 2023-10-16T13:42:31.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.079 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.136 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3942e-05 s, 0.0 kB/s 2023-10-16T13:42:31.196 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.196 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.254 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.312 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2584e-05 s, 0.0 kB/s 2023-10-16T13:42:31.312 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.313 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2308e-05 s, 0.0 kB/s 2023-10-16T13:42:31.428 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.428 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.485 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1798e-05 s, 0.0 kB/s 2023-10-16T13:42:31.544 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.483e-05 s, 0.0 kB/s 2023-10-16T13:42:31.661 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.661 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.718 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9942e-05 s, 0.0 kB/s 2023-10-16T13:42:31.776 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.777 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.835 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6275e-05 s, 0.0 kB/s 2023-10-16T13:42:31.894 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:31.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:31.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:31.951 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.009 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.009 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.009 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0383e-05 s, 0.0 kB/s 2023-10-16T13:42:32.010 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.011 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.068 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1451e-05 s, 0.0 kB/s 2023-10-16T13:42:32.127 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.127 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.185 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3499e-05 s, 0.0 kB/s 2023-10-16T13:42:32.244 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.244 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.301 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.359 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2493e-05 s, 0.0 kB/s 2023-10-16T13:42:32.359 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.416 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8644e-05 s, 0.0 kB/s 2023-10-16T13:42:32.474 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.474 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.532 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.590 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.591 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.591 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9474e-05 s, 0.0 kB/s 2023-10-16T13:42:32.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.593 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.708 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.708 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0205e-05 s, 0.0 kB/s 2023-10-16T13:42:32.709 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.709 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.767 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0008e-05 s, 0.0 kB/s 2023-10-16T13:42:32.826 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.826 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:32.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:32.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:32.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:32.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:32.942 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0106e-05 s, 0.0 kB/s 2023-10-16T13:42:32.943 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:32.943 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.001 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.058 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.059 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5181e-05 s, 0.0 kB/s 2023-10-16T13:42:33.059 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.060 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.116 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2401e-05 s, 0.0 kB/s 2023-10-16T13:42:33.175 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.175 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.232 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1311e-05 s, 0.0 kB/s 2023-10-16T13:42:33.292 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.292 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.349 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9742e-05 s, 0.0 kB/s 2023-10-16T13:42:33.407 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.407 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.466 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3243e-05 s, 0.0 kB/s 2023-10-16T13:42:33.524 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.524 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.582 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4026e-05 s, 0.0 kB/s 2023-10-16T13:42:33.641 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.641 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.1054e-05 s, 0.0 kB/s 2023-10-16T13:42:33.757 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.758 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.815 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-16T13:42:33.873 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.874 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:33.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:33.930 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:33.988 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:33.989 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:33.989 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-16T13:42:33.989 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:33.990 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.046 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0728e-05 s, 0.0 kB/s 2023-10-16T13:42:34.105 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.106 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.163 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5312e-05 s, 0.0 kB/s 2023-10-16T13:42:34.221 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.222 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.278 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.337 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7575e-05 s, 0.0 kB/s 2023-10-16T13:42:34.338 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.338 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.396 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3594e-05 s, 0.0 kB/s 2023-10-16T13:42:34.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.456 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.513 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.571 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1372e-05 s, 0.0 kB/s 2023-10-16T13:42:34.571 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.571 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.628 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6862e-05 s, 0.0 kB/s 2023-10-16T13:42:34.687 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.688 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.745 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5482e-05 s, 0.0 kB/s 2023-10-16T13:42:34.805 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.805 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.863 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:34.921 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.546e-05 s, 0.0 kB/s 2023-10-16T13:42:34.922 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:34.923 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:34.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:34.979 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.037 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.037 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.038 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3189e-05 s, 0.0 kB/s 2023-10-16T13:42:35.038 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.038 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.095 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.6681e-05 s, 0.0 kB/s 2023-10-16T13:42:35.154 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.154 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.212 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9518e-05 s, 0.0 kB/s 2023-10-16T13:42:35.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.271 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.329 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.386 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.387 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1788e-05 s, 0.0 kB/s 2023-10-16T13:42:35.387 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.388 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.445 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000103846 s, 0.0 kB/s 2023-10-16T13:42:35.503 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.504 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.560 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3139e-05 s, 0.0 kB/s 2023-10-16T13:42:35.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.619 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.675 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5024e-05 s, 0.0 kB/s 2023-10-16T13:42:35.733 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.733 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.790 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.848 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.849 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.849 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8551e-05 s, 0.0 kB/s 2023-10-16T13:42:35.849 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.850 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:35.907 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:35.983 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:35.983 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2155e-05 s, 0.0 kB/s 2023-10-16T13:42:35.984 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:35.984 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.042 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2489e-05 s, 0.0 kB/s 2023-10-16T13:42:36.109 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.109 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.167 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1035e-05 s, 0.0 kB/s 2023-10-16T13:42:36.228 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.229 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4649e-05 s, 0.0 kB/s 2023-10-16T13:42:36.347 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.348 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.406 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.464 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0465e-05 s, 0.0 kB/s 2023-10-16T13:42:36.465 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2346e-05 s, 0.0 kB/s 2023-10-16T13:42:36.589 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.589 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.645 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8391e-05 s, 0.0 kB/s 2023-10-16T13:42:36.705 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.706 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.766 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.555e-05 s, 0.0 kB/s 2023-10-16T13:42:36.824 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:36.938 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3421e-05 s, 0.0 kB/s 2023-10-16T13:42:36.940 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:36.940 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:36.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:36.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5253e-05 s, 0.0 kB/s 2023-10-16T13:42:37.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.172 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3819e-05 s, 0.0 kB/s 2023-10-16T13:42:37.172 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.229 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2606e-05 s, 0.0 kB/s 2023-10-16T13:42:37.287 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.288 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.344 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2921e-05 s, 0.0 kB/s 2023-10-16T13:42:37.403 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.404 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.461 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3241e-05 s, 0.0 kB/s 2023-10-16T13:42:37.521 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.522 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.579 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8232e-05 s, 0.0 kB/s 2023-10-16T13:42:37.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.637 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.753 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.753 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.753 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2018e-05 s, 0.0 kB/s 2023-10-16T13:42:37.754 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.754 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.812 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2037e-05 s, 0.0 kB/s 2023-10-16T13:42:37.870 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:37.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:37.927 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:37.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:37.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:37.985 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8695e-05 s, 0.0 kB/s 2023-10-16T13:42:37.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:37.985 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.042 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5358e-05 s, 0.0 kB/s 2023-10-16T13:42:38.101 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.101 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.158 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102344 s, 0.0 kB/s 2023-10-16T13:42:38.216 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.217 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.274 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2162e-05 s, 0.0 kB/s 2023-10-16T13:42:38.333 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.334 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.390 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2729e-05 s, 0.0 kB/s 2023-10-16T13:42:38.449 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.449 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.506 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9534e-05 s, 0.0 kB/s 2023-10-16T13:42:38.566 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.566 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.624 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9498e-05 s, 0.0 kB/s 2023-10-16T13:42:38.682 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.683 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.740 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0101e-05 s, 0.0 kB/s 2023-10-16T13:42:38.799 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.799 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.856 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:38.915 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9581e-05 s, 0.0 kB/s 2023-10-16T13:42:38.915 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:38.915 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:38.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:38.972 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2528e-05 s, 0.0 kB/s 2023-10-16T13:42:39.031 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.031 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.088 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1051e-05 s, 0.0 kB/s 2023-10-16T13:42:39.146 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.147 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.205 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7165e-05 s, 0.0 kB/s 2023-10-16T13:42:39.263 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.263 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5454e-05 s, 0.0 kB/s 2023-10-16T13:42:39.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.435 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5171e-05 s, 0.0 kB/s 2023-10-16T13:42:39.494 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.494 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.551 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2908e-05 s, 0.0 kB/s 2023-10-16T13:42:39.611 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.611 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.668 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6381e-05 s, 0.0 kB/s 2023-10-16T13:42:39.727 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.727 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5956e-05 s, 0.0 kB/s 2023-10-16T13:42:39.843 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:39.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:39.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:39.958 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:39.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:39.959 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.4169e-05 s, 0.0 kB/s 2023-10-16T13:42:39.959 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:39.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.016 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.074 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.074 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.075 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0808e-05 s, 0.0 kB/s 2023-10-16T13:42:40.075 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.075 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.132 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.190 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8675e-05 s, 0.0 kB/s 2023-10-16T13:42:40.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.190 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.247 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1521e-05 s, 0.0 kB/s 2023-10-16T13:42:40.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.307 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.363 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1859e-05 s, 0.0 kB/s 2023-10-16T13:42:40.422 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.423 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.479 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.538 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5374e-05 s, 0.0 kB/s 2023-10-16T13:42:40.539 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.539 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.596 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1725e-05 s, 0.0 kB/s 2023-10-16T13:42:40.654 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.655 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.711 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.318e-05 s, 0.0 kB/s 2023-10-16T13:42:40.769 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.769 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.826 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4338e-05 s, 0.0 kB/s 2023-10-16T13:42:40.885 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:40.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:40.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:40.942 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3914e-05 s, 0.0 kB/s 2023-10-16T13:42:41.000 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.000 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.057 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.115 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.115 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7003e-05 s, 0.0 kB/s 2023-10-16T13:42:41.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.115 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3485e-05 s, 0.0 kB/s 2023-10-16T13:42:41.231 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.232 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.289 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5481e-05 s, 0.0 kB/s 2023-10-16T13:42:41.347 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.347 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.404 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1831e-05 s, 0.0 kB/s 2023-10-16T13:42:41.462 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.518 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1528e-05 s, 0.0 kB/s 2023-10-16T13:42:41.577 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.577 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.694 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.694 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1296e-05 s, 0.0 kB/s 2023-10-16T13:42:41.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.695 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.751 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1554e-05 s, 0.0 kB/s 2023-10-16T13:42:41.811 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.811 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.868 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2225e-05 s, 0.0 kB/s 2023-10-16T13:42:41.927 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:41.928 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:41.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:41.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.042 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3611e-05 s, 0.0 kB/s 2023-10-16T13:42:42.042 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.042 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.099 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3166e-05 s, 0.0 kB/s 2023-10-16T13:42:42.158 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.158 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.272 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.272 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.272 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1437e-05 s, 0.0 kB/s 2023-10-16T13:42:42.273 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.273 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.331 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.389 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.389 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.389 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7013e-05 s, 0.0 kB/s 2023-10-16T13:42:42.390 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.390 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.448 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4901e-05 s, 0.0 kB/s 2023-10-16T13:42:42.506 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.507 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.563 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3726e-05 s, 0.0 kB/s 2023-10-16T13:42:42.622 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.622 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.679 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.738 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.739 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.341e-05 s, 0.0 kB/s 2023-10-16T13:42:42.739 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.740 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.797 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5628e-05 s, 0.0 kB/s 2023-10-16T13:42:42.855 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.856 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:42.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:42.912 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-16T13:42:42.970 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:42.971 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0985e-05 s, 0.0 kB/s 2023-10-16T13:42:43.086 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.086 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.143 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3355e-05 s, 0.0 kB/s 2023-10-16T13:42:43.202 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.203 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.259 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7899e-05 s, 0.0 kB/s 2023-10-16T13:42:43.318 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.319 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.376 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9592e-05 s, 0.0 kB/s 2023-10-16T13:42:43.435 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.435 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.493 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100304 s, 0.0 kB/s 2023-10-16T13:42:43.551 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.552 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.609 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.667 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5391e-05 s, 0.0 kB/s 2023-10-16T13:42:43.668 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.668 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.725 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.274e-05 s, 0.0 kB/s 2023-10-16T13:42:43.784 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.784 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9391e-05 s, 0.0 kB/s 2023-10-16T13:42:43.899 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:43.899 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:43.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:43.957 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0521e-05 s, 0.0 kB/s 2023-10-16T13:42:44.015 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.016 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.133 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1712e-05 s, 0.0 kB/s 2023-10-16T13:42:44.134 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.134 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.190 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0755e-05 s, 0.0 kB/s 2023-10-16T13:42:44.249 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.249 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.306 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6988e-05 s, 0.0 kB/s 2023-10-16T13:42:44.365 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.365 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.423 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3099e-05 s, 0.0 kB/s 2023-10-16T13:42:44.481 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.482 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.538 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.048e-05 s, 0.0 kB/s 2023-10-16T13:42:44.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.597 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.654 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1827e-05 s, 0.0 kB/s 2023-10-16T13:42:44.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.828 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8456e-05 s, 0.0 kB/s 2023-10-16T13:42:44.828 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.828 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:44.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:44.885 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1093e-05 s, 0.0 kB/s 2023-10-16T13:42:44.944 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:44.945 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.002 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5221e-05 s, 0.0 kB/s 2023-10-16T13:42:45.060 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.060 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.117 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.175 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4114e-05 s, 0.0 kB/s 2023-10-16T13:42:45.175 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.175 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.232 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.289 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2527e-05 s, 0.0 kB/s 2023-10-16T13:42:45.290 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.291 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.347 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4607e-05 s, 0.0 kB/s 2023-10-16T13:42:45.407 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.407 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.465 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9661e-05 s, 0.0 kB/s 2023-10-16T13:42:45.523 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.523 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.580 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.29e-05 s, 0.0 kB/s 2023-10-16T13:42:45.639 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.640 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.697 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.754 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3471e-05 s, 0.0 kB/s 2023-10-16T13:42:45.755 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.755 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.813 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1288e-05 s, 0.0 kB/s 2023-10-16T13:42:45.872 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.873 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:45.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:45.930 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:45.987 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3563e-05 s, 0.0 kB/s 2023-10-16T13:42:45.988 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:45.988 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.045 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5491e-05 s, 0.0 kB/s 2023-10-16T13:42:46.103 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.103 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.160 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9988e-05 s, 0.0 kB/s 2023-10-16T13:42:46.218 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.218 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.335 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7098e-05 s, 0.0 kB/s 2023-10-16T13:42:46.335 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.336 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.392 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1708e-05 s, 0.0 kB/s 2023-10-16T13:42:46.450 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.450 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.507 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.565 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101101 s, 0.0 kB/s 2023-10-16T13:42:46.566 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.567 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.624 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.681 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4397e-05 s, 0.0 kB/s 2023-10-16T13:42:46.682 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.683 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.739 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.797 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.797 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.798 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3111e-05 s, 0.0 kB/s 2023-10-16T13:42:46.799 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.799 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.856 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5824e-05 s, 0.0 kB/s 2023-10-16T13:42:46.916 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:46.916 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:46.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:46.974 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1359e-05 s, 0.0 kB/s 2023-10-16T13:42:47.033 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.033 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.091 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0908e-05 s, 0.0 kB/s 2023-10-16T13:42:47.150 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.151 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.208 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2725e-05 s, 0.0 kB/s 2023-10-16T13:42:47.266 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.266 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.323 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.381 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3863e-05 s, 0.0 kB/s 2023-10-16T13:42:47.381 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.381 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.438 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.495 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.496 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.496 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0937e-05 s, 0.0 kB/s 2023-10-16T13:42:47.496 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.496 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8578e-05 s, 0.0 kB/s 2023-10-16T13:42:47.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8335e-05 s, 0.0 kB/s 2023-10-16T13:42:47.728 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.729 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.786 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.844 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102038 s, 0.0 kB/s 2023-10-16T13:42:47.845 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.846 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:47.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:47.904 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:47.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:47.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:47.963 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8718e-05 s, 0.0 kB/s 2023-10-16T13:42:47.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:47.964 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.021 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2498e-05 s, 0.0 kB/s 2023-10-16T13:42:48.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.080 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.137 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3778e-05 s, 0.0 kB/s 2023-10-16T13:42:48.196 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.197 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.254 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9188e-05 s, 0.0 kB/s 2023-10-16T13:42:48.312 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.313 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.428 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2243e-05 s, 0.0 kB/s 2023-10-16T13:42:48.428 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.428 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.485 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3491e-05 s, 0.0 kB/s 2023-10-16T13:42:48.544 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3543e-05 s, 0.0 kB/s 2023-10-16T13:42:48.659 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.659 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.716 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.5974e-05 s, 0.0 kB/s 2023-10-16T13:42:48.775 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.775 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.832 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.5549e-05 s, 0.0 kB/s 2023-10-16T13:42:48.891 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:48.892 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:48.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:48.948 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.007 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.007 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.89e-05 s, 0.0 kB/s 2023-10-16T13:42:49.008 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.008 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.066 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3432e-05 s, 0.0 kB/s 2023-10-16T13:42:49.124 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.124 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.181 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.407e-05 s, 0.0 kB/s 2023-10-16T13:42:49.240 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.240 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.296 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.354 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3199e-05 s, 0.0 kB/s 2023-10-16T13:42:49.355 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.355 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.412 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3021e-05 s, 0.0 kB/s 2023-10-16T13:42:49.470 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.470 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.528 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3646e-05 s, 0.0 kB/s 2023-10-16T13:42:49.586 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.586 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.643 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0769e-05 s, 0.0 kB/s 2023-10-16T13:42:49.701 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.701 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.758 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7904e-05 s, 0.0 kB/s 2023-10-16T13:42:49.817 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.818 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.874 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:49.932 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:49.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:49.933 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.091e-05 s, 0.0 kB/s 2023-10-16T13:42:49.933 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:49.933 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:49.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:49.992 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.6373e-05 s, 0.0 kB/s 2023-10-16T13:42:50.050 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.051 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2295e-05 s, 0.0 kB/s 2023-10-16T13:42:50.166 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.166 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.281 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.281 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.281 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9262e-05 s, 0.0 kB/s 2023-10-16T13:42:50.282 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.282 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.339 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.399 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1869e-05 s, 0.0 kB/s 2023-10-16T13:42:50.399 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.399 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.456 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.514 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.3178e-05 s, 0.0 kB/s 2023-10-16T13:42:50.514 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.514 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.571 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.628 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.628 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3851e-05 s, 0.0 kB/s 2023-10-16T13:42:50.629 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.629 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.687 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2835e-05 s, 0.0 kB/s 2023-10-16T13:42:50.745 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.745 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.19e-05 s, 0.0 kB/s 2023-10-16T13:42:50.862 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.862 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:50.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:50.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7475e-05 s, 0.0 kB/s 2023-10-16T13:42:50.978 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:50.978 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.035 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7898e-05 s, 0.0 kB/s 2023-10-16T13:42:51.093 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.208 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0581e-05 s, 0.0 kB/s 2023-10-16T13:42:51.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.267 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.324 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1975e-05 s, 0.0 kB/s 2023-10-16T13:42:51.325 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.325 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3395e-05 s, 0.0 kB/s 2023-10-16T13:42:51.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.499 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-16T13:42:51.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.558 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.622 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.681 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5199e-05 s, 0.0 kB/s 2023-10-16T13:42:51.682 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.682 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.745 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8061e-05 s, 0.0 kB/s 2023-10-16T13:42:51.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.871 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2741e-05 s, 0.0 kB/s 2023-10-16T13:42:51.935 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:51.936 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:51.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:51.996 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1186e-05 s, 0.0 kB/s 2023-10-16T13:42:52.061 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.061 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.124 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4916e-05 s, 0.0 kB/s 2023-10-16T13:42:52.189 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.189 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.248 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-16T13:42:52.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.309 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.368 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.428 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4828e-05 s, 0.0 kB/s 2023-10-16T13:42:52.428 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.428 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.487 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1782e-05 s, 0.0 kB/s 2023-10-16T13:42:52.546 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0529e-05 s, 0.0 kB/s 2023-10-16T13:42:52.664 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.665 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.720 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.199e-05 s, 0.0 kB/s 2023-10-16T13:42:52.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.778 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1144e-05 s, 0.0 kB/s 2023-10-16T13:42:52.896 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:52.896 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:52.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:52.953 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.012 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4744e-05 s, 0.0 kB/s 2023-10-16T13:42:53.012 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.013 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.070 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.126 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.127 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.127 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.416e-05 s, 0.0 kB/s 2023-10-16T13:42:53.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.128 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.186 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.245 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2892e-05 s, 0.0 kB/s 2023-10-16T13:42:53.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.246 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.303 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5162e-05 s, 0.0 kB/s 2023-10-16T13:42:53.362 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.477 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2198e-05 s, 0.0 kB/s 2023-10-16T13:42:53.479 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.536 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.595 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3821e-05 s, 0.0 kB/s 2023-10-16T13:42:53.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.596 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.653 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.519e-05 s, 0.0 kB/s 2023-10-16T13:42:53.713 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.713 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.770 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.6892e-05 s, 0.0 kB/s 2023-10-16T13:42:53.830 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.830 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:53.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:53.886 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1915e-05 s, 0.0 kB/s 2023-10-16T13:42:53.945 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:53.946 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.061 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.061 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3651e-05 s, 0.0 kB/s 2023-10-16T13:42:54.061 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.062 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2311e-05 s, 0.0 kB/s 2023-10-16T13:42:54.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.179 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1185e-05 s, 0.0 kB/s 2023-10-16T13:42:54.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.296 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.412 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2862e-05 s, 0.0 kB/s 2023-10-16T13:42:54.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.413 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.528 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.528 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.528 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.8362e-05 s, 0.0 kB/s 2023-10-16T13:42:54.529 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.529 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.586 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3415e-05 s, 0.0 kB/s 2023-10-16T13:42:54.645 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.645 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.702 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6158e-05 s, 0.0 kB/s 2023-10-16T13:42:54.761 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.762 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.819 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7031e-05 s, 0.0 kB/s 2023-10-16T13:42:54.879 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.879 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:54.937 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0969e-05 s, 0.0 kB/s 2023-10-16T13:42:54.996 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:54.996 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.053 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.147e-05 s, 0.0 kB/s 2023-10-16T13:42:55.112 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.113 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.170 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0282e-05 s, 0.0 kB/s 2023-10-16T13:42:55.229 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.230 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.286 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.366e-05 s, 0.0 kB/s 2023-10-16T13:42:55.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.345 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2911e-05 s, 0.0 kB/s 2023-10-16T13:42:55.460 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.460 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0729e-05 s, 0.0 kB/s 2023-10-16T13:42:55.575 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.633 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3585e-05 s, 0.0 kB/s 2023-10-16T13:42:55.691 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.692 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.748 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1205e-05 s, 0.0 kB/s 2023-10-16T13:42:55.808 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.808 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.867 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9955e-05 s, 0.0 kB/s 2023-10-16T13:42:55.925 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:55.926 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:55.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:55.982 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1876e-05 s, 0.0 kB/s 2023-10-16T13:42:56.041 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.041 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.098 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9143e-05 s, 0.0 kB/s 2023-10-16T13:42:56.156 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.157 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.214 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1173e-05 s, 0.0 kB/s 2023-10-16T13:42:56.272 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.272 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.329 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0052e-05 s, 0.0 kB/s 2023-10-16T13:42:56.388 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.388 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.445 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-16T13:42:56.503 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.503 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.560 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1994e-05 s, 0.0 kB/s 2023-10-16T13:42:56.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.618 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.676 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.733 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9925e-05 s, 0.0 kB/s 2023-10-16T13:42:56.734 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.734 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.792 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106808 s, 0.0 kB/s 2023-10-16T13:42:56.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:56.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:56.908 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6664e-05 s, 0.0 kB/s 2023-10-16T13:42:56.966 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:56.967 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0717e-05 s, 0.0 kB/s 2023-10-16T13:42:57.082 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.082 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1135e-05 s, 0.0 kB/s 2023-10-16T13:42:57.197 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.198 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.255 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.313 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3763e-05 s, 0.0 kB/s 2023-10-16T13:42:57.313 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.314 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.372 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1273e-05 s, 0.0 kB/s 2023-10-16T13:42:57.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.431 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.544 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.544 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.544 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2635e-05 s, 0.0 kB/s 2023-10-16T13:42:57.545 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.546 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.603 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1872e-05 s, 0.0 kB/s 2023-10-16T13:42:57.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.662 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.719 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0678e-05 s, 0.0 kB/s 2023-10-16T13:42:57.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.779 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.835 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9588e-05 s, 0.0 kB/s 2023-10-16T13:42:57.894 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:57.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:57.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:57.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:57.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:57.952 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.010 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5929e-05 s, 0.0 kB/s 2023-10-16T13:42:58.011 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.012 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.069 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.127 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.8923e-05 s, 0.0 kB/s 2023-10-16T13:42:58.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.128 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.185 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2349e-05 s, 0.0 kB/s 2023-10-16T13:42:58.243 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.243 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.300 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4586e-05 s, 0.0 kB/s 2023-10-16T13:42:58.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.416 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.474 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.474 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3307e-05 s, 0.0 kB/s 2023-10-16T13:42:58.475 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.475 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.532 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.591 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9804e-05 s, 0.0 kB/s 2023-10-16T13:42:58.591 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.592 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.648 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7778e-05 s, 0.0 kB/s 2023-10-16T13:42:58.707 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.708 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3135e-05 s, 0.0 kB/s 2023-10-16T13:42:58.824 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.882 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3025e-05 s, 0.0 kB/s 2023-10-16T13:42:58.941 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:58.941 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:58.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:58.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.056 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2636e-05 s, 0.0 kB/s 2023-10-16T13:42:59.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3213e-05 s, 0.0 kB/s 2023-10-16T13:42:59.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.228 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.286 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3549e-05 s, 0.0 kB/s 2023-10-16T13:42:59.287 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.287 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.345 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2635e-05 s, 0.0 kB/s 2023-10-16T13:42:59.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.463 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3888e-05 s, 0.0 kB/s 2023-10-16T13:42:59.522 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.522 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.580 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3794e-05 s, 0.0 kB/s 2023-10-16T13:42:59.639 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.639 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.696 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1516e-05 s, 0.0 kB/s 2023-10-16T13:42:59.754 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.754 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.812 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.870 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.870 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0602e-05 s, 0.0 kB/s 2023-10-16T13:42:59.870 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:42:59.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:42:59.928 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:42:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:42:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:42:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7101e-05 s, 0.0 kB/s 2023-10-16T13:42:59.988 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:42:59.988 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2036e-05 s, 0.0 kB/s 2023-10-16T13:43:00.105 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.106 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.162 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9728e-05 s, 0.0 kB/s 2023-10-16T13:43:00.221 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.222 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.280 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5297e-05 s, 0.0 kB/s 2023-10-16T13:43:00.338 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.339 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.396 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.667e-05 s, 0.0 kB/s 2023-10-16T13:43:00.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.455 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.513 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3712e-05 s, 0.0 kB/s 2023-10-16T13:43:00.572 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.572 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.629 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8846e-05 s, 0.0 kB/s 2023-10-16T13:43:00.688 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.689 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.747 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.805 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3848e-05 s, 0.0 kB/s 2023-10-16T13:43:00.806 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.806 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.864 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2816e-05 s, 0.0 kB/s 2023-10-16T13:43:00.922 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:00.923 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:00.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:00.980 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.039 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.244e-05 s, 0.0 kB/s 2023-10-16T13:43:01.040 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.040 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.098 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.157 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.157 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4322e-05 s, 0.0 kB/s 2023-10-16T13:43:01.157 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.158 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3391e-05 s, 0.0 kB/s 2023-10-16T13:43:01.273 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.274 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.333 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6128e-05 s, 0.0 kB/s 2023-10-16T13:43:01.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.392 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.448 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-16T13:43:01.508 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2886e-05 s, 0.0 kB/s 2023-10-16T13:43:01.625 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.741 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1989e-05 s, 0.0 kB/s 2023-10-16T13:43:01.741 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.742 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.799 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.402e-05 s, 0.0 kB/s 2023-10-16T13:43:01.858 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.858 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:01.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:01.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5545e-05 s, 0.0 kB/s 2023-10-16T13:43:01.974 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:01.975 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4371e-05 s, 0.0 kB/s 2023-10-16T13:43:02.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.148 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9272e-05 s, 0.0 kB/s 2023-10-16T13:43:02.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7685e-05 s, 0.0 kB/s 2023-10-16T13:43:02.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.324 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.381 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3517e-05 s, 0.0 kB/s 2023-10-16T13:43:02.440 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.440 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.499 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9082e-05 s, 0.0 kB/s 2023-10-16T13:43:02.557 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.557 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.614 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.673 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6465e-05 s, 0.0 kB/s 2023-10-16T13:43:02.673 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.674 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.731 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.789 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7729e-05 s, 0.0 kB/s 2023-10-16T13:43:02.789 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.847 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3471e-05 s, 0.0 kB/s 2023-10-16T13:43:02.906 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:02.906 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:02.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:02.964 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9216e-05 s, 0.0 kB/s 2023-10-16T13:43:03.023 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.024 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2078e-05 s, 0.0 kB/s 2023-10-16T13:43:03.140 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.140 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.198 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2505e-05 s, 0.0 kB/s 2023-10-16T13:43:03.256 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.257 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.314 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.372 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1484e-05 s, 0.0 kB/s 2023-10-16T13:43:03.372 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.372 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.429 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4571e-05 s, 0.0 kB/s 2023-10-16T13:43:03.488 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.489 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.546 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.603 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2813e-05 s, 0.0 kB/s 2023-10-16T13:43:03.604 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.605 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.661 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1342e-05 s, 0.0 kB/s 2023-10-16T13:43:03.721 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.721 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.779 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.838 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9822e-05 s, 0.0 kB/s 2023-10-16T13:43:03.839 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.839 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:03.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:03.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:03.955 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:03.955 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:03.955 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1805e-05 s, 0.0 kB/s 2023-10-16T13:43:03.956 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:03.957 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.014 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.071 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.071 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.072 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-16T13:43:04.072 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.072 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.129 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.408e-05 s, 0.0 kB/s 2023-10-16T13:43:04.188 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.188 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.246 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1995e-05 s, 0.0 kB/s 2023-10-16T13:43:04.304 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.305 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.361 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.0149e-05 s, 0.0 kB/s 2023-10-16T13:43:04.419 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.420 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.476 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2682e-05 s, 0.0 kB/s 2023-10-16T13:43:04.535 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.536 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.592 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6435e-05 s, 0.0 kB/s 2023-10-16T13:43:04.651 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.708 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3663e-05 s, 0.0 kB/s 2023-10-16T13:43:04.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5977e-05 s, 0.0 kB/s 2023-10-16T13:43:04.885 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:04.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:04.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:04.944 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4738e-05 s, 0.0 kB/s 2023-10-16T13:43:05.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.003 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.060 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5075e-05 s, 0.0 kB/s 2023-10-16T13:43:05.118 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.119 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.176 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0559e-05 s, 0.0 kB/s 2023-10-16T13:43:05.234 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.234 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.291 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.349 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1509e-05 s, 0.0 kB/s 2023-10-16T13:43:05.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.406 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.462 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.463 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.463 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.146e-05 s, 0.0 kB/s 2023-10-16T13:43:05.464 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.464 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.522 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.580 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.580 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.580 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6311e-05 s, 0.0 kB/s 2023-10-16T13:43:05.581 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.582 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4364e-05 s, 0.0 kB/s 2023-10-16T13:43:05.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.698 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.814 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4476e-05 s, 0.0 kB/s 2023-10-16T13:43:05.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.815 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.872 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3922e-05 s, 0.0 kB/s 2023-10-16T13:43:05.930 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:05.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:05.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:05.987 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1778e-05 s, 0.0 kB/s 2023-10-16T13:43:06.046 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.046 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.162 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2359e-05 s, 0.0 kB/s 2023-10-16T13:43:06.166 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.166 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.224 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5719e-05 s, 0.0 kB/s 2023-10-16T13:43:06.282 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.283 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.339 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3494e-05 s, 0.0 kB/s 2023-10-16T13:43:06.397 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.397 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9719e-05 s, 0.0 kB/s 2023-10-16T13:43:06.512 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.512 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.569 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.627 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.627 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.427e-05 s, 0.0 kB/s 2023-10-16T13:43:06.627 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.628 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.685 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9568e-05 s, 0.0 kB/s 2023-10-16T13:43:06.743 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.744 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.801 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.859 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4313e-05 s, 0.0 kB/s 2023-10-16T13:43:06.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:06.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:06.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.337e-05 s, 0.0 kB/s 2023-10-16T13:43:06.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:06.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2404e-05 s, 0.0 kB/s 2023-10-16T13:43:07.091 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.149 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3867e-05 s, 0.0 kB/s 2023-10-16T13:43:07.208 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.208 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.340 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.341 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.341 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2544e-05 s, 0.0 kB/s 2023-10-16T13:43:07.342 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.343 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.406 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3869e-05 s, 0.0 kB/s 2023-10-16T13:43:07.470 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.471 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.528 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.591 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.592 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6315e-05 s, 0.0 kB/s 2023-10-16T13:43:07.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.593 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9145e-05 s, 0.0 kB/s 2023-10-16T13:43:07.719 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.719 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.780 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8581e-05 s, 0.0 kB/s 2023-10-16T13:43:07.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.842 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:07.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:07.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-16T13:43:07.961 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:07.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.022 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.082 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.082 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.082 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1731e-05 s, 0.0 kB/s 2023-10-16T13:43:08.083 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.083 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.141 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3444e-05 s, 0.0 kB/s 2023-10-16T13:43:08.200 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.258 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2624e-05 s, 0.0 kB/s 2023-10-16T13:43:08.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.317 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.373 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2092e-05 s, 0.0 kB/s 2023-10-16T13:43:08.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.432 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.548 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4438e-05 s, 0.0 kB/s 2023-10-16T13:43:08.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.548 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.606 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4198e-05 s, 0.0 kB/s 2023-10-16T13:43:08.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.666 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.723 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1788e-05 s, 0.0 kB/s 2023-10-16T13:43:08.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.782 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9791e-05 s, 0.0 kB/s 2023-10-16T13:43:08.899 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:08.900 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:08.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:08.957 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.017 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6152e-05 s, 0.0 kB/s 2023-10-16T13:43:09.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.074 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0901e-05 s, 0.0 kB/s 2023-10-16T13:43:09.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.134 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4393e-05 s, 0.0 kB/s 2023-10-16T13:43:09.250 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.250 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.307 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2509e-05 s, 0.0 kB/s 2023-10-16T13:43:09.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.423 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.482 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5354e-05 s, 0.0 kB/s 2023-10-16T13:43:09.482 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.483 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.540 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3163e-05 s, 0.0 kB/s 2023-10-16T13:43:09.598 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.599 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.656 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.713 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.714 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3219e-05 s, 0.0 kB/s 2023-10-16T13:43:09.714 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.771 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5278e-05 s, 0.0 kB/s 2023-10-16T13:43:09.831 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.831 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:09.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:09.888 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1724e-05 s, 0.0 kB/s 2023-10-16T13:43:09.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:09.948 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.005 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.064 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.065 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.158e-05 s, 0.0 kB/s 2023-10-16T13:43:10.065 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.066 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.123 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.182 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2335e-05 s, 0.0 kB/s 2023-10-16T13:43:10.182 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.183 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.239 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000112694 s, 0.0 kB/s 2023-10-16T13:43:10.299 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.299 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.356 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9105e-05 s, 0.0 kB/s 2023-10-16T13:43:10.415 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.416 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.474 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0569e-05 s, 0.0 kB/s 2023-10-16T13:43:10.532 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.532 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.590 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2304e-05 s, 0.0 kB/s 2023-10-16T13:43:10.649 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.650 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.706 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.764 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.765 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.765 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1253e-05 s, 0.0 kB/s 2023-10-16T13:43:10.765 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.766 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.822 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0768e-05 s, 0.0 kB/s 2023-10-16T13:43:10.882 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:10.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:10.939 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:10.996 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000105652 s, 0.0 kB/s 2023-10-16T13:43:10.997 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:10.998 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.055 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3112e-05 s, 0.0 kB/s 2023-10-16T13:43:11.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.116 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3731e-05 s, 0.0 kB/s 2023-10-16T13:43:11.231 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.232 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.291 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1389e-05 s, 0.0 kB/s 2023-10-16T13:43:11.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.408 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4485e-05 s, 0.0 kB/s 2023-10-16T13:43:11.467 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.467 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.524 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3508e-05 s, 0.0 kB/s 2023-10-16T13:43:11.584 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.584 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.641 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2594e-05 s, 0.0 kB/s 2023-10-16T13:43:11.700 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.701 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.758 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2693e-05 s, 0.0 kB/s 2023-10-16T13:43:11.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.816 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:11.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:11.931 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4111e-05 s, 0.0 kB/s 2023-10-16T13:43:11.931 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:11.932 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:11.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:11.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1982e-05 s, 0.0 kB/s 2023-10-16T13:43:12.047 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.047 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.149e-05 s, 0.0 kB/s 2023-10-16T13:43:12.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-16T13:43:12.279 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.279 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8995e-05 s, 0.0 kB/s 2023-10-16T13:43:12.394 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.394 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.452 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0805e-05 s, 0.0 kB/s 2023-10-16T13:43:12.512 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.513 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.569 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.627 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-16T13:43:12.627 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.628 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.684 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1528e-05 s, 0.0 kB/s 2023-10-16T13:43:12.742 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.799 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1825e-05 s, 0.0 kB/s 2023-10-16T13:43:12.859 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.859 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:12.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:12.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2515e-05 s, 0.0 kB/s 2023-10-16T13:43:12.975 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:12.976 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.032 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3831e-05 s, 0.0 kB/s 2023-10-16T13:43:13.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.090 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2659e-05 s, 0.0 kB/s 2023-10-16T13:43:13.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3722e-05 s, 0.0 kB/s 2023-10-16T13:43:13.322 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.322 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.379 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8132e-05 s, 0.0 kB/s 2023-10-16T13:43:13.437 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.438 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.494 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7288e-05 s, 0.0 kB/s 2023-10-16T13:43:13.553 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.553 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.611 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.668 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.668 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.668 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5922e-05 s, 0.0 kB/s 2023-10-16T13:43:13.670 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.670 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.727 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.785 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.785 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.785 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1588e-05 s, 0.0 kB/s 2023-10-16T13:43:13.786 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.786 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.844 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2388e-05 s, 0.0 kB/s 2023-10-16T13:43:13.902 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:13.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:13.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:13.960 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8605e-05 s, 0.0 kB/s 2023-10-16T13:43:14.019 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.019 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.076 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.135 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0995e-05 s, 0.0 kB/s 2023-10-16T13:43:14.135 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.136 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.193 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2142e-05 s, 0.0 kB/s 2023-10-16T13:43:14.253 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.254 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1726e-05 s, 0.0 kB/s 2023-10-16T13:43:14.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.370 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.485 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5358e-05 s, 0.0 kB/s 2023-10-16T13:43:14.486 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.486 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.544 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2143e-05 s, 0.0 kB/s 2023-10-16T13:43:14.603 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.603 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.661 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5164e-05 s, 0.0 kB/s 2023-10-16T13:43:14.719 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.776 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2294e-05 s, 0.0 kB/s 2023-10-16T13:43:14.834 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.835 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:14.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:14.894 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:14.953 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:14.953 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:14.954 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5078e-05 s, 0.0 kB/s 2023-10-16T13:43:14.954 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:14.954 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.012 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1765e-05 s, 0.0 kB/s 2023-10-16T13:43:15.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.128 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-16T13:43:15.187 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.187 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-16T13:43:15.304 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.304 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.361 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1243e-05 s, 0.0 kB/s 2023-10-16T13:43:15.420 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.420 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.477 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.536 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5885e-05 s, 0.0 kB/s 2023-10-16T13:43:15.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.537 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9381e-05 s, 0.0 kB/s 2023-10-16T13:43:15.652 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6414e-05 s, 0.0 kB/s 2023-10-16T13:43:15.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.767 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2133e-05 s, 0.0 kB/s 2023-10-16T13:43:15.883 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:15.884 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:15.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:15.940 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:15.998 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:15.999 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:15.999 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6452e-05 s, 0.0 kB/s 2023-10-16T13:43:15.999 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.000 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.056 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.115 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.115 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.218e-05 s, 0.0 kB/s 2023-10-16T13:43:16.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.116 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0169e-05 s, 0.0 kB/s 2023-10-16T13:43:16.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.231 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2466e-05 s, 0.0 kB/s 2023-10-16T13:43:16.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.346 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4174e-05 s, 0.0 kB/s 2023-10-16T13:43:16.461 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.518 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.576 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0773e-05 s, 0.0 kB/s 2023-10-16T13:43:16.577 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.578 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.693 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4039e-05 s, 0.0 kB/s 2023-10-16T13:43:16.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.750 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.807 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2749e-05 s, 0.0 kB/s 2023-10-16T13:43:16.808 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.808 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:16.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9508e-05 s, 0.0 kB/s 2023-10-16T13:43:16.925 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:16.926 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:16.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:16.982 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.177e-05 s, 0.0 kB/s 2023-10-16T13:43:17.041 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.042 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.098 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.155 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.155 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.155 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4935e-05 s, 0.0 kB/s 2023-10-16T13:43:17.156 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.157 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.214 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.273 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3077e-05 s, 0.0 kB/s 2023-10-16T13:43:17.273 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.273 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.330 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.39e-05 s, 0.0 kB/s 2023-10-16T13:43:17.388 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.389 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.446 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7419e-05 s, 0.0 kB/s 2023-10-16T13:43:17.504 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.504 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.561 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1832e-05 s, 0.0 kB/s 2023-10-16T13:43:17.620 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.621 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.678 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.735 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.736 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.736 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9789e-05 s, 0.0 kB/s 2023-10-16T13:43:17.736 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.737 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0688e-05 s, 0.0 kB/s 2023-10-16T13:43:17.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:17.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:17.909 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3654e-05 s, 0.0 kB/s 2023-10-16T13:43:17.967 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:17.968 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.024 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2872e-05 s, 0.0 kB/s 2023-10-16T13:43:18.083 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.084 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.140 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1749e-05 s, 0.0 kB/s 2023-10-16T13:43:18.199 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2918e-05 s, 0.0 kB/s 2023-10-16T13:43:18.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.315 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.429 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.429 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.429 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5989e-05 s, 0.0 kB/s 2023-10-16T13:43:18.430 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.431 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5149e-05 s, 0.0 kB/s 2023-10-16T13:43:18.546 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9425e-05 s, 0.0 kB/s 2023-10-16T13:43:18.663 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.664 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.720 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8691e-05 s, 0.0 kB/s 2023-10-16T13:43:18.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.779 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:18.895 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.608e-05 s, 0.0 kB/s 2023-10-16T13:43:18.896 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:18.896 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:18.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:18.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3931e-05 s, 0.0 kB/s 2023-10-16T13:43:19.013 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.013 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.072 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4045e-05 s, 0.0 kB/s 2023-10-16T13:43:19.131 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.132 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.189 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.247 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.247 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.247 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0024e-05 s, 0.0 kB/s 2023-10-16T13:43:19.248 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.248 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.306 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0636e-05 s, 0.0 kB/s 2023-10-16T13:43:19.365 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.366 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.422 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.484 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2841e-05 s, 0.0 kB/s 2023-10-16T13:43:19.485 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.485 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.543 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.602 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1672e-05 s, 0.0 kB/s 2023-10-16T13:43:19.602 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.603 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.660 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.718 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4596e-05 s, 0.0 kB/s 2023-10-16T13:43:19.719 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.719 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1305e-05 s, 0.0 kB/s 2023-10-16T13:43:19.837 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:19.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:19.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:19.955 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:19.955 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5677e-05 s, 0.0 kB/s 2023-10-16T13:43:19.956 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:19.956 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.014 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.072 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.072 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.072 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6952e-05 s, 0.0 kB/s 2023-10-16T13:43:20.073 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.073 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.132 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.189 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3272e-05 s, 0.0 kB/s 2023-10-16T13:43:20.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.190 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.249 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2141e-05 s, 0.0 kB/s 2023-10-16T13:43:20.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.308 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.366 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.424 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9198e-05 s, 0.0 kB/s 2023-10-16T13:43:20.425 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.425 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.483 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.541 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1943e-05 s, 0.0 kB/s 2023-10-16T13:43:20.543 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.600 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5588e-05 s, 0.0 kB/s 2023-10-16T13:43:20.659 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.659 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.716 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.775 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.775 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.775 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2152e-05 s, 0.0 kB/s 2023-10-16T13:43:20.776 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.776 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.833 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4551e-05 s, 0.0 kB/s 2023-10-16T13:43:20.893 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:20.893 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:20.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:20.950 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.008 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.009 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.009 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.8011e-05 s, 0.0 kB/s 2023-10-16T13:43:21.009 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.010 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.066 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1793e-05 s, 0.0 kB/s 2023-10-16T13:43:21.126 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.127 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.184 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5588e-05 s, 0.0 kB/s 2023-10-16T13:43:21.243 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.243 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.299 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.358 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5328e-05 s, 0.0 kB/s 2023-10-16T13:43:21.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.415 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1541e-05 s, 0.0 kB/s 2023-10-16T13:43:21.474 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.474 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.531 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.428e-05 s, 0.0 kB/s 2023-10-16T13:43:21.590 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.590 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.648 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4001e-05 s, 0.0 kB/s 2023-10-16T13:43:21.707 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.708 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.822 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.823 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.823 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4755e-05 s, 0.0 kB/s 2023-10-16T13:43:21.823 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.824 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2175e-05 s, 0.0 kB/s 2023-10-16T13:43:21.939 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:21.940 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:21.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:21.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100069 s, 0.0 kB/s 2023-10-16T13:43:22.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.112 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6726e-05 s, 0.0 kB/s 2023-10-16T13:43:22.172 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.228 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3815e-05 s, 0.0 kB/s 2023-10-16T13:43:22.286 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.287 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.344 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.017e-05 s, 0.0 kB/s 2023-10-16T13:43:22.402 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.403 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.460 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1843e-05 s, 0.0 kB/s 2023-10-16T13:43:22.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.518 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.575 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.633 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3838e-05 s, 0.0 kB/s 2023-10-16T13:43:22.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7581e-05 s, 0.0 kB/s 2023-10-16T13:43:22.752 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.752 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-16T13:43:22.867 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.868 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:22.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:22.924 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3479e-05 s, 0.0 kB/s 2023-10-16T13:43:22.983 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:22.984 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.041 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8469e-05 s, 0.0 kB/s 2023-10-16T13:43:23.099 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.159 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.217 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3831e-05 s, 0.0 kB/s 2023-10-16T13:43:23.217 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.218 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.334 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.334 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.334 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2201e-05 s, 0.0 kB/s 2023-10-16T13:43:23.335 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.335 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.392 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.452 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.452 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5755e-05 s, 0.0 kB/s 2023-10-16T13:43:23.452 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.453 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.510 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.568 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.9065e-05 s, 0.0 kB/s 2023-10-16T13:43:23.569 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.569 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.627 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.687 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.687 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1302e-05 s, 0.0 kB/s 2023-10-16T13:43:23.687 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.688 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.744 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0498e-05 s, 0.0 kB/s 2023-10-16T13:43:23.804 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.804 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.861 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5901e-05 s, 0.0 kB/s 2023-10-16T13:43:23.919 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:23.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:23.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:23.976 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3551e-05 s, 0.0 kB/s 2023-10-16T13:43:24.036 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.036 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.094 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0879e-05 s, 0.0 kB/s 2023-10-16T13:43:24.153 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.153 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.212 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.269 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.270 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1444e-05 s, 0.0 kB/s 2023-10-16T13:43:24.271 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.271 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.330 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.388 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0457e-05 s, 0.0 kB/s 2023-10-16T13:43:24.389 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.389 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.446 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0811e-05 s, 0.0 kB/s 2023-10-16T13:43:24.505 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.505 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.563 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1608e-05 s, 0.0 kB/s 2023-10-16T13:43:24.622 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.679 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.738 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.739 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4224e-05 s, 0.0 kB/s 2023-10-16T13:43:24.739 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.739 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4392e-05 s, 0.0 kB/s 2023-10-16T13:43:24.857 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.858 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:24.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:24.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3288e-05 s, 0.0 kB/s 2023-10-16T13:43:24.974 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:24.974 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.032 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8723e-05 s, 0.0 kB/s 2023-10-16T13:43:25.091 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.148 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0295e-05 s, 0.0 kB/s 2023-10-16T13:43:25.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0251e-05 s, 0.0 kB/s 2023-10-16T13:43:25.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.323 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.381 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.441 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7438e-05 s, 0.0 kB/s 2023-10-16T13:43:25.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.556 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.556 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6408e-05 s, 0.0 kB/s 2023-10-16T13:43:25.556 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.613 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5198e-05 s, 0.0 kB/s 2023-10-16T13:43:25.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.728 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.785 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2911e-05 s, 0.0 kB/s 2023-10-16T13:43:25.786 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.787 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.843 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:25.901 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:25.901 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:25.901 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4658e-05 s, 0.0 kB/s 2023-10-16T13:43:25.902 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:25.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:25.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:25.960 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1261e-05 s, 0.0 kB/s 2023-10-16T13:43:26.020 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.020 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.077 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3234e-05 s, 0.0 kB/s 2023-10-16T13:43:26.136 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.136 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.193 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.250 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.251 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1389e-05 s, 0.0 kB/s 2023-10-16T13:43:26.251 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.251 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.308 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1713e-05 s, 0.0 kB/s 2023-10-16T13:43:26.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.366 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.426 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6753e-05 s, 0.0 kB/s 2023-10-16T13:43:26.484 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.485 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.541 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.600 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3305e-05 s, 0.0 kB/s 2023-10-16T13:43:26.600 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.717 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4295e-05 s, 0.0 kB/s 2023-10-16T13:43:26.717 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.774 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.837 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4378e-05 s, 0.0 kB/s 2023-10-16T13:43:26.837 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.837 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:26.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:26.894 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:26.952 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5748e-05 s, 0.0 kB/s 2023-10-16T13:43:26.953 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:26.954 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.011 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1552e-05 s, 0.0 kB/s 2023-10-16T13:43:27.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.185 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3147e-05 s, 0.0 kB/s 2023-10-16T13:43:27.185 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.185 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.242 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0154e-05 s, 0.0 kB/s 2023-10-16T13:43:27.300 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.300 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.357 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.415 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.415 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9182e-05 s, 0.0 kB/s 2023-10-16T13:43:27.415 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.416 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.472 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.529 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.529 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.529 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9516e-05 s, 0.0 kB/s 2023-10-16T13:43:27.530 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.530 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.587 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4749e-05 s, 0.0 kB/s 2023-10-16T13:43:27.646 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.646 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.703 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.760 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.761 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9858e-05 s, 0.0 kB/s 2023-10-16T13:43:27.761 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.762 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.818 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.877 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.877 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.0005e-05 s, 0.0 kB/s 2023-10-16T13:43:27.877 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.878 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:27.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:27.934 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:27.992 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:27.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:27.993 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0177e-05 s, 0.0 kB/s 2023-10-16T13:43:27.993 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:27.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:43:28.035 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:43:28.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.052 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6012e-05 s, 0.0 kB/s 2023-10-16T13:43:28.151 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.151 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.208 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2336e-05 s, 0.0 kB/s 2023-10-16T13:43:28.267 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.267 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3415e-05 s, 0.0 kB/s 2023-10-16T13:43:28.382 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.382 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.496 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0941e-05 s, 0.0 kB/s 2023-10-16T13:43:28.497 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.498 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.554 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1628e-05 s, 0.0 kB/s 2023-10-16T13:43:28.613 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.614 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.670 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0118e-05 s, 0.0 kB/s 2023-10-16T13:43:28.730 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.730 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.787 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.368e-05 s, 0.0 kB/s 2023-10-16T13:43:28.847 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.848 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:28.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:28.904 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0587e-05 s, 0.0 kB/s 2023-10-16T13:43:28.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:28.964 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.021 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3072e-05 s, 0.0 kB/s 2023-10-16T13:43:29.080 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.080 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.137 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7188e-05 s, 0.0 kB/s 2023-10-16T13:43:29.195 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.196 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.252 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.256e-05 s, 0.0 kB/s 2023-10-16T13:43:29.311 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.312 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.368 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9915e-05 s, 0.0 kB/s 2023-10-16T13:43:29.426 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.427 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.485 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.542 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.543 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-16T13:43:29.543 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.659 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.659 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1344e-05 s, 0.0 kB/s 2023-10-16T13:43:29.659 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.660 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.716 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3304e-05 s, 0.0 kB/s 2023-10-16T13:43:29.774 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.774 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.833 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.914e-05 s, 0.0 kB/s 2023-10-16T13:43:29.892 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:29.892 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:29.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:29.950 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1229e-05 s, 0.0 kB/s 2023-10-16T13:43:30.009 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.009 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.066 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106504 s, 0.0 kB/s 2023-10-16T13:43:30.125 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.125 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.183 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4055e-05 s, 0.0 kB/s 2023-10-16T13:43:30.243 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.243 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.299 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4611e-05 s, 0.0 kB/s 2023-10-16T13:43:30.357 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.357 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.414 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106126 s, 0.0 kB/s 2023-10-16T13:43:30.472 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.473 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.530 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3818e-05 s, 0.0 kB/s 2023-10-16T13:43:30.589 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.589 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.647 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0645e-05 s, 0.0 kB/s 2023-10-16T13:43:30.706 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.707 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.764 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3405e-05 s, 0.0 kB/s 2023-10-16T13:43:30.822 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.823 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4059e-05 s, 0.0 kB/s 2023-10-16T13:43:30.939 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:30.939 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:30.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:30.996 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2816e-05 s, 0.0 kB/s 2023-10-16T13:43:31.055 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.055 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.112 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4467e-05 s, 0.0 kB/s 2023-10-16T13:43:31.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.171 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.228 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3895e-05 s, 0.0 kB/s 2023-10-16T13:43:31.287 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.288 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.344 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.402 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4906e-05 s, 0.0 kB/s 2023-10-16T13:43:31.403 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.404 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.460 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1665e-05 s, 0.0 kB/s 2023-10-16T13:43:31.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.519 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.575 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.632 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.633 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.633 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2576e-05 s, 0.0 kB/s 2023-10-16T13:43:31.633 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.633 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.690 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1909e-05 s, 0.0 kB/s 2023-10-16T13:43:31.749 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.750 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.806 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3086e-05 s, 0.0 kB/s 2023-10-16T13:43:31.864 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.865 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:31.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:31.921 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:31.978 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4018e-05 s, 0.0 kB/s 2023-10-16T13:43:31.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:31.980 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-16T13:43:32.095 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.096 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.153 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3021e-05 s, 0.0 kB/s 2023-10-16T13:43:32.212 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.212 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.269 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3516e-05 s, 0.0 kB/s 2023-10-16T13:43:32.327 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.328 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.385 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2987e-05 s, 0.0 kB/s 2023-10-16T13:43:32.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.443 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2983e-05 s, 0.0 kB/s 2023-10-16T13:43:32.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.559 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5078e-05 s, 0.0 kB/s 2023-10-16T13:43:32.674 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.675 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.732 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8355e-05 s, 0.0 kB/s 2023-10-16T13:43:32.790 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.791 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.848 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7181e-05 s, 0.0 kB/s 2023-10-16T13:43:32.907 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:32.907 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:32.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:32.965 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.062 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2215e-05 s, 0.0 kB/s 2023-10-16T13:43:33.062 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.083 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1062e-05 s, 0.0 kB/s 2023-10-16T13:43:33.145 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.146 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.204 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.266 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.266 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.266 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4356e-05 s, 0.0 kB/s 2023-10-16T13:43:33.267 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.267 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.7079e-05 s, 0.0 kB/s 2023-10-16T13:43:33.387 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.387 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.447 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5388e-05 s, 0.0 kB/s 2023-10-16T13:43:33.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.566 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5089e-05 s, 0.0 kB/s 2023-10-16T13:43:33.625 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.626 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.682 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-16T13:43:33.743 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.744 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.800 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.539e-05 s, 0.0 kB/s 2023-10-16T13:43:33.859 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:33.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:33.918 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8695e-05 s, 0.0 kB/s 2023-10-16T13:43:33.977 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:33.978 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1141e-05 s, 0.0 kB/s 2023-10-16T13:43:34.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.151 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5496e-05 s, 0.0 kB/s 2023-10-16T13:43:34.211 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.211 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.269 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.327 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.327 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8882e-05 s, 0.0 kB/s 2023-10-16T13:43:34.327 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.328 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.385 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102008 s, 0.0 kB/s 2023-10-16T13:43:34.444 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.444 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.501 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6428e-05 s, 0.0 kB/s 2023-10-16T13:43:34.559 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.560 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.617 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4085e-05 s, 0.0 kB/s 2023-10-16T13:43:34.676 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.677 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.733 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1275e-05 s, 0.0 kB/s 2023-10-16T13:43:34.792 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.792 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.850 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4637e-05 s, 0.0 kB/s 2023-10-16T13:43:34.908 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:34.909 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:34.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:34.966 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4656e-05 s, 0.0 kB/s 2023-10-16T13:43:35.024 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.025 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.141 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0511e-05 s, 0.0 kB/s 2023-10-16T13:43:35.142 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.142 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.199 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.258 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.259 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1642e-05 s, 0.0 kB/s 2023-10-16T13:43:35.259 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.259 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.317 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.374 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.375 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0531e-05 s, 0.0 kB/s 2023-10-16T13:43:35.376 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.376 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.434 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1045e-05 s, 0.0 kB/s 2023-10-16T13:43:35.493 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.493 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.550 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2738e-05 s, 0.0 kB/s 2023-10-16T13:43:35.610 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.610 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.667 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.725 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.726 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8109e-05 s, 0.0 kB/s 2023-10-16T13:43:35.726 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.727 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1907e-05 s, 0.0 kB/s 2023-10-16T13:43:35.843 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:35.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:35.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1589e-05 s, 0.0 kB/s 2023-10-16T13:43:35.959 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:35.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.016 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.9021e-05 s, 0.0 kB/s 2023-10-16T13:43:36.074 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.075 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7062e-05 s, 0.0 kB/s 2023-10-16T13:43:36.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.191 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.248 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.306 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.306 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4129e-05 s, 0.0 kB/s 2023-10-16T13:43:36.307 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.307 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.423 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.423 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.423 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6181e-05 s, 0.0 kB/s 2023-10-16T13:43:36.423 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.424 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.480 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-16T13:43:36.538 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.538 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.595 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1556e-05 s, 0.0 kB/s 2023-10-16T13:43:36.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.654 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.0659e-05 s, 0.0 kB/s 2023-10-16T13:43:36.770 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.771 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.827 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.344e-05 s, 0.0 kB/s 2023-10-16T13:43:36.886 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:36.887 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:36.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:36.943 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.001 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.002 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5515e-05 s, 0.0 kB/s 2023-10-16T13:43:37.002 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.003 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.059 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4409e-05 s, 0.0 kB/s 2023-10-16T13:43:37.118 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.119 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.175 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0842e-05 s, 0.0 kB/s 2023-10-16T13:43:37.233 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.233 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.1648e-05 s, 0.0 kB/s 2023-10-16T13:43:37.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.349 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.406 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2115e-05 s, 0.0 kB/s 2023-10-16T13:43:37.464 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.465 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.581 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.046e-05 s, 0.0 kB/s 2023-10-16T13:43:37.581 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.581 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.638 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.697 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0252e-05 s, 0.0 kB/s 2023-10-16T13:43:37.697 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.697 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.754 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1587e-05 s, 0.0 kB/s 2023-10-16T13:43:37.813 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.813 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.871 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0292e-05 s, 0.0 kB/s 2023-10-16T13:43:37.929 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:37.929 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:37.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:37.986 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2051e-05 s, 0.0 kB/s 2023-10-16T13:43:38.044 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.044 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0119e-05 s, 0.0 kB/s 2023-10-16T13:43:38.160 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.161 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2465e-05 s, 0.0 kB/s 2023-10-16T13:43:38.275 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.276 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.333 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.391 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-16T13:43:38.392 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.392 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.509 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3444e-05 s, 0.0 kB/s 2023-10-16T13:43:38.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.510 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.626 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.6232e-05 s, 0.0 kB/s 2023-10-16T13:43:38.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.684 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4344e-05 s, 0.0 kB/s 2023-10-16T13:43:38.742 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.799 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0104e-05 s, 0.0 kB/s 2023-10-16T13:43:38.858 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.859 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:38.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:38.916 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2688e-05 s, 0.0 kB/s 2023-10-16T13:43:38.975 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:38.976 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.032 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102908 s, 0.0 kB/s 2023-10-16T13:43:39.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.204 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.204 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.205 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1752e-05 s, 0.0 kB/s 2023-10-16T13:43:39.205 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.205 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.262 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.320 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2044e-05 s, 0.0 kB/s 2023-10-16T13:43:39.322 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.322 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1208e-05 s, 0.0 kB/s 2023-10-16T13:43:39.440 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.440 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.497 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.554 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4161e-05 s, 0.0 kB/s 2023-10-16T13:43:39.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.555 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8575e-05 s, 0.0 kB/s 2023-10-16T13:43:39.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.671 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.727 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.784 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0707e-05 s, 0.0 kB/s 2023-10-16T13:43:39.785 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.786 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.842 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106285 s, 0.0 kB/s 2023-10-16T13:43:39.900 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:39.901 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:39.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:39.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5412e-05 s, 0.0 kB/s 2023-10-16T13:43:40.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.074 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3832e-05 s, 0.0 kB/s 2023-10-16T13:43:40.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.133 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.190 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.247 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.248 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2491e-05 s, 0.0 kB/s 2023-10-16T13:43:40.248 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.248 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.305 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3309e-05 s, 0.0 kB/s 2023-10-16T13:43:40.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.420 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1289e-05 s, 0.0 kB/s 2023-10-16T13:43:40.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.536 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5169e-05 s, 0.0 kB/s 2023-10-16T13:43:40.594 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.594 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.652 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.709 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.709 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.709 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.7823e-05 s, 0.0 kB/s 2023-10-16T13:43:40.709 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.710 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.767 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1708e-05 s, 0.0 kB/s 2023-10-16T13:43:40.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.882 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000103678 s, 0.0 kB/s 2023-10-16T13:43:40.940 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:40.941 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:40.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:40.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6629e-05 s, 0.0 kB/s 2023-10-16T13:43:41.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.057 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.114 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0724e-05 s, 0.0 kB/s 2023-10-16T13:43:41.172 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.229 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0208e-05 s, 0.0 kB/s 2023-10-16T13:43:41.287 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.287 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.345 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9961e-05 s, 0.0 kB/s 2023-10-16T13:43:41.403 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.403 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.460 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7795e-05 s, 0.0 kB/s 2023-10-16T13:43:41.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.520 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1462e-05 s, 0.0 kB/s 2023-10-16T13:43:41.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.692 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0773e-05 s, 0.0 kB/s 2023-10-16T13:43:41.751 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.752 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.808 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.866 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.866 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.867 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4716e-05 s, 0.0 kB/s 2023-10-16T13:43:41.868 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.868 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:41.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:41.925 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:41.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:41.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:41.982 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0734e-05 s, 0.0 kB/s 2023-10-16T13:43:41.983 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:41.984 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.041 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.099 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1255e-05 s, 0.0 kB/s 2023-10-16T13:43:42.099 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.156 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9157e-05 s, 0.0 kB/s 2023-10-16T13:43:42.214 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.214 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.271 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.329 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9855e-05 s, 0.0 kB/s 2023-10-16T13:43:42.329 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.329 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.386 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9698e-05 s, 0.0 kB/s 2023-10-16T13:43:42.444 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.445 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.502 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4365e-05 s, 0.0 kB/s 2023-10-16T13:43:42.561 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.561 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.618 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5101e-05 s, 0.0 kB/s 2023-10-16T13:43:42.676 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.676 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.733 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4102e-05 s, 0.0 kB/s 2023-10-16T13:43:42.793 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.851 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:42.908 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:42.908 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:42.908 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4434e-05 s, 0.0 kB/s 2023-10-16T13:43:42.909 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:42.910 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:42.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:42.967 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.026 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2994e-05 s, 0.0 kB/s 2023-10-16T13:43:43.026 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.026 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.083 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.141 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5172e-05 s, 0.0 kB/s 2023-10-16T13:43:43.141 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.142 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.199 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.256 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5492e-05 s, 0.0 kB/s 2023-10-16T13:43:43.257 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.258 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2596e-05 s, 0.0 kB/s 2023-10-16T13:43:43.373 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.374 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.430 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4288e-05 s, 0.0 kB/s 2023-10-16T13:43:43.490 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.490 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.548 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0975e-05 s, 0.0 kB/s 2023-10-16T13:43:43.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.613 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.674 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0717e-05 s, 0.0 kB/s 2023-10-16T13:43:43.737 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.737 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.799 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2239e-05 s, 0.0 kB/s 2023-10-16T13:43:43.857 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:43.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:43.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.0581e-05 s, 0.0 kB/s 2023-10-16T13:43:43.977 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:43.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.037 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.094 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4975e-05 s, 0.0 kB/s 2023-10-16T13:43:44.096 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.096 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.153 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6095e-05 s, 0.0 kB/s 2023-10-16T13:43:44.213 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.213 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.270 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1655e-05 s, 0.0 kB/s 2023-10-16T13:43:44.330 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.330 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.388 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.447 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1825e-05 s, 0.0 kB/s 2023-10-16T13:43:44.447 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.448 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.505 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1786e-05 s, 0.0 kB/s 2023-10-16T13:43:44.563 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.564 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.352e-05 s, 0.0 kB/s 2023-10-16T13:43:44.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.737 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.794 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3764e-05 s, 0.0 kB/s 2023-10-16T13:43:44.795 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.796 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.852 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:44.911 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:44.911 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6122e-05 s, 0.0 kB/s 2023-10-16T13:43:44.911 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:44.912 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:44.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:44.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.157e-05 s, 0.0 kB/s 2023-10-16T13:43:45.027 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.028 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.084 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3676e-05 s, 0.0 kB/s 2023-10-16T13:43:45.144 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.144 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.201 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.258 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0486e-05 s, 0.0 kB/s 2023-10-16T13:43:45.259 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.316 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.374 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.375 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1397e-05 s, 0.0 kB/s 2023-10-16T13:43:45.375 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.376 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.432 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.490 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9453e-05 s, 0.0 kB/s 2023-10-16T13:43:45.491 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.492 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.549 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-16T13:43:45.607 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.608 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.666 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7638e-05 s, 0.0 kB/s 2023-10-16T13:43:45.725 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.725 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.783 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.843 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.843 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.844 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4846e-05 s, 0.0 kB/s 2023-10-16T13:43:45.844 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.844 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:45.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:45.902 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6744e-05 s, 0.0 kB/s 2023-10-16T13:43:45.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:45.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.017 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2057e-05 s, 0.0 kB/s 2023-10-16T13:43:46.076 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.133 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3489e-05 s, 0.0 kB/s 2023-10-16T13:43:46.192 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.193 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1758e-05 s, 0.0 kB/s 2023-10-16T13:43:46.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.309 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.365 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000109391 s, 0.0 kB/s 2023-10-16T13:43:46.424 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.424 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.481 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.36e-05 s, 0.0 kB/s 2023-10-16T13:43:46.540 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.541 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.597 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0048e-05 s, 0.0 kB/s 2023-10-16T13:43:46.656 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.657 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.714 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3891e-05 s, 0.0 kB/s 2023-10-16T13:43:46.772 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.773 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.829 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.281e-05 s, 0.0 kB/s 2023-10-16T13:43:46.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:46.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:46.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:46.945 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.363e-05 s, 0.0 kB/s 2023-10-16T13:43:47.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.003 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7557e-05 s, 0.0 kB/s 2023-10-16T13:43:47.119 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.120 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.176 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2218e-05 s, 0.0 kB/s 2023-10-16T13:43:47.235 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.236 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.292 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2973e-05 s, 0.0 kB/s 2023-10-16T13:43:47.350 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.407 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2386e-05 s, 0.0 kB/s 2023-10-16T13:43:47.465 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0722e-05 s, 0.0 kB/s 2023-10-16T13:43:47.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.582 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.640 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2741e-05 s, 0.0 kB/s 2023-10-16T13:43:47.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0359e-05 s, 0.0 kB/s 2023-10-16T13:43:47.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.815 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.872 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5318e-05 s, 0.0 kB/s 2023-10-16T13:43:47.931 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:47.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:47.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:47.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2602e-05 s, 0.0 kB/s 2023-10-16T13:43:48.046 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.046 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000118349 s, 0.0 kB/s 2023-10-16T13:43:48.162 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.163 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.219 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.276 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0667e-05 s, 0.0 kB/s 2023-10-16T13:43:48.277 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.277 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.334 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0417e-05 s, 0.0 kB/s 2023-10-16T13:43:48.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.392 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.508 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1014e-05 s, 0.0 kB/s 2023-10-16T13:43:48.508 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0968e-05 s, 0.0 kB/s 2023-10-16T13:43:48.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.624 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.680 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.737 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.737 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.737 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0633e-05 s, 0.0 kB/s 2023-10-16T13:43:48.738 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.738 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.796 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.429e-05 s, 0.0 kB/s 2023-10-16T13:43:48.855 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.855 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:48.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:48.916 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-16T13:43:48.977 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:48.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3891e-05 s, 0.0 kB/s 2023-10-16T13:43:49.095 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.095 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.156 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8868e-05 s, 0.0 kB/s 2023-10-16T13:43:49.219 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.219 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.277 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2779e-05 s, 0.0 kB/s 2023-10-16T13:43:49.338 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.338 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.396 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.455 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2026e-05 s, 0.0 kB/s 2023-10-16T13:43:49.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.455 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.516 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.186e-05 s, 0.0 kB/s 2023-10-16T13:43:49.577 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.577 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3458e-05 s, 0.0 kB/s 2023-10-16T13:43:49.695 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.695 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.755 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0805e-05 s, 0.0 kB/s 2023-10-16T13:43:49.814 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.814 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:49.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:49.932 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:49.932 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-16T13:43:49.932 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:49.933 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:49.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:49.990 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3679e-05 s, 0.0 kB/s 2023-10-16T13:43:50.048 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.049 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.105 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.384e-05 s, 0.0 kB/s 2023-10-16T13:43:50.163 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.220 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.279 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2678e-05 s, 0.0 kB/s 2023-10-16T13:43:50.279 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.394 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.394 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.394 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1079e-05 s, 0.0 kB/s 2023-10-16T13:43:50.395 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.395 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.452 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1525e-05 s, 0.0 kB/s 2023-10-16T13:43:50.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.511 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.567 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.624 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6174e-05 s, 0.0 kB/s 2023-10-16T13:43:50.625 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.626 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4047e-05 s, 0.0 kB/s 2023-10-16T13:43:50.742 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.800 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.045e-05 s, 0.0 kB/s 2023-10-16T13:43:50.859 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.859 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:50.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:50.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:50.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:50.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:50.975 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0612e-05 s, 0.0 kB/s 2023-10-16T13:43:50.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:50.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.034 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.235e-05 s, 0.0 kB/s 2023-10-16T13:43:51.092 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.092 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5084e-05 s, 0.0 kB/s 2023-10-16T13:43:51.210 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.210 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.268 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.326 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2801e-05 s, 0.0 kB/s 2023-10-16T13:43:51.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.383 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2959e-05 s, 0.0 kB/s 2023-10-16T13:43:51.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.499 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6449e-05 s, 0.0 kB/s 2023-10-16T13:43:51.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.559 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.672 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1985e-05 s, 0.0 kB/s 2023-10-16T13:43:51.673 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.674 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.730 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7058e-05 s, 0.0 kB/s 2023-10-16T13:43:51.788 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.789 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.848 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2169e-05 s, 0.0 kB/s 2023-10-16T13:43:51.907 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:51.907 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:51.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:51.965 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2094e-05 s, 0.0 kB/s 2023-10-16T13:43:52.024 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.024 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2554e-05 s, 0.0 kB/s 2023-10-16T13:43:52.141 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.141 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.198 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.257 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.257 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101148 s, 0.0 kB/s 2023-10-16T13:43:52.257 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.258 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1604e-05 s, 0.0 kB/s 2023-10-16T13:43:52.373 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.374 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.431 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3279e-05 s, 0.0 kB/s 2023-10-16T13:43:52.489 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.489 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.546 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.603 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.604 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.604 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3276e-05 s, 0.0 kB/s 2023-10-16T13:43:52.604 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.605 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.661 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0491e-05 s, 0.0 kB/s 2023-10-16T13:43:52.720 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.721 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.337e-05 s, 0.0 kB/s 2023-10-16T13:43:52.836 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.836 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:52.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:52.893 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9592e-05 s, 0.0 kB/s 2023-10-16T13:43:52.953 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:52.953 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.011 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-16T13:43:53.071 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.128 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000115561 s, 0.0 kB/s 2023-10-16T13:43:53.187 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.188 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1309e-05 s, 0.0 kB/s 2023-10-16T13:43:53.302 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.302 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.359 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9191e-05 s, 0.0 kB/s 2023-10-16T13:43:53.418 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.418 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.476 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.535 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2858e-05 s, 0.0 kB/s 2023-10-16T13:43:53.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.536 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3816e-05 s, 0.0 kB/s 2023-10-16T13:43:53.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.711 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2194e-05 s, 0.0 kB/s 2023-10-16T13:43:53.770 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.770 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.827 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7691e-05 s, 0.0 kB/s 2023-10-16T13:43:53.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:53.887 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:53.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:53.945 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.004 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.004 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.004 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.322e-05 s, 0.0 kB/s 2023-10-16T13:43:54.005 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.005 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.062 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.121 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1742e-05 s, 0.0 kB/s 2023-10-16T13:43:54.121 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.121 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.178 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.236 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2059e-05 s, 0.0 kB/s 2023-10-16T13:43:54.236 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.237 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.293 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5247e-05 s, 0.0 kB/s 2023-10-16T13:43:54.353 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.353 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.410 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.42e-05 s, 0.0 kB/s 2023-10-16T13:43:54.469 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.470 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.526 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.139e-05 s, 0.0 kB/s 2023-10-16T13:43:54.584 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.584 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.643 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-16T13:43:54.702 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.702 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.759 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4222e-05 s, 0.0 kB/s 2023-10-16T13:43:54.817 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.874 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.3297e-05 s, 0.0 kB/s 2023-10-16T13:43:54.935 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:54.935 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:54.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:54.993 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.051 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.051 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-16T13:43:55.051 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.052 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.167 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.167 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.167 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6682e-05 s, 0.0 kB/s 2023-10-16T13:43:55.167 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.168 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.225 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.284 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.284 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.284 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4662e-05 s, 0.0 kB/s 2023-10-16T13:43:55.284 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.285 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.342 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.401 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2014e-05 s, 0.0 kB/s 2023-10-16T13:43:55.401 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.402 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.459 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2667e-05 s, 0.0 kB/s 2023-10-16T13:43:55.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.518 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.576 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.634 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2659e-05 s, 0.0 kB/s 2023-10-16T13:43:55.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.692 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4008e-05 s, 0.0 kB/s 2023-10-16T13:43:55.751 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.751 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9994e-05 s, 0.0 kB/s 2023-10-16T13:43:55.868 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.868 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:55.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:55.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:55.983 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:55.984 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2517e-05 s, 0.0 kB/s 2023-10-16T13:43:55.984 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:55.985 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.041 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.100 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7091e-05 s, 0.0 kB/s 2023-10-16T13:43:56.101 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.101 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.158 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5734e-05 s, 0.0 kB/s 2023-10-16T13:43:56.218 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.218 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.275 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2999e-05 s, 0.0 kB/s 2023-10-16T13:43:56.335 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.335 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.392 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4112e-05 s, 0.0 kB/s 2023-10-16T13:43:56.451 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.452 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.509 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1441e-05 s, 0.0 kB/s 2023-10-16T13:43:56.567 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.568 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.625 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4975e-05 s, 0.0 kB/s 2023-10-16T13:43:56.684 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.684 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2212e-05 s, 0.0 kB/s 2023-10-16T13:43:56.799 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.800 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.856 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3305e-05 s, 0.0 kB/s 2023-10-16T13:43:56.915 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:56.915 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:56.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:56.972 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3414e-05 s, 0.0 kB/s 2023-10-16T13:43:57.032 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.032 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.089 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.193e-05 s, 0.0 kB/s 2023-10-16T13:43:57.147 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.148 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.205 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.263 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.06e-05 s, 0.0 kB/s 2023-10-16T13:43:57.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.321 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.379 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.380 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2736e-05 s, 0.0 kB/s 2023-10-16T13:43:57.380 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.381 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.495 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1625e-05 s, 0.0 kB/s 2023-10-16T13:43:57.496 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.497 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.302e-05 s, 0.0 kB/s 2023-10-16T13:43:57.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.044e-05 s, 0.0 kB/s 2023-10-16T13:43:57.727 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.728 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2125e-05 s, 0.0 kB/s 2023-10-16T13:43:57.843 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:57.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:57.902 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7928e-05 s, 0.0 kB/s 2023-10-16T13:43:57.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:57.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.018 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0746e-05 s, 0.0 kB/s 2023-10-16T13:43:58.076 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:43:58.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.134 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:43:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2122e-05 s, 0.0 kB/s 2023-10-16T13:43:58.193 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.193 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0884e-05 s, 0.0 kB/s 2023-10-16T13:43:58.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1416e-05 s, 0.0 kB/s 2023-10-16T13:43:58.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.499 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4824e-05 s, 0.0 kB/s 2023-10-16T13:43:58.559 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.559 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.616 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0904e-05 s, 0.0 kB/s 2023-10-16T13:43:58.675 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.676 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.732 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.790 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1109e-05 s, 0.0 kB/s 2023-10-16T13:43:58.791 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.792 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.848 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-16T13:43:58.907 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:58.907 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:58.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:58.964 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1824e-05 s, 0.0 kB/s 2023-10-16T13:43:59.025 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.025 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1722e-05 s, 0.0 kB/s 2023-10-16T13:43:59.141 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.142 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.198 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100814 s, 0.0 kB/s 2023-10-16T13:43:59.257 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.258 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.314 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.373 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2422e-05 s, 0.0 kB/s 2023-10-16T13:43:59.374 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.374 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.432 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.490 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.491 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.491 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1177e-05 s, 0.0 kB/s 2023-10-16T13:43:59.491 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.492 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.548 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1151e-05 s, 0.0 kB/s 2023-10-16T13:43:59.608 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.608 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.666 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.723 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6154e-05 s, 0.0 kB/s 2023-10-16T13:43:59.725 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.725 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.498e-05 s, 0.0 kB/s 2023-10-16T13:43:59.843 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:43:59.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:43:59.901 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:43:59.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:43:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:43:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9569e-05 s, 0.0 kB/s 2023-10-16T13:43:59.961 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:43:59.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.020 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.078 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4326e-05 s, 0.0 kB/s 2023-10-16T13:44:00.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.079 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.135 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.192 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4932e-05 s, 0.0 kB/s 2023-10-16T13:44:00.193 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.194 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.251 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3285e-05 s, 0.0 kB/s 2023-10-16T13:44:00.309 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.309 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.366 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.425 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4498e-05 s, 0.0 kB/s 2023-10-16T13:44:00.425 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.426 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.483 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.541 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3423e-05 s, 0.0 kB/s 2023-10-16T13:44:00.541 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.541 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.598 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.657 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.315e-05 s, 0.0 kB/s 2023-10-16T13:44:00.657 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.657 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.714 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.772 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.772 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1699e-05 s, 0.0 kB/s 2023-10-16T13:44:00.773 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.773 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.830 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:00.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:00.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:00.887 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2547e-05 s, 0.0 kB/s 2023-10-16T13:44:00.888 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:00.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:00.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:00.945 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2598e-05 s, 0.0 kB/s 2023-10-16T13:44:01.004 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.062 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.120 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.9874e-05 s, 0.0 kB/s 2023-10-16T13:44:01.120 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.120 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.177 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.235 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1153e-05 s, 0.0 kB/s 2023-10-16T13:44:01.235 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.235 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.292 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-16T13:44:01.350 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.407 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2723e-05 s, 0.0 kB/s 2023-10-16T13:44:01.466 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.582 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7968e-05 s, 0.0 kB/s 2023-10-16T13:44:01.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.583 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4066e-05 s, 0.0 kB/s 2023-10-16T13:44:01.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.755 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8055e-05 s, 0.0 kB/s 2023-10-16T13:44:01.813 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.813 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.871 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:01.929 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:01.929 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3324e-05 s, 0.0 kB/s 2023-10-16T13:44:01.929 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:01.930 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:01.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:01.986 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.017e-05 s, 0.0 kB/s 2023-10-16T13:44:02.045 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.046 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.102 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8148e-05 s, 0.0 kB/s 2023-10-16T13:44:02.161 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.161 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.218 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100001 s, 0.0 kB/s 2023-10-16T13:44:02.276 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.277 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.334 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1562e-05 s, 0.0 kB/s 2023-10-16T13:44:02.392 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.393 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3306e-05 s, 0.0 kB/s 2023-10-16T13:44:02.508 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.509 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3343e-05 s, 0.0 kB/s 2023-10-16T13:44:02.624 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.739 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7455e-05 s, 0.0 kB/s 2023-10-16T13:44:02.740 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.740 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.797 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4848e-05 s, 0.0 kB/s 2023-10-16T13:44:02.855 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.856 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:02.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:02.912 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2288e-05 s, 0.0 kB/s 2023-10-16T13:44:02.972 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:02.972 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.030 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.8056e-05 s, 0.0 kB/s 2023-10-16T13:44:03.089 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.089 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.145 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3795e-05 s, 0.0 kB/s 2023-10-16T13:44:03.204 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.204 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.261 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.319 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.319 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.319 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2235e-05 s, 0.0 kB/s 2023-10-16T13:44:03.320 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.320 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.377 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.434 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.435 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.435 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1962e-05 s, 0.0 kB/s 2023-10-16T13:44:03.435 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.435 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.492 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.549 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5535e-05 s, 0.0 kB/s 2023-10-16T13:44:03.551 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.551 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.609 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.667 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.667 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.8338e-05 s, 0.0 kB/s 2023-10-16T13:44:03.667 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.668 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1353e-05 s, 0.0 kB/s 2023-10-16T13:44:03.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.783 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.839 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-16T13:44:03.897 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:03.898 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:03.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:03.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.013 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8272e-05 s, 0.0 kB/s 2023-10-16T13:44:04.014 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.014 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.071 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0924e-05 s, 0.0 kB/s 2023-10-16T13:44:04.129 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.130 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.186 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4249e-05 s, 0.0 kB/s 2023-10-16T13:44:04.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.303 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2826e-05 s, 0.0 kB/s 2023-10-16T13:44:04.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1102e-05 s, 0.0 kB/s 2023-10-16T13:44:04.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.488 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.536 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1622e-05 s, 0.0 kB/s 2023-10-16T13:44:04.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.597 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.654 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2569e-05 s, 0.0 kB/s 2023-10-16T13:44:04.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.713 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5599e-05 s, 0.0 kB/s 2023-10-16T13:44:04.828 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.828 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:04.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:04.885 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:04.944 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:04.944 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9615e-05 s, 0.0 kB/s 2023-10-16T13:44:04.945 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:04.945 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.004 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8837e-05 s, 0.0 kB/s 2023-10-16T13:44:05.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.064 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.179 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.179 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.179 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4305e-05 s, 0.0 kB/s 2023-10-16T13:44:05.180 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.180 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2189e-05 s, 0.0 kB/s 2023-10-16T13:44:05.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.297 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.411 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9078e-05 s, 0.0 kB/s 2023-10-16T13:44:05.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.295e-05 s, 0.0 kB/s 2023-10-16T13:44:05.527 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.528 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.585 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.645 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1817e-05 s, 0.0 kB/s 2023-10-16T13:44:05.645 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.646 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.703 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3344e-05 s, 0.0 kB/s 2023-10-16T13:44:05.762 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.762 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.818 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4929e-05 s, 0.0 kB/s 2023-10-16T13:44:05.877 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.878 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:05.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:05.934 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:05.992 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0529e-05 s, 0.0 kB/s 2023-10-16T13:44:05.993 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:05.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.050 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.386e-05 s, 0.0 kB/s 2023-10-16T13:44:06.109 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.110 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.166 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3394e-05 s, 0.0 kB/s 2023-10-16T13:44:06.226 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.227 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.284 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.341 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.341 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.341 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5309e-05 s, 0.0 kB/s 2023-10-16T13:44:06.342 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.343 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0895e-05 s, 0.0 kB/s 2023-10-16T13:44:06.458 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.459 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.515 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3368e-05 s, 0.0 kB/s 2023-10-16T13:44:06.575 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.575 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.632 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.690 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.691 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2055e-05 s, 0.0 kB/s 2023-10-16T13:44:06.691 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.691 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.748 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2469e-05 s, 0.0 kB/s 2023-10-16T13:44:06.806 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.807 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.863 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1597e-05 s, 0.0 kB/s 2023-10-16T13:44:06.923 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:06.923 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:06.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:06.980 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.377e-05 s, 0.0 kB/s 2023-10-16T13:44:07.039 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.040 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.097 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4442e-05 s, 0.0 kB/s 2023-10-16T13:44:07.155 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.156 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.213 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1049e-05 s, 0.0 kB/s 2023-10-16T13:44:07.271 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.271 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.328 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.386 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.387 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0839e-05 s, 0.0 kB/s 2023-10-16T13:44:07.388 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.388 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.444 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.6642e-05 s, 0.0 kB/s 2023-10-16T13:44:07.503 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.503 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.560 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3579e-05 s, 0.0 kB/s 2023-10-16T13:44:07.620 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.620 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.677 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.736 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.736 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.737 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2186e-05 s, 0.0 kB/s 2023-10-16T13:44:07.737 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.737 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.794 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1997e-05 s, 0.0 kB/s 2023-10-16T13:44:07.852 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.853 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:07.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:07.909 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0834e-05 s, 0.0 kB/s 2023-10-16T13:44:07.969 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:07.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.026 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.084 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.084 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.084 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0701e-05 s, 0.0 kB/s 2023-10-16T13:44:08.085 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.085 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.142 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6661e-05 s, 0.0 kB/s 2023-10-16T13:44:08.202 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.202 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.259 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7328e-05 s, 0.0 kB/s 2023-10-16T13:44:08.319 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.320 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.376 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9174e-05 s, 0.0 kB/s 2023-10-16T13:44:08.435 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.435 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.493 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.551 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.551 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2168e-05 s, 0.0 kB/s 2023-10-16T13:44:08.551 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.552 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.608 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5577e-05 s, 0.0 kB/s 2023-10-16T13:44:08.667 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.667 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.726 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1371e-05 s, 0.0 kB/s 2023-10-16T13:44:08.783 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.783 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.840 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-16T13:44:08.898 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:08.899 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:08.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:08.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0325e-05 s, 0.0 kB/s 2023-10-16T13:44:09.015 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.015 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.072 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3956e-05 s, 0.0 kB/s 2023-10-16T13:44:09.131 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.131 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.188 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.246 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1752e-05 s, 0.0 kB/s 2023-10-16T13:44:09.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.303 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.363e-05 s, 0.0 kB/s 2023-10-16T13:44:09.362 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.362 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.478 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.478 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5412e-05 s, 0.0 kB/s 2023-10-16T13:44:09.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0419e-05 s, 0.0 kB/s 2023-10-16T13:44:09.593 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.593 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.717 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.717 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.718 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2158e-05 s, 0.0 kB/s 2023-10-16T13:44:09.718 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.718 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.785 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2987e-05 s, 0.0 kB/s 2023-10-16T13:44:09.855 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.855 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:09.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:09.920 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:09.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:09.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:09.986 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5878e-05 s, 0.0 kB/s 2023-10-16T13:44:09.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:09.987 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.050 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3859e-05 s, 0.0 kB/s 2023-10-16T13:44:10.114 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.114 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.175 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.237 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.237 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.237 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1001e-05 s, 0.0 kB/s 2023-10-16T13:44:10.237 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.238 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.297 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.357 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0619e-05 s, 0.0 kB/s 2023-10-16T13:44:10.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.418 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9969e-05 s, 0.0 kB/s 2023-10-16T13:44:10.477 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9758e-05 s, 0.0 kB/s 2023-10-16T13:44:10.594 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.595 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.651 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.710 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.710 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4574e-05 s, 0.0 kB/s 2023-10-16T13:44:10.710 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.711 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.768 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-16T13:44:10.826 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.827 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:10.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:10.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7865e-05 s, 0.0 kB/s 2023-10-16T13:44:10.943 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:10.944 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-16T13:44:11.061 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.062 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.118 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.175 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1755e-05 s, 0.0 kB/s 2023-10-16T13:44:11.176 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.176 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.234 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3255e-05 s, 0.0 kB/s 2023-10-16T13:44:11.292 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.293 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.349 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5448e-05 s, 0.0 kB/s 2023-10-16T13:44:11.408 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.409 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.465 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3938e-05 s, 0.0 kB/s 2023-10-16T13:44:11.525 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.525 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.584 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4915e-05 s, 0.0 kB/s 2023-10-16T13:44:11.643 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.700 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3853e-05 s, 0.0 kB/s 2023-10-16T13:44:11.759 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.759 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.816 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.873 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3301e-05 s, 0.0 kB/s 2023-10-16T13:44:11.874 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.875 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:11.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:11.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0318e-05 s, 0.0 kB/s 2023-10-16T13:44:11.993 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:11.993 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.049 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2364e-05 s, 0.0 kB/s 2023-10-16T13:44:12.108 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.108 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.164 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5389e-05 s, 0.0 kB/s 2023-10-16T13:44:12.223 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.223 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.279 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5764e-05 s, 0.0 kB/s 2023-10-16T13:44:12.338 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.338 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.396 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2549e-05 s, 0.0 kB/s 2023-10-16T13:44:12.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.455 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.513 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4272e-05 s, 0.0 kB/s 2023-10-16T13:44:12.572 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.572 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.630 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2555e-05 s, 0.0 kB/s 2023-10-16T13:44:12.690 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.690 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.748 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5951e-05 s, 0.0 kB/s 2023-10-16T13:44:12.808 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.808 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:12.926 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6304e-05 s, 0.0 kB/s 2023-10-16T13:44:12.926 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:12.926 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:12.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:12.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-16T13:44:13.043 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.043 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.100 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1692e-05 s, 0.0 kB/s 2023-10-16T13:44:13.160 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.161 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.218 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.279 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6732e-05 s, 0.0 kB/s 2023-10-16T13:44:13.279 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.337 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1429e-05 s, 0.0 kB/s 2023-10-16T13:44:13.396 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.397 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.512 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3878e-05 s, 0.0 kB/s 2023-10-16T13:44:13.512 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.513 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4281e-05 s, 0.0 kB/s 2023-10-16T13:44:13.629 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.629 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.688 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3725e-05 s, 0.0 kB/s 2023-10-16T13:44:13.747 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.747 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.804 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.861 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.861 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6785e-05 s, 0.0 kB/s 2023-10-16T13:44:13.862 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.863 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:13.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:13.921 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:13.979 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5358e-05 s, 0.0 kB/s 2023-10-16T13:44:13.980 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:13.980 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.037 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3424e-05 s, 0.0 kB/s 2023-10-16T13:44:14.096 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.097 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.153 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4765e-05 s, 0.0 kB/s 2023-10-16T13:44:14.213 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.213 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.273 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4528e-05 s, 0.0 kB/s 2023-10-16T13:44:14.330 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.331 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.389 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1308e-05 s, 0.0 kB/s 2023-10-16T13:44:14.448 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.449 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.506 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3835e-05 s, 0.0 kB/s 2023-10-16T13:44:14.565 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.565 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.622 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.145e-05 s, 0.0 kB/s 2023-10-16T13:44:14.685 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.685 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3778e-05 s, 0.0 kB/s 2023-10-16T13:44:14.800 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.801 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.857 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:14.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:14.916 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:14.916 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8509e-05 s, 0.0 kB/s 2023-10-16T13:44:14.917 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:14.917 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:14.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:14.975 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4075e-05 s, 0.0 kB/s 2023-10-16T13:44:15.034 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.034 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.093 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3513e-05 s, 0.0 kB/s 2023-10-16T13:44:15.152 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.209 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5128e-05 s, 0.0 kB/s 2023-10-16T13:44:15.268 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.269 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.325 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8691e-05 s, 0.0 kB/s 2023-10-16T13:44:15.383 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.383 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.441 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5661e-05 s, 0.0 kB/s 2023-10-16T13:44:15.500 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.501 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.558 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0608e-05 s, 0.0 kB/s 2023-10-16T13:44:15.617 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.617 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.676 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5226e-05 s, 0.0 kB/s 2023-10-16T13:44:15.734 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.735 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.792 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0078e-05 s, 0.0 kB/s 2023-10-16T13:44:15.852 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:15.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:15.910 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:15.968 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.0286e-05 s, 0.0 kB/s 2023-10-16T13:44:15.969 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:15.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.025 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2335e-05 s, 0.0 kB/s 2023-10-16T13:44:16.084 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.085 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.142 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2898e-05 s, 0.0 kB/s 2023-10-16T13:44:16.201 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.202 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.258 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.318 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.318 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.318 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1424e-05 s, 0.0 kB/s 2023-10-16T13:44:16.319 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.319 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.376 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.433 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.433 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.434 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2254e-05 s, 0.0 kB/s 2023-10-16T13:44:16.434 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.434 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.491 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6611e-05 s, 0.0 kB/s 2023-10-16T13:44:16.551 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.551 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.607 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.665 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.9993e-05 s, 0.0 kB/s 2023-10-16T13:44:16.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.666 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.723 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1718e-05 s, 0.0 kB/s 2023-10-16T13:44:16.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.782 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.839 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1778e-05 s, 0.0 kB/s 2023-10-16T13:44:16.899 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:16.899 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:16.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:16.957 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.161e-05 s, 0.0 kB/s 2023-10-16T13:44:17.015 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.016 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.072 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.131 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.131 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1563e-05 s, 0.0 kB/s 2023-10-16T13:44:17.132 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.132 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.190 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.372e-05 s, 0.0 kB/s 2023-10-16T13:44:17.249 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.250 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.306 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1582e-05 s, 0.0 kB/s 2023-10-16T13:44:17.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.366 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4666e-05 s, 0.0 kB/s 2023-10-16T13:44:17.482 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.482 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.539 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2875e-05 s, 0.0 kB/s 2023-10-16T13:44:17.598 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.598 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.656 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3112e-05 s, 0.0 kB/s 2023-10-16T13:44:17.714 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.771 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.828 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.828 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.829 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0923e-05 s, 0.0 kB/s 2023-10-16T13:44:17.829 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.829 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:17.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:17.886 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4655e-05 s, 0.0 kB/s 2023-10-16T13:44:17.946 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:17.946 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2925e-05 s, 0.0 kB/s 2023-10-16T13:44:18.062 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.062 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.119 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3082e-05 s, 0.0 kB/s 2023-10-16T13:44:18.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.179 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.235 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.292 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4855e-05 s, 0.0 kB/s 2023-10-16T13:44:18.294 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.294 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.352 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.411 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3288e-05 s, 0.0 kB/s 2023-10-16T13:44:18.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.528 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.528 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.529 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8095e-05 s, 0.0 kB/s 2023-10-16T13:44:18.529 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.529 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.586 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.643 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.643 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.643 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6326e-05 s, 0.0 kB/s 2023-10-16T13:44:18.644 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.645 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.702 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2805e-05 s, 0.0 kB/s 2023-10-16T13:44:18.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.763 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.819 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2011e-05 s, 0.0 kB/s 2023-10-16T13:44:18.879 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:18.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:18.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2352e-05 s, 0.0 kB/s 2023-10-16T13:44:18.997 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:18.997 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.056 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9332e-05 s, 0.0 kB/s 2023-10-16T13:44:19.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.115 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3369e-05 s, 0.0 kB/s 2023-10-16T13:44:19.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.231 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5451e-05 s, 0.0 kB/s 2023-10-16T13:44:19.346 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.347 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.404 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0565e-05 s, 0.0 kB/s 2023-10-16T13:44:19.463 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.463 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.520 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4605e-05 s, 0.0 kB/s 2023-10-16T13:44:19.579 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.580 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.637 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2682e-05 s, 0.0 kB/s 2023-10-16T13:44:19.696 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.696 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.753 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5579e-05 s, 0.0 kB/s 2023-10-16T13:44:19.813 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.813 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.869 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.116e-05 s, 0.0 kB/s 2023-10-16T13:44:19.929 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:19.929 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:19.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:19.986 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2451e-05 s, 0.0 kB/s 2023-10-16T13:44:20.045 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.046 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1782e-05 s, 0.0 kB/s 2023-10-16T13:44:20.162 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.163 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.220 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.278 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3699e-05 s, 0.0 kB/s 2023-10-16T13:44:20.278 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.279 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.335 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-16T13:44:20.394 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.394 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.118e-05 s, 0.0 kB/s 2023-10-16T13:44:20.509 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.510 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.566 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.623 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3841e-05 s, 0.0 kB/s 2023-10-16T13:44:20.624 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5085e-05 s, 0.0 kB/s 2023-10-16T13:44:20.740 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.741 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7801e-05 s, 0.0 kB/s 2023-10-16T13:44:20.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:20.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:20.913 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:20.971 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:20.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:20.972 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2738e-05 s, 0.0 kB/s 2023-10-16T13:44:20.972 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:20.973 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.029 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1981e-05 s, 0.0 kB/s 2023-10-16T13:44:21.088 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.089 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.145 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0297e-05 s, 0.0 kB/s 2023-10-16T13:44:21.204 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.204 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.261 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2622e-05 s, 0.0 kB/s 2023-10-16T13:44:21.320 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.321 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.377 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0922e-05 s, 0.0 kB/s 2023-10-16T13:44:21.437 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.437 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.494 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-16T13:44:21.553 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.553 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.611 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0695e-05 s, 0.0 kB/s 2023-10-16T13:44:21.669 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.670 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.726 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.784 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.784 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.784 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106284 s, 0.0 kB/s 2023-10-16T13:44:21.785 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.786 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.843 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:21.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:21.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:21.903 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0742e-05 s, 0.0 kB/s 2023-10-16T13:44:21.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:21.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:21.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:21.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-16T13:44:22.019 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.020 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.076 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3509e-05 s, 0.0 kB/s 2023-10-16T13:44:22.134 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.134 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4572e-05 s, 0.0 kB/s 2023-10-16T13:44:22.250 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.251 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.309 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3628e-05 s, 0.0 kB/s 2023-10-16T13:44:22.367 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3081e-05 s, 0.0 kB/s 2023-10-16T13:44:22.484 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.542 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2803e-05 s, 0.0 kB/s 2023-10-16T13:44:22.601 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.602 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.658 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3639e-05 s, 0.0 kB/s 2023-10-16T13:44:22.716 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.773 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.004e-05 s, 0.0 kB/s 2023-10-16T13:44:22.833 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.833 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:22.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:22.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5183e-05 s, 0.0 kB/s 2023-10-16T13:44:22.951 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:22.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.008 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.065 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9169e-05 s, 0.0 kB/s 2023-10-16T13:44:23.066 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.066 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.123 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.181 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0731e-05 s, 0.0 kB/s 2023-10-16T13:44:23.182 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.183 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.240 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.297 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.297 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.298 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.672e-05 s, 0.0 kB/s 2023-10-16T13:44:23.298 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.298 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.413 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8478e-05 s, 0.0 kB/s 2023-10-16T13:44:23.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.472 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2455e-05 s, 0.0 kB/s 2023-10-16T13:44:23.532 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.532 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.588 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.647 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.647 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9431e-05 s, 0.0 kB/s 2023-10-16T13:44:23.648 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.648 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0968e-05 s, 0.0 kB/s 2023-10-16T13:44:23.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.763 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.877 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.313e-05 s, 0.0 kB/s 2023-10-16T13:44:23.878 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.879 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:23.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:23.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2641e-05 s, 0.0 kB/s 2023-10-16T13:44:23.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:23.995 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.051 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1019e-05 s, 0.0 kB/s 2023-10-16T13:44:24.110 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.111 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.167 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.225 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8741e-05 s, 0.0 kB/s 2023-10-16T13:44:24.226 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.226 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.284 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1035e-05 s, 0.0 kB/s 2023-10-16T13:44:24.344 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.344 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.401 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.459 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4498e-05 s, 0.0 kB/s 2023-10-16T13:44:24.459 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.459 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.518 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1829e-05 s, 0.0 kB/s 2023-10-16T13:44:24.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.633 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0844e-05 s, 0.0 kB/s 2023-10-16T13:44:24.692 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.692 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.750 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000141921 s, 0.0 kB/s 2023-10-16T13:44:24.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:24.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:24.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:24.924 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.367e-05 s, 0.0 kB/s 2023-10-16T13:44:24.925 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:24.926 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:24.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:24.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.041 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3751e-05 s, 0.0 kB/s 2023-10-16T13:44:25.042 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.043 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.099 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.828e-05 s, 0.0 kB/s 2023-10-16T13:44:25.158 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.158 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.216 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2548e-05 s, 0.0 kB/s 2023-10-16T13:44:25.276 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.276 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.335 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.393 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7069e-05 s, 0.0 kB/s 2023-10-16T13:44:25.394 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.394 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4601e-05 s, 0.0 kB/s 2023-10-16T13:44:25.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.511 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1097e-05 s, 0.0 kB/s 2023-10-16T13:44:25.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000105696 s, 0.0 kB/s 2023-10-16T13:44:25.743 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.800 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.859 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106808 s, 0.0 kB/s 2023-10-16T13:44:25.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:25.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:25.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8714e-05 s, 0.0 kB/s 2023-10-16T13:44:25.978 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:25.978 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.035 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.094 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0872e-05 s, 0.0 kB/s 2023-10-16T13:44:26.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.095 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.151 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.209 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2292e-05 s, 0.0 kB/s 2023-10-16T13:44:26.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.266 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1135e-05 s, 0.0 kB/s 2023-10-16T13:44:26.325 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.325 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.382 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.441 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2849e-05 s, 0.0 kB/s 2023-10-16T13:44:26.441 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.499 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5855e-05 s, 0.0 kB/s 2023-10-16T13:44:26.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.558 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.617 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.676 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3674e-05 s, 0.0 kB/s 2023-10-16T13:44:26.676 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.677 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.734 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.791 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5882e-05 s, 0.0 kB/s 2023-10-16T13:44:26.793 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.849 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:26.908 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:26.908 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:26.908 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6032e-05 s, 0.0 kB/s 2023-10-16T13:44:26.909 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:26.909 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:26.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:26.967 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.025 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.025 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.025 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000103335 s, 0.0 kB/s 2023-10-16T13:44:27.025 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.026 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.140 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.141 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.141 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.7642e-05 s, 0.0 kB/s 2023-10-16T13:44:27.141 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.142 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.199 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2137e-05 s, 0.0 kB/s 2023-10-16T13:44:27.257 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.258 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1268e-05 s, 0.0 kB/s 2023-10-16T13:44:27.375 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.375 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.432 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2234e-05 s, 0.0 kB/s 2023-10-16T13:44:27.492 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.493 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.550 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0127e-05 s, 0.0 kB/s 2023-10-16T13:44:27.609 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.610 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.667 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3326e-05 s, 0.0 kB/s 2023-10-16T13:44:27.726 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.726 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3064e-05 s, 0.0 kB/s 2023-10-16T13:44:27.843 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:27.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:27.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2838e-05 s, 0.0 kB/s 2023-10-16T13:44:27.959 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:27.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.019 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9818e-05 s, 0.0 kB/s 2023-10-16T13:44:28.077 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.078 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.135 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3224e-05 s, 0.0 kB/s 2023-10-16T13:44:28.193 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.193 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:44:28.293 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:44:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6549e-05 s, 0.0 kB/s 2023-10-16T13:44:28.309 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.310 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.459 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1794e-05 s, 0.0 kB/s 2023-10-16T13:44:28.459 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.460 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0252e-05 s, 0.0 kB/s 2023-10-16T13:44:28.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.577 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.633 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4072e-05 s, 0.0 kB/s 2023-10-16T13:44:28.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.751 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000112201 s, 0.0 kB/s 2023-10-16T13:44:28.811 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.812 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.869 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:28.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:28.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:28.928 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.467e-05 s, 0.0 kB/s 2023-10-16T13:44:28.929 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:28.929 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:28.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:28.987 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102568 s, 0.0 kB/s 2023-10-16T13:44:29.045 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.046 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2244e-05 s, 0.0 kB/s 2023-10-16T13:44:29.163 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.163 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2717e-05 s, 0.0 kB/s 2023-10-16T13:44:29.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.337 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3098e-05 s, 0.0 kB/s 2023-10-16T13:44:29.397 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.398 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.457 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8182e-05 s, 0.0 kB/s 2023-10-16T13:44:29.516 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.516 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.573 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.632 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.632 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.633 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6201e-05 s, 0.0 kB/s 2023-10-16T13:44:29.633 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.633 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.690 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.749 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.749 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.749 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8348e-05 s, 0.0 kB/s 2023-10-16T13:44:29.750 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.751 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3409e-05 s, 0.0 kB/s 2023-10-16T13:44:29.868 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.869 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:29.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:29.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9833e-05 s, 0.0 kB/s 2023-10-16T13:44:29.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:29.985 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.043 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8702e-05 s, 0.0 kB/s 2023-10-16T13:44:30.101 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.102 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.159 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000103968 s, 0.0 kB/s 2023-10-16T13:44:30.218 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.218 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.275 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8948e-05 s, 0.0 kB/s 2023-10-16T13:44:30.335 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.335 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.393 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.9685e-05 s, 0.0 kB/s 2023-10-16T13:44:30.452 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.452 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.509 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1098e-05 s, 0.0 kB/s 2023-10-16T13:44:30.568 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.568 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.625 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.683 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5689e-05 s, 0.0 kB/s 2023-10-16T13:44:30.684 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.684 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1354e-05 s, 0.0 kB/s 2023-10-16T13:44:30.800 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.800 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.858 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:30.917 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9786e-05 s, 0.0 kB/s 2023-10-16T13:44:30.917 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:30.918 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:30.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:30.974 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.5869e-05 s, 0.0 kB/s 2023-10-16T13:44:31.033 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.033 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.091 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1989e-05 s, 0.0 kB/s 2023-10-16T13:44:31.149 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.150 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.206 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.263 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3862e-05 s, 0.0 kB/s 2023-10-16T13:44:31.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.265 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.323 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6715e-05 s, 0.0 kB/s 2023-10-16T13:44:31.381 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.382 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-16T13:44:31.497 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.498 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0399e-05 s, 0.0 kB/s 2023-10-16T13:44:31.615 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.615 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.673 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.731 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.5696e-05 s, 0.0 kB/s 2023-10-16T13:44:31.732 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.732 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8004e-05 s, 0.0 kB/s 2023-10-16T13:44:31.847 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.848 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:31.904 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:31.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:31.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:31.964 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3201e-05 s, 0.0 kB/s 2023-10-16T13:44:31.965 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:31.965 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3921e-05 s, 0.0 kB/s 2023-10-16T13:44:32.081 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.082 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4718e-05 s, 0.0 kB/s 2023-10-16T13:44:32.197 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.198 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.255 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.314 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.1723e-05 s, 0.0 kB/s 2023-10-16T13:44:32.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.315 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.6228e-05 s, 0.0 kB/s 2023-10-16T13:44:32.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.431 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.489 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2277e-05 s, 0.0 kB/s 2023-10-16T13:44:32.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.548 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.605 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5842e-05 s, 0.0 kB/s 2023-10-16T13:44:32.664 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.665 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.722 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.162e-05 s, 0.0 kB/s 2023-10-16T13:44:32.781 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.781 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.839 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:32.896 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:32.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:32.897 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1629e-05 s, 0.0 kB/s 2023-10-16T13:44:32.897 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:32.898 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:32.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:32.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.013 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4658e-05 s, 0.0 kB/s 2023-10-16T13:44:33.014 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.015 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.072 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102212 s, 0.0 kB/s 2023-10-16T13:44:33.132 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.132 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.189 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1676e-05 s, 0.0 kB/s 2023-10-16T13:44:33.248 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.249 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.305 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.363 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.9868e-05 s, 0.0 kB/s 2023-10-16T13:44:33.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.420 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.368e-05 s, 0.0 kB/s 2023-10-16T13:44:33.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.536 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-16T13:44:33.595 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.595 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.652 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9815e-05 s, 0.0 kB/s 2023-10-16T13:44:33.711 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.711 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.768 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2388e-05 s, 0.0 kB/s 2023-10-16T13:44:33.827 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.828 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:33.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:33.884 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1653e-05 s, 0.0 kB/s 2023-10-16T13:44:33.943 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:33.943 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.001 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6558e-05 s, 0.0 kB/s 2023-10-16T13:44:34.061 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.061 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.119 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.178 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.871e-05 s, 0.0 kB/s 2023-10-16T13:44:34.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.179 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.235 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.293 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.293 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.293 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0842e-05 s, 0.0 kB/s 2023-10-16T13:44:34.294 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.352 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3556e-05 s, 0.0 kB/s 2023-10-16T13:44:34.410 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.411 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.468 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.526 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9644e-05 s, 0.0 kB/s 2023-10-16T13:44:34.527 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.527 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.584 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0335e-05 s, 0.0 kB/s 2023-10-16T13:44:34.643 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.700 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.369e-05 s, 0.0 kB/s 2023-10-16T13:44:34.758 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.759 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.816 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5825e-05 s, 0.0 kB/s 2023-10-16T13:44:34.876 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.876 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:34.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:34.934 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4621e-05 s, 0.0 kB/s 2023-10-16T13:44:34.993 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:34.993 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.051 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4848e-05 s, 0.0 kB/s 2023-10-16T13:44:35.110 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.110 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.171 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.228 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.228 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.229 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0449e-05 s, 0.0 kB/s 2023-10-16T13:44:35.229 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.229 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.286 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.343 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.343 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.344 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.6826e-05 s, 0.0 kB/s 2023-10-16T13:44:35.344 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.344 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.401 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4559e-05 s, 0.0 kB/s 2023-10-16T13:44:35.484 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.541 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5751e-05 s, 0.0 kB/s 2023-10-16T13:44:35.600 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.715 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.715 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5045e-05 s, 0.0 kB/s 2023-10-16T13:44:35.715 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.773 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101075 s, 0.0 kB/s 2023-10-16T13:44:35.831 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.832 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:35.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:35.889 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3045e-05 s, 0.0 kB/s 2023-10-16T13:44:35.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:35.948 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.005 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9844e-05 s, 0.0 kB/s 2023-10-16T13:44:36.064 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.065 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.121 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.180 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.180 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.180 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9082e-05 s, 0.0 kB/s 2023-10-16T13:44:36.181 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.181 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.238 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.46e-05 s, 0.0 kB/s 2023-10-16T13:44:36.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.296 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1372e-05 s, 0.0 kB/s 2023-10-16T13:44:36.411 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.411 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.468 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3198e-05 s, 0.0 kB/s 2023-10-16T13:44:36.526 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.526 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.583 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.642 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.497e-05 s, 0.0 kB/s 2023-10-16T13:44:36.642 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.700 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.758 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.758 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.758 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9636e-05 s, 0.0 kB/s 2023-10-16T13:44:36.759 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.759 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.816 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3886e-05 s, 0.0 kB/s 2023-10-16T13:44:36.875 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.875 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:36.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:36.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:36.989 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:36.990 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:36.990 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3747e-05 s, 0.0 kB/s 2023-10-16T13:44:36.990 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:36.991 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4178e-05 s, 0.0 kB/s 2023-10-16T13:44:37.106 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.107 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.164 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9862e-05 s, 0.0 kB/s 2023-10-16T13:44:37.222 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.223 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.279 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8281e-05 s, 0.0 kB/s 2023-10-16T13:44:37.337 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.337 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.395 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.453 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9479e-05 s, 0.0 kB/s 2023-10-16T13:44:37.454 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.454 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.512 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-16T13:44:37.570 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.570 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.628 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4056e-05 s, 0.0 kB/s 2023-10-16T13:44:37.687 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.688 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.744 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3954e-05 s, 0.0 kB/s 2023-10-16T13:44:37.802 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.802 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.860 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8662e-05 s, 0.0 kB/s 2023-10-16T13:44:37.918 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:37.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:37.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:37.976 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.015e-05 s, 0.0 kB/s 2023-10-16T13:44:38.036 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.036 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.093 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1567e-05 s, 0.0 kB/s 2023-10-16T13:44:38.153 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.153 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.210 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106998 s, 0.0 kB/s 2023-10-16T13:44:38.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.271 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7009e-05 s, 0.0 kB/s 2023-10-16T13:44:38.386 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.387 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.443 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2906e-05 s, 0.0 kB/s 2023-10-16T13:44:38.503 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.503 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.561 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-16T13:44:38.620 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.621 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.677 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.735 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-16T13:44:38.736 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.737 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4258e-05 s, 0.0 kB/s 2023-10-16T13:44:38.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:38.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:38.909 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0181e-05 s, 0.0 kB/s 2023-10-16T13:44:38.968 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:38.968 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.025 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1744e-05 s, 0.0 kB/s 2023-10-16T13:44:39.084 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.085 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.141 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6131e-05 s, 0.0 kB/s 2023-10-16T13:44:39.199 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.258 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.316 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.317 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.317 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3121e-05 s, 0.0 kB/s 2023-10-16T13:44:39.318 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.318 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.374 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2898e-05 s, 0.0 kB/s 2023-10-16T13:44:39.433 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.433 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.491 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.549 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.550 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.550 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9752e-05 s, 0.0 kB/s 2023-10-16T13:44:39.550 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.550 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.607 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.666 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.666 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102052 s, 0.0 kB/s 2023-10-16T13:44:39.667 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.667 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.8122e-05 s, 0.0 kB/s 2023-10-16T13:44:39.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.783 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.840 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0122e-05 s, 0.0 kB/s 2023-10-16T13:44:39.900 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:39.900 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:39.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:39.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6865e-05 s, 0.0 kB/s 2023-10-16T13:44:40.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.362e-05 s, 0.0 kB/s 2023-10-16T13:44:40.134 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.134 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0641e-05 s, 0.0 kB/s 2023-10-16T13:44:40.251 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.251 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.309 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.367 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2834e-05 s, 0.0 kB/s 2023-10-16T13:44:40.368 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.368 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.425 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4349e-05 s, 0.0 kB/s 2023-10-16T13:44:40.485 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.485 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.542 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3987e-05 s, 0.0 kB/s 2023-10-16T13:44:40.600 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.658 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.716 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1081e-05 s, 0.0 kB/s 2023-10-16T13:44:40.716 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.773 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4958e-05 s, 0.0 kB/s 2023-10-16T13:44:40.832 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.833 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:40.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:40.889 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1834e-05 s, 0.0 kB/s 2023-10-16T13:44:40.949 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:40.949 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.006 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3702e-05 s, 0.0 kB/s 2023-10-16T13:44:41.065 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.066 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.122 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.179 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3216e-05 s, 0.0 kB/s 2023-10-16T13:44:41.180 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.181 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4039e-05 s, 0.0 kB/s 2023-10-16T13:44:41.297 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.297 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9372e-05 s, 0.0 kB/s 2023-10-16T13:44:41.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2073e-05 s, 0.0 kB/s 2023-10-16T13:44:41.530 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.531 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.587 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1075e-05 s, 0.0 kB/s 2023-10-16T13:44:41.646 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2472e-05 s, 0.0 kB/s 2023-10-16T13:44:41.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.763 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.821 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7069e-05 s, 0.0 kB/s 2023-10-16T13:44:41.879 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:41.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:41.937 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4541e-05 s, 0.0 kB/s 2023-10-16T13:44:41.996 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:41.996 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.053 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.112 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.112 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0558e-05 s, 0.0 kB/s 2023-10-16T13:44:42.113 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.113 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.171 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9258e-05 s, 0.0 kB/s 2023-10-16T13:44:42.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.231 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.289 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.347 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1796e-05 s, 0.0 kB/s 2023-10-16T13:44:42.348 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.348 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.405 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.465 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9674e-05 s, 0.0 kB/s 2023-10-16T13:44:42.465 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.581 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-16T13:44:42.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.582 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.640 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0824e-05 s, 0.0 kB/s 2023-10-16T13:44:42.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.755 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5789e-05 s, 0.0 kB/s 2023-10-16T13:44:42.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.815 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:42.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.543e-05 s, 0.0 kB/s 2023-10-16T13:44:42.932 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:42.933 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:42.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:42.991 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2372e-05 s, 0.0 kB/s 2023-10-16T13:44:43.051 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.051 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.166 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1921e-05 s, 0.0 kB/s 2023-10-16T13:44:43.167 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.167 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.225 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5404e-05 s, 0.0 kB/s 2023-10-16T13:44:43.284 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.285 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.342 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1475e-05 s, 0.0 kB/s 2023-10-16T13:44:43.401 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.401 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.460 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9952e-05 s, 0.0 kB/s 2023-10-16T13:44:43.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.520 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-16T13:44:43.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.637 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0382e-05 s, 0.0 kB/s 2023-10-16T13:44:43.757 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.758 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.814 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.287e-05 s, 0.0 kB/s 2023-10-16T13:44:43.874 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.874 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:43.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:43.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.368e-05 s, 0.0 kB/s 2023-10-16T13:44:43.992 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:43.992 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.049 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7672e-05 s, 0.0 kB/s 2023-10-16T13:44:44.108 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.108 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.166 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4704e-05 s, 0.0 kB/s 2023-10-16T13:44:44.226 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.226 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3138e-05 s, 0.0 kB/s 2023-10-16T13:44:44.347 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.347 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.405 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2528e-05 s, 0.0 kB/s 2023-10-16T13:44:44.465 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.465 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4688e-05 s, 0.0 kB/s 2023-10-16T13:44:44.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.583 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.640 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4868e-05 s, 0.0 kB/s 2023-10-16T13:44:44.699 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.757 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.816 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2579e-05 s, 0.0 kB/s 2023-10-16T13:44:44.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3091e-05 s, 0.0 kB/s 2023-10-16T13:44:44.933 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:44.934 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:44.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:44.991 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3362e-05 s, 0.0 kB/s 2023-10-16T13:44:45.050 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.050 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.109 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6098e-05 s, 0.0 kB/s 2023-10-16T13:44:45.168 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.168 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.225 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6152e-05 s, 0.0 kB/s 2023-10-16T13:44:45.285 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.285 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.342 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5219e-05 s, 0.0 kB/s 2023-10-16T13:44:45.404 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.461 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9558e-05 s, 0.0 kB/s 2023-10-16T13:44:45.519 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.520 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.578 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7608e-05 s, 0.0 kB/s 2023-10-16T13:44:45.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.637 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.694 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.752 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.752 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2981e-05 s, 0.0 kB/s 2023-10-16T13:44:45.752 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.753 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.812 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1983e-05 s, 0.0 kB/s 2023-10-16T13:44:45.870 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:45.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:45.928 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:45.986 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4489e-05 s, 0.0 kB/s 2023-10-16T13:44:45.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:45.987 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.045 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5206e-05 s, 0.0 kB/s 2023-10-16T13:44:46.103 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.104 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.161 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3151e-05 s, 0.0 kB/s 2023-10-16T13:44:46.220 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.220 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.277 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-16T13:44:46.337 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.337 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.393 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.451 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7025e-05 s, 0.0 kB/s 2023-10-16T13:44:46.452 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.453 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.510 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0222e-05 s, 0.0 kB/s 2023-10-16T13:44:46.567 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.568 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.625 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.684 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.684 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.684 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.8402e-05 s, 0.0 kB/s 2023-10-16T13:44:46.684 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.685 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.742 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3588e-05 s, 0.0 kB/s 2023-10-16T13:44:46.800 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.801 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.857 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3888e-05 s, 0.0 kB/s 2023-10-16T13:44:46.916 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:46.917 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:46.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:46.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2155e-05 s, 0.0 kB/s 2023-10-16T13:44:47.032 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.033 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.089 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000153731 s, 0.0 kB/s 2023-10-16T13:44:47.149 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.206 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8481e-05 s, 0.0 kB/s 2023-10-16T13:44:47.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.321 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.379 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.380 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8155e-05 s, 0.0 kB/s 2023-10-16T13:44:47.380 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.381 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.4719e-05 s, 0.0 kB/s 2023-10-16T13:44:47.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.498 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.613 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102015 s, 0.0 kB/s 2023-10-16T13:44:47.614 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.614 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.672 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3689e-05 s, 0.0 kB/s 2023-10-16T13:44:47.731 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.731 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.845 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.846 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5059e-05 s, 0.0 kB/s 2023-10-16T13:44:47.846 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.847 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:47.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:47.903 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:47.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:47.961 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:47.961 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5256e-05 s, 0.0 kB/s 2023-10-16T13:44:47.961 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:47.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.018 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2009e-05 s, 0.0 kB/s 2023-10-16T13:44:48.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.079 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.136 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3473e-05 s, 0.0 kB/s 2023-10-16T13:44:48.196 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.196 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1321e-05 s, 0.0 kB/s 2023-10-16T13:44:48.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.316 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.373 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1534e-05 s, 0.0 kB/s 2023-10-16T13:44:48.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.431 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.489 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.548 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.548 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.548 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0937e-05 s, 0.0 kB/s 2023-10-16T13:44:48.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.549 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.606 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3757e-05 s, 0.0 kB/s 2023-10-16T13:44:48.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.665 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.722 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3024e-05 s, 0.0 kB/s 2023-10-16T13:44:48.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.782 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.838 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.0173e-05 s, 0.0 kB/s 2023-10-16T13:44:48.898 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:48.898 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:48.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:48.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8192e-05 s, 0.0 kB/s 2023-10-16T13:44:49.015 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.015 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.074 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3595e-05 s, 0.0 kB/s 2023-10-16T13:44:49.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.133 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9233e-05 s, 0.0 kB/s 2023-10-16T13:44:49.249 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.250 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.307 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0944e-05 s, 0.0 kB/s 2023-10-16T13:44:49.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.366 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1841e-05 s, 0.0 kB/s 2023-10-16T13:44:49.484 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.541 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.599 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2287e-05 s, 0.0 kB/s 2023-10-16T13:44:49.600 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6973e-05 s, 0.0 kB/s 2023-10-16T13:44:49.717 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.774 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3306e-05 s, 0.0 kB/s 2023-10-16T13:44:49.833 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.833 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:49.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:49.890 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:49.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:49.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:49.950 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5953e-05 s, 0.0 kB/s 2023-10-16T13:44:49.950 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:49.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.007 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3211e-05 s, 0.0 kB/s 2023-10-16T13:44:50.067 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.067 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.126 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2748e-05 s, 0.0 kB/s 2023-10-16T13:44:50.185 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.186 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.243 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4631e-05 s, 0.0 kB/s 2023-10-16T13:44:50.302 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.302 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.360 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.419 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0677e-05 s, 0.0 kB/s 2023-10-16T13:44:50.420 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.420 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.477 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4952e-05 s, 0.0 kB/s 2023-10-16T13:44:50.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.536 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.593 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3759e-05 s, 0.0 kB/s 2023-10-16T13:44:50.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.711 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1508e-05 s, 0.0 kB/s 2023-10-16T13:44:50.770 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.771 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.828 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3311e-05 s, 0.0 kB/s 2023-10-16T13:44:50.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:50.887 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:50.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:50.944 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3482e-05 s, 0.0 kB/s 2023-10-16T13:44:51.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.120 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.120 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9773e-05 s, 0.0 kB/s 2023-10-16T13:44:51.121 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.122 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.178 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4158e-05 s, 0.0 kB/s 2023-10-16T13:44:51.237 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.238 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.297 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3348e-05 s, 0.0 kB/s 2023-10-16T13:44:51.356 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.356 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.414 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2176e-05 s, 0.0 kB/s 2023-10-16T13:44:51.473 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.473 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.530 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8778e-05 s, 0.0 kB/s 2023-10-16T13:44:51.589 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.589 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.647 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.706 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2829e-05 s, 0.0 kB/s 2023-10-16T13:44:51.707 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.708 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3004e-05 s, 0.0 kB/s 2023-10-16T13:44:51.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:51.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4103e-05 s, 0.0 kB/s 2023-10-16T13:44:51.942 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:51.943 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:51.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.000 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0928e-05 s, 0.0 kB/s 2023-10-16T13:44:52.059 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.059 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.116 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9342e-05 s, 0.0 kB/s 2023-10-16T13:44:52.175 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.175 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.231 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-16T13:44:52.290 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.290 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.346 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5072e-05 s, 0.0 kB/s 2023-10-16T13:44:52.406 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.407 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.463 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.522 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.522 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.523 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0962e-05 s, 0.0 kB/s 2023-10-16T13:44:52.523 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.524 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.580 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.638 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4415e-05 s, 0.0 kB/s 2023-10-16T13:44:52.639 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.639 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.697 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1845e-05 s, 0.0 kB/s 2023-10-16T13:44:52.757 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.758 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.815 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.873 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.873 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.873 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0606e-05 s, 0.0 kB/s 2023-10-16T13:44:52.874 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.874 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:52.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:52.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9176e-05 s, 0.0 kB/s 2023-10-16T13:44:52.992 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:52.992 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.049 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.754e-05 s, 0.0 kB/s 2023-10-16T13:44:53.109 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.110 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.166 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-16T13:44:53.226 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.226 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.283 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2742e-05 s, 0.0 kB/s 2023-10-16T13:44:53.341 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.342 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.398 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.457 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.457 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2481e-05 s, 0.0 kB/s 2023-10-16T13:44:53.458 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.458 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.516 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2804e-05 s, 0.0 kB/s 2023-10-16T13:44:53.575 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3152e-05 s, 0.0 kB/s 2023-10-16T13:44:53.713 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.713 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.770 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2893e-05 s, 0.0 kB/s 2023-10-16T13:44:53.830 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.830 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:53.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:53.886 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2063e-05 s, 0.0 kB/s 2023-10-16T13:44:53.946 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:53.946 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.004 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3968e-05 s, 0.0 kB/s 2023-10-16T13:44:54.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.178 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0519e-05 s, 0.0 kB/s 2023-10-16T13:44:54.179 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.179 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.236 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000104424 s, 0.0 kB/s 2023-10-16T13:44:54.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.296 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.411 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1858e-05 s, 0.0 kB/s 2023-10-16T13:44:54.411 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.527 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5065e-05 s, 0.0 kB/s 2023-10-16T13:44:54.528 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.528 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.585 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2833e-05 s, 0.0 kB/s 2023-10-16T13:44:54.644 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.645 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2706e-05 s, 0.0 kB/s 2023-10-16T13:44:54.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.764 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.821 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.8293e-05 s, 0.0 kB/s 2023-10-16T13:44:54.880 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:54.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:54.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2173e-05 s, 0.0 kB/s 2023-10-16T13:44:54.998 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:54.998 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.056 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.114 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.115 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0066e-05 s, 0.0 kB/s 2023-10-16T13:44:55.115 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.115 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102585 s, 0.0 kB/s 2023-10-16T13:44:55.232 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.232 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.289 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000104051 s, 0.0 kB/s 2023-10-16T13:44:55.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.349 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.407 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2846e-05 s, 0.0 kB/s 2023-10-16T13:44:55.466 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.467 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2373e-05 s, 0.0 kB/s 2023-10-16T13:44:55.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.582 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1241e-05 s, 0.0 kB/s 2023-10-16T13:44:55.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.698 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3331e-05 s, 0.0 kB/s 2023-10-16T13:44:55.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.815 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9986e-05 s, 0.0 kB/s 2023-10-16T13:44:55.932 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:55.932 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:55.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:55.989 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2395e-05 s, 0.0 kB/s 2023-10-16T13:44:56.049 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.049 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4055e-05 s, 0.0 kB/s 2023-10-16T13:44:56.167 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.168 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.224 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0692e-05 s, 0.0 kB/s 2023-10-16T13:44:56.283 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.284 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.341 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.401 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1922e-05 s, 0.0 kB/s 2023-10-16T13:44:56.402 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.402 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.460 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4073e-05 s, 0.0 kB/s 2023-10-16T13:44:56.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.518 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.576 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000123268 s, 0.0 kB/s 2023-10-16T13:44:56.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2739e-05 s, 0.0 kB/s 2023-10-16T13:44:56.752 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.752 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1284e-05 s, 0.0 kB/s 2023-10-16T13:44:56.867 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.867 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:56.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:56.924 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:56.981 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4463e-05 s, 0.0 kB/s 2023-10-16T13:44:56.982 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:56.982 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.039 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1784e-05 s, 0.0 kB/s 2023-10-16T13:44:57.097 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.097 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.213 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3355e-05 s, 0.0 kB/s 2023-10-16T13:44:57.214 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.214 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.271 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7465e-05 s, 0.0 kB/s 2023-10-16T13:44:57.330 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.331 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.388 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.447 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.082e-05 s, 0.0 kB/s 2023-10-16T13:44:57.447 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.448 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.504 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.562 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0631e-05 s, 0.0 kB/s 2023-10-16T13:44:57.563 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.563 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.678 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2704e-05 s, 0.0 kB/s 2023-10-16T13:44:57.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.736 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.999e-05 s, 0.0 kB/s 2023-10-16T13:44:57.795 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.795 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.852 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1003e-05 s, 0.0 kB/s 2023-10-16T13:44:57.911 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:57.911 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:57.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:57.968 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2086e-05 s, 0.0 kB/s 2023-10-16T13:44:58.028 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.028 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.085 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.143 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3674e-05 s, 0.0 kB/s 2023-10-16T13:44:58.143 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.144 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.200 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4383e-05 s, 0.0 kB/s 2023-10-16T13:44:58.260 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.318 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:44:58.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:44:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1804e-05 s, 0.0 kB/s 2023-10-16T13:44:58.377 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.465 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.523 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.523 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.524 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8784e-05 s, 0.0 kB/s 2023-10-16T13:44:58.524 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.524 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.581 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3579e-05 s, 0.0 kB/s 2023-10-16T13:44:58.640 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.641 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5062e-05 s, 0.0 kB/s 2023-10-16T13:44:58.756 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.757 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.814 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0192e-05 s, 0.0 kB/s 2023-10-16T13:44:58.873 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.873 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:58.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:58.930 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:58.988 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:58.988 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:58.989 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3536e-05 s, 0.0 kB/s 2023-10-16T13:44:58.989 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:58.990 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.046 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.226e-05 s, 0.0 kB/s 2023-10-16T13:44:59.105 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.106 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.162 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1332e-05 s, 0.0 kB/s 2023-10-16T13:44:59.220 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.221 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.277 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3813e-05 s, 0.0 kB/s 2023-10-16T13:44:59.336 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.337 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.394 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-16T13:44:59.452 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.453 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.510 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1887e-05 s, 0.0 kB/s 2023-10-16T13:44:59.568 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.568 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.626 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.9466e-05 s, 0.0 kB/s 2023-10-16T13:44:59.685 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.685 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.742 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2319e-05 s, 0.0 kB/s 2023-10-16T13:44:59.801 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.802 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.858 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:44:59.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:44:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:44:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1819e-05 s, 0.0 kB/s 2023-10-16T13:44:59.916 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:44:59.916 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:44:59.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:44:59.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7296e-05 s, 0.0 kB/s 2023-10-16T13:45:00.033 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.033 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.090 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.149 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3857e-05 s, 0.0 kB/s 2023-10-16T13:45:00.150 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.150 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.206 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8955e-05 s, 0.0 kB/s 2023-10-16T13:45:00.266 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.266 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0597e-05 s, 0.0 kB/s 2023-10-16T13:45:00.383 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.383 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.441 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.499 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.499 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.499 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2545e-05 s, 0.0 kB/s 2023-10-16T13:45:00.500 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.500 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.559 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.616 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.617 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3653e-05 s, 0.0 kB/s 2023-10-16T13:45:00.617 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.617 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.674 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9672e-05 s, 0.0 kB/s 2023-10-16T13:45:00.732 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.733 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.789 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.848 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7408e-05 s, 0.0 kB/s 2023-10-16T13:45:00.849 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.849 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:00.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:00.907 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1756e-05 s, 0.0 kB/s 2023-10-16T13:45:00.965 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:00.965 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-16T13:45:01.082 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.082 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.139 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.698e-05 s, 0.0 kB/s 2023-10-16T13:45:01.198 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.199 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2445e-05 s, 0.0 kB/s 2023-10-16T13:45:01.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.315 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0571e-05 s, 0.0 kB/s 2023-10-16T13:45:01.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.431 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3261e-05 s, 0.0 kB/s 2023-10-16T13:45:01.547 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.548 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.605 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.663 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102668 s, 0.0 kB/s 2023-10-16T13:45:01.663 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.664 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7192e-05 s, 0.0 kB/s 2023-10-16T13:45:01.780 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.780 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.838 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6869e-05 s, 0.0 kB/s 2023-10-16T13:45:01.896 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:01.897 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:01.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:01.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000117004 s, 0.0 kB/s 2023-10-16T13:45:02.013 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.013 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.070 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.128 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6218e-05 s, 0.0 kB/s 2023-10-16T13:45:02.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.129 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.185 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1786e-05 s, 0.0 kB/s 2023-10-16T13:45:02.244 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.245 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.301 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1048e-05 s, 0.0 kB/s 2023-10-16T13:45:02.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.360 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.418 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3377e-05 s, 0.0 kB/s 2023-10-16T13:45:02.477 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.478 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.534 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.593 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1709e-05 s, 0.0 kB/s 2023-10-16T13:45:02.594 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.594 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.651 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.710 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.710 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.710 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3267e-05 s, 0.0 kB/s 2023-10-16T13:45:02.711 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.711 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.768 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9767e-05 s, 0.0 kB/s 2023-10-16T13:45:02.827 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.827 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:02.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:02.885 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:02.943 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:02.943 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:02.943 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1463e-05 s, 0.0 kB/s 2023-10-16T13:45:02.944 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:02.944 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.001 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.060 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.0125e-05 s, 0.0 kB/s 2023-10-16T13:45:03.061 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.061 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.178 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.0316e-05 s, 0.0 kB/s 2023-10-16T13:45:03.179 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.179 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.236 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8043e-05 s, 0.0 kB/s 2023-10-16T13:45:03.295 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0805e-05 s, 0.0 kB/s 2023-10-16T13:45:03.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.526 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9968e-05 s, 0.0 kB/s 2023-10-16T13:45:03.528 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.528 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.586 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3278e-05 s, 0.0 kB/s 2023-10-16T13:45:03.645 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.645 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.702 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1272e-05 s, 0.0 kB/s 2023-10-16T13:45:03.762 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.762 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.879 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9759e-05 s, 0.0 kB/s 2023-10-16T13:45:03.880 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:03.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:03.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8848e-05 s, 0.0 kB/s 2023-10-16T13:45:03.995 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:03.996 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.054 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.112 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.112 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.112 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1236e-05 s, 0.0 kB/s 2023-10-16T13:45:04.113 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.113 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.170 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9937e-05 s, 0.0 kB/s 2023-10-16T13:45:04.228 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.229 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1731e-05 s, 0.0 kB/s 2023-10-16T13:45:04.344 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.345 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.401 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9222e-05 s, 0.0 kB/s 2023-10-16T13:45:04.460 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.460 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.576 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1604e-05 s, 0.0 kB/s 2023-10-16T13:45:04.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.577 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.633 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2718e-05 s, 0.0 kB/s 2023-10-16T13:45:04.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.750 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1005e-05 s, 0.0 kB/s 2023-10-16T13:45:04.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:04.924 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.1155e-05 s, 0.0 kB/s 2023-10-16T13:45:04.925 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:04.925 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:04.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:04.982 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1635e-05 s, 0.0 kB/s 2023-10-16T13:45:05.043 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.044 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.100 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.9729e-05 s, 0.0 kB/s 2023-10-16T13:45:05.159 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.159 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.414e-05 s, 0.0 kB/s 2023-10-16T13:45:05.274 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.275 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.332 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6413e-05 s, 0.0 kB/s 2023-10-16T13:45:05.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.392 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.450 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.507 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.421e-05 s, 0.0 kB/s 2023-10-16T13:45:05.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.348e-05 s, 0.0 kB/s 2023-10-16T13:45:05.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5612e-05 s, 0.0 kB/s 2023-10-16T13:45:05.740 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.741 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2983e-05 s, 0.0 kB/s 2023-10-16T13:45:05.857 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:05.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:05.914 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4169e-05 s, 0.0 kB/s 2023-10-16T13:45:05.973 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:05.974 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.030 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6118e-05 s, 0.0 kB/s 2023-10-16T13:45:06.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.090 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.205 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3041e-05 s, 0.0 kB/s 2023-10-16T13:45:06.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.262 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9335e-05 s, 0.0 kB/s 2023-10-16T13:45:06.320 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.321 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.378 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2799e-05 s, 0.0 kB/s 2023-10-16T13:45:06.437 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.437 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.495 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.2554e-05 s, 0.0 kB/s 2023-10-16T13:45:06.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.555 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3933e-05 s, 0.0 kB/s 2023-10-16T13:45:06.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.730 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8558e-05 s, 0.0 kB/s 2023-10-16T13:45:06.789 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.848 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4239e-05 s, 0.0 kB/s 2023-10-16T13:45:06.907 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:06.907 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:06.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:06.964 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.022 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.022 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9809e-05 s, 0.0 kB/s 2023-10-16T13:45:07.022 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.023 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7949e-05 s, 0.0 kB/s 2023-10-16T13:45:07.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.139 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.196 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.909e-05 s, 0.0 kB/s 2023-10-16T13:45:07.254 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.254 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1085e-05 s, 0.0 kB/s 2023-10-16T13:45:07.371 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.371 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.430 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.488 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.488 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.488 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2919e-05 s, 0.0 kB/s 2023-10-16T13:45:07.489 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.489 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.546 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5968e-05 s, 0.0 kB/s 2023-10-16T13:45:07.606 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.606 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.664 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.722 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.722 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.723 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3125e-05 s, 0.0 kB/s 2023-10-16T13:45:07.723 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.724 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.782 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2881e-05 s, 0.0 kB/s 2023-10-16T13:45:07.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.842 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:07.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:07.899 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3469e-05 s, 0.0 kB/s 2023-10-16T13:45:07.958 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:07.958 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.015 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0956e-05 s, 0.0 kB/s 2023-10-16T13:45:08.073 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.073 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.130 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.189 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.189 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.52e-05 s, 0.0 kB/s 2023-10-16T13:45:08.189 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.190 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.247 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4139e-05 s, 0.0 kB/s 2023-10-16T13:45:08.305 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.306 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.362 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1841e-05 s, 0.0 kB/s 2023-10-16T13:45:08.421 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.421 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.479 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.537 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4728e-05 s, 0.0 kB/s 2023-10-16T13:45:08.538 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.538 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.595 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0712e-05 s, 0.0 kB/s 2023-10-16T13:45:08.654 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.654 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.713 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3291e-05 s, 0.0 kB/s 2023-10-16T13:45:08.773 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.773 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.830 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2331e-05 s, 0.0 kB/s 2023-10-16T13:45:08.890 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:08.890 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:08.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:08.948 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2837e-05 s, 0.0 kB/s 2023-10-16T13:45:09.006 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.007 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.064 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6018e-05 s, 0.0 kB/s 2023-10-16T13:45:09.125 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.125 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.183 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.02e-05 s, 0.0 kB/s 2023-10-16T13:45:09.242 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.242 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.300 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2246e-05 s, 0.0 kB/s 2023-10-16T13:45:09.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.415 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4123e-05 s, 0.0 kB/s 2023-10-16T13:45:09.473 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.474 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.531 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4971e-05 s, 0.0 kB/s 2023-10-16T13:45:09.590 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.590 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.648 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.706 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8538e-05 s, 0.0 kB/s 2023-10-16T13:45:09.707 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.707 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2002e-05 s, 0.0 kB/s 2023-10-16T13:45:09.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.882 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4136e-05 s, 0.0 kB/s 2023-10-16T13:45:09.941 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:09.941 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:09.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:09.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3578e-05 s, 0.0 kB/s 2023-10-16T13:45:10.058 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.058 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8696e-05 s, 0.0 kB/s 2023-10-16T13:45:10.173 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.173 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.230 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101948 s, 0.0 kB/s 2023-10-16T13:45:10.288 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.289 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.346 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0002e-05 s, 0.0 kB/s 2023-10-16T13:45:10.404 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.462 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.0831e-05 s, 0.0 kB/s 2023-10-16T13:45:10.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.521 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2386e-05 s, 0.0 kB/s 2023-10-16T13:45:10.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.692 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4408e-05 s, 0.0 kB/s 2023-10-16T13:45:10.751 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.752 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102004 s, 0.0 kB/s 2023-10-16T13:45:10.869 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.870 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:10.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:10.927 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:10.985 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4199e-05 s, 0.0 kB/s 2023-10-16T13:45:10.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:10.985 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.042 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8822e-05 s, 0.0 kB/s 2023-10-16T13:45:11.100 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.157 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.1876e-05 s, 0.0 kB/s 2023-10-16T13:45:11.215 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.216 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.272 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.3748e-05 s, 0.0 kB/s 2023-10-16T13:45:11.330 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.331 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.387 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1581e-05 s, 0.0 kB/s 2023-10-16T13:45:11.446 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.447 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.503 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9159e-05 s, 0.0 kB/s 2023-10-16T13:45:11.562 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.562 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1714e-05 s, 0.0 kB/s 2023-10-16T13:45:11.680 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.680 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.737 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9525e-05 s, 0.0 kB/s 2023-10-16T13:45:11.797 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.797 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.856 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:11.914 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:11.915 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:11.915 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.432e-05 s, 0.0 kB/s 2023-10-16T13:45:11.915 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:11.916 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:11.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:11.972 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0676e-05 s, 0.0 kB/s 2023-10-16T13:45:12.032 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.032 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.089 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-16T13:45:12.148 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.205 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7288e-05 s, 0.0 kB/s 2023-10-16T13:45:12.265 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.265 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.322 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4879e-05 s, 0.0 kB/s 2023-10-16T13:45:12.382 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.382 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.440 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1502e-05 s, 0.0 kB/s 2023-10-16T13:45:12.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.499 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5935e-05 s, 0.0 kB/s 2023-10-16T13:45:12.614 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.614 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.671 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.3998e-05 s, 0.0 kB/s 2023-10-16T13:45:12.731 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.732 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5568e-05 s, 0.0 kB/s 2023-10-16T13:45:12.847 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.847 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:12.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:12.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1269e-05 s, 0.0 kB/s 2023-10-16T13:45:12.965 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:12.965 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.022 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4057e-05 s, 0.0 kB/s 2023-10-16T13:45:13.081 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.081 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3073e-05 s, 0.0 kB/s 2023-10-16T13:45:13.196 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.197 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.253 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8086e-05 s, 0.0 kB/s 2023-10-16T13:45:13.312 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.312 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9232e-05 s, 0.0 kB/s 2023-10-16T13:45:13.429 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.429 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.487 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.545 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.546 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.486e-05 s, 0.0 kB/s 2023-10-16T13:45:13.546 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9021e-05 s, 0.0 kB/s 2023-10-16T13:45:13.663 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.664 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.155e-05 s, 0.0 kB/s 2023-10-16T13:45:13.780 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.780 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.837 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0423e-05 s, 0.0 kB/s 2023-10-16T13:45:13.897 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:13.897 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:13.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:13.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.014 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.014 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.112e-05 s, 0.0 kB/s 2023-10-16T13:45:14.014 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.015 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.071 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.128 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1423e-05 s, 0.0 kB/s 2023-10-16T13:45:14.129 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.129 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.186 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3654e-05 s, 0.0 kB/s 2023-10-16T13:45:14.245 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.246 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1173e-05 s, 0.0 kB/s 2023-10-16T13:45:14.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.420 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.479 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-16T13:45:14.480 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.480 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.538 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.596 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.596 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.596 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-16T13:45:14.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.597 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.653 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.713 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.713 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1261e-05 s, 0.0 kB/s 2023-10-16T13:45:14.713 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.714 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.771 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4981e-05 s, 0.0 kB/s 2023-10-16T13:45:14.829 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.830 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:14.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:14.888 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3152e-05 s, 0.0 kB/s 2023-10-16T13:45:14.947 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:14.947 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.004 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8171e-05 s, 0.0 kB/s 2023-10-16T13:45:15.064 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.064 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.121 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1857e-05 s, 0.0 kB/s 2023-10-16T13:45:15.179 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.180 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.236 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4921e-05 s, 0.0 kB/s 2023-10-16T13:45:15.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.296 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5187e-05 s, 0.0 kB/s 2023-10-16T13:45:15.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.473 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2205e-05 s, 0.0 kB/s 2023-10-16T13:45:15.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.532 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.588 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100408 s, 0.0 kB/s 2023-10-16T13:45:15.647 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.707 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4408e-05 s, 0.0 kB/s 2023-10-16T13:45:15.766 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.767 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.823 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.0568e-05 s, 0.0 kB/s 2023-10-16T13:45:15.881 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:15.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:15.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1532e-05 s, 0.0 kB/s 2023-10-16T13:45:15.996 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:15.996 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.053 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1756e-05 s, 0.0 kB/s 2023-10-16T13:45:16.112 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.112 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.169 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0781e-05 s, 0.0 kB/s 2023-10-16T13:45:16.227 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.228 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3839e-05 s, 0.0 kB/s 2023-10-16T13:45:16.343 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.344 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0385e-05 s, 0.0 kB/s 2023-10-16T13:45:16.459 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.459 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.516 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.574 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.575 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.575 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1637e-05 s, 0.0 kB/s 2023-10-16T13:45:16.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.632 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6088e-05 s, 0.0 kB/s 2023-10-16T13:45:16.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.753 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.811 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4005e-05 s, 0.0 kB/s 2023-10-16T13:45:16.812 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.812 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.872 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6513e-05 s, 0.0 kB/s 2023-10-16T13:45:16.929 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:16.930 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:16.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:16.986 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2179e-05 s, 0.0 kB/s 2023-10-16T13:45:17.044 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.044 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.160 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.160 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9279e-05 s, 0.0 kB/s 2023-10-16T13:45:17.160 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.161 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.276 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1823e-05 s, 0.0 kB/s 2023-10-16T13:45:17.277 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.277 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6446e-05 s, 0.0 kB/s 2023-10-16T13:45:17.393 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.394 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.450 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9617e-05 s, 0.0 kB/s 2023-10-16T13:45:17.508 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.508 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9046e-05 s, 0.0 kB/s 2023-10-16T13:45:17.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6985e-05 s, 0.0 kB/s 2023-10-16T13:45:17.741 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.741 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.2199e-05 s, 0.0 kB/s 2023-10-16T13:45:17.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:17.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:17.913 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6318e-05 s, 0.0 kB/s 2023-10-16T13:45:17.973 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:17.973 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.031 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.5461e-05 s, 0.0 kB/s 2023-10-16T13:45:18.089 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.090 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.146 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4226e-05 s, 0.0 kB/s 2023-10-16T13:45:18.206 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4651e-05 s, 0.0 kB/s 2023-10-16T13:45:18.322 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.323 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.283e-05 s, 0.0 kB/s 2023-10-16T13:45:18.438 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.438 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.495 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.554 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2461e-05 s, 0.0 kB/s 2023-10-16T13:45:18.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.555 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4152e-05 s, 0.0 kB/s 2023-10-16T13:45:18.670 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.671 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.728 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.786 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.786 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.787 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9248e-05 s, 0.0 kB/s 2023-10-16T13:45:18.787 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.787 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.844 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:18.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:18.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:18.902 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6879e-05 s, 0.0 kB/s 2023-10-16T13:45:18.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:18.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:18.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:18.960 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2648e-05 s, 0.0 kB/s 2023-10-16T13:45:19.018 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.019 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.8812e-05 s, 0.0 kB/s 2023-10-16T13:45:19.135 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.135 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.250 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.250 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.250 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5015e-05 s, 0.0 kB/s 2023-10-16T13:45:19.251 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.252 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.310 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.7649e-05 s, 0.0 kB/s 2023-10-16T13:45:19.369 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.369 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.425 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.484 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9369e-05 s, 0.0 kB/s 2023-10-16T13:45:19.484 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.485 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.543 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.601 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2345e-05 s, 0.0 kB/s 2023-10-16T13:45:19.602 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.602 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.659 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.717 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5155e-05 s, 0.0 kB/s 2023-10-16T13:45:19.718 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.719 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.776 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9764e-05 s, 0.0 kB/s 2023-10-16T13:45:19.836 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.837 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:19.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:19.893 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3994e-05 s, 0.0 kB/s 2023-10-16T13:45:19.953 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:19.953 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.010 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1668e-05 s, 0.0 kB/s 2023-10-16T13:45:20.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.070 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0864e-05 s, 0.0 kB/s 2023-10-16T13:45:20.187 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.187 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3412e-05 s, 0.0 kB/s 2023-10-16T13:45:20.303 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.304 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.360 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9295e-05 s, 0.0 kB/s 2023-10-16T13:45:20.420 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.420 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.536 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1196e-05 s, 0.0 kB/s 2023-10-16T13:45:20.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.537 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.593 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2759e-05 s, 0.0 kB/s 2023-10-16T13:45:20.652 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.768 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2575e-05 s, 0.0 kB/s 2023-10-16T13:45:20.768 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:20.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:20.884 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:20.884 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2389e-05 s, 0.0 kB/s 2023-10-16T13:45:20.884 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:20.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:20.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:20.942 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.000 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.000 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.000 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3871e-05 s, 0.0 kB/s 2023-10-16T13:45:21.001 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.001 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.059 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3596e-05 s, 0.0 kB/s 2023-10-16T13:45:21.118 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.119 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.176 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1525e-05 s, 0.0 kB/s 2023-10-16T13:45:21.236 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.236 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.293 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0404e-05 s, 0.0 kB/s 2023-10-16T13:45:21.352 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.353 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.409 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.8063e-05 s, 0.0 kB/s 2023-10-16T13:45:21.469 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.469 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.526 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.585 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.586 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.586 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9349e-05 s, 0.0 kB/s 2023-10-16T13:45:21.586 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.587 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.643 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.703 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.703 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.703 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2325e-05 s, 0.0 kB/s 2023-10-16T13:45:21.704 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.704 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.762 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1377e-05 s, 0.0 kB/s 2023-10-16T13:45:21.821 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.821 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.878 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2435e-05 s, 0.0 kB/s 2023-10-16T13:45:21.938 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:21.938 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:21.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:21.996 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000103221 s, 0.0 kB/s 2023-10-16T13:45:22.055 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.055 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1895e-05 s, 0.0 kB/s 2023-10-16T13:45:22.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.228 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0445e-05 s, 0.0 kB/s 2023-10-16T13:45:22.287 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.287 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.345 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.404 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8431e-05 s, 0.0 kB/s 2023-10-16T13:45:22.404 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.405 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.461 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3698e-05 s, 0.0 kB/s 2023-10-16T13:45:22.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.521 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.578 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7675e-05 s, 0.0 kB/s 2023-10-16T13:45:22.638 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.638 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3686e-05 s, 0.0 kB/s 2023-10-16T13:45:22.755 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.755 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.813 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.872 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0492e-05 s, 0.0 kB/s 2023-10-16T13:45:22.872 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.872 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:22.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:22.929 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:22.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1592e-05 s, 0.0 kB/s 2023-10-16T13:45:22.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:22.988 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.044 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.521e-05 s, 0.0 kB/s 2023-10-16T13:45:23.103 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.103 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.159 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.218 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.218 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.218 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0448e-05 s, 0.0 kB/s 2023-10-16T13:45:23.219 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.219 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.333 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.334 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.334 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6315e-05 s, 0.0 kB/s 2023-10-16T13:45:23.334 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.335 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.392 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1598e-05 s, 0.0 kB/s 2023-10-16T13:45:23.451 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.452 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.508 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2328e-05 s, 0.0 kB/s 2023-10-16T13:45:23.567 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.567 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.625 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1091e-05 s, 0.0 kB/s 2023-10-16T13:45:23.684 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.684 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.800 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3139e-05 s, 0.0 kB/s 2023-10-16T13:45:23.801 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.801 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.858 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9852e-05 s, 0.0 kB/s 2023-10-16T13:45:23.917 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:23.917 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:23.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:23.974 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.674e-05 s, 0.0 kB/s 2023-10-16T13:45:24.033 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.034 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.091 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1109e-05 s, 0.0 kB/s 2023-10-16T13:45:24.149 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.206 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.264 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1234e-05 s, 0.0 kB/s 2023-10-16T13:45:24.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.321 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.379 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.380 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0967e-05 s, 0.0 kB/s 2023-10-16T13:45:24.380 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.381 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4741e-05 s, 0.0 kB/s 2023-10-16T13:45:24.496 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.496 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.612 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4104e-05 s, 0.0 kB/s 2023-10-16T13:45:24.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5323e-05 s, 0.0 kB/s 2023-10-16T13:45:24.729 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.730 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.786 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-16T13:45:24.845 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.846 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:24.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:24.903 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0544e-05 s, 0.0 kB/s 2023-10-16T13:45:24.962 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:24.963 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.020 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5902e-05 s, 0.0 kB/s 2023-10-16T13:45:25.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.079 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.135 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7697e-05 s, 0.0 kB/s 2023-10-16T13:45:25.193 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.194 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-16T13:45:25.311 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.311 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.368 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6928e-05 s, 0.0 kB/s 2023-10-16T13:45:25.427 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.428 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.484 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2e-05 s, 0 B/s 2023-10-16T13:45:25.543 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.543 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.600 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8105e-05 s, 0.0 kB/s 2023-10-16T13:45:25.660 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.660 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.717 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.776 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.776 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.776 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4652e-05 s, 0.0 kB/s 2023-10-16T13:45:25.777 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.777 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.835 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3444e-05 s, 0.0 kB/s 2023-10-16T13:45:25.895 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:25.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:25.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:25.953 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.011 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.011 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.011 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1693e-05 s, 0.0 kB/s 2023-10-16T13:45:26.012 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.012 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.069 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-16T13:45:26.130 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.131 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.187 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2368e-05 s, 0.0 kB/s 2023-10-16T13:45:26.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4311e-05 s, 0.0 kB/s 2023-10-16T13:45:26.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.477 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1049e-05 s, 0.0 kB/s 2023-10-16T13:45:26.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.478 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9139e-05 s, 0.0 kB/s 2023-10-16T13:45:26.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.596 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.653 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2241e-05 s, 0.0 kB/s 2023-10-16T13:45:26.715 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.826 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.826 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2139e-05 s, 0.0 kB/s 2023-10-16T13:45:26.828 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.828 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:26.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:26.885 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4441e-05 s, 0.0 kB/s 2023-10-16T13:45:26.944 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:26.945 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4874e-05 s, 0.0 kB/s 2023-10-16T13:45:27.062 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.062 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.119 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6834e-05 s, 0.0 kB/s 2023-10-16T13:45:27.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.178 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.236 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.272e-05 s, 0.0 kB/s 2023-10-16T13:45:27.295 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.352 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.093e-05 s, 0.0 kB/s 2023-10-16T13:45:27.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.695e-05 s, 0.0 kB/s 2023-10-16T13:45:27.528 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.529 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.586 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9158e-05 s, 0.0 kB/s 2023-10-16T13:45:27.646 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.703 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.762 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.0282e-05 s, 0.0 kB/s 2023-10-16T13:45:27.763 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.763 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3119e-05 s, 0.0 kB/s 2023-10-16T13:45:27.880 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:27.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:27.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0313e-05 s, 0.0 kB/s 2023-10-16T13:45:27.997 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:27.997 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.054 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7525e-05 s, 0.0 kB/s 2023-10-16T13:45:28.114 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.114 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.172 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.230 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.230 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.903e-05 s, 0.0 kB/s 2023-10-16T13:45:28.230 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.231 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3244e-05 s, 0.0 kB/s 2023-10-16T13:45:28.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.346 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:45:28.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:45:28.459 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.388e-05 s, 0.0 kB/s 2023-10-16T13:45:28.461 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.461 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.520 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2187e-05 s, 0.0 kB/s 2023-10-16T13:45:28.579 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.579 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.636 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8355e-05 s, 0.0 kB/s 2023-10-16T13:45:28.696 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.697 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.755 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.814 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0722e-05 s, 0.0 kB/s 2023-10-16T13:45:28.814 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.814 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.872 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4573e-05 s, 0.0 kB/s 2023-10-16T13:45:28.931 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:28.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:28.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:28.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3475e-05 s, 0.0 kB/s 2023-10-16T13:45:29.047 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.047 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.7203e-05 s, 0.0 kB/s 2023-10-16T13:45:29.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1059e-05 s, 0.0 kB/s 2023-10-16T13:45:29.279 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0502e-05 s, 0.0 kB/s 2023-10-16T13:45:29.394 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.394 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.452 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.509 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.510 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.510 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9941e-05 s, 0.0 kB/s 2023-10-16T13:45:29.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.511 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.626 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.297e-05 s, 0.0 kB/s 2023-10-16T13:45:29.627 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.684 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2003e-05 s, 0.0 kB/s 2023-10-16T13:45:29.744 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.744 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.801 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000118496 s, 0.0 kB/s 2023-10-16T13:45:29.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.861 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:29.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:29.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:29.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8251e-05 s, 0.0 kB/s 2023-10-16T13:45:29.977 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:29.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.034 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5129e-05 s, 0.0 kB/s 2023-10-16T13:45:30.093 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.093 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.209 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6515e-05 s, 0.0 kB/s 2023-10-16T13:45:30.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.266 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3295e-05 s, 0.0 kB/s 2023-10-16T13:45:30.324 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.325 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.381 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5089e-05 s, 0.0 kB/s 2023-10-16T13:45:30.441 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.441 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2894e-05 s, 0.0 kB/s 2023-10-16T13:45:30.556 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.614 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.672 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.327e-05 s, 0.0 kB/s 2023-10-16T13:45:30.672 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.673 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.729 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.788 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8414e-05 s, 0.0 kB/s 2023-10-16T13:45:30.789 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.789 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:30.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:30.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:30.904 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2896e-05 s, 0.0 kB/s 2023-10-16T13:45:30.904 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:30.905 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:30.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:30.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0271e-05 s, 0.0 kB/s 2023-10-16T13:45:31.021 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.021 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.078 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.136 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.136 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0216e-05 s, 0.0 kB/s 2023-10-16T13:45:31.136 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.136 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.193 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.251 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6818e-05 s, 0.0 kB/s 2023-10-16T13:45:31.251 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.252 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.308 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8632e-05 s, 0.0 kB/s 2023-10-16T13:45:31.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.423 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.482 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7361e-05 s, 0.0 kB/s 2023-10-16T13:45:31.482 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.483 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.539 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2339e-05 s, 0.0 kB/s 2023-10-16T13:45:31.598 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.599 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.655 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.713 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.713 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.713 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8089e-05 s, 0.0 kB/s 2023-10-16T13:45:31.714 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.772 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.375e-05 s, 0.0 kB/s 2023-10-16T13:45:31.832 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.833 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:31.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:31.889 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2475e-05 s, 0.0 kB/s 2023-10-16T13:45:31.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:31.948 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.006 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2695e-05 s, 0.0 kB/s 2023-10-16T13:45:32.064 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.065 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.121 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3739e-05 s, 0.0 kB/s 2023-10-16T13:45:32.180 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.181 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1608e-05 s, 0.0 kB/s 2023-10-16T13:45:32.295 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.296 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.352 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.410 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5671e-05 s, 0.0 kB/s 2023-10-16T13:45:32.410 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.411 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.467 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100045 s, 0.0 kB/s 2023-10-16T13:45:32.527 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.527 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.584 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0964e-05 s, 0.0 kB/s 2023-10-16T13:45:32.643 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.700 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.758 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4064e-05 s, 0.0 kB/s 2023-10-16T13:45:32.759 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.760 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.817 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3141e-05 s, 0.0 kB/s 2023-10-16T13:45:32.876 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.876 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:32.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:32.933 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:32.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:32.991 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:32.991 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1857e-05 s, 0.0 kB/s 2023-10-16T13:45:32.991 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:32.992 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.048 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.106 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.106 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.106 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8627e-05 s, 0.0 kB/s 2023-10-16T13:45:33.107 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.107 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.164 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9985e-05 s, 0.0 kB/s 2023-10-16T13:45:33.224 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.224 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.281 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.339 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.340 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9569e-05 s, 0.0 kB/s 2023-10-16T13:45:33.340 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.341 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.398 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9293e-05 s, 0.0 kB/s 2023-10-16T13:45:33.456 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.457 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.513 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.571 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2513e-05 s, 0.0 kB/s 2023-10-16T13:45:33.571 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.572 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.628 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.686 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.0684e-05 s, 0.0 kB/s 2023-10-16T13:45:33.686 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.687 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.743 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3256e-05 s, 0.0 kB/s 2023-10-16T13:45:33.802 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.803 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.860 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4728e-05 s, 0.0 kB/s 2023-10-16T13:45:33.920 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:33.921 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:33.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:33.979 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0419e-05 s, 0.0 kB/s 2023-10-16T13:45:34.038 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.038 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.095 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4351e-05 s, 0.0 kB/s 2023-10-16T13:45:34.154 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.155 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.212 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2372e-05 s, 0.0 kB/s 2023-10-16T13:45:34.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.271 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.328 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3392e-05 s, 0.0 kB/s 2023-10-16T13:45:34.387 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.388 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.446 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5118e-05 s, 0.0 kB/s 2023-10-16T13:45:34.505 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.505 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4643e-05 s, 0.0 kB/s 2023-10-16T13:45:34.622 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.679 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2715e-05 s, 0.0 kB/s 2023-10-16T13:45:34.739 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.739 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.797 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.855 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.855 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8945e-05 s, 0.0 kB/s 2023-10-16T13:45:34.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.856 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:34.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:34.914 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5659e-05 s, 0.0 kB/s 2023-10-16T13:45:34.974 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:34.975 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.032 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0028e-05 s, 0.0 kB/s 2023-10-16T13:45:35.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.090 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.148 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1448e-05 s, 0.0 kB/s 2023-10-16T13:45:35.206 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7295e-05 s, 0.0 kB/s 2023-10-16T13:45:35.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.323 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4058e-05 s, 0.0 kB/s 2023-10-16T13:45:35.439 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.440 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.497 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2222e-05 s, 0.0 kB/s 2023-10-16T13:45:35.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4791e-05 s, 0.0 kB/s 2023-10-16T13:45:35.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.729 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.787 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5189e-05 s, 0.0 kB/s 2023-10-16T13:45:35.788 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.788 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5091e-05 s, 0.0 kB/s 2023-10-16T13:45:35.905 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:35.906 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:35.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:35.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5769e-05 s, 0.0 kB/s 2023-10-16T13:45:36.022 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.079 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0859e-05 s, 0.0 kB/s 2023-10-16T13:45:36.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.139 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.197 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.255 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.255 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0856e-05 s, 0.0 kB/s 2023-10-16T13:45:36.255 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.256 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.312 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.5029e-05 s, 0.0 kB/s 2023-10-16T13:45:36.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.371 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3436e-05 s, 0.0 kB/s 2023-10-16T13:45:36.486 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.486 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.543 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1939e-05 s, 0.0 kB/s 2023-10-16T13:45:36.601 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.659 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0178e-05 s, 0.0 kB/s 2023-10-16T13:45:36.722 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.723 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.839 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3372e-05 s, 0.0 kB/s 2023-10-16T13:45:36.840 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.840 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:36.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:36.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2053e-05 s, 0.0 kB/s 2023-10-16T13:45:36.955 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:36.956 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.012 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1858e-05 s, 0.0 kB/s 2023-10-16T13:45:37.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.185 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0226e-05 s, 0.0 kB/s 2023-10-16T13:45:37.186 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.186 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.243 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.301 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.359e-05 s, 0.0 kB/s 2023-10-16T13:45:37.301 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.301 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.358 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4272e-05 s, 0.0 kB/s 2023-10-16T13:45:37.416 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.416 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.473 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8207e-05 s, 0.0 kB/s 2023-10-16T13:45:37.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.532 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.589 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.647 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.647 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.647 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2849e-05 s, 0.0 kB/s 2023-10-16T13:45:37.648 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.648 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.705 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3366e-05 s, 0.0 kB/s 2023-10-16T13:45:37.765 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.765 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.822 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.880 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.880 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.880 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5863e-05 s, 0.0 kB/s 2023-10-16T13:45:37.881 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:37.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:37.939 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:37.997 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0195e-05 s, 0.0 kB/s 2023-10-16T13:45:37.998 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:37.999 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.056 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.287e-05 s, 0.0 kB/s 2023-10-16T13:45:38.116 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.116 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.173 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.232 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.232 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0549e-05 s, 0.0 kB/s 2023-10-16T13:45:38.232 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.233 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.178e-05 s, 0.0 kB/s 2023-10-16T13:45:38.348 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.348 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.406 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2249e-05 s, 0.0 kB/s 2023-10-16T13:45:38.465 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1963e-05 s, 0.0 kB/s 2023-10-16T13:45:38.583 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.583 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.641 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0619e-05 s, 0.0 kB/s 2023-10-16T13:45:38.700 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.700 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.757 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.816 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.816 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.0478e-05 s, 0.0 kB/s 2023-10-16T13:45:38.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:38.932 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:38.932 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:38.933 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5269e-05 s, 0.0 kB/s 2023-10-16T13:45:38.933 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:38.933 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:38.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:38.991 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4958e-05 s, 0.0 kB/s 2023-10-16T13:45:39.050 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.050 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3188e-05 s, 0.0 kB/s 2023-10-16T13:45:39.167 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.167 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.224 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5861e-05 s, 0.0 kB/s 2023-10-16T13:45:39.282 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.282 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3118e-05 s, 0.0 kB/s 2023-10-16T13:45:39.398 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.399 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.455 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4124e-05 s, 0.0 kB/s 2023-10-16T13:45:39.514 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.515 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.572 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5249e-05 s, 0.0 kB/s 2023-10-16T13:45:39.631 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.633 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.688 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7879e-05 s, 0.0 kB/s 2023-10-16T13:45:39.748 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.748 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.806 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-16T13:45:39.865 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.865 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:39.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:39.922 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0389e-05 s, 0.0 kB/s 2023-10-16T13:45:39.981 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:39.981 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.038 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1163e-05 s, 0.0 kB/s 2023-10-16T13:45:40.097 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.098 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2221e-05 s, 0.0 kB/s 2023-10-16T13:45:40.214 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.214 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.272 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.329 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.330 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.330 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0719e-05 s, 0.0 kB/s 2023-10-16T13:45:40.331 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.332 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.387 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.446 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.447 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6838e-05 s, 0.0 kB/s 2023-10-16T13:45:40.447 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.447 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.504 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1008e-05 s, 0.0 kB/s 2023-10-16T13:45:40.563 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.563 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.678 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.8806e-05 s, 0.0 kB/s 2023-10-16T13:45:40.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.737 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4219e-05 s, 0.0 kB/s 2023-10-16T13:45:40.795 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.796 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.852 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1859e-05 s, 0.0 kB/s 2023-10-16T13:45:40.911 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:40.912 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:40.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:40.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.028 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4207e-05 s, 0.0 kB/s 2023-10-16T13:45:41.028 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.029 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.085 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3149e-05 s, 0.0 kB/s 2023-10-16T13:45:41.144 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.144 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.202 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.260 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.260 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.261 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8368e-05 s, 0.0 kB/s 2023-10-16T13:45:41.261 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.261 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.318 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101758 s, 0.0 kB/s 2023-10-16T13:45:41.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.435 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.493 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7948e-05 s, 0.0 kB/s 2023-10-16T13:45:41.495 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.495 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9388e-05 s, 0.0 kB/s 2023-10-16T13:45:41.611 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1788e-05 s, 0.0 kB/s 2023-10-16T13:45:41.728 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.729 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.786 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3203e-05 s, 0.0 kB/s 2023-10-16T13:45:41.845 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.845 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:41.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:41.902 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3845e-05 s, 0.0 kB/s 2023-10-16T13:45:41.961 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:41.962 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.076 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.094 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1826e-05 s, 0.0 kB/s 2023-10-16T13:45:42.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.152 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1331e-05 s, 0.0 kB/s 2023-10-16T13:45:42.211 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.211 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.268 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2453e-05 s, 0.0 kB/s 2023-10-16T13:45:42.328 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.328 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.385 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000111714 s, 0.0 kB/s 2023-10-16T13:45:42.444 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.445 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.503 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.562 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.513e-05 s, 0.0 kB/s 2023-10-16T13:45:42.562 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.563 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2359e-05 s, 0.0 kB/s 2023-10-16T13:45:42.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.737 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4671e-05 s, 0.0 kB/s 2023-10-16T13:45:42.795 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.796 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.852 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4418e-05 s, 0.0 kB/s 2023-10-16T13:45:42.912 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:42.912 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:42.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:42.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.028 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.028 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.029 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4595e-05 s, 0.0 kB/s 2023-10-16T13:45:43.029 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.029 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.086 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.144 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.145 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.145 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.9691e-05 s, 0.0 kB/s 2023-10-16T13:45:43.145 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.146 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.202 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.260 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.260 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.260 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5062e-05 s, 0.0 kB/s 2023-10-16T13:45:43.261 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.262 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.321 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3565e-05 s, 0.0 kB/s 2023-10-16T13:45:43.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.436 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9543e-05 s, 0.0 kB/s 2023-10-16T13:45:43.494 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.495 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.551 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8177e-05 s, 0.0 kB/s 2023-10-16T13:45:43.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.668 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7245e-05 s, 0.0 kB/s 2023-10-16T13:45:43.730 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.731 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9922e-05 s, 0.0 kB/s 2023-10-16T13:45:43.846 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.847 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:43.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:43.904 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1965e-05 s, 0.0 kB/s 2023-10-16T13:45:43.964 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:43.964 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.021 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.3697e-05 s, 0.0 kB/s 2023-10-16T13:45:44.081 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.081 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.140 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.198 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-16T13:45:44.199 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.199 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2669e-05 s, 0.0 kB/s 2023-10-16T13:45:44.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.315 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.431 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1191e-05 s, 0.0 kB/s 2023-10-16T13:45:44.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.432 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4161e-05 s, 0.0 kB/s 2023-10-16T13:45:44.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.548 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.606 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8699e-05 s, 0.0 kB/s 2023-10-16T13:45:44.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.666 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.722 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.780 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.781 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1972e-05 s, 0.0 kB/s 2023-10-16T13:45:44.782 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.782 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.838 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0212e-05 s, 0.0 kB/s 2023-10-16T13:45:44.898 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:44.899 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:44.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:44.956 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3517e-05 s, 0.0 kB/s 2023-10-16T13:45:45.015 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.016 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.073 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1095e-05 s, 0.0 kB/s 2023-10-16T13:45:45.131 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.131 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.188 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4729e-05 s, 0.0 kB/s 2023-10-16T13:45:45.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1763e-05 s, 0.0 kB/s 2023-10-16T13:45:45.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.364 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.568e-05 s, 0.0 kB/s 2023-10-16T13:45:45.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1447e-05 s, 0.0 kB/s 2023-10-16T13:45:45.593 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.593 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8135e-05 s, 0.0 kB/s 2023-10-16T13:45:45.708 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.709 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.767 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.825 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3406e-05 s, 0.0 kB/s 2023-10-16T13:45:45.826 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.826 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:45.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:45.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2378e-05 s, 0.0 kB/s 2023-10-16T13:45:45.942 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:45.943 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.000 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.057 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101281 s, 0.0 kB/s 2023-10-16T13:45:46.058 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.059 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0029e-05 s, 0.0 kB/s 2023-10-16T13:45:46.174 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.175 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.232 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1578e-05 s, 0.0 kB/s 2023-10-16T13:45:46.290 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.290 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.349 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6955e-05 s, 0.0 kB/s 2023-10-16T13:45:46.407 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.407 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.464 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.522 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.522 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.523 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1496e-05 s, 0.0 kB/s 2023-10-16T13:45:46.523 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.523 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.580 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.1611e-05 s, 0.0 kB/s 2023-10-16T13:45:46.638 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.639 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8681e-05 s, 0.0 kB/s 2023-10-16T13:45:46.755 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.755 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.813 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4065e-05 s, 0.0 kB/s 2023-10-16T13:45:46.872 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.872 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:46.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:46.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4994e-05 s, 0.0 kB/s 2023-10-16T13:45:46.991 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:46.991 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.048 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4188e-05 s, 0.0 kB/s 2023-10-16T13:45:47.107 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.108 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.165 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3469e-05 s, 0.0 kB/s 2023-10-16T13:45:47.223 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.224 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.280 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8211e-05 s, 0.0 kB/s 2023-10-16T13:45:47.339 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.340 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.396 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2466e-05 s, 0.0 kB/s 2023-10-16T13:45:47.454 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.455 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.512 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4668e-05 s, 0.0 kB/s 2023-10-16T13:45:47.571 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.571 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.629 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2538e-05 s, 0.0 kB/s 2023-10-16T13:45:47.687 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.688 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.744 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.666e-05 s, 0.0 kB/s 2023-10-16T13:45:47.802 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.803 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.859 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2375e-05 s, 0.0 kB/s 2023-10-16T13:45:47.918 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:47.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:47.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:47.976 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.033 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.034 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.034 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6742e-05 s, 0.0 kB/s 2023-10-16T13:45:48.034 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.035 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.092 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0287e-05 s, 0.0 kB/s 2023-10-16T13:45:48.150 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.151 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.207 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6375e-05 s, 0.0 kB/s 2023-10-16T13:45:48.266 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.266 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.323 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.9994e-05 s, 0.0 kB/s 2023-10-16T13:45:48.382 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.382 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.498 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0001e-05 s, 0.0 kB/s 2023-10-16T13:45:48.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.499 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.614 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.614 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.614 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3235e-05 s, 0.0 kB/s 2023-10-16T13:45:48.614 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.615 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.671 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1622e-05 s, 0.0 kB/s 2023-10-16T13:45:48.730 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.730 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2945e-05 s, 0.0 kB/s 2023-10-16T13:45:48.847 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.847 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:48.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:48.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3553e-05 s, 0.0 kB/s 2023-10-16T13:45:48.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:48.964 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.020 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6475e-05 s, 0.0 kB/s 2023-10-16T13:45:49.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.079 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.136 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5102e-05 s, 0.0 kB/s 2023-10-16T13:45:49.195 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.195 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.252 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3416e-05 s, 0.0 kB/s 2023-10-16T13:45:49.310 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.311 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.367 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5865e-05 s, 0.0 kB/s 2023-10-16T13:45:49.426 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.427 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.484 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.541 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.541 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.541 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9855e-05 s, 0.0 kB/s 2023-10-16T13:45:49.542 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.543 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.600 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.659 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3473e-05 s, 0.0 kB/s 2023-10-16T13:45:49.660 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.660 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.717 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3373e-05 s, 0.0 kB/s 2023-10-16T13:45:49.777 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.777 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.835 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5369e-05 s, 0.0 kB/s 2023-10-16T13:45:49.895 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:49.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:49.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:49.952 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2632e-05 s, 0.0 kB/s 2023-10-16T13:45:50.011 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.011 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.069 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2149e-05 s, 0.0 kB/s 2023-10-16T13:45:50.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.128 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.185 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.242 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8718e-05 s, 0.0 kB/s 2023-10-16T13:45:50.243 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.244 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8439e-05 s, 0.0 kB/s 2023-10-16T13:45:50.361 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.361 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.418 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8949e-05 s, 0.0 kB/s 2023-10-16T13:45:50.476 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.533 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.590 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0085e-05 s, 0.0 kB/s 2023-10-16T13:45:50.591 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.592 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.648 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2661e-05 s, 0.0 kB/s 2023-10-16T13:45:50.706 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.707 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.763 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.820 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.820 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5127e-05 s, 0.0 kB/s 2023-10-16T13:45:50.821 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.821 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.878 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4139e-05 s, 0.0 kB/s 2023-10-16T13:45:50.938 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:50.938 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:50.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:50.996 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.054 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2096e-05 s, 0.0 kB/s 2023-10-16T13:45:51.055 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.170 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2209e-05 s, 0.0 kB/s 2023-10-16T13:45:51.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.171 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.228 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4604e-05 s, 0.0 kB/s 2023-10-16T13:45:51.286 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.287 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.343 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4508e-05 s, 0.0 kB/s 2023-10-16T13:45:51.402 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.402 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.459 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2254e-05 s, 0.0 kB/s 2023-10-16T13:45:51.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.519 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.576 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.634 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.635 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.635 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1536e-05 s, 0.0 kB/s 2023-10-16T13:45:51.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.636 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.692 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.750 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2132e-05 s, 0.0 kB/s 2023-10-16T13:45:51.751 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.752 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3668e-05 s, 0.0 kB/s 2023-10-16T13:45:51.869 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.869 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:51.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:51.928 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:51.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:51.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:51.986 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4615e-05 s, 0.0 kB/s 2023-10-16T13:45:51.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:51.987 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.045 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.103 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4465e-05 s, 0.0 kB/s 2023-10-16T13:45:52.104 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.104 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.162 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.221 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.221 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.221 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2735e-05 s, 0.0 kB/s 2023-10-16T13:45:52.221 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.222 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.279 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.337 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.337 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5192e-05 s, 0.0 kB/s 2023-10-16T13:45:52.339 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.339 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.398 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-16T13:45:52.457 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.457 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.513 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.571 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3742e-05 s, 0.0 kB/s 2023-10-16T13:45:52.572 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.572 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.629 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3107e-05 s, 0.0 kB/s 2023-10-16T13:45:52.687 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.688 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.744 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.802 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.802 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.802 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3072e-05 s, 0.0 kB/s 2023-10-16T13:45:52.803 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.803 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.860 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102612 s, 0.0 kB/s 2023-10-16T13:45:52.919 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:52.920 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:52.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:52.976 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.196e-05 s, 0.0 kB/s 2023-10-16T13:45:53.034 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.035 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.091 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.148 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.148 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1387e-05 s, 0.0 kB/s 2023-10-16T13:45:53.149 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.206 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2062e-05 s, 0.0 kB/s 2023-10-16T13:45:53.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.265 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.321 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9832e-05 s, 0.0 kB/s 2023-10-16T13:45:53.381 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.381 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.438 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.8234e-05 s, 0.0 kB/s 2023-10-16T13:45:53.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.499 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100744 s, 0.0 kB/s 2023-10-16T13:45:53.619 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.619 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.676 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.733 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.733 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.733 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3837e-05 s, 0.0 kB/s 2023-10-16T13:45:53.734 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.735 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.8222e-05 s, 0.0 kB/s 2023-10-16T13:45:53.852 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:53.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:53.909 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0108e-05 s, 0.0 kB/s 2023-10-16T13:45:53.967 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:53.967 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.025 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.082 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.3225e-05 s, 0.0 kB/s 2023-10-16T13:45:54.083 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.084 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.141 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4699e-05 s, 0.0 kB/s 2023-10-16T13:45:54.200 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.257 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.3569e-05 s, 0.0 kB/s 2023-10-16T13:45:54.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.316 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.373 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4862e-05 s, 0.0 kB/s 2023-10-16T13:45:54.432 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.433 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.490 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.547 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1429e-05 s, 0.0 kB/s 2023-10-16T13:45:54.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.549 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.605 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6743e-05 s, 0.0 kB/s 2023-10-16T13:45:54.665 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.665 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1882e-05 s, 0.0 kB/s 2023-10-16T13:45:54.784 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.784 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:54.899 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:54.899 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:54.900 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9739e-05 s, 0.0 kB/s 2023-10-16T13:45:54.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:54.901 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:54.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:54.959 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2279e-05 s, 0.0 kB/s 2023-10-16T13:45:55.018 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.018 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.0998e-05 s, 0.0 kB/s 2023-10-16T13:45:55.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.134 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9642e-05 s, 0.0 kB/s 2023-10-16T13:45:55.249 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.250 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.307 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.366 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.366 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0475e-05 s, 0.0 kB/s 2023-10-16T13:45:55.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2645e-05 s, 0.0 kB/s 2023-10-16T13:45:55.484 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.542 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5712e-05 s, 0.0 kB/s 2023-10-16T13:45:55.602 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.602 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.659 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.717 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.718 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000106975 s, 0.0 kB/s 2023-10-16T13:45:55.719 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.719 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5725e-05 s, 0.0 kB/s 2023-10-16T13:45:55.836 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.836 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:55.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:55.894 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.24e-05 s, 0.0 kB/s 2023-10-16T13:45:55.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:55.953 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.009 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8868e-05 s, 0.0 kB/s 2023-10-16T13:45:56.068 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.068 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.125 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.183 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1064e-05 s, 0.0 kB/s 2023-10-16T13:45:56.184 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.185 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.241 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3721e-05 s, 0.0 kB/s 2023-10-16T13:45:56.300 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.301 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.357 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.418 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4731e-05 s, 0.0 kB/s 2023-10-16T13:45:56.419 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.419 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.476 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5612e-05 s, 0.0 kB/s 2023-10-16T13:45:56.535 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.536 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.595 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9044e-05 s, 0.0 kB/s 2023-10-16T13:45:56.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.654 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4162e-05 s, 0.0 kB/s 2023-10-16T13:45:56.771 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.771 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.828 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4978e-05 s, 0.0 kB/s 2023-10-16T13:45:56.888 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:56.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:56.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:56.945 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.4998e-05 s, 0.0 kB/s 2023-10-16T13:45:57.005 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.005 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.062 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7127e-05 s, 0.0 kB/s 2023-10-16T13:45:57.121 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.122 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.178 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6552e-05 s, 0.0 kB/s 2023-10-16T13:45:57.237 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.237 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.294 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.353 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.354 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.354 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8101e-05 s, 0.0 kB/s 2023-10-16T13:45:57.354 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.355 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.412 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8945e-05 s, 0.0 kB/s 2023-10-16T13:45:57.470 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.471 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.528 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4691e-05 s, 0.0 kB/s 2023-10-16T13:45:57.587 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.588 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.644 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0039e-05 s, 0.0 kB/s 2023-10-16T13:45:57.702 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.703 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.760 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2148e-05 s, 0.0 kB/s 2023-10-16T13:45:57.819 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.820 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.876 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:57.935 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:57.935 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:57.935 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2113e-05 s, 0.0 kB/s 2023-10-16T13:45:57.935 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:57.936 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:57.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:57.993 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0161e-05 s, 0.0 kB/s 2023-10-16T13:45:58.051 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.052 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.166 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5489e-05 s, 0.0 kB/s 2023-10-16T13:45:58.166 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.166 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8204e-05 s, 0.0 kB/s 2023-10-16T13:45:58.281 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.282 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.339 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.2376e-05 s, 0.0 kB/s 2023-10-16T13:45:58.398 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.399 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.455 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:45:58.514 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2991e-05 s, 0.0 kB/s 2023-10-16T13:45:58.515 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.516 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:45:58.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.574 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0612e-05 s, 0.0 kB/s 2023-10-16T13:45:58.666 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.666 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.723 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2623e-05 s, 0.0 kB/s 2023-10-16T13:45:58.783 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.783 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0636e-05 s, 0.0 kB/s 2023-10-16T13:45:58.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:58.901 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:58.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:58.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2802e-05 s, 0.0 kB/s 2023-10-16T13:45:59.016 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0368e-05 s, 0.0 kB/s 2023-10-16T13:45:59.135 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.135 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.192 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1663e-05 s, 0.0 kB/s 2023-10-16T13:45:59.252 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.252 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.309 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4339e-05 s, 0.0 kB/s 2023-10-16T13:45:59.369 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.369 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.426 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.485 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0934e-05 s, 0.0 kB/s 2023-10-16T13:45:59.485 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.486 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.544 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.0844e-05 s, 0.0 kB/s 2023-10-16T13:45:59.603 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.603 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.661 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3338e-05 s, 0.0 kB/s 2023-10-16T13:45:59.720 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9144e-05 s, 0.0 kB/s 2023-10-16T13:45:59.838 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:45:59.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:45:59.895 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:45:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:45:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:45:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.44e-05 s, 0.0 kB/s 2023-10-16T13:45:59.954 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:45:59.955 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.012 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9376e-05 s, 0.0 kB/s 2023-10-16T13:46:00.071 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.072 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.128 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0801e-05 s, 0.0 kB/s 2023-10-16T13:46:00.188 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.188 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.247 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.305 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3547e-05 s, 0.0 kB/s 2023-10-16T13:46:00.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.306 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.423 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3048e-05 s, 0.0 kB/s 2023-10-16T13:46:00.423 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.423 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.480 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7295e-05 s, 0.0 kB/s 2023-10-16T13:46:00.539 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.540 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.597 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.863e-05 s, 0.0 kB/s 2023-10-16T13:46:00.656 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.657 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.714 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.7903e-05 s, 0.0 kB/s 2023-10-16T13:46:00.774 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.774 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.831 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2578e-05 s, 0.0 kB/s 2023-10-16T13:46:00.890 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:00.890 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:00.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:00.948 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4339e-05 s, 0.0 kB/s 2023-10-16T13:46:01.006 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.007 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.063 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.122 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.122 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.123 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8372e-05 s, 0.0 kB/s 2023-10-16T13:46:01.123 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.123 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.181 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.239 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.240 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-16T13:46:01.240 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.241 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.297 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1977e-05 s, 0.0 kB/s 2023-10-16T13:46:01.356 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.357 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.414 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3075e-05 s, 0.0 kB/s 2023-10-16T13:46:01.474 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.474 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.531 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.590 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3889e-05 s, 0.0 kB/s 2023-10-16T13:46:01.590 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.591 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.649 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2965e-05 s, 0.0 kB/s 2023-10-16T13:46:01.708 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.709 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.766 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.033e-05 s, 0.0 kB/s 2023-10-16T13:46:01.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.826 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:01.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:01.883 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:01.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:01.942 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:01.942 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1053e-05 s, 0.0 kB/s 2023-10-16T13:46:01.943 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:01.943 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.000 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2805e-05 s, 0.0 kB/s 2023-10-16T13:46:02.060 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.060 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.117 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3625e-05 s, 0.0 kB/s 2023-10-16T13:46:02.175 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.176 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.233 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.292 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.292 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.292 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.216e-05 s, 0.0 kB/s 2023-10-16T13:46:02.293 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.293 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.353 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.365e-05 s, 0.0 kB/s 2023-10-16T13:46:02.410 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.410 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.467 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.0355e-05 s, 0.0 kB/s 2023-10-16T13:46:02.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.638 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.658 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.716 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.899e-05 s, 0.0 kB/s 2023-10-16T13:46:02.717 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.775 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1099e-05 s, 0.0 kB/s 2023-10-16T13:46:02.834 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.834 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:02.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:02.891 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:02.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:02.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:02.951 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6038e-05 s, 0.0 kB/s 2023-10-16T13:46:02.951 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:02.952 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.008 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.066 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.066 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1327e-05 s, 0.0 kB/s 2023-10-16T13:46:03.066 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.066 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.123 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.182 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.182 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4608e-05 s, 0.0 kB/s 2023-10-16T13:46:03.182 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.183 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.241 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.299 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.299 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2889e-05 s, 0.0 kB/s 2023-10-16T13:46:03.300 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.300 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.357 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2453e-05 s, 0.0 kB/s 2023-10-16T13:46:03.415 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.416 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.473 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4629e-05 s, 0.0 kB/s 2023-10-16T13:46:03.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.532 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.588 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1148e-05 s, 0.0 kB/s 2023-10-16T13:46:03.647 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100732 s, 0.0 kB/s 2023-10-16T13:46:03.764 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.764 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.823 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.881 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1618e-05 s, 0.0 kB/s 2023-10-16T13:46:03.881 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:03.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:03.940 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:03.997 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2368e-05 s, 0.0 kB/s 2023-10-16T13:46:03.998 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:03.998 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.055 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1205e-05 s, 0.0 kB/s 2023-10-16T13:46:04.113 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.114 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.170 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9818e-05 s, 0.0 kB/s 2023-10-16T13:46:04.228 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.229 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1546e-05 s, 0.0 kB/s 2023-10-16T13:46:04.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.345 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2605e-05 s, 0.0 kB/s 2023-10-16T13:46:04.461 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.518 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3613e-05 s, 0.0 kB/s 2023-10-16T13:46:04.577 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.578 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8778e-05 s, 0.0 kB/s 2023-10-16T13:46:04.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.694 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.751 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.811 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1757e-05 s, 0.0 kB/s 2023-10-16T13:46:04.811 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.811 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.868 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7439e-05 s, 0.0 kB/s 2023-10-16T13:46:04.927 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:04.928 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:04.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:04.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0691e-05 s, 0.0 kB/s 2023-10-16T13:46:05.044 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.044 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.159 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4045e-05 s, 0.0 kB/s 2023-10-16T13:46:05.160 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.161 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3622e-05 s, 0.0 kB/s 2023-10-16T13:46:05.276 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.276 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.333 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7355e-05 s, 0.0 kB/s 2023-10-16T13:46:05.393 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.393 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.508 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.201e-05 s, 0.0 kB/s 2023-10-16T13:46:05.509 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.510 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.567 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.019e-05 s, 0.0 kB/s 2023-10-16T13:46:05.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6394e-05 s, 0.0 kB/s 2023-10-16T13:46:05.741 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.742 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2261e-05 s, 0.0 kB/s 2023-10-16T13:46:05.858 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.858 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:05.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:05.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.7783e-05 s, 0.0 kB/s 2023-10-16T13:46:05.974 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:05.974 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.031 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4738e-05 s, 0.0 kB/s 2023-10-16T13:46:06.091 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.148 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3754e-05 s, 0.0 kB/s 2023-10-16T13:46:06.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.208 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0165e-05 s, 0.0 kB/s 2023-10-16T13:46:06.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.323 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5285e-05 s, 0.0 kB/s 2023-10-16T13:46:06.440 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.440 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.497 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0879e-05 s, 0.0 kB/s 2023-10-16T13:46:06.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4717e-05 s, 0.0 kB/s 2023-10-16T13:46:06.672 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.729 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5417e-05 s, 0.0 kB/s 2023-10-16T13:46:06.788 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.789 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4588e-05 s, 0.0 kB/s 2023-10-16T13:46:06.905 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:06.905 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:06.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:06.963 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.022 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4845e-05 s, 0.0 kB/s 2023-10-16T13:46:07.023 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.023 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2314e-05 s, 0.0 kB/s 2023-10-16T13:46:07.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.139 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.196 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0348e-05 s, 0.0 kB/s 2023-10-16T13:46:07.254 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.369 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9465e-05 s, 0.0 kB/s 2023-10-16T13:46:07.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.370 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.487 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.487 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.487 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1761e-05 s, 0.0 kB/s 2023-10-16T13:46:07.487 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.488 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.545 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.542e-05 s, 0.0 kB/s 2023-10-16T13:46:07.603 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.604 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.660 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3122e-05 s, 0.0 kB/s 2023-10-16T13:46:07.719 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3432e-05 s, 0.0 kB/s 2023-10-16T13:46:07.838 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:07.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:07.896 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-16T13:46:07.954 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:07.955 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.012 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0685e-05 s, 0.0 kB/s 2023-10-16T13:46:08.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7202e-05 s, 0.0 kB/s 2023-10-16T13:46:08.186 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.187 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1566e-05 s, 0.0 kB/s 2023-10-16T13:46:08.303 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.303 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.360 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2897e-05 s, 0.0 kB/s 2023-10-16T13:46:08.419 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.419 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.477 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.536 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.536 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1407e-05 s, 0.0 kB/s 2023-10-16T13:46:08.536 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.537 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1478e-05 s, 0.0 kB/s 2023-10-16T13:46:08.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.711 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.0322e-05 s, 0.0 kB/s 2023-10-16T13:46:08.770 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.771 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.827 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1588e-05 s, 0.0 kB/s 2023-10-16T13:46:08.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:08.887 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:08.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:08.944 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.303e-05 s, 0.0 kB/s 2023-10-16T13:46:09.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9415e-05 s, 0.0 kB/s 2023-10-16T13:46:09.120 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.120 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.177 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-16T13:46:09.236 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.237 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.295 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.352 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.353 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.353 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0921e-05 s, 0.0 kB/s 2023-10-16T13:46:09.353 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.354 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.410 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.467 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1508e-05 s, 0.0 kB/s 2023-10-16T13:46:09.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.469 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.525 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2808e-05 s, 0.0 kB/s 2023-10-16T13:46:09.585 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.586 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.644 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1896e-05 s, 0.0 kB/s 2023-10-16T13:46:09.703 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.703 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.760 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8905e-05 s, 0.0 kB/s 2023-10-16T13:46:09.819 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.819 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.877 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2634e-05 s, 0.0 kB/s 2023-10-16T13:46:09.937 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:09.937 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:09.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:09.995 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.053 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.053 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2352e-05 s, 0.0 kB/s 2023-10-16T13:46:10.053 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.054 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.110 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7351e-05 s, 0.0 kB/s 2023-10-16T13:46:10.168 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.169 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.225 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6189e-05 s, 0.0 kB/s 2023-10-16T13:46:10.283 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.284 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.399 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4146e-05 s, 0.0 kB/s 2023-10-16T13:46:10.400 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.400 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.458 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9898e-05 s, 0.0 kB/s 2023-10-16T13:46:10.517 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.517 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.575 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1878e-05 s, 0.0 kB/s 2023-10-16T13:46:10.634 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.634 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.690 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6091e-05 s, 0.0 kB/s 2023-10-16T13:46:10.751 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.751 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.808 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1766e-05 s, 0.0 kB/s 2023-10-16T13:46:10.868 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.868 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:10.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:10.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:10.984 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2048e-05 s, 0.0 kB/s 2023-10-16T13:46:10.984 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:10.985 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.041 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101208 s, 0.0 kB/s 2023-10-16T13:46:11.100 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.157 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5672e-05 s, 0.0 kB/s 2023-10-16T13:46:11.215 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.216 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.272 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.9157e-05 s, 0.0 kB/s 2023-10-16T13:46:11.331 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.331 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.387 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1468e-05 s, 0.0 kB/s 2023-10-16T13:46:11.446 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.446 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.503 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8725e-05 s, 0.0 kB/s 2023-10-16T13:46:11.562 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.562 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.620 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5567e-05 s, 0.0 kB/s 2023-10-16T13:46:11.680 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.680 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.737 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4414e-05 s, 0.0 kB/s 2023-10-16T13:46:11.797 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.797 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.854 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:11.912 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1454e-05 s, 0.0 kB/s 2023-10-16T13:46:11.912 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:11.913 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:11.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:11.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.027 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.027 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.264e-05 s, 0.0 kB/s 2023-10-16T13:46:12.028 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.028 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.085 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.223e-05 s, 0.0 kB/s 2023-10-16T13:46:12.143 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.144 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.200 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8911e-05 s, 0.0 kB/s 2023-10-16T13:46:12.260 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.318 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0644e-05 s, 0.0 kB/s 2023-10-16T13:46:12.376 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.376 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.433 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6291e-05 s, 0.0 kB/s 2023-10-16T13:46:12.492 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.493 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.549 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.608 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.608 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4585e-05 s, 0.0 kB/s 2023-10-16T13:46:12.609 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.609 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.667 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.726 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2726e-05 s, 0.0 kB/s 2023-10-16T13:46:12.727 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.727 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0735e-05 s, 0.0 kB/s 2023-10-16T13:46:12.843 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:12.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:12.900 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.378e-05 s, 0.0 kB/s 2023-10-16T13:46:12.959 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:12.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.017 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4414e-05 s, 0.0 kB/s 2023-10-16T13:46:13.076 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.076 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.133 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3069e-05 s, 0.0 kB/s 2023-10-16T13:46:13.191 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.192 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8737e-05 s, 0.0 kB/s 2023-10-16T13:46:13.309 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.309 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.368 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5235e-05 s, 0.0 kB/s 2023-10-16T13:46:13.427 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.427 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.485 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.544 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3219e-05 s, 0.0 kB/s 2023-10-16T13:46:13.544 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.544 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.603 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3083e-05 s, 0.0 kB/s 2023-10-16T13:46:13.661 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.662 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.718 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5281e-05 s, 0.0 kB/s 2023-10-16T13:46:13.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.779 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:13.893 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0318e-05 s, 0.0 kB/s 2023-10-16T13:46:13.895 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:13.896 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:13.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:13.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5998e-05 s, 0.0 kB/s 2023-10-16T13:46:14.013 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.013 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.070 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2692e-05 s, 0.0 kB/s 2023-10-16T13:46:14.129 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.130 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.186 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2895e-05 s, 0.0 kB/s 2023-10-16T13:46:14.245 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.245 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5058e-05 s, 0.0 kB/s 2023-10-16T13:46:14.361 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.362 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.477 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3894e-05 s, 0.0 kB/s 2023-10-16T13:46:14.478 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.478 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.536 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.594 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.595 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4518e-05 s, 0.0 kB/s 2023-10-16T13:46:14.595 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.595 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.653 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4382e-05 s, 0.0 kB/s 2023-10-16T13:46:14.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3294e-05 s, 0.0 kB/s 2023-10-16T13:46:14.831 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.831 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:14.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:14.888 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7606e-05 s, 0.0 kB/s 2023-10-16T13:46:14.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:14.949 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.007 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102941 s, 0.0 kB/s 2023-10-16T13:46:15.067 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.067 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.124 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4676e-05 s, 0.0 kB/s 2023-10-16T13:46:15.182 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.183 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.240 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1079e-05 s, 0.0 kB/s 2023-10-16T13:46:15.298 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.299 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2919e-05 s, 0.0 kB/s 2023-10-16T13:46:15.415 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.472 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7109e-05 s, 0.0 kB/s 2023-10-16T13:46:15.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.531 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.588 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2409e-05 s, 0.0 kB/s 2023-10-16T13:46:15.646 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.646 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.703 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.762 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1081e-05 s, 0.0 kB/s 2023-10-16T13:46:15.762 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.762 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4586e-05 s, 0.0 kB/s 2023-10-16T13:46:15.880 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:15.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:15.937 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2968e-05 s, 0.0 kB/s 2023-10-16T13:46:15.996 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:15.997 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.054 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.9177e-05 s, 0.0 kB/s 2023-10-16T13:46:16.114 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.114 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.170 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3915e-05 s, 0.0 kB/s 2023-10-16T13:46:16.229 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.230 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.286 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.344 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.344 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4965e-05 s, 0.0 kB/s 2023-10-16T13:46:16.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.345 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2589e-05 s, 0.0 kB/s 2023-10-16T13:46:16.461 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.462 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.518 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.576 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.577 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.577 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0104e-05 s, 0.0 kB/s 2023-10-16T13:46:16.577 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.578 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.693 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.693 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7082e-05 s, 0.0 kB/s 2023-10-16T13:46:16.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.694 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.753 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.812 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5385e-05 s, 0.0 kB/s 2023-10-16T13:46:16.813 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.813 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.870 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5675e-05 s, 0.0 kB/s 2023-10-16T13:46:16.930 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:16.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:16.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:16.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8109e-05 s, 0.0 kB/s 2023-10-16T13:46:17.047 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.047 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-16T13:46:17.163 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.220 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.277 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.278 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.278 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2446e-05 s, 0.0 kB/s 2023-10-16T13:46:17.278 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.279 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.335 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8718e-05 s, 0.0 kB/s 2023-10-16T13:46:17.393 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.394 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4524e-05 s, 0.0 kB/s 2023-10-16T13:46:17.509 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.510 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.567 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3263e-05 s, 0.0 kB/s 2023-10-16T13:46:17.625 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.741 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2549e-05 s, 0.0 kB/s 2023-10-16T13:46:17.742 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.799 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.858 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3428e-05 s, 0.0 kB/s 2023-10-16T13:46:17.859 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.859 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:17.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:17.916 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1574e-05 s, 0.0 kB/s 2023-10-16T13:46:17.975 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:17.975 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.032 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.403e-05 s, 0.0 kB/s 2023-10-16T13:46:18.090 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4319e-05 s, 0.0 kB/s 2023-10-16T13:46:18.206 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.263 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2614e-05 s, 0.0 kB/s 2023-10-16T13:46:18.321 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.322 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.378 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2868e-05 s, 0.0 kB/s 2023-10-16T13:46:18.436 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.437 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.494 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2307e-05 s, 0.0 kB/s 2023-10-16T13:46:18.553 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.553 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.610 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2085e-05 s, 0.0 kB/s 2023-10-16T13:46:18.669 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.670 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.726 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.783 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.784 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.784 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4379e-05 s, 0.0 kB/s 2023-10-16T13:46:18.784 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.785 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:18.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:18.900 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:18.900 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6145e-05 s, 0.0 kB/s 2023-10-16T13:46:18.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:18.901 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:18.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:18.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9288e-05 s, 0.0 kB/s 2023-10-16T13:46:19.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.075 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0151e-05 s, 0.0 kB/s 2023-10-16T13:46:19.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.133 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.190 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100198 s, 0.0 kB/s 2023-10-16T13:46:19.250 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.250 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.308 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4605e-05 s, 0.0 kB/s 2023-10-16T13:46:19.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.481 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.482 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.482 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1236e-05 s, 0.0 kB/s 2023-10-16T13:46:19.482 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.483 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.539 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.597 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.597 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-16T13:46:19.598 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.598 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.656 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.714 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1342e-05 s, 0.0 kB/s 2023-10-16T13:46:19.714 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.715 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.772 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3502e-05 s, 0.0 kB/s 2023-10-16T13:46:19.831 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.831 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:19.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:19.888 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-16T13:46:19.946 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:19.947 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.004 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.063 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1354e-05 s, 0.0 kB/s 2023-10-16T13:46:20.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.178 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1219e-05 s, 0.0 kB/s 2023-10-16T13:46:20.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.178 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.235 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.0774e-05 s, 0.0 kB/s 2023-10-16T13:46:20.294 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.352 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.410 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.410 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.1191e-05 s, 0.0 kB/s 2023-10-16T13:46:20.410 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.410 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.467 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.526 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.526 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7892e-05 s, 0.0 kB/s 2023-10-16T13:46:20.526 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.527 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.583 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.336e-05 s, 0.0 kB/s 2023-10-16T13:46:20.642 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.699 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.757 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.758 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.758 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2627e-05 s, 0.0 kB/s 2023-10-16T13:46:20.758 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.759 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.816 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6562e-05 s, 0.0 kB/s 2023-10-16T13:46:20.875 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.875 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:20.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:20.932 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2126e-05 s, 0.0 kB/s 2023-10-16T13:46:20.990 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:20.991 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2129e-05 s, 0.0 kB/s 2023-10-16T13:46:21.106 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.106 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.163 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.220 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.221 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.221 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0591e-05 s, 0.0 kB/s 2023-10-16T13:46:21.221 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.221 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.278 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.336 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4157e-05 s, 0.0 kB/s 2023-10-16T13:46:21.336 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.337 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.393 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3667e-05 s, 0.0 kB/s 2023-10-16T13:46:21.451 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.452 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.508 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.9108e-05 s, 0.0 kB/s 2023-10-16T13:46:21.566 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.567 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.624 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.682 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.682 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1122e-05 s, 0.0 kB/s 2023-10-16T13:46:21.683 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.684 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.801 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3626e-05 s, 0.0 kB/s 2023-10-16T13:46:21.801 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.802 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.859 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2043e-05 s, 0.0 kB/s 2023-10-16T13:46:21.918 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:21.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:21.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:21.976 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3528e-05 s, 0.0 kB/s 2023-10-16T13:46:22.036 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.036 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.093 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2929e-05 s, 0.0 kB/s 2023-10-16T13:46:22.152 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.153 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.210 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4021e-05 s, 0.0 kB/s 2023-10-16T13:46:22.268 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.269 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.325 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.383 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.172e-05 s, 0.0 kB/s 2023-10-16T13:46:22.383 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.383 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.440 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8705e-05 s, 0.0 kB/s 2023-10-16T13:46:22.499 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.500 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.556 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.615 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3688e-05 s, 0.0 kB/s 2023-10-16T13:46:22.615 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.616 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.672 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.731 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.731 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5472e-05 s, 0.0 kB/s 2023-10-16T13:46:22.732 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.732 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.789 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.847 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.847 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.086e-05 s, 0.0 kB/s 2023-10-16T13:46:22.848 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.848 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:22.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:22.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3229e-05 s, 0.0 kB/s 2023-10-16T13:46:22.965 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:22.965 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.3301e-05 s, 0.0 kB/s 2023-10-16T13:46:23.082 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.082 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.139 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.196 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.197 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.197 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0824e-05 s, 0.0 kB/s 2023-10-16T13:46:23.197 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.198 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.254 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.312 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.312 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3735e-05 s, 0.0 kB/s 2023-10-16T13:46:23.313 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.313 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1388e-05 s, 0.0 kB/s 2023-10-16T13:46:23.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.432 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0782e-05 s, 0.0 kB/s 2023-10-16T13:46:23.547 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.547 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.1348e-05 s, 0.0 kB/s 2023-10-16T13:46:23.663 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.664 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.779 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.779 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.779 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7532e-05 s, 0.0 kB/s 2023-10-16T13:46:23.779 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.780 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.838 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1567e-05 s, 0.0 kB/s 2023-10-16T13:46:23.897 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:23.898 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:23.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:23.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.013 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1701e-05 s, 0.0 kB/s 2023-10-16T13:46:24.014 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.015 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.072 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4215e-05 s, 0.0 kB/s 2023-10-16T13:46:24.131 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.132 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.188 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.246 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.246 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.246 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.169e-05 s, 0.0 kB/s 2023-10-16T13:46:24.247 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000101518 s, 0.0 kB/s 2023-10-16T13:46:24.363 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.420 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.479 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5698e-05 s, 0.0 kB/s 2023-10-16T13:46:24.480 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.480 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.537 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.595 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.595 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102075 s, 0.0 kB/s 2023-10-16T13:46:24.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.597 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.655 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.712 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.713 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.713 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4006e-05 s, 0.0 kB/s 2023-10-16T13:46:24.713 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.714 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.770 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3908e-05 s, 0.0 kB/s 2023-10-16T13:46:24.830 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.830 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:24.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:24.887 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0832e-05 s, 0.0 kB/s 2023-10-16T13:46:24.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:24.948 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.005 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1255e-05 s, 0.0 kB/s 2023-10-16T13:46:25.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.177 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.178 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.178 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6803e-05 s, 0.0 kB/s 2023-10-16T13:46:25.178 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.179 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.235 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.161e-05 s, 0.0 kB/s 2023-10-16T13:46:25.294 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.351 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.408 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5208e-05 s, 0.0 kB/s 2023-10-16T13:46:25.409 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.409 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.466 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2344e-05 s, 0.0 kB/s 2023-10-16T13:46:25.525 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.525 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.582 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8671e-05 s, 0.0 kB/s 2023-10-16T13:46:25.640 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.641 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2129e-05 s, 0.0 kB/s 2023-10-16T13:46:25.756 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.757 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.813 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.872 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.872 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4294e-05 s, 0.0 kB/s 2023-10-16T13:46:25.872 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.872 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:25.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:25.929 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3938e-05 s, 0.0 kB/s 2023-10-16T13:46:25.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:25.987 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.044 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1074e-05 s, 0.0 kB/s 2023-10-16T13:46:26.103 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.104 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.160 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-16T13:46:26.219 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.220 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.335 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.336 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2082e-05 s, 0.0 kB/s 2023-10-16T13:46:26.336 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.336 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.393 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.452 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.452 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.452 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.483e-05 s, 0.0 kB/s 2023-10-16T13:46:26.452 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.453 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.511 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.570 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.6522e-05 s, 0.0 kB/s 2023-10-16T13:46:26.571 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.571 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.629 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6059e-05 s, 0.0 kB/s 2023-10-16T13:46:26.688 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.689 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.746 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.804 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.804 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.805 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6638e-05 s, 0.0 kB/s 2023-10-16T13:46:26.805 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.805 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.862 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2944e-05 s, 0.0 kB/s 2023-10-16T13:46:26.922 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:26.922 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:26.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:26.979 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9995e-05 s, 0.0 kB/s 2023-10-16T13:46:27.039 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.039 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.099 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3376e-05 s, 0.0 kB/s 2023-10-16T13:46:27.158 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.159 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.273 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.273 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.273 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.6916e-05 s, 0.0 kB/s 2023-10-16T13:46:27.273 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.274 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.330 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.388 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6037e-05 s, 0.0 kB/s 2023-10-16T13:46:27.389 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.389 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.446 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9949e-05 s, 0.0 kB/s 2023-10-16T13:46:27.506 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.507 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.6342e-05 s, 0.0 kB/s 2023-10-16T13:46:27.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4353e-05 s, 0.0 kB/s 2023-10-16T13:46:27.739 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.740 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9121e-05 s, 0.0 kB/s 2023-10-16T13:46:27.857 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.857 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:27.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:27.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4615e-05 s, 0.0 kB/s 2023-10-16T13:46:27.973 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:27.974 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.031 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6728e-05 s, 0.0 kB/s 2023-10-16T13:46:28.091 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.091 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.209 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.209 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5455e-05 s, 0.0 kB/s 2023-10-16T13:46:28.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.268 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.325 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.326 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2483e-05 s, 0.0 kB/s 2023-10-16T13:46:28.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.326 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.7418e-05 s, 0.0 kB/s 2023-10-16T13:46:28.445 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.445 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.503 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.562 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.562 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.038e-05 s, 0.0 kB/s 2023-10-16T13:46:28.562 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.563 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:46:28.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:46:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.8206e-05 s, 0.0 kB/s 2023-10-16T13:46:28.680 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.680 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.773 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6865e-05 s, 0.0 kB/s 2023-10-16T13:46:28.834 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.834 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:28.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:28.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1855e-05 s, 0.0 kB/s 2023-10-16T13:46:28.951 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:28.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.009 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.0162e-05 s, 0.0 kB/s 2023-10-16T13:46:29.069 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.069 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6092e-05 s, 0.0 kB/s 2023-10-16T13:46:29.186 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.187 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1261e-05 s, 0.0 kB/s 2023-10-16T13:46:29.302 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.303 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.359 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.447e-05 s, 0.0 kB/s 2023-10-16T13:46:29.419 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.419 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.476 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2767e-05 s, 0.0 kB/s 2023-10-16T13:46:29.535 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.535 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.593 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3135e-05 s, 0.0 kB/s 2023-10-16T13:46:29.651 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.652 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.6584e-05 s, 0.0 kB/s 2023-10-16T13:46:29.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.768 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0204e-05 s, 0.0 kB/s 2023-10-16T13:46:29.884 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:29.884 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:29.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:29.943 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2449e-05 s, 0.0 kB/s 2023-10-16T13:46:30.001 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.002 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.082e-05 s, 0.0 kB/s 2023-10-16T13:46:30.118 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.118 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.175 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.234 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4946e-05 s, 0.0 kB/s 2023-10-16T13:46:30.234 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.234 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.292 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.350 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4704e-05 s, 0.0 kB/s 2023-10-16T13:46:30.351 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.351 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.409 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5381e-05 s, 0.0 kB/s 2023-10-16T13:46:30.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.469 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.526 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3085e-05 s, 0.0 kB/s 2023-10-16T13:46:30.585 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.586 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.642 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1002e-05 s, 0.0 kB/s 2023-10-16T13:46:30.702 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.703 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.760 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.818 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.818 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.818 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4344e-05 s, 0.0 kB/s 2023-10-16T13:46:30.818 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.819 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.875 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0708e-05 s, 0.0 kB/s 2023-10-16T13:46:30.935 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:30.935 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:30.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:30.992 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.049 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.050 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2609e-05 s, 0.0 kB/s 2023-10-16T13:46:31.050 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.050 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5258e-05 s, 0.0 kB/s 2023-10-16T13:46:31.165 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.166 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3516e-05 s, 0.0 kB/s 2023-10-16T13:46:31.281 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.396 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.9121e-05 s, 0.0 kB/s 2023-10-16T13:46:31.396 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.397 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.453 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4729e-05 s, 0.0 kB/s 2023-10-16T13:46:31.511 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.512 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.568 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.625 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.625 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.199e-05 s, 0.0 kB/s 2023-10-16T13:46:31.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.684 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.742 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.742 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1584e-05 s, 0.0 kB/s 2023-10-16T13:46:31.743 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.743 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.801 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.4638e-05 s, 0.0 kB/s 2023-10-16T13:46:31.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:31.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:31.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5094e-05 s, 0.0 kB/s 2023-10-16T13:46:31.975 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:31.976 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2319e-05 s, 0.0 kB/s 2023-10-16T13:46:32.092 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.093 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.149 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3738e-05 s, 0.0 kB/s 2023-10-16T13:46:32.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.208 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.264 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.322 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3094e-05 s, 0.0 kB/s 2023-10-16T13:46:32.322 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.322 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.379 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3267e-05 s, 0.0 kB/s 2023-10-16T13:46:32.438 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.438 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.495 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2895e-05 s, 0.0 kB/s 2023-10-16T13:46:32.553 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.554 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8845e-05 s, 0.0 kB/s 2023-10-16T13:46:32.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.729 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1811e-05 s, 0.0 kB/s 2023-10-16T13:46:32.787 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.788 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.844 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.5545e-05 s, 0.0 kB/s 2023-10-16T13:46:32.902 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:32.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:32.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:32.960 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.018 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0479e-05 s, 0.0 kB/s 2023-10-16T13:46:33.019 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.019 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.076 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.133 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.134 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.134 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5074e-05 s, 0.0 kB/s 2023-10-16T13:46:33.134 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.135 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.301 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.155e-05 s, 0.0 kB/s 2023-10-16T13:46:33.302 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.302 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.378 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4046e-05 s, 0.0 kB/s 2023-10-16T13:46:33.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.379 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.436 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4248e-05 s, 0.0 kB/s 2023-10-16T13:46:33.495 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.495 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.6801e-05 s, 0.0 kB/s 2023-10-16T13:46:33.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.612 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.669 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.728 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-16T13:46:33.729 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.729 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.786 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.845 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5145e-05 s, 0.0 kB/s 2023-10-16T13:46:33.845 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.845 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:33.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:33.902 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2415e-05 s, 0.0 kB/s 2023-10-16T13:46:33.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:33.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.018 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.077 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.077 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.077 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8622e-05 s, 0.0 kB/s 2023-10-16T13:46:34.077 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.078 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.134 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2069e-05 s, 0.0 kB/s 2023-10-16T13:46:34.192 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.193 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.308 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3314e-05 s, 0.0 kB/s 2023-10-16T13:46:34.309 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.309 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.367 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.143e-05 s, 0.0 kB/s 2023-10-16T13:46:34.425 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.426 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.482 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.540 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0731e-05 s, 0.0 kB/s 2023-10-16T13:46:34.540 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.540 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.597 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.654 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3575e-05 s, 0.0 kB/s 2023-10-16T13:46:34.655 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.656 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.771 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.9813e-05 s, 0.0 kB/s 2023-10-16T13:46:34.772 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.772 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.831 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.8317e-05 s, 0.0 kB/s 2023-10-16T13:46:34.890 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:34.890 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:34.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:34.948 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-16T13:46:35.007 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.008 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.065 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.233e-05 s, 0.0 kB/s 2023-10-16T13:46:35.124 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.124 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.182 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2892e-05 s, 0.0 kB/s 2023-10-16T13:46:35.241 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.242 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.299 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3055e-05 s, 0.0 kB/s 2023-10-16T13:46:35.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.415 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3207e-05 s, 0.0 kB/s 2023-10-16T13:46:35.473 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.473 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.530 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9522e-05 s, 0.0 kB/s 2023-10-16T13:46:35.589 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.590 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.646 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.704 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.704 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.705 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8475e-05 s, 0.0 kB/s 2023-10-16T13:46:35.705 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.706 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.763 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4499e-05 s, 0.0 kB/s 2023-10-16T13:46:35.823 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.824 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.880 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3143e-05 s, 0.0 kB/s 2023-10-16T13:46:35.940 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:35.940 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:35.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:35.997 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2308e-05 s, 0.0 kB/s 2023-10-16T13:46:36.055 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.056 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.113 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5502e-05 s, 0.0 kB/s 2023-10-16T13:46:36.171 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.229 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.286 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3399e-05 s, 0.0 kB/s 2023-10-16T13:46:36.287 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.288 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.344 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.401 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.0848e-05 s, 0.0 kB/s 2023-10-16T13:46:36.402 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.402 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.459 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1512e-05 s, 0.0 kB/s 2023-10-16T13:46:36.517 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.517 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.574 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4138e-05 s, 0.0 kB/s 2023-10-16T13:46:36.632 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.633 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.689 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.748 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.748 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.748 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4648e-05 s, 0.0 kB/s 2023-10-16T13:46:36.749 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.749 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.806 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000102568 s, 0.0 kB/s 2023-10-16T13:46:36.867 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.867 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:36.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:36.924 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1603e-05 s, 0.0 kB/s 2023-10-16T13:46:36.982 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:36.983 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.039 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2371e-05 s, 0.0 kB/s 2023-10-16T13:46:37.097 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.098 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5048e-05 s, 0.0 kB/s 2023-10-16T13:46:37.213 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.213 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.269 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.327 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.327 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3188e-05 s, 0.0 kB/s 2023-10-16T13:46:37.327 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.328 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-16T13:46:37.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.443 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.3245e-05 s, 0.0 kB/s 2023-10-16T13:46:37.558 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.558 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.616 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4625e-05 s, 0.0 kB/s 2023-10-16T13:46:37.674 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.674 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.731 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.789 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.789 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4642e-05 s, 0.0 kB/s 2023-10-16T13:46:37.789 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.847 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.9604e-05 s, 0.0 kB/s 2023-10-16T13:46:37.906 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:37.907 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:37.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:37.963 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.021 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1238e-05 s, 0.0 kB/s 2023-10-16T13:46:38.022 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.079 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.137 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2715e-05 s, 0.0 kB/s 2023-10-16T13:46:38.137 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.138 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.196 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2058e-05 s, 0.0 kB/s 2023-10-16T13:46:38.254 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.312 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8575e-05 s, 0.0 kB/s 2023-10-16T13:46:38.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.371 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.875e-05 s, 0.0 kB/s 2023-10-16T13:46:38.485 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.486 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.544 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9252e-05 s, 0.0 kB/s 2023-10-16T13:46:38.603 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.604 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.660 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000117914 s, 0.0 kB/s 2023-10-16T13:46:38.720 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.720 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.779 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3498e-05 s, 0.0 kB/s 2023-10-16T13:46:38.838 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.839 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:38.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:38.895 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2072e-05 s, 0.0 kB/s 2023-10-16T13:46:38.955 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:38.956 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.014 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.2351e-05 s, 0.0 kB/s 2023-10-16T13:46:39.072 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.073 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.129 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.4128e-05 s, 0.0 kB/s 2023-10-16T13:46:39.189 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.189 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.247 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-16T13:46:39.306 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.306 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.363 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0741e-05 s, 0.0 kB/s 2023-10-16T13:46:39.422 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.422 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.479 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.537 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.538 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3464e-05 s, 0.0 kB/s 2023-10-16T13:46:39.538 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.538 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.597 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.7226e-05 s, 0.0 kB/s 2023-10-16T13:46:39.655 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.656 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.771 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.771 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.771 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4329e-05 s, 0.0 kB/s 2023-10-16T13:46:39.772 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.772 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.829 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5798e-05 s, 0.0 kB/s 2023-10-16T13:46:39.889 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:39.889 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:39.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:39.947 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.005 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.006 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1385e-05 s, 0.0 kB/s 2023-10-16T13:46:40.007 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.007 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.063 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.5731e-05 s, 0.0 kB/s 2023-10-16T13:46:40.123 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.123 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.179 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1745e-05 s, 0.0 kB/s 2023-10-16T13:46:40.238 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.238 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.295 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.352 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 4.0181e-05 s, 0.0 kB/s 2023-10-16T13:46:40.353 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.354 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.410 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5882e-05 s, 0.0 kB/s 2023-10-16T13:46:40.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.469 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.525 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.9222e-05 s, 0.0 kB/s 2023-10-16T13:46:40.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.583 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.7479e-05 s, 0.0 kB/s 2023-10-16T13:46:40.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.755 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.813 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.814 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.814 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4406e-05 s, 0.0 kB/s 2023-10-16T13:46:40.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.815 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.9511e-05 s, 0.0 kB/s 2023-10-16T13:46:40.931 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:40.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:40.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:40.989 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2012e-05 s, 0.0 kB/s 2023-10-16T13:46:41.047 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.048 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.105 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.163 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.4821e-05 s, 0.0 kB/s 2023-10-16T13:46:41.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.165 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.222 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 2.985e-05 s, 0.0 kB/s 2023-10-16T13:46:41.281 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0344e-05 s, 0.0 kB/s 2023-10-16T13:46:41.397 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.397 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.5164e-05 s, 0.0 kB/s 2023-10-16T13:46:41.512 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.513 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.569 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-16T13:46:41.628 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.628 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.685 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.744 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.8571e-05 s, 0.0 kB/s 2023-10-16T13:46:41.744 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.744 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.801 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.859 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.860 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3969e-05 s, 0.0 kB/s 2023-10-16T13:46:41.860 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.860 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:41.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:41.917 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-16T13:46:41.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:41.977 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.034 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1238e-05 s, 0.0 kB/s 2023-10-16T13:46:42.093 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1055e-05 s, 0.0 kB/s 2023-10-16T13:46:42.208 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.208 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.265 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-16T13:46:42.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.324 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3984e-05 s, 0.0 kB/s 2023-10-16T13:46:42.438 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.438 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.496 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.554 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.555 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.555 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.3767e-05 s, 0.0 kB/s 2023-10-16T13:46:42.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.555 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.2038e-05 s, 0.0 kB/s 2023-10-16T13:46:42.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.728 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.5938e-05 s, 0.0 kB/s 2023-10-16T13:46:42.787 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.788 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.845 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:42.904 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 0.000100862 s, 0.0 kB/s 2023-10-16T13:46:42.904 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:42.905 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:42.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:42.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.2148e-05 s, 0.0 kB/s 2023-10-16T13:46:43.021 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.079 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 6.8455e-05 s, 0.0 kB/s 2023-10-16T13:46:43.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.139 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.196 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3751e-05 s, 0.0 kB/s 2023-10-16T13:46:43.255 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.1445e-05 s, 0.0 kB/s 2023-10-16T13:46:43.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.371 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.427 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.434e-05 s, 0.0 kB/s 2023-10-16T13:46:43.485 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.485 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.542 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1678e-05 s, 0.0 kB/s 2023-10-16T13:46:43.601 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.602 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.659 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.075e-05 s, 0.0 kB/s 2023-10-16T13:46:43.718 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.719 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.775 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.0547e-05 s, 0.0 kB/s 2023-10-16T13:46:43.835 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.835 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:43.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:43.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4522e-05 s, 0.0 kB/s 2023-10-16T13:46:43.950 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:43.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.007 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.1503e-05 s, 0.0 kB/s 2023-10-16T13:46:44.066 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.066 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.123 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3171e-05 s, 0.0 kB/s 2023-10-16T13:46:44.182 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.182 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.239 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.2786e-05 s, 0.0 kB/s 2023-10-16T13:46:44.297 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.298 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 5.9032e-05 s, 0.0 kB/s 2023-10-16T13:46:44.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.414 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.472 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.5208e-05 s, 0.0 kB/s 2023-10-16T13:46:44.532 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.532 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.590 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.3395e-05 s, 0.0 kB/s 2023-10-16T13:46:44.648 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.649 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.706 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 8.4419e-05 s, 0.0 kB/s 2023-10-16T13:46:44.764 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.765 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.823 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 7.7556e-05 s, 0.0 kB/s 2023-10-16T13:46:44.882 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:44.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:44.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:44.940 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.6412e-05 s, 0.0 kB/s 2023-10-16T13:46:45.000 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:45.000 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:45.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:45.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-16T13:46:45.117 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:45.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:45.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:45.173 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:45.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:45.231 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:45.232 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 9.8935e-05 s, 0.0 kB/s 2023-10-16T13:46:45.233 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:45.233 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:45.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:45.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000238131/e94b9392-be3c-4884-9e7b-b00b5a4b91b1/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-16T13:46:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records in 2023-10-16T13:46:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:0+0 records out 2023-10-16T13:46:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:0 bytes copied, 3.1239e-05 s, 0.0 kB/s 2023-10-16T13:46:45.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000238131 2023-10-16T13:46:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.512+0000 7fa23828d700 1 Processor -- start 2023-10-16T13:46:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.512+0000 7fa23828d700 1 -- start start 2023-10-16T13:46:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa23828d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa23015e2f0 0x7fa2300cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa23828d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa23006a840 0x7fa23006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa23828d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300b2d60 con 0x7fa2300cd950 2023-10-16T13:46:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa23828d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2301619a0 con 0x7fa23015e2f0 2023-10-16T13:46:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa23828d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23006b1f0 con 0x7fa23006a840 2023-10-16T13:46:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa235828700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa23015e2f0 0x7fa2300cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa236029700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa2300cd950 0x7fa23015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56090/0 (socket says 172.21.15.5:56090) 2023-10-16T13:46:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.513+0000 7fa236029700 1 -- 172.21.15.5:0/2400389954 learned_addr learned my addr 172.21.15.5:0/2400389954 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235828700 1 -- 172.21.15.5:0/2400389954 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa23006a840 msgr2=0x7fa23006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235828700 1 --2- 172.21.15.5:0/2400389954 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa23006a840 0x7fa23006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235027700 1 -- 172.21.15.5:0/2400389954 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792145942 0 0) 0x7fa2300b2d60 con 0x7fa2300cd950 2023-10-16T13:46:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235828700 1 -- 172.21.15.5:0/2400389954 >> v1:172.21.15.5:6789/0 conn(0x7fa2300cd950 legacy=0x7fa23015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235828700 1 -- 172.21.15.5:0/2400389954 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300cdd30 con 0x7fa23015e2f0 2023-10-16T13:46:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235828700 1 --2- 172.21.15.5:0/2400389954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa2300cede0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa230161ae0 tx=0x7fa224009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f27d493e34d9d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235027700 1 -- 172.21.15.5:0/2400389954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224015070 con 0x7fa23015e2f0 2023-10-16T13:46:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235027700 1 -- 172.21.15.5:0/2400389954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224005c30 con 0x7fa23015e2f0 2023-10-16T13:46:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.514+0000 7fa235027700 1 -- 172.21.15.5:0/2400389954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224004020 con 0x7fa23015e2f0 2023-10-16T13:46:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 -- 172.21.15.5:0/2400389954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 msgr2=0x7fa2300cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 --2- 172.21.15.5:0/2400389954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa2300cede0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa230161ae0 tx=0x7fa224009b00 comp rx=0 tx=0).stop 2023-10-16T13:46:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 -- 172.21.15.5:0/2400389954 shutdown_connections 2023-10-16T13:46:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 --2- 172.21.15.5:0/2400389954 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa23006a840 0x7fa23006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 --2- 172.21.15.5:0/2400389954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa2300cede0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 -- 172.21.15.5:0/2400389954 >> 172.21.15.5:0/2400389954 conn(0x7fa23006dae0 msgr2=0x7fa23006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 -- 172.21.15.5:0/2400389954 shutdown_connections 2023-10-16T13:46:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.515+0000 7fa23828d700 1 -- 172.21.15.5:0/2400389954 wait complete. 2023-10-16T13:46:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.516+0000 7fa23828d700 1 Processor -- start 2023-10-16T13:46:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.516+0000 7fa23828d700 1 -- start start 2023-10-16T13:46:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23828d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa23006a840 0x7fa2300af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23828d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2300cd950 0x7fa2300cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23828d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa23015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23828d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300b5120 con 0x7fa23015e2f0 2023-10-16T13:46:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23828d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300b44a0 con 0x7fa23006a840 2023-10-16T13:46:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23828d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300b4780 con 0x7fa2300cd950 2023-10-16T13:46:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.517+0000 7fa23682a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa23015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa23015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46096/0 (socket says 172.21.15.5:46096) 2023-10-16T13:46:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 -- 172.21.15.5:0/2307858469 learned_addr learned my addr 172.21.15.5:0/2307858469 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa236029700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa23006a840 0x7fa2300af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa235828700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2300cd950 0x7fa2300cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 -- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2300cd950 msgr2=0x7fa2300cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2300cd950 0x7fa2300cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 -- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa23006a840 msgr2=0x7fa2300af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa23006a840 0x7fa2300af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 -- 172.21.15.5:0/2307858469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009430 con 0x7fa23015e2f0 2023-10-16T13:46:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23682a700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa23015b680 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b970 tx=0x7fa22800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800c9b0 con 0x7fa23015e2f0 2023-10-16T13:46:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800cb30 con 0x7fa23015e2f0 2023-10-16T13:46:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2300b4a60 con 0x7fa23015e2f0 2023-10-16T13:46:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228014440 con 0x7fa23015e2f0 2023-10-16T13:46:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.518+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2300b5540 con 0x7fa23015e2f0 2023-10-16T13:46:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.519+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2300b5260 con 0x7fa23015e2f0 2023-10-16T13:46:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.520+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 89280+0+0 (secure 0 0 0) 0x7fa22801d3b0 con 0x7fa23015e2f0 2023-10-16T13:46:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.520+0000 7fa222ffd700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa21406af90 0x7fa21406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.520+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa228006e40 con 0x7fa23015e2f0 2023-10-16T13:46:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.521+0000 7fa236029700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa21406af90 0x7fa21406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.521+0000 7fa236029700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa21406af90 0x7fa21406d450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa22c000f60 tx=0x7fa22c007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.526+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2300b5260 con 0x7fa23015e2f0 2023-10-16T13:46:45.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.757+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000238131", "target": ["mon-mgr", ""]}) v1 -- 0x7fa23015ec00 con 0x7fa21406af90 2023-10-16T13:46:45.765 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.762+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.765 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.762+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.765 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.762+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.766 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.762+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.766 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.762+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.791+0000 7fa222ffd700 1 -- 172.21.15.5:0/2307858469 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa22c005aa0 con 0x7fa21406af90 2023-10-16T13:46:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa21406af90 msgr2=0x7fa21406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa21406af90 0x7fa21406d450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa22c000f60 tx=0x7fa22c007be0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 msgr2=0x7fa23015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa23015b680 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b970 tx=0x7fa22800bd30 comp rx=0 tx=0).stop 2023-10-16T13:46:45.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 shutdown_connections 2023-10-16T13:46:45.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23015e2f0 0x7fa23015b680 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa23006a840 0x7fa2300af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa21406af90 0x7fa21406d450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 --2- 172.21.15.5:0/2307858469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2300cd950 0x7fa2300cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 >> 172.21.15.5:0/2307858469 conn(0x7fa23006dae0 msgr2=0x7fa23015d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:45.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 shutdown_connections 2023-10-16T13:46:45.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.793+0000 7fa23828d700 1 -- 172.21.15.5:0/2307858469 wait complete. 2023-10-16T13:46:45.799 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.794+0000 7fdd0be5f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.799 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.794+0000 7fdd0be5f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.799 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.794+0000 7fdd0be5f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.799 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.794+0000 7fdd0be5f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.800 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.794+0000 7fdd0be5f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-16T13:46:45.811 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.809+0000 7fdd0c660700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.812 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.809+0000 7fdd0c660700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.812 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.809+0000 7fdd0c660700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.812 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.809+0000 7fdd0c660700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.812 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:46:45.809+0000 7fdd0c660700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:46:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.933+0000 7eff3b2b9700 1 Processor -- start 2023-10-16T13:46:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.933+0000 7eff3b2b9700 1 -- start start 2023-10-16T13:46:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff3b2b9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff3b2b9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3415e4e0 con 0x7eff340d3fc0 2023-10-16T13:46:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff3b2b9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340d28e0 con 0x7eff340b7050 2023-10-16T13:46:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff3b2b9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff340b7560 con 0x7eff3415dbc0 2023-10-16T13:46:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff38854700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff340d3fc0 0x7eff340d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56104/0 (socket says 172.21.15.5:56104) 2023-10-16T13:46:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff38854700 1 -- 172.21.15.5:0/982587105 learned_addr learned my addr 172.21.15.5:0/982587105 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff39055700 1 --2- 172.21.15.5:0/982587105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184223114 0 0) 0x7eff3415e4e0 con 0x7eff340d3fc0 2023-10-16T13:46:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff200035b0 con 0x7eff340d3fc0 2023-10-16T13:46:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592592571 0 0) 0x7eff340d28e0 con 0x7eff340b7050 2023-10-16T13:46:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff3415e4e0 con 0x7eff340b7050 2023-10-16T13:46:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff39055700 1 -- 172.21.15.5:0/982587105 >> v1:172.21.15.112:6789/0 conn(0x7eff340b7050 legacy=0x7eff340d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff39055700 1 -- 172.21.15.5:0/982587105 >> v1:172.21.15.5:6789/0 conn(0x7eff340d3fc0 legacy=0x7eff340d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff39055700 1 -- 172.21.15.5:0/982587105 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340b7840 con 0x7eff3415dbc0 2023-10-16T13:46:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.934+0000 7eff39055700 1 --2- 172.21.15.5:0/982587105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3415dfa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff30009850 tx=0x7eff30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a18dc20e40a89f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30005e30 con 0x7eff3415dbc0 2023-10-16T13:46:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30006030 con 0x7eff3415dbc0 2023-10-16T13:46:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff2bfff700 1 -- 172.21.15.5:0/982587105 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff300063e0 con 0x7eff3415dbc0 2023-10-16T13:46:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 -- 172.21.15.5:0/982587105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 msgr2=0x7eff3415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/982587105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3415dfa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff30009850 tx=0x7eff30009b60 comp rx=0 tx=0).stop 2023-10-16T13:46:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 -- 172.21.15.5:0/982587105 shutdown_connections 2023-10-16T13:46:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/982587105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3415dfa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 -- 172.21.15.5:0/982587105 >> 172.21.15.5:0/982587105 conn(0x7eff3409cb40 msgr2=0x7eff340d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 -- 172.21.15.5:0/982587105 shutdown_connections 2023-10-16T13:46:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.935+0000 7eff3b2b9700 1 -- 172.21.15.5:0/982587105 wait complete. 2023-10-16T13:46:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.936+0000 7eff3b2b9700 1 Processor -- start 2023-10-16T13:46:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.936+0000 7eff3b2b9700 1 -- start start 2023-10-16T13:46:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff3b2b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff340b7050 0x7eff340c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff3b2b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 0x7eff34148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff3b2b9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff3b2b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff340ca260 con 0x7eff340d3fc0 2023-10-16T13:46:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff3b2b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff34148fb0 con 0x7eff340b7050 2023-10-16T13:46:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff3b2b9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff340c8890 con 0x7eff3415dbc0 2023-10-16T13:46:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff38854700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 0x7eff34148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff38854700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 0x7eff34148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46108/0 (socket says 172.21.15.5:46108) 2023-10-16T13:46:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff38854700 1 -- 172.21.15.5:0/3846989287 learned_addr learned my addr 172.21.15.5:0/3846989287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff39055700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff340b7050 0x7eff340c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.937+0000 7eff39856700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff38854700 1 -- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 msgr2=0x7eff3406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff38854700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff38854700 1 -- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff340b7050 msgr2=0x7eff340c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff38854700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff340b7050 0x7eff340c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff38854700 1 -- 172.21.15.5:0/3846989287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30009430 con 0x7eff340d3fc0 2023-10-16T13:46:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff38854700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 0x7eff34148a70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c700 tx=0x7eff2400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24005d70 con 0x7eff340d3fc0 2023-10-16T13:46:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff240070d0 con 0x7eff340d3fc0 2023-10-16T13:46:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff340c8b70 con 0x7eff340d3fc0 2023-10-16T13:46:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24007440 con 0x7eff340d3fc0 2023-10-16T13:46:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.938+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff340c9130 con 0x7eff340d3fc0 2023-10-16T13:46:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.939+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3404ebb0 con 0x7eff340d3fc0 2023-10-16T13:46:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.940+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 89280+0+0 (secure 0 0 0) 0x7eff240075a0 con 0x7eff340d3fc0 2023-10-16T13:46:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.940+0000 7eff29ffb700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1806af90 0x7eff1806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.940+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7eff24088820 con 0x7eff340d3fc0 2023-10-16T13:46:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.940+0000 7eff39055700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1806af90 0x7eff1806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.941+0000 7eff39055700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1806af90 0x7eff1806d450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff30000c00 tx=0x7eff30008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:45.945+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff240539e0 con 0x7eff340d3fc0 2023-10-16T13:46:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.176+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7eff340b7b20 con 0x7eff1806af90 2023-10-16T13:46:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.186+0000 7eff29ffb700 1 -- 172.21.15.5:0/3846989287 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+537 (secure 0 0 0) 0x7eff30006380 con 0x7eff1806af90 2023-10-16T13:46:46.190 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:46:46.190 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_addrs": [ 2023-10-16T13:46:46.190 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.5:6789", 2023-10-16T13:46:46.190 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6789", 2023-10-16T13:46:46.191 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6790" 2023-10-16T13:46:46.191 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:46:46.191 INFO:teuthology.orchestra.run.smithi005.stdout: "pending_subvolume_deletions": 1, 2023-10-16T13:46:46.191 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": { 2023-10-16T13:46:46.192 INFO:teuthology.orchestra.run.smithi005.stdout: "data": [ 2023-10-16T13:46:46.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:46:46.192 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": 367056224256, 2023-10-16T13:46:46.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_data", 2023-10-16T13:46:46.192 INFO:teuthology.orchestra.run.smithi005.stdout: "used": 8192 2023-10-16T13:46:46.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:46:46.193 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:46:46.193 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": [ 2023-10-16T13:46:46.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:46:46.193 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": 367056224256, 2023-10-16T13:46:46.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_metadata", 2023-10-16T13:46:46.194 INFO:teuthology.orchestra.run.smithi005.stdout: "used": 24739840 2023-10-16T13:46:46.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:46:46.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:46:46.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:46:46.195 INFO:teuthology.orchestra.run.smithi005.stdout: "used_size": 145 2023-10-16T13:46:46.195 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:46:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1806af90 msgr2=0x7eff1806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1806af90 0x7eff1806d450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff30000c00 tx=0x7eff30008070 comp rx=0 tx=0).stop 2023-10-16T13:46:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 msgr2=0x7eff34148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 0x7eff34148a70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c700 tx=0x7eff2400ca10 comp rx=0 tx=0).stop 2023-10-16T13:46:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 shutdown_connections 2023-10-16T13:46:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1806af90 0x7eff1806d450 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3415dbc0 0x7eff3406c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff340b7050 0x7eff340c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 --2- 172.21.15.5:0/3846989287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff340d3fc0 0x7eff34148a70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 >> 172.21.15.5:0/3846989287 conn(0x7eff3409cb40 msgr2=0x7eff34159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 shutdown_connections 2023-10-16T13:46:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:46.188+0000 7eff3b2b9700 1 -- 172.21.15.5:0/3846989287 wait complete. 2023-10-16T13:46:46.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:46.204 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-10-16T13:46:46.237 INFO:teuthology.orchestra.run.smithi005.stdout:3 2023-10-16T13:46:51.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:51.238 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-10-16T13:46:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:3 2023-10-16T13:46:56.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:56.280 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-10-16T13:46:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:2 2023-10-16T13:46:56.337 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:46:56.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:46:56.401 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:46:56.451 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:46:56.451 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:56.451 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:56.470 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:46:56.470 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:56.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:46:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.689+0000 7f3c9709c700 1 Processor -- start 2023-10-16T13:46:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.689+0000 7f3c9709c700 1 -- start start 2023-10-16T13:46:56.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c9709c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c9015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:56.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c9709c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9015e4e0 con 0x7f3c900d3fc0 2023-10-16T13:46:56.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c9709c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900d28e0 con 0x7f3c900b7050 2023-10-16T13:46:56.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c9709c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900b7560 con 0x7f3c9015dbc0 2023-10-16T13:46:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c8ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c900d3fc0 0x7f3c900d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56120/0 (socket says 172.21.15.5:56120) 2023-10-16T13:46:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c8ffff700 1 -- 172.21.15.5:0/3210700956 learned_addr learned my addr 172.21.15.5:0/3210700956 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.690+0000 7f3c94e38700 1 --2- 172.21.15.5:0/3210700956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c9015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569424241 0 0) 0x7f3c9015e4e0 con 0x7f3c900d3fc0 2023-10-16T13:46:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c800035b0 con 0x7f3c900d3fc0 2023-10-16T13:46:56.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057928832 0 0) 0x7f3c900d28e0 con 0x7f3c900b7050 2023-10-16T13:46:56.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c9015e4e0 con 0x7f3c900b7050 2023-10-16T13:46:56.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c94e38700 1 -- 172.21.15.5:0/3210700956 >> v1:172.21.15.112:6789/0 conn(0x7f3c900b7050 legacy=0x7f3c900d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c94e38700 1 -- 172.21.15.5:0/3210700956 >> v1:172.21.15.5:6789/0 conn(0x7f3c900d3fc0 legacy=0x7f3c900d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c94e38700 1 -- 172.21.15.5:0/3210700956 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c900b7840 con 0x7f3c9015dbc0 2023-10-16T13:46:56.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c94e38700 1 --2- 172.21.15.5:0/3210700956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c9015dfa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009850 tx=0x7f3c84009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f4d446a366bb28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:56.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84005e30 con 0x7f3c9015dbc0 2023-10-16T13:46:56.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84006030 con 0x7f3c9015dbc0 2023-10-16T13:46:56.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.691+0000 7f3c8f7fe700 1 -- 172.21.15.5:0/3210700956 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840063e0 con 0x7f3c9015dbc0 2023-10-16T13:46:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 -- 172.21.15.5:0/3210700956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 msgr2=0x7f3c9015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 --2- 172.21.15.5:0/3210700956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c9015dfa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009850 tx=0x7f3c84009b60 comp rx=0 tx=0).stop 2023-10-16T13:46:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 -- 172.21.15.5:0/3210700956 shutdown_connections 2023-10-16T13:46:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 --2- 172.21.15.5:0/3210700956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c9015dfa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 -- 172.21.15.5:0/3210700956 >> 172.21.15.5:0/3210700956 conn(0x7f3c9009cb40 msgr2=0x7f3c900d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 -- 172.21.15.5:0/3210700956 shutdown_connections 2023-10-16T13:46:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.692+0000 7f3c9709c700 1 -- 172.21.15.5:0/3210700956 wait complete. 2023-10-16T13:46:56.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.693+0000 7f3c9709c700 1 Processor -- start 2023-10-16T13:46:56.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.693+0000 7f3c9709c700 1 -- start start 2023-10-16T13:46:56.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c9709c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 0x7f3c90153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:56.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c9709c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c900d3fc0 0x7f3c901544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:56.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c9709c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c901549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:56.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c9709c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90156650 con 0x7f3c900b7050 2023-10-16T13:46:56.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c9709c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c901f6670 con 0x7f3c900d3fc0 2023-10-16T13:46:56.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c9709c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c901f6950 con 0x7f3c9015dbc0 2023-10-16T13:46:56.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 0x7f3c90153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:56.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 0x7f3c90153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46120/0 (socket says 172.21.15.5:46120) 2023-10-16T13:46:56.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 -- 172.21.15.5:0/2760458430 learned_addr learned my addr 172.21.15.5:0/2760458430 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:56.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c8ffff700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c900d3fc0 0x7f3c901544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:56.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c95639700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c901549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:56.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 -- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 msgr2=0x7f3c901549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c901549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 -- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c900d3fc0 msgr2=0x7f3c901544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c900d3fc0 0x7f3c901544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 -- 172.21.15.5:0/2760458430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c84009430 con 0x7f3c900b7050 2023-10-16T13:46:56.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.694+0000 7f3c94e38700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 0x7f3c90153390 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3c84000c00 tx=0x7f3c84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.695+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84006790 con 0x7f3c900b7050 2023-10-16T13:46:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.695+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84020070 con 0x7f3c900b7050 2023-10-16T13:46:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.695+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c901f6c30 con 0x7f3c900b7050 2023-10-16T13:46:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.695+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84025670 con 0x7f3c900b7050 2023-10-16T13:46:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.695+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c90154080 con 0x7f3c900b7050 2023-10-16T13:46:56.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.696+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c90154240 con 0x7f3c900b7050 2023-10-16T13:46:56.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.696+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f3c84022030 con 0x7f3c900b7050 2023-10-16T13:46:56.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.696+0000 7f3c8d7fa700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c7406b140 0x7f3c7406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:56.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.697+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c8408ada0 con 0x7f3c900b7050 2023-10-16T13:46:56.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.697+0000 7f3c8ffff700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c7406b140 0x7f3c7406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:56.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.697+0000 7f3c8ffff700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c7406b140 0x7f3c7406d600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c901f6060 tx=0x7f3c7c007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:56.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.701+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c84055ac0 con 0x7f3c900b7050 2023-10-16T13:46:56.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.904+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c9004ebb0 con 0x7f3c900b7050 2023-10-16T13:46:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.906+0000 7f3c8d7fa700 1 -- 172.21.15.5:0/2760458430 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f3c840590e0 con 0x7f3c900b7050 2023-10-16T13:46:56.909 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:46:56.909 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:41:09.641898+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:46:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c7406b140 msgr2=0x7f3c7406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c7406b140 0x7f3c7406d600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c901f6060 tx=0x7f3c7c007de0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 msgr2=0x7f3c90153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 0x7f3c90153390 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3c84000c00 tx=0x7f3c84004750 comp rx=0 tx=0).stop 2023-10-16T13:46:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 shutdown_connections 2023-10-16T13:46:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c7406b140 0x7f3c7406d600 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c9015dbc0 0x7f3c901549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c900b7050 0x7f3c90153390 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 --2- 172.21.15.5:0/2760458430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c900d3fc0 0x7f3c901544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 >> 172.21.15.5:0/2760458430 conn(0x7f3c9009cb40 msgr2=0x7f3c9006bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 shutdown_connections 2023-10-16T13:46:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:56.908+0000 7f3c9709c700 1 -- 172.21.15.5:0/2760458430 wait complete. 2023-10-16T13:46:56.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:40:37.717414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:40:38.190883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:46:56.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:46:57.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.048+0000 7fe6eac77700 1 Processor -- start 2023-10-16T13:46:57.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.048+0000 7fe6eac77700 1 -- start start 2023-10-16T13:46:57.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6eac77700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6e406af50 0x7fe6e40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6eac77700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40b2d60 con 0x7fe6e415e2f0 2023-10-16T13:46:57.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6eac77700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40cdd30 con 0x7fe6e40cd950 2023-10-16T13:46:57.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6eac77700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e41619a0 con 0x7fe6e406af50 2023-10-16T13:46:57.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6e3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe6e415e2f0 0x7fe6e406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56134/0 (socket says 172.21.15.5:56134) 2023-10-16T13:46:57.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6e3fff700 1 -- 172.21.15.5:0/3314713443 learned_addr learned my addr 172.21.15.5:0/3314713443 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:57.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882407696 0 0) 0x7fe6e40b2d60 con 0x7fe6e415e2f0 2023-10-16T13:46:57.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.049+0000 7fe6e9214700 1 --2- 172.21.15.5:0/3314713443 >> v2:172.21.15.112:3300/0 conn(0x7fe6e406af50 0x7fe6e40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d40035b0 con 0x7fe6e415e2f0 2023-10-16T13:46:57.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2075448810 0 0) 0x7fe6d40035b0 con 0x7fe6e415e2f0 2023-10-16T13:46:57.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 >> v2:172.21.15.112:3300/0 conn(0x7fe6e406af50 msgr2=0x7fe6e40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:57.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 --2- 172.21.15.5:0/3314713443 >> v2:172.21.15.112:3300/0 conn(0x7fe6e406af50 0x7fe6e40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 >> v1:172.21.15.112:6789/0 conn(0x7fe6e40cd950 legacy=0x7fe6e415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e415e920 con 0x7fe6e415e2f0 2023-10-16T13:46:57.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fe6d00017f0 con 0x7fe6e415e2f0 2023-10-16T13:46:57.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 >> v1:172.21.15.5:6789/0 conn(0x7fe6e415e2f0 legacy=0x7fe6e406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4003a00 0x7fe6d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6d4004400 0x7fe6d40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6d40050d0 0x7fe6d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41619a0 con 0x7fe6d4004400 2023-10-16T13:46:57.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d400c030 con 0x7fe6d40050d0 2023-10-16T13:46:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d400c1f0 con 0x7fe6d4003a00 2023-10-16T13:46:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6d4004400 0x7fe6d40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e9214700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6d40050d0 0x7fe6d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e8a13700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4003a00 0x7fe6d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 -- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4003a00 msgr2=0x7fe6d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:57.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4003a00 0x7fe6d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 -- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6d40050d0 msgr2=0x7fe6d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:57.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6d40050d0 0x7fe6d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 -- 172.21.15.5:0/3314713443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40035b0 con 0x7fe6d4004400 2023-10-16T13:46:57.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e9214700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6d40050d0 0x7fe6d400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:46:57.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e9214700 1 -- 172.21.15.5:0/3314713443 reap_dead start 2023-10-16T13:46:57.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.050+0000 7fe6e3fff700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6d4004400 0x7fe6d40048d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c240 tx=0x7fe6d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69998fec1b0b12c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000cde0 con 0x7fe6d4004400 2023-10-16T13:46:57.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00070d0 con 0x7fe6d4004400 2023-10-16T13:46:57.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6e37fe700 1 -- 172.21.15.5:0/3314713443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0007480 con 0x7fe6d4004400 2023-10-16T13:46:57.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 -- 172.21.15.5:0/3314713443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6d4004400 msgr2=0x7fe6d40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6d4004400 0x7fe6d40048d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c240 tx=0x7fe6d4005880 comp rx=0 tx=0).stop 2023-10-16T13:46:57.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 -- 172.21.15.5:0/3314713443 shutdown_connections 2023-10-16T13:46:57.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 --2- 172.21.15.5:0/3314713443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6d4004400 0x7fe6d40048d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 -- 172.21.15.5:0/3314713443 >> 172.21.15.5:0/3314713443 conn(0x7fe6e406dae0 msgr2=0x7fe6e406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:57.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 -- 172.21.15.5:0/3314713443 shutdown_connections 2023-10-16T13:46:57.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.051+0000 7fe6eac77700 1 -- 172.21.15.5:0/3314713443 wait complete. 2023-10-16T13:46:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.052+0000 7fe6eac77700 1 Processor -- start 2023-10-16T13:46:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.052+0000 7fe6eac77700 1 -- start start 2023-10-16T13:46:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6eac77700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4004400 0x7fe6e41f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6eac77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e415b3a0 0x7fe6e40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6eac77700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 0x7fe6e40c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6eac77700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415bf50 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6eac77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40cb830 con 0x7fe6e415b3a0 2023-10-16T13:46:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6eac77700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b41b0 con 0x7fe6d4004400 2023-10-16T13:46:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6e9214700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 0x7fe6e40c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6e9214700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 0x7fe6e40c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46144/0 (socket says 172.21.15.5:46144) 2023-10-16T13:46:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.053+0000 7fe6e9214700 1 -- 172.21.15.5:0/1606625016 learned_addr learned my addr 172.21.15.5:0/1606625016 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e8a13700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4004400 0x7fe6e41f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e3fff700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e415b3a0 0x7fe6e40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e9214700 1 -- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4004400 msgr2=0x7fe6e41f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e9214700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4004400 0x7fe6e41f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e9214700 1 -- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e415b3a0 msgr2=0x7fe6e40cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e9214700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e415b3a0 0x7fe6e40cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e9214700 1 -- 172.21.15.5:0/1606625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40b4400 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e3fff700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e415b3a0 0x7fe6e40cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:46:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e9214700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 0x7fe6e40c4880 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe6e406ebc0 tx=0x7fe6dc00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc01c070 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00f040 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00e040 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40b46e0 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.054+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e40b4ca0 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.055+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e4067d20 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.056+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fe6dc015430 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.056+0000 7fe6e17fa700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe6c806b110 0x7fe6c806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.056+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe6dc089970 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.056+0000 7fe6e8a13700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe6c806b110 0x7fe6c806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.057+0000 7fe6e8a13700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe6c806b110 0x7fe6c806d5d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80011a0 tx=0x7fe6d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.061+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6dc054570 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.280+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6e40b2630 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.281+0000 7fe6e17fa700 1 -- 172.21.15.5:0/1606625016 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6dc057b90 con 0x7fe6e40cb3b0 2023-10-16T13:46:57.284 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:46:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe6c806b110 msgr2=0x7fe6c806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe6c806b110 0x7fe6c806d5d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80011a0 tx=0x7fe6d8009040 comp rx=0 tx=0).stop 2023-10-16T13:46:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 msgr2=0x7fe6e40c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 0x7fe6e40c4880 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe6e406ebc0 tx=0x7fe6dc00f490 comp rx=0 tx=0).stop 2023-10-16T13:46:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 shutdown_connections 2023-10-16T13:46:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6e40cb3b0 0x7fe6e40c4880 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe6c806b110 0x7fe6c806d5d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6d4004400 0x7fe6e41f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 --2- 172.21.15.5:0/1606625016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e415b3a0 0x7fe6e40cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 >> 172.21.15.5:0/1606625016 conn(0x7fe6e406dae0 msgr2=0x7fe6e406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 shutdown_connections 2023-10-16T13:46:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.283+0000 7fe6eac77700 1 -- 172.21.15.5:0/1606625016 wait complete. 2023-10-16T13:46:57.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:46:57.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.422+0000 7f04c7e87700 1 Processor -- start 2023-10-16T13:46:57.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.423+0000 7f04c7e87700 1 -- start start 2023-10-16T13:46:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.423+0000 7f04c7e87700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c015eab0 0x7f04c00cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.423+0000 7f04c7e87700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00d1d90 0x7f04c00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.423+0000 7f04c7e87700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c015ee90 con 0x7f04c00cf6d0 2023-10-16T13:46:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c7e87700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00d21c0 con 0x7f04c015eab0 2023-10-16T13:46:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c7e87700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00cfb60 con 0x7f04c00d1d90 2023-10-16T13:46:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5c23700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c015eab0 0x7f04c00cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5422700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f04c00cf6d0 0x7f04c00d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56152/0 (socket says 172.21.15.5:56152) 2023-10-16T13:46:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5422700 1 -- 172.21.15.5:0/1683686319 learned_addr learned my addr 172.21.15.5:0/1683686319 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c6424700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00d1d90 0x7f04c00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5c23700 1 -- 172.21.15.5:0/1683686319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00d1d90 msgr2=0x7f04c00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5c23700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00d1d90 0x7f04c00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5c23700 1 -- 172.21.15.5:0/1683686319 >> v1:172.21.15.5:6789/0 conn(0x7f04c00cf6d0 legacy=0x7f04c00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5c23700 1 -- 172.21.15.5:0/1683686319 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0158370 con 0x7f04c015eab0 2023-10-16T13:46:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c6424700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00d1d90 0x7f04c00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:46:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c5c23700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00cf190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009840 tx=0x7f04b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502786c2e564162f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c4c21700 1 -- 172.21.15.5:0/1683686319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011830 con 0x7f04c015eab0 2023-10-16T13:46:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c4c21700 1 -- 172.21.15.5:0/1683686319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b0011990 con 0x7f04c015eab0 2023-10-16T13:46:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.424+0000 7f04c4c21700 1 -- 172.21.15.5:0/1683686319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011d20 con 0x7f04c015eab0 2023-10-16T13:46:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 -- 172.21.15.5:0/1683686319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 msgr2=0x7f04c00cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00cf190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009840 tx=0x7f04b0009b50 comp rx=0 tx=0).stop 2023-10-16T13:46:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 -- 172.21.15.5:0/1683686319 shutdown_connections 2023-10-16T13:46:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00d1d90 0x7f04c00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 --2- 172.21.15.5:0/1683686319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00cf190 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 -- 172.21.15.5:0/1683686319 >> 172.21.15.5:0/1683686319 conn(0x7f04c00665a0 msgr2=0x7f04c0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 -- 172.21.15.5:0/1683686319 shutdown_connections 2023-10-16T13:46:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.425+0000 7f04c7e87700 1 -- 172.21.15.5:0/1683686319 wait complete. 2023-10-16T13:46:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.426+0000 7f04c7e87700 1 Processor -- start 2023-10-16T13:46:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.426+0000 7f04c7e87700 1 -- start start 2023-10-16T13:46:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c7e87700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00cf6d0 0x7f04c00aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c7e87700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c00d1d90 0x7f04c00c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c7e87700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c7e87700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00ae710 con 0x7f04c015eab0 2023-10-16T13:46:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c7e87700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00af070 con 0x7f04c00d1d90 2023-10-16T13:46:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c7e87700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01f6ba0 con 0x7f04c00cf6d0 2023-10-16T13:46:57.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46156/0 (socket says 172.21.15.5:46156) 2023-10-16T13:46:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 -- 172.21.15.5:0/449435390 learned_addr learned my addr 172.21.15.5:0/449435390 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c5c23700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00cf6d0 0x7f04c00aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c5422700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c00d1d90 0x7f04c00c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 -- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00cf6d0 msgr2=0x7f04c00aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00cf6d0 0x7f04c00aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 -- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c00d1d90 msgr2=0x7f04c00c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c00d1d90 0x7f04c00c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c6424700 1 -- 172.21.15.5:0/449435390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00094a0 con 0x7f04c015eab0 2023-10-16T13:46:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.427+0000 7f04c5422700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c00d1d90 0x7f04c00c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:46:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.428+0000 7f04c6424700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00c75c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f04b800cd80 tx=0x7f04b800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.428+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800f480 con 0x7f04c015eab0 2023-10-16T13:46:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.428+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800f600 con 0x7f04c015eab0 2023-10-16T13:46:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.428+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c01f3ed0 con 0x7f04c015eab0 2023-10-16T13:46:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.428+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800f9b0 con 0x7f04c015eab0 2023-10-16T13:46:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.428+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c00ae050 con 0x7f04c015eab0 2023-10-16T13:46:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.429+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c00ae850 con 0x7f04c015eab0 2023-10-16T13:46:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.429+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f04b800b040 con 0x7f04c015eab0 2023-10-16T13:46:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.429+0000 7f04b67fc700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04a406b140 0x7f04a406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.430+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f04b808a290 con 0x7f04c015eab0 2023-10-16T13:46:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.430+0000 7f04c5c23700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04a406b140 0x7f04a406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.430+0000 7f04c5c23700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04a406b140 0x7f04a406d600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f04b00090b0 tx=0x7f04b0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.434+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04c00ae850 con 0x7f04c015eab0 2023-10-16T13:46:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.631+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04c00ae850 con 0x7f04c015eab0 2023-10-16T13:46:57.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.631+0000 7f04b67fc700 1 -- 172.21.15.5:0/449435390 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04c00ae850 con 0x7f04c015eab0 2023-10-16T13:46:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:46:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04a406b140 msgr2=0x7f04a406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04a406b140 0x7f04a406d600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f04b00090b0 tx=0x7f04b0008030 comp rx=0 tx=0).stop 2023-10-16T13:46:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 msgr2=0x7f04c00c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00c75c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f04b800cd80 tx=0x7f04b800a560 comp rx=0 tx=0).stop 2023-10-16T13:46:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 shutdown_connections 2023-10-16T13:46:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c015eab0 0x7f04c00c75c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04a406b140 0x7f04a406d600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c00cf6d0 0x7f04c00aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 --2- 172.21.15.5:0/449435390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c00d1d90 0x7f04c00c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 >> 172.21.15.5:0/449435390 conn(0x7f04c00665a0 msgr2=0x7f04c00b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 shutdown_connections 2023-10-16T13:46:57.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.633+0000 7f04c7e87700 1 -- 172.21.15.5:0/449435390 wait complete. 2023-10-16T13:46:57.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:46:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.773+0000 7f82414ba700 1 Processor -- start 2023-10-16T13:46:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.773+0000 7f82414ba700 1 -- start start 2023-10-16T13:46:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f82414ba700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f823c15ab10 0x7f823c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f82414ba700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b1f50 0x7f823c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f82414ba700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c15e7a0 con 0x7f823c0b23d0 2023-10-16T13:46:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f82414ba700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c15f730 con 0x7f823c15ab10 2023-10-16T13:46:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f82414ba700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0b29a0 con 0x7f823c0b1f50 2023-10-16T13:46:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f823affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f823c15ab10 0x7f823c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f823affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f823c15ab10 0x7f823c15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46160/0 (socket says 172.21.15.5:46160) 2023-10-16T13:46:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f823affd700 1 -- 172.21.15.5:0/3397319068 learned_addr learned my addr 172.21.15.5:0/3397319068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.774+0000 7f823a7fc700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b1f50 0x7f823c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f8239ffb700 1 -- 172.21.15.5:0/3397319068 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623678725 0 0) 0x7f823c15e7a0 con 0x7f823c0b23d0 2023-10-16T13:46:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f823affd700 1 -- 172.21.15.5:0/3397319068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b1f50 msgr2=0x7f823c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f823affd700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b1f50 0x7f823c0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f823affd700 1 -- 172.21.15.5:0/3397319068 >> v1:172.21.15.112:6789/0 conn(0x7f823c0b23d0 legacy=0x7f823c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f823affd700 1 -- 172.21.15.5:0/3397319068 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0b2c80 con 0x7f823c15ab10 2023-10-16T13:46:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f823a7fc700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b1f50 0x7f823c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:46:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f823affd700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c15f1f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f823000bb90 tx=0x7f823000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f46a7c87249e441 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f8239ffb700 1 -- 172.21.15.5:0/3397319068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823000dd30 con 0x7f823c15ab10 2023-10-16T13:46:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f8239ffb700 1 -- 172.21.15.5:0/3397319068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823000de90 con 0x7f823c15ab10 2023-10-16T13:46:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f8239ffb700 1 -- 172.21.15.5:0/3397319068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230010690 con 0x7f823c15ab10 2023-10-16T13:46:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f82414ba700 1 -- 172.21.15.5:0/3397319068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 msgr2=0x7f823c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.775+0000 7f82414ba700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c15f1f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f823000bb90 tx=0x7f823000bea0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.776+0000 7f82414ba700 1 -- 172.21.15.5:0/3397319068 shutdown_connections 2023-10-16T13:46:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.776+0000 7f82414ba700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c15f1f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.776+0000 7f82414ba700 1 --2- 172.21.15.5:0/3397319068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b1f50 0x7f823c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.776+0000 7f82414ba700 1 -- 172.21.15.5:0/3397319068 >> 172.21.15.5:0/3397319068 conn(0x7f823c06dae0 msgr2=0x7f823c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.776+0000 7f82414ba700 1 -- 172.21.15.5:0/3397319068 shutdown_connections 2023-10-16T13:46:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.776+0000 7f82414ba700 1 -- 172.21.15.5:0/3397319068 wait complete. 2023-10-16T13:46:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.777+0000 7f82414ba700 1 Processor -- start 2023-10-16T13:46:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.777+0000 7f82414ba700 1 -- start start 2023-10-16T13:46:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f823c0b1f50 0x7f823c15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b23d0 0x7f823c0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0aed10 con 0x7f823c15ab10 2023-10-16T13:46:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0aca50 con 0x7f823c0b1f50 2023-10-16T13:46:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0acd30 con 0x7f823c0b23d0 2023-10-16T13:46:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c14d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46170/0 (socket says 172.21.15.5:46170) 2023-10-16T13:46:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 -- 172.21.15.5:0/519196117 learned_addr learned my addr 172.21.15.5:0/519196117 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823a7fc700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b23d0 0x7f823c0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823affd700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f823c0b1f50 0x7f823c15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 -- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b23d0 msgr2=0x7f823c0ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b23d0 0x7f823c0ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 -- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f823c0b1f50 msgr2=0x7f823c15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f823c0b1f50 0x7f823c15cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 -- 172.21.15.5:0/519196117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009430 con 0x7f823c15ab10 2023-10-16T13:46:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f823b7fe700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c14d940 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f823400c7a0 tx=0x7f823400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234003e30 con 0x7f823c15ab10 2023-10-16T13:46:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8234005070 con 0x7f823c15ab10 2023-10-16T13:46:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234005420 con 0x7f823c15ab10 2023-10-16T13:46:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823000b7f0 con 0x7f823c15ab10 2023-10-16T13:46:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.778+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c0ad2f0 con 0x7f823c15ab10 2023-10-16T13:46:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.779+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c0ad510 con 0x7f823c15ab10 2023-10-16T13:46:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.780+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f8234005580 con 0x7f823c15ab10 2023-10-16T13:46:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.780+0000 7f82237fe700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f822806b140 0x7f822806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.780+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8234088fe0 con 0x7f823c15ab10 2023-10-16T13:46:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.780+0000 7f823affd700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f822806b140 0x7f822806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.781+0000 7f823affd700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f822806b140 0x7f822806d600 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f823000bfd0 tx=0x7f823001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.785+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8234057780 con 0x7f823c15ab10 2023-10-16T13:46:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.986+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f823c067d20 con 0x7f823c15ab10 2023-10-16T13:46:57.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.986+0000 7f82237fe700 1 -- 172.21.15.5:0/519196117 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8234017020 con 0x7f823c15ab10 2023-10-16T13:46:57.990 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:46:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.988+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f822806b140 msgr2=0x7f822806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f822806b140 0x7f822806d600 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f823000bfd0 tx=0x7f823001c040 comp rx=0 tx=0).stop 2023-10-16T13:46:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 msgr2=0x7f823c14d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c14d940 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f823400c7a0 tx=0x7f823400cab0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 shutdown_connections 2023-10-16T13:46:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f823c15ab10 0x7f823c14d940 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f823c0b1f50 0x7f823c15cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f822806b140 0x7f822806d600 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 --2- 172.21.15.5:0/519196117 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f823c0b23d0 0x7f823c0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 >> 172.21.15.5:0/519196117 conn(0x7f823c06dae0 msgr2=0x7f823c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:57.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 shutdown_connections 2023-10-16T13:46:57.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:57.989+0000 7f82414ba700 1 -- 172.21.15.5:0/519196117 wait complete. 2023-10-16T13:46:58.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:46:58.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.126+0000 7f33b125d700 1 Processor -- start 2023-10-16T13:46:58.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.126+0000 7f33b125d700 1 -- start start 2023-10-16T13:46:58.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33b125d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 0x7f33ac0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33b125d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0ce3b0 con 0x7f33ac0cd4b0 2023-10-16T13:46:58.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33b125d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0b2dc0 con 0x7f33ac0b2940 2023-10-16T13:46:58.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33b125d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b6290 con 0x7f33ac15a850 2023-10-16T13:46:58.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33ab59e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33ac0cd4b0 0x7f33ac0ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56182/0 (socket says 172.21.15.5:56182) 2023-10-16T13:46:58.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33ab59e700 1 -- 172.21.15.5:0/2853451004 learned_addr learned my addr 172.21.15.5:0/2853451004 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:58.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33aad9d700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 0x7f33ac0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655088777 0 0) 0x7f33ac0ce3b0 con 0x7f33ac0cd4b0 2023-10-16T13:46:58.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.127+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33940035b0 con 0x7f33ac0cd4b0 2023-10-16T13:46:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793422091 0 0) 0x7f33940035b0 con 0x7f33ac0cd4b0 2023-10-16T13:46:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 msgr2=0x7f33ac0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 0x7f33ac0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 >> v1:172.21.15.112:6789/0 conn(0x7f33ac0b2940 legacy=0x7f33ac0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0cc220 con 0x7f33ac0cd4b0 2023-10-16T13:46:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f33a40019f0 con 0x7f33ac0cd4b0 2023-10-16T13:46:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 >> v1:172.21.15.5:6789/0 conn(0x7f33ac0cd4b0 legacy=0x7f33ac0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 0x7f3394003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3394003f70 0x7f3394004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394004d90 0x7f3394005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b6290 con 0x7f3394003f70 2023-10-16T13:46:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339400ba70 con 0x7f3394004d90 2023-10-16T13:46:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339400bc30 con 0x7f33ac15a850 2023-10-16T13:46:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3394003f70 0x7f3394004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aad9d700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 0x7f3394003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33ab59e700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394004d90 0x7f3394005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 -- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 msgr2=0x7f3394003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac15a850 0x7f3394003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 -- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394004d90 msgr2=0x7f3394005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394004d90 0x7f3394005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 -- 172.21.15.5:0/2853451004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940035b0 con 0x7f3394003f70 2023-10-16T13:46:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33aa59c700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3394003f70 0x7f3394004850 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f339c0018d0 tx=0x7f3394005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba775490f6e9ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c012620 con 0x7f3394003f70 2023-10-16T13:46:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c012780 con 0x7f3394003f70 2023-10-16T13:46:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.128+0000 7f33a9d9b700 1 -- 172.21.15.5:0/2853451004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c012b30 con 0x7f3394003f70 2023-10-16T13:46:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33b125d700 1 -- 172.21.15.5:0/2853451004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3394003f70 msgr2=0x7f3394004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33b125d700 1 --2- 172.21.15.5:0/2853451004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3394003f70 0x7f3394004850 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f339c0018d0 tx=0x7f3394005880 comp rx=0 tx=0).stop 2023-10-16T13:46:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33ab59e700 1 -- 172.21.15.5:0/2853451004 reap_dead start 2023-10-16T13:46:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33b125d700 1 -- 172.21.15.5:0/2853451004 shutdown_connections 2023-10-16T13:46:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33b125d700 1 -- 172.21.15.5:0/2853451004 >> 172.21.15.5:0/2853451004 conn(0x7f33ac06dac0 msgr2=0x7f33ac06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33b125d700 1 -- 172.21.15.5:0/2853451004 shutdown_connections 2023-10-16T13:46:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.129+0000 7f33b125d700 1 -- 172.21.15.5:0/2853451004 wait complete. 2023-10-16T13:46:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.130+0000 7f33b125d700 1 Processor -- start 2023-10-16T13:46:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.130+0000 7f33b125d700 1 -- start start 2023-10-16T13:46:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33b125d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394003f70 0x7f33ac158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33b125d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac0aec50 0x7f33ac0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33b125d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 0x7f33ac0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33b125d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1f2ba0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33b125d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c4960 con 0x7f3394003f70 2023-10-16T13:46:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33b125d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1f2db0 con 0x7f33ac0aec50 2023-10-16T13:46:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33ab59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 0x7f33ac0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33ab59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 0x7f33ac0c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46190/0 (socket says 172.21.15.5:46190) 2023-10-16T13:46:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.131+0000 7f33ab59e700 1 -- 172.21.15.5:0/634489520 learned_addr learned my addr 172.21.15.5:0/634489520 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33aad9d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394003f70 0x7f33ac158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33aa59c700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac0aec50 0x7f33ac0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33ab59e700 1 -- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac0aec50 msgr2=0x7f33ac0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33ab59e700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac0aec50 0x7f33ac0af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33ab59e700 1 -- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394003f70 msgr2=0x7f33ac158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33ab59e700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394003f70 0x7f33ac158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33ab59e700 1 -- 172.21.15.5:0/634489520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac1f3090 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33aa59c700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac0aec50 0x7f33ac0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:46:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33ab59e700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 0x7f33ac0c4420 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0afee0 tx=0x7f33a400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400adf0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40133f0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac1f3370 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40137a0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.132+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac1f3930 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.133+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac067d20 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.133+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f33a4013900 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.134+0000 7f33937fe700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f339806b130 0x7f339806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.134+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f33a408a3b0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.134+0000 7f33aad9d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f339806b130 0x7f339806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.134+0000 7f33aad9d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f339806b130 0x7f339806d5f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0cd250 tx=0x7f33a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:58.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.138+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33a40550c0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.355+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33ac0cb820 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.356+0000 7f33937fe700 1 -- 172.21.15.5:0/634489520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7f33a40586e0 con 0x7f33ac0c3fa0 2023-10-16T13:46:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f339806b130 msgr2=0x7f339806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f339806b130 0x7f339806d5f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0cd250 tx=0x7f33a0008040 comp rx=0 tx=0).stop 2023-10-16T13:46:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 msgr2=0x7f33ac0c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 0x7f33ac0c4420 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0afee0 tx=0x7f33a400a640 comp rx=0 tx=0).stop 2023-10-16T13:46:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 shutdown_connections 2023-10-16T13:46:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0c3fa0 0x7f33ac0c4420 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394003f70 0x7f33ac158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f339806b130 0x7f339806d5f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 --2- 172.21.15.5:0/634489520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33ac0aec50 0x7f33ac0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 >> 172.21.15.5:0/634489520 conn(0x7f33ac06dac0 msgr2=0x7f33ac159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 shutdown_connections 2023-10-16T13:46:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.358+0000 7f33b125d700 1 -- 172.21.15.5:0/634489520 wait complete. 2023-10-16T13:46:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:46:58.373 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:46:58.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:58.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:46:58.503 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:46:58.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:46:58.504 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:46:58.525 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:46:58.526 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:58.544 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:46:58.544 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:46:58.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:46:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.724+0000 7f4356706700 1 Processor -- start 2023-10-16T13:46:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.724+0000 7f4356706700 1 -- start start 2023-10-16T13:46:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f4356706700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4350157d40 0x7f43500cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f4356706700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006e2b0 0x7f43500cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f4356706700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4350158120 con 0x7f435006de50 2023-10-16T13:46:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f4356706700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435006a840 con 0x7f4350157d40 2023-10-16T13:46:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f4356706700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500caef0 con 0x7f435006e2b0 2023-10-16T13:46:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f434ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4350157d40 0x7f43500cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f434ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4350157d40 0x7f43500cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46194/0 (socket says 172.21.15.5:46194) 2023-10-16T13:46:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.725+0000 7f434ffff700 1 -- 172.21.15.5:0/340599058 learned_addr learned my addr 172.21.15.5:0/340599058 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f4354ca3700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006e2b0 0x7f43500cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434ffff700 1 -- 172.21.15.5:0/340599058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006e2b0 msgr2=0x7f43500cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434ffff700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006e2b0 0x7f43500cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434ffff700 1 -- 172.21.15.5:0/340599058 >> v1:172.21.15.112:6789/0 conn(0x7f435006de50 legacy=0x7f435015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434ffff700 1 -- 172.21.15.5:0/340599058 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435006e750 con 0x7f4350157d40 2023-10-16T13:46:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f4354ca3700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006e2b0 0x7f43500cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:46:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434ffff700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f43500cee90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f434000bb90 tx=0x7f434000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2fa8c2dd26683c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434effd700 1 -- 172.21.15.5:0/340599058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434000dd50 con 0x7f4350157d40 2023-10-16T13:46:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434effd700 1 -- 172.21.15.5:0/340599058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4340010470 con 0x7f4350157d40 2023-10-16T13:46:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.726+0000 7f434effd700 1 -- 172.21.15.5:0/340599058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340010800 con 0x7f4350157d40 2023-10-16T13:46:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 -- 172.21.15.5:0/340599058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 msgr2=0x7f43500cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f43500cee90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f434000bb90 tx=0x7f434000bea0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 -- 172.21.15.5:0/340599058 shutdown_connections 2023-10-16T13:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006e2b0 0x7f43500cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 --2- 172.21.15.5:0/340599058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f43500cee90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 -- 172.21.15.5:0/340599058 >> 172.21.15.5:0/340599058 conn(0x7f43500cc6f0 msgr2=0x7f43500ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 -- 172.21.15.5:0/340599058 shutdown_connections 2023-10-16T13:46:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.727+0000 7f4356706700 1 -- 172.21.15.5:0/340599058 wait complete. 2023-10-16T13:46:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.728+0000 7f4356706700 1 Processor -- start 2023-10-16T13:46:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.728+0000 7f4356706700 1 -- start start 2023-10-16T13:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4356706700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006de50 0x7f435015e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4356706700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f435006e2b0 0x7f4350156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4356706700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f435015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4356706700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435015e6f0 con 0x7f4350157d40 2023-10-16T13:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4356706700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500b57a0 con 0x7f435006e2b0 2023-10-16T13:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4356706700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500b54c0 con 0x7f435006de50 2023-10-16T13:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f435015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f435015d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46202/0 (socket says 172.21.15.5:46202) 2023-10-16T13:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 -- 172.21.15.5:0/3571437018 learned_addr learned my addr 172.21.15.5:0/3571437018 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f434ffff700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006de50 0x7f435015e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f434f7fe700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f435006e2b0 0x7f4350156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 -- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006de50 msgr2=0x7f435015e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006de50 0x7f435015e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 -- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f435006e2b0 msgr2=0x7f4350156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f435006e2b0 0x7f4350156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.729+0000 7f4354ca3700 1 -- 172.21.15.5:0/3571437018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434000b7f0 con 0x7f4350157d40 2023-10-16T13:46:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.730+0000 7f4354ca3700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f435015d420 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4348007ec0 tx=0x7f434800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.730+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434800dd80 con 0x7f4350157d40 2023-10-16T13:46:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.730+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434800f040 con 0x7f4350157d40 2023-10-16T13:46:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.730+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500b33f0 con 0x7f4350157d40 2023-10-16T13:46:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.730+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348003c60 con 0x7f4350157d40 2023-10-16T13:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.730+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4350157220 con 0x7f4350157d40 2023-10-16T13:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.731+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43500cd1e0 con 0x7f4350157d40 2023-10-16T13:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.731+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f4348004030 con 0x7f4350157d40 2023-10-16T13:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.732+0000 7f434cff9700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f433c06b140 0x7f433c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.732+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4348089b80 con 0x7f4350157d40 2023-10-16T13:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.732+0000 7f434ffff700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f433c06b140 0x7f433c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.732+0000 7f434ffff700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f433c06b140 0x7f433c06d600 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f434000bee0 tx=0x7f4340013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.736+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4348054780 con 0x7f4350157d40 2023-10-16T13:46:58.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:46:58.752 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:46:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.939+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4350067d20 con 0x7f4350157d40 2023-10-16T13:46:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.940+0000 7f434cff9700 1 -- 172.21.15.5:0/3571437018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f434801a090 con 0x7f4350157d40 2023-10-16T13:46:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:46:58.944 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:41:09.641898+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:46:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f433c06b140 msgr2=0x7f433c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f433c06b140 0x7f433c06d600 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f434000bee0 tx=0x7f4340013000 comp rx=0 tx=0).stop 2023-10-16T13:46:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 msgr2=0x7f435015d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f435015d420 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4348007ec0 tx=0x7f434800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 shutdown_connections 2023-10-16T13:46:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4350157d40 0x7f435015d420 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f433c06b140 0x7f433c06d600 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f435006de50 0x7f435015e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 --2- 172.21.15.5:0/3571437018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f435006e2b0 0x7f4350156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 >> 172.21.15.5:0/3571437018 conn(0x7f43500cc6f0 msgr2=0x7f4350158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 shutdown_connections 2023-10-16T13:46:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:58.943+0000 7f4356706700 1 -- 172.21.15.5:0/3571437018 wait complete. 2023-10-16T13:46:58.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:40:37.717414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:40:38.190883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:46:58.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:46:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.084+0000 7f644abec700 1 Processor -- start 2023-10-16T13:46:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.084+0000 7f644abec700 1 -- start start 2023-10-16T13:46:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f644abec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f644415b740 0x7f64440d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f644abec700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 0x7f64440cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f644abec700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440cf190 con 0x7f64440d0c70 2023-10-16T13:46:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f644abec700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644415bb20 con 0x7f644415b740 2023-10-16T13:46:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f644abec700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440cbd40 con 0x7f64440ce6e0 2023-10-16T13:46:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f6443fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f64440d0c70 0x7f64440cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56212/0 (socket says 172.21.15.5:56212) 2023-10-16T13:46:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f6443fff700 1 -- 172.21.15.5:0/3290019094 learned_addr learned my addr 172.21.15.5:0/3290019094 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f6448988700 1 --2- 172.21.15.5:0/3290019094 >> v2:172.21.15.112:3300/0 conn(0x7f644415b740 0x7f64440d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147119624 0 0) 0x7f64440cf190 con 0x7f64440d0c70 2023-10-16T13:46:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.085+0000 7f6449189700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 0x7f64440cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64340035b0 con 0x7f64440d0c70 2023-10-16T13:46:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412954732 0 0) 0x7f64340035b0 con 0x7f64440d0c70 2023-10-16T13:46:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 msgr2=0x7f64440cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 0x7f64440cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 >> v2:172.21.15.112:3300/0 conn(0x7f644415b740 msgr2=0x7f64440d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 --2- 172.21.15.5:0/3290019094 >> v2:172.21.15.112:3300/0 conn(0x7f644415b740 0x7f64440d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440cc020 con 0x7f64440d0c70 2023-10-16T13:46:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6430001670 con 0x7f64440d0c70 2023-10-16T13:46:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 >> v1:172.21.15.5:6789/0 conn(0x7f64440d0c70 legacy=0x7f64440cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 0x7f6434003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6434003fa0 0x7f6434004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6434004d90 0x7f6434005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644415bb20 con 0x7f6434004d90 2023-10-16T13:46:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440cbd40 con 0x7f6434003fa0 2023-10-16T13:46:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643400ba90 con 0x7f64440ce6e0 2023-10-16T13:46:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6434004d90 0x7f6434005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6448988700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 0x7f6434003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6443fff700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6434003fa0 0x7f6434004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 -- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 msgr2=0x7f6434003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64440ce6e0 0x7f6434003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 -- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6434003fa0 msgr2=0x7f6434004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6434003fa0 0x7f6434004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 -- 172.21.15.5:0/3290019094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340035b0 con 0x7f6434004d90 2023-10-16T13:46:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.086+0000 7f6449189700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6434004d90 0x7f6434005210 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f64441602d0 tx=0x7f6434005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45b2a39c8f9af8d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c00ebd0 con 0x7f6434004d90 2023-10-16T13:46:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c00f040 con 0x7f6434004d90 2023-10-16T13:46:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f64437fe700 1 -- 172.21.15.5:0/3290019094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c014480 con 0x7f6434004d90 2023-10-16T13:46:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f644abec700 1 -- 172.21.15.5:0/3290019094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6434004d90 msgr2=0x7f6434005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f644abec700 1 --2- 172.21.15.5:0/3290019094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6434004d90 0x7f6434005210 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f64441602d0 tx=0x7f6434005880 comp rx=0 tx=0).stop 2023-10-16T13:46:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f6449189700 1 -- 172.21.15.5:0/3290019094 reap_dead start 2023-10-16T13:46:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f644abec700 1 -- 172.21.15.5:0/3290019094 shutdown_connections 2023-10-16T13:46:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f644abec700 1 -- 172.21.15.5:0/3290019094 >> 172.21.15.5:0/3290019094 conn(0x7f64440665a0 msgr2=0x7f6444066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f644abec700 1 -- 172.21.15.5:0/3290019094 shutdown_connections 2023-10-16T13:46:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.087+0000 7f644abec700 1 -- 172.21.15.5:0/3290019094 wait complete. 2023-10-16T13:46:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.088+0000 7f644abec700 1 Processor -- start 2023-10-16T13:46:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 -- start start 2023-10-16T13:46:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 0x7f64440b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 0x7f64440b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64440b2560 0x7f644406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440b2a10 con 0x7f644414e620 2023-10-16T13:46:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644414f6f0 con 0x7f64440b2560 2023-10-16T13:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.089+0000 7f644abec700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440b6e20 con 0x7f64441f26c0 2023-10-16T13:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 0x7f64440b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6448988700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 0x7f64440b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6449189700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64440b2560 0x7f644406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6448988700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 0x7f64440b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:44122/0 (socket says 172.21.15.5:44122) 2023-10-16T13:46:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 0x7f64440b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46220/0 (socket says 172.21.15.5:46220) 2023-10-16T13:46:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6448988700 1 -- 172.21.15.5:0/2230098773 learned_addr learned my addr 172.21.15.5:0/2230098773 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 -- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 msgr2=0x7f64440b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 0x7f64440b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 -- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64440b2560 msgr2=0x7f644406b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64440b2560 0x7f644406b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 -- 172.21.15.5:0/2230098773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64441f2aa0 con 0x7f644414e620 2023-10-16T13:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6448988700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 0x7f64440b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f6443fff700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 0x7f64440b2020 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6430001050 tx=0x7f64300075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643000f5e0 con 0x7f644414e620 2023-10-16T13:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643000f740 con 0x7f644414e620 2023-10-16T13:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644414eae0 con 0x7f644414e620 2023-10-16T13:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643000fad0 con 0x7f644414e620 2023-10-16T13:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.090+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644414f0a0 con 0x7f644414e620 2023-10-16T13:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.091+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644414f8a0 con 0x7f644414e620 2023-10-16T13:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.092+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f643000fc30 con 0x7f644414e620 2023-10-16T13:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.092+0000 7f64417fa700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f642806b140 0x7f642806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.092+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6430089980 con 0x7f644414e620 2023-10-16T13:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.092+0000 7f6448988700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f642806b140 0x7f642806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.093+0000 7f6448988700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f642806b140 0x7f642806d600 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6438009fd0 tx=0x7f6438009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.097+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f644414f8a0 con 0x7f644414e620 2023-10-16T13:46:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.296+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f644414f8a0 con 0x7f644414e620 2023-10-16T13:46:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.297+0000 7f64417fa700 1 -- 172.21.15.5:0/2230098773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f644414f8a0 con 0x7f644414e620 2023-10-16T13:46:59.300 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:46:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f642806b140 msgr2=0x7f642806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f642806b140 0x7f642806d600 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6438009fd0 tx=0x7f6438009210 comp rx=0 tx=0).stop 2023-10-16T13:46:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 msgr2=0x7f64440b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 0x7f64440b2020 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6430001050 tx=0x7f64300075f0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 shutdown_connections 2023-10-16T13:46:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64440b2560 0x7f644406b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f642806b140 0x7f642806d600 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64441f26c0 0x7f64440b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 --2- 172.21.15.5:0/2230098773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f644414e620 0x7f64440b2020 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 >> 172.21.15.5:0/2230098773 conn(0x7f64440665a0 msgr2=0x7f64440c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 shutdown_connections 2023-10-16T13:46:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.299+0000 7f644abec700 1 -- 172.21.15.5:0/2230098773 wait complete. 2023-10-16T13:46:59.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:46:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.439+0000 7f01a8bab700 1 Processor -- start 2023-10-16T13:46:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.439+0000 7f01a8bab700 1 -- start start 2023-10-16T13:46:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a8bab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01a40cd950 0x7f01a415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a8bab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a40cede0 0x7f01a415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a8bab700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01a406a840 0x7f01a406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a8bab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a41619a0 con 0x7f01a40cd950 2023-10-16T13:46:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a8bab700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a406b1f0 con 0x7f01a406a840 2023-10-16T13:46:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a8bab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40cf260 con 0x7f01a40cede0 2023-10-16T13:46:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01a40cd950 0x7f01a415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01a40cd950 0x7f01a415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46226/0 (socket says 172.21.15.5:46226) 2023-10-16T13:46:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 -- 172.21.15.5:0/1966169715 learned_addr learned my addr 172.21.15.5:0/1966169715 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a2d9d700 1 --2- 172.21.15.5:0/1966169715 >> v2:172.21.15.112:3300/0 conn(0x7f01a406a840 0x7f01a406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a1d9b700 1 --2- 172.21.15.5:0/1966169715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a40cede0 0x7f01a415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 -- 172.21.15.5:0/1966169715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a40cede0 msgr2=0x7f01a415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 --2- 172.21.15.5:0/1966169715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a40cede0 0x7f01a415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 -- 172.21.15.5:0/1966169715 >> v2:172.21.15.112:3300/0 conn(0x7f01a406a840 msgr2=0x7f01a406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 --2- 172.21.15.5:0/1966169715 >> v2:172.21.15.112:3300/0 conn(0x7f01a406a840 0x7f01a406acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.440+0000 7f01a259c700 1 -- 172.21.15.5:0/1966169715 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40b2d60 con 0x7f01a40cd950 2023-10-16T13:46:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a259c700 1 --2- 172.21.15.5:0/1966169715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cd950 0x7f01a415e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f01a406ebc0 tx=0x7f0198009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88ef2af1f8511cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a159a700 1 -- 172.21.15.5:0/1966169715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198011830 con 0x7f01a40cd950 2023-10-16T13:46:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a159a700 1 -- 172.21.15.5:0/1966169715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198011990 con 0x7f01a40cd950 2023-10-16T13:46:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a159a700 1 -- 172.21.15.5:0/1966169715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198011d20 con 0x7f01a40cd950 2023-10-16T13:46:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 -- 172.21.15.5:0/1966169715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cd950 msgr2=0x7f01a415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 --2- 172.21.15.5:0/1966169715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cd950 0x7f01a415e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f01a406ebc0 tx=0x7f0198009bd0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 -- 172.21.15.5:0/1966169715 shutdown_connections 2023-10-16T13:46:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 --2- 172.21.15.5:0/1966169715 >> v2:172.21.15.112:3300/0 conn(0x7f01a406a840 0x7f01a406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 --2- 172.21.15.5:0/1966169715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cd950 0x7f01a415e2f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 --2- 172.21.15.5:0/1966169715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a40cede0 0x7f01a415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 -- 172.21.15.5:0/1966169715 >> 172.21.15.5:0/1966169715 conn(0x7f01a406dae0 msgr2=0x7f01a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 -- 172.21.15.5:0/1966169715 shutdown_connections 2023-10-16T13:46:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.441+0000 7f01a8bab700 1 -- 172.21.15.5:0/1966169715 wait complete. 2023-10-16T13:46:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.443+0000 7f01a8bab700 1 Processor -- start 2023-10-16T13:46:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.443+0000 7f01a8bab700 1 -- start start 2023-10-16T13:46:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a8bab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a406a840 0x7f01a41f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a8bab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a40cd950 0x7f01a41541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a8bab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 0x7f01a4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a8bab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41f7af0 con 0x7f01a40cede0 2023-10-16T13:46:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a8bab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4156530 con 0x7f01a40cd950 2023-10-16T13:46:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a8bab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4155f70 con 0x7f01a406a840 2023-10-16T13:46:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 0x7f01a4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 0x7f01a4153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46236/0 (socket says 172.21.15.5:46236) 2023-10-16T13:46:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.444+0000 7f01a2d9d700 1 -- 172.21.15.5:0/2464062844 learned_addr learned my addr 172.21.15.5:0/2464062844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a259c700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a406a840 0x7f01a41f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a1d9b700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a40cd950 0x7f01a41541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a2d9d700 1 -- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a406a840 msgr2=0x7f01a41f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a2d9d700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a406a840 0x7f01a41f75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a2d9d700 1 -- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a40cd950 msgr2=0x7f01a41541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a2d9d700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a40cd950 0x7f01a41541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a2d9d700 1 -- 172.21.15.5:0/2464062844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009550 con 0x7f01a40cede0 2023-10-16T13:46:59.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a2d9d700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 0x7f01a4153550 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f019c00eed0 tx=0x7f019c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c010040 con 0x7f01a40cede0 2023-10-16T13:46:59.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00bd30 con 0x7f01a40cede0 2023-10-16T13:46:59.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a4156250 con 0x7f01a40cede0 2023-10-16T13:46:59.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c009ea0 con 0x7f01a40cede0 2023-10-16T13:46:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.445+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a40c7920 con 0x7f01a40cede0 2023-10-16T13:46:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.446+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40c7b40 con 0x7f01a40cede0 2023-10-16T13:46:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.447+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f019c014640 con 0x7f01a40cede0 2023-10-16T13:46:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.447+0000 7f0192ffd700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f018406b140 0x7f018406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.447+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f019c08a160 con 0x7f01a40cede0 2023-10-16T13:46:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.447+0000 7f01a259c700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f018406b140 0x7f018406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.448+0000 7f01a259c700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f018406b140 0x7f018406d600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0198009c10 tx=0x7f0198008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.452+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f019c054d60 con 0x7f01a40cede0 2023-10-16T13:46:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.652+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01a4067d20 con 0x7f01a40cede0 2023-10-16T13:46:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.653+0000 7f0192ffd700 1 -- 172.21.15.5:0/2464062844 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f019c058380 con 0x7f01a40cede0 2023-10-16T13:46:59.656 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:46:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f018406b140 msgr2=0x7f018406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f018406b140 0x7f018406d600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0198009c10 tx=0x7f0198008030 comp rx=0 tx=0).stop 2023-10-16T13:46:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 msgr2=0x7f01a4153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 0x7f01a4153550 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f019c00eed0 tx=0x7f019c00b390 comp rx=0 tx=0).stop 2023-10-16T13:46:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 shutdown_connections 2023-10-16T13:46:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40cede0 0x7f01a4153550 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f018406b140 0x7f018406d600 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01a406a840 0x7f01a41f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 --2- 172.21.15.5:0/2464062844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01a40cd950 0x7f01a41541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 >> 172.21.15.5:0/2464062844 conn(0x7f01a406dae0 msgr2=0x7f01a406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 shutdown_connections 2023-10-16T13:46:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.655+0000 7f01a8bab700 1 -- 172.21.15.5:0/2464062844 wait complete. 2023-10-16T13:46:59.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:46:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.794+0000 7f580f102700 1 Processor -- start 2023-10-16T13:46:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.795+0000 7f580f102700 1 -- start start 2023-10-16T13:46:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.795+0000 7f580f102700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815ab10 0x7f580815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.795+0000 7f580f102700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58080cfe30 0x7f58080cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.795+0000 7f580f102700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580815e7a0 con 0x7f58080b1f50 2023-10-16T13:46:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.795+0000 7f580f102700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580815f730 con 0x7f58080cfe30 2023-10-16T13:46:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.795+0000 7f580f102700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b29a0 con 0x7f580815ab10 2023-10-16T13:46:59.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f5807fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f58080b1f50 0x7f58080cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56244/0 (socket says 172.21.15.5:56244) 2023-10-16T13:46:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f5807fff700 1 -- 172.21.15.5:0/1430581362 learned_addr learned my addr 172.21.15.5:0/1430581362 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:46:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f580ce9e700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815ab10 0x7f580815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f580d69f700 1 --2- 172.21.15.5:0/1430581362 >> v2:172.21.15.112:3300/0 conn(0x7f58080cfe30 0x7f58080cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405866945 0 0) 0x7f580815e7a0 con 0x7f58080b1f50 2023-10-16T13:46:59.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f80035b0 con 0x7f58080b1f50 2023-10-16T13:46:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129870775 0 0) 0x7f57f80035b0 con 0x7f58080b1f50 2023-10-16T13:46:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815ab10 msgr2=0x7f580815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815ab10 0x7f580815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 >> v2:172.21.15.112:3300/0 conn(0x7f58080cfe30 msgr2=0x7f58080cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 --2- 172.21.15.5:0/1430581362 >> v2:172.21.15.112:3300/0 conn(0x7f58080cfe30 0x7f58080cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080b2c80 con 0x7f58080b1f50 2023-10-16T13:46:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f57f40017f0 con 0x7f58080b1f50 2023-10-16T13:46:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 >> v1:172.21.15.5:6789/0 conn(0x7f58080b1f50 legacy=0x7f58080cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f8003a00 0x7f57f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f80043f0 0x7f57f80048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57f8004f40 0x7f57f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580815f730 con 0x7f57f80043f0 2023-10-16T13:46:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b29a0 con 0x7f57f8004f40 2023-10-16T13:46:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f800bf50 con 0x7f57f8003a00 2023-10-16T13:46:59.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f580ce9e700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815ab10 0x7f580815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:46:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f5807fff700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f80043f0 0x7f57f80048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f580d69f700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57f8004f40 0x7f57f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.796+0000 7f580ce9e700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f8003a00 0x7f57f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f5807fff700 1 -- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f8003a00 msgr2=0x7f57f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f5807fff700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f8003a00 0x7f57f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f5807fff700 1 -- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57f8004f40 msgr2=0x7f57f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:46:59.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f5807fff700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57f8004f40 0x7f57f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f5807fff700 1 -- 172.21.15.5:0/1430581362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80035b0 con 0x7f57f80043f0 2023-10-16T13:46:59.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f5807fff700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f80043f0 0x7f57f80048d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c320 tx=0x7f57f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf83f56282b9bb52 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400ce60 con 0x7f57f80043f0 2023-10-16T13:46:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f4007bf0 con 0x7f57f80043f0 2023-10-16T13:46:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f58077fe700 1 -- 172.21.15.5:0/1430581362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40072f0 con 0x7f57f80043f0 2023-10-16T13:46:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f580f102700 1 -- 172.21.15.5:0/1430581362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f80043f0 msgr2=0x7f57f80048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f580f102700 1 --2- 172.21.15.5:0/1430581362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f80043f0 0x7f57f80048d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c320 tx=0x7f57f8005880 comp rx=0 tx=0).stop 2023-10-16T13:46:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f580d69f700 1 -- 172.21.15.5:0/1430581362 reap_dead start 2023-10-16T13:46:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f580f102700 1 -- 172.21.15.5:0/1430581362 shutdown_connections 2023-10-16T13:46:59.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.797+0000 7f580f102700 1 -- 172.21.15.5:0/1430581362 >> 172.21.15.5:0/1430581362 conn(0x7f580806dae0 msgr2=0x7f580806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:46:59.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.798+0000 7f580f102700 1 -- 172.21.15.5:0/1430581362 shutdown_connections 2023-10-16T13:46:59.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.798+0000 7f580f102700 1 -- 172.21.15.5:0/1430581362 wait complete. 2023-10-16T13:46:59.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.799+0000 7f580f102700 1 Processor -- start 2023-10-16T13:46:59.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.799+0000 7f580f102700 1 -- start start 2023-10-16T13:46:59.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f80043f0 0x7f5808153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 0x7f58080cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080ad1a0 0x7f58080ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cd7b0 con 0x7f58080ccdf0 2023-10-16T13:46:59.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5808153f50 con 0x7f58080ad1a0 2023-10-16T13:46:59.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b40a0 con 0x7f57f80043f0 2023-10-16T13:46:59.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 0x7f58080cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 0x7f58080cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46254/0 (socket says 172.21.15.5:46254) 2023-10-16T13:46:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 -- 172.21.15.5:0/3636556332 learned_addr learned my addr 172.21.15.5:0/3636556332 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:46:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580ce9e700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f80043f0 0x7f5808153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580d69f700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080ad1a0 0x7f58080ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 -- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f80043f0 msgr2=0x7f5808153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f80043f0 0x7f5808153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 -- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080ad1a0 msgr2=0x7f58080ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:46:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080ad1a0 0x7f58080ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:46:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 -- 172.21.15.5:0/3636556332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080b4380 con 0x7f58080ccdf0 2023-10-16T13:46:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f5807fff700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 0x7f58080cd270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f57f4015040 tx=0x7f57f4001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4005d40 con 0x7f58080ccdf0 2023-10-16T13:46:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f40070d0 con 0x7f58080ccdf0 2023-10-16T13:46:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4005ea0 con 0x7f58080ccdf0 2023-10-16T13:46:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080b4660 con 0x7f58080ccdf0 2023-10-16T13:46:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.800+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58080b4c20 con 0x7f58080ccdf0 2023-10-16T13:46:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.801+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080b4db0 con 0x7f58080ccdf0 2023-10-16T13:46:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.802+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f57f4007480 con 0x7f58080ccdf0 2023-10-16T13:46:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.802+0000 7f58057fa700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57ec06b140 0x7f57ec06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:46:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.802+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f57f408aaa0 con 0x7f58080ccdf0 2023-10-16T13:46:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.802+0000 7f580ce9e700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57ec06b140 0x7f57ec06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:46:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.803+0000 7f580ce9e700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57ec06b140 0x7f57ec06d600 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f58080d0430 tx=0x7f57fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:46:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:46:59.807+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57f4055840 con 0x7f58080ccdf0 2023-10-16T13:47:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.010+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5808067d20 con 0x7f58080ccdf0 2023-10-16T13:47:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.010+0000 7f58057fa700 1 -- 172.21.15.5:0/3636556332 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57f4058e60 con 0x7f58080ccdf0 2023-10-16T13:47:00.013 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:47:00.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57ec06b140 msgr2=0x7f57ec06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57ec06b140 0x7f57ec06d600 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f58080d0430 tx=0x7f57fc008040 comp rx=0 tx=0).stop 2023-10-16T13:47:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 msgr2=0x7f58080cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 0x7f58080cd270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f57f4015040 tx=0x7f57f4001bf0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 shutdown_connections 2023-10-16T13:47:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080ad1a0 0x7f58080ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57ec06b140 0x7f57ec06d600 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f57f80043f0 0x7f5808153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 --2- 172.21.15.5:0/3636556332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080ccdf0 0x7f58080cd270 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 >> 172.21.15.5:0/3636556332 conn(0x7f580806dae0 msgr2=0x7f58080b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:00.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 shutdown_connections 2023-10-16T13:47:00.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.012+0000 7f580f102700 1 -- 172.21.15.5:0/3636556332 wait complete. 2023-10-16T13:47:00.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:47:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.150+0000 7fac4fffd700 1 Processor -- start 2023-10-16T13:47:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.151+0000 7fac4fffd700 1 -- start start 2023-10-16T13:47:00.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.151+0000 7fac4fffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac480cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.151+0000 7fac4fffd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac480ce3b0 con 0x7fac480b2940 2023-10-16T13:47:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.151+0000 7fac4fffd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac480b6290 con 0x7fac4815a850 2023-10-16T13:47:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.151+0000 7fac4fffd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac480cc220 con 0x7fac480cd4b0 2023-10-16T13:47:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4e59a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac480b2940 0x7fac480ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56268/0 (socket says 172.21.15.5:56268) 2023-10-16T13:47:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4e59a700 1 -- 172.21.15.5:0/731321809 learned_addr learned my addr 172.21.15.5:0/731321809 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4d598700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac480cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488723132 0 0) 0x7fac480ce3b0 con 0x7fac480b2940 2023-10-16T13:47:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac340057c0 con 0x7fac480b2940 2023-10-16T13:47:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1772484030 0 0) 0x7fac340057c0 con 0x7fac480b2940 2023-10-16T13:47:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 msgr2=0x7fac480cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac480cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 >> v1:172.21.15.112:6789/0 conn(0x7fac4815a850 legacy=0x7fac480ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480cc500 con 0x7fac480b2940 2023-10-16T13:47:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fac400019f0 con 0x7fac480b2940 2023-10-16T13:47:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 >> v1:172.21.15.5:6789/0 conn(0x7fac480b2940 legacy=0x7fac480ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac34005c40 0x7fac34006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac34006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac34007460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480cc220 con 0x7fac34006a60 2023-10-16T13:47:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3400dd80 con 0x7fac34005c40 2023-10-16T13:47:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3400df40 con 0x7fac480cd4b0 2023-10-16T13:47:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4d598700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac34006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4dd99700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac34005c40 0x7fac34006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.152+0000 7fac4e59a700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac34007460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4d598700 1 -- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 msgr2=0x7fac34007460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4d598700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac34007460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4d598700 1 -- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac34005c40 msgr2=0x7fac34006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4d598700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac34005c40 0x7fac34006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4d598700 1 -- 172.21.15.5:0/731321809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340057c0 con 0x7fac34006a60 2023-10-16T13:47:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4dd99700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac34005c40 0x7fac34006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4e59a700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac480cd4b0 0x7fac34007460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4d598700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac34006ee0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fac44009b60 tx=0x7fac34007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b128903877895cbe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4400e6c0 con 0x7fac34006a60 2023-10-16T13:47:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4400e820 con 0x7fac34006a60 2023-10-16T13:47:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4cd97700 1 -- 172.21.15.5:0/731321809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4400eb90 con 0x7fac34006a60 2023-10-16T13:47:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4fffd700 1 -- 172.21.15.5:0/731321809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 msgr2=0x7fac34006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4fffd700 1 --2- 172.21.15.5:0/731321809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac34006ee0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fac44009b60 tx=0x7fac34007a90 comp rx=0 tx=0).stop 2023-10-16T13:47:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4e59a700 1 -- 172.21.15.5:0/731321809 reap_dead start 2023-10-16T13:47:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4fffd700 1 -- 172.21.15.5:0/731321809 shutdown_connections 2023-10-16T13:47:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.153+0000 7fac4fffd700 1 -- 172.21.15.5:0/731321809 >> 172.21.15.5:0/731321809 conn(0x7fac4806dac0 msgr2=0x7fac4806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.154+0000 7fac4fffd700 1 -- 172.21.15.5:0/731321809 shutdown_connections 2023-10-16T13:47:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.154+0000 7fac4fffd700 1 -- 172.21.15.5:0/731321809 wait complete. 2023-10-16T13:47:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 Processor -- start 2023-10-16T13:47:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 -- start start 2023-10-16T13:47:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac480c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac480ca0b0 0x7fac481f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac481f3510 0x7fac481f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4815bf10 con 0x7fac34006a60 2023-10-16T13:47:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481f3ed0 con 0x7fac480ca0b0 2023-10-16T13:47:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.155+0000 7fac4fffd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4815c0a0 con 0x7fac481f3510 2023-10-16T13:47:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac480c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac480c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46272/0 (socket says 172.21.15.5:46272) 2023-10-16T13:47:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 -- 172.21.15.5:0/633143395 learned_addr learned my addr 172.21.15.5:0/633143395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4d598700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac480ca0b0 0x7fac481f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4e59a700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac481f3510 0x7fac481f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 -- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac481f3510 msgr2=0x7fac481f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac481f3510 0x7fac481f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 -- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac480ca0b0 msgr2=0x7fac481f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac480ca0b0 0x7fac481f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 -- 172.21.15.5:0/633143395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480c7ef0 con 0x7fac34006a60 2023-10-16T13:47:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4d598700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac480ca0b0 0x7fac481f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4dd99700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac480c7580 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fac3800e7e0 tx=0x7fac3800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380052e0 con 0x7fac34006a60 2023-10-16T13:47:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac38005440 con 0x7fac34006a60 2023-10-16T13:47:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380038a0 con 0x7fac34006a60 2023-10-16T13:47:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac480c81d0 con 0x7fac34006a60 2023-10-16T13:47:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.156+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac480c8790 con 0x7fac34006a60 2023-10-16T13:47:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.157+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac48067d20 con 0x7fac34006a60 2023-10-16T13:47:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.158+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fac38003a00 con 0x7fac34006a60 2023-10-16T13:47:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.158+0000 7fac3e7fc700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fac2c06b140 0x7fac2c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.158+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fac380897a0 con 0x7fac34006a60 2023-10-16T13:47:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.158+0000 7fac4d598700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fac2c06b140 0x7fac2c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.159+0000 7fac4d598700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fac2c06b140 0x7fac2c06d600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fac440090b0 tx=0x7fac44008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.163+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac380544b0 con 0x7fac34006a60 2023-10-16T13:47:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.376+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac480cb820 con 0x7fac34006a60 2023-10-16T13:47:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.377+0000 7fac3e7fc700 1 -- 172.21.15.5:0/633143395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac38001310 con 0x7fac34006a60 2023-10-16T13:47:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fac2c06b140 msgr2=0x7fac2c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fac2c06b140 0x7fac2c06d600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fac440090b0 tx=0x7fac44008030 comp rx=0 tx=0).stop 2023-10-16T13:47:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 msgr2=0x7fac480c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac480c7580 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fac3800e7e0 tx=0x7fac3800eba0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 shutdown_connections 2023-10-16T13:47:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fac2c06b140 0x7fac2c06d600 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac481f3510 0x7fac481f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac34006a60 0x7fac480c7580 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 --2- 172.21.15.5:0/633143395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac480ca0b0 0x7fac481f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 >> 172.21.15.5:0/633143395 conn(0x7fac4806dac0 msgr2=0x7fac48159760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 shutdown_connections 2023-10-16T13:47:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.379+0000 7fac4fffd700 1 -- 172.21.15.5:0/633143395 wait complete. 2023-10-16T13:47:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:47:00.393 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:47:00.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:00.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:00.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:47:00.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:00.438 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:47:00.497 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:00.497 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:00.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:47:00.516 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:00.516 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:00.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:47:00.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.677+0000 7eff2a146700 1 Processor -- start 2023-10-16T13:47:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff2a146700 1 -- start start 2023-10-16T13:47:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff2a146700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff2415f050 0x7eff240cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff2a146700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff240d0530 0x7eff2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff2a146700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff240b0a80 con 0x7eff240b0580 2023-10-16T13:47:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff2a146700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff240ccee0 con 0x7eff2415f050 2023-10-16T13:47:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff2a146700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff240cd1c0 con 0x7eff240d0530 2023-10-16T13:47:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.678+0000 7eff237fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff2415f050 0x7eff240cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff2415f050 0x7eff240cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46280/0 (socket says 172.21.15.5:46280) 2023-10-16T13:47:00.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 -- 172.21.15.5:0/3198320871 learned_addr learned my addr 172.21.15.5:0/3198320871 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff23fff700 1 --2- 172.21.15.5:0/3198320871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff240d0530 0x7eff2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 -- 172.21.15.5:0/3198320871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff240d0530 msgr2=0x7eff2406ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 --2- 172.21.15.5:0/3198320871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff240d0530 0x7eff2406ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 -- 172.21.15.5:0/3198320871 >> v1:172.21.15.112:6789/0 conn(0x7eff240b0580 legacy=0x7eff240ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 -- 172.21.15.5:0/3198320871 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240cd4a0 con 0x7eff2415f050 2023-10-16T13:47:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff237fe700 1 --2- 172.21.15.5:0/3198320871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2415f050 0x7eff240cdba0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7eff140098f0 tx=0x7eff14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31768fe9f825024 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff227fc700 1 -- 172.21.15.5:0/3198320871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14004230 con 0x7eff2415f050 2023-10-16T13:47:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff227fc700 1 -- 172.21.15.5:0/3198320871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14004390 con 0x7eff2415f050 2023-10-16T13:47:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.679+0000 7eff227fc700 1 -- 172.21.15.5:0/3198320871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140036a0 con 0x7eff2415f050 2023-10-16T13:47:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 -- 172.21.15.5:0/3198320871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2415f050 msgr2=0x7eff240cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 --2- 172.21.15.5:0/3198320871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2415f050 0x7eff240cdba0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7eff140098f0 tx=0x7eff14009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 -- 172.21.15.5:0/3198320871 shutdown_connections 2023-10-16T13:47:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 --2- 172.21.15.5:0/3198320871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff240d0530 0x7eff2406ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 --2- 172.21.15.5:0/3198320871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2415f050 0x7eff240cdba0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 -- 172.21.15.5:0/3198320871 >> 172.21.15.5:0/3198320871 conn(0x7eff240d1620 msgr2=0x7eff240d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 -- 172.21.15.5:0/3198320871 shutdown_connections 2023-10-16T13:47:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.680+0000 7eff2a146700 1 -- 172.21.15.5:0/3198320871 wait complete. 2023-10-16T13:47:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.681+0000 7eff2a146700 1 Processor -- start 2023-10-16T13:47:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.681+0000 7eff2a146700 1 -- start start 2023-10-16T13:47:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff2a146700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff240b0580 0x7eff2415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff2a146700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff2415f050 0x7eff240b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff2a146700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 0x7eff240ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff2a146700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff240b2cb0 con 0x7eff240b2800 2023-10-16T13:47:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff2a146700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff241f7270 con 0x7eff240b0580 2023-10-16T13:47:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff2a146700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff241f6660 con 0x7eff2415f050 2023-10-16T13:47:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 0x7eff240ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 0x7eff240ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46290/0 (socket says 172.21.15.5:46290) 2023-10-16T13:47:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 -- 172.21.15.5:0/3725494100 learned_addr learned my addr 172.21.15.5:0/3725494100 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff237fe700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff240b0580 0x7eff2415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff22ffd700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff2415f050 0x7eff240b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 -- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff2415f050 msgr2=0x7eff240b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff2415f050 0x7eff240b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 -- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff240b0580 msgr2=0x7eff2415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff240b0580 0x7eff2415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 -- 172.21.15.5:0/3725494100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009550 con 0x7eff240b2800 2023-10-16T13:47:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff22ffd700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff2415f050 0x7eff240b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.682+0000 7eff23fff700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 0x7eff240ca4b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00cd40 tx=0x7eff1c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.683+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00ce90 con 0x7eff240b2800 2023-10-16T13:47:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.683+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c003a20 con 0x7eff240b2800 2023-10-16T13:47:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.683+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff241f6940 con 0x7eff240b2800 2023-10-16T13:47:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.683+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c003db0 con 0x7eff240b2800 2023-10-16T13:47:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.683+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff241f6f00 con 0x7eff240b2800 2023-10-16T13:47:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.684+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff241f73b0 con 0x7eff240b2800 2023-10-16T13:47:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.684+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7eff1c003f30 con 0x7eff240b2800 2023-10-16T13:47:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.684+0000 7eff0bfff700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1006b140 0x7eff1006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.685+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7eff1c012070 con 0x7eff240b2800 2023-10-16T13:47:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.685+0000 7eff237fe700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1006b140 0x7eff1006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.685+0000 7eff237fe700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1006b140 0x7eff1006d600 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff14009130 tx=0x7eff14008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.689+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff241f73b0 con 0x7eff240b2800 2023-10-16T13:47:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.938+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff241f73b0 con 0x7eff240b2800 2023-10-16T13:47:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.938+0000 7eff0bfff700 1 -- 172.21.15.5:0/3725494100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4912 (secure 0 0 0) 0x7eff241f73b0 con 0x7eff240b2800 2023-10-16T13:47:00.941 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:00.942 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:39.225095+0000","modified":"2023-10-16T13:40:42.262157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/2729748635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2729748635},{"type":"v1","addr":"172.21.15.112:6836","nonce":2729748635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-16T13:47:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1006b140 msgr2=0x7eff1006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1006b140 0x7eff1006d600 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff14009130 tx=0x7eff14008030 comp rx=0 tx=0).stop 2023-10-16T13:47:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 msgr2=0x7eff240ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 0x7eff240ca4b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00cd40 tx=0x7eff1c00a570 comp rx=0 tx=0).stop 2023-10-16T13:47:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 shutdown_connections 2023-10-16T13:47:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff240b2800 0x7eff240ca4b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff240b0580 0x7eff2415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7eff1006b140 0x7eff1006d600 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 --2- 172.21.15.5:0/3725494100 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff2415f050 0x7eff240b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 >> 172.21.15.5:0/3725494100 conn(0x7eff240d1620 msgr2=0x7eff240ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 shutdown_connections 2023-10-16T13:47:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:00.940+0000 7eff2a146700 1 -- 172.21.15.5:0/3725494100 wait complete. 2023-10-16T13:47:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2023-10-16T13:47:00.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.077+0000 7fc8ffeb1700 1 Processor -- start 2023-10-16T13:47:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.077+0000 7fc8ffeb1700 1 -- start start 2023-10-16T13:47:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8ffeb1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8f815b740 0x7fc8f80d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8ffeb1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f80ce6e0 0x7fc8f80cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8ffeb1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f80cf190 con 0x7fc8f80d0c70 2023-10-16T13:47:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8ffeb1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f815bb20 con 0x7fc8f80ce6e0 2023-10-16T13:47:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8ffeb1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80cbd40 con 0x7fc8f815b740 2023-10-16T13:47:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8fe44e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f80ce6e0 0x7fc8f80cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8fe44e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f80ce6e0 0x7fc8f80cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46298/0 (socket says 172.21.15.5:46298) 2023-10-16T13:47:01.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8fe44e700 1 -- 172.21.15.5:0/3735696048 learned_addr learned my addr 172.21.15.5:0/3735696048 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:01.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.078+0000 7fc8fdc4d700 1 --2- 172.21.15.5:0/3735696048 >> v2:172.21.15.112:3300/0 conn(0x7fc8f815b740 0x7fc8f80d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fe44e700 1 -- 172.21.15.5:0/3735696048 >> v2:172.21.15.112:3300/0 conn(0x7fc8f815b740 msgr2=0x7fc8f80d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:01.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fe44e700 1 --2- 172.21.15.5:0/3735696048 >> v2:172.21.15.112:3300/0 conn(0x7fc8f815b740 0x7fc8f80d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fe44e700 1 -- 172.21.15.5:0/3735696048 >> v1:172.21.15.112:6789/0 conn(0x7fc8f80d0c70 legacy=0x7fc8f80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fe44e700 1 -- 172.21.15.5:0/3735696048 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80cc020 con 0x7fc8f80ce6e0 2023-10-16T13:47:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fe44e700 1 --2- 172.21.15.5:0/3735696048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80cf690 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80cee60 tx=0x7fc8f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56abb9376d6c500b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fcc4b700 1 -- 172.21.15.5:0/3735696048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000e070 con 0x7fc8f80ce6e0 2023-10-16T13:47:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fcc4b700 1 -- 172.21.15.5:0/3735696048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0003a20 con 0x7fc8f80ce6e0 2023-10-16T13:47:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8fcc4b700 1 -- 172.21.15.5:0/3735696048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0003dd0 con 0x7fc8f80ce6e0 2023-10-16T13:47:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/3735696048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f80ce6e0 msgr2=0x7fc8f80cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/3735696048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80cf690 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80cee60 tx=0x7fc8f000b330 comp rx=0 tx=0).stop 2023-10-16T13:47:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/3735696048 shutdown_connections 2023-10-16T13:47:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/3735696048 >> v2:172.21.15.112:3300/0 conn(0x7fc8f815b740 0x7fc8f80d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/3735696048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80cf690 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.079+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/3735696048 >> 172.21.15.5:0/3735696048 conn(0x7fc8f80665a0 msgr2=0x7fc8f8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:01.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.080+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/3735696048 shutdown_connections 2023-10-16T13:47:01.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.080+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/3735696048 wait complete. 2023-10-16T13:47:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 Processor -- start 2023-10-16T13:47:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 -- start start 2023-10-16T13:47:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f80d0c70 0x7fc8f80ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 0x7fc8f80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80b7290 con 0x7fc8f815b740 2023-10-16T13:47:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8153dc0 con 0x7fc8f80ce6e0 2023-10-16T13:47:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.081+0000 7fc8ffeb1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80b6fb0 con 0x7fc8f80d0c70 2023-10-16T13:47:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 0x7fc8f80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 0x7fc8f80b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46304/0 (socket says 172.21.15.5:46304) 2023-10-16T13:47:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 -- 172.21.15.5:0/4138007148 learned_addr learned my addr 172.21.15.5:0/4138007148 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fd44c700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f80d0c70 0x7fc8f80ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fdc4d700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 -- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f80d0c70 msgr2=0x7fc8f80ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f80d0c70 0x7fc8f80ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 -- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f80ce6e0 msgr2=0x7fc8f80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 -- 172.21.15.5:0/4138007148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009b30 con 0x7fc8f815b740 2023-10-16T13:47:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8fe44e700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 0x7fc8f80b48c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000b370 tx=0x7fc8f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0004440 con 0x7fc8f815b740 2023-10-16T13:47:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f00092e0 con 0x7fc8f815b740 2023-10-16T13:47:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f80c98d0 con 0x7fc8f815b740 2023-10-16T13:47:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0004800 con 0x7fc8f815b740 2023-10-16T13:47:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.082+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f80c9e90 con 0x7fc8f815b740 2023-10-16T13:47:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.083+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f8067d20 con 0x7fc8f815b740 2023-10-16T13:47:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.084+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fc8f0012430 con 0x7fc8f815b740 2023-10-16T13:47:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.084+0000 7fc8ee7fc700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8dc06b140 0x7fc8dc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.084+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc8f008adf0 con 0x7fc8f815b740 2023-10-16T13:47:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.084+0000 7fc8fdc4d700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8dc06b140 0x7fc8dc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.085+0000 7fc8fdc4d700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8dc06b140 0x7fc8dc06d600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4006b20 tx=0x7fc8f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.089+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8f0055a80 con 0x7fc8f815b740 2023-10-16T13:47:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.291+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f8153ff0 con 0x7fc8f815b740 2023-10-16T13:47:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.293+0000 7fc8ee7fc700 1 -- 172.21.15.5:0/4138007148 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fc8f0017090 con 0x7fc8f815b740 2023-10-16T13:47:01.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:01.296 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:41:09.641898+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:01.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8dc06b140 msgr2=0x7fc8dc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8dc06b140 0x7fc8dc06d600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4006b20 tx=0x7fc8f4008040 comp rx=0 tx=0).stop 2023-10-16T13:47:01.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 msgr2=0x7fc8f80b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 0x7fc8f80b48c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000b370 tx=0x7fc8f0004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 shutdown_connections 2023-10-16T13:47:01.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f815b740 0x7fc8f80b48c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f80ce6e0 0x7fc8f80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc8dc06b140 0x7fc8dc06d600 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 --2- 172.21.15.5:0/4138007148 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f80d0c70 0x7fc8f80ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 >> 172.21.15.5:0/4138007148 conn(0x7fc8f80665a0 msgr2=0x7fc8f806eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 shutdown_connections 2023-10-16T13:47:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.295+0000 7fc8ffeb1700 1 -- 172.21.15.5:0/4138007148 wait complete. 2023-10-16T13:47:01.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:40:37.717414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:40:38.190883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:01.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.436+0000 7f77ab71e700 1 Processor -- start 2023-10-16T13:47:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.436+0000 7f77ab71e700 1 -- start start 2023-10-16T13:47:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77ab71e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a415ab10 0x7f77a415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77ab71e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a40b1f50 0x7f77a40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77ab71e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a415e7a0 con 0x7f77a40b23d0 2023-10-16T13:47:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77ab71e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a415f730 con 0x7f77a415ab10 2023-10-16T13:47:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77ab71e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40b29a0 con 0x7f77a40b1f50 2023-10-16T13:47:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77a94ba700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a415ab10 0x7f77a415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77a94ba700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a415ab10 0x7f77a415f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46308/0 (socket says 172.21.15.5:46308) 2023-10-16T13:47:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.437+0000 7f77a94ba700 1 -- 172.21.15.5:0/2573153640 learned_addr learned my addr 172.21.15.5:0/2573153640 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f77a8cb9700 1 --2- 172.21.15.5:0/2573153640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a40b1f50 0x7f77a40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f77a94ba700 1 -- 172.21.15.5:0/2573153640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a40b1f50 msgr2=0x7f77a40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f77a94ba700 1 --2- 172.21.15.5:0/2573153640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a40b1f50 0x7f77a40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f77a94ba700 1 -- 172.21.15.5:0/2573153640 >> v1:172.21.15.112:6789/0 conn(0x7f77a40b23d0 legacy=0x7f77a40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f77a94ba700 1 -- 172.21.15.5:0/2573153640 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40b2c80 con 0x7f77a415ab10 2023-10-16T13:47:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f77a94ba700 1 --2- 172.21.15.5:0/2573153640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a415ab10 0x7f77a415f1f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f77940098f0 tx=0x7f7794009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd1f8edd115881a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f779bfff700 1 -- 172.21.15.5:0/2573153640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400b8a0 con 0x7f77a415ab10 2023-10-16T13:47:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f779bfff700 1 -- 172.21.15.5:0/2573153640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400ba00 con 0x7f77a415ab10 2023-10-16T13:47:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.438+0000 7f779bfff700 1 -- 172.21.15.5:0/2573153640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400bd90 con 0x7f77a415ab10 2023-10-16T13:47:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 -- 172.21.15.5:0/2573153640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a415ab10 msgr2=0x7f77a415f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 --2- 172.21.15.5:0/2573153640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a415ab10 0x7f77a415f1f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f77940098f0 tx=0x7f7794009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 -- 172.21.15.5:0/2573153640 shutdown_connections 2023-10-16T13:47:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 --2- 172.21.15.5:0/2573153640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a415ab10 0x7f77a415f1f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 --2- 172.21.15.5:0/2573153640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a40b1f50 0x7f77a40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 -- 172.21.15.5:0/2573153640 >> 172.21.15.5:0/2573153640 conn(0x7f77a406dae0 msgr2=0x7f77a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 -- 172.21.15.5:0/2573153640 shutdown_connections 2023-10-16T13:47:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.439+0000 7f77ab71e700 1 -- 172.21.15.5:0/2573153640 wait complete. 2023-10-16T13:47:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.440+0000 7f77ab71e700 1 Processor -- start 2023-10-16T13:47:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.440+0000 7f77ab71e700 1 -- start start 2023-10-16T13:47:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a40b1f50 0x7f77a40ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 0x7f77a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a415ab10 0x7f77a406ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40ad5f0 con 0x7f77a40b23d0 2023-10-16T13:47:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40ac9e0 con 0x7f77a40b1f50 2023-10-16T13:47:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40accc0 con 0x7f77a415ab10 2023-10-16T13:47:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 0x7f77a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 0x7f77a406a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46316/0 (socket says 172.21.15.5:46316) 2023-10-16T13:47:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 -- 172.21.15.5:0/3482285829 learned_addr learned my addr 172.21.15.5:0/3482285829 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a9cbb700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a415ab10 0x7f77a406ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a94ba700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a40b1f50 0x7f77a40ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 -- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a415ab10 msgr2=0x7f77a406ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a415ab10 0x7f77a406ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 -- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a40b1f50 msgr2=0x7f77a40ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a40b1f50 0x7f77a40ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 -- 172.21.15.5:0/3482285829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009550 con 0x7f77a40b23d0 2023-10-16T13:47:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77a8cb9700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 0x7f77a406a840 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f77a000d7d0 tx=0x7f77a000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00125f0 con 0x7f77a40b23d0 2023-10-16T13:47:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0012750 con 0x7f77a40b23d0 2023-10-16T13:47:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.441+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40acfa0 con 0x7f77a40b23d0 2023-10-16T13:47:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.442+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0012b00 con 0x7f77a40b23d0 2023-10-16T13:47:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.442+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a40ae660 con 0x7f77a40b23d0 2023-10-16T13:47:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.443+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a40b6110 con 0x7f77a40b23d0 2023-10-16T13:47:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.443+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f77a0012c60 con 0x7f77a40b23d0 2023-10-16T13:47:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.443+0000 7f7799ffb700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f778806b140 0x7f778806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.444+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f77a0089a90 con 0x7f77a40b23d0 2023-10-16T13:47:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.444+0000 7f77a94ba700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f778806b140 0x7f778806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.444+0000 7f77a94ba700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f778806b140 0x7f778806d600 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7794009c40 tx=0x7f7794008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.448+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77a0054830 con 0x7f77a40b23d0 2023-10-16T13:47:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.648+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77a4067d20 con 0x7f77a40b23d0 2023-10-16T13:47:01.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.648+0000 7f7799ffb700 1 -- 172.21.15.5:0/3482285829 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77a0057e50 con 0x7f77a40b23d0 2023-10-16T13:47:01.651 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f778806b140 msgr2=0x7f778806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f778806b140 0x7f778806d600 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7794009c40 tx=0x7f7794008030 comp rx=0 tx=0).stop 2023-10-16T13:47:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 msgr2=0x7f77a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 0x7f77a406a840 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f77a000d7d0 tx=0x7f77a000db90 comp rx=0 tx=0).stop 2023-10-16T13:47:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 shutdown_connections 2023-10-16T13:47:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f778806b140 0x7f778806d600 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a415ab10 0x7f77a406ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a40b1f50 0x7f77a40ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 --2- 172.21.15.5:0/3482285829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a40b23d0 0x7f77a406a840 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 >> 172.21.15.5:0/3482285829 conn(0x7f77a406dae0 msgr2=0x7f77a406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 shutdown_connections 2023-10-16T13:47:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.650+0000 7f77ab71e700 1 -- 172.21.15.5:0/3482285829 wait complete. 2023-10-16T13:47:01.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:47:01.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.790+0000 7fa29a8f2700 1 Processor -- start 2023-10-16T13:47:01.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.790+0000 7fa29a8f2700 1 -- start start 2023-10-16T13:47:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.790+0000 7fa29a8f2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa2940cd950 0x7fa29415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.790+0000 7fa29a8f2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940cf290 con 0x7fa29406a840 2023-10-16T13:47:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.790+0000 7fa29a8f2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940b2d60 con 0x7fa2940cede0 2023-10-16T13:47:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.790+0000 7fa29a8f2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2941619a0 con 0x7fa2940cd950 2023-10-16T13:47:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa298e8f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa29406a840 0x7fa294161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56330/0 (socket says 172.21.15.5:56330) 2023-10-16T13:47:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa298e8f700 1 -- 172.21.15.5:0/2011052231 learned_addr learned my addr 172.21.15.5:0/2011052231 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa293fff700 1 --2- 172.21.15.5:0/2011052231 >> v2:172.21.15.112:3300/0 conn(0x7fa2940cd950 0x7fa29415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759103044 0 0) 0x7fa2940cf290 con 0x7fa29406a840 2023-10-16T13:47:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27c0035b0 con 0x7fa29406a840 2023-10-16T13:47:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088959315 0 0) 0x7fa27c0035b0 con 0x7fa29406a840 2023-10-16T13:47:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 >> v2:172.21.15.112:3300/0 conn(0x7fa2940cd950 msgr2=0x7fa29415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 --2- 172.21.15.5:0/2011052231 >> v2:172.21.15.112:3300/0 conn(0x7fa2940cd950 0x7fa29415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 >> v1:172.21.15.112:6789/0 conn(0x7fa2940cede0 legacy=0x7fa29415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940cdd30 con 0x7fa29406a840 2023-10-16T13:47:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fa28c0019f0 con 0x7fa29406a840 2023-10-16T13:47:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 >> v1:172.21.15.5:6789/0 conn(0x7fa29406a840 legacy=0x7fa294161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa27c003a00 0x7fa27c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa27c004850 0x7fa27c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c005210 0x7fa27c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2941619a0 con 0x7fa27c004850 2023-10-16T13:47:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00c0b0 con 0x7fa27c005210 2023-10-16T13:47:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00c270 con 0x7fa27c003a00 2023-10-16T13:47:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa2937fe700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa27c004850 0x7fa27c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa293fff700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa27c003a00 0x7fa27c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.791+0000 7fa298e8f700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c005210 0x7fa27c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa2937fe700 1 -- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa27c003a00 msgr2=0x7fa27c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa2937fe700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa27c003a00 0x7fa27c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa2937fe700 1 -- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c005210 msgr2=0x7fa27c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa2937fe700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c005210 0x7fa27c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa2937fe700 1 -- 172.21.15.5:0/2011052231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0035b0 con 0x7fa27c004850 2023-10-16T13:47:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa298e8f700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c005210 0x7fa27c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa298e8f700 1 -- 172.21.15.5:0/2011052231 reap_dead start 2023-10-16T13:47:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa2937fe700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa27c004850 0x7fa27c004cd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa288001820 tx=0x7fa27c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd79fe307259bf30 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880012e0 con 0x7fa27c004850 2023-10-16T13:47:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2880052d0 con 0x7fa27c004850 2023-10-16T13:47:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa292ffd700 1 -- 172.21.15.5:0/2011052231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880036d0 con 0x7fa27c004850 2023-10-16T13:47:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa29a8f2700 1 -- 172.21.15.5:0/2011052231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa27c004850 msgr2=0x7fa27c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa27c004850 0x7fa27c004cd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa288001820 tx=0x7fa27c005880 comp rx=0 tx=0).stop 2023-10-16T13:47:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa29a8f2700 1 -- 172.21.15.5:0/2011052231 shutdown_connections 2023-10-16T13:47:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/2011052231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa27c004850 0x7fa27c004cd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.792+0000 7fa29a8f2700 1 -- 172.21.15.5:0/2011052231 >> 172.21.15.5:0/2011052231 conn(0x7fa29406dae0 msgr2=0x7fa29406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.793+0000 7fa29a8f2700 1 -- 172.21.15.5:0/2011052231 shutdown_connections 2023-10-16T13:47:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.793+0000 7fa29a8f2700 1 -- 172.21.15.5:0/2011052231 wait complete. 2023-10-16T13:47:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.794+0000 7fa29a8f2700 1 Processor -- start 2023-10-16T13:47:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.794+0000 7fa29a8f2700 1 -- start start 2023-10-16T13:47:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa29a8f2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c004850 0x7fa294153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa29a8f2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa29415f630 0x7fa29415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa29a8f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 0x7fa2940c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa29a8f2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29415fff0 con 0x7fa2940c9790 2023-10-16T13:47:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa29a8f2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940ca150 con 0x7fa27c004850 2023-10-16T13:47:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa29a8f2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940adfd0 con 0x7fa29415f630 2023-10-16T13:47:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 0x7fa2940c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 0x7fa2940c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46338/0 (socket says 172.21.15.5:46338) 2023-10-16T13:47:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 -- 172.21.15.5:0/721372192 learned_addr learned my addr 172.21.15.5:0/721372192 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa293fff700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c004850 0x7fa294153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa2937fe700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa29415f630 0x7fa29415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 -- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa29415f630 msgr2=0x7fa29415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa29415f630 0x7fa29415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 -- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c004850 msgr2=0x7fa294153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c004850 0x7fa294153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 -- 172.21.15.5:0/721372192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940aca30 con 0x7fa2940c9790 2023-10-16T13:47:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa298e8f700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 0x7fa2940c9c10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa28c001a20 tx=0x7fa28c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.795+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c017070 con 0x7fa2940c9790 2023-10-16T13:47:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.796+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00eb70 con 0x7fa2940c9790 2023-10-16T13:47:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.796+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2940accf0 con 0x7fa2940c9790 2023-10-16T13:47:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.796+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00ed20 con 0x7fa2940c9790 2023-10-16T13:47:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.796+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940ad2b0 con 0x7fa2940c9790 2023-10-16T13:47:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.797+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa294067d20 con 0x7fa2940c9790 2023-10-16T13:47:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.797+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fa28c013420 con 0x7fa2940c9790 2023-10-16T13:47:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.797+0000 7fa290ff9700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa28006b140 0x7fa28006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.798+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa28c089550 con 0x7fa2940c9790 2023-10-16T13:47:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.798+0000 7fa293fff700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa28006b140 0x7fa28006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.798+0000 7fa293fff700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa28006b140 0x7fa28006d600 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa294160a10 tx=0x7fa284009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:01.802+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa28c054330 con 0x7fa2940c9790 2023-10-16T13:47:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.005+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2940b2630 con 0x7fa2940c9790 2023-10-16T13:47:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.005+0000 7fa290ff9700 1 -- 172.21.15.5:0/721372192 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa28c057950 con 0x7fa2940c9790 2023-10-16T13:47:02.008 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:47:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa28006b140 msgr2=0x7fa28006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa28006b140 0x7fa28006d600 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa294160a10 tx=0x7fa284009210 comp rx=0 tx=0).stop 2023-10-16T13:47:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 msgr2=0x7fa2940c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 0x7fa2940c9c10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa28c001a20 tx=0x7fa28c007c90 comp rx=0 tx=0).stop 2023-10-16T13:47:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 shutdown_connections 2023-10-16T13:47:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2940c9790 0x7fa2940c9c10 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa27c004850 0x7fa294153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa28006b140 0x7fa28006d600 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 --2- 172.21.15.5:0/721372192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa29415f630 0x7fa29415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.007+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 >> 172.21.15.5:0/721372192 conn(0x7fa29406dae0 msgr2=0x7fa294160a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.008+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 shutdown_connections 2023-10-16T13:47:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.008+0000 7fa29a8f2700 1 -- 172.21.15.5:0/721372192 wait complete. 2023-10-16T13:47:02.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.147+0000 7fa55776c700 1 Processor -- start 2023-10-16T13:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.147+0000 7fa55776c700 1 -- start start 2023-10-16T13:47:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa55776c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa55015f1f0 0x7fa5500cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa55776c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa5500cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa55776c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55015e7a0 con 0x7fa55015ab10 2023-10-16T13:47:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa55776c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5500d00d0 con 0x7fa55015f1f0 2023-10-16T13:47:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa55776c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500b29a0 con 0x7fa5500cfc60 2023-10-16T13:47:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa555508700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa55015ab10 0x7fa5500b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56346/0 (socket says 172.21.15.5:56346) 2023-10-16T13:47:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa554d07700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa55015f1f0 0x7fa5500cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.148+0000 7fa555508700 1 -- 172.21.15.5:0/486741457 learned_addr learned my addr 172.21.15.5:0/486741457 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa555d09700 1 --2- 172.21.15.5:0/486741457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa5500cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa554d07700 1 -- 172.21.15.5:0/486741457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 msgr2=0x7fa5500cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa554d07700 1 --2- 172.21.15.5:0/486741457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa5500cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa554d07700 1 -- 172.21.15.5:0/486741457 >> v1:172.21.15.5:6789/0 conn(0x7fa55015ab10 legacy=0x7fa5500b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa547fff700 1 -- 172.21.15.5:0/486741457 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469012918 0 0) 0x7fa55015e7a0 con 0x7fa55015ab10 2023-10-16T13:47:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa554d07700 1 -- 172.21.15.5:0/486741457 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5500b2c80 con 0x7fa55015f1f0 2023-10-16T13:47:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa554d07700 1 --2- 172.21.15.5:0/486741457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015f1f0 0x7fa5500cf720 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009820 tx=0x7fa54c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f7a5cc31716421 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa547fff700 1 -- 172.21.15.5:0/486741457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c005e30 con 0x7fa55015f1f0 2023-10-16T13:47:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa547fff700 1 -- 172.21.15.5:0/486741457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c006030 con 0x7fa55015f1f0 2023-10-16T13:47:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.149+0000 7fa547fff700 1 -- 172.21.15.5:0/486741457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0063e0 con 0x7fa55015f1f0 2023-10-16T13:47:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 -- 172.21.15.5:0/486741457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015f1f0 msgr2=0x7fa5500cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 --2- 172.21.15.5:0/486741457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015f1f0 0x7fa5500cf720 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009820 tx=0x7fa54c009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 -- 172.21.15.5:0/486741457 shutdown_connections 2023-10-16T13:47:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 --2- 172.21.15.5:0/486741457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa5500cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 --2- 172.21.15.5:0/486741457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015f1f0 0x7fa5500cf720 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 -- 172.21.15.5:0/486741457 >> 172.21.15.5:0/486741457 conn(0x7fa55006dae0 msgr2=0x7fa55006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 -- 172.21.15.5:0/486741457 shutdown_connections 2023-10-16T13:47:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.150+0000 7fa55776c700 1 -- 172.21.15.5:0/486741457 wait complete. 2023-10-16T13:47:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.151+0000 7fa55776c700 1 Processor -- start 2023-10-16T13:47:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.151+0000 7fa55776c700 1 -- start start 2023-10-16T13:47:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa55015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 0x7fa550148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55015f1f0 0x7fa5500b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55015bcd0 con 0x7fa55015ab10 2023-10-16T13:47:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55015c630 con 0x7fa55015f1f0 2023-10-16T13:47:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55015b070 con 0x7fa5500cfc60 2023-10-16T13:47:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 0x7fa550148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 0x7fa550148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46350/0 (socket says 172.21.15.5:46350) 2023-10-16T13:47:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 -- 172.21.15.5:0/3573709788 learned_addr learned my addr 172.21.15.5:0/3573709788 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa555508700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa55015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa555d09700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55015f1f0 0x7fa5500b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 -- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 msgr2=0x7fa55015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa55015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 -- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55015f1f0 msgr2=0x7fa5500b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55015f1f0 0x7fa5500b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 -- 172.21.15.5:0/3573709788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009430 con 0x7fa55015ab10 2023-10-16T13:47:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa555d09700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55015f1f0 0x7fa5500b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa554d07700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 0x7fa550148880 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa54c013040 tx=0x7fa54c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c025430 con 0x7fa55015ab10 2023-10-16T13:47:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c020070 con 0x7fa55015ab10 2023-10-16T13:47:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55015b330 con 0x7fa55015ab10 2023-10-16T13:47:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.152+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0257d0 con 0x7fa55015ab10 2023-10-16T13:47:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.153+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55015b8f0 con 0x7fa55015ab10 2023-10-16T13:47:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.154+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55015be10 con 0x7fa55015ab10 2023-10-16T13:47:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.154+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fa54c022030 con 0x7fa55015ab10 2023-10-16T13:47:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.155+0000 7fa545ffb700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa53406b140 0x7fa53406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.155+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa54c08b010 con 0x7fa55015ab10 2023-10-16T13:47:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.155+0000 7fa555508700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa53406b140 0x7fa53406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.155+0000 7fa555508700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa53406b140 0x7fa53406d600 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa540000f60 tx=0x7fa540007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.159+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa55015be10 con 0x7fa55015ab10 2023-10-16T13:47:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.359+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa55015be10 con 0x7fa55015ab10 2023-10-16T13:47:02.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.359+0000 7fa545ffb700 1 -- 172.21.15.5:0/3573709788 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa55015be10 con 0x7fa55015ab10 2023-10-16T13:47:02.363 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:47:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa53406b140 msgr2=0x7fa53406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa53406b140 0x7fa53406d600 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa540000f60 tx=0x7fa540007e70 comp rx=0 tx=0).stop 2023-10-16T13:47:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 msgr2=0x7fa550148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 0x7fa550148880 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa54c013040 tx=0x7fa54c004750 comp rx=0 tx=0).stop 2023-10-16T13:47:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 shutdown_connections 2023-10-16T13:47:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa55015f1f0 0x7fa5500b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa53406b140 0x7fa53406d600 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa5500cfc60 0x7fa55015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 --2- 172.21.15.5:0/3573709788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa55015ab10 0x7fa550148880 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 >> 172.21.15.5:0/3573709788 conn(0x7fa55006dae0 msgr2=0x7fa5500b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 shutdown_connections 2023-10-16T13:47:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.362+0000 7fa55776c700 1 -- 172.21.15.5:0/3573709788 wait complete. 2023-10-16T13:47:02.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.499+0000 7fbd7938f700 1 Processor -- start 2023-10-16T13:47:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.499+0000 7fbd7938f700 1 -- start start 2023-10-16T13:47:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd7938f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd740d3fc0 0x7fbd7415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd7938f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbd740b7050 0x7fbd740d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd7938f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7415e4e0 con 0x7fbd7415dbc0 2023-10-16T13:47:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd7938f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740b7560 con 0x7fbd740d3fc0 2023-10-16T13:47:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd7938f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740b7840 con 0x7fbd740b7050 2023-10-16T13:47:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd740d3fc0 0x7fbd7415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd740d3fc0 0x7fbd7415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46358/0 (socket says 172.21.15.5:46358) 2023-10-16T13:47:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 -- 172.21.15.5:0/1802388980 learned_addr learned my addr 172.21.15.5:0/1802388980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd737fe700 1 --2- 172.21.15.5:0/1802388980 >> v2:172.21.15.112:3300/0 conn(0x7fbd740b7050 0x7fbd740d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 -- 172.21.15.5:0/1802388980 >> v2:172.21.15.112:3300/0 conn(0x7fbd740b7050 msgr2=0x7fbd740d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 --2- 172.21.15.5:0/1802388980 >> v2:172.21.15.112:3300/0 conn(0x7fbd740b7050 0x7fbd740d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 -- 172.21.15.5:0/1802388980 >> v1:172.21.15.112:6789/0 conn(0x7fbd7415dbc0 legacy=0x7fbd740d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 -- 172.21.15.5:0/1802388980 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740b7b20 con 0x7fbd740d3fc0 2023-10-16T13:47:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd737fe700 1 --2- 172.21.15.5:0/1802388980 >> v2:172.21.15.112:3300/0 conn(0x7fbd740b7050 0x7fbd740d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd727fc700 1 --2- 172.21.15.5:0/1802388980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd7415dfa0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd740cdea0 tx=0x7fbd68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6414b8bf88b3232 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.500+0000 7fbd71ffb700 1 -- 172.21.15.5:0/1802388980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800b870 con 0x7fbd740d3fc0 2023-10-16T13:47:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd71ffb700 1 -- 172.21.15.5:0/1802388980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800b9d0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd71ffb700 1 -- 172.21.15.5:0/1802388980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800bd60 con 0x7fbd740d3fc0 2023-10-16T13:47:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 -- 172.21.15.5:0/1802388980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 msgr2=0x7fbd7415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 --2- 172.21.15.5:0/1802388980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd7415dfa0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd740cdea0 tx=0x7fbd68009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 -- 172.21.15.5:0/1802388980 shutdown_connections 2023-10-16T13:47:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 --2- 172.21.15.5:0/1802388980 >> v2:172.21.15.112:3300/0 conn(0x7fbd740b7050 0x7fbd740d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 --2- 172.21.15.5:0/1802388980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd7415dfa0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 -- 172.21.15.5:0/1802388980 >> 172.21.15.5:0/1802388980 conn(0x7fbd7409cb40 msgr2=0x7fbd740d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 -- 172.21.15.5:0/1802388980 shutdown_connections 2023-10-16T13:47:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.501+0000 7fbd7938f700 1 -- 172.21.15.5:0/1802388980 wait complete. 2023-10-16T13:47:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.502+0000 7fbd7938f700 1 Processor -- start 2023-10-16T13:47:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.502+0000 7fbd7938f700 1 -- start start 2023-10-16T13:47:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd7938f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd740b7050 0x7fbd740cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd7938f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd741589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd7938f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd7415dbc0 0x7fbd74158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd7938f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740cdbc0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd7938f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7415c010 con 0x7fbd7415dbc0 2023-10-16T13:47:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd7938f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74158120 con 0x7fbd740b7050 2023-10-16T13:47:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd727fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd741589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd727fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd741589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46364/0 (socket says 172.21.15.5:46364) 2023-10-16T13:47:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.503+0000 7fbd727fc700 1 -- 172.21.15.5:0/3574357791 learned_addr learned my addr 172.21.15.5:0/3574357791 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd737fe700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd7415dbc0 0x7fbd74158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd72ffd700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd740b7050 0x7fbd740cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd727fc700 1 -- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd740b7050 msgr2=0x7fbd740cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd727fc700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd740b7050 0x7fbd740cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd727fc700 1 -- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd7415dbc0 msgr2=0x7fbd74158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd727fc700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd7415dbc0 0x7fbd74158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd727fc700 1 -- 172.21.15.5:0/3574357791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd68009550 con 0x7fbd740d3fc0 2023-10-16T13:47:02.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd737fe700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd7415dbc0 0x7fbd74158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:02.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd72ffd700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd740b7050 0x7fbd740cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:02.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd727fc700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd741589e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009fd0 tx=0x7fbd68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68004310 con 0x7fbd740d3fc0 2023-10-16T13:47:02.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6801f070 con 0x7fbd740d3fc0 2023-10-16T13:47:02.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd74157510 con 0x7fbd740d3fc0 2023-10-16T13:47:02.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680036a0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.504+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd74157ad0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.505+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74159ca0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.505+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fbd68021030 con 0x7fbd740d3fc0 2023-10-16T13:47:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.506+0000 7fbd5b7fe700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd6006b140 0x7fbd6006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.506+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbd6808af40 con 0x7fbd740d3fc0 2023-10-16T13:47:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.506+0000 7fbd72ffd700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd6006b140 0x7fbd6006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.507+0000 7fbd72ffd700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd6006b140 0x7fbd6006d600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000fb0 tx=0x7fbd64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.511+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd74159ca0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.756+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd74159ca0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.757+0000 7fbd5b7fe700 1 -- 172.21.15.5:0/3574357791 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fbd74159ca0 con 0x7fbd740d3fc0 2023-10-16T13:47:02.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:02.760 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:39.225095+0000","modified":"2023-10-16T13:40:42.262157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/2729748635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2729748635},{"type":"v1","addr":"172.21.15.112:6836","nonce":2729748635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-16T13:47:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd6006b140 msgr2=0x7fbd6006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd6006b140 0x7fbd6006d600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000fb0 tx=0x7fbd64009040 comp rx=0 tx=0).stop 2023-10-16T13:47:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 msgr2=0x7fbd741589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd741589e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009fd0 tx=0x7fbd68004750 comp rx=0 tx=0).stop 2023-10-16T13:47:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 shutdown_connections 2023-10-16T13:47:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd7415dbc0 0x7fbd74158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbd6006b140 0x7fbd6006d600 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd740b7050 0x7fbd740cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 --2- 172.21.15.5:0/3574357791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740d3fc0 0x7fbd741589e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 >> 172.21.15.5:0/3574357791 conn(0x7fbd7409cb40 msgr2=0x7fbd740b8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 shutdown_connections 2023-10-16T13:47:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.759+0000 7fbd7938f700 1 -- 172.21.15.5:0/3574357791 wait complete. 2023-10-16T13:47:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2023-10-16T13:47:02.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:02.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.897+0000 7fa3fd7e1700 1 Processor -- start 2023-10-16T13:47:02.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.897+0000 7fa3fd7e1700 1 -- start start 2023-10-16T13:47:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3fd7e1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3f80d3fc0 0x7fa3f815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3fd7e1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f80d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3fd7e1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f815e4e0 con 0x7fa3f815dbc0 2023-10-16T13:47:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3fd7e1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80b7560 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3fd7e1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80b7840 con 0x7fa3f80b7050 2023-10-16T13:47:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3f80d3fc0 0x7fa3f815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3f80d3fc0 0x7fa3f815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46372/0 (socket says 172.21.15.5:46372) 2023-10-16T13:47:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 -- 172.21.15.5:0/3008583608 learned_addr learned my addr 172.21.15.5:0/3008583608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f77fe700 1 --2- 172.21.15.5:0/3008583608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f80d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 -- 172.21.15.5:0/3008583608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 msgr2=0x7fa3f80d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 --2- 172.21.15.5:0/3008583608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f80d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 -- 172.21.15.5:0/3008583608 >> v1:172.21.15.112:6789/0 conn(0x7fa3f815dbc0 legacy=0x7fa3f80d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.898+0000 7fa3f67fc700 1 -- 172.21.15.5:0/3008583608 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80b7b20 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3f67fc700 1 --2- 172.21.15.5:0/3008583608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f815dfa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80098f0 tx=0x7fa3e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a3cecc282fda4c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3f5ffb700 1 -- 172.21.15.5:0/3008583608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800b8a0 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3f5ffb700 1 -- 172.21.15.5:0/3008583608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800ba00 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3f5ffb700 1 -- 172.21.15.5:0/3008583608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800bd90 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/3008583608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 msgr2=0x7fa3f815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/3008583608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f815dfa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80098f0 tx=0x7fa3e8009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/3008583608 shutdown_connections 2023-10-16T13:47:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/3008583608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f80d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/3008583608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f815dfa0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/3008583608 >> 172.21.15.5:0/3008583608 conn(0x7fa3f809cb40 msgr2=0x7fa3f80d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/3008583608 shutdown_connections 2023-10-16T13:47:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.899+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/3008583608 wait complete. 2023-10-16T13:47:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.901+0000 7fa3fd7e1700 1 Processor -- start 2023-10-16T13:47:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.901+0000 7fa3fd7e1700 1 -- start start 2023-10-16T13:47:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.901+0000 7fa3fd7e1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f81585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f806bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3f815dbc0 0x7fa3f806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80cc690 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80cba80 con 0x7fa3f815dbc0 2023-10-16T13:47:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80cbd60 con 0x7fa3f80b7050 2023-10-16T13:47:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f806bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f806bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46378/0 (socket says 172.21.15.5:46378) 2023-10-16T13:47:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 -- 172.21.15.5:0/2018427654 learned_addr learned my addr 172.21.15.5:0/2018427654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f6ffd700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f81585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f77fe700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3f815dbc0 0x7fa3f806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 -- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 msgr2=0x7fa3f81585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f81585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 -- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3f815dbc0 msgr2=0x7fa3f806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3f815dbc0 0x7fa3f806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 -- 172.21.15.5:0/2018427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8009550 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3f67fc700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f806bb60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8000c00 tx=0x7fa3e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8004300 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e801f070 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f80cc040 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80036a0 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.902+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f8158b10 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.903+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f804ebb0 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.904+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fa3e8021030 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.905+0000 7fa3df7fe700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3e406b140 0x7fa3e406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.905+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa3e808b0a0 con 0x7fa3f80d3fc0 2023-10-16T13:47:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.905+0000 7fa3f6ffd700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3e406b140 0x7fa3e406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.906+0000 7fa3f6ffd700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3e406b140 0x7fa3e406d600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec000fb0 tx=0x7fa3ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:02.909+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3e8055e40 con 0x7fa3f80d3fc0 2023-10-16T13:47:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.107+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3f80cf310 con 0x7fa3f80d3fc0 2023-10-16T13:47:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.108+0000 7fa3df7fe700 1 -- 172.21.15.5:0/2018427654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fa3e8015090 con 0x7fa3f80d3fc0 2023-10-16T13:47:03.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:03.112 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:41:09.641898+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3e406b140 msgr2=0x7fa3e406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3e406b140 0x7fa3e406d600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec000fb0 tx=0x7fa3ec009040 comp rx=0 tx=0).stop 2023-10-16T13:47:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 msgr2=0x7fa3f806bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f806bb60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8000c00 tx=0x7fa3e8004750 comp rx=0 tx=0).stop 2023-10-16T13:47:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 shutdown_connections 2023-10-16T13:47:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3f815dbc0 0x7fa3f806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3e406b140 0x7fa3e406d600 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3f80b7050 0x7fa3f81585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 --2- 172.21.15.5:0/2018427654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f80d3fc0 0x7fa3f806bb60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 >> 172.21.15.5:0/2018427654 conn(0x7fa3f809cb40 msgr2=0x7fa3f80b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 shutdown_connections 2023-10-16T13:47:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.111+0000 7fa3fd7e1700 1 -- 172.21.15.5:0/2018427654 wait complete. 2023-10-16T13:47:03.126 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:47:03.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.248+0000 7fe5f68f0700 1 Processor -- start 2023-10-16T13:47:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.248+0000 7fe5f68f0700 1 -- start start 2023-10-16T13:47:03.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5f68f0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5f68f0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe5f00d1bc0 0x7fe5f00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5f68f0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f015ee90 con 0x7fe5f015eab0 2023-10-16T13:47:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5f68f0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f0158370 con 0x7fe5f00d1bc0 2023-10-16T13:47:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5f68f0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00d23b0 con 0x7fe5f00cf8a0 2023-10-16T13:47:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5effff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5f015eab0 0x7fe5f00cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56388/0 (socket says 172.21.15.5:56388) 2023-10-16T13:47:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5effff700 1 -- 172.21.15.5:0/1378412703 learned_addr learned my addr 172.21.15.5:0/1378412703 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5f4e8d700 1 --2- 172.21.15.5:0/1378412703 >> v2:172.21.15.112:3300/0 conn(0x7fe5f00d1bc0 0x7fe5f00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.249+0000 7fe5ef7fe700 1 --2- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5eeffd700 1 -- 172.21.15.5:0/1378412703 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757856515 0 0) 0x7fe5f015ee90 con 0x7fe5f015eab0 2023-10-16T13:47:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5eeffd700 1 -- 172.21.15.5:0/1378412703 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5dc0035b0 con 0x7fe5f015eab0 2023-10-16T13:47:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 msgr2=0x7fe5f00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5f4e8d700 1 --2- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f00d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/1378412703 >> v1:172.21.15.5:6789/0 conn(0x7fe5f015eab0 legacy=0x7fe5f00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/1378412703 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00cda20 con 0x7fe5f00d1bc0 2023-10-16T13:47:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5f4e8d700 1 --2- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00cbc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009d90 tx=0x7fe5e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40915ad50b810cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5eeffd700 1 -- 172.21.15.5:0/1378412703 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800e070 con 0x7fe5f00d1bc0 2023-10-16T13:47:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5eeffd700 1 -- 172.21.15.5:0/1378412703 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800bb20 con 0x7fe5f00d1bc0 2023-10-16T13:47:03.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.250+0000 7fe5eeffd700 1 -- 172.21.15.5:0/1378412703 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8012430 con 0x7fe5f00d1bc0 2023-10-16T13:47:03.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 -- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 msgr2=0x7fe5f00cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00cbc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009d90 tx=0x7fe5e800b330 comp rx=0 tx=0).stop 2023-10-16T13:47:03.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 -- 172.21.15.5:0/1378412703 shutdown_connections 2023-10-16T13:47:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00cbc10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/1378412703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f00d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 -- 172.21.15.5:0/1378412703 >> 172.21.15.5:0/1378412703 conn(0x7fe5f00665a0 msgr2=0x7fe5f0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 -- 172.21.15.5:0/1378412703 shutdown_connections 2023-10-16T13:47:03.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.251+0000 7fe5f68f0700 1 -- 172.21.15.5:0/1378412703 wait complete. 2023-10-16T13:47:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.252+0000 7fe5f68f0700 1 Processor -- start 2023-10-16T13:47:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.252+0000 7fe5f68f0700 1 -- start start 2023-10-16T13:47:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f68f0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f0155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f68f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f68f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 0x7fe5f015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f68f0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00c5da0 con 0x7fe5f015eab0 2023-10-16T13:47:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f68f0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00c5190 con 0x7fe5f00d1bc0 2023-10-16T13:47:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f68f0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00c5470 con 0x7fe5f00cf8a0 2023-10-16T13:47:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 0x7fe5f015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 0x7fe5f015fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46394/0 (socket says 172.21.15.5:46394) 2023-10-16T13:47:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/2698062165 learned_addr learned my addr 172.21.15.5:0/2698062165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5effff700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f0155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5ef7fe700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 msgr2=0x7fe5f0155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f0155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 msgr2=0x7fe5f00b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 -- 172.21.15.5:0/2698062165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8009a70 con 0x7fe5f015eab0 2023-10-16T13:47:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.253+0000 7fe5f4e8d700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 0x7fe5f015fa60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8014040 tx=0x7fe5e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.254+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80129f0 con 0x7fe5f015eab0 2023-10-16T13:47:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.254+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e8020070 con 0x7fe5f015eab0 2023-10-16T13:47:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.254+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f00c5750 con 0x7fe5f015eab0 2023-10-16T13:47:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.254+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8012db0 con 0x7fe5f015eab0 2023-10-16T13:47:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.254+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f0155f70 con 0x7fe5f015eab0 2023-10-16T13:47:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.255+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00c5f10 con 0x7fe5f015eab0 2023-10-16T13:47:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.255+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fe5e8004040 con 0x7fe5f015eab0 2023-10-16T13:47:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.256+0000 7fe5ecff9700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5d006b140 0x7fe5d006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.256+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe5e8022070 con 0x7fe5f015eab0 2023-10-16T13:47:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.256+0000 7fe5effff700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5d006b140 0x7fe5d006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.256+0000 7fe5effff700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5d006b140 0x7fe5d006d600 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00011e0 tx=0x7fe5e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.260+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5e8056880 con 0x7fe5f015eab0 2023-10-16T13:47:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.503+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5f0067d20 con 0x7fe5f015eab0 2023-10-16T13:47:03.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.504+0000 7fe5ecff9700 1 -- 172.21.15.5:0/2698062165 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fe5e8059ea0 con 0x7fe5f015eab0 2023-10-16T13:47:03.507 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:03.507 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:39.225095+0000","modified":"2023-10-16T13:40:42.262157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/2729748635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2729748635},{"type":"v1","addr":"172.21.15.112:6836","nonce":2729748635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-16T13:47:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5d006b140 msgr2=0x7fe5d006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5d006b140 0x7fe5d006d600 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00011e0 tx=0x7fe5e0009040 comp rx=0 tx=0).stop 2023-10-16T13:47:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 msgr2=0x7fe5f015fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 0x7fe5f015fa60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8014040 tx=0x7fe5e8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 shutdown_connections 2023-10-16T13:47:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f015eab0 0x7fe5f015fa60 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5d006b140 0x7fe5d006d600 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5f00cf8a0 0x7fe5f0155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 --2- 172.21.15.5:0/2698062165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5f00d1bc0 0x7fe5f00b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 >> 172.21.15.5:0/2698062165 conn(0x7fe5f00665a0 msgr2=0x7fe5f01579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 shutdown_connections 2023-10-16T13:47:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.506+0000 7fe5f68f0700 1 -- 172.21.15.5:0/2698062165 wait complete. 2023-10-16T13:47:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2023-10-16T13:47:03.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.643+0000 7f7b72445700 1 Processor -- start 2023-10-16T13:47:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.643+0000 7f7b72445700 1 -- start start 2023-10-16T13:47:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b72445700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b6c15e2f0 0x7f7b6c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b72445700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0b2d60 con 0x7f7b6c06a840 2023-10-16T13:47:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b72445700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0cdd30 con 0x7f7b6c0cd950 2023-10-16T13:47:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b72445700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c1619a0 con 0x7f7b6c15e2f0 2023-10-16T13:47:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b709e2700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7b6c06a840 0x7f7b6c06ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56406/0 (socket says 172.21.15.5:56406) 2023-10-16T13:47:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b709e2700 1 -- 172.21.15.5:0/2963745436 learned_addr learned my addr 172.21.15.5:0/2963745436 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b6b7fe700 1 --2- 172.21.15.5:0/2963745436 >> v2:172.21.15.112:3300/0 conn(0x7f7b6c15e2f0 0x7f7b6c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b6affd700 1 -- 172.21.15.5:0/2963745436 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368545816 0 0) 0x7f7b6c0b2d60 con 0x7f7b6c06a840 2023-10-16T13:47:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.644+0000 7f7b6affd700 1 -- 172.21.15.5:0/2963745436 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b580035b0 con 0x7f7b6c06a840 2023-10-16T13:47:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/2963745436 >> v1:172.21.15.112:6789/0 conn(0x7f7b6c0cd950 legacy=0x7f7b6c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/2963745436 >> v1:172.21.15.5:6789/0 conn(0x7f7b6c06a840 legacy=0x7f7b6c06ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/2963745436 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c15e920 con 0x7f7b6c15e2f0 2023-10-16T13:47:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6b7fe700 1 --2- 172.21.15.5:0/2963745436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0cede0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009820 tx=0x7f7b54009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ebd6ff3132a382 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6affd700 1 -- 172.21.15.5:0/2963745436 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54005e30 con 0x7f7b6c15e2f0 2023-10-16T13:47:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6affd700 1 -- 172.21.15.5:0/2963745436 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54006030 con 0x7f7b6c15e2f0 2023-10-16T13:47:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b6affd700 1 -- 172.21.15.5:0/2963745436 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540063a0 con 0x7f7b6c15e2f0 2023-10-16T13:47:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b72445700 1 -- 172.21.15.5:0/2963745436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 msgr2=0x7f7b6c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.645+0000 7f7b72445700 1 --2- 172.21.15.5:0/2963745436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0cede0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009820 tx=0x7f7b54009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.646+0000 7f7b72445700 1 -- 172.21.15.5:0/2963745436 shutdown_connections 2023-10-16T13:47:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.646+0000 7f7b72445700 1 --2- 172.21.15.5:0/2963745436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0cede0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.646+0000 7f7b72445700 1 -- 172.21.15.5:0/2963745436 >> 172.21.15.5:0/2963745436 conn(0x7f7b6c06dae0 msgr2=0x7f7b6c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:03.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.646+0000 7f7b72445700 1 -- 172.21.15.5:0/2963745436 shutdown_connections 2023-10-16T13:47:03.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.646+0000 7f7b72445700 1 -- 172.21.15.5:0/2963745436 wait complete. 2023-10-16T13:47:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.647+0000 7f7b72445700 1 Processor -- start 2023-10-16T13:47:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.647+0000 7f7b72445700 1 -- start start 2023-10-16T13:47:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b72445700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b6c06a840 0x7f7b6c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b72445700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 0x7f7b6c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b72445700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b72445700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c15b2e0 con 0x7f7b6c0cd950 2023-10-16T13:47:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b72445700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0b44a0 con 0x7f7b6c15e2f0 2023-10-16T13:47:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b72445700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0c8e40 con 0x7f7b6c06a840 2023-10-16T13:47:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 0x7f7b6c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 0x7f7b6c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46406/0 (socket says 172.21.15.5:46406) 2023-10-16T13:47:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/3353571858 learned_addr learned my addr 172.21.15.5:0/3353571858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6bfff700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b6c06a840 0x7f7b6c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b709e2700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b6c06a840 msgr2=0x7f7b6c15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b6c06a840 0x7f7b6c15ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 msgr2=0x7f7b6c0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 -- 172.21.15.5:0/3353571858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54009430 con 0x7f7b6c0cd950 2023-10-16T13:47:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6bfff700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b6c06a840 0x7f7b6c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b6b7fe700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 0x7f7b6c0ac8b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009fd0 tx=0x7f7b54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.648+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540069b0 con 0x7f7b6c0cd950 2023-10-16T13:47:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.649+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54020070 con 0x7f7b6c0cd950 2023-10-16T13:47:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.649+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c0c9120 con 0x7f7b6c0cd950 2023-10-16T13:47:03.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.649+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54004260 con 0x7f7b6c0cd950 2023-10-16T13:47:03.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.649+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c0acdf0 con 0x7f7b6c0cd950 2023-10-16T13:47:03.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.650+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c0b2630 con 0x7f7b6c0cd950 2023-10-16T13:47:03.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.650+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f7b54022030 con 0x7f7b6c0cd950 2023-10-16T13:47:03.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.650+0000 7f7b68ff9700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7b4c06b140 0x7f7b4c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.651+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7b5408b010 con 0x7f7b6c0cd950 2023-10-16T13:47:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.651+0000 7f7b6bfff700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7b4c06b140 0x7f7b4c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.651+0000 7f7b6bfff700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7b4c06b140 0x7f7b4c06d600 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0017c0 tx=0x7f7b5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.655+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b54055d30 con 0x7f7b6c0cd950 2023-10-16T13:47:03.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.904+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b6c161280 con 0x7f7b6c0cd950 2023-10-16T13:47:03.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.905+0000 7f7b68ff9700 1 -- 172.21.15.5:0/3353571858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f7b54059350 con 0x7f7b6c0cd950 2023-10-16T13:47:03.908 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:40:39.225095+0000","modified":"2023-10-16T13:40:42.262157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/2729748635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2729748635},{"type":"v1","addr":"172.21.15.112:6836","nonce":2729748635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-16T13:47:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7b4c06b140 msgr2=0x7f7b4c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7b4c06b140 0x7f7b4c06d600 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0017c0 tx=0x7f7b5c009040 comp rx=0 tx=0).stop 2023-10-16T13:47:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 msgr2=0x7f7b6c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 0x7f7b6c0ac8b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009fd0 tx=0x7f7b54004750 comp rx=0 tx=0).stop 2023-10-16T13:47:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 shutdown_connections 2023-10-16T13:47:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c15e2f0 0x7f7b6c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7b4c06b140 0x7f7b4c06d600 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b6c06a840 0x7f7b6c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 --2- 172.21.15.5:0/3353571858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0cd950 0x7f7b6c0ac8b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:03.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 >> 172.21.15.5:0/3353571858 conn(0x7f7b6c06dae0 msgr2=0x7f7b6c1605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:03.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 shutdown_connections 2023-10-16T13:47:03.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:03.907+0000 7f7b72445700 1 -- 172.21.15.5:0/3353571858 wait complete. 2023-10-16T13:47:03.913 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2023-10-16T13:47:03.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.044+0000 7fc9f084d700 1 Processor -- start 2023-10-16T13:47:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.044+0000 7fc9f084d700 1 -- start start 2023-10-16T13:47:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9f084d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9ec15ab10 0x7fc9ec15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9f084d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec0cfe30 0x7fc9ec0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9f084d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec15e7a0 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9f084d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec15f730 con 0x7fc9ec15ab10 2023-10-16T13:47:04.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9f084d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0b29a0 con 0x7fc9ec0cfe30 2023-10-16T13:47:04.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ea59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9ec15ab10 0x7fc9ec15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9e9d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc9ec0b1f50 0x7fc9ec0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56416/0 (socket says 172.21.15.5:56416) 2023-10-16T13:47:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9e9d9b700 1 -- 172.21.15.5:0/2221897741 learned_addr learned my addr 172.21.15.5:0/2221897741 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ead9d700 1 --2- 172.21.15.5:0/2221897741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec0cfe30 0x7fc9ec0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ea59c700 1 -- 172.21.15.5:0/2221897741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec0cfe30 msgr2=0x7fc9ec0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ea59c700 1 --2- 172.21.15.5:0/2221897741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec0cfe30 0x7fc9ec0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ea59c700 1 -- 172.21.15.5:0/2221897741 >> v1:172.21.15.5:6789/0 conn(0x7fc9ec0b1f50 legacy=0x7fc9ec0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ea59c700 1 -- 172.21.15.5:0/2221897741 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0b2c80 con 0x7fc9ec15ab10 2023-10-16T13:47:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9ea59c700 1 --2- 172.21.15.5:0/2221897741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec15ab10 0x7fc9ec15f1f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009840 tx=0x7fc9dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add133a64be9e11d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.045+0000 7fc9e959a700 1 -- 172.21.15.5:0/2221897741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc011830 con 0x7fc9ec15ab10 2023-10-16T13:47:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9e959a700 1 -- 172.21.15.5:0/2221897741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc011990 con 0x7fc9ec15ab10 2023-10-16T13:47:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9e959a700 1 -- 172.21.15.5:0/2221897741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc011d20 con 0x7fc9ec15ab10 2023-10-16T13:47:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 -- 172.21.15.5:0/2221897741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec15ab10 msgr2=0x7fc9ec15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 --2- 172.21.15.5:0/2221897741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec15ab10 0x7fc9ec15f1f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009840 tx=0x7fc9dc009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 -- 172.21.15.5:0/2221897741 shutdown_connections 2023-10-16T13:47:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 --2- 172.21.15.5:0/2221897741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec0cfe30 0x7fc9ec0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 --2- 172.21.15.5:0/2221897741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec15ab10 0x7fc9ec15f1f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 -- 172.21.15.5:0/2221897741 >> 172.21.15.5:0/2221897741 conn(0x7fc9ec06dae0 msgr2=0x7fc9ec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 -- 172.21.15.5:0/2221897741 shutdown_connections 2023-10-16T13:47:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.046+0000 7fc9f084d700 1 -- 172.21.15.5:0/2221897741 wait complete. 2023-10-16T13:47:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 Processor -- start 2023-10-16T13:47:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 -- start start 2023-10-16T13:47:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 0x7fc9ec157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec0d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec15ab10 0x7fc9ec0ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c6b60 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0ad090 con 0x7fc9ec0cfe30 2023-10-16T13:47:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9f084d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec157f90 con 0x7fc9ec15ab10 2023-10-16T13:47:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.048+0000 7fc9ea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 0x7fc9ec157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 0x7fc9ec157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46420/0 (socket says 172.21.15.5:46420) 2023-10-16T13:47:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 -- 172.21.15.5:0/3268490244 learned_addr learned my addr 172.21.15.5:0/3268490244 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ead9d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec15ab10 0x7fc9ec0ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9e9d9b700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec0d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 -- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec15ab10 msgr2=0x7fc9ec0ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec15ab10 0x7fc9ec0ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 -- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cfe30 msgr2=0x7fc9ec0d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec0d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 -- 172.21.15.5:0/3268490244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0094a0 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9ea59c700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 0x7fc9ec157a50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0090b0 tx=0x7fc9dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0036a0 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc01f070 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0c5f50 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc003a60 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.049+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec0c6510 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.050+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec067d20 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.051+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fc9dc003bc0 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.051+0000 7fc9daffd700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9cc06b140 0x7fc9cc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.051+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc9dc021070 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.051+0000 7fc9e9d9b700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9cc06b140 0x7fc9cc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.052+0000 7fc9e9d9b700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9cc06b140 0x7fc9cc06d600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec15a2c0 tx=0x7fc9e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.056+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9dc055fc0 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.255+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9ec0afc10 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.256+0000 7fc9daffd700 1 -- 172.21.15.5:0/3268490244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fc9dc0595e0 con 0x7fc9ec0b1f50 2023-10-16T13:47:04.259 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:04.260 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:41:09.641898+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:40:37.717414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-16T13:40:38.190883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9cc06b140 msgr2=0x7fc9cc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9cc06b140 0x7fc9cc06d600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec15a2c0 tx=0x7fc9e0009040 comp rx=0 tx=0).stop 2023-10-16T13:47:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 msgr2=0x7fc9ec157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 0x7fc9ec157a50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0090b0 tx=0x7fc9dc004750 comp rx=0 tx=0).stop 2023-10-16T13:47:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 shutdown_connections 2023-10-16T13:47:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9cc06b140 0x7fc9cc06d600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9ec15ab10 0x7fc9ec0ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9ec0b1f50 0x7fc9ec157a50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 --2- 172.21.15.5:0/3268490244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec0d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.258+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 >> 172.21.15.5:0/3268490244 conn(0x7fc9ec06dae0 msgr2=0x7fc9ec0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.259+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 shutdown_connections 2023-10-16T13:47:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.259+0000 7fc9f084d700 1 -- 172.21.15.5:0/3268490244 wait complete. 2023-10-16T13:47:04.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:47:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.396+0000 7fb25fddf700 1 Processor -- start 2023-10-16T13:47:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.396+0000 7fb25fddf700 1 -- start start 2023-10-16T13:47:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25fddf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb25815a850 0x7fb2580cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25fddf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2580b2940 0x7fb2580ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25fddf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2580ce3b0 con 0x7fb2580cd2e0 2023-10-16T13:47:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25fddf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580b2df0 con 0x7fb25815a850 2023-10-16T13:47:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25fddf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580b6290 con 0x7fb2580b2940 2023-10-16T13:47:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25db7b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb25815a850 0x7fb2580cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25e37c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2580cd2e0 0x7fb258071ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56434/0 (socket says 172.21.15.5:56434) 2023-10-16T13:47:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25e37c700 1 -- 172.21.15.5:0/2095869400 learned_addr learned my addr 172.21.15.5:0/2095869400 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25d37a700 1 --2- 172.21.15.5:0/2095869400 >> v2:172.21.15.112:3300/0 conn(0x7fb2580b2940 0x7fb2580ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25cb79700 1 -- 172.21.15.5:0/2095869400 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543326561 0 0) 0x7fb2580ce3b0 con 0x7fb2580cd2e0 2023-10-16T13:47:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25cb79700 1 -- 172.21.15.5:0/2095869400 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2440035b0 con 0x7fb2580cd2e0 2023-10-16T13:47:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25db7b700 1 -- 172.21.15.5:0/2095869400 >> v2:172.21.15.112:3300/0 conn(0x7fb2580b2940 msgr2=0x7fb2580ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25db7b700 1 --2- 172.21.15.5:0/2095869400 >> v2:172.21.15.112:3300/0 conn(0x7fb2580b2940 0x7fb2580ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25db7b700 1 -- 172.21.15.5:0/2095869400 >> v1:172.21.15.5:6789/0 conn(0x7fb2580cd2e0 legacy=0x7fb258071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.397+0000 7fb25db7b700 1 -- 172.21.15.5:0/2095869400 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580cc220 con 0x7fb25815a850 2023-10-16T13:47:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25db7b700 1 --2- 172.21.15.5:0/2095869400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25815a850 0x7fb2580cbc40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb2580caa90 tx=0x7fb248009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83feef8b1c47b21e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25cb79700 1 -- 172.21.15.5:0/2095869400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248011830 con 0x7fb25815a850 2023-10-16T13:47:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25cb79700 1 -- 172.21.15.5:0/2095869400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248011990 con 0x7fb25815a850 2023-10-16T13:47:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25cb79700 1 -- 172.21.15.5:0/2095869400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248011d00 con 0x7fb25815a850 2023-10-16T13:47:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 -- 172.21.15.5:0/2095869400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25815a850 msgr2=0x7fb2580cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 --2- 172.21.15.5:0/2095869400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25815a850 0x7fb2580cbc40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb2580caa90 tx=0x7fb248009b20 comp rx=0 tx=0).stop 2023-10-16T13:47:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 -- 172.21.15.5:0/2095869400 shutdown_connections 2023-10-16T13:47:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 --2- 172.21.15.5:0/2095869400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25815a850 0x7fb2580cbc40 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 --2- 172.21.15.5:0/2095869400 >> v2:172.21.15.112:3300/0 conn(0x7fb2580b2940 0x7fb2580ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 -- 172.21.15.5:0/2095869400 >> 172.21.15.5:0/2095869400 conn(0x7fb25806dac0 msgr2=0x7fb25806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 -- 172.21.15.5:0/2095869400 shutdown_connections 2023-10-16T13:47:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.398+0000 7fb25fddf700 1 -- 172.21.15.5:0/2095869400 wait complete. 2023-10-16T13:47:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 Processor -- start 2023-10-16T13:47:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 -- start start 2023-10-16T13:47:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 0x7fb2580ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2580cd2e0 0x7fb2580c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25815a850 0x7fb2580b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581503c0 con 0x7fb2580b2940 2023-10-16T13:47:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580c7a90 con 0x7fb25815a850 2023-10-16T13:47:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25fddf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25814fe00 con 0x7fb2580cd2e0 2023-10-16T13:47:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25db7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 0x7fb2580ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.400+0000 7fb25db7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 0x7fb2580ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46432/0 (socket says 172.21.15.5:46432) 2023-10-16T13:47:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 -- 172.21.15.5:0/4244445003 learned_addr learned my addr 172.21.15.5:0/4244445003 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25d37a700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2580cd2e0 0x7fb2580c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25e37c700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25815a850 0x7fb2580b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 -- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2580cd2e0 msgr2=0x7fb2580c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2580cd2e0 0x7fb2580c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 -- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25815a850 msgr2=0x7fb2580b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25815a850 0x7fb2580b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 -- 172.21.15.5:0/4244445003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480094a0 con 0x7fb2580b2940 2023-10-16T13:47:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25db7b700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 0x7fb2580ca110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb248000c00 tx=0x7fb248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248004550 con 0x7fb2580b2940 2023-10-16T13:47:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24801e070 con 0x7fb2580b2940 2023-10-16T13:47:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2581500e0 con 0x7fb2580b2940 2023-10-16T13:47:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480038a0 con 0x7fb2580b2940 2023-10-16T13:47:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.401+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25814fa20 con 0x7fb2580b2940 2023-10-16T13:47:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.402+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2580c7560 con 0x7fb2580b2940 2023-10-16T13:47:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.403+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fb248003a00 con 0x7fb2580b2940 2023-10-16T13:47:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.403+0000 7fb24e7fc700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb23c06b140 0x7fb23c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.403+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb24808a810 con 0x7fb2580b2940 2023-10-16T13:47:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.403+0000 7fb25d37a700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb23c06b140 0x7fb23c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.404+0000 7fb25d37a700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb23c06b140 0x7fb23c06d600 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2580b0920 tx=0x7fb254009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.408+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2480555b0 con 0x7fb2580b2940 2023-10-16T13:47:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.654+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb258067d20 con 0x7fb2580b2940 2023-10-16T13:47:04.658 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:47:04.655+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:47:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.656+0000 7fb24e7fc700 1 -- 172.21.15.5:0/4244445003 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb248015090 con 0x7fb2580b2940 2023-10-16T13:47:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb23c06b140 msgr2=0x7fb23c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb23c06b140 0x7fb23c06d600 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2580b0920 tx=0x7fb254009210 comp rx=0 tx=0).stop 2023-10-16T13:47:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 msgr2=0x7fb2580ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 0x7fb2580ca110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb248000c00 tx=0x7fb248004750 comp rx=0 tx=0).stop 2023-10-16T13:47:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 shutdown_connections 2023-10-16T13:47:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25815a850 0x7fb2580b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2580b2940 0x7fb2580ca110 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb23c06b140 0x7fb23c06d600 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 --2- 172.21.15.5:0/4244445003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2580cd2e0 0x7fb2580c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.658+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 >> 172.21.15.5:0/4244445003 conn(0x7fb25806dac0 msgr2=0x7fb2580b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.659+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 shutdown_connections 2023-10-16T13:47:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.659+0000 7fb25fddf700 1 -- 172.21.15.5:0/4244445003 wait complete. 2023-10-16T13:47:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:47:04.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:47:04.703 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:47:04.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 Processor -- start 2023-10-16T13:47:04.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 -- start start 2023-10-16T13:47:04.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ed815e2f0 0x7f8ed80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed806a840 0x7f8ed806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80b2d60 con 0x7f8ed80cd950 2023-10-16T13:47:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed81619a0 con 0x7f8ed815e2f0 2023-10-16T13:47:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.801+0000 7f8ede9e9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806b1f0 con 0x7f8ed806a840 2023-10-16T13:47:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ed815e2f0 0x7f8ed80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8edcf86700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed806a840 0x7f8ed806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed7fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8ed80cd950 0x7f8ed815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47420/0 (socket says 172.21.15.5:47420) 2023-10-16T13:47:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed7fff700 1 -- 172.21.15.5:0/3804934185 learned_addr learned my addr 172.21.15.5:0/3804934185 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed77fe700 1 -- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed806a840 msgr2=0x7f8ed806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed77fe700 1 --2- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed806a840 0x7f8ed806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed77fe700 1 -- 172.21.15.5:0/3804934185 >> v1:172.21.15.112:6789/0 conn(0x7f8ed80cd950 legacy=0x7f8ed815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed77fe700 1 -- 172.21.15.5:0/3804934185 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80cdd30 con 0x7f8ed815e2f0 2023-10-16T13:47:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed6ffd700 1 -- 172.21.15.5:0/3804934185 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607871422 0 0) 0x7f8ed80b2d60 con 0x7f8ed80cd950 2023-10-16T13:47:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed77fe700 1 --2- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80cede0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8161ae0 tx=0x7f8ecc009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef8389b38bbc71f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed6ffd700 1 -- 172.21.15.5:0/3804934185 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc015070 con 0x7f8ed815e2f0 2023-10-16T13:47:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed6ffd700 1 -- 172.21.15.5:0/3804934185 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc005c30 con 0x7f8ed815e2f0 2023-10-16T13:47:04.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.802+0000 7f8ed6ffd700 1 -- 172.21.15.5:0/3804934185 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc004020 con 0x7f8ed815e2f0 2023-10-16T13:47:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 -- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 msgr2=0x7f8ed80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80cede0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8161ae0 tx=0x7f8ecc009b00 comp rx=0 tx=0).stop 2023-10-16T13:47:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 -- 172.21.15.5:0/3804934185 shutdown_connections 2023-10-16T13:47:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed806a840 0x7f8ed806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/3804934185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80cede0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 -- 172.21.15.5:0/3804934185 >> 172.21.15.5:0/3804934185 conn(0x7f8ed806dae0 msgr2=0x7f8ed806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:04.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 -- 172.21.15.5:0/3804934185 shutdown_connections 2023-10-16T13:47:04.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.803+0000 7f8ede9e9700 1 -- 172.21.15.5:0/3804934185 wait complete. 2023-10-16T13:47:04.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.804+0000 7f8ede9e9700 1 Processor -- start 2023-10-16T13:47:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.804+0000 7f8ede9e9700 1 -- start start 2023-10-16T13:47:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ede9e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 0x7f8ed80b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ede9e9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80cd950 0x7f8ed80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ede9e9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ede9e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b3120 con 0x7f8ed806a840 2023-10-16T13:47:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ede9e9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b3400 con 0x7f8ed815e2f0 2023-10-16T13:47:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ede9e9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b36e0 con 0x7f8ed80cd950 2023-10-16T13:47:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 0x7f8ed80b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 0x7f8ed80b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46446/0 (socket says 172.21.15.5:46446) 2023-10-16T13:47:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed7fff700 1 -- 172.21.15.5:0/1899163156 learned_addr learned my addr 172.21.15.5:0/1899163156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:04.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8edcf86700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed77fe700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80cd950 0x7f8ed80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed7fff700 1 -- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80cd950 msgr2=0x7f8ed80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed7fff700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80cd950 0x7f8ed80c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.805+0000 7f8ed7fff700 1 -- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 msgr2=0x7f8ed80b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ed7fff700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ed7fff700 1 -- 172.21.15.5:0/1899163156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc009430 con 0x7f8ed806a840 2023-10-16T13:47:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ed7fff700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 0x7f8ed80b4f50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80011e0 tx=0x7f8ec800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8004c80 con 0x7f8ed806a840 2023-10-16T13:47:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8004e00 con 0x7f8ed806a840 2023-10-16T13:47:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80b39c0 con 0x7f8ed806a840 2023-10-16T13:47:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8007310 con 0x7f8ed806a840 2023-10-16T13:47:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.806+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80b5490 con 0x7f8ed806a840 2023-10-16T13:47:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.807+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed8067d20 con 0x7f8ed806a840 2023-10-16T13:47:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.807+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f8ec8007470 con 0x7f8ed806a840 2023-10-16T13:47:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.808+0000 7f8ed4ff9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec406b140 0x7f8ec406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.808+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8ec8089640 con 0x7f8ed806a840 2023-10-16T13:47:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.808+0000 7f8ed77fe700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec406b140 0x7f8ec406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.808+0000 7f8ed77fe700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec406b140 0x7f8ec406d600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc013040 tx=0x7f8ecc008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:04.812+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ec8054390 con 0x7f8ed806a840 2023-10-16T13:47:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.062+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ed806ad40 con 0x7f8ed806a840 2023-10-16T13:47:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.658+0000 7f8ed4ff9700 1 -- 172.21.15.5:0/1899163156 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ec80579b0 con 0x7f8ed806a840 2023-10-16T13:47:05.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec406b140 msgr2=0x7f8ec406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec406b140 0x7f8ec406d600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc013040 tx=0x7f8ecc008070 comp rx=0 tx=0).stop 2023-10-16T13:47:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 msgr2=0x7f8ed80b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 0x7f8ed80b4f50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80011e0 tx=0x7f8ec800ca30 comp rx=0 tx=0).stop 2023-10-16T13:47:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 shutdown_connections 2023-10-16T13:47:05.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815e2f0 0x7f8ed80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.660+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed806a840 0x7f8ed80b4f50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.661+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ec406b140 0x7f8ec406d600 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.661+0000 7f8ede9e9700 1 --2- 172.21.15.5:0/1899163156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80cd950 0x7f8ed80c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.661+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 >> 172.21.15.5:0/1899163156 conn(0x7f8ed806dae0 msgr2=0x7f8ed815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.661+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 shutdown_connections 2023-10-16T13:47:05.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.661+0000 7f8ede9e9700 1 -- 172.21.15.5:0/1899163156 wait complete. 2023-10-16T13:47:05.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:47:05.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.811+0000 7ffb39561700 1 Processor -- start 2023-10-16T13:47:05.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.811+0000 7ffb39561700 1 -- start start 2023-10-16T13:47:05.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb39561700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb3415e050 0x7ffb340b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:05.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb39561700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340b6190 con 0x7ffb340d1760 2023-10-16T13:47:05.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb39561700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340cf6c0 con 0x7ffb340d2250 2023-10-16T13:47:05.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb39561700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340b58f0 con 0x7ffb3415e050 2023-10-16T13:47:05.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb32ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb340d1760 0x7ffb340d1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56458/0 (socket says 172.21.15.5:56458) 2023-10-16T13:47:05.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb32ffd700 1 -- 172.21.15.5:0/1554222630 learned_addr learned my addr 172.21.15.5:0/1554222630 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:05.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb337fe700 1 --2- 172.21.15.5:0/1554222630 >> v2:172.21.15.112:3300/0 conn(0x7ffb3415e050 0x7ffb340b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:05.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb31ffb700 1 -- 172.21.15.5:0/1554222630 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421280128 0 0) 0x7ffb340b6190 con 0x7ffb340d1760 2023-10-16T13:47:05.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.812+0000 7ffb31ffb700 1 -- 172.21.15.5:0/1554222630 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb1c0035b0 con 0x7ffb340d1760 2023-10-16T13:47:05.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb337fe700 1 -- 172.21.15.5:0/1554222630 >> v1:172.21.15.112:6789/0 conn(0x7ffb340d2250 legacy=0x7ffb3415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb31ffb700 1 -- 172.21.15.5:0/1554222630 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225337168 0 0) 0x7ffb340cf6c0 con 0x7ffb340d2250 2023-10-16T13:47:05.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb337fe700 1 -- 172.21.15.5:0/1554222630 >> v1:172.21.15.5:6789/0 conn(0x7ffb340d1760 legacy=0x7ffb340d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb337fe700 1 -- 172.21.15.5:0/1554222630 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340b5bd0 con 0x7ffb3415e050 2023-10-16T13:47:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb337fe700 1 --2- 172.21.15.5:0/1554222630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb3415e050 0x7ffb340b4890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009d90 tx=0x7ffb2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6620d2ded16680d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb31ffb700 1 -- 172.21.15.5:0/1554222630 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00e070 con 0x7ffb3415e050 2023-10-16T13:47:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb31ffb700 1 -- 172.21.15.5:0/1554222630 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c003a20 con 0x7ffb3415e050 2023-10-16T13:47:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.813+0000 7ffb31ffb700 1 -- 172.21.15.5:0/1554222630 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280017f0 con 0x7ffb3415e050 2023-10-16T13:47:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 -- 172.21.15.5:0/1554222630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb3415e050 msgr2=0x7ffb340b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 --2- 172.21.15.5:0/1554222630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb3415e050 0x7ffb340b4890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009d90 tx=0x7ffb2c00b330 comp rx=0 tx=0).stop 2023-10-16T13:47:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 -- 172.21.15.5:0/1554222630 shutdown_connections 2023-10-16T13:47:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 --2- 172.21.15.5:0/1554222630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb3415e050 0x7ffb340b4890 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 -- 172.21.15.5:0/1554222630 >> 172.21.15.5:0/1554222630 conn(0x7ffb340d37a0 msgr2=0x7ffb340d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 -- 172.21.15.5:0/1554222630 shutdown_connections 2023-10-16T13:47:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.814+0000 7ffb39561700 1 -- 172.21.15.5:0/1554222630 wait complete. 2023-10-16T13:47:05.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.815+0000 7ffb39561700 1 Processor -- start 2023-10-16T13:47:05.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.815+0000 7ffb39561700 1 -- start start 2023-10-16T13:47:05.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340d1760 0x7ffb341500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:05.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340d2250 0x7ffb341e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:05.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 0x7ffb341e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:05.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341541a0 con 0x7ffb3415e050 2023-10-16T13:47:05.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34150620 con 0x7ffb340d2250 2023-10-16T13:47:05.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340cb2a0 con 0x7ffb340d1760 2023-10-16T13:47:05.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 0x7ffb341e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:05.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 0x7ffb341e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46464/0 (socket says 172.21.15.5:46464) 2023-10-16T13:47:05.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 -- 172.21.15.5:0/1272923662 learned_addr learned my addr 172.21.15.5:0/1272923662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:05.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb327fc700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340d2250 0x7ffb341e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:05.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb32ffd700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340d1760 0x7ffb341500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:05.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 -- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340d1760 msgr2=0x7ffb341500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340d1760 0x7ffb341500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 -- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340d2250 msgr2=0x7ffb341e6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:05.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340d2250 0x7ffb341e6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:05.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 -- 172.21.15.5:0/1272923662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009a70 con 0x7ffb3415e050 2023-10-16T13:47:05.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb337fe700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 0x7ffb341e6e90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ffb3408c650 tx=0x7ffb2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:05.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0046f0 con 0x7ffb3415e050 2023-10-16T13:47:05.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c004870 con 0x7ffb3415e050 2023-10-16T13:47:05.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.816+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340cb580 con 0x7ffb3415e050 2023-10-16T13:47:05.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.817+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c012690 con 0x7ffb3415e050 2023-10-16T13:47:05.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.817+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340cbb40 con 0x7ffb3415e050 2023-10-16T13:47:05.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.817+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3404ebb0 con 0x7ffb3415e050 2023-10-16T13:47:05.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.818+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7ffb2c019030 con 0x7ffb3415e050 2023-10-16T13:47:05.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.818+0000 7ffb1b7fe700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb2006b140 0x7ffb2006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:05.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.818+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ffb2c08b960 con 0x7ffb3415e050 2023-10-16T13:47:05.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.819+0000 7ffb32ffd700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb2006b140 0x7ffb2006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:05.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.819+0000 7ffb32ffd700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb2006b140 0x7ffb2006d600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb28007a80 tx=0x7ffb28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:05.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:05.823+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb2c056520 con 0x7ffb3415e050 2023-10-16T13:47:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.024+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb34156360 con 0x7ffb3415e050 2023-10-16T13:47:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.880+0000 7ffb1b7fe700 1 -- 172.21.15.5:0/1272923662 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb2c059b40 con 0x7ffb3415e050 2023-10-16T13:47:06.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb2006b140 msgr2=0x7ffb2006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb2006b140 0x7ffb2006d600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb28007a80 tx=0x7ffb28009040 comp rx=0 tx=0).stop 2023-10-16T13:47:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 msgr2=0x7ffb341e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 0x7ffb341e6e90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ffb3408c650 tx=0x7ffb2c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 shutdown_connections 2023-10-16T13:47:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3415e050 0x7ffb341e6e90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffb2006b140 0x7ffb2006d600 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb340d1760 0x7ffb341500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 --2- 172.21.15.5:0/1272923662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb340d2250 0x7ffb341e6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 >> 172.21.15.5:0/1272923662 conn(0x7ffb340d37a0 msgr2=0x7ffb340cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 shutdown_connections 2023-10-16T13:47:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:06.883+0000 7ffb39561700 1 -- 172.21.15.5:0/1272923662 wait complete. 2023-10-16T13:47:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:47:06.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:47:07.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.038+0000 7fe3da84a700 1 Processor -- start 2023-10-16T13:47:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.038+0000 7fe3da84a700 1 -- start start 2023-10-16T13:47:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.038+0000 7fe3da84a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3d40cdf10 0x7fe3d40d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3da84a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe3d40cc240 0x7fe3d40cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3da84a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40cbdb0 con 0x7fe3d40b0730 2023-10-16T13:47:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3da84a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d40d0b40 con 0x7fe3d40cdf10 2023-10-16T13:47:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3da84a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d40d0e20 con 0x7fe3d40cc240 2023-10-16T13:47:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3d40cdf10 0x7fe3d40d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3d40cdf10 0x7fe3d40d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46468/0 (socket says 172.21.15.5:46468) 2023-10-16T13:47:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 -- 172.21.15.5:0/1705568638 learned_addr learned my addr 172.21.15.5:0/1705568638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d8de7700 1 --2- 172.21.15.5:0/1705568638 >> v2:172.21.15.112:3300/0 conn(0x7fe3d40cc240 0x7fe3d40cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 -- 172.21.15.5:0/1705568638 >> v2:172.21.15.112:3300/0 conn(0x7fe3d40cc240 msgr2=0x7fe3d40cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 --2- 172.21.15.5:0/1705568638 >> v2:172.21.15.112:3300/0 conn(0x7fe3d40cc240 0x7fe3d40cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 -- 172.21.15.5:0/1705568638 >> v1:172.21.15.112:6789/0 conn(0x7fe3d40b0730 legacy=0x7fe3d40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 -- 172.21.15.5:0/1705568638 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40d1100 con 0x7fe3d40cdf10 2023-10-16T13:47:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d3fff700 1 --2- 172.21.15.5:0/1705568638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40d04b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4072bc0 tx=0x7fe3bc009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb541b18b048ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d2ffd700 1 -- 172.21.15.5:0/1705568638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00b8a0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.039+0000 7fe3d2ffd700 1 -- 172.21.15.5:0/1705568638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00ba00 con 0x7fe3d40cdf10 2023-10-16T13:47:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3d2ffd700 1 -- 172.21.15.5:0/1705568638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00bdb0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 -- 172.21.15.5:0/1705568638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 msgr2=0x7fe3d40d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1705568638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40d04b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4072bc0 tx=0x7fe3bc009bc0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 -- 172.21.15.5:0/1705568638 shutdown_connections 2023-10-16T13:47:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1705568638 >> v2:172.21.15.112:3300/0 conn(0x7fe3d40cc240 0x7fe3d40cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1705568638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40d04b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 -- 172.21.15.5:0/1705568638 >> 172.21.15.5:0/1705568638 conn(0x7fe3d40d1530 msgr2=0x7fe3d40d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 -- 172.21.15.5:0/1705568638 shutdown_connections 2023-10-16T13:47:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.040+0000 7fe3da84a700 1 -- 172.21.15.5:0/1705568638 wait complete. 2023-10-16T13:47:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.041+0000 7fe3da84a700 1 Processor -- start 2023-10-16T13:47:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 -- start start 2023-10-16T13:47:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d40b0730 0x7fe3d4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3d40cc240 0x7fe3d415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40b5aa0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40b6340 con 0x7fe3d40b0730 2023-10-16T13:47:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3da84a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d415f460 con 0x7fe3d40cc240 2023-10-16T13:47:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3d8de7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3d8de7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46478/0 (socket says 172.21.15.5:46478) 2023-10-16T13:47:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.042+0000 7fe3d8de7700 1 -- 172.21.15.5:0/1568786944 learned_addr learned my addr 172.21.15.5:0/1568786944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d3fff700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d40b0730 0x7fe3d4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d37fe700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3d40cc240 0x7fe3d415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d8de7700 1 -- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3d40cc240 msgr2=0x7fe3d415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d8de7700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3d40cc240 0x7fe3d415eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d8de7700 1 -- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d40b0730 msgr2=0x7fe3d4159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d8de7700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d40b0730 0x7fe3d4159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d8de7700 1 -- 172.21.15.5:0/1568786944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc0094f0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d37fe700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3d40cc240 0x7fe3d415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d3fff700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d40b0730 0x7fe3d4159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d8de7700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40c8600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc007d90 tx=0x7fe3cc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00ede0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc014420 con 0x7fe3d40cdf10 2023-10-16T13:47:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40b5cf0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0147d0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.043+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d415f070 con 0x7fe3d40cdf10 2023-10-16T13:47:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.044+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d415f230 con 0x7fe3d40cdf10 2023-10-16T13:47:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.045+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fe3cc014930 con 0x7fe3d40cdf10 2023-10-16T13:47:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.045+0000 7fe3d0ff9700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3b406b140 0x7fe3b406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.045+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fe3cc089eb0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.045+0000 7fe3d3fff700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3b406b140 0x7fe3b406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.046+0000 7fe3d3fff700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3b406b140 0x7fe3b406d600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009c00 tx=0x7fe3bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.050+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3cc054e80 con 0x7fe3d40cdf10 2023-10-16T13:47:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.251+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3d40b64b0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.901+0000 7fe3d0ff9700 1 -- 172.21.15.5:0/1568786944 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe3cc0584a0 con 0x7fe3d40cdf10 2023-10-16T13:47:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3b406b140 msgr2=0x7fe3b406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3b406b140 0x7fe3b406d600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009c00 tx=0x7fe3bc008030 comp rx=0 tx=0).stop 2023-10-16T13:47:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 msgr2=0x7fe3d40c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:07.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40c8600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc007d90 tx=0x7fe3cc00e3c0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 shutdown_connections 2023-10-16T13:47:07.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d40cdf10 0x7fe3d40c8600 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d40b0730 0x7fe3d4159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3b406b140 0x7fe3b406d600 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 --2- 172.21.15.5:0/1568786944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3d40cc240 0x7fe3d415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 >> 172.21.15.5:0/1568786944 conn(0x7fe3d40d1530 msgr2=0x7fe3d406fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 shutdown_connections 2023-10-16T13:47:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:07.905+0000 7fe3da84a700 1 -- 172.21.15.5:0/1568786944 wait complete. 2023-10-16T13:47:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:47:07.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:47:08.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.056+0000 7f68f68cf700 1 Processor -- start 2023-10-16T13:47:08.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.056+0000 7f68f68cf700 1 -- start start 2023-10-16T13:47:08.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68f68cf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68f015ab10 0x7f68f015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68f68cf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68f00b1f50 0x7f68f00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68f68cf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f015e7a0 con 0x7f68f00b2400 2023-10-16T13:47:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68f68cf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f015f730 con 0x7f68f015ab10 2023-10-16T13:47:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68f68cf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00b29a0 con 0x7f68f00b1f50 2023-10-16T13:47:08.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68f015ab10 0x7f68f015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68f015ab10 0x7f68f015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46482/0 (socket says 172.21.15.5:46482) 2023-10-16T13:47:08.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68f4e6c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68f00b2400 0x7f68f00cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56488/0 (socket says 172.21.15.5:56488) 2023-10-16T13:47:08.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 -- 172.21.15.5:0/3531455441 learned_addr learned my addr 172.21.15.5:0/3531455441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:08.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68ef7fe700 1 --2- 172.21.15.5:0/3531455441 >> v2:172.21.15.112:3300/0 conn(0x7f68f00b1f50 0x7f68f00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 -- 172.21.15.5:0/3531455441 >> v2:172.21.15.112:3300/0 conn(0x7f68f00b1f50 msgr2=0x7f68f00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:08.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 --2- 172.21.15.5:0/3531455441 >> v2:172.21.15.112:3300/0 conn(0x7f68f00b1f50 0x7f68f00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 -- 172.21.15.5:0/3531455441 >> v1:172.21.15.5:6789/0 conn(0x7f68f00b2400 legacy=0x7f68f00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68effff700 1 -- 172.21.15.5:0/3531455441 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00b2c80 con 0x7f68f015ab10 2023-10-16T13:47:08.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.057+0000 7f68eeffd700 1 -- 172.21.15.5:0/3531455441 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621079713 0 0) 0x7f68f015e7a0 con 0x7f68f00b2400 2023-10-16T13:47:08.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68effff700 1 --2- 172.21.15.5:0/3531455441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f015ab10 0x7f68f015f1f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f68f006d470 tx=0x7f68d800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ba92c9b70e92f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68eeffd700 1 -- 172.21.15.5:0/3531455441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800dd30 con 0x7f68f015ab10 2023-10-16T13:47:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68eeffd700 1 -- 172.21.15.5:0/3531455441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d800de90 con 0x7f68f015ab10 2023-10-16T13:47:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68eeffd700 1 -- 172.21.15.5:0/3531455441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8010690 con 0x7f68f015ab10 2023-10-16T13:47:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 -- 172.21.15.5:0/3531455441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f015ab10 msgr2=0x7f68f015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 --2- 172.21.15.5:0/3531455441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f015ab10 0x7f68f015f1f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f68f006d470 tx=0x7f68d800be70 comp rx=0 tx=0).stop 2023-10-16T13:47:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 -- 172.21.15.5:0/3531455441 shutdown_connections 2023-10-16T13:47:08.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 --2- 172.21.15.5:0/3531455441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f015ab10 0x7f68f015f1f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 --2- 172.21.15.5:0/3531455441 >> v2:172.21.15.112:3300/0 conn(0x7f68f00b1f50 0x7f68f00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 -- 172.21.15.5:0/3531455441 >> 172.21.15.5:0/3531455441 conn(0x7f68f006dae0 msgr2=0x7f68f006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:08.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 -- 172.21.15.5:0/3531455441 shutdown_connections 2023-10-16T13:47:08.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.058+0000 7f68f68cf700 1 -- 172.21.15.5:0/3531455441 wait complete. 2023-10-16T13:47:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.059+0000 7f68f68cf700 1 Processor -- start 2023-10-16T13:47:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 -- start start 2023-10-16T13:47:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68f00b1f50 0x7f68f014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 0x7f68f00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68f015ab10 0x7f68f00cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c44a0 con 0x7f68f00b2400 2023-10-16T13:47:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00ad930 con 0x7f68f00b1f50 2023-10-16T13:47:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.060+0000 7f68f68cf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00ad370 con 0x7f68f015ab10 2023-10-16T13:47:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 0x7f68f00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 0x7f68f00ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46488/0 (socket says 172.21.15.5:46488) 2023-10-16T13:47:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 -- 172.21.15.5:0/2104809546 learned_addr learned my addr 172.21.15.5:0/2104809546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68effff700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68f00b1f50 0x7f68f014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68f4e6c700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68f015ab10 0x7f68f00cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 -- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68f015ab10 msgr2=0x7f68f00cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68f015ab10 0x7f68f00cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 -- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68f00b1f50 msgr2=0x7f68f014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68f00b1f50 0x7f68f014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 -- 172.21.15.5:0/2104809546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d800b7f0 con 0x7f68f00b2400 2023-10-16T13:47:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ef7fe700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 0x7f68f00ac8b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f68e000d800 tx=0x7f68e000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0017070 con 0x7f68f00b2400 2023-10-16T13:47:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0005a20 con 0x7f68f00b2400 2023-10-16T13:47:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f00ad650 con 0x7f68f00b2400 2023-10-16T13:47:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0005bb0 con 0x7f68f00b2400 2023-10-16T13:47:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.061+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f00aef00 con 0x7f68f00b2400 2023-10-16T13:47:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.062+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f00c4610 con 0x7f68f00b2400 2023-10-16T13:47:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.063+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f68e00125f0 con 0x7f68f00b2400 2023-10-16T13:47:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.063+0000 7f68ecff9700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68d006b140 0x7f68d006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.063+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f68e0089070 con 0x7f68f00b2400 2023-10-16T13:47:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.063+0000 7f68effff700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68d006b140 0x7f68d006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.064+0000 7f68effff700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68d006b140 0x7f68d006d600 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b6f0 tx=0x7f68d801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:08.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.068+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68e0054150 con 0x7f68f00b2400 2023-10-16T13:47:08.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.270+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f68f0067d20 con 0x7f68f00b2400 2023-10-16T13:47:08.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.273+0000 7f68ecff9700 1 -- 172.21.15.5:0/2104809546 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f68e0057770 con 0x7f68f00b2400 2023-10-16T13:47:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68d006b140 msgr2=0x7f68d006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68d006b140 0x7f68d006d600 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b6f0 tx=0x7f68d801c040 comp rx=0 tx=0).stop 2023-10-16T13:47:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 msgr2=0x7f68f00ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 0x7f68f00ac8b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f68e000d800 tx=0x7f68e000db10 comp rx=0 tx=0).stop 2023-10-16T13:47:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 shutdown_connections 2023-10-16T13:47:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f68d006b140 0x7f68d006d600 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68f015ab10 0x7f68f00cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68f00b1f50 0x7f68f014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 --2- 172.21.15.5:0/2104809546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f00b2400 0x7f68f00ac8b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 >> 172.21.15.5:0/2104809546 conn(0x7f68f006dae0 msgr2=0x7f68f00cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 shutdown_connections 2023-10-16T13:47:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.275+0000 7f68f68cf700 1 -- 172.21.15.5:0/2104809546 wait complete. 2023-10-16T13:47:08.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-16T13:47:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.413+0000 7f885fbce700 1 Processor -- start 2023-10-16T13:47:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.413+0000 7f885fbce700 1 -- start start 2023-10-16T13:47:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885fbce700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f885815ab10 0x7f885815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885fbce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88580b1f50 0x7f88580cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885fbce700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885815e7a0 con 0x7f88580b23d0 2023-10-16T13:47:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885fbce700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885815f730 con 0x7f88580b1f50 2023-10-16T13:47:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885fbce700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b29a0 con 0x7f885815ab10 2023-10-16T13:47:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885d169700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88580b1f50 0x7f88580cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885e16b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88580b23d0 0x7f88580cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56502/0 (socket says 172.21.15.5:56502) 2023-10-16T13:47:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885e16b700 1 -- 172.21.15.5:0/3719620595 learned_addr learned my addr 172.21.15.5:0/3719620595 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885d169700 1 --2- 172.21.15.5:0/3719620595 >> v2:172.21.15.5:3300/0 conn(0x7f88580b1f50 0x7f88580cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46494/0 (socket says 172.21.15.5:46494) 2023-10-16T13:47:08.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885d96a700 1 --2- 172.21.15.5:0/3719620595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f885815ab10 0x7f885815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885d169700 1 -- 172.21.15.5:0/3719620595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f885815ab10 msgr2=0x7f885815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:08.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885d169700 1 --2- 172.21.15.5:0/3719620595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f885815ab10 0x7f885815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885d169700 1 -- 172.21.15.5:0/3719620595 >> v1:172.21.15.5:6789/0 conn(0x7f88580b23d0 legacy=0x7f88580cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885d169700 1 -- 172.21.15.5:0/3719620595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580b2c80 con 0x7f88580b1f50 2023-10-16T13:47:08.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.414+0000 7f885c968700 1 -- 172.21.15.5:0/3719620595 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009473436 0 0) 0x7f885815e7a0 con 0x7f88580b23d0 2023-10-16T13:47:08.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885d169700 1 --2- 172.21.15.5:0/3719620595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b1f50 0x7f88580cf720 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8848009820 tx=0x7f8848009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcacf3ff0b2318 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:08.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885c968700 1 -- 172.21.15.5:0/3719620595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848005e30 con 0x7f88580b1f50 2023-10-16T13:47:08.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885c968700 1 -- 172.21.15.5:0/3719620595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848006030 con 0x7f88580b1f50 2023-10-16T13:47:08.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885c968700 1 -- 172.21.15.5:0/3719620595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480063e0 con 0x7f88580b1f50 2023-10-16T13:47:08.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885fbce700 1 -- 172.21.15.5:0/3719620595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b1f50 msgr2=0x7f88580cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885fbce700 1 --2- 172.21.15.5:0/3719620595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b1f50 0x7f88580cf720 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8848009820 tx=0x7f8848009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:08.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885fbce700 1 -- 172.21.15.5:0/3719620595 shutdown_connections 2023-10-16T13:47:08.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885fbce700 1 --2- 172.21.15.5:0/3719620595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f885815ab10 0x7f885815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885fbce700 1 --2- 172.21.15.5:0/3719620595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b1f50 0x7f88580cf720 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.415+0000 7f885fbce700 1 -- 172.21.15.5:0/3719620595 >> 172.21.15.5:0/3719620595 conn(0x7f885806dae0 msgr2=0x7f885806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:08.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.416+0000 7f885fbce700 1 -- 172.21.15.5:0/3719620595 shutdown_connections 2023-10-16T13:47:08.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.416+0000 7f885fbce700 1 -- 172.21.15.5:0/3719620595 wait complete. 2023-10-16T13:47:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.417+0000 7f885fbce700 1 Processor -- start 2023-10-16T13:47:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.417+0000 7f885fbce700 1 -- start start 2023-10-16T13:47:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885fbce700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88580b1f50 0x7f885814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885fbce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 0x7f885815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885fbce700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885815ab10 0x7f88580cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885fbce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b42a0 con 0x7f88580b23d0 2023-10-16T13:47:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885fbce700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b5d70 con 0x7f885815ab10 2023-10-16T13:47:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885fbce700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b3620 con 0x7f88580b1f50 2023-10-16T13:47:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d169700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 0x7f885815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d169700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 0x7f885815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46502/0 (socket says 172.21.15.5:46502) 2023-10-16T13:47:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d169700 1 -- 172.21.15.5:0/2374762400 learned_addr learned my addr 172.21.15.5:0/2374762400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d96a700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88580b1f50 0x7f885814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d169700 1 -- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88580b1f50 msgr2=0x7f885814d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d169700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88580b1f50 0x7f885814d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885e16b700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885815ab10 0x7f88580cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.418+0000 7f885d169700 1 -- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885815ab10 msgr2=0x7f88580cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f885d169700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885815ab10 0x7f88580cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f885d169700 1 -- 172.21.15.5:0/2374762400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009430 con 0x7f88580b23d0 2023-10-16T13:47:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f885d169700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 0x7f885815b8d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8848013040 tx=0x7f8848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848025430 con 0x7f88580b23d0 2023-10-16T13:47:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848020070 con 0x7f88580b23d0 2023-10-16T13:47:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580b3900 con 0x7f88580b23d0 2023-10-16T13:47:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480257d0 con 0x7f88580b23d0 2023-10-16T13:47:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.419+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88580b3ec0 con 0x7f88580b23d0 2023-10-16T13:47:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.420+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858067d20 con 0x7f88580b23d0 2023-10-16T13:47:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.420+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f8848022030 con 0x7f88580b23d0 2023-10-16T13:47:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.421+0000 7f884e7fc700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f883c06b140 0x7f883c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.421+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f884808ad70 con 0x7f88580b23d0 2023-10-16T13:47:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.421+0000 7f885d96a700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f883c06b140 0x7f883c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.422+0000 7f885d96a700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f883c06b140 0x7f883c06d600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8854009950 tx=0x7f8854008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.426+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8848055e50 con 0x7f88580b23d0 2023-10-16T13:47:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.709+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f88580afc10 con 0x7f88580b23d0 2023-10-16T13:47:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.902+0000 7f884e7fc700 1 -- 172.21.15.5:0/2374762400 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v357) v1 ==== 158+0+0 (secure 0 0 0) 0x7f8848059470 con 0x7f88580b23d0 2023-10-16T13:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f883c06b140 msgr2=0x7f883c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f883c06b140 0x7f883c06d600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8854009950 tx=0x7f8854008040 comp rx=0 tx=0).stop 2023-10-16T13:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 msgr2=0x7f885815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 0x7f885815b8d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8848013040 tx=0x7f8848004750 comp rx=0 tx=0).stop 2023-10-16T13:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 shutdown_connections 2023-10-16T13:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885815ab10 0x7f88580cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f883c06b140 0x7f883c06d600 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88580b1f50 0x7f885814d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 --2- 172.21.15.5:0/2374762400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580b23d0 0x7f885815b8d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 >> 172.21.15.5:0/2374762400 conn(0x7f885806dae0 msgr2=0x7f88580724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 shutdown_connections 2023-10-16T13:47:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:08.905+0000 7f885fbce700 1 -- 172.21.15.5:0/2374762400 wait complete. 2023-10-16T13:47:08.920 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ok 2023-10-16T13:47:08.921 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command 2023-10-16T13:47:08.921 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:47:08.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.044+0000 7fd378981700 1 Processor -- start 2023-10-16T13:47:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.044+0000 7fd378981700 1 -- start start 2023-10-16T13:47:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd378981700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3740cd950 0x7fd37415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd378981700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd37406a840 0x7fd37406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd378981700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3740cf260 con 0x7fd3740cede0 2023-10-16T13:47:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd378981700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3741619a0 con 0x7fd37406a840 2023-10-16T13:47:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd378981700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37406b1f0 con 0x7fd3740cd950 2023-10-16T13:47:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd372d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd37406a840 0x7fd37406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd372d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd37406a840 0x7fd37406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46512/0 (socket says 172.21.15.5:46512) 2023-10-16T13:47:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd371d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd3740cede0 0x7fd37415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56514/0 (socket says 172.21.15.5:56514) 2023-10-16T13:47:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.045+0000 7fd372d9d700 1 -- 172.21.15.5:0/332108724 learned_addr learned my addr 172.21.15.5:0/332108724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd37259c700 1 --2- 172.21.15.5:0/332108724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3740cd950 0x7fd37415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd372d9d700 1 -- 172.21.15.5:0/332108724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3740cd950 msgr2=0x7fd37415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:09.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd372d9d700 1 --2- 172.21.15.5:0/332108724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3740cd950 0x7fd37415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd372d9d700 1 -- 172.21.15.5:0/332108724 >> v1:172.21.15.5:6789/0 conn(0x7fd3740cede0 legacy=0x7fd37415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd372d9d700 1 -- 172.21.15.5:0/332108724 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740b2d60 con 0x7fd37406a840 2023-10-16T13:47:09.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd37159a700 1 -- 172.21.15.5:0/332108724 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489942413 0 0) 0x7fd3740cf260 con 0x7fd3740cede0 2023-10-16T13:47:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd372d9d700 1 --2- 172.21.15.5:0/332108724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37406a840 0x7fd37406acb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009e50 tx=0x7fd36c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec4de6be2ba52e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd37159a700 1 -- 172.21.15.5:0/332108724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00e070 con 0x7fd37406a840 2023-10-16T13:47:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd37159a700 1 -- 172.21.15.5:0/332108724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c00b9c0 con 0x7fd37406a840 2023-10-16T13:47:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.046+0000 7fd37159a700 1 -- 172.21.15.5:0/332108724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00bd70 con 0x7fd37406a840 2023-10-16T13:47:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 -- 172.21.15.5:0/332108724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37406a840 msgr2=0x7fd37406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 --2- 172.21.15.5:0/332108724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37406a840 0x7fd37406acb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009e50 tx=0x7fd36c00b330 comp rx=0 tx=0).stop 2023-10-16T13:47:09.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 -- 172.21.15.5:0/332108724 shutdown_connections 2023-10-16T13:47:09.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 --2- 172.21.15.5:0/332108724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37406a840 0x7fd37406acb0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 --2- 172.21.15.5:0/332108724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3740cd950 0x7fd37415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 -- 172.21.15.5:0/332108724 >> 172.21.15.5:0/332108724 conn(0x7fd37406dae0 msgr2=0x7fd37406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:09.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 -- 172.21.15.5:0/332108724 shutdown_connections 2023-10-16T13:47:09.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.047+0000 7fd378981700 1 -- 172.21.15.5:0/332108724 wait complete. 2023-10-16T13:47:09.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.048+0000 7fd378981700 1 Processor -- start 2023-10-16T13:47:09.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.048+0000 7fd378981700 1 -- start start 2023-10-16T13:47:09.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd378981700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd37406a840 0x7fd3741e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd378981700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3740cd950 0x7fd3741530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd378981700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 0x7fd3741605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd378981700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741e88d0 con 0x7fd3740cede0 2023-10-16T13:47:09.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd378981700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740b57b0 con 0x7fd3740cd950 2023-10-16T13:47:09.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd378981700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740b3460 con 0x7fd37406a840 2023-10-16T13:47:09.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 0x7fd3741605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 0x7fd3741605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46518/0 (socket says 172.21.15.5:46518) 2023-10-16T13:47:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 -- 172.21.15.5:0/3535179095 learned_addr learned my addr 172.21.15.5:0/3535179095 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd37259c700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd37406a840 0x7fd3741e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd371d9b700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3740cd950 0x7fd3741530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 -- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd37406a840 msgr2=0x7fd3741e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd37406a840 0x7fd3741e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 -- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3740cd950 msgr2=0x7fd3741530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3740cd950 0x7fd3741530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd372d9d700 1 -- 172.21.15.5:0/3535179095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009b30 con 0x7fd3740cede0 2023-10-16T13:47:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd37259c700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd37406a840 0x7fd3741e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.049+0000 7fd371d9b700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3740cd950 0x7fd3741530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.050+0000 7fd372d9d700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 0x7fd3741605b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd37406d4f0 tx=0x7fd36c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.050+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c003ea0 con 0x7fd3740cede0 2023-10-16T13:47:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.050+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0092e0 con 0x7fd3740cede0 2023-10-16T13:47:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.050+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c01b650 con 0x7fd3740cede0 2023-10-16T13:47:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.050+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3740b3740 con 0x7fd3740cede0 2023-10-16T13:47:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.050+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3740b3d00 con 0x7fd3740cede0 2023-10-16T13:47:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.051+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374067d20 con 0x7fd3740cede0 2023-10-16T13:47:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.051+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fd36c01b7b0 con 0x7fd3740cede0 2023-10-16T13:47:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.052+0000 7fd362ffd700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd35406b140 0x7fd35406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.052+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd36c08b200 con 0x7fd3740cede0 2023-10-16T13:47:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.052+0000 7fd37259c700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd35406b140 0x7fd35406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.052+0000 7fd37259c700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd35406b140 0x7fd35406d600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd3680099f0 tx=0x7fd368008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.056+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd36c056130 con 0x7fd3740cede0 2023-10-16T13:47:09.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.257+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3740b2630 con 0x7fd3740cede0 2023-10-16T13:47:09.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.258+0000 7fd362ffd700 1 -- 172.21.15.5:0/3535179095 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+12917 (secure 0 0 0) 0x7fd36c059750 con 0x7fd3740cede0 2023-10-16T13:47:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:09.261 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":67,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:07.895489+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6836/2729748635":"2023-10-17T13:47:04.656086+0000","172.21.15.112:6834/2729748635":"2023-10-17T13:47:04.656086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd35406b140 msgr2=0x7fd35406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd35406b140 0x7fd35406d600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd3680099f0 tx=0x7fd368008040 comp rx=0 tx=0).stop 2023-10-16T13:47:09.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 msgr2=0x7fd3741605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 0x7fd3741605b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd37406d4f0 tx=0x7fd36c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 shutdown_connections 2023-10-16T13:47:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3740cede0 0x7fd3741605b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd35406b140 0x7fd35406d600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd37406a840 0x7fd3741e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 --2- 172.21.15.5:0/3535179095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3740cd950 0x7fd3741530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 >> 172.21.15.5:0/3535179095 conn(0x7fd37406dae0 msgr2=0x7fd3740cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 shutdown_connections 2023-10-16T13:47:09.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.260+0000 7fd378981700 1 -- 172.21.15.5:0/3535179095 wait complete. 2023-10-16T13:47:09.275 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:09.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:09.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.400+0000 7fd91d9c1700 1 Processor -- start 2023-10-16T13:47:09.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.400+0000 7fd91d9c1700 1 -- start start 2023-10-16T13:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.401+0000 7fd91d9c1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd9180cd950 0x7fd91815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.401+0000 7fd91d9c1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd91815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.401+0000 7fd91d9c1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180cf260 con 0x7fd91806a840 2023-10-16T13:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.401+0000 7fd91d9c1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9181619a0 con 0x7fd9180cd950 2023-10-16T13:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.401+0000 7fd91d9c1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180b2d60 con 0x7fd9180cede0 2023-10-16T13:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd9167fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd91815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd9180cd950 0x7fd91815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd9167fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd91815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:44428/0 (socket says 172.21.15.5:44428) 2023-10-16T13:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd9180cd950 0x7fd91815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42418/0 (socket says 172.21.15.5:42418) 2023-10-16T13:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd9167fc700 1 -- 172.21.15.5:0/565891916 learned_addr learned my addr 172.21.15.5:0/565891916 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 -- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 msgr2=0x7fd91815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 --2- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd91815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 -- 172.21.15.5:0/565891916 >> v1:172.21.15.112:6789/0 conn(0x7fd91806a840 legacy=0x7fd918161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd915ffb700 1 -- 172.21.15.5:0/565891916 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314530185 0 0) 0x7fd9180cf260 con 0x7fd91806a840 2023-10-16T13:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 -- 172.21.15.5:0/565891916 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9180cdd30 con 0x7fd9180cd950 2023-10-16T13:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd9167fc700 1 --2- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd91815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd916ffd700 1 --2- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd91815e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009840 tx=0x7fd90c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf1dc026180a8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd915ffb700 1 -- 172.21.15.5:0/565891916 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011830 con 0x7fd9180cd950 2023-10-16T13:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd915ffb700 1 -- 172.21.15.5:0/565891916 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c011990 con 0x7fd9180cd950 2023-10-16T13:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.402+0000 7fd915ffb700 1 -- 172.21.15.5:0/565891916 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011d20 con 0x7fd9180cd950 2023-10-16T13:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 -- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 msgr2=0x7fd91815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd91815e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009840 tx=0x7fd90c009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 -- 172.21.15.5:0/565891916 shutdown_connections 2023-10-16T13:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd91815e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/565891916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd91815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 -- 172.21.15.5:0/565891916 >> 172.21.15.5:0/565891916 conn(0x7fd91806dae0 msgr2=0x7fd91806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 -- 172.21.15.5:0/565891916 shutdown_connections 2023-10-16T13:47:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.403+0000 7fd91d9c1700 1 -- 172.21.15.5:0/565891916 wait complete. 2023-10-16T13:47:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.404+0000 7fd91d9c1700 1 Processor -- start 2023-10-16T13:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.404+0000 7fd91d9c1700 1 -- start start 2023-10-16T13:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd91d9c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 0x7fd918153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd91d9c1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd9180c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd91d9c1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd9180c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd91d9c1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c7ab0 con 0x7fd91806a840 2023-10-16T13:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd91d9c1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd918154000 con 0x7fd9180cd950 2023-10-16T13:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd91d9c1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180b5420 con 0x7fd9180cede0 2023-10-16T13:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd916ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 0x7fd918153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd916ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 0x7fd918153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46528/0 (socket says 172.21.15.5:46528) 2023-10-16T13:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd916ffd700 1 -- 172.21.15.5:0/1586384980 learned_addr learned my addr 172.21.15.5:0/1586384980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd9167fc700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd9180c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.405+0000 7fd9177fe700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd9180c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd916ffd700 1 -- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 msgr2=0x7fd9180c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd916ffd700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd9180c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd916ffd700 1 -- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 msgr2=0x7fd9180c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd916ffd700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd9180c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd916ffd700 1 -- 172.21.15.5:0/1586384980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009500 con 0x7fd91806a840 2023-10-16T13:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd916ffd700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 0x7fd918153ac0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009fd0 tx=0x7fd90c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0036a0 con 0x7fd91806a840 2023-10-16T13:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c01f070 con 0x7fd91806a840 2023-10-16T13:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c0094a0 con 0x7fd91806a840 2023-10-16T13:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c003a40 con 0x7fd91806a840 2023-10-16T13:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.406+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9180c76d0 con 0x7fd91806a840 2023-10-16T13:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.407+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd918067d20 con 0x7fd91806a840 2023-10-16T13:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.407+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fd90c003ba0 con 0x7fd91806a840 2023-10-16T13:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.408+0000 7fd8fffff700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd90406b140 0x7fd90406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.408+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd90c021070 con 0x7fd91806a840 2023-10-16T13:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.408+0000 7fd9167fc700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd90406b140 0x7fd90406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.409+0000 7fd9167fc700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd90406b140 0x7fd90406d600 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd9181f6aa0 tx=0x7fd908008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.413+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd90c056130 con 0x7fd91806a840 2023-10-16T13:47:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.620+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9180b2100 con 0x7fd91806a840 2023-10-16T13:47:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.621+0000 7fd8fffff700 1 -- 172.21.15.5:0/1586384980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd90c059750 con 0x7fd91806a840 2023-10-16T13:47:09.624 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd90406b140 msgr2=0x7fd90406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd90406b140 0x7fd90406d600 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd9181f6aa0 tx=0x7fd908008040 comp rx=0 tx=0).stop 2023-10-16T13:47:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 msgr2=0x7fd918153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 0x7fd918153ac0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009fd0 tx=0x7fd90c004750 comp rx=0 tx=0).stop 2023-10-16T13:47:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 shutdown_connections 2023-10-16T13:47:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd90406b140 0x7fd90406d600 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9180cede0 0x7fd9180c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91806a840 0x7fd918153ac0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 --2- 172.21.15.5:0/1586384980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9180cd950 0x7fd9180c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.622+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 >> 172.21.15.5:0/1586384980 conn(0x7fd91806dae0 msgr2=0x7fd91815d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.623+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 shutdown_connections 2023-10-16T13:47:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.623+0000 7fd91d9c1700 1 -- 172.21.15.5:0/1586384980 wait complete. 2023-10-16T13:47:09.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-16T13:47:09.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.760+0000 7f4e89009700 1 Processor -- start 2023-10-16T13:47:09.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.760+0000 7f4e89009700 1 -- start start 2023-10-16T13:47:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e89009700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4e8415ab10 0x7f4e8415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e89009700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e840cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e89009700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8415e7a0 con 0x7f4e840b23d0 2023-10-16T13:47:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e89009700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8415f730 con 0x7f4e8415ab10 2023-10-16T13:47:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e89009700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840b29a0 con 0x7f4e840b1f50 2023-10-16T13:47:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e8359e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4e840b23d0 0x7f4e840cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56544/0 (socket says 172.21.15.5:56544) 2023-10-16T13:47:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e8359e700 1 -- 172.21.15.5:0/1669925992 learned_addr learned my addr 172.21.15.5:0/1669925992 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895487159 0 0) 0x7f4e8415e7a0 con 0x7f4e840b23d0 2023-10-16T13:47:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e82d9d700 1 --2- 172.21.15.5:0/1669925992 >> v2:172.21.15.112:3300/0 conn(0x7f4e8415ab10 0x7f4e8415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e8259c700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e840cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c0035b0 con 0x7f4e840b23d0 2023-10-16T13:47:09.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697991199 0 0) 0x7f4e6c0035b0 con 0x7f4e840b23d0 2023-10-16T13:47:09.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 msgr2=0x7f4e840cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:09.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e840cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 >> v2:172.21.15.112:3300/0 conn(0x7f4e8415ab10 msgr2=0x7f4e8415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.761+0000 7f4e81d9b700 1 --2- 172.21.15.5:0/1669925992 >> v2:172.21.15.112:3300/0 conn(0x7f4e8415ab10 0x7f4e8415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840b2c80 con 0x7f4e840b23d0 2023-10-16T13:47:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f4e7c0019f0 con 0x7f4e840b23d0 2023-10-16T13:47:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 >> v1:172.21.15.5:6789/0 conn(0x7f4e840b23d0 legacy=0x7f4e840cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c003a00 0x7f4e6c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e6c004850 0x7f4e6c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e6c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8415f730 con 0x7f4e6c004850 2023-10-16T13:47:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840b29a0 con 0x7f4e6c003a00 2023-10-16T13:47:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c00dc20 con 0x7f4e840b1f50 2023-10-16T13:47:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e6c004850 0x7f4e6c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e82d9d700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c003a00 0x7f4e6c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8359e700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e6c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 -- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 msgr2=0x7f4e6c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e6c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 -- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c003a00 msgr2=0x7f4e6c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c003a00 0x7f4e6c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 -- 172.21.15.5:0/1669925992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0035b0 con 0x7f4e6c004850 2023-10-16T13:47:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8359e700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840b1f50 0x7f4e6c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e8259c700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e6c004850 0x7f4e6c004cd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009b40 tx=0x7f4e6c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491a878e350a2aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74005a20 con 0x7f4e6c004850 2023-10-16T13:47:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74005b80 con 0x7f4e6c004850 2023-10-16T13:47:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.762+0000 7f4e81d9b700 1 -- 172.21.15.5:0/1669925992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7400e6c0 con 0x7f4e6c004850 2023-10-16T13:47:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e89009700 1 -- 172.21.15.5:0/1669925992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e6c004850 msgr2=0x7f4e6c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e89009700 1 --2- 172.21.15.5:0/1669925992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e6c004850 0x7f4e6c004cd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009b40 tx=0x7f4e6c005880 comp rx=0 tx=0).stop 2023-10-16T13:47:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e8359e700 1 -- 172.21.15.5:0/1669925992 reap_dead start 2023-10-16T13:47:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e89009700 1 -- 172.21.15.5:0/1669925992 shutdown_connections 2023-10-16T13:47:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e89009700 1 -- 172.21.15.5:0/1669925992 >> 172.21.15.5:0/1669925992 conn(0x7f4e8406dae0 msgr2=0x7f4e8406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e89009700 1 -- 172.21.15.5:0/1669925992 shutdown_connections 2023-10-16T13:47:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.763+0000 7f4e89009700 1 -- 172.21.15.5:0/1669925992 wait complete. 2023-10-16T13:47:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.764+0000 7f4e89009700 1 Processor -- start 2023-10-16T13:47:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.764+0000 7f4e89009700 1 -- start start 2023-10-16T13:47:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e89009700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c004850 0x7f4e8414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e89009700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 0x7f4e840b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e89009700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840c6b70 0x7f4e840b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e89009700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c4ff0 con 0x7f4e840c66f0 2023-10-16T13:47:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e89009700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c43e0 con 0x7f4e6c004850 2023-10-16T13:47:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e89009700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c46c0 con 0x7f4e840c6b70 2023-10-16T13:47:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e8259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 0x7f4e840b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e8259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 0x7f4e840b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46550/0 (socket says 172.21.15.5:46550) 2023-10-16T13:47:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.765+0000 7f4e8259c700 1 -- 172.21.15.5:0/4065059087 learned_addr learned my addr 172.21.15.5:0/4065059087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e82d9d700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c004850 0x7f4e8414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8359e700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840c6b70 0x7f4e840b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8259c700 1 -- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840c6b70 msgr2=0x7f4e840b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8259c700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840c6b70 0x7f4e840b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8259c700 1 -- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c004850 msgr2=0x7f4e8414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8259c700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c004850 0x7f4e8414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8259c700 1 -- 172.21.15.5:0/4065059087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840c49a0 con 0x7f4e840c66f0 2023-10-16T13:47:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8359e700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840c6b70 0x7f4e840b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e82d9d700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c004850 0x7f4e8414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e8259c700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 0x7f4e840b07b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0046a0 tx=0x7f4e740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74021070 con 0x7f4e840c66f0 2023-10-16T13:47:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74004030 con 0x7f4e840c66f0 2023-10-16T13:47:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840c4c80 con 0x7f4e840c66f0 2023-10-16T13:47:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74004460 con 0x7f4e840c66f0 2023-10-16T13:47:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.766+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e840c4000 con 0x7f4e840c66f0 2023-10-16T13:47:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.767+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8415c630 con 0x7f4e840c66f0 2023-10-16T13:47:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.768+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f4e740036a0 con 0x7f4e840c66f0 2023-10-16T13:47:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.768+0000 7f4e6b7fe700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e7006b140 0x7f4e7006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.768+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e7408ab00 con 0x7f4e840c66f0 2023-10-16T13:47:09.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.768+0000 7f4e82d9d700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e7006b140 0x7f4e7006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:09.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.769+0000 7f4e82d9d700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e7006b140 0x7f4e7006d600 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e840b1c70 tx=0x7f4e78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:09.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:09.773+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e74055c30 con 0x7f4e840c66f0 2023-10-16T13:47:10.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.057+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f4e840c7260 con 0x7f4e840c66f0 2023-10-16T13:47:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.908+0000 7f4e6b7fe700 1 -- 172.21.15.5:0/4065059087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v359) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4e74059250 con 0x7f4e840c66f0 2023-10-16T13:47:10.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e7006b140 msgr2=0x7f4e7006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:10.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e7006b140 0x7f4e7006d600 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e840b1c70 tx=0x7f4e78008040 comp rx=0 tx=0).stop 2023-10-16T13:47:10.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 msgr2=0x7f4e840b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 0x7f4e840b07b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0046a0 tx=0x7f4e740047c0 comp rx=0 tx=0).stop 2023-10-16T13:47:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 shutdown_connections 2023-10-16T13:47:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e7006b140 0x7f4e7006d600 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e840c6b70 0x7f4e840b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c004850 0x7f4e8414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 --2- 172.21.15.5:0/4065059087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e840c66f0 0x7f4e840b07b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 >> 172.21.15.5:0/4065059087 conn(0x7f4e8406dae0 msgr2=0x7f4e840c3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 shutdown_connections 2023-10-16T13:47:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:10.911+0000 7f4e89009700 1 -- 172.21.15.5:0/4065059087 wait complete. 2023-10-16T13:47:10.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:47:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.061+0000 7f3cb1972700 1 Processor -- start 2023-10-16T13:47:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.061+0000 7f3cb1972700 1 -- start start 2023-10-16T13:47:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3cb1972700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cac15dbc0 0x7f3cac15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3cb1972700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac0d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3cb1972700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac15e4e0 con 0x7f3cac0d3fc0 2023-10-16T13:47:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3cb1972700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0b7560 con 0x7f3cac15dbc0 2023-10-16T13:47:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3cb1972700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b7840 con 0x7f3cac0b7050 2023-10-16T13:47:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cac15dbc0 0x7f3cac15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cac15dbc0 0x7f3cac15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46556/0 (socket says 172.21.15.5:46556) 2023-10-16T13:47:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 -- 172.21.15.5:0/1651747270 learned_addr learned my addr 172.21.15.5:0/1651747270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3cab7fe700 1 --2- 172.21.15.5:0/1651747270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac0d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 -- 172.21.15.5:0/1651747270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 msgr2=0x7f3cac0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 --2- 172.21.15.5:0/1651747270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac0d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 -- 172.21.15.5:0/1651747270 >> v1:172.21.15.112:6789/0 conn(0x7f3cac0d3fc0 legacy=0x7f3cac0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.062+0000 7f3caaffd700 1 -- 172.21.15.5:0/1651747270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0b7b20 con 0x7f3cac15dbc0 2023-10-16T13:47:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3caaffd700 1 --2- 172.21.15.5:0/1651747270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac15dfa0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0006fd0 tx=0x7f3ca0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d1ca788b43fb8a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3ca9ffb700 1 -- 172.21.15.5:0/1651747270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0005e30 con 0x7f3cac15dbc0 2023-10-16T13:47:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3ca9ffb700 1 -- 172.21.15.5:0/1651747270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0006030 con 0x7f3cac15dbc0 2023-10-16T13:47:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3ca9ffb700 1 -- 172.21.15.5:0/1651747270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00063c0 con 0x7f3cac15dbc0 2023-10-16T13:47:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 -- 172.21.15.5:0/1651747270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 msgr2=0x7f3cac15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 --2- 172.21.15.5:0/1651747270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac15dfa0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0006fd0 tx=0x7f3ca0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 -- 172.21.15.5:0/1651747270 shutdown_connections 2023-10-16T13:47:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 --2- 172.21.15.5:0/1651747270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac0d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 --2- 172.21.15.5:0/1651747270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac15dfa0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 -- 172.21.15.5:0/1651747270 >> 172.21.15.5:0/1651747270 conn(0x7f3cac09cb40 msgr2=0x7f3cac0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 -- 172.21.15.5:0/1651747270 shutdown_connections 2023-10-16T13:47:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.063+0000 7f3cb1972700 1 -- 172.21.15.5:0/1651747270 wait complete. 2023-10-16T13:47:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 Processor -- start 2023-10-16T13:47:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 -- start start 2023-10-16T13:47:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cac0d3fc0 0x7f3cac0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac157dc0 con 0x7f3cac15dbc0 2023-10-16T13:47:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1581e0 con 0x7f3cac0d3fc0 2023-10-16T13:47:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.065+0000 7f3cb1972700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1598b0 con 0x7f3cac0b7050 2023-10-16T13:47:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac0cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46566/0 (socket says 172.21.15.5:46566) 2023-10-16T13:47:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 -- 172.21.15.5:0/3483016404 learned_addr learned my addr 172.21.15.5:0/3483016404 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3caa7fc700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cac0d3fc0 0x7f3cac0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3caaffd700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 -- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 msgr2=0x7f3cac148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 -- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cac0d3fc0 msgr2=0x7f3cac0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cac0d3fc0 0x7f3cac0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 -- 172.21.15.5:0/3483016404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0009500 con 0x7f3cac15dbc0 2023-10-16T13:47:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3caaffd700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cab7fe700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac0cc7e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4007e40 tx=0x7f3ca400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:11.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400ede0 con 0x7f3cac15dbc0 2023-10-16T13:47:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4014420 con 0x7f3cac15dbc0 2023-10-16T13:47:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40147d0 con 0x7f3cac15dbc0 2023-10-16T13:47:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac157140 con 0x7f3cac15dbc0 2023-10-16T13:47:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.066+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac157700 con 0x7f3cac15dbc0 2023-10-16T13:47:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.067+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac157f00 con 0x7f3cac15dbc0 2023-10-16T13:47:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.068+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f3ca4014930 con 0x7f3cac15dbc0 2023-10-16T13:47:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.068+0000 7f3c93fff700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c9806b140 0x7f3c9806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.068+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3ca4089cb0 con 0x7f3cac15dbc0 2023-10-16T13:47:11.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.069+0000 7f3caaffd700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c9806b140 0x7f3c9806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.069+0000 7f3caaffd700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c9806b140 0x7f3c9806d600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0013040 tx=0x7f3ca0008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:11.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.073+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cac157f00 con 0x7f3cac15dbc0 2023-10-16T13:47:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.276+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3cac157f00 con 0x7f3cac15dbc0 2023-10-16T13:47:11.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.279+0000 7f3c93fff700 1 -- 172.21.15.5:0/3483016404 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cac157f00 con 0x7f3cac15dbc0 2023-10-16T13:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c9806b140 msgr2=0x7f3c9806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c9806b140 0x7f3c9806d600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0013040 tx=0x7f3ca0008070 comp rx=0 tx=0).stop 2023-10-16T13:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 msgr2=0x7f3cac0cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac0cc7e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4007e40 tx=0x7f3ca400e3c0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 shutdown_connections 2023-10-16T13:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cac15dbc0 0x7f3cac0cc7e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3c9806b140 0x7f3c9806d600 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cac0b7050 0x7f3cac148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 --2- 172.21.15.5:0/3483016404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cac0d3fc0 0x7f3cac0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 >> 172.21.15.5:0/3483016404 conn(0x7f3cac09cb40 msgr2=0x7f3cac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 shutdown_connections 2023-10-16T13:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.281+0000 7f3cb1972700 1 -- 172.21.15.5:0/3483016404 wait complete. 2023-10-16T13:47:11.296 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:47:11.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:47:11.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:47:11.381 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:47:11.381 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:11.382 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:11.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:47:11.400 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:11.400 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:11.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:47:11.442 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:11.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:11.460 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:47:11.460 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:11.460 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:11.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:47:11.500 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:47:11.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:11.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.623+0000 7f99864b7700 1 Processor -- start 2023-10-16T13:47:11.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.623+0000 7f99864b7700 1 -- start start 2023-10-16T13:47:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.623+0000 7f99864b7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f998015ab10 0x7f998015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.623+0000 7f99864b7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998015e7a0 con 0x7f99800cfe30 2023-10-16T13:47:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.623+0000 7f99864b7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998015f730 con 0x7f99800b1f50 2023-10-16T13:47:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.623+0000 7f99864b7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800b29a0 con 0x7f998015ab10 2023-10-16T13:47:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f9984a54700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f99800cfe30 0x7f99800cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56576/0 (socket says 172.21.15.5:56576) 2023-10-16T13:47:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f9984a54700 1 -- 172.21.15.5:0/182221705 learned_addr learned my addr 172.21.15.5:0/182221705 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997ffff700 1 --2- 172.21.15.5:0/182221705 >> v2:172.21.15.112:3300/0 conn(0x7f998015ab10 0x7f998015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366801625 0 0) 0x7f998015e7a0 con 0x7f99800cfe30 2023-10-16T13:47:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99680057c0 con 0x7f99800cfe30 2023-10-16T13:47:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273489575 0 0) 0x7f99680057c0 con 0x7f99800cfe30 2023-10-16T13:47:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 >> v2:172.21.15.112:3300/0 conn(0x7f998015ab10 msgr2=0x7f998015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 --2- 172.21.15.5:0/182221705 >> v2:172.21.15.112:3300/0 conn(0x7f998015ab10 0x7f998015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 >> v1:172.21.15.112:6789/0 conn(0x7f99800b1f50 legacy=0x7f99800cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800b2c80 con 0x7f99800cfe30 2023-10-16T13:47:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f99780019f0 con 0x7f99800cfe30 2023-10-16T13:47:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 >> v1:172.21.15.5:6789/0 conn(0x7f99800cfe30 legacy=0x7f99800cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9968005c10 0x7f9968006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968006a60 0x7f9968006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968007420 0x7f996800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800b29a0 con 0x7f9968006a60 2023-10-16T13:47:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996800e2c0 con 0x7f9968007420 2023-10-16T13:47:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996800e480 con 0x7f9968005c10 2023-10-16T13:47:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.624+0000 7f997f7fe700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968006a60 0x7f9968006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997ffff700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9968005c10 0x7f9968006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f9984a54700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968007420 0x7f996800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997f7fe700 1 -- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9968005c10 msgr2=0x7f9968006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997f7fe700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9968005c10 0x7f9968006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997f7fe700 1 -- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968007420 msgr2=0x7f996800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997f7fe700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968007420 0x7f996800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997f7fe700 1 -- 172.21.15.5:0/182221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680057c0 con 0x7f9968006a60 2023-10-16T13:47:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997ffff700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9968005c10 0x7f9968006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f9984a54700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968007420 0x7f996800dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f9984a54700 1 -- 172.21.15.5:0/182221705 reap_dead start 2023-10-16T13:47:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997f7fe700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968006a60 0x7f9968006ee0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9974001820 tx=0x7f9968007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f297d748d3126114 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740012e0 con 0x7f9968006a60 2023-10-16T13:47:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99740052d0 con 0x7f9968006a60 2023-10-16T13:47:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.625+0000 7f997effd700 1 -- 172.21.15.5:0/182221705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740036d0 con 0x7f9968006a60 2023-10-16T13:47:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 -- 172.21.15.5:0/182221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968006a60 msgr2=0x7f9968006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968006a60 0x7f9968006ee0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9974001820 tx=0x7f9968007a90 comp rx=0 tx=0).stop 2023-10-16T13:47:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 -- 172.21.15.5:0/182221705 shutdown_connections 2023-10-16T13:47:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 --2- 172.21.15.5:0/182221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968006a60 0x7f9968006ee0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 -- 172.21.15.5:0/182221705 >> 172.21.15.5:0/182221705 conn(0x7f998006dae0 msgr2=0x7f998006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 -- 172.21.15.5:0/182221705 shutdown_connections 2023-10-16T13:47:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.626+0000 7f99864b7700 1 -- 172.21.15.5:0/182221705 wait complete. 2023-10-16T13:47:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.627+0000 7f99864b7700 1 Processor -- start 2023-10-16T13:47:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.627+0000 7f99864b7700 1 -- start start 2023-10-16T13:47:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f99864b7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968006a60 0x7f99800c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f99864b7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99800b16e0 0x7f9980156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f99864b7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 0x7f99800b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f99864b7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800ae500 con 0x7f998015aef0 2023-10-16T13:47:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f99864b7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800c7df0 con 0x7f9968006a60 2023-10-16T13:47:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f99864b7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99800c84d0 con 0x7f99800b16e0 2023-10-16T13:47:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 0x7f99800b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 0x7f99800b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46584/0 (socket says 172.21.15.5:46584) 2023-10-16T13:47:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 -- 172.21.15.5:0/2828247561 learned_addr learned my addr 172.21.15.5:0/2828247561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f997ffff700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968006a60 0x7f99800c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f997f7fe700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99800b16e0 0x7f9980156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 -- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99800b16e0 msgr2=0x7f9980156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99800b16e0 0x7f9980156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 -- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968006a60 msgr2=0x7f99800c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968006a60 0x7f99800c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 -- 172.21.15.5:0/2828247561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800ca420 con 0x7f998015aef0 2023-10-16T13:47:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.628+0000 7f9984a54700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 0x7f99800b07a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f99800c7550 tx=0x7f997800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.629+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978017070 con 0x7f998015aef0 2023-10-16T13:47:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.629+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800ec20 con 0x7f998015aef0 2023-10-16T13:47:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.629+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99800c9e60 con 0x7f998015aef0 2023-10-16T13:47:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.629+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800edb0 con 0x7f998015aef0 2023-10-16T13:47:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.629+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99800c9b10 con 0x7f998015aef0 2023-10-16T13:47:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.630+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99800ae640 con 0x7f998015aef0 2023-10-16T13:47:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.630+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f9978013420 con 0x7f998015aef0 2023-10-16T13:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.630+0000 7f997cff9700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f996c06b140 0x7f996c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.630+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9978089240 con 0x7f998015aef0 2023-10-16T13:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.631+0000 7f997ffff700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f996c06b140 0x7f996c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.631+0000 7f997ffff700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f996c06b140 0x7f996c06d600 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9970009bb0 tx=0x7f9970008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.635+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99800ae640 con 0x7f998015aef0 2023-10-16T13:47:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.880+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99800ae640 con 0x7f998015aef0 2023-10-16T13:47:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.880+0000 7f997cff9700 1 -- 172.21.15.5:0/2828247561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f99800ae640 con 0x7f998015aef0 2023-10-16T13:47:11.884 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:11.884 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2279531051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2279531051},{"type":"v1","addr":"172.21.15.112:6837","nonce":2279531051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6024,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/412112461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":412112461},{"type":"v1","addr":"172.21.15.5:6834","nonce":412112461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6027,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2000069934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2000069934},{"type":"v1","addr":"172.21.15.5:6835","nonce":2000069934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1396435845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1396435845},{"type":"v1","addr":"172.21.15.112:6836","nonce":1396435845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[]} 2023-10-16T13:47:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.882+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f996c06b140 msgr2=0x7f996c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.882+0000 7f99864b7700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f996c06b140 0x7f996c06d600 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9970009bb0 tx=0x7f9970008040 comp rx=0 tx=0).stop 2023-10-16T13:47:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 msgr2=0x7f99800b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 0x7f99800b07a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f99800c7550 tx=0x7f997800e440 comp rx=0 tx=0).stop 2023-10-16T13:47:11.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 shutdown_connections 2023-10-16T13:47:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998015aef0 0x7f99800b07a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9968006a60 0x7f99800c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f996c06b140 0x7f996c06d600 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 --2- 172.21.15.5:0/2828247561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99800b16e0 0x7f9980156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 >> 172.21.15.5:0/2828247561 conn(0x7f998006dae0 msgr2=0x7f99800b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:11.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 shutdown_connections 2023-10-16T13:47:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:11.883+0000 7f99864b7700 1 -- 172.21.15.5:0/2828247561 wait complete. 2023-10-16T13:47:11.888 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2023-10-16T13:47:11.898 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:47:11.898 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:47:11.898 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:47:11.899 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:11.899 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:47:11.899 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:47:11.900 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:47:11.900 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:11.900 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:47:11.900 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:47:11.901 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:47:11.901 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:11.901 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:47:11.902 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:47:11.902 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:47:11.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:11.908 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:47:11.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:47:11.909 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:47:11.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:47:11.912 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:47:11.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:47:11.913 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:47:11.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:47:11.950 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:47:11.950 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:11.951 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:47:11.951 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:11.955 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:47:11.955 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:11.956 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:47:11.956 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:11.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:47:12.032 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:47:12.033 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:47:12.040 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:47:12.041 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:47:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 Processor -- start 2023-10-16T13:47:12.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 -- start start 2023-10-16T13:47:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a04153ff0 0x7f3a041543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a0415dac0 0x7f3a040ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0415e9d0 con 0x7f3a040cecb0 2023-10-16T13:47:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040ccc90 con 0x7f3a04153ff0 2023-10-16T13:47:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.085+0000 7f3a0aed8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040ce2e0 con 0x7f3a0415dac0 2023-10-16T13:47:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a08c74700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a04153ff0 0x7f3a041543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a03fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a0415dac0 0x7f3a040ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a09475700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3a040cecb0 0x7f3a040cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47594/0 (socket says 172.21.15.5:47594) 2023-10-16T13:47:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a09475700 1 -- 172.21.15.5:0/3559150234 learned_addr learned my addr 172.21.15.5:0/3559150234 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a08c74700 1 -- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a0415dac0 msgr2=0x7f3a040ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a08c74700 1 --2- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a0415dac0 0x7f3a040ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a08c74700 1 -- 172.21.15.5:0/3559150234 >> v1:172.21.15.112:6789/0 conn(0x7f3a040cecb0 legacy=0x7f3a040cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a037fe700 1 -- 172.21.15.5:0/3559150234 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645209875 0 0) 0x7f3a0415e9d0 con 0x7f3a040cecb0 2023-10-16T13:47:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a08c74700 1 -- 172.21.15.5:0/3559150234 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04154910 con 0x7f3a04153ff0 2023-10-16T13:47:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a03fff700 1 --2- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a0415dac0 0x7f3a040ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a08c74700 1 --2- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a04153ff0 0x7f3a041543d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009840 tx=0x7f39f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa47bde70ef5dfc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a037fe700 1 -- 172.21.15.5:0/3559150234 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8011830 con 0x7f3a04153ff0 2023-10-16T13:47:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a037fe700 1 -- 172.21.15.5:0/3559150234 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8011990 con 0x7f3a04153ff0 2023-10-16T13:47:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.086+0000 7f3a037fe700 1 -- 172.21.15.5:0/3559150234 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8011d20 con 0x7f3a04153ff0 2023-10-16T13:47:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 -- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a04153ff0 msgr2=0x7f3a041543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a04153ff0 0x7f3a041543d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009840 tx=0x7f39f8009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 -- 172.21.15.5:0/3559150234 shutdown_connections 2023-10-16T13:47:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a04153ff0 0x7f3a041543d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/3559150234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a0415dac0 0x7f3a040ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 -- 172.21.15.5:0/3559150234 >> 172.21.15.5:0/3559150234 conn(0x7f3a0406afb0 msgr2=0x7f3a040cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 -- 172.21.15.5:0/3559150234 shutdown_connections 2023-10-16T13:47:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.087+0000 7f3a0aed8700 1 -- 172.21.15.5:0/3559150234 wait complete. 2023-10-16T13:47:12.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.088+0000 7f3a0aed8700 1 Processor -- start 2023-10-16T13:47:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.088+0000 7f3a0aed8700 1 -- start start 2023-10-16T13:47:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a0aed8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cecb0 0x7f3a04151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a0aed8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a04153ff0 0x7f3a04150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a0aed8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 0x7f3a040c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a0aed8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04152e90 con 0x7f3a0415dac0 2023-10-16T13:47:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a0aed8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04151d50 con 0x7f3a040cecb0 2023-10-16T13:47:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a0aed8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04152030 con 0x7f3a04153ff0 2023-10-16T13:47:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a09475700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 0x7f3a040c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a09475700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 0x7f3a040c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46620/0 (socket says 172.21.15.5:46620) 2023-10-16T13:47:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a09475700 1 -- 172.21.15.5:0/2651785905 learned_addr learned my addr 172.21.15.5:0/2651785905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a08c74700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cecb0 0x7f3a04151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a03fff700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a04153ff0 0x7f3a04150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a08c74700 1 -- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a04153ff0 msgr2=0x7f3a04150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a08c74700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a04153ff0 0x7f3a04150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.089+0000 7f3a08c74700 1 -- 172.21.15.5:0/2651785905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 msgr2=0x7f3a040c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a08c74700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 0x7f3a040c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a08c74700 1 -- 172.21.15.5:0/2651785905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00094a0 con 0x7f3a040cecb0 2023-10-16T13:47:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a03fff700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a04153ff0 0x7f3a04150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a09475700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 0x7f3a040c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a08c74700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cecb0 0x7f3a04151690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f39f8016000 tx=0x7f39f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80036a0 con 0x7f3a040cecb0 2023-10-16T13:47:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f801f070 con 0x7f3a040cecb0 2023-10-16T13:47:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f80094a0 con 0x7f3a040cecb0 2023-10-16T13:47:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8003a20 con 0x7f3a040cecb0 2023-10-16T13:47:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.090+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a041525f0 con 0x7f3a040cecb0 2023-10-16T13:47:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.091+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0404ebb0 con 0x7f3a040cecb0 2023-10-16T13:47:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.091+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f39f8003b80 con 0x7f3a040cecb0 2023-10-16T13:47:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.092+0000 7f3a017fa700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39e806b140 0x7f39e806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.092+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f39f8021070 con 0x7f3a040cecb0 2023-10-16T13:47:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.092+0000 7f3a03fff700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39e806b140 0x7f39e806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.092+0000 7f3a03fff700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39e806b140 0x7f39e806d600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3a040b54f0 tx=0x7f39f0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.097+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39f8055f70 con 0x7f3a040cecb0 2023-10-16T13:47:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:12.313+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3a040cd6d0 con 0x7f3a040cecb0 2023-10-16T13:47:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.299+0000 7f3a017fa700 1 -- 172.21.15.5:0/2651785905 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v72) v1 ==== 97+0+0 (secure 0 0 0) 0x7f39f802b020 con 0x7f3a040cecb0 2023-10-16T13:47:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39e806b140 msgr2=0x7f39e806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39e806b140 0x7f39e806d600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3a040b54f0 tx=0x7f39f0009210 comp rx=0 tx=0).stop 2023-10-16T13:47:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cecb0 msgr2=0x7f3a04151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cecb0 0x7f3a04151690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f39f8016000 tx=0x7f39f8004750 comp rx=0 tx=0).stop 2023-10-16T13:47:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 shutdown_connections 2023-10-16T13:47:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a0415dac0 0x7f3a040c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cecb0 0x7f3a04151690 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39e806b140 0x7f39e806d600 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 --2- 172.21.15.5:0/2651785905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a04153ff0 0x7f3a04150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 >> 172.21.15.5:0/2651785905 conn(0x7f3a0406afb0 msgr2=0x7f3a040b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 shutdown_connections 2023-10-16T13:47:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.302+0000 7f3a0aed8700 1 -- 172.21.15.5:0/2651785905 wait complete. 2023-10-16T13:47:13.310 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:47:13.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:47:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.450+0000 7f68a0f88700 1 Processor -- start 2023-10-16T13:47:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.450+0000 7f68a0f88700 1 -- start start 2023-10-16T13:47:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f68a0f88700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f689c160fb0 0x7f689c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f68a0f88700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f689c06af50 0x7f689c161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f68a0f88700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c161390 con 0x7f689c0727b0 2023-10-16T13:47:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f68a0f88700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0b23f0 con 0x7f689c06af50 2023-10-16T13:47:13.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f68a0f88700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0b26b0 con 0x7f689c160fb0 2023-10-16T13:47:13.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f689ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f689c06af50 0x7f689c161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.451+0000 7f6899d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f689c0727b0 0x7f689c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56636/0 (socket says 172.21.15.5:56636) 2023-10-16T13:47:13.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f6899d9b700 1 -- 172.21.15.5:0/3293304125 learned_addr learned my addr 172.21.15.5:0/3293304125 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:13.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689a59c700 1 --2- 172.21.15.5:0/3293304125 >> v2:172.21.15.112:3300/0 conn(0x7f689c160fb0 0x7f689c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689959a700 1 -- 172.21.15.5:0/3293304125 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037078787 0 0) 0x7f689c161390 con 0x7f689c0727b0 2023-10-16T13:47:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689959a700 1 -- 172.21.15.5:0/3293304125 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68880035b0 con 0x7f689c0727b0 2023-10-16T13:47:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689ad9d700 1 -- 172.21.15.5:0/3293304125 >> v2:172.21.15.112:3300/0 conn(0x7f689c160fb0 msgr2=0x7f689c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689ad9d700 1 --2- 172.21.15.5:0/3293304125 >> v2:172.21.15.112:3300/0 conn(0x7f689c160fb0 0x7f689c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689ad9d700 1 -- 172.21.15.5:0/3293304125 >> v1:172.21.15.5:6789/0 conn(0x7f689c0727b0 legacy=0x7f689c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689ad9d700 1 -- 172.21.15.5:0/3293304125 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c0b2990 con 0x7f689c06af50 2023-10-16T13:47:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689a59c700 1 --2- 172.21.15.5:0/3293304125 >> v2:172.21.15.112:3300/0 conn(0x7f689c160fb0 0x7f689c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689ad9d700 1 --2- 172.21.15.5:0/3293304125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c06af50 0x7f689c161600 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f689c06b730 tx=0x7f689400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2836806883774441 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689959a700 1 -- 172.21.15.5:0/3293304125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400e070 con 0x7f689c06af50 2023-10-16T13:47:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689959a700 1 -- 172.21.15.5:0/3293304125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400bb20 con 0x7f689c06af50 2023-10-16T13:47:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.452+0000 7f689959a700 1 -- 172.21.15.5:0/3293304125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894012430 con 0x7f689c06af50 2023-10-16T13:47:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 -- 172.21.15.5:0/3293304125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c06af50 msgr2=0x7f689c161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3293304125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c06af50 0x7f689c161600 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f689c06b730 tx=0x7f689400b330 comp rx=0 tx=0).stop 2023-10-16T13:47:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 -- 172.21.15.5:0/3293304125 shutdown_connections 2023-10-16T13:47:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3293304125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c06af50 0x7f689c161600 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3293304125 >> v2:172.21.15.112:3300/0 conn(0x7f689c160fb0 0x7f689c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 -- 172.21.15.5:0/3293304125 >> 172.21.15.5:0/3293304125 conn(0x7f689c0cd270 msgr2=0x7f689c0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 -- 172.21.15.5:0/3293304125 shutdown_connections 2023-10-16T13:47:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.453+0000 7f68a0f88700 1 -- 172.21.15.5:0/3293304125 wait complete. 2023-10-16T13:47:13.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.454+0000 7f68a0f88700 1 Processor -- start 2023-10-16T13:47:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.454+0000 7f68a0f88700 1 -- start start 2023-10-16T13:47:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f68a0f88700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f689c06af50 0x7f689c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f68a0f88700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 0x7f689c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f68a0f88700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c160fb0 0x7f689c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f68a0f88700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0b5d00 con 0x7f689c0727b0 2023-10-16T13:47:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f68a0f88700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c14f810 con 0x7f689c160fb0 2023-10-16T13:47:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f68a0f88700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c14c4f0 con 0x7f689c06af50 2023-10-16T13:47:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 0x7f689c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 0x7f689c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46636/0 (socket says 172.21.15.5:46636) 2023-10-16T13:47:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 -- 172.21.15.5:0/3032277857 learned_addr learned my addr 172.21.15.5:0/3032277857 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 -- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f689c06af50 msgr2=0x7f689c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f689c06af50 0x7f689c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 -- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c160fb0 msgr2=0x7f689c0b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c160fb0 0x7f689c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 -- 172.21.15.5:0/3032277857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894009a70 con 0x7f689c0727b0 2023-10-16T13:47:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.455+0000 7f6899d9b700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 0x7f689c0aede0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f688400c700 tx=0x7f688400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.456+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884005d70 con 0x7f689c0727b0 2023-10-16T13:47:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.456+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840070d0 con 0x7f689c0727b0 2023-10-16T13:47:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.456+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c0b53e0 con 0x7f689c0727b0 2023-10-16T13:47:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.456+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884007460 con 0x7f689c0727b0 2023-10-16T13:47:13.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.456+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c0b5640 con 0x7f689c0727b0 2023-10-16T13:47:13.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.457+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c0b5e40 con 0x7f689c0727b0 2023-10-16T13:47:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.457+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f68840075c0 con 0x7f689c0727b0 2023-10-16T13:47:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.458+0000 7f6892ffd700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f687c06b140 0x7f687c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.458+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6884088c90 con 0x7f689c0727b0 2023-10-16T13:47:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.458+0000 7f689a59c700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f687c06b140 0x7f687c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.458+0000 7f689a59c700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f687c06b140 0x7f687c06d600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f688c006fd0 tx=0x7f688c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.462+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f689c0b5e40 con 0x7f689c0727b0 2023-10-16T13:47:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.748+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f689c0b5e40 con 0x7f689c0727b0 2023-10-16T13:47:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.748+0000 7f6892ffd700 1 -- 172.21.15.5:0/3032277857 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f689c0b5e40 con 0x7f689c0727b0 2023-10-16T13:47:13.751 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:13.752 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:47:13.752 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:47:13.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.752 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:47:13.752 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:47:13.753 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:13.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:13.753 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.754 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:47:13.754 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:47:13.755 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:13.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:13.755 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.756 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:47:13.756 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:47:13.757 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:13.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:13.757 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.758 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:47:13.759 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:47:13.759 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.759 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.759 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:13.759 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:13.760 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.761 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:47:13.761 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:47:13.761 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.762 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.762 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:47:13.763 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:47:13.763 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.763 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.763 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.764 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.764 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.764 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:47:13.765 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:47:13.765 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.765 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.765 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.765 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.766 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:47:13.766 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:47:13.766 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.767 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.767 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.767 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.768 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:47:13.768 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:47:13.768 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.768 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.769 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.769 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.770 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:47:13.770 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:47:13.770 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.770 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.770 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.771 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.772 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:47:13.772 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:47:13.772 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.772 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.772 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.773 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.773 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:47:13.773 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:47:13.774 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.774 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:13.774 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:13.774 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.774 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.775 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:47:13.775 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:47:13.775 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.776 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.776 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:47:13.776 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:47:13.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.777 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:47:13.777 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:47:13.777 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.777 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.777 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:47:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:47:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:47:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.779 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:47:13.779 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:47:13.779 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.779 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.779 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:47:13.780 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:47:13.780 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:47:13.780 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.781 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:47:13.781 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:47:13.781 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.781 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:13.781 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:47:13.782 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:47:13.782 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:47:13.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.783 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:47:13.783 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:47:13.783 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.783 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:47:13.783 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:13.783 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:13.784 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.784 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:47:13.785 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:47:13.785 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.785 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:47:13.785 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:47:13.785 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:13.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:13.786 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:47:13.786 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:47:13.786 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:13.787 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:47:13.787 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:47:13.787 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:13.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:13.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:47:13.788 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:47:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f687c06b140 msgr2=0x7f687c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f687c06b140 0x7f687c06d600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f688c006fd0 tx=0x7f688c008040 comp rx=0 tx=0).stop 2023-10-16T13:47:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 msgr2=0x7f689c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 0x7f689c0aede0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f688400c700 tx=0x7f688400cac0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 shutdown_connections 2023-10-16T13:47:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c160fb0 0x7f689c0b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f687c06b140 0x7f687c06d600 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f689c06af50 0x7f689c0b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 --2- 172.21.15.5:0/3032277857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f689c0727b0 0x7f689c0aede0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 >> 172.21.15.5:0/3032277857 conn(0x7f689c0cd270 msgr2=0x7f689c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 shutdown_connections 2023-10-16T13:47:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.750+0000 7f68a0f88700 1 -- 172.21.15.5:0/3032277857 wait complete. 2023-10-16T13:47:13.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.915+0000 7f146e4f5700 1 Processor -- start 2023-10-16T13:47:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.915+0000 7f146e4f5700 1 -- start start 2023-10-16T13:47:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f146e4f5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f146e4f5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680cf190 con 0x7f14680d0c70 2023-10-16T13:47:13.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f146e4f5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680cbd40 con 0x7f14680ce6e0 2023-10-16T13:47:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f146e4f5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146815bb20 con 0x7f146815b740 2023-10-16T13:47:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f145ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14680d0c70 0x7f14680cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56648/0 (socket says 172.21.15.5:56648) 2023-10-16T13:47:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f145ffff700 1 -- 172.21.15.5:0/3852830955 learned_addr learned my addr 172.21.15.5:0/3852830955 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.916+0000 7f1467fff700 1 --2- 172.21.15.5:0/3852830955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.917+0000 7f1467fff700 1 -- 172.21.15.5:0/3852830955 >> v1:172.21.15.112:6789/0 conn(0x7f14680ce6e0 legacy=0x7f14680cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.917+0000 7f1467fff700 1 -- 172.21.15.5:0/3852830955 >> v1:172.21.15.5:6789/0 conn(0x7f14680d0c70 legacy=0x7f14680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.917+0000 7f1467fff700 1 -- 172.21.15.5:0/3852830955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680cc020 con 0x7f146815b740 2023-10-16T13:47:13.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.917+0000 7f1467fff700 1 --2- 172.21.15.5:0/3852830955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680d1cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1458009870 tx=0x7f1458009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58f5bd25771105e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:13.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f14677fe700 1 -- 172.21.15.5:0/3852830955 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458011830 con 0x7f146815b740 2023-10-16T13:47:13.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f14677fe700 1 -- 172.21.15.5:0/3852830955 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458011990 con 0x7f146815b740 2023-10-16T13:47:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f14677fe700 1 -- 172.21.15.5:0/3852830955 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458011d20 con 0x7f146815b740 2023-10-16T13:47:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 -- 172.21.15.5:0/3852830955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 msgr2=0x7f14680d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 --2- 172.21.15.5:0/3852830955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680d1cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1458009870 tx=0x7f1458009b80 comp rx=0 tx=0).stop 2023-10-16T13:47:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 -- 172.21.15.5:0/3852830955 shutdown_connections 2023-10-16T13:47:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 --2- 172.21.15.5:0/3852830955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680d1cd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 -- 172.21.15.5:0/3852830955 >> 172.21.15.5:0/3852830955 conn(0x7f14680665a0 msgr2=0x7f1468066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 -- 172.21.15.5:0/3852830955 shutdown_connections 2023-10-16T13:47:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.919+0000 7f146e4f5700 1 -- 172.21.15.5:0/3852830955 wait complete. 2023-10-16T13:47:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.920+0000 7f146e4f5700 1 Processor -- start 2023-10-16T13:47:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 -- start start 2023-10-16T13:47:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 0x7f14680b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14680d0c70 0x7f14680c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680b5130 con 0x7f14680ce6e0 2023-10-16T13:47:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680b5410 con 0x7f14680d0c70 2023-10-16T13:47:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f146e4f5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14680b56f0 con 0x7f146815b740 2023-10-16T13:47:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f1467fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 0x7f14680b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f1467fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 0x7f14680b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46648/0 (socket says 172.21.15.5:46648) 2023-10-16T13:47:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.921+0000 7f1467fff700 1 -- 172.21.15.5:0/1774971071 learned_addr learned my addr 172.21.15.5:0/1774971071 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f146ca92700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f145ffff700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14680d0c70 0x7f14680c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f1467fff700 1 -- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 msgr2=0x7f14680c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f1467fff700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f1467fff700 1 -- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14680d0c70 msgr2=0x7f14680c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f1467fff700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14680d0c70 0x7f14680c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f1467fff700 1 -- 172.21.15.5:0/1774971071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580094a0 con 0x7f14680ce6e0 2023-10-16T13:47:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f146ca92700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f1467fff700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 0x7f14680b61d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f14580090b0 tx=0x7f1458004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580038a0 con 0x7f14680ce6e0 2023-10-16T13:47:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145801f070 con 0x7f14680ce6e0 2023-10-16T13:47:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458003c40 con 0x7f14680ce6e0 2023-10-16T13:47:13.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14680b59d0 con 0x7f14680ce6e0 2023-10-16T13:47:13.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.922+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146814d510 con 0x7f14680ce6e0 2023-10-16T13:47:13.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.923+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146814d6a0 con 0x7f14680ce6e0 2023-10-16T13:47:13.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.923+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f145801a430 con 0x7f14680ce6e0 2023-10-16T13:47:13.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.924+0000 7f14657fa700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144806b140 0x7f144806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:13.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.924+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1458021070 con 0x7f14680ce6e0 2023-10-16T13:47:13.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.924+0000 7f145ffff700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144806b140 0x7f144806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:13.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.924+0000 7f145ffff700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144806b140 0x7f144806d600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f146814a950 tx=0x7f1450009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:13.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:13.929+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14580562a0 con 0x7f14680ce6e0 2023-10-16T13:47:14.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.131+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14680b5e90 con 0x7f14680ce6e0 2023-10-16T13:47:14.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.132+0000 7f14657fa700 1 -- 172.21.15.5:0/1774971071 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+12786 (secure 0 0 0) 0x7f14580598c0 con 0x7f14680ce6e0 2023-10-16T13:47:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:14.135 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:13.293677+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144806b140 msgr2=0x7f144806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144806b140 0x7f144806d600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f146814a950 tx=0x7f1450009040 comp rx=0 tx=0).stop 2023-10-16T13:47:14.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 msgr2=0x7f14680b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 0x7f14680b61d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f14580090b0 tx=0x7f1458004750 comp rx=0 tx=0).stop 2023-10-16T13:47:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 shutdown_connections 2023-10-16T13:47:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144806b140 0x7f144806d600 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f146815b740 0x7f14680c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14680ce6e0 0x7f14680b61d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 --2- 172.21.15.5:0/1774971071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14680d0c70 0x7f14680c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 >> 172.21.15.5:0/1774971071 conn(0x7f14680665a0 msgr2=0x7f14680c6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 shutdown_connections 2023-10-16T13:47:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.134+0000 7f146e4f5700 1 -- 172.21.15.5:0/1774971071 wait complete. 2023-10-16T13:47:14.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:14.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.275+0000 7f6ce489d700 1 Processor -- start 2023-10-16T13:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.275+0000 7f6ce489d700 1 -- start start 2023-10-16T13:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6ce489d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce015ab10 0x7f6ce015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6ce489d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ce00b1f50 0x7f6ce00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6ce489d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce015e7a0 con 0x7f6ce00b23d0 2023-10-16T13:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6ce489d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce015f730 con 0x7f6ce00b1f50 2023-10-16T13:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6ce489d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00b29a0 con 0x7f6ce015ab10 2023-10-16T13:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6cddd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ce00b1f50 0x7f6ce00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6cddd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ce00b1f50 0x7f6ce00cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46658/0 (socket says 172.21.15.5:46658) 2023-10-16T13:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6cddd9b700 1 -- 172.21.15.5:0/4139760417 learned_addr learned my addr 172.21.15.5:0/4139760417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.276+0000 7f6cde59c700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce015ab10 0x7f6ce015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cddd9b700 1 -- 172.21.15.5:0/4139760417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce015ab10 msgr2=0x7f6ce015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cddd9b700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce015ab10 0x7f6ce015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cddd9b700 1 -- 172.21.15.5:0/4139760417 >> v1:172.21.15.112:6789/0 conn(0x7f6ce00b23d0 legacy=0x7f6ce00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cddd9b700 1 -- 172.21.15.5:0/4139760417 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce00b2c80 con 0x7f6ce00b1f50 2023-10-16T13:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cde59c700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce015ab10 0x7f6ce015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cddd9b700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce00b1f50 0x7f6ce00cf720 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0006fd0 tx=0x7f6cd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e190973833c3e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cdd59a700 1 -- 172.21.15.5:0/4139760417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0005e30 con 0x7f6ce00b1f50 2023-10-16T13:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cdd59a700 1 -- 172.21.15.5:0/4139760417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd0004030 con 0x7f6ce00b1f50 2023-10-16T13:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6cdd59a700 1 -- 172.21.15.5:0/4139760417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00043e0 con 0x7f6ce00b1f50 2023-10-16T13:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6ce489d700 1 -- 172.21.15.5:0/4139760417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce00b1f50 msgr2=0x7f6ce00cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.277+0000 7f6ce489d700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce00b1f50 0x7f6ce00cf720 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0006fd0 tx=0x7f6cd0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.278+0000 7f6ce489d700 1 -- 172.21.15.5:0/4139760417 shutdown_connections 2023-10-16T13:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.278+0000 7f6ce489d700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce015ab10 0x7f6ce015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.278+0000 7f6ce489d700 1 --2- 172.21.15.5:0/4139760417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce00b1f50 0x7f6ce00cf720 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.278+0000 7f6ce489d700 1 -- 172.21.15.5:0/4139760417 >> 172.21.15.5:0/4139760417 conn(0x7f6ce006dae0 msgr2=0x7f6ce006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.278+0000 7f6ce489d700 1 -- 172.21.15.5:0/4139760417 shutdown_connections 2023-10-16T13:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.278+0000 7f6ce489d700 1 -- 172.21.15.5:0/4139760417 wait complete. 2023-10-16T13:47:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.279+0000 7f6ce489d700 1 Processor -- start 2023-10-16T13:47:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.279+0000 7f6ce489d700 1 -- start start 2023-10-16T13:47:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6ce489d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce00b1f50 0x7f6ce01454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6ce489d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00b23d0 0x7f6ce0151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6ce489d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 0x7f6ce0151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6ce489d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce015aef0 con 0x7f6ce015ab10 2023-10-16T13:47:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6ce489d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce015de50 con 0x7f6ce00b23d0 2023-10-16T13:47:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6ce489d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce0150560 con 0x7f6ce00b1f50 2023-10-16T13:47:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 0x7f6ce0151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 0x7f6ce0151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46666/0 (socket says 172.21.15.5:46666) 2023-10-16T13:47:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 -- 172.21.15.5:0/3500970109 learned_addr learned my addr 172.21.15.5:0/3500970109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cde59c700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce00b1f50 0x7f6ce01454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cddd9b700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00b23d0 0x7f6ce0151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 -- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce00b1f50 msgr2=0x7f6ce01454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce00b1f50 0x7f6ce01454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 -- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00b23d0 msgr2=0x7f6ce0151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00b23d0 0x7f6ce0151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 -- 172.21.15.5:0/3500970109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009500 con 0x7f6ce015ab10 2023-10-16T13:47:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cddd9b700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00b23d0 0x7f6ce0151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cded9d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 0x7f6ce0151860 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800cc50 tx=0x7f6cd800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.280+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8003c00 con 0x7f6ce015ab10 2023-10-16T13:47:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.281+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8003d60 con 0x7f6ce015ab10 2023-10-16T13:47:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.281+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce0150280 con 0x7f6ce015ab10 2023-10-16T13:47:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.281+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800ab60 con 0x7f6ce015ab10 2023-10-16T13:47:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.281+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce0146180 con 0x7f6ce015ab10 2023-10-16T13:47:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.281+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce015b060 con 0x7f6ce015ab10 2023-10-16T13:47:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.282+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f6cd800acc0 con 0x7f6ce015ab10 2023-10-16T13:47:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.283+0000 7f6cceffd700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cc006b140 0x7f6cc006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.283+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6cd8089690 con 0x7f6ce015ab10 2023-10-16T13:47:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.283+0000 7f6cde59c700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cc006b140 0x7f6cc006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.283+0000 7f6cde59c700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cc006b140 0x7f6cc006d600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40099d0 tx=0x7f6cd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.287+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cd80547c0 con 0x7f6ce015ab10 2023-10-16T13:47:14.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.487+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ce0067d20 con 0x7f6ce015ab10 2023-10-16T13:47:14.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.487+0000 7f6cceffd700 1 -- 172.21.15.5:0/3500970109 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cd8057de0 con 0x7f6ce015ab10 2023-10-16T13:47:14.491 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:14.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cc006b140 msgr2=0x7f6cc006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cc006b140 0x7f6cc006d600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40099d0 tx=0x7f6cd4008040 comp rx=0 tx=0).stop 2023-10-16T13:47:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 msgr2=0x7f6ce0151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 0x7f6ce0151860 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800cc50 tx=0x7f6cd800cf60 comp rx=0 tx=0).stop 2023-10-16T13:47:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 shutdown_connections 2023-10-16T13:47:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce015ab10 0x7f6ce0151860 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cc006b140 0x7f6cc006d600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ce00b1f50 0x7f6ce01454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 --2- 172.21.15.5:0/3500970109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00b23d0 0x7f6ce0151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 >> 172.21.15.5:0/3500970109 conn(0x7f6ce006dae0 msgr2=0x7f6ce0159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.489+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 shutdown_connections 2023-10-16T13:47:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.490+0000 7f6ce489d700 1 -- 172.21.15.5:0/3500970109 wait complete. 2023-10-16T13:47:14.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:47:14.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.627+0000 7efdc88f8700 1 Processor -- start 2023-10-16T13:47:14.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.627+0000 7efdc88f8700 1 -- start start 2023-10-16T13:47:14.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc88f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efdc415f050 0x7efdc40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc88f8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc40b0a80 con 0x7efdc40b0580 2023-10-16T13:47:14.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc88f8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc40ccee0 con 0x7efdc40d0530 2023-10-16T13:47:14.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc88f8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc40cd1c0 con 0x7efdc415f050 2023-10-16T13:47:14.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc1d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efdc40b0580 0x7efdc40ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56674/0 (socket says 172.21.15.5:56674) 2023-10-16T13:47:14.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efdc415f050 0x7efdc40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc1d9b700 1 -- 172.21.15.5:0/35169480 learned_addr learned my addr 172.21.15.5:0/35169480 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:14.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc259c700 1 -- 172.21.15.5:0/35169480 >> v1:172.21.15.112:6789/0 conn(0x7efdc40d0530 legacy=0x7efdc406ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc259c700 1 -- 172.21.15.5:0/35169480 >> v1:172.21.15.5:6789/0 conn(0x7efdc40b0580 legacy=0x7efdc40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc259c700 1 -- 172.21.15.5:0/35169480 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40cd4a0 con 0x7efdc415f050 2023-10-16T13:47:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc159a700 1 -- 172.21.15.5:0/35169480 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091580072 0 0) 0x7efdc40b0a80 con 0x7efdc40b0580 2023-10-16T13:47:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc259c700 1 --2- 172.21.15.5:0/35169480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc415f050 0x7efdc40cdba0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009840 tx=0x7efdb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea17516b996b4dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc159a700 1 -- 172.21.15.5:0/35169480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4011830 con 0x7efdc415f050 2023-10-16T13:47:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc159a700 1 -- 172.21.15.5:0/35169480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb4011990 con 0x7efdc415f050 2023-10-16T13:47:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.628+0000 7efdc159a700 1 -- 172.21.15.5:0/35169480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4011d20 con 0x7efdc415f050 2023-10-16T13:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 -- 172.21.15.5:0/35169480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc415f050 msgr2=0x7efdc40cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 --2- 172.21.15.5:0/35169480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc415f050 0x7efdc40cdba0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009840 tx=0x7efdb4009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 -- 172.21.15.5:0/35169480 shutdown_connections 2023-10-16T13:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 --2- 172.21.15.5:0/35169480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc415f050 0x7efdc40cdba0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 -- 172.21.15.5:0/35169480 >> 172.21.15.5:0/35169480 conn(0x7efdc40d1620 msgr2=0x7efdc40d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 -- 172.21.15.5:0/35169480 shutdown_connections 2023-10-16T13:47:14.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.629+0000 7efdc88f8700 1 -- 172.21.15.5:0/35169480 wait complete. 2023-10-16T13:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.630+0000 7efdc88f8700 1 Processor -- start 2023-10-16T13:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.630+0000 7efdc88f8700 1 -- start start 2023-10-16T13:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc88f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 0x7efdc415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc88f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc415f050 0x7efdc40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc88f8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc415d000 0x7efdc41e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc88f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc415b6c0 con 0x7efdc40b0580 2023-10-16T13:47:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc88f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc415d570 con 0x7efdc415f050 2023-10-16T13:47:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc88f8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc415d850 con 0x7efdc415d000 2023-10-16T13:47:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 0x7efdc415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 0x7efdc415b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46676/0 (socket says 172.21.15.5:46676) 2023-10-16T13:47:14.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc259c700 1 -- 172.21.15.5:0/1526385329 learned_addr learned my addr 172.21.15.5:0/1526385329 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc1d9b700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc415f050 0x7efdc40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.631+0000 7efdc2d9d700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc415d000 0x7efdc41e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc259c700 1 -- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc415d000 msgr2=0x7efdc41e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc259c700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc415d000 0x7efdc41e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc259c700 1 -- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc415f050 msgr2=0x7efdc40c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc259c700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc415f050 0x7efdc40c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc259c700 1 -- 172.21.15.5:0/1526385329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb40094a0 con 0x7efdc40b0580 2023-10-16T13:47:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc259c700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 0x7efdc415b850 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efdb4014040 tx=0x7efdb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb401a980 con 0x7efdc40b0580 2023-10-16T13:47:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb401ab00 con 0x7efdc40b0580 2023-10-16T13:47:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc415db30 con 0x7efdc40b0580 2023-10-16T13:47:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4024420 con 0x7efdc40b0580 2023-10-16T13:47:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.632+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc415bf60 con 0x7efdc40b0580 2023-10-16T13:47:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.633+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc415c0f0 con 0x7efdc40b0580 2023-10-16T13:47:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.633+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7efdb4022070 con 0x7efdc40b0580 2023-10-16T13:47:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.634+0000 7efdb2ffd700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efda406b140 0x7efda406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.634+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efdb408a990 con 0x7efdc40b0580 2023-10-16T13:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.634+0000 7efdc1d9b700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efda406b140 0x7efda406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.635+0000 7efdc1d9b700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efda406b140 0x7efda406d600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efdc40c8de0 tx=0x7efdb8007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.639+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdb4055a30 con 0x7efdc40b0580 2023-10-16T13:47:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.844+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efdc415e050 con 0x7efdc40b0580 2023-10-16T13:47:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.845+0000 7efdb2ffd700 1 -- 172.21.15.5:0/1526385329 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) v1 ==== 84+0+65 (secure 0 0 0) 0x7efdc415e050 con 0x7efdc40b0580 2023-10-16T13:47:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:14.848 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:47:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:47:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:47:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:14.849 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:47:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efda406b140 msgr2=0x7efda406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efda406b140 0x7efda406d600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efdc40c8de0 tx=0x7efdb8007c40 comp rx=0 tx=0).stop 2023-10-16T13:47:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 msgr2=0x7efdc415b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 0x7efdc415b850 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efdb4014040 tx=0x7efdb4004750 comp rx=0 tx=0).stop 2023-10-16T13:47:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 shutdown_connections 2023-10-16T13:47:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efda406b140 0x7efda406d600 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdc415d000 0x7efdc41e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdc40b0580 0x7efdc415b850 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 --2- 172.21.15.5:0/1526385329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc415f050 0x7efdc40c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 >> 172.21.15.5:0/1526385329 conn(0x7efdc40d1620 msgr2=0x7efdc40b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 shutdown_connections 2023-10-16T13:47:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.847+0000 7efdc88f8700 1 -- 172.21.15.5:0/1526385329 wait complete. 2023-10-16T13:47:14.861 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:47:14.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:47:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.989+0000 7f743a116700 1 Processor -- start 2023-10-16T13:47:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.989+0000 7f743a116700 1 -- start start 2023-10-16T13:47:14.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f743a116700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f74340d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f743a116700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340d05e0 con 0x7f74340b0d30 2023-10-16T13:47:14.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f743a116700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340b08d0 con 0x7f74340cdf40 2023-10-16T13:47:14.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f743a116700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cfcb0 con 0x7f74340cf430 2023-10-16T13:47:14.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f7433fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f74340b0d30 0x7f74340b11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56692/0 (socket says 172.21.15.5:56692) 2023-10-16T13:47:14.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f7433fff700 1 -- 172.21.15.5:0/4277965196 learned_addr learned my addr 172.21.15.5:0/4277965196 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:14.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f7432ffd700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f74340d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:14.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184038620 0 0) 0x7f74340d05e0 con 0x7f74340b0d30 2023-10-16T13:47:14.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.990+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c0035b0 con 0x7f74340b0d30 2023-10-16T13:47:14.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753010862 0 0) 0x7f741c0035b0 con 0x7f74340b0d30 2023-10-16T13:47:14.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 msgr2=0x7f74340d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:14.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f74340d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:14.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 >> v1:172.21.15.112:6789/0 conn(0x7f74340cdf40 legacy=0x7f74340ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340cff90 con 0x7f74340b0d30 2023-10-16T13:47:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f742c0019f0 con 0x7f74340b0d30 2023-10-16T13:47:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 >> v1:172.21.15.5:6789/0 conn(0x7f74340b0d30 legacy=0x7f74340b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f741c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c004850 0x7f741c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f741c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cfcb0 con 0x7f741c003a30 2023-10-16T13:47:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c00bac0 con 0x7f741c004850 2023-10-16T13:47:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c00bc80 con 0x7f74340cf430 2023-10-16T13:47:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f741c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f7433fff700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f741c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f7432ffd700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c004850 0x7f741c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 -- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 msgr2=0x7f741c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f741c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 -- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c004850 msgr2=0x7f741c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c004850 0x7f741c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 -- 172.21.15.5:0/4277965196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0035b0 con 0x7f741c003a30 2023-10-16T13:47:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f7433fff700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74340cf430 0x7f741c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74337fe700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f741c003e50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f74240017f0 tx=0x7f741c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4120799e71a04b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240012e0 con 0x7f741c003a30 2023-10-16T13:47:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74240052d0 con 0x7f741c003a30 2023-10-16T13:47:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.991+0000 7f74327fc700 1 -- 172.21.15.5:0/4277965196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240036d0 con 0x7f741c003a30 2023-10-16T13:47:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f743a116700 1 -- 172.21.15.5:0/4277965196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 msgr2=0x7f741c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f743a116700 1 --2- 172.21.15.5:0/4277965196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f741c003e50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f74240017f0 tx=0x7f741c005880 comp rx=0 tx=0).stop 2023-10-16T13:47:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f7433fff700 1 -- 172.21.15.5:0/4277965196 reap_dead start 2023-10-16T13:47:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f743a116700 1 -- 172.21.15.5:0/4277965196 shutdown_connections 2023-10-16T13:47:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f743a116700 1 -- 172.21.15.5:0/4277965196 >> 172.21.15.5:0/4277965196 conn(0x7f74340d1530 msgr2=0x7f74340d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f743a116700 1 -- 172.21.15.5:0/4277965196 shutdown_connections 2023-10-16T13:47:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.992+0000 7f743a116700 1 -- 172.21.15.5:0/4277965196 wait complete. 2023-10-16T13:47:15.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.993+0000 7f743a116700 1 Processor -- start 2023-10-16T13:47:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.993+0000 7f743a116700 1 -- start start 2023-10-16T13:47:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f743a116700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f74340c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f743a116700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74340cb330 0x7f74341535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f743a116700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74341e4160 0x7f74341e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f743a116700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74341e5b40 con 0x7f741c003a30 2023-10-16T13:47:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f743a116700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434153ae0 con 0x7f74340cb330 2023-10-16T13:47:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f743a116700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340caea0 con 0x7f74341e4160 2023-10-16T13:47:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f74337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f74340c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f74337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f74340c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46696/0 (socket says 172.21.15.5:46696) 2023-10-16T13:47:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.994+0000 7f74337fe700 1 -- 172.21.15.5:0/2615368574 learned_addr learned my addr 172.21.15.5:0/2615368574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f7432ffd700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74340cb330 0x7f74341535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f7433fff700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74341e4160 0x7f74341e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f74337fe700 1 -- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74341e4160 msgr2=0x7f74341e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f74337fe700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74341e4160 0x7f74341e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f74337fe700 1 -- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74340cb330 msgr2=0x7f74341535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f74337fe700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74340cb330 0x7f74341535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f74337fe700 1 -- 172.21.15.5:0/2615368574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340cb7b0 con 0x7f741c003a30 2023-10-16T13:47:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f7433fff700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74341e4160 0x7f74341e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f7432ffd700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74340cb330 0x7f74341535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f74337fe700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f74340c8690 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7424005040 tx=0x7f7424001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424001280 con 0x7f741c003a30 2023-10-16T13:47:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7424005440 con 0x7f741c003a30 2023-10-16T13:47:15.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74340c67d0 con 0x7f741c003a30 2023-10-16T13:47:15.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742401d630 con 0x7f741c003a30 2023-10-16T13:47:15.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.995+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74340c64f0 con 0x7f741c003a30 2023-10-16T13:47:15.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.996+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74340cb180 con 0x7f741c003a30 2023-10-16T13:47:15.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.996+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f742401d790 con 0x7f741c003a30 2023-10-16T13:47:15.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.997+0000 7f741bfff700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f742006b140 0x7f742006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:15.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.997+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f742408a260 con 0x7f741c003a30 2023-10-16T13:47:15.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.997+0000 7f7432ffd700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f742006b140 0x7f742006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:15.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:14.997+0000 7f7432ffd700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f742006b140 0x7f742006d600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f743415b4c0 tx=0x7f7428008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:15.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.002+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7424055580 con 0x7f741c003a30 2023-10-16T13:47:15.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.202+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7434067d20 con 0x7f741c003a30 2023-10-16T13:47:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.922+0000 7f741bfff700 1 -- 172.21.15.5:0/2615368574 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7424058ba0 con 0x7f741c003a30 2023-10-16T13:47:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f742006b140 msgr2=0x7f742006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f742006b140 0x7f742006d600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f743415b4c0 tx=0x7f7428008040 comp rx=0 tx=0).stop 2023-10-16T13:47:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 msgr2=0x7f74340c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f74340c8690 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7424005040 tx=0x7f7424001170 comp rx=0 tx=0).stop 2023-10-16T13:47:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 shutdown_connections 2023-10-16T13:47:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f742006b140 0x7f742006d600 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74341e4160 0x7f74341e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f741c003a30 0x7f74340c8690 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 --2- 172.21.15.5:0/2615368574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74340cb330 0x7f74341535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.925+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 >> 172.21.15.5:0/2615368574 conn(0x7f74340d1530 msgr2=0x7f743406f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.926+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 shutdown_connections 2023-10-16T13:47:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:15.926+0000 7f743a116700 1 -- 172.21.15.5:0/2615368574 wait complete. 2023-10-16T13:47:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:47:15.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:47:16.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.083+0000 7f2e59ca8700 1 Processor -- start 2023-10-16T13:47:16.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.083+0000 7f2e59ca8700 1 -- start start 2023-10-16T13:47:16.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e59ca8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 0x7f2e54071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:16.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e59ca8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 0x7f2e540cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:16.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e59ca8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5406a8e0 con 0x7f2e540cf450 2023-10-16T13:47:16.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e59ca8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5415aed0 con 0x7f2e540717c0 2023-10-16T13:47:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e59ca8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54071c50 con 0x7f2e540b5380 2023-10-16T13:47:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e53fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 0x7f2e540cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.084+0000 7f2e52ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 0x7f2e54071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e53fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 0x7f2e540cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42604/0 (socket says 172.21.15.5:42604) 2023-10-16T13:47:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e53fff700 1 -- 172.21.15.5:0/3965399213 learned_addr learned my addr 172.21.15.5:0/3965399213 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e52ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 0x7f2e54071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:44610/0 (socket says 172.21.15.5:44610) 2023-10-16T13:47:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e52ffd700 1 -- 172.21.15.5:0/3965399213 >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 msgr2=0x7f2e540cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e52ffd700 1 --2- 172.21.15.5:0/3965399213 >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 0x7f2e540cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e52ffd700 1 -- 172.21.15.5:0/3965399213 >> v1:172.21.15.112:6789/0 conn(0x7f2e540cf450 legacy=0x7f2e5415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e52ffd700 1 -- 172.21.15.5:0/3965399213 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5406abc0 con 0x7f2e540b5380 2023-10-16T13:47:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e53fff700 1 --2- 172.21.15.5:0/3965399213 >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 0x7f2e540cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e52ffd700 1 --2- 172.21.15.5:0/3965399213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 0x7f2e54071280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009840 tx=0x7f2e44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd0a918c4d8ba67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e527fc700 1 -- 172.21.15.5:0/3965399213 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44011830 con 0x7f2e540b5380 2023-10-16T13:47:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e527fc700 1 -- 172.21.15.5:0/3965399213 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44011990 con 0x7f2e540b5380 2023-10-16T13:47:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.085+0000 7f2e527fc700 1 -- 172.21.15.5:0/3965399213 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44011d20 con 0x7f2e540b5380 2023-10-16T13:47:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 -- 172.21.15.5:0/3965399213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 msgr2=0x7f2e54071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/3965399213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 0x7f2e54071280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009840 tx=0x7f2e44009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 -- 172.21.15.5:0/3965399213 shutdown_connections 2023-10-16T13:47:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/3965399213 >> v2:172.21.15.112:3300/0 conn(0x7f2e540717c0 0x7f2e540cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/3965399213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540b5380 0x7f2e54071280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 -- 172.21.15.5:0/3965399213 >> 172.21.15.5:0/3965399213 conn(0x7f2e540cfc40 msgr2=0x7f2e540d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 -- 172.21.15.5:0/3965399213 shutdown_connections 2023-10-16T13:47:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.086+0000 7f2e59ca8700 1 -- 172.21.15.5:0/3965399213 wait complete. 2023-10-16T13:47:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.087+0000 7f2e59ca8700 1 Processor -- start 2023-10-16T13:47:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.087+0000 7f2e59ca8700 1 -- start start 2023-10-16T13:47:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e59ca8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 0x7f2e54158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e59ca8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e540b5380 0x7f2e540a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e59ca8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540cf450 0x7f2e540c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e59ca8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541e5330 con 0x7f2e540717c0 2023-10-16T13:47:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e59ca8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540a8b10 con 0x7f2e540b5380 2023-10-16T13:47:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e59ca8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540a8df0 con 0x7f2e540cf450 2023-10-16T13:47:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 0x7f2e54158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 0x7f2e54158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46710/0 (socket says 172.21.15.5:46710) 2023-10-16T13:47:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 -- 172.21.15.5:0/4087804543 learned_addr learned my addr 172.21.15.5:0/4087804543 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e53fff700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540cf450 0x7f2e540c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e52ffd700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e540b5380 0x7f2e540a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 -- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540cf450 msgr2=0x7f2e540c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540cf450 0x7f2e540c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 -- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e540b5380 msgr2=0x7f2e540a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e540b5380 0x7f2e540a95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e537fe700 1 -- 172.21.15.5:0/4087804543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009b30 con 0x7f2e540717c0 2023-10-16T13:47:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.088+0000 7f2e52ffd700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e540b5380 0x7f2e540a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.089+0000 7f2e537fe700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 0x7f2e54158d90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c4e0 tx=0x7f2e3c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.089+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0052d0 con 0x7f2e540717c0 2023-10-16T13:47:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.089+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c005430 con 0x7f2e540717c0 2023-10-16T13:47:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.089+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e440094a0 con 0x7f2e540717c0 2023-10-16T13:47:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.089+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0038c0 con 0x7f2e540717c0 2023-10-16T13:47:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.089+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54158a40 con 0x7f2e540717c0 2023-10-16T13:47:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.090+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e540a92b0 con 0x7f2e540717c0 2023-10-16T13:47:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.090+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f2e3c003a20 con 0x7f2e540717c0 2023-10-16T13:47:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.091+0000 7f2e4bfff700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e3406b140 0x7f2e3406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.091+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2e3c088fc0 con 0x7f2e540717c0 2023-10-16T13:47:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.091+0000 7f2e52ffd700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e3406b140 0x7f2e3406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.092+0000 7f2e52ffd700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e3406b140 0x7f2e3406d600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2e440090b0 tx=0x7f2e44008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.095+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e3c0540a0 con 0x7f2e540717c0 2023-10-16T13:47:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.295+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2e54158bd0 con 0x7f2e540717c0 2023-10-16T13:47:16.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.924+0000 7f2e4bfff700 1 -- 172.21.15.5:0/4087804543 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2e54158bd0 con 0x7f2e540717c0 2023-10-16T13:47:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e3406b140 msgr2=0x7f2e3406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e3406b140 0x7f2e3406d600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2e440090b0 tx=0x7f2e44008030 comp rx=0 tx=0).stop 2023-10-16T13:47:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 msgr2=0x7f2e54158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 0x7f2e54158d90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c4e0 tx=0x7f2e3c00c8a0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 shutdown_connections 2023-10-16T13:47:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e3406b140 0x7f2e3406d600 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e540cf450 0x7f2e540c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e540717c0 0x7f2e54158d90 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.926+0000 7f2e59ca8700 1 --2- 172.21.15.5:0/4087804543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e540b5380 0x7f2e540a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.927+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 >> 172.21.15.5:0/4087804543 conn(0x7f2e540cfc40 msgr2=0x7f2e5415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:16.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.927+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 shutdown_connections 2023-10-16T13:47:16.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:16.927+0000 7f2e59ca8700 1 -- 172.21.15.5:0/4087804543 wait complete. 2023-10-16T13:47:16.932 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:47:16.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:47:17.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.090+0000 7fa10a44f700 1 Processor -- start 2023-10-16T13:47:17.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.091+0000 7fa10a44f700 1 -- start start 2023-10-16T13:47:17.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.091+0000 7fa10a44f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa10415e2f0 0x7fa1040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:17.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.091+0000 7fa10a44f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040b2d60 con 0x7fa10406a840 2023-10-16T13:47:17.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.091+0000 7fa10a44f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040cdd30 con 0x7fa1040cd950 2023-10-16T13:47:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.091+0000 7fa10a44f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1041619a0 con 0x7fa10415e2f0 2023-10-16T13:47:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1037fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa10415e2f0 0x7fa1040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1089ec700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa10406a840 0x7fa10406ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56726/0 (socket says 172.21.15.5:56726) 2023-10-16T13:47:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1089ec700 1 -- 172.21.15.5:0/1497420957 learned_addr learned my addr 172.21.15.5:0/1497420957 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1037fe700 1 -- 172.21.15.5:0/1497420957 >> v1:172.21.15.112:6789/0 conn(0x7fa1040cd950 legacy=0x7fa10415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1037fe700 1 -- 172.21.15.5:0/1497420957 >> v1:172.21.15.5:6789/0 conn(0x7fa10406a840 legacy=0x7fa10406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:17.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1037fe700 1 -- 172.21.15.5:0/1497420957 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10415e920 con 0x7fa10415e2f0 2023-10-16T13:47:17.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa102ffd700 1 -- 172.21.15.5:0/1497420957 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797317196 0 0) 0x7fa1040b2d60 con 0x7fa10406a840 2023-10-16T13:47:17.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa1037fe700 1 --2- 172.21.15.5:0/1497420957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10415e2f0 0x7fa1040cede0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009820 tx=0x7fa0f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4fb3d6ac11724e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:17.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa102ffd700 1 -- 172.21.15.5:0/1497420957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8005e30 con 0x7fa10415e2f0 2023-10-16T13:47:17.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa102ffd700 1 -- 172.21.15.5:0/1497420957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8004030 con 0x7fa10415e2f0 2023-10-16T13:47:17.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.092+0000 7fa102ffd700 1 -- 172.21.15.5:0/1497420957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80043e0 con 0x7fa10415e2f0 2023-10-16T13:47:17.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 -- 172.21.15.5:0/1497420957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10415e2f0 msgr2=0x7fa1040cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:17.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 --2- 172.21.15.5:0/1497420957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10415e2f0 0x7fa1040cede0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009820 tx=0x7fa0f8009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:17.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 -- 172.21.15.5:0/1497420957 shutdown_connections 2023-10-16T13:47:17.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 --2- 172.21.15.5:0/1497420957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10415e2f0 0x7fa1040cede0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 -- 172.21.15.5:0/1497420957 >> 172.21.15.5:0/1497420957 conn(0x7fa10406dae0 msgr2=0x7fa10406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:17.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 -- 172.21.15.5:0/1497420957 shutdown_connections 2023-10-16T13:47:17.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.093+0000 7fa10a44f700 1 -- 172.21.15.5:0/1497420957 wait complete. 2023-10-16T13:47:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.094+0000 7fa10a44f700 1 Processor -- start 2023-10-16T13:47:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.094+0000 7fa10a44f700 1 -- start start 2023-10-16T13:47:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa10a44f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 0x7fa10415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa10a44f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1040cd950 0x7fa1040ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa10a44f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa10415e2f0 0x7fa1040af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa10a44f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040c6f90 con 0x7fa10406a840 2023-10-16T13:47:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa10a44f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040aedc0 con 0x7fa10415e2f0 2023-10-16T13:47:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa10a44f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10415ab00 con 0x7fa1040cd950 2023-10-16T13:47:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 0x7fa10415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 0x7fa10415a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46724/0 (socket says 172.21.15.5:46724) 2023-10-16T13:47:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 -- 172.21.15.5:0/4074964871 learned_addr learned my addr 172.21.15.5:0/4074964871 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa1037fe700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1040cd950 0x7fa1040ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa1089ec700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa10415e2f0 0x7fa1040af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 -- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1040cd950 msgr2=0x7fa1040ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1040cd950 0x7fa1040ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 -- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa10415e2f0 msgr2=0x7fa1040af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:17.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa10415e2f0 0x7fa1040af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 -- 172.21.15.5:0/4074964871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8009430 con 0x7fa10406a840 2023-10-16T13:47:17.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.095+0000 7fa103fff700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 0x7fa10415a5c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c4d0 tx=0x7fa0f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:17.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.096+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4011790 con 0x7fa10406a840 2023-10-16T13:47:17.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.096+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40118f0 con 0x7fa10406a840 2023-10-16T13:47:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.096+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1040adc30 con 0x7fa10406a840 2023-10-16T13:47:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.096+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4011ca0 con 0x7fa10406a840 2023-10-16T13:47:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.096+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040ae770 con 0x7fa10406a840 2023-10-16T13:47:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.097+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104067d20 con 0x7fa10406a840 2023-10-16T13:47:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.098+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fa0f401c460 con 0x7fa10406a840 2023-10-16T13:47:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.098+0000 7fa100ff9700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0f006b170 0x7fa0f006d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.098+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa0f408a140 con 0x7fa10406a840 2023-10-16T13:47:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.098+0000 7fa1037fe700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0f006b170 0x7fa0f006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.099+0000 7fa1037fe700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0f006b170 0x7fa0f006d630 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8014040 tx=0x7fa0f8008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.102+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0f40550a0 con 0x7fa10406a840 2023-10-16T13:47:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.348+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa104074460 con 0x7fa10406a840 2023-10-16T13:47:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.970+0000 7fa100ff9700 1 -- 172.21.15.5:0/4074964871 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa104074460 con 0x7fa10406a840 2023-10-16T13:47:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0f006b170 msgr2=0x7fa0f006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0f006b170 0x7fa0f006d630 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8014040 tx=0x7fa0f8008070 comp rx=0 tx=0).stop 2023-10-16T13:47:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 msgr2=0x7fa10415a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 0x7fa10415a5c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c4d0 tx=0x7fa0f400c890 comp rx=0 tx=0).stop 2023-10-16T13:47:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 shutdown_connections 2023-10-16T13:47:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa10415e2f0 0x7fa1040af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10406a840 0x7fa10415a5c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa0f006b170 0x7fa0f006d630 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 --2- 172.21.15.5:0/4074964871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1040cd950 0x7fa1040ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.978+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 >> 172.21.15.5:0/4074964871 conn(0x7fa10406dae0 msgr2=0x7fa104160580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:17.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.979+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 shutdown_connections 2023-10-16T13:47:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:17.979+0000 7fa10a44f700 1 -- 172.21.15.5:0/4074964871 wait complete. 2023-10-16T13:47:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 12 and data pool 13 2023-10-16T13:47:18.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.130+0000 7f03776ca700 1 Processor -- start 2023-10-16T13:47:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.131+0000 7f03776ca700 1 -- start start 2023-10-16T13:47:18.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.131+0000 7f03776ca700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f03700cf8a0 0x7f03700d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.131+0000 7f03776ca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037015ee90 con 0x7f03700d1bc0 2023-10-16T13:47:18.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.131+0000 7f03776ca700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0370158370 con 0x7f037015eab0 2023-10-16T13:47:18.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.131+0000 7f03776ca700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700d23b0 con 0x7f03700cf8a0 2023-10-16T13:47:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.131+0000 7f0375c67700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03700d1bc0 0x7f03700cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56754/0 (socket says 172.21.15.5:56754) 2023-10-16T13:47:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0375c67700 1 -- 172.21.15.5:0/226351051 learned_addr learned my addr 172.21.15.5:0/226351051 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0374c65700 1 --2- 172.21.15.5:0/226351051 >> v2:172.21.15.112:3300/0 conn(0x7f03700cf8a0 0x7f03700d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916780575 0 0) 0x7f037015ee90 con 0x7f03700d1bc0 2023-10-16T13:47:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c0035b0 con 0x7f03700d1bc0 2023-10-16T13:47:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2150861414 0 0) 0x7f035c0035b0 con 0x7f03700d1bc0 2023-10-16T13:47:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 >> v2:172.21.15.112:3300/0 conn(0x7f03700cf8a0 msgr2=0x7f03700d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 --2- 172.21.15.5:0/226351051 >> v2:172.21.15.112:3300/0 conn(0x7f03700cf8a0 0x7f03700d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 >> v1:172.21.15.112:6789/0 conn(0x7f037015eab0 legacy=0x7f03700cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700cda20 con 0x7f03700d1bc0 2023-10-16T13:47:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f03680019f0 con 0x7f03700d1bc0 2023-10-16T13:47:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0374c65700 1 --2- 172.21.15.5:0/226351051 >> v2:172.21.15.112:3300/0 conn(0x7f03700cf8a0 0x7f03700d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 >> v1:172.21.15.5:6789/0 conn(0x7f03700d1bc0 legacy=0x7f03700cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c003a00 0x7f035c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f035c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f035c005210 0x7f035c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700d23b0 con 0x7f035c004850 2023-10-16T13:47:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00c0b0 con 0x7f035c003a00 2023-10-16T13:47:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00c270 con 0x7f035c005210 2023-10-16T13:47:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0374c65700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f035c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0375466700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c003a00 0x7f035c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.132+0000 7f0375c67700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f035c005210 0x7f035c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0374c65700 1 -- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f035c005210 msgr2=0x7f035c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0374c65700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f035c005210 0x7f035c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0374c65700 1 -- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c003a00 msgr2=0x7f035c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0374c65700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c003a00 0x7f035c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0374c65700 1 -- 172.21.15.5:0/226351051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0035b0 con 0x7f035c004850 2023-10-16T13:47:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0375c67700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f035c005210 0x7f035c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0375c67700 1 -- 172.21.15.5:0/226351051 reap_dead start 2023-10-16T13:47:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0374c65700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f035c004cd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0364009d30 tx=0x7f035c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e89e57f4472150 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364009e80 con 0x7f035c004850 2023-10-16T13:47:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036400e9a0 con 0x7f035c004850 2023-10-16T13:47:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f0363fff700 1 -- 172.21.15.5:0/226351051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036400ed10 con 0x7f035c004850 2023-10-16T13:47:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f03776ca700 1 -- 172.21.15.5:0/226351051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 msgr2=0x7f035c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.133+0000 7f03776ca700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f035c004cd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0364009d30 tx=0x7f035c005880 comp rx=0 tx=0).stop 2023-10-16T13:47:18.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.134+0000 7f03776ca700 1 -- 172.21.15.5:0/226351051 shutdown_connections 2023-10-16T13:47:18.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.134+0000 7f03776ca700 1 --2- 172.21.15.5:0/226351051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f035c004cd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.134+0000 7f03776ca700 1 -- 172.21.15.5:0/226351051 >> 172.21.15.5:0/226351051 conn(0x7f03700665a0 msgr2=0x7f0370066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:18.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.134+0000 7f03776ca700 1 -- 172.21.15.5:0/226351051 shutdown_connections 2023-10-16T13:47:18.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.134+0000 7f03776ca700 1 -- 172.21.15.5:0/226351051 wait complete. 2023-10-16T13:47:18.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.135+0000 7f03776ca700 1 Processor -- start 2023-10-16T13:47:18.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.135+0000 7f03776ca700 1 -- start start 2023-10-16T13:47:18.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f0370154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03700c7490 0x7f03701f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03701f3a50 0x7f03700c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c6540 con 0x7f035c004850 2023-10-16T13:47:18.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370155360 con 0x7f03700c7490 2023-10-16T13:47:18.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03701f4500 con 0x7f03701f3a50 2023-10-16T13:47:18.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f0370154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f0370154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46758/0 (socket says 172.21.15.5:46758) 2023-10-16T13:47:18.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 -- 172.21.15.5:0/518756648 learned_addr learned my addr 172.21.15.5:0/518756648 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:18.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0374c65700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03700c7490 0x7f03701f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375c67700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03701f3a50 0x7f03700c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 -- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03701f3a50 msgr2=0x7f03700c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03701f3a50 0x7f03700c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 -- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03700c7490 msgr2=0x7f03701f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03700c7490 0x7f03701f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 -- 172.21.15.5:0/518756648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03701f3f40 con 0x7f035c004850 2023-10-16T13:47:18.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0375466700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f0370154e20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f036c00f7a0 tx=0x7f036c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0052e0 con 0x7f035c004850 2023-10-16T13:47:18.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c005440 con 0x7f035c004850 2023-10-16T13:47:18.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03701f4220 con 0x7f035c004850 2023-10-16T13:47:18.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.136+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0038c0 con 0x7f035c004850 2023-10-16T13:47:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.137+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700c6f10 con 0x7f035c004850 2023-10-16T13:47:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.138+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0370158030 con 0x7f035c004850 2023-10-16T13:47:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.138+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f036c003a20 con 0x7f035c004850 2023-10-16T13:47:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.138+0000 7f0361ffb700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f035406b140 0x7f035406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.138+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f036c0895c0 con 0x7f035c004850 2023-10-16T13:47:18.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.139+0000 7f0374c65700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f035406b140 0x7f035406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.139+0000 7f0374c65700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f035406b140 0x7f035406d600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f03640090b0 tx=0x7f036401f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.143+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f036c0543a0 con 0x7f035c004850 2023-10-16T13:47:18.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.344+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03700b7540 con 0x7f035c004850 2023-10-16T13:47:18.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.345+0000 7f0361ffb700 1 -- 172.21.15.5:0/518756648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16501 (secure 0 0 0) 0x7f036c0579c0 con 0x7f035c004850 2023-10-16T13:47:18.348 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:18.349 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":75,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:17.350098+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:18.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f035406b140 msgr2=0x7f035406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f035406b140 0x7f035406d600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f03640090b0 tx=0x7f036401f040 comp rx=0 tx=0).stop 2023-10-16T13:47:18.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 msgr2=0x7f0370154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f0370154e20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f036c00f7a0 tx=0x7f036c00fab0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 shutdown_connections 2023-10-16T13:47:18.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f035406b140 0x7f035406d600 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03701f3a50 0x7f03700c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f035c004850 0x7f0370154e20 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 --2- 172.21.15.5:0/518756648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03700c7490 0x7f03701f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.347+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 >> 172.21.15.5:0/518756648 conn(0x7f03700665a0 msgr2=0x7f03700b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:18.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.348+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 shutdown_connections 2023-10-16T13:47:18.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.348+0000 7f03776ca700 1 -- 172.21.15.5:0/518756648 wait complete. 2023-10-16T13:47:18.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.485+0000 7f8467524700 1 Processor -- start 2023-10-16T13:47:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.485+0000 7f8467524700 1 -- start start 2023-10-16T13:47:18.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8467524700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f846015eab0 0x7f84600cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8467524700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84600d1d90 0x7f84600cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8467524700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84600d2170 con 0x7f84600cf6d0 2023-10-16T13:47:18.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8467524700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84600cfb60 con 0x7f84600d1d90 2023-10-16T13:47:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8467524700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846015ee90 con 0x7f846015eab0 2023-10-16T13:47:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84600d1d90 0x7f84600cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84600d1d90 0x7f84600cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46770/0 (socket says 172.21.15.5:46770) 2023-10-16T13:47:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 -- 172.21.15.5:0/4231237306 learned_addr learned my addr 172.21.15.5:0/4231237306 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f84652c0700 1 --2- 172.21.15.5:0/4231237306 >> v2:172.21.15.112:3300/0 conn(0x7f846015eab0 0x7f84600cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 -- 172.21.15.5:0/4231237306 >> v2:172.21.15.112:3300/0 conn(0x7f846015eab0 msgr2=0x7f84600cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 --2- 172.21.15.5:0/4231237306 >> v2:172.21.15.112:3300/0 conn(0x7f846015eab0 0x7f84600cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 -- 172.21.15.5:0/4231237306 >> v1:172.21.15.112:6789/0 conn(0x7f84600cf6d0 legacy=0x7f84600d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 -- 172.21.15.5:0/4231237306 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8460158370 con 0x7f84600d1d90 2023-10-16T13:47:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.486+0000 7f8465ac1700 1 --2- 172.21.15.5:0/4231237306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84600d1d90 0x7f84600cbc10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8460067550 tx=0x7f845800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d777ba688f800a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8457fff700 1 -- 172.21.15.5:0/4231237306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800e070 con 0x7f84600d1d90 2023-10-16T13:47:18.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8457fff700 1 -- 172.21.15.5:0/4231237306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845800b910 con 0x7f84600d1d90 2023-10-16T13:47:18.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8457fff700 1 -- 172.21.15.5:0/4231237306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800bcc0 con 0x7f84600d1d90 2023-10-16T13:47:18.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 -- 172.21.15.5:0/4231237306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84600d1d90 msgr2=0x7f84600cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 --2- 172.21.15.5:0/4231237306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84600d1d90 0x7f84600cbc10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8460067550 tx=0x7f845800b330 comp rx=0 tx=0).stop 2023-10-16T13:47:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 -- 172.21.15.5:0/4231237306 shutdown_connections 2023-10-16T13:47:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 --2- 172.21.15.5:0/4231237306 >> v2:172.21.15.112:3300/0 conn(0x7f846015eab0 0x7f84600cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 --2- 172.21.15.5:0/4231237306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84600d1d90 0x7f84600cbc10 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 -- 172.21.15.5:0/4231237306 >> 172.21.15.5:0/4231237306 conn(0x7f84600665a0 msgr2=0x7f8460066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 -- 172.21.15.5:0/4231237306 shutdown_connections 2023-10-16T13:47:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.487+0000 7f8467524700 1 -- 172.21.15.5:0/4231237306 wait complete. 2023-10-16T13:47:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.488+0000 7f8467524700 1 Processor -- start 2023-10-16T13:47:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.488+0000 7f8467524700 1 -- start start 2023-10-16T13:47:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8467524700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84600cf6d0 0x7f84601f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8467524700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600d1d90 0x7f84600c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8467524700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 0x7f846014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8467524700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600c5b10 con 0x7f846015eab0 2023-10-16T13:47:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8467524700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600c5df0 con 0x7f84600d1d90 2023-10-16T13:47:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8467524700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84600c60d0 con 0x7f84600cf6d0 2023-10-16T13:47:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8465ac1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 0x7f846014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8465ac1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 0x7f846014a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46774/0 (socket says 172.21.15.5:46774) 2023-10-16T13:47:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.489+0000 7f8465ac1700 1 -- 172.21.15.5:0/1324908158 learned_addr learned my addr 172.21.15.5:0/1324908158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8465ac1700 1 -- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84600cf6d0 msgr2=0x7f84601f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8465ac1700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84600cf6d0 0x7f84601f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8465ac1700 1 -- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600d1d90 msgr2=0x7f84600c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8465ac1700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600d1d90 0x7f84600c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8465ac1700 1 -- 172.21.15.5:0/1324908158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009b30 con 0x7f846015eab0 2023-10-16T13:47:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8465ac1700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 0x7f846014a810 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f84600cee90 tx=0x7f8458004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580099b0 con 0x7f846015eab0 2023-10-16T13:47:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84580092e0 con 0x7f846015eab0 2023-10-16T13:47:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845801c640 con 0x7f846015eab0 2023-10-16T13:47:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84600c63b0 con 0x7f846015eab0 2023-10-16T13:47:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.490+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846014b640 con 0x7f846015eab0 2023-10-16T13:47:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.491+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84600c6870 con 0x7f846015eab0 2023-10-16T13:47:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.491+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f845801c7a0 con 0x7f846015eab0 2023-10-16T13:47:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.492+0000 7f8455ffb700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f844406b140 0x7f844406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.492+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f845808b490 con 0x7f846015eab0 2023-10-16T13:47:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.492+0000 7f84652c0700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f844406b140 0x7f844406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.492+0000 7f84652c0700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f844406b140 0x7f844406d600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f845c006b20 tx=0x7f845c006ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.497+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8458056160 con 0x7f846015eab0 2023-10-16T13:47:18.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.700+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8460067d20 con 0x7f846015eab0 2023-10-16T13:47:18.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.701+0000 7f8455ffb700 1 -- 172.21.15.5:0/1324908158 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16501 (secure 0 0 0) 0x7f8458059780 con 0x7f846015eab0 2023-10-16T13:47:18.705 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:18.705 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":75,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:17.350098+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:18.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f844406b140 msgr2=0x7f844406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f844406b140 0x7f844406d600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f845c006b20 tx=0x7f845c006ab0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 msgr2=0x7f846014a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 0x7f846014a810 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f84600cee90 tx=0x7f8458004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 shutdown_connections 2023-10-16T13:47:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846015eab0 0x7f846014a810 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f844406b140 0x7f844406d600 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84600cf6d0 0x7f84601f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 --2- 172.21.15.5:0/1324908158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84600d1d90 0x7f84600c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 >> 172.21.15.5:0/1324908158 conn(0x7f84600665a0 msgr2=0x7f846006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:18.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 shutdown_connections 2023-10-16T13:47:18.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.704+0000 7f8467524700 1 -- 172.21.15.5:0/1324908158 wait complete. 2023-10-16T13:47:18.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:47:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.845+0000 7f2627c98700 1 Processor -- start 2023-10-16T13:47:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.845+0000 7f2627c98700 1 -- start start 2023-10-16T13:47:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2627c98700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f262006eb30 0x7f262015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2627c98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 0x7f262015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2627c98700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26200b5c70 con 0x7f262006e750 2023-10-16T13:47:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2627c98700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26200b5990 con 0x7f262006eb30 2023-10-16T13:47:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2627c98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262015b2b0 con 0x7f26200b54f0 2023-10-16T13:47:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2625a34700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f262006e750 0x7f26200ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56784/0 (socket says 172.21.15.5:56784) 2023-10-16T13:47:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2625a34700 1 -- 172.21.15.5:0/2881628298 learned_addr learned my addr 172.21.15.5:0/2881628298 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203770808 0 0) 0x7f26200b5c70 con 0x7f262006e750 2023-10-16T13:47:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2625233700 1 --2- 172.21.15.5:0/2881628298 >> v2:172.21.15.112:3300/0 conn(0x7f262006eb30 0x7f262015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2626235700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 0x7f262015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.846+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c0035b0 con 0x7f262006e750 2023-10-16T13:47:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1822793929 0 0) 0x7f260c0035b0 con 0x7f262006e750 2023-10-16T13:47:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 msgr2=0x7f262015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 0x7f262015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 >> v2:172.21.15.112:3300/0 conn(0x7f262006eb30 msgr2=0x7f262015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 --2- 172.21.15.5:0/2881628298 >> v2:172.21.15.112:3300/0 conn(0x7f262006eb30 0x7f262015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262015b590 con 0x7f262006e750 2023-10-16T13:47:18.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f261c001670 con 0x7f262006e750 2023-10-16T13:47:18.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 >> v1:172.21.15.5:6789/0 conn(0x7f262006e750 legacy=0x7f26200ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 0x7f260c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c003f80 0x7f260c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f260c004d90 0x7f260c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200b5990 con 0x7f260c003f80 2023-10-16T13:47:18.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262015b2b0 con 0x7f260c004d90 2023-10-16T13:47:18.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00ba10 con 0x7f26200b54f0 2023-10-16T13:47:18.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c003f80 0x7f260c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625a34700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 0x7f260c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2626235700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f260c004d90 0x7f260c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 -- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 msgr2=0x7f260c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26200b54f0 0x7f260c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 -- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f260c004d90 msgr2=0x7f260c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f260c004d90 0x7f260c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 -- 172.21.15.5:0/2881628298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0035b0 con 0x7f260c003f80 2023-10-16T13:47:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2626235700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f260c004d90 0x7f260c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2625233700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c003f80 0x7f260c004850 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f262006c2d0 tx=0x7f260c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de056931f26872ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.847+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000e660 con 0x7f260c003f80 2023-10-16T13:47:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000e7c0 con 0x7f260c003f80 2023-10-16T13:47:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2624a32700 1 -- 172.21.15.5:0/2881628298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000eb30 con 0x7f260c003f80 2023-10-16T13:47:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2627c98700 1 -- 172.21.15.5:0/2881628298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c003f80 msgr2=0x7f260c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2627c98700 1 --2- 172.21.15.5:0/2881628298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c003f80 0x7f260c004850 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f262006c2d0 tx=0x7f260c005880 comp rx=0 tx=0).stop 2023-10-16T13:47:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2626235700 1 -- 172.21.15.5:0/2881628298 reap_dead start 2023-10-16T13:47:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2627c98700 1 -- 172.21.15.5:0/2881628298 shutdown_connections 2023-10-16T13:47:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2627c98700 1 -- 172.21.15.5:0/2881628298 >> 172.21.15.5:0/2881628298 conn(0x7f26200cc6f0 msgr2=0x7f26200ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2627c98700 1 -- 172.21.15.5:0/2881628298 shutdown_connections 2023-10-16T13:47:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.848+0000 7f2627c98700 1 -- 172.21.15.5:0/2881628298 wait complete. 2023-10-16T13:47:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.849+0000 7f2627c98700 1 Processor -- start 2023-10-16T13:47:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.849+0000 7f2627c98700 1 -- start start 2023-10-16T13:47:18.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2627c98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f260c003f80 0x7f26201f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2627c98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26201f2e30 0x7f26200b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2627c98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 0x7f262015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2627c98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200b4450 con 0x7f26200b3fc0 2023-10-16T13:47:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2627c98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26201f4540 con 0x7f26201f2e30 2023-10-16T13:47:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2627c98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200c7a10 con 0x7f260c003f80 2023-10-16T13:47:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2626235700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 0x7f262015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2626235700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 0x7f262015cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46794/0 (socket says 172.21.15.5:46794) 2023-10-16T13:47:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2626235700 1 -- 172.21.15.5:0/97505598 learned_addr learned my addr 172.21.15.5:0/97505598 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2625233700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26201f2e30 0x7f26200b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.850+0000 7f2625a34700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f260c003f80 0x7f26201f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2626235700 1 -- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f260c003f80 msgr2=0x7f26201f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2626235700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f260c003f80 0x7f26201f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2626235700 1 -- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26201f2e30 msgr2=0x7f26200b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2626235700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26201f2e30 0x7f26200b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2626235700 1 -- 172.21.15.5:0/97505598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200c7cf0 con 0x7f26200b3fc0 2023-10-16T13:47:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2626235700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 0x7f262015cc80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f262015b3f0 tx=0x7f26180104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800e050 con 0x7f26200b3fc0 2023-10-16T13:47:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800f040 con 0x7f26200b3fc0 2023-10-16T13:47:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26200c7fd0 con 0x7f26200b3fc0 2023-10-16T13:47:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618007ea0 con 0x7f26200b3fc0 2023-10-16T13:47:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.851+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26200c8590 con 0x7f26200b3fc0 2023-10-16T13:47:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.852+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2620067d20 con 0x7f26200b3fc0 2023-10-16T13:47:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.853+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f2618010d00 con 0x7f26200b3fc0 2023-10-16T13:47:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.853+0000 7f26167fc700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b140 0x7f260406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.853+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f261808a340 con 0x7f26200b3fc0 2023-10-16T13:47:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.854+0000 7f2625a34700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b140 0x7f260406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.854+0000 7f2625a34700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b140 0x7f260406d600 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f26200b4760 tx=0x7f261c000f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:18.857+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2618054ff0 con 0x7f26200b3fc0 2023-10-16T13:47:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.109+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f262006b950 con 0x7f26200b3fc0 2023-10-16T13:47:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.986+0000 7f26167fc700 1 -- 172.21.15.5:0/97505598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f261801ee90 con 0x7f26200b3fc0 2023-10-16T13:47:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.989+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b140 msgr2=0x7f260406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.989+0000 7f2627c98700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b140 0x7f260406d600 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f26200b4760 tx=0x7f261c000f80 comp rx=0 tx=0).stop 2023-10-16T13:47:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.989+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 msgr2=0x7f262015cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.989+0000 7f2627c98700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 0x7f262015cc80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f262015b3f0 tx=0x7f26180104a0 comp rx=0 tx=0).stop 2023-10-16T13:47:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 shutdown_connections 2023-10-16T13:47:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26200b3fc0 0x7f262015cc80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b140 0x7f260406d600 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f260c003f80 0x7f26201f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 --2- 172.21.15.5:0/97505598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26201f2e30 0x7f26200b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 >> 172.21.15.5:0/97505598 conn(0x7f26200cc6f0 msgr2=0x7f262006dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 shutdown_connections 2023-10-16T13:47:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:19.990+0000 7f2627c98700 1 -- 172.21.15.5:0/97505598 wait complete. 2023-10-16T13:47:20.007 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:47:20.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:47:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.140+0000 7f46a17c0700 1 Processor -- start 2023-10-16T13:47:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.141+0000 7f46a17c0700 1 -- start start 2023-10-16T13:47:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.141+0000 7f46a17c0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f469c0af740 0x7f469c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.141+0000 7f46a17c0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.141+0000 7f46a17c0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0afd30 con 0x7f469c0cd870 2023-10-16T13:47:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.141+0000 7f46a17c0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c161cd0 con 0x7f469c0af740 2023-10-16T13:47:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.141+0000 7f46a17c0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c161fb0 con 0x7f469c161730 2023-10-16T13:47:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469a7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f469c0af740 0x7f469c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c0b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:44708/0 (socket says 172.21.15.5:44708) 2023-10-16T13:47:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 -- 172.21.15.5:0/409560308 learned_addr learned my addr 172.21.15.5:0/409560308 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469affd700 1 --1- 172.21.15.5:0/409560308 >> v1:172.21.15.112:6789/0 conn(0x7f469c0cd870 0x7f469c0cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47780/0 (socket says 172.21.15.5:47780) 2023-10-16T13:47:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 -- 172.21.15.5:0/409560308 >> v2:172.21.15.112:3300/0 conn(0x7f469c0af740 msgr2=0x7f469c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 --2- 172.21.15.5:0/409560308 >> v2:172.21.15.112:3300/0 conn(0x7f469c0af740 0x7f469c0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 -- 172.21.15.5:0/409560308 >> v1:172.21.15.112:6789/0 conn(0x7f469c0cd870 legacy=0x7f469c0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 -- 172.21.15.5:0/409560308 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c162290 con 0x7f469c161730 2023-10-16T13:47:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469a7fc700 1 --2- 172.21.15.5:0/409560308 >> v2:172.21.15.112:3300/0 conn(0x7f469c0af740 0x7f469c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.142+0000 7f469b7fe700 1 --2- 172.21.15.5:0/409560308 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c0b1a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4694009e80 tx=0x7f469400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=163f9e21fc4f744d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f4699ffb700 1 -- 172.21.15.5:0/409560308 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400e070 con 0x7f469c161730 2023-10-16T13:47:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f4699ffb700 1 -- 172.21.15.5:0/409560308 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469400b8d0 con 0x7f469c161730 2023-10-16T13:47:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f4699ffb700 1 -- 172.21.15.5:0/409560308 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400bc80 con 0x7f469c161730 2023-10-16T13:47:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 -- 172.21.15.5:0/409560308 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 msgr2=0x7f469c0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 --2- 172.21.15.5:0/409560308 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c0b1a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4694009e80 tx=0x7f469400b330 comp rx=0 tx=0).stop 2023-10-16T13:47:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 -- 172.21.15.5:0/409560308 shutdown_connections 2023-10-16T13:47:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 --2- 172.21.15.5:0/409560308 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c0b1a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 --2- 172.21.15.5:0/409560308 >> v2:172.21.15.112:3300/0 conn(0x7f469c0af740 0x7f469c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 -- 172.21.15.5:0/409560308 >> 172.21.15.5:0/409560308 conn(0x7f469c099a30 msgr2=0x7f469c0d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 -- 172.21.15.5:0/409560308 shutdown_connections 2023-10-16T13:47:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.143+0000 7f46a17c0700 1 -- 172.21.15.5:0/409560308 wait complete. 2023-10-16T13:47:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.144+0000 7f46a17c0700 1 Processor -- start 2023-10-16T13:47:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 -- start start 2023-10-16T13:47:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f469c0af740 0x7f469c1f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 0x7f469c0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b3fe0 con 0x7f469c0cd870 2023-10-16T13:47:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b33d0 con 0x7f469c0af740 2023-10-16T13:47:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f46a17c0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b36b0 con 0x7f469c161730 2023-10-16T13:47:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f469a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 0x7f469c0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f469a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 0x7f469c0c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46808/0 (socket says 172.21.15.5:46808) 2023-10-16T13:47:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.145+0000 7f469a7fc700 1 -- 172.21.15.5:0/3262381525 learned_addr learned my addr 172.21.15.5:0/3262381525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469b7fe700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469affd700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f469c0af740 0x7f469c1f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469a7fc700 1 -- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 msgr2=0x7f469c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469a7fc700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469a7fc700 1 -- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f469c0af740 msgr2=0x7f469c1f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469a7fc700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f469c0af740 0x7f469c1f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469a7fc700 1 -- 172.21.15.5:0/3262381525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0094a0 con 0x7f469c0cd870 2023-10-16T13:47:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469b7fe700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469affd700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f469c0af740 0x7f469c1f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f469a7fc700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 0x7f469c0c5a80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f468c00ebb0 tx=0x7f468c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00c850 con 0x7f469c0cd870 2023-10-16T13:47:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00c9b0 con 0x7f469c0cd870 2023-10-16T13:47:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4694009b30 con 0x7f469c0cd870 2023-10-16T13:47:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00cd40 con 0x7f469c0cd870 2023-10-16T13:47:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.146+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0b3c70 con 0x7f469c0cd870 2023-10-16T13:47:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.147+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c04ebb0 con 0x7f469c0cd870 2023-10-16T13:47:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.148+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f468c013470 con 0x7f469c0cd870 2023-10-16T13:47:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.148+0000 7f46837fe700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f468806b170 0x7f468806d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.148+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f468c089a70 con 0x7f469c0cd870 2023-10-16T13:47:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.148+0000 7f469affd700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f468806b170 0x7f468806d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.149+0000 7f469affd700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f468806b170 0x7f468806d630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4690000fb0 tx=0x7f4690007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.153+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f468c054740 con 0x7f469c0cd870 2023-10-16T13:47:20.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.402+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f469c071df0 con 0x7f469c0cd870 2023-10-16T13:47:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.987+0000 7f46837fe700 1 -- 172.21.15.5:0/3262381525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7f468c057d60 con 0x7f469c0cd870 2023-10-16T13:47:20.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f468806b170 msgr2=0x7f468806d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f468806b170 0x7f468806d630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4690000fb0 tx=0x7f4690007ec0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 msgr2=0x7f469c0c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 0x7f469c0c5a80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f468c00ebb0 tx=0x7f468c00eec0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 shutdown_connections 2023-10-16T13:47:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f468806b170 0x7f468806d630 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f469c161730 0x7f469c15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f469c0af740 0x7f469c1f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 --2- 172.21.15.5:0/3262381525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f469c0cd870 0x7f469c0c5a80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 >> 172.21.15.5:0/3262381525 conn(0x7f469c099a30 msgr2=0x7f469c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 shutdown_connections 2023-10-16T13:47:20.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:20.990+0000 7f46a17c0700 1 -- 172.21.15.5:0/3262381525 wait complete. 2023-10-16T13:47:21.008 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:47:21.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.135+0000 7fb555382700 1 Processor -- start 2023-10-16T13:47:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.135+0000 7fb555382700 1 -- start start 2023-10-16T13:47:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb555382700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb55015dbc0 0x7fb55015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb555382700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500d3fc0 0x7fb5500d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb555382700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55015e4e0 con 0x7fb5500b7050 2023-10-16T13:47:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb555382700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500b7560 con 0x7fb55015dbc0 2023-10-16T13:47:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb555382700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500b7840 con 0x7fb5500d3fc0 2023-10-16T13:47:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb54effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb55015dbc0 0x7fb55015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb54f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5500b7050 0x7fb5500d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56822/0 (socket says 172.21.15.5:56822) 2023-10-16T13:47:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.136+0000 7fb54f7fe700 1 -- 172.21.15.5:0/3330200405 learned_addr learned my addr 172.21.15.5:0/3330200405 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:21.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54e7fc700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500d3fc0 0x7fb5500d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54effd700 1 -- 172.21.15.5:0/3330200405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500d3fc0 msgr2=0x7fb5500d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54effd700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500d3fc0 0x7fb5500d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54effd700 1 -- 172.21.15.5:0/3330200405 >> v1:172.21.15.5:6789/0 conn(0x7fb5500b7050 legacy=0x7fb5500d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54effd700 1 -- 172.21.15.5:0/3330200405 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5500b7b20 con 0x7fb55015dbc0 2023-10-16T13:47:21.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54dffb700 1 -- 172.21.15.5:0/3330200405 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322002648 0 0) 0x7fb55015e4e0 con 0x7fb5500b7050 2023-10-16T13:47:21.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54e7fc700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500d3fc0 0x7fb5500d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:21.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54effd700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb55015dfa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb538009820 tx=0x7fb538009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a691b0b2b52115 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54dffb700 1 -- 172.21.15.5:0/3330200405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538005e30 con 0x7fb55015dbc0 2023-10-16T13:47:21.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54dffb700 1 -- 172.21.15.5:0/3330200405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538006030 con 0x7fb55015dbc0 2023-10-16T13:47:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.137+0000 7fb54dffb700 1 -- 172.21.15.5:0/3330200405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5380063e0 con 0x7fb55015dbc0 2023-10-16T13:47:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 -- 172.21.15.5:0/3330200405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 msgr2=0x7fb55015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb55015dfa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb538009820 tx=0x7fb538009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 -- 172.21.15.5:0/3330200405 shutdown_connections 2023-10-16T13:47:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb55015dfa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 --2- 172.21.15.5:0/3330200405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500d3fc0 0x7fb5500d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 -- 172.21.15.5:0/3330200405 >> 172.21.15.5:0/3330200405 conn(0x7fb55009cb40 msgr2=0x7fb5500d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:21.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 -- 172.21.15.5:0/3330200405 shutdown_connections 2023-10-16T13:47:21.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.138+0000 7fb555382700 1 -- 172.21.15.5:0/3330200405 wait complete. 2023-10-16T13:47:21.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.139+0000 7fb555382700 1 Processor -- start 2023-10-16T13:47:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.139+0000 7fb555382700 1 -- start start 2023-10-16T13:47:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb555382700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500b7050 0x7fb550155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb555382700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5500d3fc0 0x7fb5500c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb555382700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb550154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb555382700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550156400 con 0x7fb55015dbc0 2023-10-16T13:47:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb555382700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550155140 con 0x7fb5500d3fc0 2023-10-16T13:47:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb555382700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501553e0 con 0x7fb5500b7050 2023-10-16T13:47:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb550154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb550154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46824/0 (socket says 172.21.15.5:46824) 2023-10-16T13:47:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 -- 172.21.15.5:0/1737805035 learned_addr learned my addr 172.21.15.5:0/1737805035 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54effd700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500b7050 0x7fb550155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 -- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500b7050 msgr2=0x7fb550155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500b7050 0x7fb550155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 -- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5500d3fc0 msgr2=0x7fb5500c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5500d3fc0 0x7fb5500c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 -- 172.21.15.5:0/1737805035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538009430 con 0x7fb55015dbc0 2023-10-16T13:47:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.140+0000 7fb54f7fe700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb550154480 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb54800cc70 tx=0x7fb54800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.141+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800ad80 con 0x7fb55015dbc0 2023-10-16T13:47:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.141+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800ce70 con 0x7fb55015dbc0 2023-10-16T13:47:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.141+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5501556c0 con 0x7fb55015dbc0 2023-10-16T13:47:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.141+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480072f0 con 0x7fb55015dbc0 2023-10-16T13:47:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.141+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb550158ff0 con 0x7fb55015dbc0 2023-10-16T13:47:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.142+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb550155be0 con 0x7fb55015dbc0 2023-10-16T13:47:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.142+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fb548007450 con 0x7fb55015dbc0 2023-10-16T13:47:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.142+0000 7fb5477fe700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb53006b140 0x7fb53006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.143+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb548089800 con 0x7fb55015dbc0 2023-10-16T13:47:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.143+0000 7fb54effd700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb53006b140 0x7fb53006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.143+0000 7fb54effd700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb53006b140 0x7fb53006d600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb538009b70 tx=0x7fb538008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.147+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb550155be0 con 0x7fb55015dbc0 2023-10-16T13:47:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.391+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb550155be0 con 0x7fb55015dbc0 2023-10-16T13:47:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.391+0000 7fb5477fe700 1 -- 172.21.15.5:0/1737805035 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fb550155be0 con 0x7fb55015dbc0 2023-10-16T13:47:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:21.395 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:17.350421+0000","modified":"2023-10-16T13:47:20.404057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1286413980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1286413980},{"type":"v1","addr":"172.21.15.5:6834","nonce":1286413980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-16T13:47:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb53006b140 msgr2=0x7fb53006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb53006b140 0x7fb53006d600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb538009b70 tx=0x7fb538008070 comp rx=0 tx=0).stop 2023-10-16T13:47:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 msgr2=0x7fb550154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb550154480 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb54800cc70 tx=0x7fb54800a340 comp rx=0 tx=0).stop 2023-10-16T13:47:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 shutdown_connections 2023-10-16T13:47:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55015dbc0 0x7fb550154480 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb53006b140 0x7fb53006d600 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5500b7050 0x7fb550155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 --2- 172.21.15.5:0/1737805035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5500d3fc0 0x7fb5500c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 >> 172.21.15.5:0/1737805035 conn(0x7fb55009cb40 msgr2=0x7fb5501e4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:21.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 shutdown_connections 2023-10-16T13:47:21.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.393+0000 7fb555382700 1 -- 172.21.15.5:0/1737805035 wait complete. 2023-10-16T13:47:21.399 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 50 2023-10-16T13:47:21.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:21.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.530+0000 7f60dfa4b700 1 Processor -- start 2023-10-16T13:47:21.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.531+0000 7f60dfa4b700 1 -- start start 2023-10-16T13:47:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60dfa4b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 0x7f60d8168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60dfa4b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d8161390 con 0x7f60d8160fb0 2023-10-16T13:47:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60dfa4b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80b23f0 con 0x7f60d80cee40 2023-10-16T13:47:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60dfa4b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80cf2f0 con 0x7f60d806af50 2023-10-16T13:47:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60dd7e7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60d8160fb0 0x7f60d80727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56832/0 (socket says 172.21.15.5:56832) 2023-10-16T13:47:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60dd7e7700 1 -- 172.21.15.5:0/4156379846 learned_addr learned my addr 172.21.15.5:0/4156379846 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55713325 0 0) 0x7f60d8161390 con 0x7f60d8160fb0 2023-10-16T13:47:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60ddfe8700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 0x7f60d8168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c40035b0 con 0x7f60d8160fb0 2023-10-16T13:47:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197010696 0 0) 0x7f60c40035b0 con 0x7f60d8160fb0 2023-10-16T13:47:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 msgr2=0x7f60d8168930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 0x7f60d8168930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 >> v1:172.21.15.112:6789/0 conn(0x7f60d80cee40 legacy=0x7f60d806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80b26b0 con 0x7f60d8160fb0 2023-10-16T13:47:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f60d40017f0 con 0x7f60d8160fb0 2023-10-16T13:47:21.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.532+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 >> v1:172.21.15.5:6789/0 conn(0x7f60d8160fb0 legacy=0x7f60d80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 0x7f60c4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c4003f70 0x7f60c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80cf2f0 con 0x7f60c4004d90 2023-10-16T13:47:21.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c400ba70 con 0x7f60c4003f70 2023-10-16T13:47:21.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c400bc30 con 0x7f60d806af50 2023-10-16T13:47:21.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60dcfe6700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c4003f70 0x7f60c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60dd7e7700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 0x7f60c4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 -- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 msgr2=0x7f60c4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d806af50 0x7f60c4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 -- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c4003f70 msgr2=0x7f60c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c4003f70 0x7f60c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 -- 172.21.15.5:0/4156379846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40035b0 con 0x7f60c4004d90 2023-10-16T13:47:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60ddfe8700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60c4005210 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009f90 tx=0x7f60c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33141c330e3ef76f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000ec30 con 0x7f60c4004d90 2023-10-16T13:47:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d000f040 con 0x7f60c4004d90 2023-10-16T13:47:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.533+0000 7f60cbfff700 1 -- 172.21.15.5:0/4156379846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0014480 con 0x7f60c4004d90 2023-10-16T13:47:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60dfa4b700 1 -- 172.21.15.5:0/4156379846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 msgr2=0x7f60c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/4156379846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60c4005210 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009f90 tx=0x7f60c4005880 comp rx=0 tx=0).stop 2023-10-16T13:47:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60ddfe8700 1 -- 172.21.15.5:0/4156379846 reap_dead start 2023-10-16T13:47:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60dfa4b700 1 -- 172.21.15.5:0/4156379846 shutdown_connections 2023-10-16T13:47:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60dfa4b700 1 -- 172.21.15.5:0/4156379846 >> 172.21.15.5:0/4156379846 conn(0x7f60d80cd270 msgr2=0x7f60d80cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60dfa4b700 1 -- 172.21.15.5:0/4156379846 shutdown_connections 2023-10-16T13:47:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.534+0000 7f60dfa4b700 1 -- 172.21.15.5:0/4156379846 wait complete. 2023-10-16T13:47:21.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.535+0000 7f60dfa4b700 1 Processor -- start 2023-10-16T13:47:21.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.535+0000 7f60dfa4b700 1 -- start start 2023-10-16T13:47:21.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dfa4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60d814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dfa4b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d80b1430 0x7f60d80b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dfa4b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d814f650 0x7f60d814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dfa4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80b1df0 con 0x7f60c4004d90 2023-10-16T13:47:21.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dfa4b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81f6620 con 0x7f60d814f650 2023-10-16T13:47:21.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dfa4b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81f6890 con 0x7f60d80b1430 2023-10-16T13:47:21.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60d814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60d814cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46840/0 (socket says 172.21.15.5:46840) 2023-10-16T13:47:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 -- 172.21.15.5:0/885912888 learned_addr learned my addr 172.21.15.5:0/885912888 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 -- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d80b1430 msgr2=0x7f60d80b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d80b1430 0x7f60d80b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 -- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d814f650 msgr2=0x7f60d814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d814f650 0x7f60d814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 -- 172.21.15.5:0/885912888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d81f6b70 con 0x7f60c4004d90 2023-10-16T13:47:21.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.536+0000 7f60dd7e7700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60d814cde0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f60d400fae0 tx=0x7f60d400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.537+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40072e0 con 0x7f60c4004d90 2023-10-16T13:47:21.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.537+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4007460 con 0x7f60c4004d90 2023-10-16T13:47:21.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.537+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d81f6e50 con 0x7f60c4004d90 2023-10-16T13:47:21.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.537+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4005830 con 0x7f60c4004d90 2023-10-16T13:47:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.537+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d8150380 con 0x7f60c4004d90 2023-10-16T13:47:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.538+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d815f050 con 0x7f60c4004d90 2023-10-16T13:47:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.538+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f60d4005990 con 0x7f60c4004d90 2023-10-16T13:47:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.538+0000 7f60c9ffb700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60bc06b140 0x7f60bc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.539+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60d4089b70 con 0x7f60c4004d90 2023-10-16T13:47:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.539+0000 7f60dcfe6700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60bc06b140 0x7f60bc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.539+0000 7f60dcfe6700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60bc06b140 0x7f60bc06d600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f60d8072ce0 tx=0x7f60cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.543+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60d40582d0 con 0x7f60c4004d90 2023-10-16T13:47:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.746+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d815dfd0 con 0x7f60c4004d90 2023-10-16T13:47:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.747+0000 7f60c9ffb700 1 -- 172.21.15.5:0/885912888 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f60d4001060 con 0x7f60c4004d90 2023-10-16T13:47:21.750 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:21.751 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:18.949509+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60bc06b140 msgr2=0x7f60bc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60bc06b140 0x7f60bc06d600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f60d8072ce0 tx=0x7f60cc009040 comp rx=0 tx=0).stop 2023-10-16T13:47:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 msgr2=0x7f60d814cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60d814cde0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f60d400fae0 tx=0x7f60d400fea0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 shutdown_connections 2023-10-16T13:47:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60d814f650 0x7f60d814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60c4004d90 0x7f60d814cde0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60bc06b140 0x7f60bc06d600 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 --2- 172.21.15.5:0/885912888 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60d80b1430 0x7f60d80b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 >> 172.21.15.5:0/885912888 conn(0x7f60d80cd270 msgr2=0x7f60d80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:21.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 shutdown_connections 2023-10-16T13:47:21.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.749+0000 7f60dfa4b700 1 -- 172.21.15.5:0/885912888 wait complete. 2023-10-16T13:47:21.765 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:47:21.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:47:21.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.887+0000 7f1fd7526700 1 Processor -- start 2023-10-16T13:47:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd7526700 1 -- start start 2023-10-16T13:47:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd7526700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 0x7f1fd015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd7526700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1fd00cede0 0x7f1fd015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd7526700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd00cf260 con 0x7f1fd006a840 2023-10-16T13:47:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd7526700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd01619a0 con 0x7f1fd00cede0 2023-10-16T13:47:21.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd7526700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b2d60 con 0x7f1fd00cd950 2023-10-16T13:47:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd5ac3700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1fd006a840 0x7f1fd0161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56856/0 (socket says 172.21.15.5:56856) 2023-10-16T13:47:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.888+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1384354460 learned_addr learned my addr 172.21.15.5:0/1384354460 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681088648 0 0) 0x7f1fd00cf260 con 0x7f1fd006a840 2023-10-16T13:47:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fd52c2700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 0x7f1fd015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fbc0035b0 con 0x7f1fd006a840 2023-10-16T13:47:21.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fd4ac1700 1 --2- 172.21.15.5:0/1384354460 >> v2:172.21.15.112:3300/0 conn(0x7f1fd00cede0 0x7f1fd015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190423949 0 0) 0x7f1fbc0035b0 con 0x7f1fd006a840 2023-10-16T13:47:21.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 msgr2=0x7f1fd015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 0x7f1fd015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 >> v2:172.21.15.112:3300/0 conn(0x7f1fd00cede0 msgr2=0x7f1fd015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 --2- 172.21.15.5:0/1384354460 >> v2:172.21.15.112:3300/0 conn(0x7f1fd00cede0 0x7f1fd015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00cdd30 con 0x7f1fd006a840 2023-10-16T13:47:21.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f1fc80019f0 con 0x7f1fd006a840 2023-10-16T13:47:21.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 >> v1:172.21.15.5:6789/0 conn(0x7f1fd006a840 legacy=0x7f1fd0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fbc003a00 0x7f1fbc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 0x7f1fbc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fbc004d90 0x7f1fbc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd01619a0 con 0x7f1fbc004d90 2023-10-16T13:47:21.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b2d60 con 0x7f1fbc003a00 2023-10-16T13:47:21.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc00ba10 con 0x7f1fd00cd950 2023-10-16T13:47:21.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fbc004d90 0x7f1fbc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fd52c2700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fbc003a00 0x7f1fbc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.889+0000 7f1fd4ac1700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 0x7f1fbc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 msgr2=0x7f1fbc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00cd950 0x7f1fbc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fbc003a00 msgr2=0x7f1fbc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:21.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fbc003a00 0x7f1fbc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1384354460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0035b0 con 0x7f1fbc004d90 2023-10-16T13:47:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fbc004d90 0x7f1fbc005210 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800a8d0 tx=0x7f1fbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f35681939b9d13 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800a340 con 0x7f1fbc004d90 2023-10-16T13:47:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8012600 con 0x7f1fbc004d90 2023-10-16T13:47:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fc7fff700 1 -- 172.21.15.5:0/1384354460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80129b0 con 0x7f1fbc004d90 2023-10-16T13:47:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd7526700 1 -- 172.21.15.5:0/1384354460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fbc004d90 msgr2=0x7f1fbc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1384354460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fbc004d90 0x7f1fbc005210 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800a8d0 tx=0x7f1fbc005880 comp rx=0 tx=0).stop 2023-10-16T13:47:21.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1384354460 reap_dead start 2023-10-16T13:47:21.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd7526700 1 -- 172.21.15.5:0/1384354460 shutdown_connections 2023-10-16T13:47:21.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.890+0000 7f1fd7526700 1 -- 172.21.15.5:0/1384354460 >> 172.21.15.5:0/1384354460 conn(0x7f1fd006dae0 msgr2=0x7f1fd006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:21.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.891+0000 7f1fd7526700 1 -- 172.21.15.5:0/1384354460 shutdown_connections 2023-10-16T13:47:21.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.891+0000 7f1fd7526700 1 -- 172.21.15.5:0/1384354460 wait complete. 2023-10-16T13:47:21.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 Processor -- start 2023-10-16T13:47:21.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 -- start start 2023-10-16T13:47:21.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd00ca160 0x7f1fd00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00ca540 0x7f1fd00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 0x7f1fd00b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00c8940 con 0x7f1fd00af320 2023-10-16T13:47:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00af7d0 con 0x7f1fd00ca160 2023-10-16T13:47:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.892+0000 7f1fd7526700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b5a70 con 0x7f1fd00ca540 2023-10-16T13:47:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 0x7f1fd00b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 0x7f1fd00b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46864/0 (socket says 172.21.15.5:46864) 2023-10-16T13:47:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1054831058 learned_addr learned my addr 172.21.15.5:0/1054831058 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd52c2700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd00ca160 0x7f1fd00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd4ac1700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00ca540 0x7f1fd00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00ca540 msgr2=0x7f1fd00aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00ca540 0x7f1fd00aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd00ca160 msgr2=0x7f1fd00c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd00ca160 0x7f1fd00c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 -- 172.21.15.5:0/1054831058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00ad030 con 0x7f1fd00af320 2023-10-16T13:47:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd5ac3700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 0x7f1fd00b4a40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc0046e0 tx=0x7f1fc8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800a340 con 0x7f1fd00af320 2023-10-16T13:47:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc80019c0 con 0x7f1fd00af320 2023-10-16T13:47:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd00b5790 con 0x7f1fd00af320 2023-10-16T13:47:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8001e50 con 0x7f1fd00af320 2023-10-16T13:47:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.893+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd00accc0 con 0x7f1fd00af320 2023-10-16T13:47:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.894+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd00ad1c0 con 0x7f1fd00af320 2023-10-16T13:47:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.896+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f1fc8019070 con 0x7f1fd00af320 2023-10-16T13:47:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.896+0000 7f1fc5ffb700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb406b140 0x7f1fb406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.896+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fc808b0b0 con 0x7f1fd00af320 2023-10-16T13:47:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.896+0000 7f1fd52c2700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb406b140 0x7f1fb406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.897+0000 7f1fd52c2700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb406b140 0x7f1fb406d600 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009be0 tx=0x7f1fc0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:21.900+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fc8056030 con 0x7f1fd00af320 2023-10-16T13:47:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.099+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fd015ec00 con 0x7f1fb406b140 2023-10-16T13:47:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.108+0000 7f1fc5ffb700 1 -- 172.21.15.5:0/1054831058 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289475 (secure 0 0 0) 0x7f1fc0019070 con 0x7f1fb406b140 2023-10-16T13:47:22.114 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb406b140 msgr2=0x7f1fb406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb406b140 0x7f1fb406d600 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009be0 tx=0x7f1fc0009210 comp rx=0 tx=0).stop 2023-10-16T13:47:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 msgr2=0x7f1fd00b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 0x7f1fd00b4a40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc0046e0 tx=0x7f1fc8001360 comp rx=0 tx=0).stop 2023-10-16T13:47:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 shutdown_connections 2023-10-16T13:47:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd00af320 0x7f1fd00b4a40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd00ca160 0x7f1fd00c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb406b140 0x7f1fb406d600 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 --2- 172.21.15.5:0/1054831058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fd00ca540 0x7f1fd00aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 >> 172.21.15.5:0/1054831058 conn(0x7f1fd006dae0 msgr2=0x7f1fd015db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 shutdown_connections 2023-10-16T13:47:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.111+0000 7f1fd7526700 1 -- 172.21.15.5:0/1054831058 wait complete. 2023-10-16T13:47:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:47:22.126 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2023-10-16T13:47:21.595011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257812,"kb_used_data":8344,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716908,"statfs":{"total":773094113280,"available":772830113792,"internally_reserved":0,"allocated":8544256,"data_stored":4341949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669032"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970093+0000","last_change":"2023-10-16T13:47:17.967594+0000","last_active":"2023-10-16T13:47:17.970093+0000","last_peered":"2023-10-16T13:47:17.970093+0000","last_clean":"2023-10-16T13:47:17.970093+0000","last_became_active":"2023-10-16T13:47:17.965823+0000","last_became_peered":"2023-10-16T13:47:17.965823+0000","last_unstale":"2023-10-16T13:47:17.970093+0000","last_undegraded":"2023-10-16T13:47:17.970093+0000","last_fullsized":"2023-10-16T13:47:17.970093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:39:16.964786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972870+0000","last_change":"2023-10-16T13:47:17.970011+0000","last_active":"2023-10-16T13:47:17.972870+0000","last_peered":"2023-10-16T13:47:17.972870+0000","last_clean":"2023-10-16T13:47:17.972870+0000","last_became_active":"2023-10-16T13:47:17.967674+0000","last_became_peered":"2023-10-16T13:47:17.967674+0000","last_unstale":"2023-10-16T13:47:17.972870+0000","last_undegraded":"2023-10-16T13:47:17.972870+0000","last_fullsized":"2023-10-16T13:47:17.972870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:00:14.640426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967987+0000","last_change":"2023-10-16T13:47:17.963733+0000","last_active":"2023-10-16T13:47:17.967987+0000","last_peered":"2023-10-16T13:47:17.967987+0000","last_clean":"2023-10-16T13:47:17.967987+0000","last_became_active":"2023-10-16T13:47:17.963447+0000","last_became_peered":"2023-10-16T13:47:17.963447+0000","last_unstale":"2023-10-16T13:47:17.967987+0000","last_undegraded":"2023-10-16T13:47:17.967987+0000","last_fullsized":"2023-10-16T13:47:17.967987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:09:05.271494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.974153+0000","last_change":"2023-10-16T13:47:17.969302+0000","last_active":"2023-10-16T13:47:17.974153+0000","last_peered":"2023-10-16T13:47:17.974153+0000","last_clean":"2023-10-16T13:47:17.974153+0000","last_became_active":"2023-10-16T13:47:17.968997+0000","last_became_peered":"2023-10-16T13:47:17.968997+0000","last_unstale":"2023-10-16T13:47:17.974153+0000","last_undegraded":"2023-10-16T13:47:17.974153+0000","last_fullsized":"2023-10-16T13:47:17.974153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:47:35.577251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971698+0000","last_change":"2023-10-16T13:47:17.965691+0000","last_active":"2023-10-16T13:47:17.971698+0000","last_peered":"2023-10-16T13:47:17.971698+0000","last_clean":"2023-10-16T13:47:17.971698+0000","last_became_active":"2023-10-16T13:47:17.965408+0000","last_became_peered":"2023-10-16T13:47:17.965408+0000","last_unstale":"2023-10-16T13:47:17.971698+0000","last_undegraded":"2023-10-16T13:47:17.971698+0000","last_fullsized":"2023-10-16T13:47:17.971698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:10:37.043855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969675+0000","last_change":"2023-10-16T13:47:17.968671+0000","last_active":"2023-10-16T13:47:17.969675+0000","last_peered":"2023-10-16T13:47:17.969675+0000","last_clean":"2023-10-16T13:47:17.969675+0000","last_became_active":"2023-10-16T13:47:17.968381+0000","last_became_peered":"2023-10-16T13:47:17.968381+0000","last_unstale":"2023-10-16T13:47:17.969675+0000","last_undegraded":"2023-10-16T13:47:17.969675+0000","last_fullsized":"2023-10-16T13:47:17.969675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:07.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.966675+0000","last_change":"2023-10-16T13:47:17.962507+0000","last_active":"2023-10-16T13:47:17.966675+0000","last_peered":"2023-10-16T13:47:17.966675+0000","last_clean":"2023-10-16T13:47:17.966675+0000","last_became_active":"2023-10-16T13:47:17.962196+0000","last_became_peered":"2023-10-16T13:47:17.962196+0000","last_unstale":"2023-10-16T13:47:17.966675+0000","last_undegraded":"2023-10-16T13:47:17.966675+0000","last_fullsized":"2023-10-16T13:47:17.966675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:35.034787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967905+0000","last_change":"2023-10-16T13:47:17.965686+0000","last_active":"2023-10-16T13:47:17.967905+0000","last_peered":"2023-10-16T13:47:17.967905+0000","last_clean":"2023-10-16T13:47:17.967905+0000","last_became_active":"2023-10-16T13:47:17.965424+0000","last_became_peered":"2023-10-16T13:47:17.965424+0000","last_unstale":"2023-10-16T13:47:17.967905+0000","last_undegraded":"2023-10-16T13:47:17.967905+0000","last_fullsized":"2023-10-16T13:47:17.967905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:57.440679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.977360+0000","last_change":"2023-10-16T13:47:17.976710+0000","last_active":"2023-10-16T13:47:17.977360+0000","last_peered":"2023-10-16T13:47:17.977360+0000","last_clean":"2023-10-16T13:47:17.977360+0000","last_became_active":"2023-10-16T13:47:17.976371+0000","last_became_peered":"2023-10-16T13:47:17.976371+0000","last_unstale":"2023-10-16T13:47:17.977360+0000","last_undegraded":"2023-10-16T13:47:17.977360+0000","last_fullsized":"2023-10-16T13:47:17.977360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969453+0000","last_change":"2023-10-16T13:47:17.966641+0000","last_active":"2023-10-16T13:47:17.969453+0000","last_peered":"2023-10-16T13:47:17.969453+0000","last_clean":"2023-10-16T13:47:17.969453+0000","last_became_active":"2023-10-16T13:47:17.966349+0000","last_became_peered":"2023-10-16T13:47:17.966349+0000","last_unstale":"2023-10-16T13:47:17.969453+0000","last_undegraded":"2023-10-16T13:47:17.969453+0000","last_fullsized":"2023-10-16T13:47:17.969453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:44.362752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969053+0000","last_change":"2023-10-16T13:47:17.964826+0000","last_active":"2023-10-16T13:47:17.969053+0000","last_peered":"2023-10-16T13:47:17.969053+0000","last_clean":"2023-10-16T13:47:17.969053+0000","last_became_active":"2023-10-16T13:47:17.964513+0000","last_became_peered":"2023-10-16T13:47:17.964513+0000","last_unstale":"2023-10-16T13:47:17.969053+0000","last_undegraded":"2023-10-16T13:47:17.969053+0000","last_fullsized":"2023-10-16T13:47:17.969053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:35.076804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969801+0000","last_change":"2023-10-16T13:47:17.966845+0000","last_active":"2023-10-16T13:47:17.969801+0000","last_peered":"2023-10-16T13:47:17.969801+0000","last_clean":"2023-10-16T13:47:17.969801+0000","last_became_active":"2023-10-16T13:47:17.966318+0000","last_became_peered":"2023-10-16T13:47:17.966318+0000","last_unstale":"2023-10-16T13:47:17.969801+0000","last_undegraded":"2023-10-16T13:47:17.969801+0000","last_fullsized":"2023-10-16T13:47:17.969801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:20:22.390577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.966707+0000","last_change":"2023-10-16T13:47:17.962532+0000","last_active":"2023-10-16T13:47:17.966707+0000","last_peered":"2023-10-16T13:47:17.966707+0000","last_clean":"2023-10-16T13:47:17.966707+0000","last_became_active":"2023-10-16T13:47:17.962210+0000","last_became_peered":"2023-10-16T13:47:17.962210+0000","last_unstale":"2023-10-16T13:47:17.966707+0000","last_undegraded":"2023-10-16T13:47:17.966707+0000","last_fullsized":"2023-10-16T13:47:17.966707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:17:28.018920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973086+0000","last_change":"2023-10-16T13:47:17.969486+0000","last_active":"2023-10-16T13:47:17.973086+0000","last_peered":"2023-10-16T13:47:17.973086+0000","last_clean":"2023-10-16T13:47:17.973086+0000","last_became_active":"2023-10-16T13:47:17.968967+0000","last_became_peered":"2023-10-16T13:47:17.968967+0000","last_unstale":"2023-10-16T13:47:17.973086+0000","last_undegraded":"2023-10-16T13:47:17.973086+0000","last_fullsized":"2023-10-16T13:47:17.973086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:41.068500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970000+0000","last_change":"2023-10-16T13:47:17.966447+0000","last_active":"2023-10-16T13:47:17.970000+0000","last_peered":"2023-10-16T13:47:17.970000+0000","last_clean":"2023-10-16T13:47:17.970000+0000","last_became_active":"2023-10-16T13:47:17.964550+0000","last_became_peered":"2023-10-16T13:47:17.964550+0000","last_unstale":"2023-10-16T13:47:17.970000+0000","last_undegraded":"2023-10-16T13:47:17.970000+0000","last_fullsized":"2023-10-16T13:47:17.970000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:10.419358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970574+0000","last_change":"2023-10-16T13:47:17.961799+0000","last_active":"2023-10-16T13:47:17.970574+0000","last_peered":"2023-10-16T13:47:17.970574+0000","last_clean":"2023-10-16T13:47:17.970574+0000","last_became_active":"2023-10-16T13:47:17.961467+0000","last_became_peered":"2023-10-16T13:47:17.961467+0000","last_unstale":"2023-10-16T13:47:17.970574+0000","last_undegraded":"2023-10-16T13:47:17.970574+0000","last_fullsized":"2023-10-16T13:47:17.970574+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:07.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970572+0000","last_change":"2023-10-16T13:47:17.961990+0000","last_active":"2023-10-16T13:47:17.970572+0000","last_peered":"2023-10-16T13:47:17.970572+0000","last_clean":"2023-10-16T13:47:17.970572+0000","last_became_active":"2023-10-16T13:47:17.961487+0000","last_became_peered":"2023-10-16T13:47:17.961487+0000","last_unstale":"2023-10-16T13:47:17.970572+0000","last_undegraded":"2023-10-16T13:47:17.970572+0000","last_fullsized":"2023-10-16T13:47:17.970572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:24.385395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973993+0000","last_change":"2023-10-16T13:47:17.968644+0000","last_active":"2023-10-16T13:47:17.973993+0000","last_peered":"2023-10-16T13:47:17.973993+0000","last_clean":"2023-10-16T13:47:17.973993+0000","last_became_active":"2023-10-16T13:47:17.968330+0000","last_became_peered":"2023-10-16T13:47:17.968330+0000","last_unstale":"2023-10-16T13:47:17.973993+0000","last_undegraded":"2023-10-16T13:47:17.973993+0000","last_fullsized":"2023-10-16T13:47:17.973993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:30:23.911005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.982386+0000","last_change":"2023-10-16T13:47:17.977342+0000","last_active":"2023-10-16T13:47:17.982386+0000","last_peered":"2023-10-16T13:47:17.982386+0000","last_clean":"2023-10-16T13:47:17.982386+0000","last_became_active":"2023-10-16T13:47:17.977003+0000","last_became_peered":"2023-10-16T13:47:17.977003+0000","last_unstale":"2023-10-16T13:47:17.982386+0000","last_undegraded":"2023-10-16T13:47:17.982386+0000","last_fullsized":"2023-10-16T13:47:17.982386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:24.385395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979606+0000","last_change":"2023-10-16T13:47:17.978776+0000","last_active":"2023-10-16T13:47:17.979606+0000","last_peered":"2023-10-16T13:47:17.979606+0000","last_clean":"2023-10-16T13:47:17.979606+0000","last_became_active":"2023-10-16T13:47:17.978216+0000","last_became_peered":"2023-10-16T13:47:17.978216+0000","last_unstale":"2023-10-16T13:47:17.979606+0000","last_undegraded":"2023-10-16T13:47:17.979606+0000","last_fullsized":"2023-10-16T13:47:17.979606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:24.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.978627+0000","last_change":"2023-10-16T13:47:17.976899+0000","last_active":"2023-10-16T13:47:17.978627+0000","last_peered":"2023-10-16T13:47:17.978627+0000","last_clean":"2023-10-16T13:47:17.978627+0000","last_became_active":"2023-10-16T13:47:17.976601+0000","last_became_peered":"2023-10-16T13:47:17.976601+0000","last_unstale":"2023-10-16T13:47:17.978627+0000","last_undegraded":"2023-10-16T13:47:17.978627+0000","last_fullsized":"2023-10-16T13:47:17.978627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:17:05.197646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979047+0000","last_change":"2023-10-16T13:47:17.976045+0000","last_active":"2023-10-16T13:47:17.979047+0000","last_peered":"2023-10-16T13:47:17.979047+0000","last_clean":"2023-10-16T13:47:17.979047+0000","last_became_active":"2023-10-16T13:47:17.975733+0000","last_became_peered":"2023-10-16T13:47:17.975733+0000","last_unstale":"2023-10-16T13:47:17.979047+0000","last_undegraded":"2023-10-16T13:47:17.979047+0000","last_fullsized":"2023-10-16T13:47:17.979047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:48:38.786197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972652+0000","last_change":"2023-10-16T13:47:17.971680+0000","last_active":"2023-10-16T13:47:17.972652+0000","last_peered":"2023-10-16T13:47:17.972652+0000","last_clean":"2023-10-16T13:47:17.972652+0000","last_became_active":"2023-10-16T13:47:17.971316+0000","last_became_peered":"2023-10-16T13:47:17.971316+0000","last_unstale":"2023-10-16T13:47:17.972652+0000","last_undegraded":"2023-10-16T13:47:17.972652+0000","last_fullsized":"2023-10-16T13:47:17.972652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:53:22.959884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973052+0000","last_change":"2023-10-16T13:47:17.967024+0000","last_active":"2023-10-16T13:47:17.973052+0000","last_peered":"2023-10-16T13:47:17.973052+0000","last_clean":"2023-10-16T13:47:17.973052+0000","last_became_active":"2023-10-16T13:47:17.966669+0000","last_became_peered":"2023-10-16T13:47:17.966669+0000","last_unstale":"2023-10-16T13:47:17.973052+0000","last_undegraded":"2023-10-16T13:47:17.973052+0000","last_fullsized":"2023-10-16T13:47:17.973052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:47:05.914749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972759+0000","last_change":"2023-10-16T13:47:17.967833+0000","last_active":"2023-10-16T13:47:17.972759+0000","last_peered":"2023-10-16T13:47:17.972759+0000","last_clean":"2023-10-16T13:47:17.972759+0000","last_became_active":"2023-10-16T13:47:17.967493+0000","last_became_peered":"2023-10-16T13:47:17.967493+0000","last_unstale":"2023-10-16T13:47:17.972759+0000","last_undegraded":"2023-10-16T13:47:17.972759+0000","last_fullsized":"2023-10-16T13:47:17.972759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:31.057059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.968777+0000","last_change":"2023-10-16T13:47:17.965196+0000","last_active":"2023-10-16T13:47:17.968777+0000","last_peered":"2023-10-16T13:47:17.968777+0000","last_clean":"2023-10-16T13:47:17.968777+0000","last_became_active":"2023-10-16T13:47:17.964855+0000","last_became_peered":"2023-10-16T13:47:17.964855+0000","last_unstale":"2023-10-16T13:47:17.968777+0000","last_undegraded":"2023-10-16T13:47:17.968777+0000","last_fullsized":"2023-10-16T13:47:17.968777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:47:31.363120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971758+0000","last_change":"2023-10-16T13:47:17.967606+0000","last_active":"2023-10-16T13:47:17.971758+0000","last_peered":"2023-10-16T13:47:17.971758+0000","last_clean":"2023-10-16T13:47:17.971758+0000","last_became_active":"2023-10-16T13:47:17.967321+0000","last_became_peered":"2023-10-16T13:47:17.967321+0000","last_unstale":"2023-10-16T13:47:17.971758+0000","last_undegraded":"2023-10-16T13:47:17.971758+0000","last_fullsized":"2023-10-16T13:47:17.971758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:30.278595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969791+0000","last_change":"2023-10-16T13:47:17.966731+0000","last_active":"2023-10-16T13:47:17.969791+0000","last_peered":"2023-10-16T13:47:17.969791+0000","last_clean":"2023-10-16T13:47:17.969791+0000","last_became_active":"2023-10-16T13:47:17.965891+0000","last_became_peered":"2023-10-16T13:47:17.965891+0000","last_unstale":"2023-10-16T13:47:17.969791+0000","last_undegraded":"2023-10-16T13:47:17.969791+0000","last_fullsized":"2023-10-16T13:47:17.969791+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:50.999422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972820+0000","last_change":"2023-10-16T13:47:17.968512+0000","last_active":"2023-10-16T13:47:17.972820+0000","last_peered":"2023-10-16T13:47:17.972820+0000","last_clean":"2023-10-16T13:47:17.972820+0000","last_became_active":"2023-10-16T13:47:17.968067+0000","last_became_peered":"2023-10-16T13:47:17.968067+0000","last_unstale":"2023-10-16T13:47:17.972820+0000","last_undegraded":"2023-10-16T13:47:17.972820+0000","last_fullsized":"2023-10-16T13:47:17.972820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:57.440679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979024+0000","last_change":"2023-10-16T13:47:17.973465+0000","last_active":"2023-10-16T13:47:17.979024+0000","last_peered":"2023-10-16T13:47:17.979024+0000","last_clean":"2023-10-16T13:47:17.979024+0000","last_became_active":"2023-10-16T13:47:17.972848+0000","last_became_peered":"2023-10-16T13:47:17.972848+0000","last_unstale":"2023-10-16T13:47:17.979024+0000","last_undegraded":"2023-10-16T13:47:17.979024+0000","last_fullsized":"2023-10-16T13:47:17.979024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:24.068803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979091+0000","last_change":"2023-10-16T13:47:17.978657+0000","last_active":"2023-10-16T13:47:17.979091+0000","last_peered":"2023-10-16T13:47:17.979091+0000","last_clean":"2023-10-16T13:47:17.979091+0000","last_became_active":"2023-10-16T13:47:17.978370+0000","last_became_peered":"2023-10-16T13:47:17.978370+0000","last_unstale":"2023-10-16T13:47:17.979091+0000","last_undegraded":"2023-10-16T13:47:17.979091+0000","last_fullsized":"2023-10-16T13:47:17.979091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969707+0000","last_change":"2023-10-16T13:47:17.968239+0000","last_active":"2023-10-16T13:47:17.969707+0000","last_peered":"2023-10-16T13:47:17.969707+0000","last_clean":"2023-10-16T13:47:17.969707+0000","last_became_active":"2023-10-16T13:47:17.967936+0000","last_became_peered":"2023-10-16T13:47:17.967936+0000","last_unstale":"2023-10-16T13:47:17.969707+0000","last_undegraded":"2023-10-16T13:47:17.969707+0000","last_fullsized":"2023-10-16T13:47:17.969707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:35:56.126210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971416+0000","last_change":"2023-10-16T13:47:17.964572+0000","last_active":"2023-10-16T13:47:17.971416+0000","last_peered":"2023-10-16T13:47:17.971416+0000","last_clean":"2023-10-16T13:47:17.971416+0000","last_became_active":"2023-10-16T13:47:17.963752+0000","last_became_peered":"2023-10-16T13:47:17.963752+0000","last_unstale":"2023-10-16T13:47:17.971416+0000","last_undegraded":"2023-10-16T13:47:17.971416+0000","last_fullsized":"2023-10-16T13:47:17.971416+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:50.734095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"75'4","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.983530+0000","last_change":"2023-10-16T13:47:16.937734+0000","last_active":"2023-10-16T13:47:17.983530+0000","last_peered":"2023-10-16T13:47:17.983530+0000","last_clean":"2023-10-16T13:47:17.983530+0000","last_became_active":"2023-10-16T13:47:16.935730+0000","last_became_peered":"2023-10-16T13:47:16.935730+0000","last_unstale":"2023-10-16T13:47:17.983530+0000","last_undegraded":"2023-10-16T13:47:17.983530+0000","last_fullsized":"2023-10-16T13:47:17.983530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:23.064117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.977486+0000","last_change":"2023-10-16T13:47:17.976728+0000","last_active":"2023-10-16T13:47:17.977486+0000","last_peered":"2023-10-16T13:47:17.977486+0000","last_clean":"2023-10-16T13:47:17.977486+0000","last_became_active":"2023-10-16T13:47:17.976414+0000","last_became_peered":"2023-10-16T13:47:17.976414+0000","last_unstale":"2023-10-16T13:47:17.977486+0000","last_undegraded":"2023-10-16T13:47:17.977486+0000","last_fullsized":"2023-10-16T13:47:17.977486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:11:13.537020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988860+0000","last_change":"2023-10-16T13:47:16.938871+0000","last_active":"2023-10-16T13:47:17.988860+0000","last_peered":"2023-10-16T13:47:17.988860+0000","last_clean":"2023-10-16T13:47:17.988860+0000","last_became_active":"2023-10-16T13:47:16.938573+0000","last_became_peered":"2023-10-16T13:47:16.938573+0000","last_unstale":"2023-10-16T13:47:17.988860+0000","last_undegraded":"2023-10-16T13:47:17.988860+0000","last_fullsized":"2023-10-16T13:47:17.988860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:55.197237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970306+0000","last_change":"2023-10-16T13:47:17.968917+0000","last_active":"2023-10-16T13:47:17.970306+0000","last_peered":"2023-10-16T13:47:17.970306+0000","last_clean":"2023-10-16T13:47:17.970306+0000","last_became_active":"2023-10-16T13:47:17.968296+0000","last_became_peered":"2023-10-16T13:47:17.968296+0000","last_unstale":"2023-10-16T13:47:17.970306+0000","last_undegraded":"2023-10-16T13:47:17.970306+0000","last_fullsized":"2023-10-16T13:47:17.970306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:20.859318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.987582+0000","last_change":"2023-10-16T13:47:16.945376+0000","last_active":"2023-10-16T13:47:17.987582+0000","last_peered":"2023-10-16T13:47:17.987582+0000","last_clean":"2023-10-16T13:47:17.987582+0000","last_became_active":"2023-10-16T13:47:16.945070+0000","last_became_peered":"2023-10-16T13:47:16.945070+0000","last_unstale":"2023-10-16T13:47:17.987582+0000","last_undegraded":"2023-10-16T13:47:17.987582+0000","last_fullsized":"2023-10-16T13:47:17.987582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:42.076304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.963019+0000","last_change":"2023-10-16T13:47:17.959997+0000","last_active":"2023-10-16T13:47:17.963019+0000","last_peered":"2023-10-16T13:47:17.963019+0000","last_clean":"2023-10-16T13:47:17.963019+0000","last_became_active":"2023-10-16T13:47:17.959523+0000","last_became_peered":"2023-10-16T13:47:17.959523+0000","last_unstale":"2023-10-16T13:47:17.963019+0000","last_undegraded":"2023-10-16T13:47:17.963019+0000","last_fullsized":"2023-10-16T13:47:17.963019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:11.781995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988163+0000","last_change":"2023-10-16T13:47:16.945221+0000","last_active":"2023-10-16T13:47:17.988163+0000","last_peered":"2023-10-16T13:47:17.988163+0000","last_clean":"2023-10-16T13:47:17.988163+0000","last_became_active":"2023-10-16T13:47:16.944915+0000","last_became_peered":"2023-10-16T13:47:16.944915+0000","last_unstale":"2023-10-16T13:47:17.988163+0000","last_undegraded":"2023-10-16T13:47:17.988163+0000","last_fullsized":"2023-10-16T13:47:17.988163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:07.690535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973086+0000","last_change":"2023-10-16T13:47:17.968866+0000","last_active":"2023-10-16T13:47:17.973086+0000","last_peered":"2023-10-16T13:47:17.973086+0000","last_clean":"2023-10-16T13:47:17.973086+0000","last_became_active":"2023-10-16T13:47:17.968538+0000","last_became_peered":"2023-10-16T13:47:17.968538+0000","last_unstale":"2023-10-16T13:47:17.973086+0000","last_undegraded":"2023-10-16T13:47:17.973086+0000","last_fullsized":"2023-10-16T13:47:17.973086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:17.753549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988581+0000","last_change":"2023-10-16T13:47:16.942885+0000","last_active":"2023-10-16T13:47:17.988581+0000","last_peered":"2023-10-16T13:47:17.988581+0000","last_clean":"2023-10-16T13:47:17.988581+0000","last_became_active":"2023-10-16T13:47:16.942575+0000","last_became_peered":"2023-10-16T13:47:16.942575+0000","last_unstale":"2023-10-16T13:47:17.988581+0000","last_undegraded":"2023-10-16T13:47:17.988581+0000","last_fullsized":"2023-10-16T13:47:17.988581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:09:15.032341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970550+0000","last_change":"2023-10-16T13:47:17.961785+0000","last_active":"2023-10-16T13:47:17.970550+0000","last_peered":"2023-10-16T13:47:17.970550+0000","last_clean":"2023-10-16T13:47:17.970550+0000","last_became_active":"2023-10-16T13:47:17.961338+0000","last_became_peered":"2023-10-16T13:47:17.961338+0000","last_unstale":"2023-10-16T13:47:17.970550+0000","last_undegraded":"2023-10-16T13:47:17.970550+0000","last_fullsized":"2023-10-16T13:47:17.970550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:01:11.530634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988854+0000","last_change":"2023-10-16T13:47:16.938798+0000","last_active":"2023-10-16T13:47:17.988854+0000","last_peered":"2023-10-16T13:47:17.988854+0000","last_clean":"2023-10-16T13:47:17.988854+0000","last_became_active":"2023-10-16T13:47:16.938463+0000","last_became_peered":"2023-10-16T13:47:16.938463+0000","last_unstale":"2023-10-16T13:47:17.988854+0000","last_undegraded":"2023-10-16T13:47:17.988854+0000","last_fullsized":"2023-10-16T13:47:17.988854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:01.873643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969477+0000","last_change":"2023-10-16T13:47:17.967237+0000","last_active":"2023-10-16T13:47:17.969477+0000","last_peered":"2023-10-16T13:47:17.969477+0000","last_clean":"2023-10-16T13:47:17.969477+0000","last_became_active":"2023-10-16T13:47:17.966944+0000","last_became_peered":"2023-10-16T13:47:17.966944+0000","last_unstale":"2023-10-16T13:47:17.969477+0000","last_undegraded":"2023-10-16T13:47:17.969477+0000","last_fullsized":"2023-10-16T13:47:17.969477+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:11:09.864865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.976519+0000","last_change":"2023-10-16T13:47:16.948385+0000","last_active":"2023-10-16T13:47:17.976519+0000","last_peered":"2023-10-16T13:47:17.976519+0000","last_clean":"2023-10-16T13:47:17.976519+0000","last_became_active":"2023-10-16T13:47:16.948067+0000","last_became_peered":"2023-10-16T13:47:16.948067+0000","last_unstale":"2023-10-16T13:47:17.976519+0000","last_undegraded":"2023-10-16T13:47:17.976519+0000","last_fullsized":"2023-10-16T13:47:17.976519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:09:15.032341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.966553+0000","last_change":"2023-10-16T13:47:17.964547+0000","last_active":"2023-10-16T13:47:17.966553+0000","last_peered":"2023-10-16T13:47:17.966553+0000","last_clean":"2023-10-16T13:47:17.966553+0000","last_became_active":"2023-10-16T13:47:17.964108+0000","last_became_peered":"2023-10-16T13:47:17.964108+0000","last_unstale":"2023-10-16T13:47:17.966553+0000","last_undegraded":"2023-10-16T13:47:17.966553+0000","last_fullsized":"2023-10-16T13:47:17.966553+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:23.326528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.959864+0000","last_change":"2023-10-16T13:47:16.942885+0000","last_active":"2023-10-16T13:47:17.959864+0000","last_peered":"2023-10-16T13:47:17.959864+0000","last_clean":"2023-10-16T13:47:17.959864+0000","last_became_active":"2023-10-16T13:47:16.942117+0000","last_became_peered":"2023-10-16T13:47:16.942117+0000","last_unstale":"2023-10-16T13:47:17.959864+0000","last_undegraded":"2023-10-16T13:47:17.959864+0000","last_fullsized":"2023-10-16T13:47:17.959864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:14.456350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.975755+0000","last_change":"2023-10-16T13:47:17.968868+0000","last_active":"2023-10-16T13:47:17.975755+0000","last_peered":"2023-10-16T13:47:17.975755+0000","last_clean":"2023-10-16T13:47:17.975755+0000","last_became_active":"2023-10-16T13:47:17.968532+0000","last_became_peered":"2023-10-16T13:47:17.968532+0000","last_unstale":"2023-10-16T13:47:17.975755+0000","last_undegraded":"2023-10-16T13:47:17.975755+0000","last_fullsized":"2023-10-16T13:47:17.975755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:19:35.254823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961312+0000","last_change":"2023-10-16T13:47:16.938037+0000","last_active":"2023-10-16T13:47:17.961312+0000","last_peered":"2023-10-16T13:47:17.961312+0000","last_clean":"2023-10-16T13:47:17.961312+0000","last_became_active":"2023-10-16T13:47:16.937626+0000","last_became_peered":"2023-10-16T13:47:16.937626+0000","last_unstale":"2023-10-16T13:47:17.961312+0000","last_undegraded":"2023-10-16T13:47:17.961312+0000","last_fullsized":"2023-10-16T13:47:17.961312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.452596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969625+0000","last_change":"2023-10-16T13:47:17.968519+0000","last_active":"2023-10-16T13:47:17.969625+0000","last_peered":"2023-10-16T13:47:17.969625+0000","last_clean":"2023-10-16T13:47:17.969625+0000","last_became_active":"2023-10-16T13:47:17.968247+0000","last_became_peered":"2023-10-16T13:47:17.968247+0000","last_unstale":"2023-10-16T13:47:17.969625+0000","last_undegraded":"2023-10-16T13:47:17.969625+0000","last_fullsized":"2023-10-16T13:47:17.969625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:02.878329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961033+0000","last_change":"2023-10-16T13:47:16.941898+0000","last_active":"2023-10-16T13:47:17.961033+0000","last_peered":"2023-10-16T13:47:17.961033+0000","last_clean":"2023-10-16T13:47:17.961033+0000","last_became_active":"2023-10-16T13:47:16.941551+0000","last_became_peered":"2023-10-16T13:47:16.941551+0000","last_unstale":"2023-10-16T13:47:17.961033+0000","last_undegraded":"2023-10-16T13:47:17.961033+0000","last_fullsized":"2023-10-16T13:47:17.961033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:16.748863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973451+0000","last_change":"2023-10-16T13:47:17.968870+0000","last_active":"2023-10-16T13:47:17.973451+0000","last_peered":"2023-10-16T13:47:17.973451+0000","last_clean":"2023-10-16T13:47:17.973451+0000","last_became_active":"2023-10-16T13:47:17.968561+0000","last_became_peered":"2023-10-16T13:47:17.968561+0000","last_unstale":"2023-10-16T13:47:17.973451+0000","last_undegraded":"2023-10-16T13:47:17.973451+0000","last_fullsized":"2023-10-16T13:47:17.973451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:15.461037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"75'3","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.983528+0000","last_change":"2023-10-16T13:47:16.944413+0000","last_active":"2023-10-16T13:47:17.983528+0000","last_peered":"2023-10-16T13:47:17.983528+0000","last_clean":"2023-10-16T13:47:17.983528+0000","last_became_active":"2023-10-16T13:47:16.943927+0000","last_became_peered":"2023-10-16T13:47:16.943927+0000","last_unstale":"2023-10-16T13:47:17.983528+0000","last_undegraded":"2023-10-16T13:47:17.983528+0000","last_fullsized":"2023-10-16T13:47:17.983528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:06.732034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.974090+0000","last_change":"2023-10-16T13:47:17.973527+0000","last_active":"2023-10-16T13:47:17.974090+0000","last_peered":"2023-10-16T13:47:17.974090+0000","last_clean":"2023-10-16T13:47:17.974090+0000","last_became_active":"2023-10-16T13:47:17.973164+0000","last_became_peered":"2023-10-16T13:47:17.973164+0000","last_unstale":"2023-10-16T13:47:17.974090+0000","last_undegraded":"2023-10-16T13:47:17.974090+0000","last_fullsized":"2023-10-16T13:47:17.974090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:47.017559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"75'6","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.990320+0000","last_change":"2023-10-16T13:47:16.939772+0000","last_active":"2023-10-16T13:47:17.990320+0000","last_peered":"2023-10-16T13:47:17.990320+0000","last_clean":"2023-10-16T13:47:17.990320+0000","last_became_active":"2023-10-16T13:47:16.939487+0000","last_became_peered":"2023-10-16T13:47:16.939487+0000","last_unstale":"2023-10-16T13:47:17.990320+0000","last_undegraded":"2023-10-16T13:47:17.990320+0000","last_fullsized":"2023-10-16T13:47:17.990320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:07.690535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.975220+0000","last_change":"2023-10-16T13:47:17.974327+0000","last_active":"2023-10-16T13:47:17.975220+0000","last_peered":"2023-10-16T13:47:17.975220+0000","last_clean":"2023-10-16T13:47:17.975220+0000","last_became_active":"2023-10-16T13:47:17.972919+0000","last_became_peered":"2023-10-16T13:47:17.972919+0000","last_unstale":"2023-10-16T13:47:17.975220+0000","last_undegraded":"2023-10-16T13:47:17.975220+0000","last_fullsized":"2023-10-16T13:47:17.975220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:07.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.990091+0000","last_change":"2023-10-16T13:47:16.944386+0000","last_active":"2023-10-16T13:47:17.990091+0000","last_peered":"2023-10-16T13:47:17.990091+0000","last_clean":"2023-10-16T13:47:17.990091+0000","last_became_active":"2023-10-16T13:47:16.944075+0000","last_became_peered":"2023-10-16T13:47:16.944075+0000","last_unstale":"2023-10-16T13:47:17.990091+0000","last_undegraded":"2023-10-16T13:47:17.990091+0000","last_fullsized":"2023-10-16T13:47:17.990091+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:01.873643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972093+0000","last_change":"2023-10-16T13:47:17.970636+0000","last_active":"2023-10-16T13:47:17.972093+0000","last_peered":"2023-10-16T13:47:17.972093+0000","last_clean":"2023-10-16T13:47:17.972093+0000","last_became_active":"2023-10-16T13:47:17.970416+0000","last_became_peered":"2023-10-16T13:47:17.970416+0000","last_unstale":"2023-10-16T13:47:17.972093+0000","last_undegraded":"2023-10-16T13:47:17.972093+0000","last_fullsized":"2023-10-16T13:47:17.972093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:06.102314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.959195+0000","last_change":"2023-10-16T13:47:16.945229+0000","last_active":"2023-10-16T13:47:17.959195+0000","last_peered":"2023-10-16T13:47:17.959195+0000","last_clean":"2023-10-16T13:47:17.959195+0000","last_became_active":"2023-10-16T13:47:16.944897+0000","last_became_peered":"2023-10-16T13:47:16.944897+0000","last_unstale":"2023-10-16T13:47:17.959195+0000","last_undegraded":"2023-10-16T13:47:17.959195+0000","last_fullsized":"2023-10-16T13:47:17.959195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:12.891980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972903+0000","last_change":"2023-10-16T13:47:17.969772+0000","last_active":"2023-10-16T13:47:17.972903+0000","last_peered":"2023-10-16T13:47:17.972903+0000","last_clean":"2023-10-16T13:47:17.972903+0000","last_became_active":"2023-10-16T13:47:17.969197+0000","last_became_peered":"2023-10-16T13:47:17.969197+0000","last_unstale":"2023-10-16T13:47:17.972903+0000","last_undegraded":"2023-10-16T13:47:17.972903+0000","last_fullsized":"2023-10-16T13:47:17.972903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.960200+0000","last_change":"2023-10-16T13:47:16.942375+0000","last_active":"2023-10-16T13:47:17.960200+0000","last_peered":"2023-10-16T13:47:17.960200+0000","last_clean":"2023-10-16T13:47:17.960200+0000","last_became_active":"2023-10-16T13:47:16.940867+0000","last_became_peered":"2023-10-16T13:47:16.940867+0000","last_unstale":"2023-10-16T13:47:17.960200+0000","last_undegraded":"2023-10-16T13:47:17.960200+0000","last_fullsized":"2023-10-16T13:47:17.960200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:01:10.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972624+0000","last_change":"2023-10-16T13:47:17.967635+0000","last_active":"2023-10-16T13:47:17.972624+0000","last_peered":"2023-10-16T13:47:17.972624+0000","last_clean":"2023-10-16T13:47:17.972624+0000","last_became_active":"2023-10-16T13:47:17.967244+0000","last_became_peered":"2023-10-16T13:47:17.967244+0000","last_unstale":"2023-10-16T13:47:17.972624+0000","last_undegraded":"2023-10-16T13:47:17.972624+0000","last_fullsized":"2023-10-16T13:47:17.972624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:01.811897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"75'8","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.989088+0000","last_change":"2023-10-16T13:47:16.948597+0000","last_active":"2023-10-16T13:47:17.989088+0000","last_peered":"2023-10-16T13:47:17.989088+0000","last_clean":"2023-10-16T13:47:17.989088+0000","last_became_active":"2023-10-16T13:47:16.948288+0000","last_became_peered":"2023-10-16T13:47:16.948288+0000","last_unstale":"2023-10-16T13:47:17.989088+0000","last_undegraded":"2023-10-16T13:47:17.989088+0000","last_fullsized":"2023-10-16T13:47:17.989088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:15.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967950+0000","last_change":"2023-10-16T13:47:17.963790+0000","last_active":"2023-10-16T13:47:17.967950+0000","last_peered":"2023-10-16T13:47:17.967950+0000","last_clean":"2023-10-16T13:47:17.967950+0000","last_became_active":"2023-10-16T13:47:17.963422+0000","last_became_peered":"2023-10-16T13:47:17.963422+0000","last_unstale":"2023-10-16T13:47:17.967950+0000","last_undegraded":"2023-10-16T13:47:17.967950+0000","last_fullsized":"2023-10-16T13:47:17.967950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:49.299263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.982652+0000","last_change":"2023-10-16T13:47:16.937914+0000","last_active":"2023-10-16T13:47:17.982652+0000","last_peered":"2023-10-16T13:47:17.982652+0000","last_clean":"2023-10-16T13:47:17.982652+0000","last_became_active":"2023-10-16T13:47:16.937268+0000","last_became_peered":"2023-10-16T13:47:16.937268+0000","last_unstale":"2023-10-16T13:47:17.982652+0000","last_undegraded":"2023-10-16T13:47:17.982652+0000","last_fullsized":"2023-10-16T13:47:17.982652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:48:37.781511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969186+0000","last_change":"2023-10-16T13:47:17.965593+0000","last_active":"2023-10-16T13:47:17.969186+0000","last_peered":"2023-10-16T13:47:17.969186+0000","last_clean":"2023-10-16T13:47:17.969186+0000","last_became_active":"2023-10-16T13:47:17.965017+0000","last_became_peered":"2023-10-16T13:47:17.965017+0000","last_unstale":"2023-10-16T13:47:17.969186+0000","last_undegraded":"2023-10-16T13:47:17.969186+0000","last_fullsized":"2023-10-16T13:47:17.969186+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:18.557099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.986396+0000","last_change":"2023-10-16T13:47:16.946393+0000","last_active":"2023-10-16T13:47:17.986396+0000","last_peered":"2023-10-16T13:47:17.986396+0000","last_clean":"2023-10-16T13:47:17.986396+0000","last_became_active":"2023-10-16T13:47:16.946049+0000","last_became_peered":"2023-10-16T13:47:16.946049+0000","last_unstale":"2023-10-16T13:47:17.986396+0000","last_undegraded":"2023-10-16T13:47:17.986396+0000","last_fullsized":"2023-10-16T13:47:17.986396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:49.729409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971675+0000","last_change":"2023-10-16T13:47:17.965815+0000","last_active":"2023-10-16T13:47:17.971675+0000","last_peered":"2023-10-16T13:47:17.971675+0000","last_clean":"2023-10-16T13:47:17.971675+0000","last_became_active":"2023-10-16T13:47:17.965560+0000","last_became_peered":"2023-10-16T13:47:17.965560+0000","last_unstale":"2023-10-16T13:47:17.971675+0000","last_undegraded":"2023-10-16T13:47:17.971675+0000","last_fullsized":"2023-10-16T13:47:17.971675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:08.188498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971825+0000","last_change":"2023-10-16T13:47:16.948394+0000","last_active":"2023-10-16T13:47:17.971825+0000","last_peered":"2023-10-16T13:47:17.971825+0000","last_clean":"2023-10-16T13:47:17.971825+0000","last_became_active":"2023-10-16T13:47:16.948076+0000","last_became_peered":"2023-10-16T13:47:16.948076+0000","last_unstale":"2023-10-16T13:47:17.971825+0000","last_undegraded":"2023-10-16T13:47:17.971825+0000","last_fullsized":"2023-10-16T13:47:17.971825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:10:36.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973106+0000","last_change":"2023-10-16T13:47:17.969989+0000","last_active":"2023-10-16T13:47:17.973106+0000","last_peered":"2023-10-16T13:47:17.973106+0000","last_clean":"2023-10-16T13:47:17.973106+0000","last_became_active":"2023-10-16T13:47:17.968546+0000","last_became_peered":"2023-10-16T13:47:17.968546+0000","last_unstale":"2023-10-16T13:47:17.973106+0000","last_undegraded":"2023-10-16T13:47:17.973106+0000","last_fullsized":"2023-10-16T13:47:17.973106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:48.626462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988787+0000","last_change":"2023-10-16T13:47:16.940868+0000","last_active":"2023-10-16T13:47:17.988787+0000","last_peered":"2023-10-16T13:47:17.988787+0000","last_clean":"2023-10-16T13:47:17.988787+0000","last_became_active":"2023-10-16T13:47:16.940542+0000","last_became_peered":"2023-10-16T13:47:16.940542+0000","last_unstale":"2023-10-16T13:47:17.988787+0000","last_undegraded":"2023-10-16T13:47:17.988787+0000","last_fullsized":"2023-10-16T13:47:17.988787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:08.875202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969116+0000","last_change":"2023-10-16T13:47:17.966807+0000","last_active":"2023-10-16T13:47:17.969116+0000","last_peered":"2023-10-16T13:47:17.969116+0000","last_clean":"2023-10-16T13:47:17.969116+0000","last_became_active":"2023-10-16T13:47:17.966539+0000","last_became_peered":"2023-10-16T13:47:17.966539+0000","last_unstale":"2023-10-16T13:47:17.969116+0000","last_undegraded":"2023-10-16T13:47:17.969116+0000","last_fullsized":"2023-10-16T13:47:17.969116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:24.385395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.960661+0000","last_change":"2023-10-16T13:47:16.944886+0000","last_active":"2023-10-16T13:47:17.960661+0000","last_peered":"2023-10-16T13:47:17.960661+0000","last_clean":"2023-10-16T13:47:17.960661+0000","last_became_active":"2023-10-16T13:47:16.944610+0000","last_became_peered":"2023-10-16T13:47:16.944610+0000","last_unstale":"2023-10-16T13:47:17.960661+0000","last_undegraded":"2023-10-16T13:47:17.960661+0000","last_fullsized":"2023-10-16T13:47:17.960661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:47.739333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973030+0000","last_change":"2023-10-16T13:47:17.965249+0000","last_active":"2023-10-16T13:47:17.973030+0000","last_peered":"2023-10-16T13:47:17.973030+0000","last_clean":"2023-10-16T13:47:17.973030+0000","last_became_active":"2023-10-16T13:47:17.964925+0000","last_became_peered":"2023-10-16T13:47:17.964925+0000","last_unstale":"2023-10-16T13:47:17.973030+0000","last_undegraded":"2023-10-16T13:47:17.973030+0000","last_fullsized":"2023-10-16T13:47:17.973030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:26.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.955643+0000","last_change":"2023-10-16T13:47:16.944360+0000","last_active":"2023-10-16T13:47:17.955643+0000","last_peered":"2023-10-16T13:47:17.955643+0000","last_clean":"2023-10-16T13:47:17.955643+0000","last_became_active":"2023-10-16T13:47:16.944006+0000","last_became_peered":"2023-10-16T13:47:16.944006+0000","last_unstale":"2023-10-16T13:47:17.955643+0000","last_undegraded":"2023-10-16T13:47:17.955643+0000","last_fullsized":"2023-10-16T13:47:17.955643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:06:28.746592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.978330+0000","last_change":"2023-10-16T13:47:17.977684+0000","last_active":"2023-10-16T13:47:17.978330+0000","last_peered":"2023-10-16T13:47:17.978330+0000","last_clean":"2023-10-16T13:47:17.978330+0000","last_became_active":"2023-10-16T13:47:17.977417+0000","last_became_peered":"2023-10-16T13:47:17.977417+0000","last_unstale":"2023-10-16T13:47:17.978330+0000","last_undegraded":"2023-10-16T13:47:17.978330+0000","last_fullsized":"2023-10-16T13:47:17.978330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:16.383299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.958661+0000","last_change":"2023-10-16T13:47:16.941232+0000","last_active":"2023-10-16T13:47:17.958661+0000","last_peered":"2023-10-16T13:47:17.958661+0000","last_clean":"2023-10-16T13:47:17.958661+0000","last_became_active":"2023-10-16T13:47:16.940360+0000","last_became_peered":"2023-10-16T13:47:16.940360+0000","last_unstale":"2023-10-16T13:47:17.958661+0000","last_undegraded":"2023-10-16T13:47:17.958661+0000","last_fullsized":"2023-10-16T13:47:17.958661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:41.712783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971437+0000","last_change":"2023-10-16T13:47:17.964627+0000","last_active":"2023-10-16T13:47:17.971437+0000","last_peered":"2023-10-16T13:47:17.971437+0000","last_clean":"2023-10-16T13:47:17.971437+0000","last_became_active":"2023-10-16T13:47:17.964359+0000","last_became_peered":"2023-10-16T13:47:17.964359+0000","last_unstale":"2023-10-16T13:47:17.971437+0000","last_undegraded":"2023-10-16T13:47:17.971437+0000","last_fullsized":"2023-10-16T13:47:17.971437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:08.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.989239+0000","last_change":"2023-10-16T13:47:16.943342+0000","last_active":"2023-10-16T13:47:17.989239+0000","last_peered":"2023-10-16T13:47:17.989239+0000","last_clean":"2023-10-16T13:47:17.989239+0000","last_became_active":"2023-10-16T13:47:16.943048+0000","last_became_peered":"2023-10-16T13:47:16.943048+0000","last_unstale":"2023-10-16T13:47:17.989239+0000","last_undegraded":"2023-10-16T13:47:17.989239+0000","last_fullsized":"2023-10-16T13:47:17.989239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:56.142160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.968577+0000","last_change":"2023-10-16T13:47:17.964103+0000","last_active":"2023-10-16T13:47:17.968577+0000","last_peered":"2023-10-16T13:47:17.968577+0000","last_clean":"2023-10-16T13:47:17.968577+0000","last_became_active":"2023-10-16T13:47:17.963465+0000","last_became_peered":"2023-10-16T13:47:17.963465+0000","last_unstale":"2023-10-16T13:47:17.968577+0000","last_undegraded":"2023-10-16T13:47:17.968577+0000","last_fullsized":"2023-10-16T13:47:17.968577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:46:09.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.955963+0000","last_change":"2023-10-16T13:47:16.944577+0000","last_active":"2023-10-16T13:47:17.955963+0000","last_peered":"2023-10-16T13:47:17.955963+0000","last_clean":"2023-10-16T13:47:17.955963+0000","last_became_active":"2023-10-16T13:47:16.944291+0000","last_became_peered":"2023-10-16T13:47:16.944291+0000","last_unstale":"2023-10-16T13:47:17.955963+0000","last_undegraded":"2023-10-16T13:47:17.955963+0000","last_fullsized":"2023-10-16T13:47:17.955963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.452596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971178+0000","last_change":"2023-10-16T13:47:17.969895+0000","last_active":"2023-10-16T13:47:17.971178+0000","last_peered":"2023-10-16T13:47:17.971178+0000","last_clean":"2023-10-16T13:47:17.971178+0000","last_became_active":"2023-10-16T13:47:17.969609+0000","last_became_peered":"2023-10-16T13:47:17.969609+0000","last_unstale":"2023-10-16T13:47:17.971178+0000","last_undegraded":"2023-10-16T13:47:17.971178+0000","last_fullsized":"2023-10-16T13:47:17.971178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:03:09.074200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961092+0000","last_change":"2023-10-16T13:47:16.937745+0000","last_active":"2023-10-16T13:47:17.961092+0000","last_peered":"2023-10-16T13:47:17.961092+0000","last_clean":"2023-10-16T13:47:17.961092+0000","last_became_active":"2023-10-16T13:47:16.937438+0000","last_became_peered":"2023-10-16T13:47:16.937438+0000","last_unstale":"2023-10-16T13:47:17.961092+0000","last_undegraded":"2023-10-16T13:47:17.961092+0000","last_fullsized":"2023-10-16T13:47:17.961092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:00:13.635740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.980608+0000","last_change":"2023-10-16T13:47:17.979425+0000","last_active":"2023-10-16T13:47:17.980608+0000","last_peered":"2023-10-16T13:47:17.980608+0000","last_clean":"2023-10-16T13:47:17.980608+0000","last_became_active":"2023-10-16T13:47:17.979068+0000","last_became_peered":"2023-10-16T13:47:17.979068+0000","last_unstale":"2023-10-16T13:47:17.980608+0000","last_undegraded":"2023-10-16T13:47:17.980608+0000","last_fullsized":"2023-10-16T13:47:17.980608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:43.080990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.960899+0000","last_change":"2023-10-16T13:47:16.937951+0000","last_active":"2023-10-16T13:47:17.960899+0000","last_peered":"2023-10-16T13:47:17.960899+0000","last_clean":"2023-10-16T13:47:17.960899+0000","last_became_active":"2023-10-16T13:47:16.937290+0000","last_became_peered":"2023-10-16T13:47:16.937290+0000","last_unstale":"2023-10-16T13:47:17.960899+0000","last_undegraded":"2023-10-16T13:47:17.960899+0000","last_fullsized":"2023-10-16T13:47:17.960899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:34.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967989+0000","last_change":"2023-10-16T13:47:17.964750+0000","last_active":"2023-10-16T13:47:17.967989+0000","last_peered":"2023-10-16T13:47:17.967989+0000","last_clean":"2023-10-16T13:47:17.967989+0000","last_became_active":"2023-10-16T13:47:17.964457+0000","last_became_peered":"2023-10-16T13:47:17.964457+0000","last_unstale":"2023-10-16T13:47:17.967989+0000","last_undegraded":"2023-10-16T13:47:17.967989+0000","last_fullsized":"2023-10-16T13:47:17.967989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:15.461037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971550+0000","last_change":"2023-10-16T13:47:16.948450+0000","last_active":"2023-10-16T13:47:17.971550+0000","last_peered":"2023-10-16T13:47:17.971550+0000","last_clean":"2023-10-16T13:47:17.971550+0000","last_became_active":"2023-10-16T13:47:16.948156+0000","last_became_peered":"2023-10-16T13:47:16.948156+0000","last_unstale":"2023-10-16T13:47:17.971550+0000","last_undegraded":"2023-10-16T13:47:17.971550+0000","last_fullsized":"2023-10-16T13:47:17.971550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:01:10.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.974233+0000","last_change":"2023-10-16T13:47:17.973318+0000","last_active":"2023-10-16T13:47:17.974233+0000","last_peered":"2023-10-16T13:47:17.974233+0000","last_clean":"2023-10-16T13:47:17.974233+0000","last_became_active":"2023-10-16T13:47:17.973035+0000","last_became_peered":"2023-10-16T13:47:17.973035+0000","last_unstale":"2023-10-16T13:47:17.974233+0000","last_undegraded":"2023-10-16T13:47:17.974233+0000","last_fullsized":"2023-10-16T13:47:17.974233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.952795+0000","last_change":"2023-10-16T13:47:16.940775+0000","last_active":"2023-10-16T13:47:17.952795+0000","last_peered":"2023-10-16T13:47:17.952795+0000","last_clean":"2023-10-16T13:47:17.952795+0000","last_became_active":"2023-10-16T13:47:16.940501+0000","last_became_peered":"2023-10-16T13:47:16.940501+0000","last_unstale":"2023-10-16T13:47:17.952795+0000","last_undegraded":"2023-10-16T13:47:17.952795+0000","last_fullsized":"2023-10-16T13:47:17.952795+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:14.456350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967126+0000","last_change":"2023-10-16T13:47:17.962247+0000","last_active":"2023-10-16T13:47:17.967126+0000","last_peered":"2023-10-16T13:47:17.967126+0000","last_clean":"2023-10-16T13:47:17.967126+0000","last_became_active":"2023-10-16T13:47:17.961861+0000","last_became_peered":"2023-10-16T13:47:17.961861+0000","last_unstale":"2023-10-16T13:47:17.967126+0000","last_undegraded":"2023-10-16T13:47:17.967126+0000","last_fullsized":"2023-10-16T13:47:17.967126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:13:38.636827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961098+0000","last_change":"2023-10-16T13:47:16.940773+0000","last_active":"2023-10-16T13:47:17.961098+0000","last_peered":"2023-10-16T13:47:17.961098+0000","last_clean":"2023-10-16T13:47:17.961098+0000","last_became_active":"2023-10-16T13:47:16.940503+0000","last_became_peered":"2023-10-16T13:47:16.940503+0000","last_unstale":"2023-10-16T13:47:17.961098+0000","last_undegraded":"2023-10-16T13:47:17.961098+0000","last_fullsized":"2023-10-16T13:47:17.961098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:00.807211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972149+0000","last_change":"2023-10-16T13:47:17.970198+0000","last_active":"2023-10-16T13:47:17.972149+0000","last_peered":"2023-10-16T13:47:17.972149+0000","last_clean":"2023-10-16T13:47:17.972149+0000","last_became_active":"2023-10-16T13:47:17.969887+0000","last_became_peered":"2023-10-16T13:47:17.969887+0000","last_unstale":"2023-10-16T13:47:17.972149+0000","last_undegraded":"2023-10-16T13:47:17.972149+0000","last_fullsized":"2023-10-16T13:47:17.972149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:42:24.264575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.954041+0000","last_change":"2023-10-16T13:47:16.943622+0000","last_active":"2023-10-16T13:47:17.954041+0000","last_peered":"2023-10-16T13:47:17.954041+0000","last_clean":"2023-10-16T13:47:17.954041+0000","last_became_active":"2023-10-16T13:47:16.943284+0000","last_became_peered":"2023-10-16T13:47:16.943284+0000","last_unstale":"2023-10-16T13:47:17.954041+0000","last_undegraded":"2023-10-16T13:47:17.954041+0000","last_fullsized":"2023-10-16T13:47:17.954041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:15.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971825+0000","last_change":"2023-10-16T13:47:17.966402+0000","last_active":"2023-10-16T13:47:17.971825+0000","last_peered":"2023-10-16T13:47:17.971825+0000","last_clean":"2023-10-16T13:47:17.971825+0000","last_became_active":"2023-10-16T13:47:17.965571+0000","last_became_peered":"2023-10-16T13:47:17.965571+0000","last_unstale":"2023-10-16T13:47:17.971825+0000","last_undegraded":"2023-10-16T13:47:17.971825+0000","last_fullsized":"2023-10-16T13:47:17.971825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:07.736721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.989291+0000","last_change":"2023-10-16T13:47:16.946306+0000","last_active":"2023-10-16T13:47:17.989291+0000","last_peered":"2023-10-16T13:47:17.989291+0000","last_clean":"2023-10-16T13:47:17.989291+0000","last_became_active":"2023-10-16T13:47:16.946044+0000","last_became_peered":"2023-10-16T13:47:16.946044+0000","last_unstale":"2023-10-16T13:47:17.989291+0000","last_undegraded":"2023-10-16T13:47:17.989291+0000","last_fullsized":"2023-10-16T13:47:17.989291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:23:34.160267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-16T13:47:16.939077+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:47:16.939077+0000","last_peered":"2023-10-16T13:47:16.939077+0000","last_clean":"2023-10-16T13:47:16.939077+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:47:16.939077+0000","last_undegraded":"2023-10-16T13:47:16.939077+0000","last_fullsized":"2023-10-16T13:47:16.939077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":988095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.308},"max":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":0.82699999999999996},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.83099999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.76500000000000001,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.49199999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":0.83899999999999997},"last":0.433},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.57199999999999995},"min":{"1min":0.317,"5min":0.309,"15min":0.309},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.59199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71399999999999997,"5min":0.76600000000000001,"15min":0.86399999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":0.82299999999999995,"15min":0.90600000000000003},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59399999999999997,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39500000000000002},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":0.98299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.61399999999999999},"min":{"1min":0.371,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73299999999999998,"5min":0.80600000000000005,"15min":0.82899999999999996},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":390882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.23100000000000001},"max":{"1min":0.66100000000000003,"5min":0.73699999999999999,"15min":1.0089999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.86099999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.61599999999999999},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":2.8100000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.45400000000000001,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78200000000000003,"5min":1.157,"15min":1.157},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.75,"5min":0.75,"15min":10.964},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.76800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.57199999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.98999999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.754},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.879,"15min":0.879},"last":0.42999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":1.036},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":390882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.311,"15min":0.33300000000000002},"min":{"1min":0.221,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.24399999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.52500000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.223,"5min":0.189,"15min":0.189},"max":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":1.1619999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.752},"last":0.435}]},{"osd":3,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.41299999999999998},"min":{"1min":0.28399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.88},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.40699999999999997},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":1.4390000000000001},"last":0.496}]},{"osd":4,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.86299999999999999,"15min":1.905},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":1.879},"last":0.78000000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":0.89000000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.8340000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.90400000000000003,"15min":1.925},"last":0.63}]},{"osd":7,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.749,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.64000000000000001},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80100000000000005,"5min":0.873,"15min":1.085},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":987040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.31900000000000001,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.41999999999999998,"5min":0.54600000000000004,"15min":3.8260000000000001},"last":0.374},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.373},"min":{"1min":0.221,"5min":0.221,"15min":0.214},"max":{"1min":0.49099999999999999,"5min":0.58299999999999996,"15min":4.0499999999999998},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34599999999999997,"15min":0.38900000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":3.9169999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.37,"15min":0.39900000000000002},"min":{"1min":0.29699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.495,"5min":0.624,"15min":3.8849999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.376},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":3.9359999999999999},"last":0.435},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.51700000000000002,"5min":0.65300000000000002,"15min":3.9940000000000002},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.83199999999999996,"15min":4.0650000000000004},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58599999999999997,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.376,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":4.0369999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.58399999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.87,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.84599999999999997,"15min":4.2359999999999998},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.80900000000000005,"5min":0.84199999999999997,"15min":4.2119999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.86199999999999999,"15min":4.2649999999999997},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.33700000000000002},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.99199999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34000000000000002,"15min":0.36399999999999999},"min":{"1min":0.23999999999999999,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":0.55700000000000005,"15min":0.78700000000000003},"last":0.30599999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32900000000000001,"15min":0.33200000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45100000000000001,"5min":0.60599999999999998,"15min":0.67800000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51800000000000002,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38700000000000001,"15min":0.40699999999999997},"min":{"1min":0.32000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.64300000000000002,"15min":0.88500000000000001},"last":0.5},{"interface":"front","average":{"1min":0.371,"5min":0.38200000000000001,"15min":0.41399999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":1.153},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.054},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.379,"15min":1.379},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.436,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.395,"15min":1.395},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.96599999999999997,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81499999999999995,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.875}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":390882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.317,"15min":0.48799999999999999},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":5.8890000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.35599999999999998,"15min":0.41199999999999998},"min":{"1min":0.248,"5min":0.222,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":2.181},"last":0.33900000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.51600000000000001,"5min":0.55100000000000005,"15min":0.89100000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.377,"15min":0.443},"min":{"1min":0.27700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58099999999999996,"5min":0.625,"15min":2.3519999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.27300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.94199999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.46500000000000002},"min":{"1min":0.28000000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.61199999999999999,"5min":0.65800000000000003,"15min":2.4820000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.59599999999999997},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59999999999999998,"15min":0.77600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83099999999999996,"5min":0.97099999999999997,"15min":5.7560000000000002},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.76300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83399999999999996,"5min":0.95399999999999996,"15min":5.8559999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.80300000000000005,"5min":0.96199999999999997,"15min":2.2999999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.68899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84599999999999997,"5min":0.90800000000000003,"15min":2.4039999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61299999999999999,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":2.2799999999999998},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.79800000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90700000000000003,"15min":5.8179999999999996},"last":0.623},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.432,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":2.4430000000000001},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":397657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.52000000000000002},"min":{"1min":0.314,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73599999999999999,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67500000000000004,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.76100000000000001,"5min":0.77900000000000003,"15min":0.89900000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70999999999999996,"5min":0.76800000000000002,"15min":0.85099999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77800000000000002,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":0.88},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.502},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.81200000000000006},"last":0.71299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.78000000000000003,"5min":0.78100000000000003,"15min":0.94199999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":1.0209999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":399291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.51200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76100000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.745,"15min":0.745},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.622},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.34999999999999998},"max":{"1min":0.71899999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.435}]},{"osd":3,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.32600000000000001},"max":{"1min":0.77200000000000002,"5min":0.81399999999999995,"15min":0.84399999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":0.67900000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.746,"5min":0.82299999999999995,"15min":1.141},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":0.84899999999999998,"15min":1.3700000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70199999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.879},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.81899999999999995,"15min":0.90700000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":0.87,"15min":0.87},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:47:22.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:47:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.289+0000 7f438f462700 1 Processor -- start 2023-10-16T13:47:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.289+0000 7f438f462700 1 -- start start 2023-10-16T13:47:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438f462700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438815e2f0 0x7f43880cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438f462700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f438806a840 0x7f438806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438f462700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880b2d60 con 0x7f43880cd950 2023-10-16T13:47:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438f462700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43881619a0 con 0x7f438806a840 2023-10-16T13:47:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438f462700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438806b1f0 con 0x7f438815e2f0 2023-10-16T13:47:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438d9ff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f438806a840 0x7f438806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438c9fd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438815e2f0 0x7f43880cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438d1fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f43880cd950 0x7f438815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47848/0 (socket says 172.21.15.5:47848) 2023-10-16T13:47:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.290+0000 7f438d1fe700 1 -- 172.21.15.5:0/2546261159 learned_addr learned my addr 172.21.15.5:0/2546261159 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f437bfff700 1 -- 172.21.15.5:0/2546261159 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824724371 0 0) 0x7f43880b2d60 con 0x7f43880cd950 2023-10-16T13:47:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f437bfff700 1 -- 172.21.15.5:0/2546261159 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43740035b0 con 0x7f43880cd950 2023-10-16T13:47:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f438c9fd700 1 -- 172.21.15.5:0/2546261159 >> v2:172.21.15.112:3300/0 conn(0x7f438806a840 msgr2=0x7f438806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f438c9fd700 1 --2- 172.21.15.5:0/2546261159 >> v2:172.21.15.112:3300/0 conn(0x7f438806a840 0x7f438806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f438c9fd700 1 -- 172.21.15.5:0/2546261159 >> v1:172.21.15.112:6789/0 conn(0x7f43880cd950 legacy=0x7f438815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f438c9fd700 1 -- 172.21.15.5:0/2546261159 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43880cdd30 con 0x7f438815e2f0 2023-10-16T13:47:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f438d9ff700 1 --2- 172.21.15.5:0/2546261159 >> v2:172.21.15.112:3300/0 conn(0x7f438806a840 0x7f438806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f438c9fd700 1 --2- 172.21.15.5:0/2546261159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438815e2f0 0x7f43880cede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f437c009820 tx=0x7f437c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4858c99a58d56552 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f437bfff700 1 -- 172.21.15.5:0/2546261159 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c005e30 con 0x7f438815e2f0 2023-10-16T13:47:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f437bfff700 1 -- 172.21.15.5:0/2546261159 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c006030 con 0x7f438815e2f0 2023-10-16T13:47:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.291+0000 7f437bfff700 1 -- 172.21.15.5:0/2546261159 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c0063a0 con 0x7f438815e2f0 2023-10-16T13:47:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 -- 172.21.15.5:0/2546261159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438815e2f0 msgr2=0x7f43880cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 --2- 172.21.15.5:0/2546261159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438815e2f0 0x7f43880cede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f437c009820 tx=0x7f437c009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 -- 172.21.15.5:0/2546261159 shutdown_connections 2023-10-16T13:47:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 --2- 172.21.15.5:0/2546261159 >> v2:172.21.15.112:3300/0 conn(0x7f438806a840 0x7f438806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 --2- 172.21.15.5:0/2546261159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438815e2f0 0x7f43880cede0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 -- 172.21.15.5:0/2546261159 >> 172.21.15.5:0/2546261159 conn(0x7f438806dae0 msgr2=0x7f438806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 -- 172.21.15.5:0/2546261159 shutdown_connections 2023-10-16T13:47:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.292+0000 7f438f462700 1 -- 172.21.15.5:0/2546261159 wait complete. 2023-10-16T13:47:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.293+0000 7f438f462700 1 Processor -- start 2023-10-16T13:47:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.293+0000 7f438f462700 1 -- start start 2023-10-16T13:47:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438f462700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438806a840 0x7f43880c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438f462700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43880cd950 0x7f4388158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438f462700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 0x7f43881530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438f462700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43880ca3d0 con 0x7f438815e2f0 2023-10-16T13:47:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438f462700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43880c9e10 con 0x7f43880cd950 2023-10-16T13:47:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438f462700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880ca0f0 con 0x7f438806a840 2023-10-16T13:47:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 0x7f43881530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 0x7f43881530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46878/0 (socket says 172.21.15.5:46878) 2023-10-16T13:47:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 -- 172.21.15.5:0/273235493 learned_addr learned my addr 172.21.15.5:0/273235493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d1fe700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438806a840 0x7f43880c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438c9fd700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43880cd950 0x7f4388158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 -- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438806a840 msgr2=0x7f43880c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438806a840 0x7f43880c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 -- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43880cd950 msgr2=0x7f4388158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43880cd950 0x7f4388158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.294+0000 7f438d9ff700 1 -- 172.21.15.5:0/273235493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380009a70 con 0x7f438815e2f0 2023-10-16T13:47:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.295+0000 7f438d9ff700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 0x7f43881530b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f438000efc0 tx=0x7f438000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.295+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000ca90 con 0x7f438815e2f0 2023-10-16T13:47:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.295+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000f040 con 0x7f438815e2f0 2023-10-16T13:47:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.295+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c009430 con 0x7f438815e2f0 2023-10-16T13:47:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.295+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000ce10 con 0x7f438815e2f0 2023-10-16T13:47:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.295+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4388157340 con 0x7f438815e2f0 2023-10-16T13:47:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.296+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4388067d20 con 0x7f438815e2f0 2023-10-16T13:47:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.296+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f4380014480 con 0x7f438815e2f0 2023-10-16T13:47:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.297+0000 7f4379ffb700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f436c06b190 0x7f436c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.297+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f438008a1e0 con 0x7f438815e2f0 2023-10-16T13:47:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.297+0000 7f438d1fe700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f436c06b190 0x7f436c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.298+0000 7f438d1fe700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f436c06b190 0x7f436c06d650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4384007fd0 tx=0x7f4384009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.302+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4380054e10 con 0x7f438815e2f0 2023-10-16T13:47:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.498+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f438815ec00 con 0x7f436c06b190 2023-10-16T13:47:22.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.507+0000 7f4379ffb700 1 -- 172.21.15.5:0/273235493 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289475 (secure 0 0 0) 0x7f438400f690 con 0x7f436c06b190 2023-10-16T13:47:22.514 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f436c06b190 msgr2=0x7f436c06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f436c06b190 0x7f436c06d650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4384007fd0 tx=0x7f4384009040 comp rx=0 tx=0).stop 2023-10-16T13:47:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 msgr2=0x7f43881530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 0x7f43881530b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f438000efc0 tx=0x7f438000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 shutdown_connections 2023-10-16T13:47:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438815e2f0 0x7f43881530b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f436c06b190 0x7f436c06d650 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f438806a840 0x7f43880c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 --2- 172.21.15.5:0/273235493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43880cd950 0x7f4388158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 >> 172.21.15.5:0/273235493 conn(0x7f438806dae0 msgr2=0x7f438815d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 shutdown_connections 2023-10-16T13:47:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.510+0000 7f438f462700 1 -- 172.21.15.5:0/273235493 wait complete. 2023-10-16T13:47:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:47:22.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2023-10-16T13:47:21.595011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257812,"kb_used_data":8344,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716908,"statfs":{"total":773094113280,"available":772830113792,"internally_reserved":0,"allocated":8544256,"data_stored":4341949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669032"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970093+0000","last_change":"2023-10-16T13:47:17.967594+0000","last_active":"2023-10-16T13:47:17.970093+0000","last_peered":"2023-10-16T13:47:17.970093+0000","last_clean":"2023-10-16T13:47:17.970093+0000","last_became_active":"2023-10-16T13:47:17.965823+0000","last_became_peered":"2023-10-16T13:47:17.965823+0000","last_unstale":"2023-10-16T13:47:17.970093+0000","last_undegraded":"2023-10-16T13:47:17.970093+0000","last_fullsized":"2023-10-16T13:47:17.970093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:39:16.964786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972870+0000","last_change":"2023-10-16T13:47:17.970011+0000","last_active":"2023-10-16T13:47:17.972870+0000","last_peered":"2023-10-16T13:47:17.972870+0000","last_clean":"2023-10-16T13:47:17.972870+0000","last_became_active":"2023-10-16T13:47:17.967674+0000","last_became_peered":"2023-10-16T13:47:17.967674+0000","last_unstale":"2023-10-16T13:47:17.972870+0000","last_undegraded":"2023-10-16T13:47:17.972870+0000","last_fullsized":"2023-10-16T13:47:17.972870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:00:14.640426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967987+0000","last_change":"2023-10-16T13:47:17.963733+0000","last_active":"2023-10-16T13:47:17.967987+0000","last_peered":"2023-10-16T13:47:17.967987+0000","last_clean":"2023-10-16T13:47:17.967987+0000","last_became_active":"2023-10-16T13:47:17.963447+0000","last_became_peered":"2023-10-16T13:47:17.963447+0000","last_unstale":"2023-10-16T13:47:17.967987+0000","last_undegraded":"2023-10-16T13:47:17.967987+0000","last_fullsized":"2023-10-16T13:47:17.967987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:09:05.271494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.974153+0000","last_change":"2023-10-16T13:47:17.969302+0000","last_active":"2023-10-16T13:47:17.974153+0000","last_peered":"2023-10-16T13:47:17.974153+0000","last_clean":"2023-10-16T13:47:17.974153+0000","last_became_active":"2023-10-16T13:47:17.968997+0000","last_became_peered":"2023-10-16T13:47:17.968997+0000","last_unstale":"2023-10-16T13:47:17.974153+0000","last_undegraded":"2023-10-16T13:47:17.974153+0000","last_fullsized":"2023-10-16T13:47:17.974153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:47:35.577251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971698+0000","last_change":"2023-10-16T13:47:17.965691+0000","last_active":"2023-10-16T13:47:17.971698+0000","last_peered":"2023-10-16T13:47:17.971698+0000","last_clean":"2023-10-16T13:47:17.971698+0000","last_became_active":"2023-10-16T13:47:17.965408+0000","last_became_peered":"2023-10-16T13:47:17.965408+0000","last_unstale":"2023-10-16T13:47:17.971698+0000","last_undegraded":"2023-10-16T13:47:17.971698+0000","last_fullsized":"2023-10-16T13:47:17.971698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:10:37.043855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969675+0000","last_change":"2023-10-16T13:47:17.968671+0000","last_active":"2023-10-16T13:47:17.969675+0000","last_peered":"2023-10-16T13:47:17.969675+0000","last_clean":"2023-10-16T13:47:17.969675+0000","last_became_active":"2023-10-16T13:47:17.968381+0000","last_became_peered":"2023-10-16T13:47:17.968381+0000","last_unstale":"2023-10-16T13:47:17.969675+0000","last_undegraded":"2023-10-16T13:47:17.969675+0000","last_fullsized":"2023-10-16T13:47:17.969675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:07.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.966675+0000","last_change":"2023-10-16T13:47:17.962507+0000","last_active":"2023-10-16T13:47:17.966675+0000","last_peered":"2023-10-16T13:47:17.966675+0000","last_clean":"2023-10-16T13:47:17.966675+0000","last_became_active":"2023-10-16T13:47:17.962196+0000","last_became_peered":"2023-10-16T13:47:17.962196+0000","last_unstale":"2023-10-16T13:47:17.966675+0000","last_undegraded":"2023-10-16T13:47:17.966675+0000","last_fullsized":"2023-10-16T13:47:17.966675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:35.034787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967905+0000","last_change":"2023-10-16T13:47:17.965686+0000","last_active":"2023-10-16T13:47:17.967905+0000","last_peered":"2023-10-16T13:47:17.967905+0000","last_clean":"2023-10-16T13:47:17.967905+0000","last_became_active":"2023-10-16T13:47:17.965424+0000","last_became_peered":"2023-10-16T13:47:17.965424+0000","last_unstale":"2023-10-16T13:47:17.967905+0000","last_undegraded":"2023-10-16T13:47:17.967905+0000","last_fullsized":"2023-10-16T13:47:17.967905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:57.440679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.977360+0000","last_change":"2023-10-16T13:47:17.976710+0000","last_active":"2023-10-16T13:47:17.977360+0000","last_peered":"2023-10-16T13:47:17.977360+0000","last_clean":"2023-10-16T13:47:17.977360+0000","last_became_active":"2023-10-16T13:47:17.976371+0000","last_became_peered":"2023-10-16T13:47:17.976371+0000","last_unstale":"2023-10-16T13:47:17.977360+0000","last_undegraded":"2023-10-16T13:47:17.977360+0000","last_fullsized":"2023-10-16T13:47:17.977360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969453+0000","last_change":"2023-10-16T13:47:17.966641+0000","last_active":"2023-10-16T13:47:17.969453+0000","last_peered":"2023-10-16T13:47:17.969453+0000","last_clean":"2023-10-16T13:47:17.969453+0000","last_became_active":"2023-10-16T13:47:17.966349+0000","last_became_peered":"2023-10-16T13:47:17.966349+0000","last_unstale":"2023-10-16T13:47:17.969453+0000","last_undegraded":"2023-10-16T13:47:17.969453+0000","last_fullsized":"2023-10-16T13:47:17.969453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:25:44.362752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969053+0000","last_change":"2023-10-16T13:47:17.964826+0000","last_active":"2023-10-16T13:47:17.969053+0000","last_peered":"2023-10-16T13:47:17.969053+0000","last_clean":"2023-10-16T13:47:17.969053+0000","last_became_active":"2023-10-16T13:47:17.964513+0000","last_became_peered":"2023-10-16T13:47:17.964513+0000","last_unstale":"2023-10-16T13:47:17.969053+0000","last_undegraded":"2023-10-16T13:47:17.969053+0000","last_fullsized":"2023-10-16T13:47:17.969053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:35.076804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969801+0000","last_change":"2023-10-16T13:47:17.966845+0000","last_active":"2023-10-16T13:47:17.969801+0000","last_peered":"2023-10-16T13:47:17.969801+0000","last_clean":"2023-10-16T13:47:17.969801+0000","last_became_active":"2023-10-16T13:47:17.966318+0000","last_became_peered":"2023-10-16T13:47:17.966318+0000","last_unstale":"2023-10-16T13:47:17.969801+0000","last_undegraded":"2023-10-16T13:47:17.969801+0000","last_fullsized":"2023-10-16T13:47:17.969801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:20:22.390577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.966707+0000","last_change":"2023-10-16T13:47:17.962532+0000","last_active":"2023-10-16T13:47:17.966707+0000","last_peered":"2023-10-16T13:47:17.966707+0000","last_clean":"2023-10-16T13:47:17.966707+0000","last_became_active":"2023-10-16T13:47:17.962210+0000","last_became_peered":"2023-10-16T13:47:17.962210+0000","last_unstale":"2023-10-16T13:47:17.966707+0000","last_undegraded":"2023-10-16T13:47:17.966707+0000","last_fullsized":"2023-10-16T13:47:17.966707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:17:28.018920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973086+0000","last_change":"2023-10-16T13:47:17.969486+0000","last_active":"2023-10-16T13:47:17.973086+0000","last_peered":"2023-10-16T13:47:17.973086+0000","last_clean":"2023-10-16T13:47:17.973086+0000","last_became_active":"2023-10-16T13:47:17.968967+0000","last_became_peered":"2023-10-16T13:47:17.968967+0000","last_unstale":"2023-10-16T13:47:17.973086+0000","last_undegraded":"2023-10-16T13:47:17.973086+0000","last_fullsized":"2023-10-16T13:47:17.973086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:41.068500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970000+0000","last_change":"2023-10-16T13:47:17.966447+0000","last_active":"2023-10-16T13:47:17.970000+0000","last_peered":"2023-10-16T13:47:17.970000+0000","last_clean":"2023-10-16T13:47:17.970000+0000","last_became_active":"2023-10-16T13:47:17.964550+0000","last_became_peered":"2023-10-16T13:47:17.964550+0000","last_unstale":"2023-10-16T13:47:17.970000+0000","last_undegraded":"2023-10-16T13:47:17.970000+0000","last_fullsized":"2023-10-16T13:47:17.970000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:10.419358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970574+0000","last_change":"2023-10-16T13:47:17.961799+0000","last_active":"2023-10-16T13:47:17.970574+0000","last_peered":"2023-10-16T13:47:17.970574+0000","last_clean":"2023-10-16T13:47:17.970574+0000","last_became_active":"2023-10-16T13:47:17.961467+0000","last_became_peered":"2023-10-16T13:47:17.961467+0000","last_unstale":"2023-10-16T13:47:17.970574+0000","last_undegraded":"2023-10-16T13:47:17.970574+0000","last_fullsized":"2023-10-16T13:47:17.970574+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:07.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970572+0000","last_change":"2023-10-16T13:47:17.961990+0000","last_active":"2023-10-16T13:47:17.970572+0000","last_peered":"2023-10-16T13:47:17.970572+0000","last_clean":"2023-10-16T13:47:17.970572+0000","last_became_active":"2023-10-16T13:47:17.961487+0000","last_became_peered":"2023-10-16T13:47:17.961487+0000","last_unstale":"2023-10-16T13:47:17.970572+0000","last_undegraded":"2023-10-16T13:47:17.970572+0000","last_fullsized":"2023-10-16T13:47:17.970572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:24.385395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973993+0000","last_change":"2023-10-16T13:47:17.968644+0000","last_active":"2023-10-16T13:47:17.973993+0000","last_peered":"2023-10-16T13:47:17.973993+0000","last_clean":"2023-10-16T13:47:17.973993+0000","last_became_active":"2023-10-16T13:47:17.968330+0000","last_became_peered":"2023-10-16T13:47:17.968330+0000","last_unstale":"2023-10-16T13:47:17.973993+0000","last_undegraded":"2023-10-16T13:47:17.973993+0000","last_fullsized":"2023-10-16T13:47:17.973993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:30:23.911005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.982386+0000","last_change":"2023-10-16T13:47:17.977342+0000","last_active":"2023-10-16T13:47:17.982386+0000","last_peered":"2023-10-16T13:47:17.982386+0000","last_clean":"2023-10-16T13:47:17.982386+0000","last_became_active":"2023-10-16T13:47:17.977003+0000","last_became_peered":"2023-10-16T13:47:17.977003+0000","last_unstale":"2023-10-16T13:47:17.982386+0000","last_undegraded":"2023-10-16T13:47:17.982386+0000","last_fullsized":"2023-10-16T13:47:17.982386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:24.385395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979606+0000","last_change":"2023-10-16T13:47:17.978776+0000","last_active":"2023-10-16T13:47:17.979606+0000","last_peered":"2023-10-16T13:47:17.979606+0000","last_clean":"2023-10-16T13:47:17.979606+0000","last_became_active":"2023-10-16T13:47:17.978216+0000","last_became_peered":"2023-10-16T13:47:17.978216+0000","last_unstale":"2023-10-16T13:47:17.979606+0000","last_undegraded":"2023-10-16T13:47:17.979606+0000","last_fullsized":"2023-10-16T13:47:17.979606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:08:24.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.978627+0000","last_change":"2023-10-16T13:47:17.976899+0000","last_active":"2023-10-16T13:47:17.978627+0000","last_peered":"2023-10-16T13:47:17.978627+0000","last_clean":"2023-10-16T13:47:17.978627+0000","last_became_active":"2023-10-16T13:47:17.976601+0000","last_became_peered":"2023-10-16T13:47:17.976601+0000","last_unstale":"2023-10-16T13:47:17.978627+0000","last_undegraded":"2023-10-16T13:47:17.978627+0000","last_fullsized":"2023-10-16T13:47:17.978627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:17:05.197646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979047+0000","last_change":"2023-10-16T13:47:17.976045+0000","last_active":"2023-10-16T13:47:17.979047+0000","last_peered":"2023-10-16T13:47:17.979047+0000","last_clean":"2023-10-16T13:47:17.979047+0000","last_became_active":"2023-10-16T13:47:17.975733+0000","last_became_peered":"2023-10-16T13:47:17.975733+0000","last_unstale":"2023-10-16T13:47:17.979047+0000","last_undegraded":"2023-10-16T13:47:17.979047+0000","last_fullsized":"2023-10-16T13:47:17.979047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:48:38.786197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972652+0000","last_change":"2023-10-16T13:47:17.971680+0000","last_active":"2023-10-16T13:47:17.972652+0000","last_peered":"2023-10-16T13:47:17.972652+0000","last_clean":"2023-10-16T13:47:17.972652+0000","last_became_active":"2023-10-16T13:47:17.971316+0000","last_became_peered":"2023-10-16T13:47:17.971316+0000","last_unstale":"2023-10-16T13:47:17.972652+0000","last_undegraded":"2023-10-16T13:47:17.972652+0000","last_fullsized":"2023-10-16T13:47:17.972652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:53:22.959884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973052+0000","last_change":"2023-10-16T13:47:17.967024+0000","last_active":"2023-10-16T13:47:17.973052+0000","last_peered":"2023-10-16T13:47:17.973052+0000","last_clean":"2023-10-16T13:47:17.973052+0000","last_became_active":"2023-10-16T13:47:17.966669+0000","last_became_peered":"2023-10-16T13:47:17.966669+0000","last_unstale":"2023-10-16T13:47:17.973052+0000","last_undegraded":"2023-10-16T13:47:17.973052+0000","last_fullsized":"2023-10-16T13:47:17.973052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:47:05.914749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972759+0000","last_change":"2023-10-16T13:47:17.967833+0000","last_active":"2023-10-16T13:47:17.972759+0000","last_peered":"2023-10-16T13:47:17.972759+0000","last_clean":"2023-10-16T13:47:17.972759+0000","last_became_active":"2023-10-16T13:47:17.967493+0000","last_became_peered":"2023-10-16T13:47:17.967493+0000","last_unstale":"2023-10-16T13:47:17.972759+0000","last_undegraded":"2023-10-16T13:47:17.972759+0000","last_fullsized":"2023-10-16T13:47:17.972759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:31.057059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.968777+0000","last_change":"2023-10-16T13:47:17.965196+0000","last_active":"2023-10-16T13:47:17.968777+0000","last_peered":"2023-10-16T13:47:17.968777+0000","last_clean":"2023-10-16T13:47:17.968777+0000","last_became_active":"2023-10-16T13:47:17.964855+0000","last_became_peered":"2023-10-16T13:47:17.964855+0000","last_unstale":"2023-10-16T13:47:17.968777+0000","last_undegraded":"2023-10-16T13:47:17.968777+0000","last_fullsized":"2023-10-16T13:47:17.968777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:47:31.363120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971758+0000","last_change":"2023-10-16T13:47:17.967606+0000","last_active":"2023-10-16T13:47:17.971758+0000","last_peered":"2023-10-16T13:47:17.971758+0000","last_clean":"2023-10-16T13:47:17.971758+0000","last_became_active":"2023-10-16T13:47:17.967321+0000","last_became_peered":"2023-10-16T13:47:17.967321+0000","last_unstale":"2023-10-16T13:47:17.971758+0000","last_undegraded":"2023-10-16T13:47:17.971758+0000","last_fullsized":"2023-10-16T13:47:17.971758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:30.278595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969791+0000","last_change":"2023-10-16T13:47:17.966731+0000","last_active":"2023-10-16T13:47:17.969791+0000","last_peered":"2023-10-16T13:47:17.969791+0000","last_clean":"2023-10-16T13:47:17.969791+0000","last_became_active":"2023-10-16T13:47:17.965891+0000","last_became_peered":"2023-10-16T13:47:17.965891+0000","last_unstale":"2023-10-16T13:47:17.969791+0000","last_undegraded":"2023-10-16T13:47:17.969791+0000","last_fullsized":"2023-10-16T13:47:17.969791+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:50.999422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972820+0000","last_change":"2023-10-16T13:47:17.968512+0000","last_active":"2023-10-16T13:47:17.972820+0000","last_peered":"2023-10-16T13:47:17.972820+0000","last_clean":"2023-10-16T13:47:17.972820+0000","last_became_active":"2023-10-16T13:47:17.968067+0000","last_became_peered":"2023-10-16T13:47:17.968067+0000","last_unstale":"2023-10-16T13:47:17.972820+0000","last_undegraded":"2023-10-16T13:47:17.972820+0000","last_fullsized":"2023-10-16T13:47:17.972820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:57.440679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979024+0000","last_change":"2023-10-16T13:47:17.973465+0000","last_active":"2023-10-16T13:47:17.979024+0000","last_peered":"2023-10-16T13:47:17.979024+0000","last_clean":"2023-10-16T13:47:17.979024+0000","last_became_active":"2023-10-16T13:47:17.972848+0000","last_became_peered":"2023-10-16T13:47:17.972848+0000","last_unstale":"2023-10-16T13:47:17.979024+0000","last_undegraded":"2023-10-16T13:47:17.979024+0000","last_fullsized":"2023-10-16T13:47:17.979024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:24.068803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.979091+0000","last_change":"2023-10-16T13:47:17.978657+0000","last_active":"2023-10-16T13:47:17.979091+0000","last_peered":"2023-10-16T13:47:17.979091+0000","last_clean":"2023-10-16T13:47:17.979091+0000","last_became_active":"2023-10-16T13:47:17.978370+0000","last_became_peered":"2023-10-16T13:47:17.978370+0000","last_unstale":"2023-10-16T13:47:17.979091+0000","last_undegraded":"2023-10-16T13:47:17.979091+0000","last_fullsized":"2023-10-16T13:47:17.979091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969707+0000","last_change":"2023-10-16T13:47:17.968239+0000","last_active":"2023-10-16T13:47:17.969707+0000","last_peered":"2023-10-16T13:47:17.969707+0000","last_clean":"2023-10-16T13:47:17.969707+0000","last_became_active":"2023-10-16T13:47:17.967936+0000","last_became_peered":"2023-10-16T13:47:17.967936+0000","last_unstale":"2023-10-16T13:47:17.969707+0000","last_undegraded":"2023-10-16T13:47:17.969707+0000","last_fullsized":"2023-10-16T13:47:17.969707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:35:56.126210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971416+0000","last_change":"2023-10-16T13:47:17.964572+0000","last_active":"2023-10-16T13:47:17.971416+0000","last_peered":"2023-10-16T13:47:17.971416+0000","last_clean":"2023-10-16T13:47:17.971416+0000","last_became_active":"2023-10-16T13:47:17.963752+0000","last_became_peered":"2023-10-16T13:47:17.963752+0000","last_unstale":"2023-10-16T13:47:17.971416+0000","last_undegraded":"2023-10-16T13:47:17.971416+0000","last_fullsized":"2023-10-16T13:47:17.971416+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:50.734095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"75'4","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.983530+0000","last_change":"2023-10-16T13:47:16.937734+0000","last_active":"2023-10-16T13:47:17.983530+0000","last_peered":"2023-10-16T13:47:17.983530+0000","last_clean":"2023-10-16T13:47:17.983530+0000","last_became_active":"2023-10-16T13:47:16.935730+0000","last_became_peered":"2023-10-16T13:47:16.935730+0000","last_unstale":"2023-10-16T13:47:17.983530+0000","last_undegraded":"2023-10-16T13:47:17.983530+0000","last_fullsized":"2023-10-16T13:47:17.983530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:23.064117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.977486+0000","last_change":"2023-10-16T13:47:17.976728+0000","last_active":"2023-10-16T13:47:17.977486+0000","last_peered":"2023-10-16T13:47:17.977486+0000","last_clean":"2023-10-16T13:47:17.977486+0000","last_became_active":"2023-10-16T13:47:17.976414+0000","last_became_peered":"2023-10-16T13:47:17.976414+0000","last_unstale":"2023-10-16T13:47:17.977486+0000","last_undegraded":"2023-10-16T13:47:17.977486+0000","last_fullsized":"2023-10-16T13:47:17.977486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:11:13.537020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988860+0000","last_change":"2023-10-16T13:47:16.938871+0000","last_active":"2023-10-16T13:47:17.988860+0000","last_peered":"2023-10-16T13:47:17.988860+0000","last_clean":"2023-10-16T13:47:17.988860+0000","last_became_active":"2023-10-16T13:47:16.938573+0000","last_became_peered":"2023-10-16T13:47:16.938573+0000","last_unstale":"2023-10-16T13:47:17.988860+0000","last_undegraded":"2023-10-16T13:47:17.988860+0000","last_fullsized":"2023-10-16T13:47:17.988860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:55.197237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970306+0000","last_change":"2023-10-16T13:47:17.968917+0000","last_active":"2023-10-16T13:47:17.970306+0000","last_peered":"2023-10-16T13:47:17.970306+0000","last_clean":"2023-10-16T13:47:17.970306+0000","last_became_active":"2023-10-16T13:47:17.968296+0000","last_became_peered":"2023-10-16T13:47:17.968296+0000","last_unstale":"2023-10-16T13:47:17.970306+0000","last_undegraded":"2023-10-16T13:47:17.970306+0000","last_fullsized":"2023-10-16T13:47:17.970306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:20.859318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.987582+0000","last_change":"2023-10-16T13:47:16.945376+0000","last_active":"2023-10-16T13:47:17.987582+0000","last_peered":"2023-10-16T13:47:17.987582+0000","last_clean":"2023-10-16T13:47:17.987582+0000","last_became_active":"2023-10-16T13:47:16.945070+0000","last_became_peered":"2023-10-16T13:47:16.945070+0000","last_unstale":"2023-10-16T13:47:17.987582+0000","last_undegraded":"2023-10-16T13:47:17.987582+0000","last_fullsized":"2023-10-16T13:47:17.987582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:42.076304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.963019+0000","last_change":"2023-10-16T13:47:17.959997+0000","last_active":"2023-10-16T13:47:17.963019+0000","last_peered":"2023-10-16T13:47:17.963019+0000","last_clean":"2023-10-16T13:47:17.963019+0000","last_became_active":"2023-10-16T13:47:17.959523+0000","last_became_peered":"2023-10-16T13:47:17.959523+0000","last_unstale":"2023-10-16T13:47:17.963019+0000","last_undegraded":"2023-10-16T13:47:17.963019+0000","last_fullsized":"2023-10-16T13:47:17.963019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:11.781995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988163+0000","last_change":"2023-10-16T13:47:16.945221+0000","last_active":"2023-10-16T13:47:17.988163+0000","last_peered":"2023-10-16T13:47:17.988163+0000","last_clean":"2023-10-16T13:47:17.988163+0000","last_became_active":"2023-10-16T13:47:16.944915+0000","last_became_peered":"2023-10-16T13:47:16.944915+0000","last_unstale":"2023-10-16T13:47:17.988163+0000","last_undegraded":"2023-10-16T13:47:17.988163+0000","last_fullsized":"2023-10-16T13:47:17.988163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:07.690535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973086+0000","last_change":"2023-10-16T13:47:17.968866+0000","last_active":"2023-10-16T13:47:17.973086+0000","last_peered":"2023-10-16T13:47:17.973086+0000","last_clean":"2023-10-16T13:47:17.973086+0000","last_became_active":"2023-10-16T13:47:17.968538+0000","last_became_peered":"2023-10-16T13:47:17.968538+0000","last_unstale":"2023-10-16T13:47:17.973086+0000","last_undegraded":"2023-10-16T13:47:17.973086+0000","last_fullsized":"2023-10-16T13:47:17.973086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:17.753549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988581+0000","last_change":"2023-10-16T13:47:16.942885+0000","last_active":"2023-10-16T13:47:17.988581+0000","last_peered":"2023-10-16T13:47:17.988581+0000","last_clean":"2023-10-16T13:47:17.988581+0000","last_became_active":"2023-10-16T13:47:16.942575+0000","last_became_peered":"2023-10-16T13:47:16.942575+0000","last_unstale":"2023-10-16T13:47:17.988581+0000","last_undegraded":"2023-10-16T13:47:17.988581+0000","last_fullsized":"2023-10-16T13:47:17.988581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:09:15.032341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.970550+0000","last_change":"2023-10-16T13:47:17.961785+0000","last_active":"2023-10-16T13:47:17.970550+0000","last_peered":"2023-10-16T13:47:17.970550+0000","last_clean":"2023-10-16T13:47:17.970550+0000","last_became_active":"2023-10-16T13:47:17.961338+0000","last_became_peered":"2023-10-16T13:47:17.961338+0000","last_unstale":"2023-10-16T13:47:17.970550+0000","last_undegraded":"2023-10-16T13:47:17.970550+0000","last_fullsized":"2023-10-16T13:47:17.970550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:01:11.530634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988854+0000","last_change":"2023-10-16T13:47:16.938798+0000","last_active":"2023-10-16T13:47:17.988854+0000","last_peered":"2023-10-16T13:47:17.988854+0000","last_clean":"2023-10-16T13:47:17.988854+0000","last_became_active":"2023-10-16T13:47:16.938463+0000","last_became_peered":"2023-10-16T13:47:16.938463+0000","last_unstale":"2023-10-16T13:47:17.988854+0000","last_undegraded":"2023-10-16T13:47:17.988854+0000","last_fullsized":"2023-10-16T13:47:17.988854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:01.873643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969477+0000","last_change":"2023-10-16T13:47:17.967237+0000","last_active":"2023-10-16T13:47:17.969477+0000","last_peered":"2023-10-16T13:47:17.969477+0000","last_clean":"2023-10-16T13:47:17.969477+0000","last_became_active":"2023-10-16T13:47:17.966944+0000","last_became_peered":"2023-10-16T13:47:17.966944+0000","last_unstale":"2023-10-16T13:47:17.969477+0000","last_undegraded":"2023-10-16T13:47:17.969477+0000","last_fullsized":"2023-10-16T13:47:17.969477+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:11:09.864865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.976519+0000","last_change":"2023-10-16T13:47:16.948385+0000","last_active":"2023-10-16T13:47:17.976519+0000","last_peered":"2023-10-16T13:47:17.976519+0000","last_clean":"2023-10-16T13:47:17.976519+0000","last_became_active":"2023-10-16T13:47:16.948067+0000","last_became_peered":"2023-10-16T13:47:16.948067+0000","last_unstale":"2023-10-16T13:47:17.976519+0000","last_undegraded":"2023-10-16T13:47:17.976519+0000","last_fullsized":"2023-10-16T13:47:17.976519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:09:15.032341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.966553+0000","last_change":"2023-10-16T13:47:17.964547+0000","last_active":"2023-10-16T13:47:17.966553+0000","last_peered":"2023-10-16T13:47:17.966553+0000","last_clean":"2023-10-16T13:47:17.966553+0000","last_became_active":"2023-10-16T13:47:17.964108+0000","last_became_peered":"2023-10-16T13:47:17.964108+0000","last_unstale":"2023-10-16T13:47:17.966553+0000","last_undegraded":"2023-10-16T13:47:17.966553+0000","last_fullsized":"2023-10-16T13:47:17.966553+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:23.326528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.959864+0000","last_change":"2023-10-16T13:47:16.942885+0000","last_active":"2023-10-16T13:47:17.959864+0000","last_peered":"2023-10-16T13:47:17.959864+0000","last_clean":"2023-10-16T13:47:17.959864+0000","last_became_active":"2023-10-16T13:47:16.942117+0000","last_became_peered":"2023-10-16T13:47:16.942117+0000","last_unstale":"2023-10-16T13:47:17.959864+0000","last_undegraded":"2023-10-16T13:47:17.959864+0000","last_fullsized":"2023-10-16T13:47:17.959864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:14.456350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.975755+0000","last_change":"2023-10-16T13:47:17.968868+0000","last_active":"2023-10-16T13:47:17.975755+0000","last_peered":"2023-10-16T13:47:17.975755+0000","last_clean":"2023-10-16T13:47:17.975755+0000","last_became_active":"2023-10-16T13:47:17.968532+0000","last_became_peered":"2023-10-16T13:47:17.968532+0000","last_unstale":"2023-10-16T13:47:17.975755+0000","last_undegraded":"2023-10-16T13:47:17.975755+0000","last_fullsized":"2023-10-16T13:47:17.975755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:19:35.254823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961312+0000","last_change":"2023-10-16T13:47:16.938037+0000","last_active":"2023-10-16T13:47:17.961312+0000","last_peered":"2023-10-16T13:47:17.961312+0000","last_clean":"2023-10-16T13:47:17.961312+0000","last_became_active":"2023-10-16T13:47:16.937626+0000","last_became_peered":"2023-10-16T13:47:16.937626+0000","last_unstale":"2023-10-16T13:47:17.961312+0000","last_undegraded":"2023-10-16T13:47:17.961312+0000","last_fullsized":"2023-10-16T13:47:17.961312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.452596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969625+0000","last_change":"2023-10-16T13:47:17.968519+0000","last_active":"2023-10-16T13:47:17.969625+0000","last_peered":"2023-10-16T13:47:17.969625+0000","last_clean":"2023-10-16T13:47:17.969625+0000","last_became_active":"2023-10-16T13:47:17.968247+0000","last_became_peered":"2023-10-16T13:47:17.968247+0000","last_unstale":"2023-10-16T13:47:17.969625+0000","last_undegraded":"2023-10-16T13:47:17.969625+0000","last_fullsized":"2023-10-16T13:47:17.969625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:02.878329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961033+0000","last_change":"2023-10-16T13:47:16.941898+0000","last_active":"2023-10-16T13:47:17.961033+0000","last_peered":"2023-10-16T13:47:17.961033+0000","last_clean":"2023-10-16T13:47:17.961033+0000","last_became_active":"2023-10-16T13:47:16.941551+0000","last_became_peered":"2023-10-16T13:47:16.941551+0000","last_unstale":"2023-10-16T13:47:17.961033+0000","last_undegraded":"2023-10-16T13:47:17.961033+0000","last_fullsized":"2023-10-16T13:47:17.961033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:16.748863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973451+0000","last_change":"2023-10-16T13:47:17.968870+0000","last_active":"2023-10-16T13:47:17.973451+0000","last_peered":"2023-10-16T13:47:17.973451+0000","last_clean":"2023-10-16T13:47:17.973451+0000","last_became_active":"2023-10-16T13:47:17.968561+0000","last_became_peered":"2023-10-16T13:47:17.968561+0000","last_unstale":"2023-10-16T13:47:17.973451+0000","last_undegraded":"2023-10-16T13:47:17.973451+0000","last_fullsized":"2023-10-16T13:47:17.973451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:15.461037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"75'3","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.983528+0000","last_change":"2023-10-16T13:47:16.944413+0000","last_active":"2023-10-16T13:47:17.983528+0000","last_peered":"2023-10-16T13:47:17.983528+0000","last_clean":"2023-10-16T13:47:17.983528+0000","last_became_active":"2023-10-16T13:47:16.943927+0000","last_became_peered":"2023-10-16T13:47:16.943927+0000","last_unstale":"2023-10-16T13:47:17.983528+0000","last_undegraded":"2023-10-16T13:47:17.983528+0000","last_fullsized":"2023-10-16T13:47:17.983528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:06.732034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.974090+0000","last_change":"2023-10-16T13:47:17.973527+0000","last_active":"2023-10-16T13:47:17.974090+0000","last_peered":"2023-10-16T13:47:17.974090+0000","last_clean":"2023-10-16T13:47:17.974090+0000","last_became_active":"2023-10-16T13:47:17.973164+0000","last_became_peered":"2023-10-16T13:47:17.973164+0000","last_unstale":"2023-10-16T13:47:17.974090+0000","last_undegraded":"2023-10-16T13:47:17.974090+0000","last_fullsized":"2023-10-16T13:47:17.974090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:47.017559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"75'6","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.990320+0000","last_change":"2023-10-16T13:47:16.939772+0000","last_active":"2023-10-16T13:47:17.990320+0000","last_peered":"2023-10-16T13:47:17.990320+0000","last_clean":"2023-10-16T13:47:17.990320+0000","last_became_active":"2023-10-16T13:47:16.939487+0000","last_became_peered":"2023-10-16T13:47:16.939487+0000","last_unstale":"2023-10-16T13:47:17.990320+0000","last_undegraded":"2023-10-16T13:47:17.990320+0000","last_fullsized":"2023-10-16T13:47:17.990320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:07.690535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.975220+0000","last_change":"2023-10-16T13:47:17.974327+0000","last_active":"2023-10-16T13:47:17.975220+0000","last_peered":"2023-10-16T13:47:17.975220+0000","last_clean":"2023-10-16T13:47:17.975220+0000","last_became_active":"2023-10-16T13:47:17.972919+0000","last_became_peered":"2023-10-16T13:47:17.972919+0000","last_unstale":"2023-10-16T13:47:17.975220+0000","last_undegraded":"2023-10-16T13:47:17.975220+0000","last_fullsized":"2023-10-16T13:47:17.975220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:07.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.990091+0000","last_change":"2023-10-16T13:47:16.944386+0000","last_active":"2023-10-16T13:47:17.990091+0000","last_peered":"2023-10-16T13:47:17.990091+0000","last_clean":"2023-10-16T13:47:17.990091+0000","last_became_active":"2023-10-16T13:47:16.944075+0000","last_became_peered":"2023-10-16T13:47:16.944075+0000","last_unstale":"2023-10-16T13:47:17.990091+0000","last_undegraded":"2023-10-16T13:47:17.990091+0000","last_fullsized":"2023-10-16T13:47:17.990091+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:01.873643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972093+0000","last_change":"2023-10-16T13:47:17.970636+0000","last_active":"2023-10-16T13:47:17.972093+0000","last_peered":"2023-10-16T13:47:17.972093+0000","last_clean":"2023-10-16T13:47:17.972093+0000","last_became_active":"2023-10-16T13:47:17.970416+0000","last_became_peered":"2023-10-16T13:47:17.970416+0000","last_unstale":"2023-10-16T13:47:17.972093+0000","last_undegraded":"2023-10-16T13:47:17.972093+0000","last_fullsized":"2023-10-16T13:47:17.972093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:06.102314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.959195+0000","last_change":"2023-10-16T13:47:16.945229+0000","last_active":"2023-10-16T13:47:17.959195+0000","last_peered":"2023-10-16T13:47:17.959195+0000","last_clean":"2023-10-16T13:47:17.959195+0000","last_became_active":"2023-10-16T13:47:16.944897+0000","last_became_peered":"2023-10-16T13:47:16.944897+0000","last_unstale":"2023-10-16T13:47:17.959195+0000","last_undegraded":"2023-10-16T13:47:17.959195+0000","last_fullsized":"2023-10-16T13:47:17.959195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:12.891980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972903+0000","last_change":"2023-10-16T13:47:17.969772+0000","last_active":"2023-10-16T13:47:17.972903+0000","last_peered":"2023-10-16T13:47:17.972903+0000","last_clean":"2023-10-16T13:47:17.972903+0000","last_became_active":"2023-10-16T13:47:17.969197+0000","last_became_peered":"2023-10-16T13:47:17.969197+0000","last_unstale":"2023-10-16T13:47:17.972903+0000","last_undegraded":"2023-10-16T13:47:17.972903+0000","last_fullsized":"2023-10-16T13:47:17.972903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.960200+0000","last_change":"2023-10-16T13:47:16.942375+0000","last_active":"2023-10-16T13:47:17.960200+0000","last_peered":"2023-10-16T13:47:17.960200+0000","last_clean":"2023-10-16T13:47:17.960200+0000","last_became_active":"2023-10-16T13:47:16.940867+0000","last_became_peered":"2023-10-16T13:47:16.940867+0000","last_unstale":"2023-10-16T13:47:17.960200+0000","last_undegraded":"2023-10-16T13:47:17.960200+0000","last_fullsized":"2023-10-16T13:47:17.960200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:01:10.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972624+0000","last_change":"2023-10-16T13:47:17.967635+0000","last_active":"2023-10-16T13:47:17.972624+0000","last_peered":"2023-10-16T13:47:17.972624+0000","last_clean":"2023-10-16T13:47:17.972624+0000","last_became_active":"2023-10-16T13:47:17.967244+0000","last_became_peered":"2023-10-16T13:47:17.967244+0000","last_unstale":"2023-10-16T13:47:17.972624+0000","last_undegraded":"2023-10-16T13:47:17.972624+0000","last_fullsized":"2023-10-16T13:47:17.972624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:01.811897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"75'8","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.989088+0000","last_change":"2023-10-16T13:47:16.948597+0000","last_active":"2023-10-16T13:47:17.989088+0000","last_peered":"2023-10-16T13:47:17.989088+0000","last_clean":"2023-10-16T13:47:17.989088+0000","last_became_active":"2023-10-16T13:47:16.948288+0000","last_became_peered":"2023-10-16T13:47:16.948288+0000","last_unstale":"2023-10-16T13:47:17.989088+0000","last_undegraded":"2023-10-16T13:47:17.989088+0000","last_fullsized":"2023-10-16T13:47:17.989088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:15.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967950+0000","last_change":"2023-10-16T13:47:17.963790+0000","last_active":"2023-10-16T13:47:17.967950+0000","last_peered":"2023-10-16T13:47:17.967950+0000","last_clean":"2023-10-16T13:47:17.967950+0000","last_became_active":"2023-10-16T13:47:17.963422+0000","last_became_peered":"2023-10-16T13:47:17.963422+0000","last_unstale":"2023-10-16T13:47:17.967950+0000","last_undegraded":"2023-10-16T13:47:17.967950+0000","last_fullsized":"2023-10-16T13:47:17.967950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:49.299263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.982652+0000","last_change":"2023-10-16T13:47:16.937914+0000","last_active":"2023-10-16T13:47:17.982652+0000","last_peered":"2023-10-16T13:47:17.982652+0000","last_clean":"2023-10-16T13:47:17.982652+0000","last_became_active":"2023-10-16T13:47:16.937268+0000","last_became_peered":"2023-10-16T13:47:16.937268+0000","last_unstale":"2023-10-16T13:47:17.982652+0000","last_undegraded":"2023-10-16T13:47:17.982652+0000","last_fullsized":"2023-10-16T13:47:17.982652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:48:37.781511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969186+0000","last_change":"2023-10-16T13:47:17.965593+0000","last_active":"2023-10-16T13:47:17.969186+0000","last_peered":"2023-10-16T13:47:17.969186+0000","last_clean":"2023-10-16T13:47:17.969186+0000","last_became_active":"2023-10-16T13:47:17.965017+0000","last_became_peered":"2023-10-16T13:47:17.965017+0000","last_unstale":"2023-10-16T13:47:17.969186+0000","last_undegraded":"2023-10-16T13:47:17.969186+0000","last_fullsized":"2023-10-16T13:47:17.969186+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:18.557099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.986396+0000","last_change":"2023-10-16T13:47:16.946393+0000","last_active":"2023-10-16T13:47:17.986396+0000","last_peered":"2023-10-16T13:47:17.986396+0000","last_clean":"2023-10-16T13:47:17.986396+0000","last_became_active":"2023-10-16T13:47:16.946049+0000","last_became_peered":"2023-10-16T13:47:16.946049+0000","last_unstale":"2023-10-16T13:47:17.986396+0000","last_undegraded":"2023-10-16T13:47:17.986396+0000","last_fullsized":"2023-10-16T13:47:17.986396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:49:49.729409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971675+0000","last_change":"2023-10-16T13:47:17.965815+0000","last_active":"2023-10-16T13:47:17.971675+0000","last_peered":"2023-10-16T13:47:17.971675+0000","last_clean":"2023-10-16T13:47:17.971675+0000","last_became_active":"2023-10-16T13:47:17.965560+0000","last_became_peered":"2023-10-16T13:47:17.965560+0000","last_unstale":"2023-10-16T13:47:17.971675+0000","last_undegraded":"2023-10-16T13:47:17.971675+0000","last_fullsized":"2023-10-16T13:47:17.971675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:08.188498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971825+0000","last_change":"2023-10-16T13:47:16.948394+0000","last_active":"2023-10-16T13:47:17.971825+0000","last_peered":"2023-10-16T13:47:17.971825+0000","last_clean":"2023-10-16T13:47:17.971825+0000","last_became_active":"2023-10-16T13:47:16.948076+0000","last_became_peered":"2023-10-16T13:47:16.948076+0000","last_unstale":"2023-10-16T13:47:17.971825+0000","last_undegraded":"2023-10-16T13:47:17.971825+0000","last_fullsized":"2023-10-16T13:47:17.971825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:10:36.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973106+0000","last_change":"2023-10-16T13:47:17.969989+0000","last_active":"2023-10-16T13:47:17.973106+0000","last_peered":"2023-10-16T13:47:17.973106+0000","last_clean":"2023-10-16T13:47:17.973106+0000","last_became_active":"2023-10-16T13:47:17.968546+0000","last_became_peered":"2023-10-16T13:47:17.968546+0000","last_unstale":"2023-10-16T13:47:17.973106+0000","last_undegraded":"2023-10-16T13:47:17.973106+0000","last_fullsized":"2023-10-16T13:47:17.973106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:48.626462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.988787+0000","last_change":"2023-10-16T13:47:16.940868+0000","last_active":"2023-10-16T13:47:17.988787+0000","last_peered":"2023-10-16T13:47:17.988787+0000","last_clean":"2023-10-16T13:47:17.988787+0000","last_became_active":"2023-10-16T13:47:16.940542+0000","last_became_peered":"2023-10-16T13:47:16.940542+0000","last_unstale":"2023-10-16T13:47:17.988787+0000","last_undegraded":"2023-10-16T13:47:17.988787+0000","last_fullsized":"2023-10-16T13:47:17.988787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:08.875202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.969116+0000","last_change":"2023-10-16T13:47:17.966807+0000","last_active":"2023-10-16T13:47:17.969116+0000","last_peered":"2023-10-16T13:47:17.969116+0000","last_clean":"2023-10-16T13:47:17.969116+0000","last_became_active":"2023-10-16T13:47:17.966539+0000","last_became_peered":"2023-10-16T13:47:17.966539+0000","last_unstale":"2023-10-16T13:47:17.969116+0000","last_undegraded":"2023-10-16T13:47:17.969116+0000","last_fullsized":"2023-10-16T13:47:17.969116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:50:24.385395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.960661+0000","last_change":"2023-10-16T13:47:16.944886+0000","last_active":"2023-10-16T13:47:17.960661+0000","last_peered":"2023-10-16T13:47:17.960661+0000","last_clean":"2023-10-16T13:47:17.960661+0000","last_became_active":"2023-10-16T13:47:16.944610+0000","last_became_peered":"2023-10-16T13:47:16.944610+0000","last_unstale":"2023-10-16T13:47:17.960661+0000","last_undegraded":"2023-10-16T13:47:17.960661+0000","last_fullsized":"2023-10-16T13:47:17.960661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:47.739333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.973030+0000","last_change":"2023-10-16T13:47:17.965249+0000","last_active":"2023-10-16T13:47:17.973030+0000","last_peered":"2023-10-16T13:47:17.973030+0000","last_clean":"2023-10-16T13:47:17.973030+0000","last_became_active":"2023-10-16T13:47:17.964925+0000","last_became_peered":"2023-10-16T13:47:17.964925+0000","last_unstale":"2023-10-16T13:47:17.973030+0000","last_undegraded":"2023-10-16T13:47:17.973030+0000","last_fullsized":"2023-10-16T13:47:17.973030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:47:26.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.955643+0000","last_change":"2023-10-16T13:47:16.944360+0000","last_active":"2023-10-16T13:47:17.955643+0000","last_peered":"2023-10-16T13:47:17.955643+0000","last_clean":"2023-10-16T13:47:17.955643+0000","last_became_active":"2023-10-16T13:47:16.944006+0000","last_became_peered":"2023-10-16T13:47:16.944006+0000","last_unstale":"2023-10-16T13:47:17.955643+0000","last_undegraded":"2023-10-16T13:47:17.955643+0000","last_fullsized":"2023-10-16T13:47:17.955643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:06:28.746592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.978330+0000","last_change":"2023-10-16T13:47:17.977684+0000","last_active":"2023-10-16T13:47:17.978330+0000","last_peered":"2023-10-16T13:47:17.978330+0000","last_clean":"2023-10-16T13:47:17.978330+0000","last_became_active":"2023-10-16T13:47:17.977417+0000","last_became_peered":"2023-10-16T13:47:17.977417+0000","last_unstale":"2023-10-16T13:47:17.978330+0000","last_undegraded":"2023-10-16T13:47:17.978330+0000","last_fullsized":"2023-10-16T13:47:17.978330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:16.383299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.958661+0000","last_change":"2023-10-16T13:47:16.941232+0000","last_active":"2023-10-16T13:47:17.958661+0000","last_peered":"2023-10-16T13:47:17.958661+0000","last_clean":"2023-10-16T13:47:17.958661+0000","last_became_active":"2023-10-16T13:47:16.940360+0000","last_became_peered":"2023-10-16T13:47:16.940360+0000","last_unstale":"2023-10-16T13:47:17.958661+0000","last_undegraded":"2023-10-16T13:47:17.958661+0000","last_fullsized":"2023-10-16T13:47:17.958661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:41.712783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971437+0000","last_change":"2023-10-16T13:47:17.964627+0000","last_active":"2023-10-16T13:47:17.971437+0000","last_peered":"2023-10-16T13:47:17.971437+0000","last_clean":"2023-10-16T13:47:17.971437+0000","last_became_active":"2023-10-16T13:47:17.964359+0000","last_became_peered":"2023-10-16T13:47:17.964359+0000","last_unstale":"2023-10-16T13:47:17.971437+0000","last_undegraded":"2023-10-16T13:47:17.971437+0000","last_fullsized":"2023-10-16T13:47:17.971437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:08.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"75'2","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.989239+0000","last_change":"2023-10-16T13:47:16.943342+0000","last_active":"2023-10-16T13:47:17.989239+0000","last_peered":"2023-10-16T13:47:17.989239+0000","last_clean":"2023-10-16T13:47:17.989239+0000","last_became_active":"2023-10-16T13:47:16.943048+0000","last_became_peered":"2023-10-16T13:47:16.943048+0000","last_unstale":"2023-10-16T13:47:17.989239+0000","last_undegraded":"2023-10-16T13:47:17.989239+0000","last_fullsized":"2023-10-16T13:47:17.989239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:09:56.142160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.968577+0000","last_change":"2023-10-16T13:47:17.964103+0000","last_active":"2023-10-16T13:47:17.968577+0000","last_peered":"2023-10-16T13:47:17.968577+0000","last_clean":"2023-10-16T13:47:17.968577+0000","last_became_active":"2023-10-16T13:47:17.963465+0000","last_became_peered":"2023-10-16T13:47:17.963465+0000","last_unstale":"2023-10-16T13:47:17.968577+0000","last_undegraded":"2023-10-16T13:47:17.968577+0000","last_fullsized":"2023-10-16T13:47:17.968577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:46:09.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.955963+0000","last_change":"2023-10-16T13:47:16.944577+0000","last_active":"2023-10-16T13:47:17.955963+0000","last_peered":"2023-10-16T13:47:17.955963+0000","last_clean":"2023-10-16T13:47:17.955963+0000","last_became_active":"2023-10-16T13:47:16.944291+0000","last_became_peered":"2023-10-16T13:47:16.944291+0000","last_unstale":"2023-10-16T13:47:17.955963+0000","last_undegraded":"2023-10-16T13:47:17.955963+0000","last_fullsized":"2023-10-16T13:47:17.955963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.452596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971178+0000","last_change":"2023-10-16T13:47:17.969895+0000","last_active":"2023-10-16T13:47:17.971178+0000","last_peered":"2023-10-16T13:47:17.971178+0000","last_clean":"2023-10-16T13:47:17.971178+0000","last_became_active":"2023-10-16T13:47:17.969609+0000","last_became_peered":"2023-10-16T13:47:17.969609+0000","last_unstale":"2023-10-16T13:47:17.971178+0000","last_undegraded":"2023-10-16T13:47:17.971178+0000","last_fullsized":"2023-10-16T13:47:17.971178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:03:09.074200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961092+0000","last_change":"2023-10-16T13:47:16.937745+0000","last_active":"2023-10-16T13:47:17.961092+0000","last_peered":"2023-10-16T13:47:17.961092+0000","last_clean":"2023-10-16T13:47:17.961092+0000","last_became_active":"2023-10-16T13:47:16.937438+0000","last_became_peered":"2023-10-16T13:47:16.937438+0000","last_unstale":"2023-10-16T13:47:17.961092+0000","last_undegraded":"2023-10-16T13:47:17.961092+0000","last_fullsized":"2023-10-16T13:47:17.961092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:00:13.635740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.980608+0000","last_change":"2023-10-16T13:47:17.979425+0000","last_active":"2023-10-16T13:47:17.980608+0000","last_peered":"2023-10-16T13:47:17.980608+0000","last_clean":"2023-10-16T13:47:17.980608+0000","last_became_active":"2023-10-16T13:47:17.979068+0000","last_became_peered":"2023-10-16T13:47:17.979068+0000","last_unstale":"2023-10-16T13:47:17.980608+0000","last_undegraded":"2023-10-16T13:47:17.980608+0000","last_fullsized":"2023-10-16T13:47:17.980608+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:43.080990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.960899+0000","last_change":"2023-10-16T13:47:16.937951+0000","last_active":"2023-10-16T13:47:17.960899+0000","last_peered":"2023-10-16T13:47:17.960899+0000","last_clean":"2023-10-16T13:47:17.960899+0000","last_became_active":"2023-10-16T13:47:16.937290+0000","last_became_peered":"2023-10-16T13:47:16.937290+0000","last_unstale":"2023-10-16T13:47:17.960899+0000","last_undegraded":"2023-10-16T13:47:17.960899+0000","last_fullsized":"2023-10-16T13:47:17.960899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:34.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967989+0000","last_change":"2023-10-16T13:47:17.964750+0000","last_active":"2023-10-16T13:47:17.967989+0000","last_peered":"2023-10-16T13:47:17.967989+0000","last_clean":"2023-10-16T13:47:17.967989+0000","last_became_active":"2023-10-16T13:47:17.964457+0000","last_became_peered":"2023-10-16T13:47:17.964457+0000","last_unstale":"2023-10-16T13:47:17.967989+0000","last_undegraded":"2023-10-16T13:47:17.967989+0000","last_fullsized":"2023-10-16T13:47:17.967989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:15.461037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971550+0000","last_change":"2023-10-16T13:47:16.948450+0000","last_active":"2023-10-16T13:47:17.971550+0000","last_peered":"2023-10-16T13:47:17.971550+0000","last_clean":"2023-10-16T13:47:17.971550+0000","last_became_active":"2023-10-16T13:47:16.948156+0000","last_became_peered":"2023-10-16T13:47:16.948156+0000","last_unstale":"2023-10-16T13:47:17.971550+0000","last_undegraded":"2023-10-16T13:47:17.971550+0000","last_fullsized":"2023-10-16T13:47:17.971550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:01:10.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.974233+0000","last_change":"2023-10-16T13:47:17.973318+0000","last_active":"2023-10-16T13:47:17.974233+0000","last_peered":"2023-10-16T13:47:17.974233+0000","last_clean":"2023-10-16T13:47:17.974233+0000","last_became_active":"2023-10-16T13:47:17.973035+0000","last_became_peered":"2023-10-16T13:47:17.973035+0000","last_unstale":"2023-10-16T13:47:17.974233+0000","last_undegraded":"2023-10-16T13:47:17.974233+0000","last_fullsized":"2023-10-16T13:47:17.974233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.388394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.952795+0000","last_change":"2023-10-16T13:47:16.940775+0000","last_active":"2023-10-16T13:47:17.952795+0000","last_peered":"2023-10-16T13:47:17.952795+0000","last_clean":"2023-10-16T13:47:17.952795+0000","last_became_active":"2023-10-16T13:47:16.940501+0000","last_became_peered":"2023-10-16T13:47:16.940501+0000","last_unstale":"2023-10-16T13:47:17.952795+0000","last_undegraded":"2023-10-16T13:47:17.952795+0000","last_fullsized":"2023-10-16T13:47:17.952795+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:50:14.456350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.967126+0000","last_change":"2023-10-16T13:47:17.962247+0000","last_active":"2023-10-16T13:47:17.967126+0000","last_peered":"2023-10-16T13:47:17.967126+0000","last_clean":"2023-10-16T13:47:17.967126+0000","last_became_active":"2023-10-16T13:47:17.961861+0000","last_became_peered":"2023-10-16T13:47:17.961861+0000","last_unstale":"2023-10-16T13:47:17.967126+0000","last_undegraded":"2023-10-16T13:47:17.967126+0000","last_fullsized":"2023-10-16T13:47:17.967126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:13:38.636827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.961098+0000","last_change":"2023-10-16T13:47:16.940773+0000","last_active":"2023-10-16T13:47:17.961098+0000","last_peered":"2023-10-16T13:47:17.961098+0000","last_clean":"2023-10-16T13:47:17.961098+0000","last_became_active":"2023-10-16T13:47:16.940503+0000","last_became_peered":"2023-10-16T13:47:16.940503+0000","last_unstale":"2023-10-16T13:47:17.961098+0000","last_undegraded":"2023-10-16T13:47:17.961098+0000","last_fullsized":"2023-10-16T13:47:17.961098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:41:00.807211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.972149+0000","last_change":"2023-10-16T13:47:17.970198+0000","last_active":"2023-10-16T13:47:17.972149+0000","last_peered":"2023-10-16T13:47:17.972149+0000","last_clean":"2023-10-16T13:47:17.972149+0000","last_became_active":"2023-10-16T13:47:17.969887+0000","last_became_peered":"2023-10-16T13:47:17.969887+0000","last_unstale":"2023-10-16T13:47:17.972149+0000","last_undegraded":"2023-10-16T13:47:17.972149+0000","last_fullsized":"2023-10-16T13:47:17.972149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:42:24.264575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.954041+0000","last_change":"2023-10-16T13:47:16.943622+0000","last_active":"2023-10-16T13:47:17.954041+0000","last_peered":"2023-10-16T13:47:17.954041+0000","last_clean":"2023-10-16T13:47:17.954041+0000","last_became_active":"2023-10-16T13:47:16.943284+0000","last_became_peered":"2023-10-16T13:47:16.943284+0000","last_unstale":"2023-10-16T13:47:17.954041+0000","last_undegraded":"2023-10-16T13:47:17.954041+0000","last_fullsized":"2023-10-16T13:47:17.954041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:15.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.971825+0000","last_change":"2023-10-16T13:47:17.966402+0000","last_active":"2023-10-16T13:47:17.971825+0000","last_peered":"2023-10-16T13:47:17.971825+0000","last_clean":"2023-10-16T13:47:17.971825+0000","last_became_active":"2023-10-16T13:47:17.965571+0000","last_became_peered":"2023-10-16T13:47:17.965571+0000","last_unstale":"2023-10-16T13:47:17.971825+0000","last_undegraded":"2023-10-16T13:47:17.971825+0000","last_fullsized":"2023-10-16T13:47:17.971825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:16.922749+0000","last_clean_scrub_stamp":"2023-10-16T13:47:16.922749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:50:07.736721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"75'1","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-16T13:47:17.989291+0000","last_change":"2023-10-16T13:47:16.946306+0000","last_active":"2023-10-16T13:47:17.989291+0000","last_peered":"2023-10-16T13:47:17.989291+0000","last_clean":"2023-10-16T13:47:17.989291+0000","last_became_active":"2023-10-16T13:47:16.946044+0000","last_became_peered":"2023-10-16T13:47:16.946044+0000","last_unstale":"2023-10-16T13:47:17.989291+0000","last_undegraded":"2023-10-16T13:47:17.989291+0000","last_fullsized":"2023-10-16T13:47:17.989291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:15.918063+0000","last_clean_scrub_stamp":"2023-10-16T13:47:15.918063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:23:34.160267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-16T13:47:16.939077+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:47:16.939077+0000","last_peered":"2023-10-16T13:47:16.939077+0000","last_clean":"2023-10-16T13:47:16.939077+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:47:16.939077+0000","last_undegraded":"2023-10-16T13:47:16.939077+0000","last_fullsized":"2023-10-16T13:47:16.939077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":988095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.308},"max":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":0.82699999999999996},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.83099999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.76500000000000001,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.49199999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":0.83899999999999997},"last":0.433},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.57199999999999995},"min":{"1min":0.317,"5min":0.309,"15min":0.309},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.81299999999999994},"last":0.42099999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.59199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71399999999999997,"5min":0.76600000000000001,"15min":0.86399999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":0.82299999999999995,"15min":0.90600000000000003},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59399999999999997,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39500000000000002},"max":{"1min":0.77600000000000002,"5min":0.83399999999999996,"15min":0.98299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.61399999999999999},"min":{"1min":0.371,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73299999999999998,"5min":0.80600000000000005,"15min":0.82899999999999996},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":390882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.23100000000000001},"max":{"1min":0.66100000000000003,"5min":0.73699999999999999,"15min":1.0089999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.86099999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.61599999999999999},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":2.8100000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.45400000000000001,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78200000000000003,"5min":1.157,"15min":1.157},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.75,"5min":0.75,"15min":10.964},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.76800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.57199999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.98999999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.754},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.879,"15min":0.879},"last":0.42999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":1.036},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":390882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.311,"15min":0.33300000000000002},"min":{"1min":0.221,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.24399999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.52500000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.35199999999999998},"min":{"1min":0.223,"5min":0.189,"15min":0.189},"max":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":1.1619999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.752},"last":0.435}]},{"osd":3,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.41299999999999998},"min":{"1min":0.28399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.88},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.40699999999999997},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":1.4390000000000001},"last":0.496}]},{"osd":4,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.79100000000000004,"5min":0.86299999999999999,"15min":1.905},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.47399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":0.88800000000000001,"15min":1.879},"last":0.78000000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.437,"5min":0.38500000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.84399999999999997,"15min":0.89000000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.8340000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.90400000000000003,"15min":1.925},"last":0.63}]},{"osd":7,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.749,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.64000000000000001},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80100000000000005,"5min":0.873,"15min":1.085},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":987040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.31900000000000001,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.41999999999999998,"5min":0.54600000000000004,"15min":3.8260000000000001},"last":0.374},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.373},"min":{"1min":0.221,"5min":0.221,"15min":0.214},"max":{"1min":0.49099999999999999,"5min":0.58299999999999996,"15min":4.0499999999999998},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34599999999999997,"15min":0.38900000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":0.52600000000000002,"5min":0.60199999999999998,"15min":3.9169999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.37,"15min":0.39900000000000002},"min":{"1min":0.29699999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.495,"5min":0.624,"15min":3.8849999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.376},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":3.9359999999999999},"last":0.435},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.51700000000000002,"5min":0.65300000000000002,"15min":3.9940000000000002},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.83199999999999996,"15min":4.0650000000000004},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58599999999999997,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.376,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":4.0369999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.58399999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80200000000000005,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.87,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.64800000000000002},"min":{"1min":0.49399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.84599999999999997,"15min":4.2359999999999998},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.80900000000000005,"5min":0.84199999999999997,"15min":4.2119999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.86199999999999999,"15min":4.2649999999999997},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.33700000000000002},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.99199999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34000000000000002,"15min":0.36399999999999999},"min":{"1min":0.23999999999999999,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":0.55700000000000005,"15min":0.78700000000000003},"last":0.30599999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32900000000000001,"15min":0.33200000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45100000000000001,"5min":0.60599999999999998,"15min":0.67800000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.24199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51800000000000002,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38700000000000001,"15min":0.40699999999999997},"min":{"1min":0.32000000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56499999999999995,"5min":0.64300000000000002,"15min":0.88500000000000001},"last":0.5},{"interface":"front","average":{"1min":0.371,"5min":0.38200000000000001,"15min":0.41399999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":1.153},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.054},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83299999999999996,"5min":1.379,"15min":1.379},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.436,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.395,"15min":1.395},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.96599999999999997,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81499999999999995,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.875}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":390882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.317,"15min":0.48799999999999999},"min":{"1min":0.214,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":5.8890000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.35599999999999998,"15min":0.41199999999999998},"min":{"1min":0.248,"5min":0.222,"15min":0.222},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":2.181},"last":0.33900000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.51600000000000001,"5min":0.55100000000000005,"15min":0.89100000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.377,"15min":0.443},"min":{"1min":0.27700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58099999999999996,"5min":0.625,"15min":2.3519999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.27300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.94199999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.46500000000000002},"min":{"1min":0.28000000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.61199999999999999,"5min":0.65800000000000003,"15min":2.4820000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.59599999999999997},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59999999999999998,"15min":0.77600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83099999999999996,"5min":0.97099999999999997,"15min":5.7560000000000002},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.76300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83399999999999996,"5min":0.95399999999999996,"15min":5.8559999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.80300000000000005,"5min":0.96199999999999997,"15min":2.2999999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.68899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84599999999999997,"5min":0.90800000000000003,"15min":2.4039999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61299999999999999,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":2.2799999999999998},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.79800000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90700000000000003,"15min":5.8179999999999996},"last":0.623},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.432,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":2.4430000000000001},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":397657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.52000000000000002},"min":{"1min":0.314,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73599999999999999,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67500000000000004,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.76100000000000001,"5min":0.77900000000000003,"15min":0.89900000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70999999999999996,"5min":0.76800000000000002,"15min":0.85099999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77800000000000002,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":0.88},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.502},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.81200000000000006},"last":0.71299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.58899999999999997},"min":{"1min":0.39200000000000002,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.78000000000000003,"5min":0.78100000000000003,"15min":0.94199999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59799999999999998,"15min":0.63800000000000001},"min":{"1min":0.46100000000000002,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":0.872,"15min":1.0209999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.61299999999999999},"min":{"1min":0.36799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":399291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.51200000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.76100000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.745,"15min":0.745},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.622},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.34999999999999998},"max":{"1min":0.71899999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.435}]},{"osd":3,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.32600000000000001},"max":{"1min":0.77200000000000002,"5min":0.81399999999999995,"15min":0.84399999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":0.67900000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.746,"5min":0.82299999999999995,"15min":1.141},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.59399999999999997},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":0.84899999999999998,"15min":1.3700000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70199999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":0.81599999999999995,"15min":0.879},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Oct 16 13:46:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.81899999999999995,"15min":0.90700000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":0.87,"15min":0.87},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:47:22.532 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:47:22.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:47:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.695+0000 7f9bbb448700 1 Processor -- start 2023-10-16T13:47:22.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.695+0000 7f9bbb448700 1 -- start start 2023-10-16T13:47:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bbb448700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 0x7f9bb40cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bbb448700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40b6400 con 0x7f9bb40b5e20 2023-10-16T13:47:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bbb448700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb415ea30 con 0x7f9bb415a730 2023-10-16T13:47:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bbb448700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40b1fc0 con 0x7f9bb40cd5a0 2023-10-16T13:47:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bb89e3700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9bb40b5e20 0x7f9bb40cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56886/0 (socket says 172.21.15.5:56886) 2023-10-16T13:47:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bb89e3700 1 -- 172.21.15.5:0/359118576 learned_addr learned my addr 172.21.15.5:0/359118576 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037939595 0 0) 0x7f9bb40b6400 con 0x7f9bb40b5e20 2023-10-16T13:47:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 0x7f9bb40cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00035b0 con 0x7f9bb40b5e20 2023-10-16T13:47:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192898709 0 0) 0x7f9ba00035b0 con 0x7f9bb40b5e20 2023-10-16T13:47:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 msgr2=0x7f9bb40cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 0x7f9bb40cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 >> v1:172.21.15.112:6789/0 conn(0x7f9bb415a730 legacy=0x7f9bb415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40ce450 con 0x7f9bb40b5e20 2023-10-16T13:47:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f9ba4001670 con 0x7f9bb40b5e20 2023-10-16T13:47:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 >> v1:172.21.15.5:6789/0 conn(0x7f9bb40b5e20 legacy=0x7f9bb40cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 0x7f9ba0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.696+0000 7f9babfff700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0003fb0 0x7f9ba0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40b1fc0 con 0x7f9ba0004d90 2023-10-16T13:47:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000baf0 con 0x7f9ba0003fb0 2023-10-16T13:47:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000bcb0 con 0x7f9bb40cd5a0 2023-10-16T13:47:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb89e3700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0003fb0 0x7f9ba0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb91e4700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 0x7f9ba0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 -- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 msgr2=0x7f9ba0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb40cd5a0 0x7f9ba0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 -- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0003fb0 msgr2=0x7f9ba0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0003fb0 0x7f9ba0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 -- 172.21.15.5:0/359118576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00035b0 con 0x7f9ba0004d90 2023-10-16T13:47:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009fc0 tx=0x7f9ba0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadb030275dbe2ab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ec30 con 0x7f9ba0004d90 2023-10-16T13:47:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f040 con 0x7f9ba0004d90 2023-10-16T13:47:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.697+0000 7f9babfff700 1 -- 172.21.15.5:0/359118576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac014480 con 0x7f9ba0004d90 2023-10-16T13:47:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bbb448700 1 -- 172.21.15.5:0/359118576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0004d90 msgr2=0x7f9ba0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bbb448700 1 --2- 172.21.15.5:0/359118576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0004d90 0x7f9ba0005210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009fc0 tx=0x7f9ba0005880 comp rx=0 tx=0).stop 2023-10-16T13:47:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bb99e5700 1 -- 172.21.15.5:0/359118576 reap_dead start 2023-10-16T13:47:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bbb448700 1 -- 172.21.15.5:0/359118576 shutdown_connections 2023-10-16T13:47:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bbb448700 1 -- 172.21.15.5:0/359118576 >> 172.21.15.5:0/359118576 conn(0x7f9bb406dac0 msgr2=0x7f9bb406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bbb448700 1 -- 172.21.15.5:0/359118576 shutdown_connections 2023-10-16T13:47:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.698+0000 7f9bbb448700 1 -- 172.21.15.5:0/359118576 wait complete. 2023-10-16T13:47:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.700+0000 7f9bbb448700 1 Processor -- start 2023-10-16T13:47:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.700+0000 7f9bbb448700 1 -- start start 2023-10-16T13:47:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0004d90 0x7f9bb41f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb4146fd0 0x7f9bb4149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 0x7f9bb4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415b730 con 0x7f9bb4147450 2023-10-16T13:47:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41f40c0 con 0x7f9ba0004d90 2023-10-16T13:47:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb414a550 con 0x7f9bb4146fd0 2023-10-16T13:47:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 0x7f9bb4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 0x7f9bb4149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46896/0 (socket says 172.21.15.5:46896) 2023-10-16T13:47:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 -- 172.21.15.5:0/1650659671 learned_addr learned my addr 172.21.15.5:0/1650659671 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb89e3700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb4146fd0 0x7f9bb4149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb91e4700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0004d90 0x7f9bb41f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 -- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb4146fd0 msgr2=0x7f9bb4149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb4146fd0 0x7f9bb4149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 -- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0004d90 msgr2=0x7f9bb41f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0004d90 0x7f9bb41f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:22.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 -- 172.21.15.5:0/1650659671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb414a830 con 0x7f9bb4147450 2023-10-16T13:47:22.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bb99e5700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 0x7f9bb4149f40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9bac016000 tx=0x7f9bac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:22.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac007000 con 0x7f9bb4147450 2023-10-16T13:47:22.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac022070 con 0x7f9bb4147450 2023-10-16T13:47:22.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb41f4380 con 0x7f9bb4147450 2023-10-16T13:47:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.701+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac015e70 con 0x7f9bb4147450 2023-10-16T13:47:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.702+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb40c61f0 con 0x7f9bb4147450 2023-10-16T13:47:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.703+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb41f48a0 con 0x7f9bb4147450 2023-10-16T13:47:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.703+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f9bac01e430 con 0x7f9bb4147450 2023-10-16T13:47:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.703+0000 7f9ba9ffb700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b9806b140 0x7f9b9806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.703+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bac024070 con 0x7f9bb4147450 2023-10-16T13:47:22.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.704+0000 7f9bb91e4700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b9806b140 0x7f9b9806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:22.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.704+0000 7f9bb91e4700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b9806b140 0x7f9b9806d600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:22.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.708+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bb41f48a0 con 0x7f9bb4147450 2023-10-16T13:47:22.919 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-10-16T13:47:22.917+0000 7fb195a06700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:47:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.992+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9bb41f48a0 con 0x7f9bb4147450 2023-10-16T13:47:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.994+0000 7f9ba9ffb700 1 -- 172.21.15.5:0/1650659671 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9bb41f48a0 con 0x7f9bb4147450 2023-10-16T13:47:22.997 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:47:22.997 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:47:22.997 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:47:22.998 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:47:22.998 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:47:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b9806b140 msgr2=0x7f9b9806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b9806b140 0x7f9b9806d600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0009040 comp rx=0 tx=0).stop 2023-10-16T13:47:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 msgr2=0x7f9bb4149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 0x7f9bb4149f40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9bac016000 tx=0x7f9bac009750 comp rx=0 tx=0).stop 2023-10-16T13:47:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 shutdown_connections 2023-10-16T13:47:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb4147450 0x7f9bb4149f40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ba0004d90 0x7f9bb41f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b9806b140 0x7f9b9806d600 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 --2- 172.21.15.5:0/1650659671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bb4146fd0 0x7f9bb4149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 >> 172.21.15.5:0/1650659671 conn(0x7f9bb406dac0 msgr2=0x7f9bb40cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 shutdown_connections 2023-10-16T13:47:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:22.996+0000 7f9bbb448700 1 -- 172.21.15.5:0/1650659671 wait complete. 2023-10-16T13:47:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:47:23.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.134+0000 7fa0adb38700 1 Processor -- start 2023-10-16T13:47:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.134+0000 7fa0adb38700 1 -- start start 2023-10-16T13:47:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0adb38700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0a815e2f0 0x7fa0a80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0adb38700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a80b2d60 con 0x7fa0a806a840 2023-10-16T13:47:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0adb38700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a80cdd30 con 0x7fa0a80cd950 2023-10-16T13:47:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0adb38700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a81619a0 con 0x7fa0a815e2f0 2023-10-16T13:47:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0a815e2f0 0x7fa0a80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0a806a840 0x7fa0a806ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56908/0 (socket says 172.21.15.5:56908) 2023-10-16T13:47:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0a815e2f0 0x7fa0a80cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46902/0 (socket says 172.21.15.5:46902) 2023-10-16T13:47:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a7fff700 1 -- 172.21.15.5:0/2343503149 learned_addr learned my addr 172.21.15.5:0/2343503149 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/2343503149 >> v1:172.21.15.112:6789/0 conn(0x7fa0a80cd950 legacy=0x7fa0a815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/2343503149 >> v1:172.21.15.5:6789/0 conn(0x7fa0a806a840 legacy=0x7fa0a806ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/2343503149 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a815e920 con 0x7fa0a815e2f0 2023-10-16T13:47:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a67fc700 1 -- 172.21.15.5:0/2343503149 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775369462 0 0) 0x7fa0a80b2d60 con 0x7fa0a806a840 2023-10-16T13:47:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.135+0000 7fa0a6ffd700 1 --2- 172.21.15.5:0/2343503149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a815e2f0 0x7fa0a80cede0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa090009820 tx=0x7fa090009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3418226ce898733e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0a67fc700 1 -- 172.21.15.5:0/2343503149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090005e30 con 0x7fa0a815e2f0 2023-10-16T13:47:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0a67fc700 1 -- 172.21.15.5:0/2343503149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090006030 con 0x7fa0a815e2f0 2023-10-16T13:47:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0a67fc700 1 -- 172.21.15.5:0/2343503149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900063e0 con 0x7fa0a815e2f0 2023-10-16T13:47:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 -- 172.21.15.5:0/2343503149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a815e2f0 msgr2=0x7fa0a80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 --2- 172.21.15.5:0/2343503149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a815e2f0 0x7fa0a80cede0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa090009820 tx=0x7fa090009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 -- 172.21.15.5:0/2343503149 shutdown_connections 2023-10-16T13:47:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 --2- 172.21.15.5:0/2343503149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a815e2f0 0x7fa0a80cede0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 -- 172.21.15.5:0/2343503149 >> 172.21.15.5:0/2343503149 conn(0x7fa0a806dae0 msgr2=0x7fa0a806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 -- 172.21.15.5:0/2343503149 shutdown_connections 2023-10-16T13:47:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.136+0000 7fa0adb38700 1 -- 172.21.15.5:0/2343503149 wait complete. 2023-10-16T13:47:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.137+0000 7fa0adb38700 1 Processor -- start 2023-10-16T13:47:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 -- start start 2023-10-16T13:47:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0a806a840 0x7fa0a81f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 0x7fa0a80c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a815e2f0 0x7fa0a8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80b31b0 con 0x7fa0a80cd950 2023-10-16T13:47:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80b3450 con 0x7fa0a815e2f0 2023-10-16T13:47:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0adb38700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80b3730 con 0x7fa0a806a840 2023-10-16T13:47:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 0x7fa0a80c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 0x7fa0a80c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46908/0 (socket says 172.21.15.5:46908) 2023-10-16T13:47:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.138+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/1451661810 learned_addr learned my addr 172.21.15.5:0/1451661810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a7fff700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a815e2f0 0x7fa0a8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a77fe700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0a806a840 0x7fa0a81f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0a806a840 msgr2=0x7fa0a81f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a6ffd700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0a806a840 0x7fa0a81f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a815e2f0 msgr2=0x7fa0a8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a6ffd700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a815e2f0 0x7fa0a8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a6ffd700 1 -- 172.21.15.5:0/1451661810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090009430 con 0x7fa0a80cd950 2023-10-16T13:47:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a7fff700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a815e2f0 0x7fa0a8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a77fe700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0a806a840 0x7fa0a81f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0a6ffd700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 0x7fa0a80c6440 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa090000c00 tx=0x7fa090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090004240 con 0x7fa0a80cd950 2023-10-16T13:47:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900043c0 con 0x7fa0a80cd950 2023-10-16T13:47:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900036a0 con 0x7fa0a80cd950 2023-10-16T13:47:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a80b3a10 con 0x7fa0a80cd950 2023-10-16T13:47:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.139+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a81f7ea0 con 0x7fa0a80cd950 2023-10-16T13:47:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.140+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a81f8030 con 0x7fa0a80cd950 2023-10-16T13:47:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.141+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fa090022070 con 0x7fa0a80cd950 2023-10-16T13:47:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.141+0000 7fa09ffff700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa08806b140 0x7fa08806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.141+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa09008b3c0 con 0x7fa0a80cd950 2023-10-16T13:47:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.141+0000 7fa0a77fe700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa08806b140 0x7fa08806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.142+0000 7fa0a77fe700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa08806b140 0x7fa08806d600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa098000f60 tx=0x7fa098009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.146+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0900561a0 con 0x7fa0a80cd950 2023-10-16T13:47:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.391+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0a80b3f30 con 0x7fa0a80cd950 2023-10-16T13:47:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.392+0000 7fa09ffff700 1 -- 172.21.15.5:0/1451661810 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fa0a80b3f30 con 0x7fa0a80cd950 2023-10-16T13:47:23.395 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:23.395 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:17.350421+0000","modified":"2023-10-16T13:47:20.404057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1286413980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1286413980},{"type":"v1","addr":"172.21.15.5:6834","nonce":1286413980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-16T13:47:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa08806b140 msgr2=0x7fa08806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa08806b140 0x7fa08806d600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa098000f60 tx=0x7fa098009040 comp rx=0 tx=0).stop 2023-10-16T13:47:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 msgr2=0x7fa0a80c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 0x7fa0a80c6440 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa090000c00 tx=0x7fa090004750 comp rx=0 tx=0).stop 2023-10-16T13:47:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 shutdown_connections 2023-10-16T13:47:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a815e2f0 0x7fa0a8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa08806b140 0x7fa08806d600 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0a806a840 0x7fa0a81f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 --2- 172.21.15.5:0/1451661810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0a80cd950 0x7fa0a80c6440 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 >> 172.21.15.5:0/1451661810 conn(0x7fa0a806dae0 msgr2=0x7fa0a806ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 shutdown_connections 2023-10-16T13:47:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.394+0000 7fa0adb38700 1 -- 172.21.15.5:0/1451661810 wait complete. 2023-10-16T13:47:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 50 2023-10-16T13:47:23.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:47:17.350421+0000', 'modified': '2023-10-16T13:47:20.404057+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6507}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6507': {'gid': 6507, 'name': 'c', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/1286413980', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1286413980}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 1286413980}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:47:23.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:47:23.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-16T13:47:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.938+0000 7f2c437cf700 1 Processor -- start 2023-10-16T13:47:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.938+0000 7f2c437cf700 1 -- start start 2023-10-16T13:47:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c437cf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 0x7f2c3c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c437cf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c3c0cd4b0 0x7f2c3c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c437cf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c0ce3b0 con 0x7f2c3c0b2940 2023-10-16T13:47:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c437cf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c0b2dc0 con 0x7f2c3c0cd4b0 2023-10-16T13:47:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c437cf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0b6290 con 0x7f2c3c15a850 2023-10-16T13:47:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c40d6a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2c3c0b2940 0x7f2c3c0ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56918/0 (socket says 172.21.15.5:56918) 2023-10-16T13:47:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c40d6a700 1 -- 172.21.15.5:0/1199287972 learned_addr learned my addr 172.21.15.5:0/1199287972 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682996226 0 0) 0x7f2c3c0ce3b0 con 0x7f2c3c0b2940 2023-10-16T13:47:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c4156b700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 0x7f2c3c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/1199287972 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c0cd4b0 0x7f2c3c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.939+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c280035b0 con 0x7f2c3c0b2940 2023-10-16T13:47:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1398040476 0 0) 0x7f2c280035b0 con 0x7f2c3c0b2940 2023-10-16T13:47:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 msgr2=0x7f2c3c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 0x7f2c3c0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c0cd4b0 msgr2=0x7f2c3c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 --2- 172.21.15.5:0/1199287972 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c0cd4b0 0x7f2c3c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0cc220 con 0x7f2c3c0b2940 2023-10-16T13:47:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f2c38001670 con 0x7f2c3c0b2940 2023-10-16T13:47:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 >> v1:172.21.15.5:6789/0 conn(0x7f2c3c0b2940 legacy=0x7f2c3c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 0x7f2c28003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c28003f80 0x7f2c28004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c28004d90 0x7f2c28005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0b2dc0 con 0x7f2c28004d90 2023-10-16T13:47:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0b6290 con 0x7f2c28003f80 2023-10-16T13:47:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2800ba10 con 0x7f2c3c15a850 2023-10-16T13:47:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c28004d90 0x7f2c28005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c28003f80 0x7f2c28004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c4156b700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 0x7f2c28003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 -- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 msgr2=0x7f2c28003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c15a850 0x7f2c28003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 -- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c28003f80 msgr2=0x7f2c28004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c28003f80 0x7f2c28004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 -- 172.21.15.5:0/1199287972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280035b0 con 0x7f2c28004d90 2023-10-16T13:47:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c28004d90 0x7f2c28005210 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009fc0 tx=0x7f2c28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c177cfa43be64858 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400ebd0 con 0x7f2c28004d90 2023-10-16T13:47:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400f040 con 0x7f2c28004d90 2023-10-16T13:47:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.940+0000 7f2c33fff700 1 -- 172.21.15.5:0/1199287972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34012430 con 0x7f2c28004d90 2023-10-16T13:47:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c437cf700 1 -- 172.21.15.5:0/1199287972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c28004d90 msgr2=0x7f2c28005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c437cf700 1 --2- 172.21.15.5:0/1199287972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c28004d90 0x7f2c28005210 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009fc0 tx=0x7f2c28005880 comp rx=0 tx=0).stop 2023-10-16T13:47:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c41d6c700 1 -- 172.21.15.5:0/1199287972 reap_dead start 2023-10-16T13:47:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c437cf700 1 -- 172.21.15.5:0/1199287972 shutdown_connections 2023-10-16T13:47:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c437cf700 1 -- 172.21.15.5:0/1199287972 >> 172.21.15.5:0/1199287972 conn(0x7f2c3c06dac0 msgr2=0x7f2c3c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c437cf700 1 -- 172.21.15.5:0/1199287972 shutdown_connections 2023-10-16T13:47:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.941+0000 7f2c437cf700 1 -- 172.21.15.5:0/1199287972 wait complete. 2023-10-16T13:47:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.942+0000 7f2c437cf700 1 Processor -- start 2023-10-16T13:47:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.942+0000 7f2c437cf700 1 -- start start 2023-10-16T13:47:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c437cf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0b4300 0x7f2c3c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c437cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c0b46e0 0x7f2c3c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c437cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 0x7f2c3c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c437cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c155f30 con 0x7f2c3c155570 2023-10-16T13:47:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c437cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c15bf70 con 0x7f2c3c0b46e0 2023-10-16T13:47:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c437cf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c15c250 con 0x7f2c3c0b4300 2023-10-16T13:47:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 0x7f2c3c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 0x7f2c3c1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46926/0 (socket says 172.21.15.5:46926) 2023-10-16T13:47:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 -- 172.21.15.5:0/4100004736 learned_addr learned my addr 172.21.15.5:0/4100004736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c0b46e0 0x7f2c3c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c4156b700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0b4300 0x7f2c3c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 -- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0b4300 msgr2=0x7f2c3c0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0b4300 0x7f2c3c0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 -- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c0b46e0 msgr2=0x7f2c3c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c0b46e0 0x7f2c3c0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.943+0000 7f2c41d6c700 1 -- 172.21.15.5:0/4100004736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c15c530 con 0x7f2c3c155570 2023-10-16T13:47:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.944+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 0x7f2c3c1559f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2c280046f0 tx=0x7f2c34009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.944+0000 7f2c31ffb700 1 -- 172.21.15.5:0/4100004736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34007000 con 0x7f2c3c155570 2023-10-16T13:47:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.944+0000 7f2c31ffb700 1 -- 172.21.15.5:0/4100004736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34003c30 con 0x7f2c3c155570 2023-10-16T13:47:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.944+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c15c810 con 0x7f2c3c155570 2023-10-16T13:47:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.944+0000 7f2c31ffb700 1 -- 172.21.15.5:0/4100004736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34003de0 con 0x7f2c3c155570 2023-10-16T13:47:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.944+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0b5290 con 0x7f2c3c155570 2023-10-16T13:47:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.945+0000 7f2c31ffb700 1 -- 172.21.15.5:0/4100004736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f2c340128c0 con 0x7f2c3c155570 2023-10-16T13:47:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.946+0000 7f2c31ffb700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c2006b170 0x7f2c2006d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.946+0000 7f2c31ffb700 1 -- 172.21.15.5:0/4100004736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c34016070 con 0x7f2c3c155570 2023-10-16T13:47:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.946+0000 7f2c4156b700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c2006b170 0x7f2c2006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.947+0000 7f2c4156b700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c2006b170 0x7f2c2006d630 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009ba0 tx=0x7f2c2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 Processor -- start 2023-10-16T13:47:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 -- start start 2023-10-16T13:47:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea25fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05e96fc20 con 0x55b05e9f9010 2023-10-16T13:47:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05e954c10 con 0x55b05ea23630 2023-10-16T13:47:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.948+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b05e952530 con 0x55b05ea1e220 2023-10-16T13:47:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46936/0 (socket says 172.21.15.5:46936) 2023-10-16T13:47:23.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 -- 172.21.15.5:0/3586021220 learned_addr learned my addr 172.21.15.5:0/3586021220 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:23.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea25fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c4156b700 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 -- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 msgr2=0x55b05ea25a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea25a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 -- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 msgr2=0x55b05ea25fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea25fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 -- 172.21.15.5:0/3586021220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b05e90b3a0 con 0x55b05e9f9010 2023-10-16T13:47:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f96c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2c34002230 tx=0x7f2c3405ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be27a90d42fb96a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c26ffd700 1 -- 172.21.15.5:0/3586021220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340633b0 con 0x55b05e9f9010 2023-10-16T13:47:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c26ffd700 1 -- 172.21.15.5:0/3586021220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34009b10 con 0x55b05e9f9010 2023-10-16T13:47:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.949+0000 7f2c26ffd700 1 -- 172.21.15.5:0/3586021220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3405b310 con 0x55b05e9f9010 2023-10-16T13:47:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/3586021220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 msgr2=0x55b05e9f96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f96c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2c34002230 tx=0x7f2c3405ab40 comp rx=0 tx=0).stop 2023-10-16T13:47:23.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/3586021220 shutdown_connections 2023-10-16T13:47:23.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f96c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea25a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/3586021220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea25fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/3586021220 >> 172.21.15.5:0/3586021220 conn(0x55b05e928d80 msgr2=0x55b05ea43ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/3586021220 shutdown_connections 2023-10-16T13:47:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/3586021220 wait complete. 2023-10-16T13:47:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.950+0000 7f2c4f9b9b80 1 -- start start 2023-10-16T13:47:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.951+0000 7f2c4f9b9b80 1 Processor -- start 2023-10-16T13:47:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05ea1baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea42f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05e94de20 con 0x55b05e9f9010 2023-10-16T13:47:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05e8ea6c0 con 0x55b05ea23630 2023-10-16T13:47:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b05e8ea360 con 0x55b05ea1e220 2023-10-16T13:47:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05ea1baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4f9b9b80 10 client.0 _ll_register_callbacks cb 0x55b05e7477b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:47:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05ea1baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46938/0 (socket says 172.21.15.5:46938) 2023-10-16T13:47:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 -- 172.21.15.5:0/101122604 learned_addr learned my addr 172.21.15.5:0/101122604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea42f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 -- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 msgr2=0x55b05ea407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 -- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 msgr2=0x55b05ea42f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea42f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c4156b700 1 -- 172.21.15.5:0/101122604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0b5290 con 0x55b05e9f9010 2023-10-16T13:47:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.952+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea42f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4156b700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05ea1baa0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0169e0 tx=0x7f2c2c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f0780d7cf252ed server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:47:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c1bfff700 1 -- 172.21.15.5:0/101122604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c016e50 con 0x55b05e9f9010 2023-10-16T13:47:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c1bfff700 1 -- 172.21.15.5:0/101122604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c2c0239e0 con 0x55b05e9f9010 2023-10-16T13:47:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b05e9ee5b0 con 0x55b05e9f9010 2023-10-16T13:47:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c1bfff700 1 -- 172.21.15.5:0/101122604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c2c023be0 con 0x55b05e9f9010 2023-10-16T13:47:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 10 client.6639 fetch_fsmap learned FSMap version 50 2023-10-16T13:47:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55b05e778d90 con 0x55b05e9f9010 2023-10-16T13:47:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c1bfff700 1 -- 172.21.15.5:0/101122604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b05e9ee5b0 con 0x55b05e9f9010 2023-10-16T13:47:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c1bfff700 1 -- 172.21.15.5:0/101122604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c2c023d40 con 0x55b05e9f9010 2023-10-16T13:47:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 10 client.6639 fetch_fsmap finished waiting for FSMap version 50 2023-10-16T13:47:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 10 client.6639 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T13:47:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 20 client.6639 populate_metadata read hostname 'smithi005' 2023-10-16T13:47:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea21bb0 0x55b05ea532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 4 client.6639 mds_command: new command op to 6507 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:47:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 --> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b05e946e00 con 0x55b05ea21bb0 2023-10-16T13:47:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.953+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea21bb0 0x55b05ea532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.954+0000 7f2c1bfff700 10 client.6639 ms_handle_connect on v2:172.21.15.5:6832/1286413980 2023-10-16T13:47:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.954+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea21bb0 0x55b05ea532a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74c388834f628087 server_cookie=b0a8b47a65219d4f in_seq=0 out_seq=0 2023-10-16T13:47:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.954+0000 7f2c1bfff700 1 -- 172.21.15.5:0/101122604 <== mds.0 v2:172.21.15.5:6832/1286413980 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b05e946e00 con 0x55b05ea21bb0 2023-10-16T13:47:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c1bfff700 10 client.6639 handle_command_reply: tid=0 2023-10-16T13:47:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 client.6639 shutdown 2023-10-16T13:47:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 msgr2=0x55b05ea1baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05ea1baa0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0169e0 tx=0x7f2c2c0047c0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 shutdown_connections 2023-10-16T13:47:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea21bb0 0x55b05ea532a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea42f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05ea1baa0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/101122604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c1bfff700 0 client.6639 ms_handle_reset on v2:172.21.15.5:6832/1286413980 2023-10-16T13:47:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 >> 172.21.15.5:0/101122604 conn(0x55b05e928d80 msgr2=0x55b05ea3a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 shutdown_connections 2023-10-16T13:47:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/101122604 wait complete. 2023-10-16T13:47:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.955+0000 7f2c4f9b9b80 20 client.6639 trim_cache size 0 max 16384 2023-10-16T13:47:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.973+0000 7f2c4f9b9b80 1 Processor -- start 2023-10-16T13:47:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.973+0000 7f2c4f9b9b80 1 -- start start 2023-10-16T13:47:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea1fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea1c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05e7ce8d0 con 0x55b05e9f9010 2023-10-16T13:47:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05e9f6c80 con 0x55b05ea23630 2023-10-16T13:47:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b05e9f0d80 con 0x55b05ea1e220 2023-10-16T13:47:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46946/0 (socket says 172.21.15.5:46946) 2023-10-16T13:47:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 -- 172.21.15.5:0/2048165904 learned_addr learned my addr 172.21.15.5:0/2048165904 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 -- 172.21.15.5:0/2048165904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 msgr2=0x55b05ea1fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea1fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 -- 172.21.15.5:0/2048165904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 msgr2=0x55b05ea1c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea1c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 -- 172.21.15.5:0/2048165904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b05e9efaf0 con 0x55b05e9f9010 2023-10-16T13:47:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.974+0000 7f2c4156b700 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f0840 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c023700 tx=0x7f2c2c026070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb606b3100bce326 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c277fe700 1 -- 172.21.15.5:0/2048165904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0239e0 con 0x55b05e9f9010 2023-10-16T13:47:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c277fe700 1 -- 172.21.15.5:0/2048165904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c023b40 con 0x55b05e9f9010 2023-10-16T13:47:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c277fe700 1 -- 172.21.15.5:0/2048165904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c004020 con 0x55b05e9f9010 2023-10-16T13:47:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2048165904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 msgr2=0x55b05e9f0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f0840 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c023700 tx=0x7f2c2c026070 comp rx=0 tx=0).stop 2023-10-16T13:47:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2048165904 shutdown_connections 2023-10-16T13:47:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea23630 0x55b05ea1c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05e9f9010 0x55b05e9f0840 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2048165904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05ea1e220 0x55b05ea1fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2048165904 >> 172.21.15.5:0/2048165904 conn(0x55b05e928d80 msgr2=0x55b05ea43f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2048165904 shutdown_connections 2023-10-16T13:47:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.975+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2048165904 wait complete. 2023-10-16T13:47:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.976+0000 7f2c4f9b9b80 1 -- start start 2023-10-16T13:47:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.976+0000 7f2c4f9b9b80 1 Processor -- start 2023-10-16T13:47:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05e9f9010 0x55b05ea5a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea1e220 0x55b05ea5a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 0x55b05ea21f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05ea1e810 con 0x55b05ea23630 2023-10-16T13:47:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05eaa9590 con 0x55b05ea1e220 2023-10-16T13:47:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b05ea1e980 con 0x55b05e9f9010 2023-10-16T13:47:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c4f9b9b80 10 client.0 _ll_register_callbacks cb 0x7f2c2c014f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:47:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.977+0000 7f2c41d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 0x55b05ea21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 0x55b05ea21f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46956/0 (socket says 172.21.15.5:46956) 2023-10-16T13:47:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 -- 172.21.15.5:0/2673076562 learned_addr learned my addr 172.21.15.5:0/2673076562 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c4156b700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05e9f9010 0x55b05ea5a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c40d6a700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea1e220 0x55b05ea5a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 -- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05e9f9010 msgr2=0x55b05ea5a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05e9f9010 0x55b05ea5a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 -- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea1e220 msgr2=0x55b05ea5a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea1e220 0x55b05ea5a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 -- 172.21.15.5:0/2673076562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b05e778d90 con 0x55b05ea23630 2023-10-16T13:47:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c41d6c700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 0x55b05ea21f90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2c3405b040 tx=0x7f2c34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f00d885e50c90c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:47:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c1bfff700 1 -- 172.21.15.5:0/2673076562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34089070 con 0x55b05ea23630 2023-10-16T13:47:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c1bfff700 1 -- 172.21.15.5:0/2673076562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c340633b0 con 0x55b05ea23630 2023-10-16T13:47:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c34009b10 con 0x55b05ea23630 2023-10-16T13:47:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c1bfff700 1 -- 172.21.15.5:0/2673076562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c340573f0 con 0x55b05ea23630 2023-10-16T13:47:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c4f9b9b80 10 client.6645 fetch_fsmap learned FSMap version 50 2023-10-16T13:47:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55b05e761c10 con 0x55b05ea23630 2023-10-16T13:47:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.978+0000 7f2c1bfff700 1 -- 172.21.15.5:0/2673076562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34009b10 con 0x55b05ea23630 2023-10-16T13:47:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c1bfff700 1 -- 172.21.15.5:0/2673076562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c3405b310 con 0x55b05ea23630 2023-10-16T13:47:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 10 client.6645 fetch_fsmap finished waiting for FSMap version 50 2023-10-16T13:47:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 10 client.6645 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T13:47:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 20 client.6645 populate_metadata read hostname 'smithi005' 2023-10-16T13:47:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea224d0 0x55b05ea228b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 4 client.6645 mds_command: new command op to 6507 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:47:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 --> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b05e946b20 con 0x55b05ea224d0 2023-10-16T13:47:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4156b700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea224d0 0x55b05ea228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c1bfff700 10 client.6645 ms_handle_connect on v2:172.21.15.5:6832/1286413980 2023-10-16T13:47:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4156b700 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea224d0 0x55b05ea228b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef1b93343a65bc9 server_cookie=d42f84542676a66b in_seq=0 out_seq=0 2023-10-16T13:47:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c1bfff700 1 -- 172.21.15.5:0/2673076562 <== mds.0 v2:172.21.15.5:6832/1286413980 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b05e946b20 con 0x55b05ea224d0 2023-10-16T13:47:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c1bfff700 10 client.6645 handle_command_reply: tid=0 2023-10-16T13:47:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 client.6645 shutdown 2023-10-16T13:47:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 msgr2=0x55b05ea21f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 0x55b05ea21f90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2c3405b040 tx=0x7f2c34016000 comp rx=0 tx=0).stop 2023-10-16T13:47:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 shutdown_connections 2023-10-16T13:47:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:6832/1286413980,v1:172.21.15.5:6834/1286413980] conn(0x55b05ea224d0 0x55b05ea228b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b05ea23630 0x55b05ea21f90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55b05e9f9010 0x55b05ea5a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c1bfff700 0 client.6645 ms_handle_reset on v2:172.21.15.5:6832/1286413980 2023-10-16T13:47:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 --2- 172.21.15.5:0/2673076562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b05ea1e220 0x55b05ea5a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.979+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 >> 172.21.15.5:0/2673076562 conn(0x55b05e928d80 msgr2=0x55b05ea1fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 shutdown_connections 2023-10-16T13:47:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c4f9b9b80 1 -- 172.21.15.5:0/2673076562 wait complete. 2023-10-16T13:47:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c4f9b9b80 20 client.6645 trim_cache size 0 max 16384 2023-10-16T13:47:24.005 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:47:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:47:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:47:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6507, 2023-10-16T13:47:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:47:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:47:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:47:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.0090115749999997, 2023-10-16T13:47:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 50, 2023-10-16T13:47:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 76, 2023-10-16T13:47:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2023-10-16T13:47:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 11.947875013999999 2023-10-16T13:47:24.008 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:47:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c2006b170 msgr2=0x7f2c2006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c2006b170 0x7f2c2006d630 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009ba0 tx=0x7f2c2c008040 comp rx=0 tx=0).stop 2023-10-16T13:47:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 msgr2=0x7f2c3c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 0x7f2c3c1559f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2c280046f0 tx=0x7f2c34009750 comp rx=0 tx=0).stop 2023-10-16T13:47:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 shutdown_connections 2023-10-16T13:47:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c155570 0x7f2c3c1559f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2c2006b170 0x7f2c2006d630 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0b4300 0x7f2c3c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 --2- 172.21.15.5:0/4100004736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c0b46e0 0x7f2c3c0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 >> 172.21.15.5:0/4100004736 conn(0x7f2c3c06dac0 msgr2=0x7f2c3c0ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:24.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 shutdown_connections 2023-10-16T13:47:24.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:23.980+0000 7f2c437cf700 1 -- 172.21.15.5:0/4100004736 wait complete. 2023-10-16T13:47:24.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:47:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.134+0000 7fc190f29700 1 Processor -- start 2023-10-16T13:47:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.134+0000 7fc190f29700 1 -- start start 2023-10-16T13:47:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc190f29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc18c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc190f29700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0b3530 con 0x7fc18c06af50 2023-10-16T13:47:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc190f29700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0cd180 con 0x7fc18c15f130 2023-10-16T13:47:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc190f29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0cde00 con 0x7fc18c0b28b0 2023-10-16T13:47:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc189d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc18c06af50 0x7fc18c0b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56966/0 (socket says 172.21.15.5:56966) 2023-10-16T13:47:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc189d9b700 1 -- 172.21.15.5:0/2414566739 learned_addr learned my addr 172.21.15.5:0/2414566739 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc18ad9d700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc18c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405487747 0 0) 0x7fc18c0b3530 con 0x7fc18c06af50 2023-10-16T13:47:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.135+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1740035b0 con 0x7fc18c06af50 2023-10-16T13:47:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311332925 0 0) 0x7fc1740035b0 con 0x7fc18c06af50 2023-10-16T13:47:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 msgr2=0x7fc18c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc18c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 >> v1:172.21.15.112:6789/0 conn(0x7fc18c15f130 legacy=0x7fc18c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0cd460 con 0x7fc18c06af50 2023-10-16T13:47:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fc17c0017f0 con 0x7fc18c06af50 2023-10-16T13:47:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 >> v1:172.21.15.5:6789/0 conn(0x7fc18c06af50 legacy=0x7fc18c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174003a30 0x7fc174003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740043e0 0x7fc1740048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc174005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0cde00 con 0x7fc174003a30 2023-10-16T13:47:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17400ba10 con 0x7fc1740043e0 2023-10-16T13:47:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17400bbd0 con 0x7fc18c0b28b0 2023-10-16T13:47:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174003a30 0x7fc174003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc189d9b700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740043e0 0x7fc1740048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18ad9d700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc174005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 -- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 msgr2=0x7fc174005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc174005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 -- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740043e0 msgr2=0x7fc1740048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1740043e0 0x7fc1740048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 -- 172.21.15.5:0/2414566739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740035b0 con 0x7fc174003a30 2023-10-16T13:47:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18ad9d700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc18c0b28b0 0x7fc174005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.136+0000 7fc18a59c700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174003a30 0x7fc174003e10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc1800018d0 tx=0x7fc174005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2108895ceeab0e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000c690 con 0x7fc174003a30 2023-10-16T13:47:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000c810 con 0x7fc174003a30 2023-10-16T13:47:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc18959a700 1 -- 172.21.15.5:0/2414566739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000cbc0 con 0x7fc174003a30 2023-10-16T13:47:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc190f29700 1 -- 172.21.15.5:0/2414566739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174003a30 msgr2=0x7fc174003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc190f29700 1 --2- 172.21.15.5:0/2414566739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174003a30 0x7fc174003e10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc1800018d0 tx=0x7fc174005880 comp rx=0 tx=0).stop 2023-10-16T13:47:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc18ad9d700 1 -- 172.21.15.5:0/2414566739 reap_dead start 2023-10-16T13:47:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc190f29700 1 -- 172.21.15.5:0/2414566739 shutdown_connections 2023-10-16T13:47:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc190f29700 1 -- 172.21.15.5:0/2414566739 >> 172.21.15.5:0/2414566739 conn(0x7fc18c06dae0 msgr2=0x7fc18c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:24.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc190f29700 1 -- 172.21.15.5:0/2414566739 shutdown_connections 2023-10-16T13:47:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.137+0000 7fc190f29700 1 -- 172.21.15.5:0/2414566739 wait complete. 2023-10-16T13:47:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 Processor -- start 2023-10-16T13:47:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 -- start start 2023-10-16T13:47:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc174003a30 0x7fc18c0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 0x7fc18c144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c144a70 0x7fc18c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c157f80 con 0x7fc18c14a5d0 2023-10-16T13:47:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c14aa50 con 0x7fc18c144a70 2023-10-16T13:47:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.139+0000 7fc190f29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c154d00 con 0x7fc174003a30 2023-10-16T13:47:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 0x7fc18c144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 0x7fc18c144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46974/0 (socket says 172.21.15.5:46974) 2023-10-16T13:47:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 -- 172.21.15.5:0/1109582759 learned_addr learned my addr 172.21.15.5:0/1109582759 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc18a59c700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc174003a30 0x7fc18c0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc18ad9d700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c144a70 0x7fc18c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 -- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc174003a30 msgr2=0x7fc18c0c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc174003a30 0x7fc18c0c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 -- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c144a70 msgr2=0x7fc18c146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c144a70 0x7fc18c146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 -- 172.21.15.5:0/1109582759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c154fe0 con 0x7fc18c14a5d0 2023-10-16T13:47:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc189d9b700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 0x7fc18c144530 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00f8b0 tx=0x7fc17c00fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0072e0 con 0x7fc18c14a5d0 2023-10-16T13:47:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c007440 con 0x7fc18c14a5d0 2023-10-16T13:47:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c005830 con 0x7fc18c14a5d0 2023-10-16T13:47:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c0c90a0 con 0x7fc18c14a5d0 2023-10-16T13:47:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.140+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c146ad0 con 0x7fc18c14a5d0 2023-10-16T13:47:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.141+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c06b730 con 0x7fc18c14a5d0 2023-10-16T13:47:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.142+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7fc17c005990 con 0x7fc18c14a5d0 2023-10-16T13:47:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.142+0000 7fc17affd700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc16c06b140 0x7fc16c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.142+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc17c089810 con 0x7fc18c14a5d0 2023-10-16T13:47:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.142+0000 7fc18a59c700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc16c06b140 0x7fc16c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.143+0000 7fc18a59c700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc16c06b140 0x7fc16c06d600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc180014040 tx=0x7fc180005040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.147+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc17c058080 con 0x7fc18c14a5d0 2023-10-16T13:47:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.397+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc18c0c9280 con 0x7fc18c14a5d0 2023-10-16T13:47:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.397+0000 7fc17affd700 1 -- 172.21.15.5:0/1109582759 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc17c057c10 con 0x7fc18c14a5d0 2023-10-16T13:47:24.401 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:47:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.399+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc16c06b140 msgr2=0x7fc16c06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.399+0000 7fc190f29700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc16c06b140 0x7fc16c06d600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc180014040 tx=0x7fc180005040 comp rx=0 tx=0).stop 2023-10-16T13:47:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.399+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 msgr2=0x7fc18c144530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.399+0000 7fc190f29700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 0x7fc18c144530 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00f8b0 tx=0x7fc17c00fbc0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 shutdown_connections 2023-10-16T13:47:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c144a70 0x7fc18c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc16c06b140 0x7fc16c06d600 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc174003a30 0x7fc18c0c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 --2- 172.21.15.5:0/1109582759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c14a5d0 0x7fc18c144530 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 >> 172.21.15.5:0/1109582759 conn(0x7fc18c06dae0 msgr2=0x7fc18c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 shutdown_connections 2023-10-16T13:47:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:24.400+0000 7fc190f29700 1 -- 172.21.15.5:0/1109582759 wait complete. 2023-10-16T13:47:24.415 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:47:24.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:47:24.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:47:24.416 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:47:24.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:24.416 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:47:24.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:47:24.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:47:24.417 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:47:24.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.418 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:47:24.436 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:47:24.436 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:47:24.436 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:47:24.437 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.437 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:47:24.437 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.437 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:24.437 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:24.438 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:24.438 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:24.438 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:47:24.438 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:24.438 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:47:24.439 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41858sec preferred_lft 41858sec 2023-10-16T13:47:24.439 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:47:24.439 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.439 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:24.439 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:24.440 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:47:24.440 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:24.440 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:47:24.440 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.440 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:47:24.441 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.441 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:24.441 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:47:24.441 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:47:24.441 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.442 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:24.442 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:47:24.442 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:47:24.442 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:24.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.443 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:47:24.502 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:47:24.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.504 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:47:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:47:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:47:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:47:24.564 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:47:24.564 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:47:24.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:47:24.565 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:47:24.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:47:24.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:47:24.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:47:24.566 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:47:24.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.671 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:47:24.688 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:47:24.688 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:47:24.688 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:47:24.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:47:24.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:24.757 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:24.814 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:47:24.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:24.815 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:24.871 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:47:24.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:24.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:24.959 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:24.959 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:24.990 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:24.990 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:24.990 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:24.990 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:24.991 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:24.991 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:24.991 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:24.991 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:25.063 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:25.063 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:25.065 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:25.065 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:47:25.065 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:47:25.065 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:47:25.066 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:47:25.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:25.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.094 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:47:25.177 INFO:teuthology.orchestra.run.smithi005.stdout:client5756 2023-10-16T13:47:25.177 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:25.177 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:25.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:47:25.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.397+0000 7f6d08f84700 1 Processor -- start 2023-10-16T13:47:25.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.398+0000 7f6d08f84700 1 -- start start 2023-10-16T13:47:25.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.398+0000 7f6d08f84700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 0x7f6d040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:25.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d08f84700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 0x7f6d040b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:25.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d08f84700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040b3530 con 0x7f6d0415f130 2023-10-16T13:47:25.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d08f84700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040cde00 con 0x7f6d040b28b0 2023-10-16T13:47:25.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d08f84700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040cd180 con 0x7f6d0406af50 2023-10-16T13:47:25.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d02d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 0x7f6d040b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:25.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 0x7f6d040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 0x7f6d040cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:44890/0 (socket says 172.21.15.5:44890) 2023-10-16T13:47:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d02d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 0x7f6d040b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:42884/0 (socket says 172.21.15.5:42884) 2023-10-16T13:47:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 -- 172.21.15.5:0/2710968645 learned_addr learned my addr 172.21.15.5:0/2710968645 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d0259c700 1 --1- 172.21.15.5:0/2710968645 >> v1:172.21.15.112:6789/0 conn(0x7f6d0415f130 0x7f6d0406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:47964/0 (socket says 172.21.15.5:47964) 2023-10-16T13:47:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 -- 172.21.15.5:0/2710968645 >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 msgr2=0x7f6d040b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 --2- 172.21.15.5:0/2710968645 >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 0x7f6d040b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 -- 172.21.15.5:0/2710968645 >> v1:172.21.15.112:6789/0 conn(0x7f6d0415f130 legacy=0x7f6d0406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:25.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d01d9b700 1 -- 172.21.15.5:0/2710968645 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040cd460 con 0x7f6d0406af50 2023-10-16T13:47:25.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d02d9d700 1 --2- 172.21.15.5:0/2710968645 >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 0x7f6d040b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:25.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.399+0000 7f6d0159a700 1 -- 172.21.15.5:0/2710968645 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894534200 0 0) 0x7f6d040b3530 con 0x7f6d0415f130 2023-10-16T13:47:25.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d01d9b700 1 --2- 172.21.15.5:0/2710968645 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 0x7f6d040cede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cec006fd0 tx=0x7f6cec009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bec5f3f273dd2c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:25.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d0159a700 1 -- 172.21.15.5:0/2710968645 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec005e30 con 0x7f6d0406af50 2023-10-16T13:47:25.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d0159a700 1 -- 172.21.15.5:0/2710968645 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec004030 con 0x7f6d0406af50 2023-10-16T13:47:25.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d0159a700 1 -- 172.21.15.5:0/2710968645 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0043e0 con 0x7f6d0406af50 2023-10-16T13:47:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 -- 172.21.15.5:0/2710968645 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 msgr2=0x7f6d040cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 --2- 172.21.15.5:0/2710968645 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 0x7f6d040cede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cec006fd0 tx=0x7f6cec009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 -- 172.21.15.5:0/2710968645 shutdown_connections 2023-10-16T13:47:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 --2- 172.21.15.5:0/2710968645 >> v2:172.21.15.112:3300/0 conn(0x7f6d040b28b0 0x7f6d040b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 --2- 172.21.15.5:0/2710968645 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0406af50 0x7f6d040cede0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 -- 172.21.15.5:0/2710968645 >> 172.21.15.5:0/2710968645 conn(0x7f6d0406dae0 msgr2=0x7f6d0406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 -- 172.21.15.5:0/2710968645 shutdown_connections 2023-10-16T13:47:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.400+0000 7f6d08f84700 1 -- 172.21.15.5:0/2710968645 wait complete. 2023-10-16T13:47:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 Processor -- start 2023-10-16T13:47:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 -- start start 2023-10-16T13:47:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d0406af50 0x7f6d040ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 0x7f6d041f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0415f130 0x7f6d040c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041f1540 con 0x7f6d040b28b0 2023-10-16T13:47:25.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040b0a20 con 0x7f6d0406af50 2023-10-16T13:47:25.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.402+0000 7f6d08f84700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040b0cc0 con 0x7f6d0415f130 2023-10-16T13:47:25.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 0x7f6d041f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:25.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 0x7f6d041f1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46992/0 (socket says 172.21.15.5:46992) 2023-10-16T13:47:25.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 -- 172.21.15.5:0/1819395583 learned_addr learned my addr 172.21.15.5:0/1819395583 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d02d9d700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0415f130 0x7f6d040c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d0259c700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d0406af50 0x7f6d040ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 -- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0415f130 msgr2=0x7f6d040c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0415f130 0x7f6d040c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 -- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d0406af50 msgr2=0x7f6d040ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:25.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d0406af50 0x7f6d040ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 -- 172.21.15.5:0/1819395583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc009a70 con 0x7f6d040b28b0 2023-10-16T13:47:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d01d9b700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 0x7f6d041f1000 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009130 tx=0x7f6cec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0045b0 con 0x7f6d040b28b0 2023-10-16T13:47:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec01d430 con 0x7f6d040b28b0 2023-10-16T13:47:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec009500 con 0x7f6d040b28b0 2023-10-16T13:47:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec01d7e0 con 0x7f6d040b28b0 2023-10-16T13:47:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.403+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d040c9aa0 con 0x7f6d040b28b0 2023-10-16T13:47:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.404+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04067d20 con 0x7f6d040b28b0 2023-10-16T13:47:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.405+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f6cec01d940 con 0x7f6d040b28b0 2023-10-16T13:47:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.405+0000 7f6cfaffd700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ce406b140 0x7f6ce406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.405+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cec08ad80 con 0x7f6d040b28b0 2023-10-16T13:47:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.405+0000 7f6d0259c700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ce406b140 0x7f6ce406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.406+0000 7f6d0259c700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ce406b140 0x7f6ce406d600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4007b10 tx=0x7f6cf4007a60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.410+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cec055ac0 con 0x7f6d040b28b0 2023-10-16T13:47:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.653+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d040c9ea0 con 0x7f6d040b28b0 2023-10-16T13:47:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.654+0000 7f6cfaffd700 1 -- 172.21.15.5:0/1819395583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6cec016060 con 0x7f6d040b28b0 2023-10-16T13:47:25.657 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:47:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.655+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ce406b140 msgr2=0x7f6ce406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.655+0000 7f6d08f84700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ce406b140 0x7f6ce406d600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4007b10 tx=0x7f6cf4007a60 comp rx=0 tx=0).stop 2023-10-16T13:47:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.655+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 msgr2=0x7f6d041f1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.655+0000 7f6d08f84700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 0x7f6d041f1000 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009130 tx=0x7f6cec004750 comp rx=0 tx=0).stop 2023-10-16T13:47:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 shutdown_connections 2023-10-16T13:47:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ce406b140 0x7f6ce406d600 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d0415f130 0x7f6d040c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d0406af50 0x7f6d040ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 --2- 172.21.15.5:0/1819395583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b28b0 0x7f6d041f1000 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 >> 172.21.15.5:0/1819395583 conn(0x7f6d0406dae0 msgr2=0x7f6d040d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 shutdown_connections 2023-10-16T13:47:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:25.656+0000 7f6d08f84700 1 -- 172.21.15.5:0/1819395583 wait complete. 2023-10-16T13:47:25.670 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:47:25.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:47:25.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:47:25.671 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:47:25.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:25.672 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:47:25.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:47:25.673 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:47:25.673 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:47:25.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.674 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:47:25.695 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:47:25.695 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:47:25.695 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:47:25.696 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.696 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:47:25.696 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.696 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:25.696 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:25.697 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:25.697 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:25.697 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:25.697 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:25.697 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:47:25.698 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:25.698 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:47:25.698 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 41871sec preferred_lft 41871sec 2023-10-16T13:47:25.698 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:47:25.698 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.698 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:47:25.699 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:25.699 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:47:25.699 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.699 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:47:25.699 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.699 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:25.700 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:47:25.700 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:47:25.700 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.700 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:25.700 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:47:25.701 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:47:25.701 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:25.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.701 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:47:25.765 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:47:25.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.766 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:47:25.827 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:47:25.827 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:47:25.827 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:47:25.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:47:25.828 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:47:25.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.828 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:47:25.829 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:47:25.829 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:47:25.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:47:25.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:47:25.830 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:47:25.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.937 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:47:25.954 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:47:25.954 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:47:25.954 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:47:25.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:25.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:47:26.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:26.023 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:26.080 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:47:26.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:26.081 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:26.136 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:47:26.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:26.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:26.221 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:26.221 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:26.246 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:26.246 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:26.246 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:26.246 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:26.246 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:26.322 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:26.322 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:26.322 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:26.322 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:26.322 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:26.323 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:26.323 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:26.323 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:26.323 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:47:26.323 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:47:26.324 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:47:26.324 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:47:26.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:26.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:26.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:26.351 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:47:26.423 INFO:teuthology.orchestra.run.smithi112.stdout:client6657 2023-10-16T13:47:26.423 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:26.424 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:26.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:47:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.621+0000 7f42a3ed4700 1 Processor -- start 2023-10-16T13:47:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.621+0000 7f42a3ed4700 1 -- start start 2023-10-16T13:47:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a3ed4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f429c15d840 0x7f429c162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a3ed4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cdfd0 0x7f429c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a3ed4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f429c0cd330 0x7f429c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a3ed4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0cdd00 con 0x7f429c15d840 2023-10-16T13:47:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a3ed4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0cee20 con 0x7f429c0cd330 2023-10-16T13:47:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a3ed4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0b2ce0 con 0x7f429c0cdfd0 2023-10-16T13:47:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a1c70700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f429c15d840 0x7f429c162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a1c70700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f429c15d840 0x7f429c162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46998/0 (socket says 172.21.15.5:46998) 2023-10-16T13:47:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a1c70700 1 -- 172.21.15.5:0/2183410315 learned_addr learned my addr 172.21.15.5:0/2183410315 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a146f700 1 --2- 172.21.15.5:0/2183410315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cdfd0 0x7f429c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.622+0000 7f42a2471700 1 --2- 172.21.15.5:0/2183410315 >> v2:172.21.15.112:3300/0 conn(0x7f429c0cd330 0x7f429c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a1c70700 1 -- 172.21.15.5:0/2183410315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cdfd0 msgr2=0x7f429c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a1c70700 1 --2- 172.21.15.5:0/2183410315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cdfd0 0x7f429c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a1c70700 1 -- 172.21.15.5:0/2183410315 >> v2:172.21.15.112:3300/0 conn(0x7f429c0cd330 msgr2=0x7f429c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a1c70700 1 --2- 172.21.15.5:0/2183410315 >> v2:172.21.15.112:3300/0 conn(0x7f429c0cd330 0x7f429c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a1c70700 1 -- 172.21.15.5:0/2183410315 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0ceb40 con 0x7f429c15d840 2023-10-16T13:47:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a2471700 1 --2- 172.21.15.5:0/2183410315 >> v2:172.21.15.112:3300/0 conn(0x7f429c0cd330 0x7f429c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a1c70700 1 --2- 172.21.15.5:0/2183410315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c15d840 0x7f429c162070 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f429c0c3f00 tx=0x7f428c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565b39af24e498c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a0c6e700 1 -- 172.21.15.5:0/2183410315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011830 con 0x7f429c15d840 2023-10-16T13:47:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a0c6e700 1 -- 172.21.15.5:0/2183410315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c011990 con 0x7f429c15d840 2023-10-16T13:47:26.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a0c6e700 1 -- 172.21.15.5:0/2183410315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011d20 con 0x7f429c15d840 2023-10-16T13:47:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2183410315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c15d840 msgr2=0x7f429c162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2183410315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c15d840 0x7f429c162070 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f429c0c3f00 tx=0x7f428c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2183410315 shutdown_connections 2023-10-16T13:47:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2183410315 >> v2:172.21.15.112:3300/0 conn(0x7f429c0cd330 0x7f429c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2183410315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c15d840 0x7f429c162070 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2183410315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cdfd0 0x7f429c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.623+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2183410315 >> 172.21.15.5:0/2183410315 conn(0x7f429c06bd70 msgr2=0x7f429c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.624+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2183410315 shutdown_connections 2023-10-16T13:47:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.624+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2183410315 wait complete. 2023-10-16T13:47:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.625+0000 7f42a3ed4700 1 Processor -- start 2023-10-16T13:47:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.625+0000 7f42a3ed4700 1 -- start start 2023-10-16T13:47:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cd330 0x7f429c14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 0x7f429c1e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429c15d840 0x7f429c1e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c1e8470 con 0x7f429c0cdfd0 2023-10-16T13:47:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c14de40 con 0x7f429c15d840 2023-10-16T13:47:26.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c1e7860 con 0x7f429c0cd330 2023-10-16T13:47:26.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 0x7f429c1e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 0x7f429c1e6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47004/0 (socket says 172.21.15.5:47004) 2023-10-16T13:47:26.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 -- 172.21.15.5:0/2229782407 learned_addr learned my addr 172.21.15.5:0/2229782407 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:26.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a1c70700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cd330 0x7f429c14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a2471700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429c15d840 0x7f429c1e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 -- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cd330 msgr2=0x7f429c14d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:26.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cd330 0x7f429c14d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 -- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429c15d840 msgr2=0x7f429c1e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:26.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429c15d840 0x7f429c1e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:26.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 -- 172.21.15.5:0/2229782407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009550 con 0x7f429c0cdfd0 2023-10-16T13:47:26.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a2471700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429c15d840 0x7f429c1e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:26.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a146f700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 0x7f429c1e6cf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9e0 tx=0x7f429800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:26.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298009710 con 0x7f429c0cdfd0 2023-10-16T13:47:26.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800c850 con 0x7f429c0cdfd0 2023-10-16T13:47:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c1e7b40 con 0x7f429c0cdfd0 2023-10-16T13:47:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800cbc0 con 0x7f429c0cdfd0 2023-10-16T13:47:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.626+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c1e8100 con 0x7f429c0cdfd0 2023-10-16T13:47:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.627+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c067d20 con 0x7f429c0cdfd0 2023-10-16T13:47:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.628+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f429800cd20 con 0x7f429c0cdfd0 2023-10-16T13:47:26.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.628+0000 7f42927fc700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f428006b140 0x7f428006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:26.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.628+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f429808a200 con 0x7f429c0cdfd0 2023-10-16T13:47:26.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.629+0000 7f42a1c70700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f428006b140 0x7f428006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:26.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.629+0000 7f42a1c70700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f428006b140 0x7f428006d600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f428c009c10 tx=0x7f428c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:26.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.633+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4298055030 con 0x7f429c0cdfd0 2023-10-16T13:47:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:26.879+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f429c0b20c0 con 0x7f429c0cdfd0 2023-10-16T13:47:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.702+0000 7f42927fc700 1 -- 172.21.15.5:0/2229782407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4298058650 con 0x7f429c0cdfd0 2023-10-16T13:47:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f428006b140 msgr2=0x7f428006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f428006b140 0x7f428006d600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f428c009c10 tx=0x7f428c008030 comp rx=0 tx=0).stop 2023-10-16T13:47:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 msgr2=0x7f429c1e6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 0x7f429c1e6cf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9e0 tx=0x7f429800eda0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 shutdown_connections 2023-10-16T13:47:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429c15d840 0x7f429c1e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f428006b140 0x7f428006d600 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f429c0cd330 0x7f429c14d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 --2- 172.21.15.5:0/2229782407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f429c0cdfd0 0x7f429c1e6cf0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 >> 172.21.15.5:0/2229782407 conn(0x7f429c06bd70 msgr2=0x7f429c15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 shutdown_connections 2023-10-16T13:47:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.705+0000 7f42a3ed4700 1 -- 172.21.15.5:0/2229782407 wait complete. 2023-10-16T13:47:27.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:47:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.854+0000 7f9b8df4c700 1 Processor -- start 2023-10-16T13:47:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.854+0000 7f9b8df4c700 1 -- start start 2023-10-16T13:47:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b8df4c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b880b7050 0x7f9b8815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b8df4c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815e4e0 con 0x7f9b880d3fc0 2023-10-16T13:47:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b8df4c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880d28e0 con 0x7f9b8815dbc0 2023-10-16T13:47:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b8df4c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880b7560 con 0x7f9b880b7050 2023-10-16T13:47:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b86ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b880d3fc0 0x7f9b880d21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57016/0 (socket says 172.21.15.5:57016) 2023-10-16T13:47:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b86ffd700 1 -- 172.21.15.5:0/137428217 learned_addr learned my addr 172.21.15.5:0/137428217 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b87fff700 1 --2- 172.21.15.5:0/137428217 >> v2:172.21.15.112:3300/0 conn(0x7f9b880b7050 0x7f9b8815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b867fc700 1 -- 172.21.15.5:0/137428217 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775483546 0 0) 0x7f9b8815e4e0 con 0x7f9b880d3fc0 2023-10-16T13:47:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.855+0000 7f9b867fc700 1 -- 172.21.15.5:0/137428217 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b740035b0 con 0x7f9b880d3fc0 2023-10-16T13:47:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b867fc700 1 -- 172.21.15.5:0/137428217 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3874870927 0 0) 0x7f9b740035b0 con 0x7f9b880d3fc0 2023-10-16T13:47:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b87fff700 1 -- 172.21.15.5:0/137428217 >> v1:172.21.15.112:6789/0 conn(0x7f9b8815dbc0 legacy=0x7f9b880d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b87fff700 1 -- 172.21.15.5:0/137428217 >> v1:172.21.15.5:6789/0 conn(0x7f9b880d3fc0 legacy=0x7f9b880d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b87fff700 1 -- 172.21.15.5:0/137428217 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880b7840 con 0x7f9b880b7050 2023-10-16T13:47:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b87fff700 1 --2- 172.21.15.5:0/137428217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880b7050 0x7f9b8815dfa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27b2a3f9e3c7fb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b867fc700 1 -- 172.21.15.5:0/137428217 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000e070 con 0x7f9b880b7050 2023-10-16T13:47:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b867fc700 1 -- 172.21.15.5:0/137428217 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80003a20 con 0x7f9b880b7050 2023-10-16T13:47:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.856+0000 7f9b867fc700 1 -- 172.21.15.5:0/137428217 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78001670 con 0x7f9b880b7050 2023-10-16T13:47:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 -- 172.21.15.5:0/137428217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880b7050 msgr2=0x7f9b8815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/137428217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880b7050 0x7f9b8815dfa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b8000b330 comp rx=0 tx=0).stop 2023-10-16T13:47:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 -- 172.21.15.5:0/137428217 shutdown_connections 2023-10-16T13:47:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/137428217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880b7050 0x7f9b8815dfa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 -- 172.21.15.5:0/137428217 >> 172.21.15.5:0/137428217 conn(0x7f9b8809cb40 msgr2=0x7f9b880d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 -- 172.21.15.5:0/137428217 shutdown_connections 2023-10-16T13:47:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.857+0000 7f9b8df4c700 1 -- 172.21.15.5:0/137428217 wait complete. 2023-10-16T13:47:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.858+0000 7f9b8df4c700 1 Processor -- start 2023-10-16T13:47:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.858+0000 7f9b8df4c700 1 -- start start 2023-10-16T13:47:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b8df4c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b880b7050 0x7f9b8814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b8df4c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880d3fc0 0x7f9b8809fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b8df4c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 0x7f9b880a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b8df4c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880cb550 con 0x7f9b8815dbc0 2023-10-16T13:47:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b8df4c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880cb1b0 con 0x7f9b880d3fc0 2023-10-16T13:47:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b8df4c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880a0730 con 0x7f9b880b7050 2023-10-16T13:47:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 0x7f9b880a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 0x7f9b880a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47020/0 (socket says 172.21.15.5:47020) 2023-10-16T13:47:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 -- 172.21.15.5:0/548381338 learned_addr learned my addr 172.21.15.5:0/548381338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b86ffd700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880d3fc0 0x7f9b8809fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 -- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b880b7050 msgr2=0x7f9b8814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b877fe700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b880b7050 0x7f9b8814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b880b7050 0x7f9b8814eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 -- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880d3fc0 msgr2=0x7f9b8809fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880d3fc0 0x7f9b8809fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 -- 172.21.15.5:0/548381338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009a70 con 0x7f9b8815dbc0 2023-10-16T13:47:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b86ffd700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880d3fc0 0x7f9b8809fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b877fe700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b880b7050 0x7f9b8814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b87fff700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 0x7f9b880a0130 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9b8806b4b0 tx=0x7f9b80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.859+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004670 con 0x7f9b8815dbc0 2023-10-16T13:47:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.860+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b800047d0 con 0x7f9b8815dbc0 2023-10-16T13:47:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.860+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8001d6b0 con 0x7f9b8815dbc0 2023-10-16T13:47:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.860+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880a0a10 con 0x7f9b8815dbc0 2023-10-16T13:47:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.860+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8809d720 con 0x7f9b8815dbc0 2023-10-16T13:47:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.860+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b880cb690 con 0x7f9b8815dbc0 2023-10-16T13:47:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.861+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f9b8001d810 con 0x7f9b8815dbc0 2023-10-16T13:47:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.861+0000 7f9b7ffff700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b6806b140 0x7f9b6806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.861+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b8008b890 con 0x7f9b8815dbc0 2023-10-16T13:47:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.862+0000 7f9b877fe700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b6806b140 0x7f9b6806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.862+0000 7f9b877fe700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b6806b140 0x7f9b6806d600 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b700016a0 tx=0x7f9b70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:27.866+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b80056560 con 0x7f9b8815dbc0 2023-10-16T13:47:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.094+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b880b7e00 con 0x7f9b6806b140 2023-10-16T13:47:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.097+0000 7f9b7ffff700 1 -- 172.21.15.5:0/548381338 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9b70014420 con 0x7f9b6806b140 2023-10-16T13:47:28.099 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:47:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:47:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:28.100 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:47:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b6806b140 msgr2=0x7f9b6806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b6806b140 0x7f9b6806d600 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b700016a0 tx=0x7f9b70009040 comp rx=0 tx=0).stop 2023-10-16T13:47:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 msgr2=0x7f9b880a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 0x7f9b880a0130 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9b8806b4b0 tx=0x7f9b80004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 shutdown_connections 2023-10-16T13:47:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b8815dbc0 0x7f9b880a0130 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b6806b140 0x7f9b6806d600 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b880b7050 0x7f9b8814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 --2- 172.21.15.5:0/548381338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b880d3fc0 0x7f9b8809fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.098+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 >> 172.21.15.5:0/548381338 conn(0x7f9b8809cb40 msgr2=0x7f9b881e2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.099+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 shutdown_connections 2023-10-16T13:47:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.099+0000 7f9b8df4c700 1 -- 172.21.15.5:0/548381338 wait complete. 2023-10-16T13:47:28.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:47:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.252+0000 7f72f6cd9700 1 Processor -- start 2023-10-16T13:47:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.252+0000 7f72f6cd9700 1 -- start start 2023-10-16T13:47:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f6cd9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72f006af50 0x7f72f00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f6cd9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72f00b28b0 0x7f72f00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f6cd9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f00b3530 con 0x7f72f015f130 2023-10-16T13:47:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f6cd9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00cde00 con 0x7f72f00b28b0 2023-10-16T13:47:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f6cd9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00cd180 con 0x7f72f006af50 2023-10-16T13:47:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f4a75700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72f015f130 0x7f72f006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57028/0 (socket says 172.21.15.5:57028) 2023-10-16T13:47:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f5276700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72f00b28b0 0x7f72f00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72f4a75700 1 -- 172.21.15.5:0/3252761535 learned_addr learned my addr 172.21.15.5:0/3252761535 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.253+0000 7f72effff700 1 --2- 172.21.15.5:0/3252761535 >> v2:172.21.15.112:3300/0 conn(0x7f72f006af50 0x7f72f00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f5276700 1 -- 172.21.15.5:0/3252761535 >> v2:172.21.15.112:3300/0 conn(0x7f72f006af50 msgr2=0x7f72f00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f5276700 1 --2- 172.21.15.5:0/3252761535 >> v2:172.21.15.112:3300/0 conn(0x7f72f006af50 0x7f72f00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f5276700 1 -- 172.21.15.5:0/3252761535 >> v1:172.21.15.5:6789/0 conn(0x7f72f015f130 legacy=0x7f72f006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f5276700 1 -- 172.21.15.5:0/3252761535 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00cd460 con 0x7f72f00b28b0 2023-10-16T13:47:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72ef7fe700 1 -- 172.21.15.5:0/3252761535 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978847665 0 0) 0x7f72f00b3530 con 0x7f72f015f130 2023-10-16T13:47:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72effff700 1 --2- 172.21.15.5:0/3252761535 >> v2:172.21.15.112:3300/0 conn(0x7f72f006af50 0x7f72f00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f5276700 1 --2- 172.21.15.5:0/3252761535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f00b28b0 0x7f72f00b3960 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f72f006e820 tx=0x7f72e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2731d217d31546b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72ef7fe700 1 -- 172.21.15.5:0/3252761535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e800e070 con 0x7f72f00b28b0 2023-10-16T13:47:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72ef7fe700 1 -- 172.21.15.5:0/3252761535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e800bbd0 con 0x7f72f00b28b0 2023-10-16T13:47:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72ef7fe700 1 -- 172.21.15.5:0/3252761535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8012430 con 0x7f72f00b28b0 2023-10-16T13:47:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 -- 172.21.15.5:0/3252761535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f00b28b0 msgr2=0x7f72f00b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/3252761535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f00b28b0 0x7f72f00b3960 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f72f006e820 tx=0x7f72e800b330 comp rx=0 tx=0).stop 2023-10-16T13:47:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 -- 172.21.15.5:0/3252761535 shutdown_connections 2023-10-16T13:47:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/3252761535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f00b28b0 0x7f72f00b3960 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/3252761535 >> v2:172.21.15.112:3300/0 conn(0x7f72f006af50 0x7f72f00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 -- 172.21.15.5:0/3252761535 >> 172.21.15.5:0/3252761535 conn(0x7f72f006dae0 msgr2=0x7f72f006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 -- 172.21.15.5:0/3252761535 shutdown_connections 2023-10-16T13:47:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.254+0000 7f72f6cd9700 1 -- 172.21.15.5:0/3252761535 wait complete. 2023-10-16T13:47:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.256+0000 7f72f6cd9700 1 Processor -- start 2023-10-16T13:47:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.256+0000 7f72f6cd9700 1 -- start start 2023-10-16T13:47:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 0x7f72f01585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f00b28b0 0x7f72f00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f015f130 0x7f72f00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00ae540 con 0x7f72f006af50 2023-10-16T13:47:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00c6e90 con 0x7f72f00b28b0 2023-10-16T13:47:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00adca0 con 0x7f72f015f130 2023-10-16T13:47:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 0x7f72f01585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 0x7f72f01585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47030/0 (socket says 172.21.15.5:47030) 2023-10-16T13:47:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 -- 172.21.15.5:0/941115777 learned_addr learned my addr 172.21.15.5:0/941115777 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f5276700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f015f130 0x7f72f00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72effff700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f00b28b0 0x7f72f00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 -- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f015f130 msgr2=0x7f72f00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f015f130 0x7f72f00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 -- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f00b28b0 msgr2=0x7f72f00ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f00b28b0 0x7f72f00ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 -- 172.21.15.5:0/941115777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009a70 con 0x7f72f006af50 2023-10-16T13:47:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f5276700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f015f130 0x7f72f00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72effff700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f00b28b0 0x7f72f00ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f4a75700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 0x7f72f01585a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f72e40011e0 tx=0x7f72e400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4004c80 con 0x7f72f006af50 2023-10-16T13:47:28.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e4004e00 con 0x7f72f006af50 2023-10-16T13:47:28.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4007310 con 0x7f72f006af50 2023-10-16T13:47:28.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f00adf80 con 0x7f72f006af50 2023-10-16T13:47:28.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.257+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f00c4770 con 0x7f72f006af50 2023-10-16T13:47:28.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.258+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f0067d20 con 0x7f72f006af50 2023-10-16T13:47:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.259+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f72e4007470 con 0x7f72f006af50 2023-10-16T13:47:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.259+0000 7f72ed7fa700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72d406b140 0x7f72d406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.259+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72e40897b0 con 0x7f72f006af50 2023-10-16T13:47:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.259+0000 7f72effff700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72d406b140 0x7f72d406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.260+0000 7f72effff700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72d406b140 0x7f72d406d600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f72f0158ae0 tx=0x7f72dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:28.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.264+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72e4054500 con 0x7f72f006af50 2023-10-16T13:47:28.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.463+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72f00ceca0 con 0x7f72f006af50 2023-10-16T13:47:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.464+0000 7f72ed7fa700 1 -- 172.21.15.5:0/941115777 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72e4057b20 con 0x7f72f006af50 2023-10-16T13:47:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.465+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72d406b140 msgr2=0x7f72d406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.465+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72d406b140 0x7f72d406d600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f72f0158ae0 tx=0x7f72dc008040 comp rx=0 tx=0).stop 2023-10-16T13:47:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 msgr2=0x7f72f01585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 0x7f72f01585a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f72e40011e0 tx=0x7f72e400cae0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 shutdown_connections 2023-10-16T13:47:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f72d406b140 0x7f72d406d600 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f015f130 0x7f72f00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f006af50 0x7f72f01585a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 --2- 172.21.15.5:0/941115777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f00b28b0 0x7f72f00ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 >> 172.21.15.5:0/941115777 conn(0x7f72f006dae0 msgr2=0x7f72f00b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 shutdown_connections 2023-10-16T13:47:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.466+0000 7f72f6cd9700 1 -- 172.21.15.5:0/941115777 wait complete. 2023-10-16T13:47:28.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000973954 2023-10-16T13:47:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.606+0000 7f27ed785700 1 Processor -- start 2023-10-16T13:47:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.606+0000 7f27ed785700 1 -- start start 2023-10-16T13:47:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27ed785700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e80cd950 0x7f27e815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27ed785700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27e806a840 0x7f27e806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27ed785700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80cf260 con 0x7f27e80cede0 2023-10-16T13:47:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27ed785700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e81619a0 con 0x7f27e806a840 2023-10-16T13:47:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27ed785700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e806b1f0 con 0x7f27e80cd950 2023-10-16T13:47:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27e67fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27e80cede0 0x7f27e815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57042/0 (socket says 172.21.15.5:57042) 2023-10-16T13:47:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27e67fc700 1 -- 172.21.15.5:0/1215641965 learned_addr learned my addr 172.21.15.5:0/1215641965 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27e6ffd700 1 --2- 172.21.15.5:0/1215641965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e80cd950 0x7f27e815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.607+0000 7f27e77fe700 1 --2- 172.21.15.5:0/1215641965 >> v2:172.21.15.112:3300/0 conn(0x7f27e806a840 0x7f27e806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e5ffb700 1 -- 172.21.15.5:0/1215641965 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951869283 0 0) 0x7f27e80cf260 con 0x7f27e80cede0 2023-10-16T13:47:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e5ffb700 1 -- 172.21.15.5:0/1215641965 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d00035b0 con 0x7f27e80cede0 2023-10-16T13:47:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e6ffd700 1 -- 172.21.15.5:0/1215641965 >> v2:172.21.15.112:3300/0 conn(0x7f27e806a840 msgr2=0x7f27e806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e6ffd700 1 --2- 172.21.15.5:0/1215641965 >> v2:172.21.15.112:3300/0 conn(0x7f27e806a840 0x7f27e806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e6ffd700 1 -- 172.21.15.5:0/1215641965 >> v1:172.21.15.5:6789/0 conn(0x7f27e80cede0 legacy=0x7f27e815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e5ffb700 1 -- 172.21.15.5:0/1215641965 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 858093808 0 0) 0x7f27d00035b0 con 0x7f27e80cede0 2023-10-16T13:47:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e6ffd700 1 -- 172.21.15.5:0/1215641965 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80b2d60 con 0x7f27e80cd950 2023-10-16T13:47:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e77fe700 1 --2- 172.21.15.5:0/1215641965 >> v2:172.21.15.112:3300/0 conn(0x7f27e806a840 0x7f27e806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e6ffd700 1 --2- 172.21.15.5:0/1215641965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e80cd950 0x7f27e815e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009840 tx=0x7f27dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e0b5f4ca10e6424 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e5ffb700 1 -- 172.21.15.5:0/1215641965 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80017f0 con 0x7f27e80cd950 2023-10-16T13:47:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e5ffb700 1 -- 172.21.15.5:0/1215641965 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc004030 con 0x7f27e80cd950 2023-10-16T13:47:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.608+0000 7f27e5ffb700 1 -- 172.21.15.5:0/1215641965 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0043a0 con 0x7f27e80cd950 2023-10-16T13:47:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 -- 172.21.15.5:0/1215641965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e80cd950 msgr2=0x7f27e815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 --2- 172.21.15.5:0/1215641965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e80cd950 0x7f27e815e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009840 tx=0x7f27dc009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 -- 172.21.15.5:0/1215641965 shutdown_connections 2023-10-16T13:47:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 --2- 172.21.15.5:0/1215641965 >> v2:172.21.15.112:3300/0 conn(0x7f27e806a840 0x7f27e806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 --2- 172.21.15.5:0/1215641965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e80cd950 0x7f27e815e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 -- 172.21.15.5:0/1215641965 >> 172.21.15.5:0/1215641965 conn(0x7f27e806dae0 msgr2=0x7f27e806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 -- 172.21.15.5:0/1215641965 shutdown_connections 2023-10-16T13:47:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.609+0000 7f27ed785700 1 -- 172.21.15.5:0/1215641965 wait complete. 2023-10-16T13:47:28.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.610+0000 7f27ed785700 1 Processor -- start 2023-10-16T13:47:28.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.610+0000 7f27ed785700 1 -- start start 2023-10-16T13:47:28.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27ed785700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e806a840 0x7f27e81f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27ed785700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 0x7f27e81f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27ed785700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e80cede0 0x7f27e80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27ed785700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e81f6b90 con 0x7f27e80cd950 2023-10-16T13:47:28.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27ed785700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80c9540 con 0x7f27e80cede0 2023-10-16T13:47:28.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27ed785700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80ae0b0 con 0x7f27e806a840 2023-10-16T13:47:28.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 0x7f27e81f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 0x7f27e81f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47046/0 (socket says 172.21.15.5:47046) 2023-10-16T13:47:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e67fc700 1 -- 172.21.15.5:0/2895647745 learned_addr learned my addr 172.21.15.5:0/2895647745 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e77fe700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e80cede0 0x7f27e80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e6ffd700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e806a840 0x7f27e81f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e67fc700 1 -- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e806a840 msgr2=0x7f27e81f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e67fc700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e806a840 0x7f27e81f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.611+0000 7f27e67fc700 1 -- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e80cede0 msgr2=0x7f27e80c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27e67fc700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e80cede0 0x7f27e80c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27e67fc700 1 -- 172.21.15.5:0/2895647745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009a70 con 0x7f27e80cd950 2023-10-16T13:47:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27e67fc700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 0x7f27e81f6650 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c750 tx=0x7f27d800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80074e0 con 0x7f27e80cd950 2023-10-16T13:47:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8007660 con 0x7f27e80cd950 2023-10-16T13:47:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc0094a0 con 0x7f27e80cd950 2023-10-16T13:47:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8005a70 con 0x7f27e80cd950 2023-10-16T13:47:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.612+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e80c9e60 con 0x7f27e80cd950 2023-10-16T13:47:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.613+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e8067d20 con 0x7f27e80cd950 2023-10-16T13:47:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.613+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f27d8005bd0 con 0x7f27e80cd950 2023-10-16T13:47:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.614+0000 7f27cf7fe700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27d406b140 0x7f27d406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:28.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.614+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27d8088fc0 con 0x7f27e80cd950 2023-10-16T13:47:28.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.614+0000 7f27e6ffd700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27d406b140 0x7f27d406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:28.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.615+0000 7f27e6ffd700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27d406b140 0x7f27d406d600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b2460 tx=0x7f27dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:28.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.619+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27d80bbca0 con 0x7f27e80cd950 2023-10-16T13:47:28.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:47:28.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:47:28.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.850+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000973954", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e815e920 con 0x7f27d406b140 2023-10-16T13:47:28.859 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:28.856+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:28.859 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:28.856+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:28.859 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:28.856+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:28.860 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:28.856+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:28.860 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:28.856+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:28.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.871+0000 7f27cf7fe700 1 -- 172.21.15.5:0/2895647745 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f27dc004320 con 0x7f27d406b140 2023-10-16T13:47:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27d406b140 msgr2=0x7f27d406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27d406b140 0x7f27d406d600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b2460 tx=0x7f27dc008030 comp rx=0 tx=0).stop 2023-10-16T13:47:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 msgr2=0x7f27e81f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 0x7f27e81f6650 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c750 tx=0x7f27d800cb10 comp rx=0 tx=0).stop 2023-10-16T13:47:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 shutdown_connections 2023-10-16T13:47:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27e80cede0 0x7f27e80c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f27d406b140 0x7f27d406d600 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27e806a840 0x7f27e81f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 --2- 172.21.15.5:0/2895647745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27e80cd950 0x7f27e81f6650 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 >> 172.21.15.5:0/2895647745 conn(0x7f27e806dae0 msgr2=0x7f27e815ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 shutdown_connections 2023-10-16T13:47:28.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:28.873+0000 7f27ed785700 1 -- 172.21.15.5:0/2895647745 wait complete. 2023-10-16T13:47:28.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-16T13:47:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.054+0000 7f7877cfd700 1 Processor -- start 2023-10-16T13:47:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.054+0000 7f7877cfd700 1 -- start start 2023-10-16T13:47:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7877cfd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f787015e2f0 0x7f78700cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7877cfd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f787006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7877cfd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700b2d60 con 0x7f78700cd950 2023-10-16T13:47:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7877cfd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78701619a0 con 0x7f787015e2f0 2023-10-16T13:47:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7877cfd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787006b1f0 con 0x7f787006a840 2023-10-16T13:47:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7875a99700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78700cd950 0x7f787015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57056/0 (socket says 172.21.15.5:57056) 2023-10-16T13:47:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.055+0000 7f7875a99700 1 -- 172.21.15.5:0/3855081302 learned_addr learned my addr 172.21.15.5:0/3855081302 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f787629a700 1 --2- 172.21.15.5:0/3855081302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f787006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7875298700 1 --2- 172.21.15.5:0/3855081302 >> v2:172.21.15.112:3300/0 conn(0x7f787015e2f0 0x7f78700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7874a97700 1 -- 172.21.15.5:0/3855081302 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417761261 0 0) 0x7f78700b2d60 con 0x7f78700cd950 2023-10-16T13:47:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7874a97700 1 -- 172.21.15.5:0/3855081302 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f785c0035b0 con 0x7f78700cd950 2023-10-16T13:47:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f787629a700 1 -- 172.21.15.5:0/3855081302 >> v2:172.21.15.112:3300/0 conn(0x7f787015e2f0 msgr2=0x7f78700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f787629a700 1 --2- 172.21.15.5:0/3855081302 >> v2:172.21.15.112:3300/0 conn(0x7f787015e2f0 0x7f78700cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f787629a700 1 -- 172.21.15.5:0/3855081302 >> v1:172.21.15.5:6789/0 conn(0x7f78700cd950 legacy=0x7f787015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7874a97700 1 -- 172.21.15.5:0/3855081302 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700751742 0 0) 0x7f785c0035b0 con 0x7f78700cd950 2023-10-16T13:47:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f787629a700 1 -- 172.21.15.5:0/3855081302 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700cdd30 con 0x7f787006a840 2023-10-16T13:47:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f787629a700 1 --2- 172.21.15.5:0/3855081302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f787006acb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7870161ae0 tx=0x7f786800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd06c1c59923806 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7874a97700 1 -- 172.21.15.5:0/3855081302 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800e070 con 0x7f787006a840 2023-10-16T13:47:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7874a97700 1 -- 172.21.15.5:0/3855081302 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868003a20 con 0x7f787006a840 2023-10-16T13:47:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.056+0000 7f7874a97700 1 -- 172.21.15.5:0/3855081302 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860001670 con 0x7f787006a840 2023-10-16T13:47:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 -- 172.21.15.5:0/3855081302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 msgr2=0x7f787006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 --2- 172.21.15.5:0/3855081302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f787006acb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7870161ae0 tx=0x7f786800b330 comp rx=0 tx=0).stop 2023-10-16T13:47:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 -- 172.21.15.5:0/3855081302 shutdown_connections 2023-10-16T13:47:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 --2- 172.21.15.5:0/3855081302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f787006acb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 --2- 172.21.15.5:0/3855081302 >> v2:172.21.15.112:3300/0 conn(0x7f787015e2f0 0x7f78700cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 -- 172.21.15.5:0/3855081302 >> 172.21.15.5:0/3855081302 conn(0x7f787006dae0 msgr2=0x7f787006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 -- 172.21.15.5:0/3855081302 shutdown_connections 2023-10-16T13:47:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.057+0000 7f7877cfd700 1 -- 172.21.15.5:0/3855081302 wait complete. 2023-10-16T13:47:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.058+0000 7f7877cfd700 1 Processor -- start 2023-10-16T13:47:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.058+0000 7f7877cfd700 1 -- start start 2023-10-16T13:47:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7877cfd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f78700b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7877cfd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78700cd950 0x7f78700af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7877cfd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 0x7f787015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7877cfd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700b4080 con 0x7f787015e2f0 2023-10-16T13:47:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7877cfd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700b3400 con 0x7f78700cd950 2023-10-16T13:47:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7877cfd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700b36e0 con 0x7f787006a840 2023-10-16T13:47:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f787629a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 0x7f787015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f787629a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 0x7f787015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47062/0 (socket says 172.21.15.5:47062) 2023-10-16T13:47:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f787629a700 1 -- 172.21.15.5:0/2712995349 learned_addr learned my addr 172.21.15.5:0/2712995349 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7875298700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78700cd950 0x7f78700af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f7875a99700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f78700b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.059+0000 7f787629a700 1 -- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 msgr2=0x7f78700b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f787629a700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f78700b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f787629a700 1 -- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78700cd950 msgr2=0x7f78700af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f787629a700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78700cd950 0x7f78700af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f787629a700 1 -- 172.21.15.5:0/2712995349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009a70 con 0x7f787015e2f0 2023-10-16T13:47:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f787629a700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 0x7f787015c1c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f786800b020 tx=0x7f7868004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868004580 con 0x7f787015e2f0 2023-10-16T13:47:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78680046e0 con 0x7f787015e2f0 2023-10-16T13:47:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78700b39c0 con 0x7f787015e2f0 2023-10-16T13:47:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868012430 con 0x7f787015e2f0 2023-10-16T13:47:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.060+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78700b3080 con 0x7f787015e2f0 2023-10-16T13:47:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.061+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78700b41c0 con 0x7f787015e2f0 2023-10-16T13:47:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.061+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f7868012590 con 0x7f787015e2f0 2023-10-16T13:47:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.062+0000 7f78667fc700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f785406b140 0x7f785406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.062+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f786808b530 con 0x7f787015e2f0 2023-10-16T13:47:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.062+0000 7f7875a99700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f785406b140 0x7f785406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.062+0000 7f7875a99700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f785406b140 0x7f785406d600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7860001eb0 tx=0x7f7860001e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.066+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78700b41c0 con 0x7f787015e2f0 2023-10-16T13:47:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.298+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f787015ec00 con 0x7f785406b140 2023-10-16T13:47:29.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.302+0000 7f78667fc700 1 -- 172.21.15.5:0/2712995349 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+533 (secure 0 0 0) 0x7f786000f690 con 0x7f785406b140 2023-10-16T13:47:29.305 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:47:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_addrs": [ 2023-10-16T13:47:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.5:6789", 2023-10-16T13:47:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6789", 2023-10-16T13:47:29.305 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6790" 2023-10-16T13:47:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:47:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "pending_subvolume_deletions": 0, 2023-10-16T13:47:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": { 2023-10-16T13:47:29.306 INFO:teuthology.orchestra.run.smithi005.stdout: "data": [ 2023-10-16T13:47:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:29.307 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": " 341G", 2023-10-16T13:47:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_data", 2023-10-16T13:47:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: "used": " 0 " 2023-10-16T13:47:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:29.308 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:47:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": [ 2023-10-16T13:47:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": " 341G", 2023-10-16T13:47:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_metadata", 2023-10-16T13:47:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: "used": "64.0k" 2023-10-16T13:47:29.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:47:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:29.311 INFO:teuthology.orchestra.run.smithi005.stdout: "used_size": " 0 " 2023-10-16T13:47:29.312 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f785406b140 msgr2=0x7f785406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f785406b140 0x7f785406d600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7860001eb0 tx=0x7f7860001e40 comp rx=0 tx=0).stop 2023-10-16T13:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 msgr2=0x7f787015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 0x7f787015c1c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f786800b020 tx=0x7f7868004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 shutdown_connections 2023-10-16T13:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787015e2f0 0x7f787015c1c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f785406b140 0x7f785406d600 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f787006a840 0x7f78700b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 --2- 172.21.15.5:0/2712995349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78700cd950 0x7f78700af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 >> 172.21.15.5:0/2712995349 conn(0x7f787006dae0 msgr2=0x7f78700ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 shutdown_connections 2023-10-16T13:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.304+0000 7f7877cfd700 1 -- 172.21.15.5:0/2712995349 wait complete. 2023-10-16T13:47:29.319 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:47:29.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:47:29.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:47:29.414 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:47:29.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:29.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:29.433 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:29.433 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:29.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.654+0000 7faa54162700 1 Processor -- start 2023-10-16T13:47:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.654+0000 7faa54162700 1 -- start start 2023-10-16T13:47:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa54162700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 0x7faa4c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa54162700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c070040 con 0x7faa4c0728e0 2023-10-16T13:47:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa54162700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c0afce0 con 0x7faa4c15a8e0 2023-10-16T13:47:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa54162700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0d0420 con 0x7faa4c0b2980 2023-10-16T13:47:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa526ff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa4c0728e0 0x7faa4c15e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57074/0 (socket says 172.21.15.5:57074) 2023-10-16T13:47:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa526ff700 1 -- 172.21.15.5:0/2465967522 learned_addr learned my addr 172.21.15.5:0/2465967522 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110028320 0 0) 0x7faa4c070040 con 0x7faa4c0728e0 2023-10-16T13:47:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa516fd700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 0x7faa4c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa380035b0 con 0x7faa4c0728e0 2023-10-16T13:47:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4124388890 0 0) 0x7faa380035b0 con 0x7faa4c0728e0 2023-10-16T13:47:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 msgr2=0x7faa4c06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 0x7faa4c06fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 >> v1:172.21.15.112:6789/0 conn(0x7faa4c15a8e0 legacy=0x7faa4c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c071e00 con 0x7faa4c0728e0 2023-10-16T13:47:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.655+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7faa440019f0 con 0x7faa4c0728e0 2023-10-16T13:47:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 >> v1:172.21.15.5:6789/0 conn(0x7faa4c0728e0 legacy=0x7faa4c15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 0x7faa38003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa38003fb0 0x7faa38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa38004d90 0x7faa38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0d0420 con 0x7faa38004d90 2023-10-16T13:47:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800baf0 con 0x7faa38003fb0 2023-10-16T13:47:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800bcb0 con 0x7faa4c0b2980 2023-10-16T13:47:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa38004d90 0x7faa38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa516fd700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa38003fb0 0x7faa38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa51efe700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 0x7faa38003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 -- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 msgr2=0x7faa38003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c0b2980 0x7faa38003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 -- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa38003fb0 msgr2=0x7faa38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa38003fb0 0x7faa38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 -- 172.21.15.5:0/2465967522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380035b0 con 0x7faa38004d90 2023-10-16T13:47:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa526ff700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa38004d90 0x7faa38005210 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0b3150 tx=0x7faa38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c119904f663f7a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44010690 con 0x7faa38004d90 2023-10-16T13:47:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440107f0 con 0x7faa38004d90 2023-10-16T13:47:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.656+0000 7faa50efc700 1 -- 172.21.15.5:0/2465967522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44010b60 con 0x7faa38004d90 2023-10-16T13:47:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa54162700 1 -- 172.21.15.5:0/2465967522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa38004d90 msgr2=0x7faa38005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa54162700 1 --2- 172.21.15.5:0/2465967522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa38004d90 0x7faa38005210 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0b3150 tx=0x7faa38005880 comp rx=0 tx=0).stop 2023-10-16T13:47:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa526ff700 1 -- 172.21.15.5:0/2465967522 reap_dead start 2023-10-16T13:47:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa54162700 1 -- 172.21.15.5:0/2465967522 shutdown_connections 2023-10-16T13:47:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa54162700 1 -- 172.21.15.5:0/2465967522 >> 172.21.15.5:0/2465967522 conn(0x7faa4c0cd270 msgr2=0x7faa4c0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa54162700 1 -- 172.21.15.5:0/2465967522 shutdown_connections 2023-10-16T13:47:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.657+0000 7faa54162700 1 -- 172.21.15.5:0/2465967522 wait complete. 2023-10-16T13:47:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.658+0000 7faa54162700 1 Processor -- start 2023-10-16T13:47:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.658+0000 7faa54162700 1 -- start start 2023-10-16T13:47:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa54162700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c155ce0 0x7faa4c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa54162700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 0x7faa4c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa54162700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4c15d9d0 0x7faa4c0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa54162700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15de50 con 0x7faa4c15b430 2023-10-16T13:47:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa54162700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15c670 con 0x7faa4c15d9d0 2023-10-16T13:47:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa54162700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0acbb0 con 0x7faa4c155ce0 2023-10-16T13:47:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 0x7faa4c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 0x7faa4c15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47078/0 (socket says 172.21.15.5:47078) 2023-10-16T13:47:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 -- 172.21.15.5:0/3541668385 learned_addr learned my addr 172.21.15.5:0/3541668385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa526ff700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4c15d9d0 0x7faa4c0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa51efe700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c155ce0 0x7faa4c15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 -- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c155ce0 msgr2=0x7faa4c15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c155ce0 0x7faa4c15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 -- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4c15d9d0 msgr2=0x7faa4c0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4c15d9d0 0x7faa4c0ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa516fd700 1 -- 172.21.15.5:0/3541668385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c15ba60 con 0x7faa4c15b430 2023-10-16T13:47:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.659+0000 7faa526ff700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4c15d9d0 0x7faa4c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.660+0000 7faa516fd700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 0x7faa4c15d490 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faa3c011aa0 tx=0x7faa3c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.660+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00f920 con 0x7faa4c15b430 2023-10-16T13:47:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.660+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00fa80 con 0x7faa4c15b430 2023-10-16T13:47:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.660+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c15bd40 con 0x7faa4c15b430 2023-10-16T13:47:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.660+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00fe30 con 0x7faa4c15b430 2023-10-16T13:47:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.660+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c15c300 con 0x7faa4c15b430 2023-10-16T13:47:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.661+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c06f550 con 0x7faa4c15b430 2023-10-16T13:47:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.661+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7faa3c014440 con 0x7faa4c15b430 2023-10-16T13:47:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.662+0000 7faa427fc700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faa3006b140 0x7faa3006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.662+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3c08a130 con 0x7faa4c15b430 2023-10-16T13:47:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.662+0000 7faa51efe700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faa3006b140 0x7faa3006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.662+0000 7faa51efe700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faa3006b140 0x7faa3006d600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faa48005690 tx=0x7faa48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.667+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa3c054fd0 con 0x7faa4c15b430 2023-10-16T13:47:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.868+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa4c06c760 con 0x7faa4c15b430 2023-10-16T13:47:29.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.869+0000 7faa427fc700 1 -- 172.21.15.5:0/3541668385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16488 (secure 0 0 0) 0x7faa3c0585f0 con 0x7faa4c15b430 2023-10-16T13:47:29.872 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:29.872 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:18.949509+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:29.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faa3006b140 msgr2=0x7faa3006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faa3006b140 0x7faa3006d600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faa48005690 tx=0x7faa48009040 comp rx=0 tx=0).stop 2023-10-16T13:47:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 msgr2=0x7faa4c15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 0x7faa4c15d490 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faa3c011aa0 tx=0x7faa3c011e60 comp rx=0 tx=0).stop 2023-10-16T13:47:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 shutdown_connections 2023-10-16T13:47:29.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4c15d9d0 0x7faa4c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faa3006b140 0x7faa3006d600 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa4c155ce0 0x7faa4c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 --2- 172.21.15.5:0/3541668385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15b430 0x7faa4c15d490 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 >> 172.21.15.5:0/3541668385 conn(0x7faa4c0cd270 msgr2=0x7faa4c0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.871+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 shutdown_connections 2023-10-16T13:47:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:29.872+0000 7faa54162700 1 -- 172.21.15.5:0/3541668385 wait complete. 2023-10-16T13:47:29.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:47:15.233911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:47:16.326353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:29.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 Processor -- start 2023-10-16T13:47:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 -- start start 2023-10-16T13:47:30.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12a806af50 0x7f12a80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12a80b28b0 0x7f12a80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80b3530 con 0x7f12a815f130 2023-10-16T13:47:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80cde00 con 0x7f12a806af50 2023-10-16T13:47:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12adcdf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80cd180 con 0x7f12a80b28b0 2023-10-16T13:47:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.014+0000 7f12a77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12a815f130 0x7f12a806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57090/0 (socket says 172.21.15.5:57090) 2023-10-16T13:47:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a77fe700 1 -- 172.21.15.5:0/1169196714 learned_addr learned my addr 172.21.15.5:0/1169196714 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:30.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1169196714 >> v2:172.21.15.5:3300/0 conn(0x7f12a806af50 0x7f12a80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a7fff700 1 --2- 172.21.15.5:0/1169196714 >> v2:172.21.15.112:3300/0 conn(0x7f12a80b28b0 0x7f12a80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a67fc700 1 -- 172.21.15.5:0/1169196714 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812312862 0 0) 0x7f12a80b3530 con 0x7f12a815f130 2023-10-16T13:47:30.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a67fc700 1 -- 172.21.15.5:0/1169196714 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12900035b0 con 0x7f12a815f130 2023-10-16T13:47:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a6ffd700 1 -- 172.21.15.5:0/1169196714 >> v2:172.21.15.112:3300/0 conn(0x7f12a80b28b0 msgr2=0x7f12a80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1169196714 >> v2:172.21.15.112:3300/0 conn(0x7f12a80b28b0 0x7f12a80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a6ffd700 1 -- 172.21.15.5:0/1169196714 >> v1:172.21.15.5:6789/0 conn(0x7f12a815f130 legacy=0x7f12a806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a6ffd700 1 -- 172.21.15.5:0/1169196714 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80cd460 con 0x7f12a806af50 2023-10-16T13:47:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1169196714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80cede0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f12a80d02d0 tx=0x7f129c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4baedc665b91c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a67fc700 1 -- 172.21.15.5:0/1169196714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c005e30 con 0x7f12a806af50 2023-10-16T13:47:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a67fc700 1 -- 172.21.15.5:0/1169196714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c006030 con 0x7f12a806af50 2023-10-16T13:47:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.015+0000 7f12a67fc700 1 -- 172.21.15.5:0/1169196714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0063c0 con 0x7f12a806af50 2023-10-16T13:47:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 -- 172.21.15.5:0/1169196714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 msgr2=0x7f12a80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1169196714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80cede0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f12a80d02d0 tx=0x7f129c009b00 comp rx=0 tx=0).stop 2023-10-16T13:47:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 -- 172.21.15.5:0/1169196714 shutdown_connections 2023-10-16T13:47:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1169196714 >> v2:172.21.15.112:3300/0 conn(0x7f12a80b28b0 0x7f12a80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1169196714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80cede0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 -- 172.21.15.5:0/1169196714 >> 172.21.15.5:0/1169196714 conn(0x7f12a806dae0 msgr2=0x7f12a806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 -- 172.21.15.5:0/1169196714 shutdown_connections 2023-10-16T13:47:30.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.016+0000 7f12adcdf700 1 -- 172.21.15.5:0/1169196714 wait complete. 2023-10-16T13:47:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.017+0000 7f12adcdf700 1 Processor -- start 2023-10-16T13:47:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.017+0000 7f12adcdf700 1 -- start start 2023-10-16T13:47:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12adcdf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12adcdf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a80b28b0 0x7f12a8156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12adcdf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a815f130 0x7f12a815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12adcdf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80c6b10 con 0x7f12a806af50 2023-10-16T13:47:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12adcdf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80c9350 con 0x7f12a815f130 2023-10-16T13:47:30.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12adcdf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8156aa0 con 0x7f12a80b28b0 2023-10-16T13:47:30.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47092/0 (socket says 172.21.15.5:47092) 2023-10-16T13:47:30.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 -- 172.21.15.5:0/1030116929 learned_addr learned my addr 172.21.15.5:0/1030116929 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:30.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a7fff700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a815f130 0x7f12a815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a80b28b0 0x7f12a8156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 -- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a80b28b0 msgr2=0x7f12a8156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a80b28b0 0x7f12a8156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 -- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a815f130 msgr2=0x7f12a815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a815f130 0x7f12a815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a77fe700 1 -- 172.21.15.5:0/1030116929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c009430 con 0x7f12a806af50 2023-10-16T13:47:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a7fff700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a815f130 0x7f12a815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.018+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a80b28b0 0x7f12a8156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.019+0000 7f12a77fe700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80c97e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f129800c730 tx=0x7f129800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.019+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298005d70 con 0x7f12a806af50 2023-10-16T13:47:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.019+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980070d0 con 0x7f12a806af50 2023-10-16T13:47:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.019+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a80c6570 con 0x7f12a806af50 2023-10-16T13:47:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.019+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298007440 con 0x7f12a806af50 2023-10-16T13:47:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.019+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a80c8fe0 con 0x7f12a806af50 2023-10-16T13:47:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.020+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a80c9630 con 0x7f12a806af50 2023-10-16T13:47:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.020+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f12980075a0 con 0x7f12a806af50 2023-10-16T13:47:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.021+0000 7f128ffff700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129406b140 0x7f129406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.021+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1298088e70 con 0x7f12a806af50 2023-10-16T13:47:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.021+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129406b140 0x7f129406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.021+0000 7f12a6ffd700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129406b140 0x7f129406d600 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f12a80d02d0 tx=0x7f129c008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.025+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1298053c70 con 0x7f12a806af50 2023-10-16T13:47:30.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.226+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12a8067d20 con 0x7f12a806af50 2023-10-16T13:47:30.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.226+0000 7f128ffff700 1 -- 172.21.15.5:0/1030116929 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12980170a0 con 0x7f12a806af50 2023-10-16T13:47:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129406b140 msgr2=0x7f129406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129406b140 0x7f129406d600 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f12a80d02d0 tx=0x7f129c008070 comp rx=0 tx=0).stop 2023-10-16T13:47:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 msgr2=0x7f12a80c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80c97e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f129800c730 tx=0x7f129800caf0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 shutdown_connections 2023-10-16T13:47:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a815f130 0x7f12a815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a806af50 0x7f12a80c97e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129406b140 0x7f129406d600 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 --2- 172.21.15.5:0/1030116929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a80b28b0 0x7f12a8156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 >> 172.21.15.5:0/1030116929 conn(0x7f12a806dae0 msgr2=0x7f12a80b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:30.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 shutdown_connections 2023-10-16T13:47:30.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.228+0000 7f12adcdf700 1 -- 172.21.15.5:0/1030116929 wait complete. 2023-10-16T13:47:30.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:47:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.368+0000 7f1251101700 1 Processor -- start 2023-10-16T13:47:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.368+0000 7f1251101700 1 -- start start 2023-10-16T13:47:30.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1251101700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f124c06af50 0x7f124c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1251101700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c0b2d60 con 0x7f124c15e2f0 2023-10-16T13:47:30.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1251101700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c0cdd30 con 0x7f124c0cd950 2023-10-16T13:47:30.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1251101700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c1619a0 con 0x7f124c06af50 2023-10-16T13:47:30.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f124a59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f124c15e2f0 0x7f124c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57104/0 (socket says 172.21.15.5:57104) 2023-10-16T13:47:30.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f124a59c700 1 -- 172.21.15.5:0/2895133362 learned_addr learned my addr 172.21.15.5:0/2895133362 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:30.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f124b59e700 1 --2- 172.21.15.5:0/2895133362 >> v2:172.21.15.112:3300/0 conn(0x7f124c06af50 0x7f124c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511837191 0 0) 0x7f124c0b2d60 con 0x7f124c15e2f0 2023-10-16T13:47:30.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12340035b0 con 0x7f124c15e2f0 2023-10-16T13:47:30.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089972598 0 0) 0x7f12340035b0 con 0x7f124c15e2f0 2023-10-16T13:47:30.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 >> v2:172.21.15.112:3300/0 conn(0x7f124c06af50 msgr2=0x7f124c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:30.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.369+0000 7f1249d9b700 1 --2- 172.21.15.5:0/2895133362 >> v2:172.21.15.112:3300/0 conn(0x7f124c06af50 0x7f124c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 >> v1:172.21.15.112:6789/0 conn(0x7f124c0cd950 legacy=0x7f124c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c15e920 con 0x7f124c15e2f0 2023-10-16T13:47:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f123c0017f0 con 0x7f124c15e2f0 2023-10-16T13:47:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 >> v1:172.21.15.5:6789/0 conn(0x7f124c15e2f0 legacy=0x7f124c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1234003a00 0x7f1234003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234004850 0x7f1234004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1234005210 0x7f123400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c1619a0 con 0x7f1234003a00 2023-10-16T13:47:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123400c0b0 con 0x7f1234005210 2023-10-16T13:47:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123400c270 con 0x7f1234004850 2023-10-16T13:47:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1234003a00 0x7f1234003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124b59e700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1234005210 0x7f123400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124a59c700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234004850 0x7f1234004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 -- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234004850 msgr2=0x7f1234004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234004850 0x7f1234004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 -- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1234005210 msgr2=0x7f123400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1234005210 0x7f123400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 -- 172.21.15.5:0/2895133362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340035b0 con 0x7f1234003a00 2023-10-16T13:47:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124b59e700 1 -- 172.21.15.5:0/2895133362 reap_dead start 2023-10-16T13:47:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124a59c700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234004850 0x7f1234004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f124ad9d700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1234003a00 0x7f1234003e20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1240001800 tx=0x7f1234005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb229355496ac21 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400012f0 con 0x7f1234003a00 2023-10-16T13:47:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1240005310 con 0x7f1234003a00 2023-10-16T13:47:30.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.370+0000 7f1249d9b700 1 -- 172.21.15.5:0/2895133362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240006860 con 0x7f1234003a00 2023-10-16T13:47:30.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 -- 172.21.15.5:0/2895133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1234003a00 msgr2=0x7f1234003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1234003a00 0x7f1234003e20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1240001800 tx=0x7f1234005880 comp rx=0 tx=0).stop 2023-10-16T13:47:30.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 -- 172.21.15.5:0/2895133362 shutdown_connections 2023-10-16T13:47:30.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 --2- 172.21.15.5:0/2895133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1234003a00 0x7f1234003e20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 -- 172.21.15.5:0/2895133362 >> 172.21.15.5:0/2895133362 conn(0x7f124c06dae0 msgr2=0x7f124c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 -- 172.21.15.5:0/2895133362 shutdown_connections 2023-10-16T13:47:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.371+0000 7f1251101700 1 -- 172.21.15.5:0/2895133362 wait complete. 2023-10-16T13:47:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.372+0000 7f1251101700 1 Processor -- start 2023-10-16T13:47:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 -- start start 2023-10-16T13:47:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234003a00 0x7f124c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f124c0c4f50 0x7f124c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 0x7f124c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0c5a90 con 0x7f124c0ae590 2023-10-16T13:47:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c1f54b0 con 0x7f124c0c4f50 2023-10-16T13:47:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f1251101700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0c54d0 con 0x7f1234003a00 2023-10-16T13:47:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f124b59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 0x7f124c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f124b59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 0x7f124c0aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47114/0 (socket says 172.21.15.5:47114) 2023-10-16T13:47:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.373+0000 7f124b59e700 1 -- 172.21.15.5:0/3130000238 learned_addr learned my addr 172.21.15.5:0/3130000238 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124a59c700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f124c0c4f50 0x7f124c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124ad9d700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234003a00 0x7f124c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124b59e700 1 -- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234003a00 msgr2=0x7f124c0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124b59e700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234003a00 0x7f124c0c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124b59e700 1 -- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f124c0c4f50 msgr2=0x7f124c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124b59e700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f124c0c4f50 0x7f124c0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124b59e700 1 -- 172.21.15.5:0/3130000238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c0c57b0 con 0x7f124c0ae590 2023-10-16T13:47:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f124b59e700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 0x7f124c0aea10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f124c0cdfc0 tx=0x7f1244011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400e040 con 0x7f124c0ae590 2023-10-16T13:47:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400f040 con 0x7f124c0ae590 2023-10-16T13:47:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c1f5140 con 0x7f124c0ae590 2023-10-16T13:47:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400fbe0 con 0x7f124c0ae590 2023-10-16T13:47:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.374+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c0af250 con 0x7f124c0ae590 2023-10-16T13:47:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.375+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c1f4fa0 con 0x7f124c0ae590 2023-10-16T13:47:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.376+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f124400fd40 con 0x7f124c0ae590 2023-10-16T13:47:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.376+0000 7f12337fe700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f123806b140 0x7f123806d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.376+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f124408a260 con 0x7f124c0ae590 2023-10-16T13:47:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.376+0000 7f124ad9d700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f123806b140 0x7f123806d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.377+0000 7f124ad9d700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f123806b140 0x7f123806d600 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1240001800 tx=0x7f1240009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.381+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f124c1f4fa0 con 0x7f124c0ae590 2023-10-16T13:47:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.579+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f124c1f4fa0 con 0x7f124c0ae590 2023-10-16T13:47:30.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.580+0000 7f12337fe700 1 -- 172.21.15.5:0/3130000238 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f124c1f4fa0 con 0x7f124c0ae590 2023-10-16T13:47:30.583 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:47:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f123806b140 msgr2=0x7f123806d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f123806b140 0x7f123806d600 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1240001800 tx=0x7f1240009030 comp rx=0 tx=0).stop 2023-10-16T13:47:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 msgr2=0x7f124c0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 0x7f124c0aea10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f124c0cdfc0 tx=0x7f1244011e20 comp rx=0 tx=0).stop 2023-10-16T13:47:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 shutdown_connections 2023-10-16T13:47:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124c0ae590 0x7f124c0aea10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f123806b140 0x7f123806d600 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1234003a00 0x7f124c0c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 --2- 172.21.15.5:0/3130000238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f124c0c4f50 0x7f124c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 >> 172.21.15.5:0/3130000238 conn(0x7f124c06dae0 msgr2=0x7f124c15da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 shutdown_connections 2023-10-16T13:47:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.582+0000 7f1251101700 1 -- 172.21.15.5:0/3130000238 wait complete. 2023-10-16T13:47:30.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:47:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.724+0000 7f7a8e854700 1 Processor -- start 2023-10-16T13:47:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.724+0000 7f7a8e854700 1 -- start start 2023-10-16T13:47:30.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8e854700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a8806e750 0x7f7a880ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8e854700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a880b54f0 0x7f7a880cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8e854700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a880b5c70 con 0x7f7a8806eb30 2023-10-16T13:47:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8e854700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a880b5990 con 0x7f7a8806e750 2023-10-16T13:47:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8e854700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815b2b0 con 0x7f7a880b54f0 2023-10-16T13:47:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a8806e750 0x7f7a880ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a8806e750 0x7f7a880ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47118/0 (socket says 172.21.15.5:47118) 2023-10-16T13:47:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 -- 172.21.15.5:0/1479666452 learned_addr learned my addr 172.21.15.5:0/1479666452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8cdf1700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a880b54f0 0x7f7a880cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 -- 172.21.15.5:0/1479666452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a880b54f0 msgr2=0x7f7a880cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a880b54f0 0x7f7a880cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 -- 172.21.15.5:0/1479666452 >> v1:172.21.15.112:6789/0 conn(0x7f7a8806eb30 legacy=0x7f7a8815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a87fff700 1 -- 172.21.15.5:0/1479666452 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8815b590 con 0x7f7a8806e750 2023-10-16T13:47:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.725+0000 7f7a8cdf1700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a880b54f0 0x7f7a880cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a87fff700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806e750 0x7f7a880ceec0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009920 tx=0x7f7a7c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124e8ace7bbc1f9f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a86ffd700 1 -- 172.21.15.5:0/1479666452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00ba20 con 0x7f7a8806e750 2023-10-16T13:47:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a86ffd700 1 -- 172.21.15.5:0/1479666452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00bb80 con 0x7f7a8806e750 2023-10-16T13:47:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a86ffd700 1 -- 172.21.15.5:0/1479666452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c009e70 con 0x7f7a8806e750 2023-10-16T13:47:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 -- 172.21.15.5:0/1479666452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806e750 msgr2=0x7f7a880ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806e750 0x7f7a880ceec0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009920 tx=0x7f7a7c009c30 comp rx=0 tx=0).stop 2023-10-16T13:47:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 -- 172.21.15.5:0/1479666452 shutdown_connections 2023-10-16T13:47:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a880b54f0 0x7f7a880cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1479666452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806e750 0x7f7a880ceec0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 -- 172.21.15.5:0/1479666452 >> 172.21.15.5:0/1479666452 conn(0x7f7a880cc6f0 msgr2=0x7f7a880ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 -- 172.21.15.5:0/1479666452 shutdown_connections 2023-10-16T13:47:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.726+0000 7f7a8e854700 1 -- 172.21.15.5:0/1479666452 wait complete. 2023-10-16T13:47:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.728+0000 7f7a8e854700 1 Processor -- start 2023-10-16T13:47:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.728+0000 7f7a8e854700 1 -- start start 2023-10-16T13:47:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.728+0000 7f7a8e854700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a8806e750 0x7f7a880afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.728+0000 7f7a8e854700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a8806eb30 0x7f7a88152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8e854700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 0x7f7a8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8e854700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880c6ee0 con 0x7f7a880b54f0 2023-10-16T13:47:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8e854700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880c36b0 con 0x7f7a8806eb30 2023-10-16T13:47:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8e854700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880b4430 con 0x7f7a8806e750 2023-10-16T13:47:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 0x7f7a8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 0x7f7a8806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47128/0 (socket says 172.21.15.5:47128) 2023-10-16T13:47:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 -- 172.21.15.5:0/1392833094 learned_addr learned my addr 172.21.15.5:0/1392833094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a877fe700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a8806eb30 0x7f7a88152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a87fff700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a8806e750 0x7f7a880afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 -- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a8806e750 msgr2=0x7f7a880afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a8806e750 0x7f7a880afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 -- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a8806eb30 msgr2=0x7f7a88152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a8806eb30 0x7f7a88152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 -- 172.21.15.5:0/1392833094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009550 con 0x7f7a880b54f0 2023-10-16T13:47:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8cdf1700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 0x7f7a8806a840 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000cd50 tx=0x7f7a8000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000cea0 con 0x7f7a880b54f0 2023-10-16T13:47:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000f480 con 0x7f7a880b54f0 2023-10-16T13:47:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a880b4710 con 0x7f7a880b54f0 2023-10-16T13:47:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000f830 con 0x7f7a880b54f0 2023-10-16T13:47:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.729+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a880b4cd0 con 0x7f7a880b54f0 2023-10-16T13:47:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.730+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a880c7020 con 0x7f7a880b54f0 2023-10-16T13:47:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.731+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f7a8000b040 con 0x7f7a880b54f0 2023-10-16T13:47:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.731+0000 7f7a84ff9700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a7406b140 0x7f7a7406d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.731+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a8008a240 con 0x7f7a880b54f0 2023-10-16T13:47:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.732+0000 7f7a87fff700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a7406b140 0x7f7a7406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.732+0000 7f7a87fff700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a7406b140 0x7f7a7406d600 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009c70 tx=0x7f7a7c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.736+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a80054de0 con 0x7f7a880b54f0 2023-10-16T13:47:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.935+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a88067d20 con 0x7f7a880b54f0 2023-10-16T13:47:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.935+0000 7f7a84ff9700 1 -- 172.21.15.5:0/1392833094 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a80058400 con 0x7f7a880b54f0 2023-10-16T13:47:30.939 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:47:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a7406b140 msgr2=0x7f7a7406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a7406b140 0x7f7a7406d600 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009c70 tx=0x7f7a7c008030 comp rx=0 tx=0).stop 2023-10-16T13:47:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 msgr2=0x7f7a8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 0x7f7a8806a840 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000cd50 tx=0x7f7a8000a560 comp rx=0 tx=0).stop 2023-10-16T13:47:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 shutdown_connections 2023-10-16T13:47:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a880b54f0 0x7f7a8806a840 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7a7406b140 0x7f7a7406d600 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a8806e750 0x7f7a880afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 --2- 172.21.15.5:0/1392833094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a8806eb30 0x7f7a88152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.937+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 >> 172.21.15.5:0/1392833094 conn(0x7f7a880cc6f0 msgr2=0x7f7a88071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.938+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 shutdown_connections 2023-10-16T13:47:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:30.938+0000 7f7a8e854700 1 -- 172.21.15.5:0/1392833094 wait complete. 2023-10-16T13:47:30.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:47:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.076+0000 7feee5f04700 1 Processor -- start 2023-10-16T13:47:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.076+0000 7feee5f04700 1 -- start start 2023-10-16T13:47:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feee5f04700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feee00cc3f0 0x7feee00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feee5f04700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee0071ab0 con 0x7feee0161670 2023-10-16T13:47:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feee5f04700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee0161bc0 con 0x7feee006af50 2023-10-16T13:47:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feee5f04700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee0161ea0 con 0x7feee00cc3f0 2023-10-16T13:47:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feedf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feee00cc3f0 0x7feee00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feedeffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feee0161670 0x7feee006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57138/0 (socket says 172.21.15.5:57138) 2023-10-16T13:47:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feedf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feee00cc3f0 0x7feee00cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47132/0 (socket says 172.21.15.5:47132) 2023-10-16T13:47:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.077+0000 7feedeffd700 1 -- 172.21.15.5:0/4071745061 learned_addr learned my addr 172.21.15.5:0/4071745061 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feedf7fe700 1 -- 172.21.15.5:0/4071745061 >> v1:172.21.15.112:6789/0 conn(0x7feee006af50 legacy=0x7feee0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feedf7fe700 1 -- 172.21.15.5:0/4071745061 >> v1:172.21.15.5:6789/0 conn(0x7feee0161670 legacy=0x7feee006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feedf7fe700 1 -- 172.21.15.5:0/4071745061 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0162180 con 0x7feee00cc3f0 2023-10-16T13:47:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feede7fc700 1 -- 172.21.15.5:0/4071745061 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741485986 0 0) 0x7feee0071ab0 con 0x7feee0161670 2023-10-16T13:47:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feedf7fe700 1 --2- 172.21.15.5:0/4071745061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee00cc3f0 0x7feee00cc7d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7feec8009840 tx=0x7feec8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bcbdde6bb9173b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feede7fc700 1 -- 172.21.15.5:0/4071745061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011830 con 0x7feee00cc3f0 2023-10-16T13:47:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feede7fc700 1 -- 172.21.15.5:0/4071745061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8011990 con 0x7feee00cc3f0 2023-10-16T13:47:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.078+0000 7feede7fc700 1 -- 172.21.15.5:0/4071745061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011d20 con 0x7feee00cc3f0 2023-10-16T13:47:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 -- 172.21.15.5:0/4071745061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee00cc3f0 msgr2=0x7feee00cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 --2- 172.21.15.5:0/4071745061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee00cc3f0 0x7feee00cc7d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7feec8009840 tx=0x7feec8009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 -- 172.21.15.5:0/4071745061 shutdown_connections 2023-10-16T13:47:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 --2- 172.21.15.5:0/4071745061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee00cc3f0 0x7feee00cc7d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 -- 172.21.15.5:0/4071745061 >> 172.21.15.5:0/4071745061 conn(0x7feee006dac0 msgr2=0x7feee006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 -- 172.21.15.5:0/4071745061 shutdown_connections 2023-10-16T13:47:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.079+0000 7feee5f04700 1 -- 172.21.15.5:0/4071745061 wait complete. 2023-10-16T13:47:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.080+0000 7feee5f04700 1 Processor -- start 2023-10-16T13:47:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.080+0000 7feee5f04700 1 -- start start 2023-10-16T13:47:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feee5f04700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 0x7feee0153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feee5f04700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee00cc3f0 0x7feee0154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feee5f04700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feee0161670 0x7feee00c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feee5f04700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee01f49a0 con 0x7feee006af50 2023-10-16T13:47:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feee5f04700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee01549f0 con 0x7feee00cc3f0 2023-10-16T13:47:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feee5f04700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee0154cd0 con 0x7feee0161670 2023-10-16T13:47:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 0x7feee0153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 0x7feee0153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47138/0 (socket says 172.21.15.5:47138) 2023-10-16T13:47:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 -- 172.21.15.5:0/813596496 learned_addr learned my addr 172.21.15.5:0/813596496 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedeffd700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee00cc3f0 0x7feee0154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedffff700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feee0161670 0x7feee00c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 -- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feee0161670 msgr2=0x7feee00c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feee0161670 0x7feee00c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 -- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee00cc3f0 msgr2=0x7feee0154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee00cc3f0 0x7feee0154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 -- 172.21.15.5:0/813596496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80094a0 con 0x7feee006af50 2023-10-16T13:47:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedeffd700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee00cc3f0 0x7feee0154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.081+0000 7feedf7fe700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 0x7feee0153c50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7feec80090b0 tx=0x7feec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.082+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec801a900 con 0x7feee006af50 2023-10-16T13:47:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.082+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec801aa60 con 0x7feee006af50 2023-10-16T13:47:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.082+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee0154fb0 con 0x7feee006af50 2023-10-16T13:47:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.082+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec801add0 con 0x7feee006af50 2023-10-16T13:47:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.082+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee01546d0 con 0x7feee006af50 2023-10-16T13:47:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.083+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee01f4ae0 con 0x7feee006af50 2023-10-16T13:47:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.083+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7feec8022070 con 0x7feee006af50 2023-10-16T13:47:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.083+0000 7feed7fff700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feec006b140 0x7feec006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.084+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec808ac30 con 0x7feee006af50 2023-10-16T13:47:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.084+0000 7feedeffd700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feec006b140 0x7feec006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.084+0000 7feedeffd700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feec006b140 0x7feec006d600 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feee0155e00 tx=0x7feed0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.088+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feee01f4ae0 con 0x7feee006af50 2023-10-16T13:47:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.304+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feee01f4ae0 con 0x7feee006af50 2023-10-16T13:47:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.304+0000 7feed7fff700 1 -- 172.21.15.5:0/813596496 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7feee01f4ae0 con 0x7feee006af50 2023-10-16T13:47:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feec006b140 msgr2=0x7feec006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feec006b140 0x7feec006d600 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feee0155e00 tx=0x7feed0009040 comp rx=0 tx=0).stop 2023-10-16T13:47:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 msgr2=0x7feee0153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 0x7feee0153c50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7feec80090b0 tx=0x7feec8004750 comp rx=0 tx=0).stop 2023-10-16T13:47:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 shutdown_connections 2023-10-16T13:47:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feec006b140 0x7feec006d600 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feee0161670 0x7feee00c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee006af50 0x7feee0153c50 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 --2- 172.21.15.5:0/813596496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee00cc3f0 0x7feee0154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 >> 172.21.15.5:0/813596496 conn(0x7feee006dac0 msgr2=0x7feee006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:31.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 shutdown_connections 2023-10-16T13:47:31.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.306+0000 7feee5f04700 1 -- 172.21.15.5:0/813596496 wait complete. 2023-10-16T13:47:31.312 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:47:31.321 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:47:31.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:31.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:31.366 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:47:31.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:31.367 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:47:31.384 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:31.384 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:31.406 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:31.406 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:31.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.586+0000 7f22b5e07700 1 Processor -- start 2023-10-16T13:47:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.586+0000 7f22b5e07700 1 -- start start 2023-10-16T13:47:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22b5e07700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22b015b740 0x7f22b00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22b5e07700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00ce6e0 0x7f22b00cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22b5e07700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00cf190 con 0x7f22b00d0c70 2023-10-16T13:47:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22b5e07700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b015bb20 con 0x7f22b015b740 2023-10-16T13:47:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22b5e07700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00cbd40 con 0x7f22b00ce6e0 2023-10-16T13:47:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22af7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22b015b740 0x7f22b00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22af7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22b015b740 0x7f22b00d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47146/0 (socket says 172.21.15.5:47146) 2023-10-16T13:47:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.587+0000 7f22af7fe700 1 -- 172.21.15.5:0/2015807717 learned_addr learned my addr 172.21.15.5:0/2015807717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22af7fe700 1 -- 172.21.15.5:0/2015807717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00ce6e0 msgr2=0x7f22b00cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22affff700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00ce6e0 0x7f22b00cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22af7fe700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00ce6e0 0x7f22b00cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22af7fe700 1 -- 172.21.15.5:0/2015807717 >> v1:172.21.15.112:6789/0 conn(0x7f22b00d0c70 legacy=0x7f22b00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22af7fe700 1 -- 172.21.15.5:0/2015807717 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00cc020 con 0x7f22b015b740 2023-10-16T13:47:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22affff700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00ce6e0 0x7f22b00cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22af7fe700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b015b740 0x7f22b00d1cd0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f22b015bc60 tx=0x7f22a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d058066b462400 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22ae7fc700 1 -- 172.21.15.5:0/2015807717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0004230 con 0x7f22b015b740 2023-10-16T13:47:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22ae7fc700 1 -- 172.21.15.5:0/2015807717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0004390 con 0x7f22b015b740 2023-10-16T13:47:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.588+0000 7f22ae7fc700 1 -- 172.21.15.5:0/2015807717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00036a0 con 0x7f22b015b740 2023-10-16T13:47:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 -- 172.21.15.5:0/2015807717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b015b740 msgr2=0x7f22b00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b015b740 0x7f22b00d1cd0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f22b015bc60 tx=0x7f22a0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 -- 172.21.15.5:0/2015807717 shutdown_connections 2023-10-16T13:47:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00ce6e0 0x7f22b00cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 --2- 172.21.15.5:0/2015807717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b015b740 0x7f22b00d1cd0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 -- 172.21.15.5:0/2015807717 >> 172.21.15.5:0/2015807717 conn(0x7f22b00665a0 msgr2=0x7f22b0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 -- 172.21.15.5:0/2015807717 shutdown_connections 2023-10-16T13:47:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.589+0000 7f22b5e07700 1 -- 172.21.15.5:0/2015807717 wait complete. 2023-10-16T13:47:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.590+0000 7f22b5e07700 1 Processor -- start 2023-10-16T13:47:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.590+0000 7f22b5e07700 1 -- start start 2023-10-16T13:47:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22b5e07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 0x7f22b00c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22b5e07700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00d0c70 0x7f22b0157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22b5e07700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22b015b740 0x7f22b0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22b5e07700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00b5af0 con 0x7f22b00ce6e0 2023-10-16T13:47:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22b5e07700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00b24a0 con 0x7f22b015b740 2023-10-16T13:47:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22b5e07700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00b51c0 con 0x7f22b00d0c70 2023-10-16T13:47:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.591+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 0x7f22b00c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 0x7f22b00c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47150/0 (socket says 172.21.15.5:47150) 2023-10-16T13:47:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 -- 172.21.15.5:0/4166178899 learned_addr learned my addr 172.21.15.5:0/4166178899 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22affff700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22b015b740 0x7f22b0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22aeffd700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00d0c70 0x7f22b0157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 -- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00d0c70 msgr2=0x7f22b0157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00d0c70 0x7f22b0157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 -- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22b015b740 msgr2=0x7f22b0159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22b015b740 0x7f22b0159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 -- 172.21.15.5:0/4166178899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009550 con 0x7f22b00ce6e0 2023-10-16T13:47:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22af7fe700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 0x7f22b00c8690 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f22b00ced20 tx=0x7f22a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0003da0 con 0x7f22b00ce6e0 2023-10-16T13:47:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000b670 con 0x7f22b00ce6e0 2023-10-16T13:47:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b00b5430 con 0x7f22b00ce6e0 2023-10-16T13:47:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000ba00 con 0x7f22b00ce6e0 2023-10-16T13:47:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.592+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00c8d70 con 0x7f22b00ce6e0 2023-10-16T13:47:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.593+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b00b5c30 con 0x7f22b00ce6e0 2023-10-16T13:47:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.594+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 89433+0+0 (secure 0 0 0) 0x7f22a000bb60 con 0x7f22b00ce6e0 2023-10-16T13:47:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.594+0000 7f22a7fff700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f229006b140 0x7f229006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.594+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22a008b100 con 0x7f22b00ce6e0 2023-10-16T13:47:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.594+0000 7f22aeffd700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f229006b140 0x7f229006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.595+0000 7f22aeffd700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f229006b140 0x7f229006d600 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f22b015ade0 tx=0x7f2298009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.599+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22a0055ee0 con 0x7f22b00ce6e0 2023-10-16T13:47:31.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.721+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f22a00562b0 con 0x7f22b00ce6e0 2023-10-16T13:47:31.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.804+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b0067d20 con 0x7f22b00ce6e0 2023-10-16T13:47:31.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.805+0000 7f22a7fff700 1 -- 172.21.15.5:0/4166178899 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f22a006f3d0 con 0x7f22b00ce6e0 2023-10-16T13:47:31.808 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:31.809 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:18.949509+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f229006b140 msgr2=0x7f229006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f229006b140 0x7f229006d600 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f22b015ade0 tx=0x7f2298009040 comp rx=0 tx=0).stop 2023-10-16T13:47:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 msgr2=0x7f22b00c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 0x7f22b00c8690 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f22b00ced20 tx=0x7f22a0004750 comp rx=0 tx=0).stop 2023-10-16T13:47:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 shutdown_connections 2023-10-16T13:47:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22b015b740 0x7f22b0159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22b00ce6e0 0x7f22b00c8690 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f229006b140 0x7f229006d600 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 --2- 172.21.15.5:0/4166178899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22b00d0c70 0x7f22b0157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 >> 172.21.15.5:0/4166178899 conn(0x7f22b00665a0 msgr2=0x7f22b015f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 shutdown_connections 2023-10-16T13:47:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.807+0000 7f22b5e07700 1 -- 172.21.15.5:0/4166178899 wait complete. 2023-10-16T13:47:31.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:47:15.233911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:47:16.326353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:31.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.948+0000 7f820a531700 1 Processor -- start 2023-10-16T13:47:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.948+0000 7f820a531700 1 -- start start 2023-10-16T13:47:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f820a531700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f820415e2f0 0x7f82040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f820a531700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f820406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f820a531700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040b2d60 con 0x7f82040cd950 2023-10-16T13:47:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f820a531700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82041619a0 con 0x7f820415e2f0 2023-10-16T13:47:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f820a531700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820406b1f0 con 0x7f820406a840 2023-10-16T13:47:31.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f8203fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82040cd950 0x7f820415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57162/0 (socket says 172.21.15.5:57162) 2023-10-16T13:47:31.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f8203fff700 1 -- 172.21.15.5:0/1193841350 learned_addr learned my addr 172.21.15.5:0/1193841350 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:31.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f8208ace700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f820406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f82037fe700 1 --2- 172.21.15.5:0/1193841350 >> v2:172.21.15.112:3300/0 conn(0x7f820415e2f0 0x7f82040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217822917 0 0) 0x7f82040b2d60 con 0x7f82040cd950 2023-10-16T13:47:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.949+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ec0035b0 con 0x7f82040cd950 2023-10-16T13:47:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225778715 0 0) 0x7f81ec0035b0 con 0x7f82040cd950 2023-10-16T13:47:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 msgr2=0x7f820406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f820406acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 >> v2:172.21.15.112:3300/0 conn(0x7f820415e2f0 msgr2=0x7f82040cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 --2- 172.21.15.5:0/1193841350 >> v2:172.21.15.112:3300/0 conn(0x7f820415e2f0 0x7f82040cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040cdd30 con 0x7f82040cd950 2023-10-16T13:47:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f81f4001670 con 0x7f82040cd950 2023-10-16T13:47:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8208ace700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f820406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 >> v1:172.21.15.5:6789/0 conn(0x7f82040cd950 legacy=0x7f820415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f81ec003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81ec003f60 0x7f81ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec004d90 0x7f81ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82041619a0 con 0x7f81ec003f60 2023-10-16T13:47:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820406b1f0 con 0x7f81ec004d90 2023-10-16T13:47:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec00ba10 con 0x7f820406a840 2023-10-16T13:47:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81ec003f60 0x7f81ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8203fff700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f81ec003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8208ace700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec004d90 0x7f81ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 -- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 msgr2=0x7f81ec003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f820406a840 0x7f81ec003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 -- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec004d90 msgr2=0x7f81ec005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:31.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec004d90 0x7f81ec005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 -- 172.21.15.5:0/1193841350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009a70 con 0x7f81ec003f60 2023-10-16T13:47:31.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f82037fe700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81ec003f60 0x7f81ec004850 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009b40 tx=0x7f81ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd0987632512560 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.950+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8005a20 con 0x7f81ec003f60 2023-10-16T13:47:31.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8005b80 con 0x7f81ec003f60 2023-10-16T13:47:31.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f8202ffd700 1 -- 172.21.15.5:0/1193841350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800e6c0 con 0x7f81ec003f60 2023-10-16T13:47:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f820a531700 1 -- 172.21.15.5:0/1193841350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81ec003f60 msgr2=0x7f81ec004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f820a531700 1 --2- 172.21.15.5:0/1193841350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81ec003f60 0x7f81ec004850 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009b40 tx=0x7f81ec005880 comp rx=0 tx=0).stop 2023-10-16T13:47:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f8208ace700 1 -- 172.21.15.5:0/1193841350 reap_dead start 2023-10-16T13:47:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f820a531700 1 -- 172.21.15.5:0/1193841350 shutdown_connections 2023-10-16T13:47:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f820a531700 1 -- 172.21.15.5:0/1193841350 >> 172.21.15.5:0/1193841350 conn(0x7f820406dae0 msgr2=0x7f820406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:31.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f820a531700 1 -- 172.21.15.5:0/1193841350 shutdown_connections 2023-10-16T13:47:31.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.951+0000 7f820a531700 1 -- 172.21.15.5:0/1193841350 wait complete. 2023-10-16T13:47:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.953+0000 7f820a531700 1 Processor -- start 2023-10-16T13:47:31.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.953+0000 7f820a531700 1 -- start start 2023-10-16T13:47:31.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f820a531700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec003f60 0x7f820415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f820a531700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 0x7f82040c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f820a531700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82040c9a70 0x7f82040c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f820a531700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c8620 con 0x7f82040c95f0 2023-10-16T13:47:31.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f820a531700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c8340 con 0x7f81ec003f60 2023-10-16T13:47:31.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f820a531700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c8b10 con 0x7f82040c9a70 2023-10-16T13:47:31.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 0x7f82040c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 0x7f82040c64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47172/0 (socket says 172.21.15.5:47172) 2023-10-16T13:47:31.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 -- 172.21.15.5:0/1395193213 learned_addr learned my addr 172.21.15.5:0/1395193213 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:31.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f8208ace700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82040c9a70 0x7f82040c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f8203fff700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec003f60 0x7f820415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 -- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82040c9a70 msgr2=0x7f82040c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82040c9a70 0x7f82040c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 -- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec003f60 msgr2=0x7f820415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec003f60 0x7f820415c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 -- 172.21.15.5:0/1395193213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040c8df0 con 0x7f82040c95f0 2023-10-16T13:47:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.954+0000 7f82037fe700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 0x7f82040c64f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f81f8000c00 tx=0x7f81f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.955+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8021070 con 0x7f82040c95f0 2023-10-16T13:47:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.955+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82040c90d0 con 0x7f82040c95f0 2023-10-16T13:47:31.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.955+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820415c9f0 con 0x7f82040c95f0 2023-10-16T13:47:31.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.955+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8004240 con 0x7f82040c95f0 2023-10-16T13:47:31.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.955+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80045b0 con 0x7f82040c95f0 2023-10-16T13:47:31.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.956+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e40052f0 con 0x7f82040c95f0 2023-10-16T13:47:31.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.956+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f81f80036a0 con 0x7f82040c95f0 2023-10-16T13:47:31.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.957+0000 7f8200ff9700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f81f006b200 0x7f81f006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:31.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.957+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81f808aa80 con 0x7f82040c95f0 2023-10-16T13:47:31.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.957+0000 7f8203fff700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f81f006b200 0x7f81f006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:31.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.957+0000 7f8203fff700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f81f006b200 0x7f81f006d6c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000c00 tx=0x7f81f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:31.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:31.962+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81f808ce60 con 0x7f82040c95f0 2023-10-16T13:47:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.160+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81e4005b20 con 0x7f82040c95f0 2023-10-16T13:47:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.160+0000 7f8200ff9700 1 -- 172.21.15.5:0/1395193213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81f8055870 con 0x7f82040c95f0 2023-10-16T13:47:32.163 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f81f006b200 msgr2=0x7f81f006d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f81f006b200 0x7f81f006d6c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000c00 tx=0x7f81f4009040 comp rx=0 tx=0).stop 2023-10-16T13:47:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 msgr2=0x7f82040c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 0x7f82040c64f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f81f8000c00 tx=0x7f81f80047c0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 shutdown_connections 2023-10-16T13:47:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f81f006b200 0x7f81f006d6c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82040c9a70 0x7f82040c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ec003f60 0x7f820415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 --2- 172.21.15.5:0/1395193213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82040c95f0 0x7f82040c64f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 >> 172.21.15.5:0/1395193213 conn(0x7f820406dae0 msgr2=0x7f8204160440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 shutdown_connections 2023-10-16T13:47:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.162+0000 7f820a531700 1 -- 172.21.15.5:0/1395193213 wait complete. 2023-10-16T13:47:32.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:47:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.301+0000 7f4242bf6700 1 Processor -- start 2023-10-16T13:47:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 -- start start 2023-10-16T13:47:32.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c15eab0 0x7f423c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f423c0cf6d0 0x7f423c0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f423c0d1bc0 0x7f423c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0cfb50 con 0x7f423c0cf6d0 2023-10-16T13:47:32.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c15ee90 con 0x7f423c0d1bc0 2023-10-16T13:47:32.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f4242bf6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c158370 con 0x7f423c15eab0 2023-10-16T13:47:32.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.302+0000 7f423bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f423c0cf6d0 0x7f423c0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f423c0cf6d0 0x7f423c0d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47178/0 (socket says 172.21.15.5:47178) 2023-10-16T13:47:32.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 -- 172.21.15.5:0/1968329258 learned_addr learned my addr 172.21.15.5:0/1968329258 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:32.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f4241193700 1 --2- 172.21.15.5:0/1968329258 >> v2:172.21.15.112:3300/0 conn(0x7f423c0d1bc0 0x7f423c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f4240992700 1 --2- 172.21.15.5:0/1968329258 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c15eab0 0x7f423c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 -- 172.21.15.5:0/1968329258 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c15eab0 msgr2=0x7f423c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 --2- 172.21.15.5:0/1968329258 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c15eab0 0x7f423c0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 -- 172.21.15.5:0/1968329258 >> v2:172.21.15.112:3300/0 conn(0x7f423c0d1bc0 msgr2=0x7f423c161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 --2- 172.21.15.5:0/1968329258 >> v2:172.21.15.112:3300/0 conn(0x7f423c0d1bc0 0x7f423c161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 -- 172.21.15.5:0/1968329258 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0d23b0 con 0x7f423c0cf6d0 2023-10-16T13:47:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f4241193700 1 --2- 172.21.15.5:0/1968329258 >> v2:172.21.15.112:3300/0 conn(0x7f423c0d1bc0 0x7f423c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423bfff700 1 --2- 172.21.15.5:0/1968329258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0cf6d0 0x7f423c0d1680 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f423c0cd190 tx=0x7f4228009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0572e0675c31164 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423b7fe700 1 -- 172.21.15.5:0/1968329258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228011830 con 0x7f423c0cf6d0 2023-10-16T13:47:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423b7fe700 1 -- 172.21.15.5:0/1968329258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228011990 con 0x7f423c0cf6d0 2023-10-16T13:47:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.303+0000 7f423b7fe700 1 -- 172.21.15.5:0/1968329258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228011d20 con 0x7f423c0cf6d0 2023-10-16T13:47:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 -- 172.21.15.5:0/1968329258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0cf6d0 msgr2=0x7f423c0d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 --2- 172.21.15.5:0/1968329258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0cf6d0 0x7f423c0d1680 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f423c0cd190 tx=0x7f4228009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 -- 172.21.15.5:0/1968329258 shutdown_connections 2023-10-16T13:47:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 --2- 172.21.15.5:0/1968329258 >> v2:172.21.15.112:3300/0 conn(0x7f423c0d1bc0 0x7f423c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 --2- 172.21.15.5:0/1968329258 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c15eab0 0x7f423c0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 --2- 172.21.15.5:0/1968329258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0cf6d0 0x7f423c0d1680 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 -- 172.21.15.5:0/1968329258 >> 172.21.15.5:0/1968329258 conn(0x7f423c0665a0 msgr2=0x7f423c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:32.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 -- 172.21.15.5:0/1968329258 shutdown_connections 2023-10-16T13:47:32.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.304+0000 7f4242bf6700 1 -- 172.21.15.5:0/1968329258 wait complete. 2023-10-16T13:47:32.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.305+0000 7f4242bf6700 1 Processor -- start 2023-10-16T13:47:32.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.305+0000 7f4242bf6700 1 -- start start 2023-10-16T13:47:32.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4242bf6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c0cf6d0 0x7f423c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4242bf6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 0x7f423c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4242bf6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f423c15eab0 0x7f423c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4242bf6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0af410 con 0x7f423c0d1bc0 2023-10-16T13:47:32.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4242bf6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0af6f0 con 0x7f423c15eab0 2023-10-16T13:47:32.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4242bf6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0af9d0 con 0x7f423c0cf6d0 2023-10-16T13:47:32.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 0x7f423c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 0x7f423c0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47188/0 (socket says 172.21.15.5:47188) 2023-10-16T13:47:32.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 -- 172.21.15.5:0/4053941094 learned_addr learned my addr 172.21.15.5:0/4053941094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:32.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4241193700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f423c15eab0 0x7f423c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f4240992700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c0cf6d0 0x7f423c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 -- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c0cf6d0 msgr2=0x7f423c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c0cf6d0 0x7f423c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 -- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f423c15eab0 msgr2=0x7f423c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f423c15eab0 0x7f423c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.306+0000 7f423bfff700 1 -- 172.21.15.5:0/4053941094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009550 con 0x7f423c0d1bc0 2023-10-16T13:47:32.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.307+0000 7f423bfff700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 0x7f423c0ae640 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4228009c10 tx=0x7f4228004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:32.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.307+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228004510 con 0x7f423c0d1bc0 2023-10-16T13:47:32.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.307+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422801e070 con 0x7f423c0d1bc0 2023-10-16T13:47:32.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.307+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c0afcb0 con 0x7f423c0d1bc0 2023-10-16T13:47:32.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.307+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42280038e0 con 0x7f423c0d1bc0 2023-10-16T13:47:32.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.307+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0b4b70 con 0x7f423c0d1bc0 2023-10-16T13:47:32.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.308+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0afec0 con 0x7f423c0d1bc0 2023-10-16T13:47:32.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.309+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f4228003a40 con 0x7f423c0d1bc0 2023-10-16T13:47:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.309+0000 7f42397fa700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f422006b1d0 0x7f422006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.310+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f422808acf0 con 0x7f423c0d1bc0 2023-10-16T13:47:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.310+0000 7f4240992700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f422006b1d0 0x7f422006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.310+0000 7f4240992700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f422006b1d0 0x7f422006d690 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4230009be0 tx=0x7f4230009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.314+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4228055b20 con 0x7f423c0d1bc0 2023-10-16T13:47:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.512+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f423c0b1700 con 0x7f423c0d1bc0 2023-10-16T13:47:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.513+0000 7f42397fa700 1 -- 172.21.15.5:0/4053941094 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4228059140 con 0x7f423c0d1bc0 2023-10-16T13:47:32.516 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:47:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f422006b1d0 msgr2=0x7f422006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f422006b1d0 0x7f422006d690 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4230009be0 tx=0x7f4230009210 comp rx=0 tx=0).stop 2023-10-16T13:47:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 msgr2=0x7f423c0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 0x7f423c0ae640 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4228009c10 tx=0x7f4228004750 comp rx=0 tx=0).stop 2023-10-16T13:47:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 shutdown_connections 2023-10-16T13:47:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f423c15eab0 0x7f423c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f422006b1d0 0x7f422006d690 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f423c0cf6d0 0x7f423c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 --2- 172.21.15.5:0/4053941094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423c0d1bc0 0x7f423c0ae640 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 >> 172.21.15.5:0/4053941094 conn(0x7f423c0665a0 msgr2=0x7f423c15dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 shutdown_connections 2023-10-16T13:47:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.515+0000 7f4242bf6700 1 -- 172.21.15.5:0/4053941094 wait complete. 2023-10-16T13:47:32.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:47:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.655+0000 7efd342f8700 1 Processor -- start 2023-10-16T13:47:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.655+0000 7efd342f8700 1 -- start start 2023-10-16T13:47:32.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd342f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd2c15b740 0x7efd2c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd342f8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c0ce6e0 0x7efd2c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd342f8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2c0cf190 con 0x7efd2c0d0c70 2023-10-16T13:47:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd342f8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c15bb20 con 0x7efd2c15b740 2023-10-16T13:47:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd342f8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0cbd40 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd32094700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd2c15b740 0x7efd2c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd32094700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd2c15b740 0x7efd2c0d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47192/0 (socket says 172.21.15.5:47192) 2023-10-16T13:47:32.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd31893700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efd2c0d0c70 0x7efd2c0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57196/0 (socket says 172.21.15.5:57196) 2023-10-16T13:47:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd32094700 1 -- 172.21.15.5:0/3567016087 learned_addr learned my addr 172.21.15.5:0/3567016087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.656+0000 7efd32895700 1 --2- 172.21.15.5:0/3567016087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c0ce6e0 0x7efd2c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd32094700 1 -- 172.21.15.5:0/3567016087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c0ce6e0 msgr2=0x7efd2c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd32094700 1 --2- 172.21.15.5:0/3567016087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c0ce6e0 0x7efd2c0cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd32094700 1 -- 172.21.15.5:0/3567016087 >> v1:172.21.15.5:6789/0 conn(0x7efd2c0d0c70 legacy=0x7efd2c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd32094700 1 -- 172.21.15.5:0/3567016087 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c0cc020 con 0x7efd2c15b740 2023-10-16T13:47:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd31092700 1 -- 172.21.15.5:0/3567016087 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127391532 0 0) 0x7efd2c0cf190 con 0x7efd2c0d0c70 2023-10-16T13:47:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd32094700 1 --2- 172.21.15.5:0/3567016087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c15b740 0x7efd2c0d1cd0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7efd2c15bc60 tx=0x7efd1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19d75f64ae4b4ab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd31092700 1 -- 172.21.15.5:0/3567016087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c004230 con 0x7efd2c15b740 2023-10-16T13:47:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd31092700 1 -- 172.21.15.5:0/3567016087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c004390 con 0x7efd2c15b740 2023-10-16T13:47:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd31092700 1 -- 172.21.15.5:0/3567016087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0036a0 con 0x7efd2c15b740 2023-10-16T13:47:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd342f8700 1 -- 172.21.15.5:0/3567016087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c15b740 msgr2=0x7efd2c0d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.657+0000 7efd342f8700 1 --2- 172.21.15.5:0/3567016087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c15b740 0x7efd2c0d1cd0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7efd2c15bc60 tx=0x7efd1c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.658+0000 7efd342f8700 1 -- 172.21.15.5:0/3567016087 shutdown_connections 2023-10-16T13:47:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.658+0000 7efd342f8700 1 --2- 172.21.15.5:0/3567016087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c0ce6e0 0x7efd2c0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.658+0000 7efd342f8700 1 --2- 172.21.15.5:0/3567016087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c15b740 0x7efd2c0d1cd0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.658+0000 7efd342f8700 1 -- 172.21.15.5:0/3567016087 >> 172.21.15.5:0/3567016087 conn(0x7efd2c0665a0 msgr2=0x7efd2c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.658+0000 7efd342f8700 1 -- 172.21.15.5:0/3567016087 shutdown_connections 2023-10-16T13:47:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.658+0000 7efd342f8700 1 -- 172.21.15.5:0/3567016087 wait complete. 2023-10-16T13:47:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.659+0000 7efd342f8700 1 Processor -- start 2023-10-16T13:47:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.659+0000 7efd342f8700 1 -- start start 2023-10-16T13:47:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 0x7efd2c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd2c0d0c70 0x7efd2c14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c15b740 0x7efd2c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c14efe0 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0c9840 con 0x7efd2c0d0c70 2023-10-16T13:47:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0c9b20 con 0x7efd2c15b740 2023-10-16T13:47:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 0x7efd2c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 0x7efd2c14bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47198/0 (socket says 172.21.15.5:47198) 2023-10-16T13:47:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 -- 172.21.15.5:0/244871480 learned_addr learned my addr 172.21.15.5:0/244871480 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd31893700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd2c0d0c70 0x7efd2c14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32895700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c15b740 0x7efd2c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 -- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c15b740 msgr2=0x7efd2c0c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c15b740 0x7efd2c0c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 -- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd2c0d0c70 msgr2=0x7efd2c14eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd2c0d0c70 0x7efd2c14eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 -- 172.21.15.5:0/244871480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009550 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd32094700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 0x7efd2c14bd20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000c00 tx=0x7efd1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c003e20 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c00b670 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c0c9e00 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00ba20 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.660+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c0b3f50 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.661+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c067d20 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.662+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7efd1c00bb80 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.662+0000 7efd22ffd700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efd1006b1d0 0x7efd1006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:32.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.662+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd1c08b260 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.662+0000 7efd31893700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efd1006b1d0 0x7efd1006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.663+0000 7efd31893700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efd1006b1d0 0x7efd1006d690 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b09d0 tx=0x7efd28007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.667+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd1c056050 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.867+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd2c066b20 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.867+0000 7efd22ffd700 1 -- 172.21.15.5:0/244871480 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd1c059670 con 0x7efd2c0ce6e0 2023-10-16T13:47:32.871 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:47:32.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efd1006b1d0 msgr2=0x7efd1006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efd1006b1d0 0x7efd1006d690 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b09d0 tx=0x7efd28007be0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 msgr2=0x7efd2c14bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 0x7efd2c14bd20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000c00 tx=0x7efd1c004750 comp rx=0 tx=0).stop 2023-10-16T13:47:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 shutdown_connections 2023-10-16T13:47:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efd1006b1d0 0x7efd1006d690 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd2c15b740 0x7efd2c0c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd2c0ce6e0 0x7efd2c14bd20 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 --2- 172.21.15.5:0/244871480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd2c0d0c70 0x7efd2c14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 >> 172.21.15.5:0/244871480 conn(0x7efd2c0665a0 msgr2=0x7efd2c15f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.869+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 shutdown_connections 2023-10-16T13:47:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:32.870+0000 7efd342f8700 1 -- 172.21.15.5:0/244871480 wait complete. 2023-10-16T13:47:32.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:47:33.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.010+0000 7fd2905bf700 1 Processor -- start 2023-10-16T13:47:33.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.010+0000 7fd2905bf700 1 -- start start 2023-10-16T13:47:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd2905bf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2880cc3f0 0x7fd2880cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd2905bf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd288161670 0x7fd28806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd2905bf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd288071ab0 con 0x7fd2880ccd10 2023-10-16T13:47:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd2905bf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd288161bc0 con 0x7fd288161670 2023-10-16T13:47:33.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd2905bf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd288161ea0 con 0x7fd2880cc3f0 2023-10-16T13:47:33.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd288161670 0x7fd28806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd288161670 0x7fd28806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47208/0 (socket says 172.21.15.5:47208) 2023-10-16T13:47:33.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 -- 172.21.15.5:0/3061380572 learned_addr learned my addr 172.21.15.5:0/3061380572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:33.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28e35b700 1 --2- 172.21.15.5:0/3061380572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2880cc3f0 0x7fd2880cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 -- 172.21.15.5:0/3061380572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2880cc3f0 msgr2=0x7fd2880cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:33.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 --2- 172.21.15.5:0/3061380572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2880cc3f0 0x7fd2880cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 -- 172.21.15.5:0/3061380572 >> v1:172.21.15.112:6789/0 conn(0x7fd2880ccd10 legacy=0x7fd288071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:33.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 -- 172.21.15.5:0/3061380572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288162180 con 0x7fd288161670 2023-10-16T13:47:33.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28db5a700 1 --2- 172.21.15.5:0/3061380572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd288161670 0x7fd28806a840 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098f0 tx=0x7fd284009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5a448e792e1095 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28d359700 1 -- 172.21.15.5:0/3061380572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400b8a0 con 0x7fd288161670 2023-10-16T13:47:33.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28d359700 1 -- 172.21.15.5:0/3061380572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400ba00 con 0x7fd288161670 2023-10-16T13:47:33.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.011+0000 7fd28d359700 1 -- 172.21.15.5:0/3061380572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400bd90 con 0x7fd288161670 2023-10-16T13:47:33.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 -- 172.21.15.5:0/3061380572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd288161670 msgr2=0x7fd28806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 --2- 172.21.15.5:0/3061380572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd288161670 0x7fd28806a840 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098f0 tx=0x7fd284009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:33.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 -- 172.21.15.5:0/3061380572 shutdown_connections 2023-10-16T13:47:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 --2- 172.21.15.5:0/3061380572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2880cc3f0 0x7fd2880cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 --2- 172.21.15.5:0/3061380572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd288161670 0x7fd28806a840 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 -- 172.21.15.5:0/3061380572 >> 172.21.15.5:0/3061380572 conn(0x7fd28806dac0 msgr2=0x7fd28806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 -- 172.21.15.5:0/3061380572 shutdown_connections 2023-10-16T13:47:33.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.012+0000 7fd2905bf700 1 -- 172.21.15.5:0/3061380572 wait complete. 2023-10-16T13:47:33.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.013+0000 7fd2905bf700 1 Processor -- start 2023-10-16T13:47:33.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.013+0000 7fd2905bf700 1 -- start start 2023-10-16T13:47:33.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd2905bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 0x7fd28815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd2905bf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2880ccd10 0x7fd2880c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd2905bf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd288161670 0x7fd2880b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd2905bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2881f2fb0 con 0x7fd2880cc3f0 2023-10-16T13:47:33.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd2905bf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880c6ab0 con 0x7fd2880ccd10 2023-10-16T13:47:33.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd2905bf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880b4380 con 0x7fd288161670 2023-10-16T13:47:33.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 0x7fd28815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 0x7fd28815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47212/0 (socket says 172.21.15.5:47212) 2023-10-16T13:47:33.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 -- 172.21.15.5:0/859876626 learned_addr learned my addr 172.21.15.5:0/859876626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 -- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd288161670 msgr2=0x7fd2880b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd288161670 0x7fd2880b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 -- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2880ccd10 msgr2=0x7fd2880c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2880ccd10 0x7fd2880c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.014+0000 7fd28e35b700 1 -- 172.21.15.5:0/859876626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009550 con 0x7fd2880cc3f0 2023-10-16T13:47:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.015+0000 7fd28e35b700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 0x7fd28815b5b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd27800d800 tx=0x7fd27800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.015+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780125f0 con 0x7fd2880cc3f0 2023-10-16T13:47:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.015+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd278012750 con 0x7fd2880cc3f0 2023-10-16T13:47:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.015+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2880b5a90 con 0x7fd2880cc3f0 2023-10-16T13:47:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.015+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278012b00 con 0x7fd2880cc3f0 2023-10-16T13:47:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.015+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2880ae930 con 0x7fd2880cc3f0 2023-10-16T13:47:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.016+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288067d20 con 0x7fd2880cc3f0 2023-10-16T13:47:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.016+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fd278012c60 con 0x7fd2880cc3f0 2023-10-16T13:47:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.017+0000 7fd27effd700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd26c06b1d0 0x7fd26c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.017+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd278089e60 con 0x7fd2880cc3f0 2023-10-16T13:47:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.017+0000 7fd28db5a700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd26c06b1d0 0x7fd26c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.017+0000 7fd28db5a700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd26c06b1d0 0x7fd26c06d690 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098f0 tx=0x7fd284010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.022+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd278054b80 con 0x7fd2880cc3f0 2023-10-16T13:47:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.240+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2880b6430 con 0x7fd2880cc3f0 2023-10-16T13:47:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.240+0000 7fd27effd700 1 -- 172.21.15.5:0/859876626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2780581a0 con 0x7fd2880cc3f0 2023-10-16T13:47:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd26c06b1d0 msgr2=0x7fd26c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd26c06b1d0 0x7fd26c06d690 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098f0 tx=0x7fd284010000 comp rx=0 tx=0).stop 2023-10-16T13:47:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 msgr2=0x7fd28815b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 0x7fd28815b5b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd27800d800 tx=0x7fd27800dbc0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 shutdown_connections 2023-10-16T13:47:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd26c06b1d0 0x7fd26c06d690 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd288161670 0x7fd2880b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2880cc3f0 0x7fd28815b5b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 --2- 172.21.15.5:0/859876626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2880ccd10 0x7fd2880c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 >> 172.21.15.5:0/859876626 conn(0x7fd28806dac0 msgr2=0x7fd28806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 shutdown_connections 2023-10-16T13:47:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.242+0000 7fd2905bf700 1 -- 172.21.15.5:0/859876626 wait complete. 2023-10-16T13:47:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:47:33.257 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:47:33.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:33.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:33.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:47:33.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:33.307 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:47:33.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:33.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:33.347 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:47:33.348 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:33.348 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:33.386 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:47:33.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.510+0000 7f42364c5700 1 Processor -- start 2023-10-16T13:47:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.510+0000 7f42364c5700 1 -- start start 2023-10-16T13:47:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f42364c5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f423015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f42364c5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f42300cede0 0x7f423015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f42364c5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300cf260 con 0x7f423006a840 2023-10-16T13:47:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f42364c5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42301619a0 con 0x7f42300cede0 2023-10-16T13:47:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f42364c5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300b2d60 con 0x7f42300cd950 2023-10-16T13:47:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f422f7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f42300cede0 0x7f423015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f422ffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f423015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f4234a62700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f423006a840 0x7f4230161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:48204/0 (socket says 172.21.15.5:48204) 2023-10-16T13:47:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f4234a62700 1 -- 172.21.15.5:0/971979602 learned_addr learned my addr 172.21.15.5:0/971979602 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f422effd700 1 -- 172.21.15.5:0/971979602 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26443997 0 0) 0x7f42300cf260 con 0x7f423006a840 2023-10-16T13:47:33.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.511+0000 7f422effd700 1 -- 172.21.15.5:0/971979602 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f421c0035b0 con 0x7f423006a840 2023-10-16T13:47:33.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422ffff700 1 -- 172.21.15.5:0/971979602 >> v2:172.21.15.112:3300/0 conn(0x7f42300cede0 msgr2=0x7f423015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:33.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422ffff700 1 --2- 172.21.15.5:0/971979602 >> v2:172.21.15.112:3300/0 conn(0x7f42300cede0 0x7f423015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422ffff700 1 -- 172.21.15.5:0/971979602 >> v1:172.21.15.112:6789/0 conn(0x7f423006a840 legacy=0x7f4230161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422ffff700 1 -- 172.21.15.5:0/971979602 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300cdd30 con 0x7f42300cd950 2023-10-16T13:47:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422f7fe700 1 --2- 172.21.15.5:0/971979602 >> v2:172.21.15.112:3300/0 conn(0x7f42300cede0 0x7f423015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422ffff700 1 --2- 172.21.15.5:0/971979602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f423015e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4220009840 tx=0x7f4220009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fc362ac0a21e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422effd700 1 -- 172.21.15.5:0/971979602 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220011830 con 0x7f42300cd950 2023-10-16T13:47:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422effd700 1 -- 172.21.15.5:0/971979602 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220011990 con 0x7f42300cd950 2023-10-16T13:47:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f422effd700 1 -- 172.21.15.5:0/971979602 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220011d20 con 0x7f42300cd950 2023-10-16T13:47:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f42364c5700 1 -- 172.21.15.5:0/971979602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 msgr2=0x7f423015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f42364c5700 1 --2- 172.21.15.5:0/971979602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f423015e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4220009840 tx=0x7f4220009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f42364c5700 1 -- 172.21.15.5:0/971979602 shutdown_connections 2023-10-16T13:47:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f42364c5700 1 --2- 172.21.15.5:0/971979602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f423015e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f42364c5700 1 --2- 172.21.15.5:0/971979602 >> v2:172.21.15.112:3300/0 conn(0x7f42300cede0 0x7f423015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.512+0000 7f42364c5700 1 -- 172.21.15.5:0/971979602 >> 172.21.15.5:0/971979602 conn(0x7f423006dae0 msgr2=0x7f423006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.513+0000 7f42364c5700 1 -- 172.21.15.5:0/971979602 shutdown_connections 2023-10-16T13:47:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.513+0000 7f42364c5700 1 -- 172.21.15.5:0/971979602 wait complete. 2023-10-16T13:47:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.514+0000 7f42364c5700 1 Processor -- start 2023-10-16T13:47:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.514+0000 7f42364c5700 1 -- start start 2023-10-16T13:47:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f42364c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 0x7f42300c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f42364c5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f42300b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f42364c5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42300cede0 0x7f42300b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f42364c5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42301f4ba0 con 0x7f423006a840 2023-10-16T13:47:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f42364c5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300b5630 con 0x7f42300cede0 2023-10-16T13:47:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f42364c5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300b5910 con 0x7f42300cd950 2023-10-16T13:47:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 0x7f42300c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 0x7f42300c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47226/0 (socket says 172.21.15.5:47226) 2023-10-16T13:47:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 -- 172.21.15.5:0/1253302838 learned_addr learned my addr 172.21.15.5:0/1253302838 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f4234a62700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42300cede0 0x7f42300b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422f7fe700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f42300b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 -- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 msgr2=0x7f42300b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f42300b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 -- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42300cede0 msgr2=0x7f42300b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42300cede0 0x7f42300b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 -- 172.21.15.5:0/1253302838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009430 con 0x7f423006a840 2023-10-16T13:47:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422ffff700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 0x7f42300c9e30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f42200090b0 tx=0x7f4220004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.515+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220004590 con 0x7f423006a840 2023-10-16T13:47:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.516+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200094a0 con 0x7f423006a840 2023-10-16T13:47:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.516+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422001f070 con 0x7f423006a840 2023-10-16T13:47:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.516+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200038e0 con 0x7f423006a840 2023-10-16T13:47:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.516+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42300b5ed0 con 0x7f423006a840 2023-10-16T13:47:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.517+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42301f4ce0 con 0x7f423006a840 2023-10-16T13:47:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.517+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f4220003a40 con 0x7f423006a840 2023-10-16T13:47:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.517+0000 7f422cff9700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.517+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4220021070 con 0x7f423006a840 2023-10-16T13:47:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.518+0000 7f422f7fe700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.518+0000 7f422f7fe700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42300cac80 tx=0x7f42180091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.522+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42301f4ce0 con 0x7f423006a840 2023-10-16T13:47:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.772+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42301f4ce0 con 0x7f423006a840 2023-10-16T13:47:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.772+0000 7f422cff9700 1 -- 172.21.15.5:0/1253302838 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f42301f4ce0 con 0x7f423006a840 2023-10-16T13:47:33.776 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:33.776 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:17.350421+0000","modified":"2023-10-16T13:47:20.404057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1286413980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1286413980},{"type":"v1","addr":"172.21.15.5:6834","nonce":1286413980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-16T13:47:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 msgr2=0x7f421006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42300cac80 tx=0x7f42180091c0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 msgr2=0x7f42300c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 0x7f42300c9e30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f42200090b0 tx=0x7f4220004750 comp rx=0 tx=0).stop 2023-10-16T13:47:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 shutdown_connections 2023-10-16T13:47:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42300cede0 0x7f42300b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f423006a840 0x7f42300c9e30 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 --2- 172.21.15.5:0/1253302838 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42300cd950 0x7f42300b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 >> 172.21.15.5:0/1253302838 conn(0x7f423006dae0 msgr2=0x7f423015d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 shutdown_connections 2023-10-16T13:47:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.775+0000 7f42364c5700 1 -- 172.21.15.5:0/1253302838 wait complete. 2023-10-16T13:47:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 51 2023-10-16T13:47:33.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.912+0000 7f9b61d3e700 1 Processor -- start 2023-10-16T13:47:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.912+0000 7f9b61d3e700 1 -- start start 2023-10-16T13:47:33.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.913+0000 7f9b61d3e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b5c15b740 0x7f9b5c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.913+0000 7f9b61d3e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c0d0c70 0x7f9b5c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.913+0000 7f9b61d3e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0cf190 con 0x7f9b5c0c5110 2023-10-16T13:47:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.913+0000 7f9b61d3e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c15bb20 con 0x7f9b5c15b740 2023-10-16T13:47:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.913+0000 7f9b61d3e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0cbd40 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5affd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c0d0c70 0x7f9b5c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b5c15b740 0x7f9b5c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9b5c0c5110 0x7f9b5c0cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:48218/0 (socket says 172.21.15.5:48218) 2023-10-16T13:47:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5bfff700 1 -- 172.21.15.5:0/3801269154 learned_addr learned my addr 172.21.15.5:0/3801269154 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5b7fe700 1 -- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c0d0c70 msgr2=0x7f9b5c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5b7fe700 1 --2- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c0d0c70 0x7f9b5c0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5b7fe700 1 -- 172.21.15.5:0/3801269154 >> v1:172.21.15.112:6789/0 conn(0x7f9b5c0c5110 legacy=0x7f9b5c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5b7fe700 1 -- 172.21.15.5:0/3801269154 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0cc020 con 0x7f9b5c15b740 2023-10-16T13:47:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5a7fc700 1 -- 172.21.15.5:0/3801269154 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781930829 0 0) 0x7f9b5c0cf190 con 0x7f9b5c0c5110 2023-10-16T13:47:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5affd700 1 --2- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c0d0c70 0x7f9b5c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5b7fe700 1 --2- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c15b740 0x7f9b5c0d1cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009840 tx=0x7f9b4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49eaded98def09ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5a7fc700 1 -- 172.21.15.5:0/3801269154 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c011830 con 0x7f9b5c15b740 2023-10-16T13:47:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5a7fc700 1 -- 172.21.15.5:0/3801269154 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c011990 con 0x7f9b5c15b740 2023-10-16T13:47:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.914+0000 7f9b5a7fc700 1 -- 172.21.15.5:0/3801269154 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c011d20 con 0x7f9b5c15b740 2023-10-16T13:47:33.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c15b740 msgr2=0x7f9b5c0d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c15b740 0x7f9b5c0d1cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009840 tx=0x7f9b4c009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3801269154 shutdown_connections 2023-10-16T13:47:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c15b740 0x7f9b5c0d1cd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3801269154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c0d0c70 0x7f9b5c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3801269154 >> 172.21.15.5:0/3801269154 conn(0x7f9b5c0665a0 msgr2=0x7f9b5c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3801269154 shutdown_connections 2023-10-16T13:47:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.915+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3801269154 wait complete. 2023-10-16T13:47:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.916+0000 7f9b61d3e700 1 Processor -- start 2023-10-16T13:47:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 -- start start 2023-10-16T13:47:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0c5110 0x7f9b5c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 0x7f9b5c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c15b740 0x7f9b5c15d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1f2bd0 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1573f0 con 0x7f9b5c0c5110 2023-10-16T13:47:33.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b61d3e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c8690 con 0x7f9b5c15b740 2023-10-16T13:47:33.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b5affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 0x7f9b5c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b5affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 0x7f9b5c15cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47242/0 (socket says 172.21.15.5:47242) 2023-10-16T13:47:33.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b5affd700 1 -- 172.21.15.5:0/3942329209 learned_addr learned my addr 172.21.15.5:0/3942329209 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b5b7fe700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0c5110 0x7f9b5c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.917+0000 7f9b5bfff700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c15b740 0x7f9b5c15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b5affd700 1 -- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c15b740 msgr2=0x7f9b5c15d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b5affd700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c15b740 0x7f9b5c15d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b5affd700 1 -- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0c5110 msgr2=0x7f9b5c0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b5affd700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0c5110 0x7f9b5c0b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b5affd700 1 -- 172.21.15.5:0/3942329209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440094a0 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b5affd700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 0x7f9b5c15cfc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ec10 tx=0x7f9b4400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400c850 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400c9b0 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c0094a0 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400cd20 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.918+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c0b4c70 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.919+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c067d20 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.920+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f9b44013470 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.920+0000 7f9b53fff700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b3c06b1d0 0x7f9b3c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.920+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b44089b30 con 0x7f9b5c0d0c70 2023-10-16T13:47:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.920+0000 7f9b5b7fe700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b3c06b1d0 0x7f9b3c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:33.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.921+0000 7f9b5b7fe700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b3c06b1d0 0x7f9b3c06d690 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0090b0 tx=0x7f9b4c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:33.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:33.925+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b44054810 con 0x7f9b5c0d0c70 2023-10-16T13:47:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.127+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b5c0b2b00 con 0x7f9b5c0d0c70 2023-10-16T13:47:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.129+0000 7f9b53fff700 1 -- 172.21.15.5:0/3942329209 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f9b44057e30 con 0x7f9b5c0d0c70 2023-10-16T13:47:34.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:34.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:18.949509+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.130+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b3c06b1d0 msgr2=0x7f9b3c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.130+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b3c06b1d0 0x7f9b3c06d690 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0090b0 tx=0x7f9b4c01c040 comp rx=0 tx=0).stop 2023-10-16T13:47:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.130+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 msgr2=0x7f9b5c15cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.130+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 0x7f9b5c15cfc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ec10 tx=0x7f9b4400ef20 comp rx=0 tx=0).stop 2023-10-16T13:47:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 shutdown_connections 2023-10-16T13:47:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9b3c06b1d0 0x7f9b3c06d690 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b5c15b740 0x7f9b5c15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0c5110 0x7f9b5c0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 --2- 172.21.15.5:0/3942329209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b5c0d0c70 0x7f9b5c15cfc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 >> 172.21.15.5:0/3942329209 conn(0x7f9b5c0665a0 msgr2=0x7f9b5c0c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:34.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 shutdown_connections 2023-10-16T13:47:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.131+0000 7f9b61d3e700 1 -- 172.21.15.5:0/3942329209 wait complete. 2023-10-16T13:47:34.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:47:15.233911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:47:16.326353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:34.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.272+0000 7f1fd405f700 1 Processor -- start 2023-10-16T13:47:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.272+0000 7f1fd405f700 1 -- start start 2023-10-16T13:47:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd405f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1fcc0d08a0 0x7f1fcc0d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd405f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1fcc0b7ab0 0x7f1fcc0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd405f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0b6610 con 0x7f1fcc160e30 2023-10-16T13:47:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd405f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0d1da0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd405f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0d2080 con 0x7f1fcc0d08a0 2023-10-16T13:47:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd25fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1fcc0b7ab0 0x7f1fcc0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd25fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1fcc0b7ab0 0x7f1fcc0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47252/0 (socket says 172.21.15.5:47252) 2023-10-16T13:47:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd25fc700 1 -- 172.21.15.5:0/7007288 learned_addr learned my addr 172.21.15.5:0/7007288 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.273+0000 7f1fd15fa700 1 --2- 172.21.15.5:0/7007288 >> v2:172.21.15.112:3300/0 conn(0x7f1fcc0d08a0 0x7f1fcc0d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd25fc700 1 -- 172.21.15.5:0/7007288 >> v2:172.21.15.112:3300/0 conn(0x7f1fcc0d08a0 msgr2=0x7f1fcc0d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd25fc700 1 --2- 172.21.15.5:0/7007288 >> v2:172.21.15.112:3300/0 conn(0x7f1fcc0d08a0 0x7f1fcc0d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd25fc700 1 -- 172.21.15.5:0/7007288 >> v1:172.21.15.112:6789/0 conn(0x7f1fcc160e30 legacy=0x7f1fcc0d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd25fc700 1 -- 172.21.15.5:0/7007288 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0d2360 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd25fc700 1 --2- 172.21.15.5:0/7007288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc0ce3d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0cdf10 tx=0x7f1fc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e19d5850bc80ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd0df9700 1 -- 172.21.15.5:0/7007288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400e070 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd0df9700 1 -- 172.21.15.5:0/7007288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400b9c0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd0df9700 1 -- 172.21.15.5:0/7007288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400bd70 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd405f700 1 -- 172.21.15.5:0/7007288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 msgr2=0x7f1fcc0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd405f700 1 --2- 172.21.15.5:0/7007288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc0ce3d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0cdf10 tx=0x7f1fc400b330 comp rx=0 tx=0).stop 2023-10-16T13:47:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd405f700 1 -- 172.21.15.5:0/7007288 shutdown_connections 2023-10-16T13:47:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd405f700 1 --2- 172.21.15.5:0/7007288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc0ce3d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.274+0000 7f1fd405f700 1 --2- 172.21.15.5:0/7007288 >> v2:172.21.15.112:3300/0 conn(0x7f1fcc0d08a0 0x7f1fcc0d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.275+0000 7f1fd405f700 1 -- 172.21.15.5:0/7007288 >> 172.21.15.5:0/7007288 conn(0x7f1fcc09cb40 msgr2=0x7f1fcc0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.275+0000 7f1fd405f700 1 -- 172.21.15.5:0/7007288 shutdown_connections 2023-10-16T13:47:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.275+0000 7f1fd405f700 1 -- 172.21.15.5:0/7007288 wait complete. 2023-10-16T13:47:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.276+0000 7f1fd405f700 1 Processor -- start 2023-10-16T13:47:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.276+0000 7f1fd405f700 1 -- start start 2023-10-16T13:47:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fcc0d08a0 0x7f1fcc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fcc160e30 0x7f1fcc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1598d0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0c7a00 con 0x7f1fcc0d08a0 2023-10-16T13:47:34.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc159310 con 0x7f1fcc160e30 2023-10-16T13:47:34.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47254/0 (socket says 172.21.15.5:47254) 2023-10-16T13:47:34.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 -- 172.21.15.5:0/1730174454 learned_addr learned my addr 172.21.15.5:0/1730174454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:34.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd15fa700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fcc0d08a0 0x7f1fcc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd25fc700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fcc160e30 0x7f1fcc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 -- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fcc160e30 msgr2=0x7f1fcc15aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fcc160e30 0x7f1fcc15aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 -- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fcc0d08a0 msgr2=0x7f1fcc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fcc0d08a0 0x7f1fcc15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 -- 172.21.15.5:0/1730174454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4009b30 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd25fc700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fcc160e30 0x7f1fcc15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:34.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd1dfb700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc157470 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00c500 tx=0x7f1fbc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0052d0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc005430 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0038f0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc1595f0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.277+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc0caca0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.278+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc0caec0 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.279+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f1fbc003a50 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.279+0000 7f1fc27fc700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb006b1d0 0x7f1fb006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.279+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fbc088e10 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.279+0000 7f1fd15fa700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb006b1d0 0x7f1fb006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.280+0000 7f1fd15fa700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb006b1d0 0x7f1fb006d690 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0cd990 tx=0x7f1fc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.284+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fbc053c00 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.484+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fcc067d20 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.485+0000 7f1fc27fc700 1 -- 172.21.15.5:0/1730174454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fbc08a020 con 0x7f1fcc0b7ab0 2023-10-16T13:47:34.488 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb006b1d0 msgr2=0x7f1fb006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb006b1d0 0x7f1fb006d690 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0cd990 tx=0x7f1fc8008040 comp rx=0 tx=0).stop 2023-10-16T13:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 msgr2=0x7f1fcc157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc157470 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00c500 tx=0x7f1fbc00c8c0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 shutdown_connections 2023-10-16T13:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fb006b1d0 0x7f1fb006d690 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1fcc160e30 0x7f1fcc15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fcc0b7ab0 0x7f1fcc157470 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 --2- 172.21.15.5:0/1730174454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fcc0d08a0 0x7f1fcc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 >> 172.21.15.5:0/1730174454 conn(0x7f1fcc09cb40 msgr2=0x7f1fcc0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 shutdown_connections 2023-10-16T13:47:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.487+0000 7f1fd405f700 1 -- 172.21.15.5:0/1730174454 wait complete. 2023-10-16T13:47:34.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:47:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.627+0000 7ff3ed475700 1 Processor -- start 2023-10-16T13:47:34.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.627+0000 7ff3ed475700 1 -- start start 2023-10-16T13:47:34.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3ed475700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3e815ab10 0x7ff3e815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3ed475700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3e80b1f50 0x7ff3e80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3ed475700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e815e7a0 con 0x7ff3e80b2400 2023-10-16T13:47:34.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3ed475700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e815f730 con 0x7ff3e80b1f50 2023-10-16T13:47:34.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3ed475700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80b29a0 con 0x7ff3e815ab10 2023-10-16T13:47:34.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3e67fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3e80b1f50 0x7ff3e80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3e77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff3e80b2400 0x7ff3e80cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57270/0 (socket says 172.21.15.5:57270) 2023-10-16T13:47:34.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.628+0000 7ff3e77fe700 1 -- 172.21.15.5:0/2908198151 learned_addr learned my addr 172.21.15.5:0/2908198151 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:34.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e6ffd700 1 --2- 172.21.15.5:0/2908198151 >> v2:172.21.15.112:3300/0 conn(0x7ff3e815ab10 0x7ff3e815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e67fc700 1 -- 172.21.15.5:0/2908198151 >> v2:172.21.15.112:3300/0 conn(0x7ff3e815ab10 msgr2=0x7ff3e815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e67fc700 1 --2- 172.21.15.5:0/2908198151 >> v2:172.21.15.112:3300/0 conn(0x7ff3e815ab10 0x7ff3e815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e67fc700 1 -- 172.21.15.5:0/2908198151 >> v1:172.21.15.5:6789/0 conn(0x7ff3e80b2400 legacy=0x7ff3e80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e5ffb700 1 -- 172.21.15.5:0/2908198151 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692739500 0 0) 0x7ff3e815e7a0 con 0x7ff3e80b2400 2023-10-16T13:47:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e67fc700 1 -- 172.21.15.5:0/2908198151 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80b2c80 con 0x7ff3e80b1f50 2023-10-16T13:47:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e6ffd700 1 --2- 172.21.15.5:0/2908198151 >> v2:172.21.15.112:3300/0 conn(0x7ff3e815ab10 0x7ff3e815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e67fc700 1 --2- 172.21.15.5:0/2908198151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e80cf720 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80d0430 tx=0x7ff3d8009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6e0df13ef50749 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e5ffb700 1 -- 172.21.15.5:0/2908198151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8005e30 con 0x7ff3e80b1f50 2023-10-16T13:47:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e5ffb700 1 -- 172.21.15.5:0/2908198151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8006030 con 0x7ff3e80b1f50 2023-10-16T13:47:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3e5ffb700 1 -- 172.21.15.5:0/2908198151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80063c0 con 0x7ff3e80b1f50 2023-10-16T13:47:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3ed475700 1 -- 172.21.15.5:0/2908198151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 msgr2=0x7ff3e80cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2908198151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e80cf720 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80d0430 tx=0x7ff3d8009b00 comp rx=0 tx=0).stop 2023-10-16T13:47:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.629+0000 7ff3ed475700 1 -- 172.21.15.5:0/2908198151 shutdown_connections 2023-10-16T13:47:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.630+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2908198151 >> v2:172.21.15.112:3300/0 conn(0x7ff3e815ab10 0x7ff3e815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.630+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2908198151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e80cf720 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.630+0000 7ff3ed475700 1 -- 172.21.15.5:0/2908198151 >> 172.21.15.5:0/2908198151 conn(0x7ff3e806dae0 msgr2=0x7ff3e806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.630+0000 7ff3ed475700 1 -- 172.21.15.5:0/2908198151 shutdown_connections 2023-10-16T13:47:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.630+0000 7ff3ed475700 1 -- 172.21.15.5:0/2908198151 wait complete. 2023-10-16T13:47:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.631+0000 7ff3ed475700 1 Processor -- start 2023-10-16T13:47:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.631+0000 7ff3ed475700 1 -- start start 2023-10-16T13:47:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3ed475700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3ed475700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80b2400 0x7ff3e80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3ed475700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e815ab10 0x7ff3e80c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3ed475700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80c72b0 con 0x7ff3e80b1f50 2023-10-16T13:47:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3ed475700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e814ecf0 con 0x7ff3e815ab10 2023-10-16T13:47:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3ed475700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80c6730 con 0x7ff3e80b2400 2023-10-16T13:47:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e814e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47268/0 (socket says 172.21.15.5:47268) 2023-10-16T13:47:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 -- 172.21.15.5:0/2823684124 learned_addr learned my addr 172.21.15.5:0/2823684124 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e67fc700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80b2400 0x7ff3e80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e77fe700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e815ab10 0x7ff3e80c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 -- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80b2400 msgr2=0x7ff3e80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80b2400 0x7ff3e80c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 -- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e815ab10 msgr2=0x7ff3e80c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e815ab10 0x7ff3e80c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 -- 172.21.15.5:0/2823684124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8009430 con 0x7ff3e80b1f50 2023-10-16T13:47:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e67fc700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80b2400 0x7ff3e80c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3e6ffd700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e814e7b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c780 tx=0x7ff3dc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.632+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc011800 con 0x7ff3e80b1f50 2023-10-16T13:47:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.633+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc011960 con 0x7ff3e80b1f50 2023-10-16T13:47:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.633+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e80c6a10 con 0x7ff3e80b1f50 2023-10-16T13:47:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.633+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc011cd0 con 0x7ff3e80b1f50 2023-10-16T13:47:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.633+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e80c6fd0 con 0x7ff3e80b1f50 2023-10-16T13:47:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.633+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e815b170 con 0x7ff3e80b1f50 2023-10-16T13:47:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.634+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7ff3dc021350 con 0x7ff3e80b1f50 2023-10-16T13:47:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.634+0000 7ff3cf7fe700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff3d406b1d0 0x7ff3d406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.634+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3dc089ac0 con 0x7ff3e80b1f50 2023-10-16T13:47:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.635+0000 7ff3e67fc700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff3d406b1d0 0x7ff3d406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.635+0000 7ff3e67fc700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff3d406b1d0 0x7ff3d406d690 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8013040 tx=0x7ff3d8008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.639+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3dc054720 con 0x7ff3e80b1f50 2023-10-16T13:47:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.840+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3e8067d20 con 0x7ff3e80b1f50 2023-10-16T13:47:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.840+0000 7ff3cf7fe700 1 -- 172.21.15.5:0/2823684124 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3dc057d40 con 0x7ff3e80b1f50 2023-10-16T13:47:34.843 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:47:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff3d406b1d0 msgr2=0x7ff3d406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff3d406b1d0 0x7ff3d406d690 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8013040 tx=0x7ff3d8008070 comp rx=0 tx=0).stop 2023-10-16T13:47:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 msgr2=0x7ff3e814e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e814e7b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c780 tx=0x7ff3dc00cb40 comp rx=0 tx=0).stop 2023-10-16T13:47:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 shutdown_connections 2023-10-16T13:47:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e815ab10 0x7ff3e80c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3e80b1f50 0x7ff3e814e7b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff3d406b1d0 0x7ff3d406d690 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 --2- 172.21.15.5:0/2823684124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80b2400 0x7ff3e80c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 >> 172.21.15.5:0/2823684124 conn(0x7ff3e806dae0 msgr2=0x7ff3e80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.842+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 shutdown_connections 2023-10-16T13:47:34.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.843+0000 7ff3ed475700 1 -- 172.21.15.5:0/2823684124 wait complete. 2023-10-16T13:47:34.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:47:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.983+0000 7fca13958700 1 Processor -- start 2023-10-16T13:47:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.983+0000 7fca13958700 1 -- start start 2023-10-16T13:47:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.984+0000 7fca13958700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 0x7fca0c06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.984+0000 7fca13958700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 0x7fca0c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.984+0000 7fca13958700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c15bf30 con 0x7fca0c0ce0b0 2023-10-16T13:47:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.984+0000 7fca13958700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c06f1d0 con 0x7fca0c06ed50 2023-10-16T13:47:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.984+0000 7fca13958700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0ce540 con 0x7fca0c15bb50 2023-10-16T13:47:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca10ef3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 0x7fca0c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 0x7fca0c06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca11ef5700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fca0c0ce0b0 0x7fca0c15f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:48260/0 (socket says 172.21.15.5:48260) 2023-10-16T13:47:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca10ef3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 0x7fca0c0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43174/0 (socket says 172.21.15.5:43174) 2023-10-16T13:47:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca11ef5700 1 -- 172.21.15.5:0/1622287572 learned_addr learned my addr 172.21.15.5:0/1622287572 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 0x7fca0c06e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45180/0 (socket says 172.21.15.5:45180) 2023-10-16T13:47:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca03fff700 1 -- 172.21.15.5:0/1622287572 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134204582 0 0) 0x7fca0c15bf30 con 0x7fca0c0ce0b0 2023-10-16T13:47:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca03fff700 1 -- 172.21.15.5:0/1622287572 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f80035b0 con 0x7fca0c0ce0b0 2023-10-16T13:47:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 -- 172.21.15.5:0/1622287572 >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 msgr2=0x7fca0c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 --2- 172.21.15.5:0/1622287572 >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 0x7fca0c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 -- 172.21.15.5:0/1622287572 >> v1:172.21.15.112:6789/0 conn(0x7fca0c0ce0b0 legacy=0x7fca0c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 -- 172.21.15.5:0/1622287572 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c06d500 con 0x7fca0c15bb50 2023-10-16T13:47:34.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca10ef3700 1 --2- 172.21.15.5:0/1622287572 >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 0x7fca0c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:34.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca116f4700 1 --2- 172.21.15.5:0/1622287572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 0x7fca0c06e810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009870 tx=0x7fc9fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c0d63ccd61992c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:34.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca03fff700 1 -- 172.21.15.5:0/1622287572 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011830 con 0x7fca0c15bb50 2023-10-16T13:47:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca03fff700 1 -- 172.21.15.5:0/1622287572 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc011990 con 0x7fca0c15bb50 2023-10-16T13:47:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.985+0000 7fca03fff700 1 -- 172.21.15.5:0/1622287572 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011d20 con 0x7fca0c15bb50 2023-10-16T13:47:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 -- 172.21.15.5:0/1622287572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 msgr2=0x7fca0c06e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 --2- 172.21.15.5:0/1622287572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 0x7fca0c06e810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009870 tx=0x7fc9fc009b80 comp rx=0 tx=0).stop 2023-10-16T13:47:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 -- 172.21.15.5:0/1622287572 shutdown_connections 2023-10-16T13:47:34.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 --2- 172.21.15.5:0/1622287572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c15bb50 0x7fca0c06e810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 --2- 172.21.15.5:0/1622287572 >> v2:172.21.15.112:3300/0 conn(0x7fca0c06ed50 0x7fca0c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:34.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 -- 172.21.15.5:0/1622287572 >> 172.21.15.5:0/1622287572 conn(0x7fca0c0cc6f0 msgr2=0x7fca0c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:34.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 -- 172.21.15.5:0/1622287572 shutdown_connections 2023-10-16T13:47:34.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.986+0000 7fca13958700 1 -- 172.21.15.5:0/1622287572 wait complete. 2023-10-16T13:47:34.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.987+0000 7fca13958700 1 Processor -- start 2023-10-16T13:47:34.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.987+0000 7fca13958700 1 -- start start 2023-10-16T13:47:34.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca13958700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c06ed50 0x7fca0c0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca13958700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0c0ce0b0 0x7fca0c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca13958700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 0x7fca0c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca13958700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1e5020 con 0x7fca0c15bb50 2023-10-16T13:47:35.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca13958700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1e4410 con 0x7fca0c0ce0b0 2023-10-16T13:47:35.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca13958700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1e46f0 con 0x7fca0c06ed50 2023-10-16T13:47:35.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 0x7fca0c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 0x7fca0c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47286/0 (socket says 172.21.15.5:47286) 2023-10-16T13:47:35.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 -- 172.21.15.5:0/629566855 learned_addr learned my addr 172.21.15.5:0/629566855 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:35.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca116f4700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c06ed50 0x7fca0c0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca10ef3700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0c0ce0b0 0x7fca0c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 -- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c06ed50 msgr2=0x7fca0c0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c06ed50 0x7fca0c0c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 -- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0c0ce0b0 msgr2=0x7fca0c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0c0ce0b0 0x7fca0c14bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.988+0000 7fca11ef5700 1 -- 172.21.15.5:0/629566855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080094a0 con 0x7fca0c15bb50 2023-10-16T13:47:35.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.989+0000 7fca11ef5700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 0x7fca0c0b00d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fca0400cb40 tx=0x7fca0400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.989+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0400ab50 con 0x7fca0c15bb50 2023-10-16T13:47:35.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.989+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0400acb0 con 0x7fca0c15bb50 2023-10-16T13:47:35.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.989+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc0094a0 con 0x7fca0c15bb50 2023-10-16T13:47:35.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.989+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04012620 con 0x7fca0c15bb50 2023-10-16T13:47:35.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.989+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c1e4cb0 con 0x7fca0c15bb50 2023-10-16T13:47:35.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.990+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c067d20 con 0x7fca0c15bb50 2023-10-16T13:47:35.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.990+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fca0401b3b0 con 0x7fca0c15bb50 2023-10-16T13:47:35.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.991+0000 7fca01ffb700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9f006b1d0 0x7fc9f006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.991+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca04089870 con 0x7fca0c15bb50 2023-10-16T13:47:35.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.991+0000 7fca116f4700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9f006b1d0 0x7fc9f006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.992+0000 7fca116f4700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9f006b1d0 0x7fc9f006d690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009bc0 tx=0x7fc9fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:34.996+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca04054580 con 0x7fca0c15bb50 2023-10-16T13:47:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.199+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca0c06e070 con 0x7fca0c15bb50 2023-10-16T13:47:35.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.200+0000 7fca01ffb700 1 -- 172.21.15.5:0/629566855 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca040170a0 con 0x7fca0c15bb50 2023-10-16T13:47:35.203 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:47:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9f006b1d0 msgr2=0x7fc9f006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9f006b1d0 0x7fc9f006d690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009bc0 tx=0x7fc9fc008030 comp rx=0 tx=0).stop 2023-10-16T13:47:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 msgr2=0x7fca0c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 0x7fca0c0b00d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fca0400cb40 tx=0x7fca0400cf00 comp rx=0 tx=0).stop 2023-10-16T13:47:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 shutdown_connections 2023-10-16T13:47:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0c15bb50 0x7fca0c0b00d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc9f006b1d0 0x7fc9f006d690 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca0c06ed50 0x7fca0c0c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 --2- 172.21.15.5:0/629566855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0c0ce0b0 0x7fca0c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 >> 172.21.15.5:0/629566855 conn(0x7fca0c0cc6f0 msgr2=0x7fca0c15ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 shutdown_connections 2023-10-16T13:47:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.202+0000 7fca13958700 1 -- 172.21.15.5:0/629566855 wait complete. 2023-10-16T13:47:35.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:35.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.339+0000 7f9ffe5b5700 1 Processor -- start 2023-10-16T13:47:35.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.339+0000 7f9ffe5b5700 1 -- start start 2023-10-16T13:47:35.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ffe5b5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ffe5b5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ff80cfe30 0x7f9ff80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ffe5b5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff815e7a0 con 0x7f9ff80b1f50 2023-10-16T13:47:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ffe5b5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff815f730 con 0x7f9ff80cfe30 2023-10-16T13:47:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ffe5b5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80b29a0 con 0x7f9ff815ab10 2023-10-16T13:47:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ff77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9ff80b1f50 0x7f9ff80cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57294/0 (socket says 172.21.15.5:57294) 2023-10-16T13:47:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ff77fe700 1 -- 172.21.15.5:0/3559711222 learned_addr learned my addr 172.21.15.5:0/3559711222 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.340+0000 7f9ffcb52700 1 --2- 172.21.15.5:0/3559711222 >> v2:172.21.15.5:3300/0 conn(0x7f9ff80cfe30 0x7f9ff80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ff7fff700 1 --2- 172.21.15.5:0/3559711222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ffcb52700 1 -- 172.21.15.5:0/3559711222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 msgr2=0x7f9ff815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ffcb52700 1 --2- 172.21.15.5:0/3559711222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ffcb52700 1 -- 172.21.15.5:0/3559711222 >> v1:172.21.15.5:6789/0 conn(0x7f9ff80b1f50 legacy=0x7f9ff80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ffcb52700 1 -- 172.21.15.5:0/3559711222 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80b2c80 con 0x7f9ff80cfe30 2023-10-16T13:47:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ff6ffd700 1 -- 172.21.15.5:0/3559711222 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495571453 0 0) 0x7f9ff815e7a0 con 0x7f9ff80b1f50 2023-10-16T13:47:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ffcb52700 1 --2- 172.21.15.5:0/3559711222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80cbf40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009d90 tx=0x7f9ff000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a78123fb80d7a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ff6ffd700 1 -- 172.21.15.5:0/3559711222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000e070 con 0x7f9ff80cfe30 2023-10-16T13:47:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ff6ffd700 1 -- 172.21.15.5:0/3559711222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff000bbd0 con 0x7f9ff80cfe30 2023-10-16T13:47:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.341+0000 7f9ff6ffd700 1 -- 172.21.15.5:0/3559711222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0012430 con 0x7f9ff80cfe30 2023-10-16T13:47:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3559711222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80cfe30 msgr2=0x7f9ff80cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3559711222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80cbf40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009d90 tx=0x7f9ff000b330 comp rx=0 tx=0).stop 2023-10-16T13:47:35.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3559711222 shutdown_connections 2023-10-16T13:47:35.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3559711222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80cbf40 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3559711222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3559711222 >> 172.21.15.5:0/3559711222 conn(0x7f9ff806dae0 msgr2=0x7f9ff806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:35.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3559711222 shutdown_connections 2023-10-16T13:47:35.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.342+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3559711222 wait complete. 2023-10-16T13:47:35.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.343+0000 7f9ffe5b5700 1 Processor -- start 2023-10-16T13:47:35.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.343+0000 7f9ffe5b5700 1 -- start start 2023-10-16T13:47:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffe5b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 0x7f9ff80c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffe5b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffe5b5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff81403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffe5b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80c4900 con 0x7f9ff80b1f50 2023-10-16T13:47:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffe5b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8156880 con 0x7f9ff80cfe30 2023-10-16T13:47:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffe5b5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8157400 con 0x7f9ff815ab10 2023-10-16T13:47:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 0x7f9ff80c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 0x7f9ff80c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47296/0 (socket says 172.21.15.5:47296) 2023-10-16T13:47:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 -- 172.21.15.5:0/3192246510 learned_addr learned my addr 172.21.15.5:0/3192246510 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:35.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ffcb52700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff81403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff77fe700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 -- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 msgr2=0x7f9ff81403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff81403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 -- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ff80cfe30 msgr2=0x7f9ff80c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 -- 172.21.15.5:0/3192246510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff0009a70 con 0x7f9ff80b1f50 2023-10-16T13:47:35.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.344+0000 7f9ff7fff700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 0x7f9ff80c9de0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009fa0 tx=0x7f9fe800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.345+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8011920 con 0x7f9ff80b1f50 2023-10-16T13:47:35.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.345+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8011a80 con 0x7f9ff80b1f50 2023-10-16T13:47:35.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.345+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8156ad0 con 0x7f9ff80b1f50 2023-10-16T13:47:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.345+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8011e30 con 0x7f9ff80b1f50 2023-10-16T13:47:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.345+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff8157090 con 0x7f9ff80b1f50 2023-10-16T13:47:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.346+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8067d20 con 0x7f9ff80b1f50 2023-10-16T13:47:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.346+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f9fe8019440 con 0x7f9ff80b1f50 2023-10-16T13:47:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.347+0000 7f9ff4ff9700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9fd806b1d0 0x7f9fd806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.347+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fe808b320 con 0x7f9ff80b1f50 2023-10-16T13:47:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.347+0000 7f9ff77fe700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9fd806b1d0 0x7f9fd806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.347+0000 7f9ff77fe700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9fd806b1d0 0x7f9fd806d690 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ff815a050 tx=0x7f9fe0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.351+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9fe8053ca0 con 0x7f9ff80b1f50 2023-10-16T13:47:35.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.595+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ff80ca380 con 0x7f9ff80b1f50 2023-10-16T13:47:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.596+0000 7f9ff4ff9700 1 -- 172.21.15.5:0/3192246510 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f9fe80560b0 con 0x7f9ff80b1f50 2023-10-16T13:47:35.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:35.599 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:17.350421+0000","modified":"2023-10-16T13:47:20.404057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1286413980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1286413980},{"type":"v1","addr":"172.21.15.5:6834","nonce":1286413980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-16T13:47:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9fd806b1d0 msgr2=0x7f9fd806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9fd806b1d0 0x7f9fd806d690 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ff815a050 tx=0x7f9fe0009040 comp rx=0 tx=0).stop 2023-10-16T13:47:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 msgr2=0x7f9ff80c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 0x7f9ff80c9de0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009fa0 tx=0x7f9fe800eb70 comp rx=0 tx=0).stop 2023-10-16T13:47:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 shutdown_connections 2023-10-16T13:47:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9fd806b1d0 0x7f9fd806d690 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ff815ab10 0x7f9ff81403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80b1f50 0x7f9ff80c9de0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 --2- 172.21.15.5:0/3192246510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ff80cfe30 0x7f9ff80c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.597+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 >> 172.21.15.5:0/3192246510 conn(0x7f9ff806dae0 msgr2=0x7f9ff81589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.598+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 shutdown_connections 2023-10-16T13:47:35.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.598+0000 7f9ffe5b5700 1 -- 172.21.15.5:0/3192246510 wait complete. 2023-10-16T13:47:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 51 2023-10-16T13:47:35.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.735+0000 7f91a93d5700 1 Processor -- start 2023-10-16T13:47:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a93d5700 1 -- start start 2023-10-16T13:47:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a93d5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91a415f1f0 0x7f91a40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a93d5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a415e7a0 con 0x7f91a40cfc60 2023-10-16T13:47:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a93d5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a40d0090 con 0x7f91a415ab10 2023-10-16T13:47:35.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a93d5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40b29a0 con 0x7f91a415f1f0 2023-10-16T13:47:35.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a27fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91a415f1f0 0x7f91a40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.736+0000 7f91a37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91a40cfc60 0x7f91a40cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57312/0 (socket says 172.21.15.5:57312) 2023-10-16T13:47:35.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a37fe700 1 -- 172.21.15.5:0/1008552729 learned_addr learned my addr 172.21.15.5:0/1008552729 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:35.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a27fc700 1 -- 172.21.15.5:0/1008552729 >> v1:172.21.15.112:6789/0 conn(0x7f91a415ab10 legacy=0x7f91a40b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:35.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a27fc700 1 -- 172.21.15.5:0/1008552729 >> v1:172.21.15.5:6789/0 conn(0x7f91a40cfc60 legacy=0x7f91a40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a27fc700 1 -- 172.21.15.5:0/1008552729 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40b2c80 con 0x7f91a415f1f0 2023-10-16T13:47:35.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a27fc700 1 --2- 172.21.15.5:0/1008552729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a40cf720 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9194009820 tx=0x7f9194009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7759317f2453a6f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a1ffb700 1 -- 172.21.15.5:0/1008552729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194005e30 con 0x7f91a415f1f0 2023-10-16T13:47:35.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a1ffb700 1 -- 172.21.15.5:0/1008552729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9194004030 con 0x7f91a415f1f0 2023-10-16T13:47:35.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.737+0000 7f91a1ffb700 1 -- 172.21.15.5:0/1008552729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940043c0 con 0x7f91a415f1f0 2023-10-16T13:47:35.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 -- 172.21.15.5:0/1008552729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 msgr2=0x7f91a40cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 --2- 172.21.15.5:0/1008552729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a40cf720 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9194009820 tx=0x7f9194009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:35.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 -- 172.21.15.5:0/1008552729 shutdown_connections 2023-10-16T13:47:35.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 --2- 172.21.15.5:0/1008552729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a40cf720 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 -- 172.21.15.5:0/1008552729 >> 172.21.15.5:0/1008552729 conn(0x7f91a406dae0 msgr2=0x7f91a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:35.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 -- 172.21.15.5:0/1008552729 shutdown_connections 2023-10-16T13:47:35.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.738+0000 7f91a93d5700 1 -- 172.21.15.5:0/1008552729 wait complete. 2023-10-16T13:47:35.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.739+0000 7f91a93d5700 1 Processor -- start 2023-10-16T13:47:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.739+0000 7f91a93d5700 1 -- start start 2023-10-16T13:47:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a93d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a40cfc60 0x7f91a41f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a93d5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a415ab10 0x7f91a406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a93d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a93d5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a414b1a0 con 0x7f91a415f1f0 2023-10-16T13:47:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a93d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a414b440 con 0x7f91a40cfc60 2023-10-16T13:47:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a93d5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a41f50e0 con 0x7f91a415ab10 2023-10-16T13:47:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a414b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47314/0 (socket says 172.21.15.5:47314) 2023-10-16T13:47:35.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 -- 172.21.15.5:0/457613951 learned_addr learned my addr 172.21.15.5:0/457613951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:35.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 -- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a415ab10 msgr2=0x7f91a406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a415ab10 0x7f91a406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 -- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a40cfc60 msgr2=0x7f91a41f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a2ffd700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a40cfc60 0x7f91a41f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a40cfc60 0x7f91a41f4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 -- 172.21.15.5:0/457613951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009430 con 0x7f91a415f1f0 2023-10-16T13:47:35.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.740+0000 7f91a37fe700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a414b8d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f919c00ca80 tx=0x7f919c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.741+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00aaa0 con 0x7f91a415f1f0 2023-10-16T13:47:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.741+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00ac00 con 0x7f91a415f1f0 2023-10-16T13:47:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.741+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a41f5380 con 0x7f91a415f1f0 2023-10-16T13:47:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.741+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c012400 con 0x7f91a415f1f0 2023-10-16T13:47:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.741+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a41f5940 con 0x7f91a415f1f0 2023-10-16T13:47:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.742+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a41f5ad0 con 0x7f91a415f1f0 2023-10-16T13:47:35.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.742+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f919c01b3b0 con 0x7f91a415f1f0 2023-10-16T13:47:35.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.742+0000 7f918b7fe700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919006b1d0 0x7f919006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:35.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.742+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f919c089670 con 0x7f91a415f1f0 2023-10-16T13:47:35.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.743+0000 7f91a2ffd700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919006b1d0 0x7f919006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:35.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.743+0000 7f91a2ffd700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919006b1d0 0x7f919006d690 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f919800a7d0 tx=0x7f9198008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:35.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.747+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f919c0543a0 con 0x7f91a415f1f0 2023-10-16T13:47:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.948+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91a40afc10 con 0x7f91a415f1f0 2023-10-16T13:47:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.949+0000 7f918b7fe700 1 -- 172.21.15.5:0/457613951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f919c0579c0 con 0x7f91a415f1f0 2023-10-16T13:47:35.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:35.953 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:18.949509+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:35.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.951+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919006b1d0 msgr2=0x7f919006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.951+0000 7f91a93d5700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919006b1d0 0x7f919006d690 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f919800a7d0 tx=0x7f9198008040 comp rx=0 tx=0).stop 2023-10-16T13:47:35.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.951+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 msgr2=0x7f91a414b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.951+0000 7f91a93d5700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a414b8d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f919c00ca80 tx=0x7f919c00ce40 comp rx=0 tx=0).stop 2023-10-16T13:47:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 shutdown_connections 2023-10-16T13:47:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a415f1f0 0x7f91a414b8d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a40cfc60 0x7f91a41f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919006b1d0 0x7f919006d690 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 --2- 172.21.15.5:0/457613951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a415ab10 0x7f91a406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 >> 172.21.15.5:0/457613951 conn(0x7f91a406dae0 msgr2=0x7f91a40cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 shutdown_connections 2023-10-16T13:47:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:35.952+0000 7f91a93d5700 1 -- 172.21.15.5:0/457613951 wait complete. 2023-10-16T13:47:35.967 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:47:35.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:36.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.090+0000 7fcb9d190700 1 Processor -- start 2023-10-16T13:47:36.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.090+0000 7fcb9d190700 1 -- start start 2023-10-16T13:47:36.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9d190700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb9815e2f0 0x7fcb980cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9d190700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9d190700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb980b2d60 con 0x7fcb980cd950 2023-10-16T13:47:36.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9d190700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb981619a0 con 0x7fcb9815e2f0 2023-10-16T13:47:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9d190700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9806b1f0 con 0x7fcb9806a840 2023-10-16T13:47:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb9815e2f0 0x7fcb980cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9759e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb9815e2f0 0x7fcb980cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43216/0 (socket says 172.21.15.5:43216) 2023-10-16T13:47:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb96d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcb980cd950 0x7fcb9815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:48298/0 (socket says 172.21.15.5:48298) 2023-10-16T13:47:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9659c700 1 -- 172.21.15.5:0/2939461276 learned_addr learned my addr 172.21.15.5:0/2939461276 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:36.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.091+0000 7fcb9759e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45226/0 (socket says 172.21.15.5:45226) 2023-10-16T13:47:36.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb9659c700 1 -- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 msgr2=0x7fcb9806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:36.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb9659c700 1 --2- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb9659c700 1 -- 172.21.15.5:0/2939461276 >> v1:172.21.15.112:6789/0 conn(0x7fcb980cd950 legacy=0x7fcb9815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb9659c700 1 -- 172.21.15.5:0/2939461276 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980cdd30 con 0x7fcb9815e2f0 2023-10-16T13:47:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb95d9b700 1 -- 172.21.15.5:0/2939461276 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36609645 0 0) 0x7fcb980b2d60 con 0x7fcb980cd950 2023-10-16T13:47:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb9759e700 1 --2- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb9659c700 1 --2- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9815e2f0 0x7fcb980cede0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcb98161ae0 tx=0x7fcb88009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae34b4d153ed753 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb95d9b700 1 -- 172.21.15.5:0/2939461276 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88005c20 con 0x7fcb9815e2f0 2023-10-16T13:47:36.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb95d9b700 1 -- 172.21.15.5:0/2939461276 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88005d80 con 0x7fcb9815e2f0 2023-10-16T13:47:36.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.092+0000 7fcb95d9b700 1 -- 172.21.15.5:0/2939461276 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88004250 con 0x7fcb9815e2f0 2023-10-16T13:47:36.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 -- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9815e2f0 msgr2=0x7fcb980cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 --2- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9815e2f0 0x7fcb980cede0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcb98161ae0 tx=0x7fcb88009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 -- 172.21.15.5:0/2939461276 shutdown_connections 2023-10-16T13:47:36.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 --2- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 --2- 172.21.15.5:0/2939461276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9815e2f0 0x7fcb980cede0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 -- 172.21.15.5:0/2939461276 >> 172.21.15.5:0/2939461276 conn(0x7fcb9806dae0 msgr2=0x7fcb9806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:36.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 -- 172.21.15.5:0/2939461276 shutdown_connections 2023-10-16T13:47:36.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.093+0000 7fcb9d190700 1 -- 172.21.15.5:0/2939461276 wait complete. 2023-10-16T13:47:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.094+0000 7fcb9d190700 1 Processor -- start 2023-10-16T13:47:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.094+0000 7fcb9d190700 1 -- start start 2023-10-16T13:47:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9d190700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9815b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9d190700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb980cd950 0x7fcb980c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9d190700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 0x7fcb980b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9d190700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980b4e20 con 0x7fcb9815e2f0 2023-10-16T13:47:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9d190700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980b4860 con 0x7fcb980cd950 2023-10-16T13:47:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9d190700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980b4b40 con 0x7fcb9806a840 2023-10-16T13:47:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 0x7fcb980b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 0x7fcb980b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47328/0 (socket says 172.21.15.5:47328) 2023-10-16T13:47:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9759e700 1 -- 172.21.15.5:0/520907029 learned_addr learned my addr 172.21.15.5:0/520907029 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb96d9d700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9815b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.095+0000 7fcb9659c700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb980cd950 0x7fcb980c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9759e700 1 -- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 msgr2=0x7fcb9815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9759e700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9815b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9759e700 1 -- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb980cd950 msgr2=0x7fcb980c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9759e700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb980cd950 0x7fcb980c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9759e700 1 -- 172.21.15.5:0/520907029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009a70 con 0x7fcb9815e2f0 2023-10-16T13:47:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9759e700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 0x7fcb980b3920 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000efc0 tx=0x7fcb9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000ca90 con 0x7fcb9815e2f0 2023-10-16T13:47:36.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000f040 con 0x7fcb9815e2f0 2023-10-16T13:47:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000ce10 con 0x7fcb9815e2f0 2023-10-16T13:47:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb88009500 con 0x7fcb9815e2f0 2023-10-16T13:47:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.096+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb980b3400 con 0x7fcb9815e2f0 2023-10-16T13:47:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.097+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb980b35f0 con 0x7fcb9815e2f0 2023-10-16T13:47:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.097+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fcb90014480 con 0x7fcb9815e2f0 2023-10-16T13:47:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.098+0000 7fcb7f7fe700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcb8406b1d0 0x7fcb8406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.098+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb9008a0f0 con 0x7fcb9815e2f0 2023-10-16T13:47:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.098+0000 7fcb96d9d700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcb8406b1d0 0x7fcb8406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.098+0000 7fcb96d9d700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcb8406b1d0 0x7fcb8406d690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c007fd0 tx=0x7fcb8c007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.102+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb90054dd0 con 0x7fcb9815e2f0 2023-10-16T13:47:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.345+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb98067d20 con 0x7fcb9815e2f0 2023-10-16T13:47:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.345+0000 7fcb7f7fe700 1 -- 172.21.15.5:0/520907029 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fcb90009d70 con 0x7fcb9815e2f0 2023-10-16T13:47:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:36.349 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:17.350421+0000","modified":"2023-10-16T13:47:20.404057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1286413980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1286413980},{"type":"v1","addr":"172.21.15.5:6834","nonce":1286413980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-16T13:47:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcb8406b1d0 msgr2=0x7fcb8406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcb8406b1d0 0x7fcb8406d690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c007fd0 tx=0x7fcb8c007de0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 msgr2=0x7fcb980b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 0x7fcb980b3920 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000efc0 tx=0x7fcb9000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 shutdown_connections 2023-10-16T13:47:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb9815e2f0 0x7fcb980b3920 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcb8406b1d0 0x7fcb8406d690 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb9806a840 0x7fcb9815b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 --2- 172.21.15.5:0/520907029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb980cd950 0x7fcb980c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 >> 172.21.15.5:0/520907029 conn(0x7fcb9806dae0 msgr2=0x7fcb980cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 shutdown_connections 2023-10-16T13:47:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.348+0000 7fcb9d190700 1 -- 172.21.15.5:0/520907029 wait complete. 2023-10-16T13:47:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 51 2023-10-16T13:47:36.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.484+0000 7f5f03f73700 1 Processor -- start 2023-10-16T13:47:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f03f73700 1 -- start start 2023-10-16T13:47:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f03f73700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 0x7f5efc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f03f73700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc15e7a0 con 0x7f5efc15ab10 2023-10-16T13:47:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f03f73700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc0b29a0 con 0x7f5efc0cfc60 2023-10-16T13:47:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f03f73700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0d00d0 con 0x7f5efc15f1f0 2023-10-16T13:47:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f01d0f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5efc15ab10 0x7f5efc0b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57336/0 (socket says 172.21.15.5:57336) 2023-10-16T13:47:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.485+0000 7f5f01d0f700 1 -- 172.21.15.5:0/4146703182 learned_addr learned my addr 172.21.15.5:0/4146703182 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f0150e700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 0x7f5efc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621159564 0 0) 0x7f5efc15e7a0 con 0x7f5efc15ab10 2023-10-16T13:47:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee80035b0 con 0x7f5efc15ab10 2023-10-16T13:47:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564865149 0 0) 0x7f5ee80035b0 con 0x7f5efc15ab10 2023-10-16T13:47:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 msgr2=0x7f5efc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 0x7f5efc0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 >> v1:172.21.15.112:6789/0 conn(0x7f5efc0cfc60 legacy=0x7f5efc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc0b2c80 con 0x7f5efc15ab10 2023-10-16T13:47:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5ef0001670 con 0x7f5efc15ab10 2023-10-16T13:47:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 >> v1:172.21.15.5:6789/0 conn(0x7f5efc15ab10 legacy=0x7f5efc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 0x7f5ee8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ee8003fb0 0x7f5ee8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee8004d90 0x7f5ee8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0d00d0 con 0x7f5ee8004d90 2023-10-16T13:47:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee800baf0 con 0x7f5ee8003fb0 2023-10-16T13:47:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee800bcb0 con 0x7f5efc15f1f0 2023-10-16T13:47:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f02510700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee8004d90 0x7f5ee8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f01d0f700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 0x7f5ee8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.486+0000 7f5f0150e700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ee8003fb0 0x7f5ee8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 -- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 msgr2=0x7f5ee8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc15f1f0 0x7f5ee8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 -- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ee8003fb0 msgr2=0x7f5ee8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ee8003fb0 0x7f5ee8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 -- 172.21.15.5:0/4146703182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80035b0 con 0x7f5ee8004d90 2023-10-16T13:47:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee8004d90 0x7f5ee8005210 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c190 tx=0x7f5ee8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab54d076ed33e455 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4001db0 con 0x7f5ee8004d90 2023-10-16T13:47:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400ccd0 con 0x7f5ee8004d90 2023-10-16T13:47:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f00d0d700 1 -- 172.21.15.5:0/4146703182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4003c40 con 0x7f5ee8004d90 2023-10-16T13:47:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f03f73700 1 -- 172.21.15.5:0/4146703182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee8004d90 msgr2=0x7f5ee8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f03f73700 1 --2- 172.21.15.5:0/4146703182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee8004d90 0x7f5ee8005210 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c190 tx=0x7f5ee8005880 comp rx=0 tx=0).stop 2023-10-16T13:47:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f02510700 1 -- 172.21.15.5:0/4146703182 reap_dead start 2023-10-16T13:47:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f03f73700 1 -- 172.21.15.5:0/4146703182 shutdown_connections 2023-10-16T13:47:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f03f73700 1 -- 172.21.15.5:0/4146703182 >> 172.21.15.5:0/4146703182 conn(0x7f5efc06dae0 msgr2=0x7f5efc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f03f73700 1 -- 172.21.15.5:0/4146703182 shutdown_connections 2023-10-16T13:47:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.487+0000 7f5f03f73700 1 -- 172.21.15.5:0/4146703182 wait complete. 2023-10-16T13:47:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 Processor -- start 2023-10-16T13:47:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 -- start start 2023-10-16T13:47:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 0x7f5efc0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5efc1506d0 0x7f5efc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc0c6a00 0x7f5efc06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0c6ef0 con 0x7f5efc1502f0 2023-10-16T13:47:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1f5c30 con 0x7f5efc1506d0 2023-10-16T13:47:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.489+0000 7f5f03f73700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1f4e70 con 0x7f5efc0c6a00 2023-10-16T13:47:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 0x7f5efc0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 0x7f5efc0c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47344/0 (socket says 172.21.15.5:47344) 2023-10-16T13:47:36.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 -- 172.21.15.5:0/3469181540 learned_addr learned my addr 172.21.15.5:0/3469181540 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:36.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f0150e700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5efc1506d0 0x7f5efc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f02510700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc0c6a00 0x7f5efc06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 -- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc0c6a00 msgr2=0x7f5efc06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc0c6a00 0x7f5efc06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 -- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5efc1506d0 msgr2=0x7f5efc06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5efc1506d0 0x7f5efc06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 -- 172.21.15.5:0/3469181540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc1f5150 con 0x7f5efc1502f0 2023-10-16T13:47:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f01d0f700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 0x7f5efc0c64c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00011e0 tx=0x7f5ef0007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000f620 con 0x7f5efc1502f0 2023-10-16T13:47:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000f780 con 0x7f5efc1502f0 2023-10-16T13:47:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc1f5430 con 0x7f5efc1502f0 2023-10-16T13:47:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000fb30 con 0x7f5efc1502f0 2023-10-16T13:47:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.490+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc1f2560 con 0x7f5efc1502f0 2023-10-16T13:47:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.491+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc1f26f0 con 0x7f5efc1502f0 2023-10-16T13:47:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.492+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f5ef000fc90 con 0x7f5efc1502f0 2023-10-16T13:47:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.492+0000 7f5eee7fc700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ee006b1d0 0x7f5ee006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.492+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ef0089a10 con 0x7f5efc1502f0 2023-10-16T13:47:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.492+0000 7f5f0150e700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ee006b1d0 0x7f5ee006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.493+0000 7f5f0150e700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ee006b1d0 0x7f5ee006d690 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5efc150ab0 tx=0x7f5ef80091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.497+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ef0054770 con 0x7f5efc1502f0 2023-10-16T13:47:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.743+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5efc0afc10 con 0x7f5efc1502f0 2023-10-16T13:47:36.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.744+0000 7f5eee7fc700 1 -- 172.21.15.5:0/3469181540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f5ef0057d90 con 0x7f5efc1502f0 2023-10-16T13:47:36.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:36.747 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:17.350421+0000","modified":"2023-10-16T13:47:20.404057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1286413980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1286413980},{"type":"v1","addr":"172.21.15.5:6834","nonce":1286413980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-16T13:47:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.745+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ee006b1d0 msgr2=0x7f5ee006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.745+0000 7f5f03f73700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ee006b1d0 0x7f5ee006d690 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5efc150ab0 tx=0x7f5ef80091c0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.745+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 msgr2=0x7f5efc0c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.745+0000 7f5f03f73700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 0x7f5efc0c64c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00011e0 tx=0x7f5ef0007570 comp rx=0 tx=0).stop 2023-10-16T13:47:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 shutdown_connections 2023-10-16T13:47:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ee006b1d0 0x7f5ee006d690 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5efc0c6a00 0x7f5efc06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5efc1502f0 0x7f5efc0c64c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 --2- 172.21.15.5:0/3469181540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5efc1506d0 0x7f5efc06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 >> 172.21.15.5:0/3469181540 conn(0x7f5efc06dae0 msgr2=0x7f5efc0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 shutdown_connections 2023-10-16T13:47:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.746+0000 7f5f03f73700 1 -- 172.21.15.5:0/3469181540 wait complete. 2023-10-16T13:47:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 51 2023-10-16T13:47:36.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.883+0000 7f56474fb700 1 Processor -- start 2023-10-16T13:47:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.883+0000 7f56474fb700 1 -- start start 2023-10-16T13:47:36.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f56474fb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f564015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f56474fb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56400b54f0 0x7f564015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f56474fb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400b5c70 con 0x7f564006e750 2023-10-16T13:47:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f56474fb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400b5990 con 0x7f56400b54f0 2023-10-16T13:47:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f56474fb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564015b2b0 con 0x7f564006eb30 2023-10-16T13:47:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56400b54f0 0x7f564015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56400b54f0 0x7f564015ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47356/0 (socket says 172.21.15.5:47356) 2023-10-16T13:47:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 -- 172.21.15.5:0/1391889440 learned_addr learned my addr 172.21.15.5:0/1391889440 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5644a96700 1 --2- 172.21.15.5:0/1391889440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f564015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 -- 172.21.15.5:0/1391889440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 msgr2=0x7f564015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:36.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 --2- 172.21.15.5:0/1391889440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f564015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 -- 172.21.15.5:0/1391889440 >> v1:172.21.15.112:6789/0 conn(0x7f564006e750 legacy=0x7f56400ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 -- 172.21.15.5:0/1391889440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564015b590 con 0x7f56400b54f0 2023-10-16T13:47:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.884+0000 7f5645a98700 1 --2- 172.21.15.5:0/1391889440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f564015ec40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f563800d150 tx=0x7f563800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31f4e95cc463e49 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f5637fff700 1 -- 172.21.15.5:0/1391889440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638010070 con 0x7f56400b54f0 2023-10-16T13:47:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f5637fff700 1 -- 172.21.15.5:0/1391889440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800dd10 con 0x7f56400b54f0 2023-10-16T13:47:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f5637fff700 1 -- 172.21.15.5:0/1391889440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800b310 con 0x7f56400b54f0 2023-10-16T13:47:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 -- 172.21.15.5:0/1391889440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 msgr2=0x7f564015ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 --2- 172.21.15.5:0/1391889440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f564015ec40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f563800d150 tx=0x7f563800d460 comp rx=0 tx=0).stop 2023-10-16T13:47:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 -- 172.21.15.5:0/1391889440 shutdown_connections 2023-10-16T13:47:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 --2- 172.21.15.5:0/1391889440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f564015ec40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 --2- 172.21.15.5:0/1391889440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f564015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 -- 172.21.15.5:0/1391889440 >> 172.21.15.5:0/1391889440 conn(0x7f56400cc6f0 msgr2=0x7f56400ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 -- 172.21.15.5:0/1391889440 shutdown_connections 2023-10-16T13:47:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.885+0000 7f56474fb700 1 -- 172.21.15.5:0/1391889440 wait complete. 2023-10-16T13:47:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.887+0000 7f56474fb700 1 Processor -- start 2023-10-16T13:47:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.887+0000 7f56474fb700 1 -- start start 2023-10-16T13:47:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f56474fb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f564006e750 0x7f56400c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f56474fb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f56401551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f56474fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f56401f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f56474fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640155730 con 0x7f56400b54f0 2023-10-16T13:47:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f56474fb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640157c90 con 0x7f564006e750 2023-10-16T13:47:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f56474fb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56401f0550 con 0x7f564006eb30 2023-10-16T13:47:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f56401f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f56401f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47362/0 (socket says 172.21.15.5:47362) 2023-10-16T13:47:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 -- 172.21.15.5:0/2249166689 learned_addr learned my addr 172.21.15.5:0/2249166689 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 -- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 msgr2=0x7f56401551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5644a96700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f56401551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645297700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f564006e750 0x7f56400c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f56401551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 -- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f564006e750 msgr2=0x7f56400c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f564006e750 0x7f56400c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 -- 172.21.15.5:0/2249166689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800bd40 con 0x7f56400b54f0 2023-10-16T13:47:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.888+0000 7f5645a98700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f56401f0010 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f56400b2900 tx=0x7f5638004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.889+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800b4c0 con 0x7f56400b54f0 2023-10-16T13:47:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.889+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800adb0 con 0x7f56400b54f0 2023-10-16T13:47:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.889+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56400c83f0 con 0x7f56400b54f0 2023-10-16T13:47:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.889+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638004280 con 0x7f56400b54f0 2023-10-16T13:47:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.889+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56400c89b0 con 0x7f56400b54f0 2023-10-16T13:47:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.890+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5640067d20 con 0x7f56400b54f0 2023-10-16T13:47:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.890+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f56380043e0 con 0x7f56400b54f0 2023-10-16T13:47:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.891+0000 7f5635ffb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f562406b1d0 0x7f562406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.891+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f563808d4a0 con 0x7f56400b54f0 2023-10-16T13:47:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.891+0000 7f5645297700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f562406b1d0 0x7f562406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.891+0000 7f5645297700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f562406b1d0 0x7f562406d690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f60 tx=0x7f563c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:36.896+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56380580a0 con 0x7f56400b54f0 2023-10-16T13:47:37.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.097+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f564015e0d0 con 0x7f56400b54f0 2023-10-16T13:47:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.098+0000 7f5635ffb700 1 -- 172.21.15.5:0/2249166689 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16488 (secure 0 0 0) 0x7f563805b6c0 con 0x7f56400b54f0 2023-10-16T13:47:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:37.102 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:18.949509+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:15.233911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:16.326353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f562406b1d0 msgr2=0x7f562406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f562406b1d0 0x7f562406d690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f60 tx=0x7f563c009040 comp rx=0 tx=0).stop 2023-10-16T13:47:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 msgr2=0x7f56401f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f56401f0010 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f56400b2900 tx=0x7f5638004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 shutdown_connections 2023-10-16T13:47:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56400b54f0 0x7f56401f0010 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f564006e750 0x7f56400c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f562406b1d0 0x7f562406d690 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 --2- 172.21.15.5:0/2249166689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564006eb30 0x7f56401551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 >> 172.21.15.5:0/2249166689 conn(0x7f56400cc6f0 msgr2=0x7f56400ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 shutdown_connections 2023-10-16T13:47:37.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.101+0000 7f56474fb700 1 -- 172.21.15.5:0/2249166689 wait complete. 2023-10-16T13:47:37.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:47:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.239+0000 7f418660b700 1 Processor -- start 2023-10-16T13:47:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.239+0000 7f418660b700 1 -- start start 2023-10-16T13:47:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f418660b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f418660b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4180161670 0x7f418006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f418660b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41800ccd10 0x7f418006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f418660b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4180071ab0 con 0x7f4180161670 2023-10-16T13:47:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f418660b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4180161bc0 con 0x7f41800ccd10 2023-10-16T13:47:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f418660b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180161ea0 con 0x7f41800cc3f0 2023-10-16T13:47:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f417f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4180161670 0x7f418006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f417f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4180161670 0x7f418006a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47366/0 (socket says 172.21.15.5:47366) 2023-10-16T13:47:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f417f7fe700 1 -- 172.21.15.5:0/1352108797 learned_addr learned my addr 172.21.15.5:0/1352108797 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f4184ba8700 1 --2- 172.21.15.5:0/1352108797 >> v2:172.21.15.112:3300/0 conn(0x7f41800ccd10 0x7f418006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.240+0000 7f417ffff700 1 --2- 172.21.15.5:0/1352108797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417f7fe700 1 -- 172.21.15.5:0/1352108797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 msgr2=0x7f41800cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417f7fe700 1 --2- 172.21.15.5:0/1352108797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417f7fe700 1 -- 172.21.15.5:0/1352108797 >> v2:172.21.15.112:3300/0 conn(0x7f41800ccd10 msgr2=0x7f418006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417f7fe700 1 --2- 172.21.15.5:0/1352108797 >> v2:172.21.15.112:3300/0 conn(0x7f41800ccd10 0x7f418006ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417f7fe700 1 -- 172.21.15.5:0/1352108797 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180162180 con 0x7f4180161670 2023-10-16T13:47:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417f7fe700 1 --2- 172.21.15.5:0/1352108797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4180161670 0x7f418006a840 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f41800c7480 tx=0x7f4170009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6390fee0fa587e6a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417effd700 1 -- 172.21.15.5:0/1352108797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170011830 con 0x7f4180161670 2023-10-16T13:47:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417effd700 1 -- 172.21.15.5:0/1352108797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170011990 con 0x7f4180161670 2023-10-16T13:47:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f417effd700 1 -- 172.21.15.5:0/1352108797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170011d20 con 0x7f4180161670 2023-10-16T13:47:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f418660b700 1 -- 172.21.15.5:0/1352108797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4180161670 msgr2=0x7f418006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.241+0000 7f418660b700 1 --2- 172.21.15.5:0/1352108797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4180161670 0x7f418006a840 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f41800c7480 tx=0x7f4170009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 -- 172.21.15.5:0/1352108797 shutdown_connections 2023-10-16T13:47:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 --2- 172.21.15.5:0/1352108797 >> v2:172.21.15.112:3300/0 conn(0x7f41800ccd10 0x7f418006ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 --2- 172.21.15.5:0/1352108797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 --2- 172.21.15.5:0/1352108797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4180161670 0x7f418006a840 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 -- 172.21.15.5:0/1352108797 >> 172.21.15.5:0/1352108797 conn(0x7f418006dac0 msgr2=0x7f418006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 -- 172.21.15.5:0/1352108797 shutdown_connections 2023-10-16T13:47:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.242+0000 7f418660b700 1 -- 172.21.15.5:0/1352108797 wait complete. 2023-10-16T13:47:37.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.243+0000 7f418660b700 1 Processor -- start 2023-10-16T13:47:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.243+0000 7f418660b700 1 -- start start 2023-10-16T13:47:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f418660b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f418660b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 0x7f4180153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f418660b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4180161670 0x7f4180152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f418660b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180153db0 con 0x7f41800ccd10 2023-10-16T13:47:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f418660b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c4e70 con 0x7f4180161670 2023-10-16T13:47:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f418660b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800b37d0 con 0x7f41800cc3f0 2023-10-16T13:47:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 0x7f4180153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 0x7f4180153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47374/0 (socket says 172.21.15.5:47374) 2023-10-16T13:47:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 -- 172.21.15.5:0/3994490969 learned_addr learned my addr 172.21.15.5:0/3994490969 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417ffff700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f4184ba8700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4180161670 0x7f4180152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 -- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 msgr2=0x7f41800b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 -- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4180161670 msgr2=0x7f4180152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4180161670 0x7f4180152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 -- 172.21.15.5:0/3994490969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009550 con 0x7f41800ccd10 2023-10-16T13:47:37.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417f7fe700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 0x7f4180153870 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4170009c10 tx=0x7f4170004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:37.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.244+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170004300 con 0x7f41800ccd10 2023-10-16T13:47:37.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.245+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417001f070 con 0x7f41800ccd10 2023-10-16T13:47:37.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.245+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41800b3ab0 con 0x7f41800ccd10 2023-10-16T13:47:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.245+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700036a0 con 0x7f41800ccd10 2023-10-16T13:47:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.245+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41800b4070 con 0x7f41800ccd10 2023-10-16T13:47:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.245+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800c5000 con 0x7f41800ccd10 2023-10-16T13:47:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.246+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f4170021030 con 0x7f41800ccd10 2023-10-16T13:47:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.246+0000 7f417cff9700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f416006b1d0 0x7f416006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.246+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f417008ac30 con 0x7f41800ccd10 2023-10-16T13:47:37.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.247+0000 7f417ffff700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f416006b1d0 0x7f416006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.247+0000 7f417ffff700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f416006b1d0 0x7f416006d690 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4168009a50 tx=0x7f4168008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:37.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.251+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41700559e0 con 0x7f41800ccd10 2023-10-16T13:47:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.499+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4180067d20 con 0x7f41800ccd10 2023-10-16T13:47:37.502 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:47:37.500+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:47:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.501+0000 7f417cff9700 1 -- 172.21.15.5:0/3994490969 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4170015020 con 0x7f41800ccd10 2023-10-16T13:47:37.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f416006b1d0 msgr2=0x7f416006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f416006b1d0 0x7f416006d690 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4168009a50 tx=0x7f4168008040 comp rx=0 tx=0).stop 2023-10-16T13:47:37.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 msgr2=0x7f4180153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 0x7f4180153870 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4170009c10 tx=0x7f4170004750 comp rx=0 tx=0).stop 2023-10-16T13:47:37.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 shutdown_connections 2023-10-16T13:47:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4180161670 0x7f4180152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f416006b1d0 0x7f416006d690 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cc3f0 0x7f41800b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 --2- 172.21.15.5:0/3994490969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41800ccd10 0x7f4180153870 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 >> 172.21.15.5:0/3994490969 conn(0x7f418006dac0 msgr2=0x7f41800b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:37.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 shutdown_connections 2023-10-16T13:47:37.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.505+0000 7f418660b700 1 -- 172.21.15.5:0/3994490969 wait complete. 2023-10-16T13:47:37.510 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:47:37.511 INFO:tasks.ceph.mds.c.smithi005.stderr: -4559> 2023-10-16T13:47:22.917+0000 7fb195a06700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:47:37.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:47:37.539 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:47:37.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.646+0000 7f012de52700 1 Processor -- start 2023-10-16T13:47:37.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.646+0000 7f012de52700 1 -- start start 2023-10-16T13:47:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f012de52700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01280d0c70 0x7f01280cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f012de52700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01280c5110 0x7f01280ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f012de52700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280d23e0 con 0x7f012815b740 2023-10-16T13:47:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f012de52700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012815bb20 con 0x7f01280d0c70 2023-10-16T13:47:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f012de52700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01280cf190 con 0x7f01280c5110 2023-10-16T13:47:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01280d0c70 0x7f01280cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01280d0c70 0x7f01280cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47392/0 (socket says 172.21.15.5:47392) 2023-10-16T13:47:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 -- 172.21.15.5:0/1919582195 learned_addr learned my addr 172.21.15.5:0/1919582195 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 -- 172.21.15.5:0/1919582195 >> v2:172.21.15.112:3300/0 conn(0x7f01280c5110 msgr2=0x7f01280ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0127fff700 1 --2- 172.21.15.5:0/1919582195 >> v2:172.21.15.112:3300/0 conn(0x7f01280c5110 0x7f01280ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 --2- 172.21.15.5:0/1919582195 >> v2:172.21.15.112:3300/0 conn(0x7f01280c5110 0x7f01280ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 -- 172.21.15.5:0/1919582195 >> v1:172.21.15.112:6789/0 conn(0x7f012815b740 legacy=0x7f01280d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 -- 172.21.15.5:0/1919582195 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01280cbd40 con 0x7f01280d0c70 2023-10-16T13:47:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0127fff700 1 --2- 172.21.15.5:0/1919582195 >> v2:172.21.15.112:3300/0 conn(0x7f01280c5110 0x7f01280ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.647+0000 7f0126ffd700 1 --2- 172.21.15.5:0/1919582195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280d0c70 0x7f01280cdfd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f01280c8620 tx=0x7f0118009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7841d964770ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f01267fc700 1 -- 172.21.15.5:0/1919582195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118004230 con 0x7f01280d0c70 2023-10-16T13:47:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f01267fc700 1 -- 172.21.15.5:0/1919582195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0118004390 con 0x7f01280d0c70 2023-10-16T13:47:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f01267fc700 1 -- 172.21.15.5:0/1919582195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01180036a0 con 0x7f01280d0c70 2023-10-16T13:47:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 -- 172.21.15.5:0/1919582195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280d0c70 msgr2=0x7f01280cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 --2- 172.21.15.5:0/1919582195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280d0c70 0x7f01280cdfd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f01280c8620 tx=0x7f0118009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 -- 172.21.15.5:0/1919582195 shutdown_connections 2023-10-16T13:47:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 --2- 172.21.15.5:0/1919582195 >> v2:172.21.15.112:3300/0 conn(0x7f01280c5110 0x7f01280ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 --2- 172.21.15.5:0/1919582195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280d0c70 0x7f01280cdfd0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 -- 172.21.15.5:0/1919582195 >> 172.21.15.5:0/1919582195 conn(0x7f01280665a0 msgr2=0x7f0128066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 -- 172.21.15.5:0/1919582195 shutdown_connections 2023-10-16T13:47:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.648+0000 7f012de52700 1 -- 172.21.15.5:0/1919582195 wait complete. 2023-10-16T13:47:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 Processor -- start 2023-10-16T13:47:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 -- start start 2023-10-16T13:47:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 0x7f012806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01280d0c70 0x7f01281f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f012815b740 0x7f01280b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012806cce0 con 0x7f01280c5110 2023-10-16T13:47:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281f2d30 con 0x7f01280d0c70 2023-10-16T13:47:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.650+0000 7f012de52700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012806c720 con 0x7f012815b740 2023-10-16T13:47:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 0x7f012806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 0x7f012806d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47398/0 (socket says 172.21.15.5:47398) 2023-10-16T13:47:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 -- 172.21.15.5:0/1285793525 learned_addr learned my addr 172.21.15.5:0/1285793525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f0126ffd700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01280d0c70 0x7f01281f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f0127fff700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f012815b740 0x7f01280b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 -- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f012815b740 msgr2=0x7f01280b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f012815b740 0x7f01280b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 -- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01280d0c70 msgr2=0x7f01281f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01280d0c70 0x7f01281f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 -- 172.21.15.5:0/1285793525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0118009550 con 0x7f01280c5110 2023-10-16T13:47:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f0127fff700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f012815b740 0x7f01280b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f01277fe700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 0x7f012806d5d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f011c00b4a0 tx=0x7f011c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c011830 con 0x7f01280c5110 2023-10-16T13:47:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c011990 con 0x7f01280c5110 2023-10-16T13:47:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012806ca00 con 0x7f01280c5110 2023-10-16T13:47:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c011d40 con 0x7f01280c5110 2023-10-16T13:47:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.651+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0128152ce0 con 0x7f01280c5110 2023-10-16T13:47:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.652+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0128152860 con 0x7f01280c5110 2023-10-16T13:47:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.653+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f011c01a400 con 0x7f01280c5110 2023-10-16T13:47:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.653+0000 7f010ffff700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f011406b1d0 0x7f011406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.653+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f011c089780 con 0x7f01280c5110 2023-10-16T13:47:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.653+0000 7f0126ffd700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f011406b1d0 0x7f011406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.654+0000 7f0126ffd700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f011406b1d0 0x7f011406d690 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0118009130 tx=0x7f0118008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.658+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0128152860 con 0x7f01280c5110 2023-10-16T13:47:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:37.905+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0128152860 con 0x7f01280c5110 2023-10-16T13:47:38.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.505+0000 7f010ffff700 1 -- 172.21.15.5:0/1285793525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0128152860 con 0x7f01280c5110 2023-10-16T13:47:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f011406b1d0 msgr2=0x7f011406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f011406b1d0 0x7f011406d690 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0118009130 tx=0x7f0118008030 comp rx=0 tx=0).stop 2023-10-16T13:47:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 msgr2=0x7f012806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:38.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 0x7f012806d5d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f011c00b4a0 tx=0x7f011c00b7b0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 shutdown_connections 2023-10-16T13:47:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f011406b1d0 0x7f011406d690 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f012815b740 0x7f01280b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01280c5110 0x7f012806d5d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 --2- 172.21.15.5:0/1285793525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01280d0c70 0x7f01281f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 >> 172.21.15.5:0/1285793525 conn(0x7f01280665a0 msgr2=0x7f01280b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 shutdown_connections 2023-10-16T13:47:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.508+0000 7f012de52700 1 -- 172.21.15.5:0/1285793525 wait complete. 2023-10-16T13:47:38.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:47:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.697+0000 7fe2b46e7700 1 Processor -- start 2023-10-16T13:47:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.697+0000 7fe2b46e7700 1 -- start start 2023-10-16T13:47:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b46e7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2ac15ba50 0x7fe2ac072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b46e7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b46e7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac072890 con 0x7fe2ac0cd870 2023-10-16T13:47:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b46e7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac0cdcf0 con 0x7fe2ac15ba50 2023-10-16T13:47:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b46e7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac06e950 con 0x7fe2ac0b29b0 2023-10-16T13:47:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2483700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2ac15ba50 0x7fe2ac072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2c84700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe2ac0cd870 0x7fe2ac06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57412/0 (socket says 172.21.15.5:57412) 2023-10-16T13:47:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2c84700 1 -- 172.21.15.5:0/2691948051 learned_addr learned my addr 172.21.15.5:0/2691948051 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b1c82700 1 --2- 172.21.15.5:0/2691948051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2483700 1 -- 172.21.15.5:0/2691948051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 msgr2=0x7fe2ac0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2483700 1 --2- 172.21.15.5:0/2691948051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2483700 1 -- 172.21.15.5:0/2691948051 >> v1:172.21.15.5:6789/0 conn(0x7fe2ac0cd870 legacy=0x7fe2ac06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2483700 1 -- 172.21.15.5:0/2691948051 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac0caaf0 con 0x7fe2ac15ba50 2023-10-16T13:47:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b1481700 1 -- 172.21.15.5:0/2691948051 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845017725 0 0) 0x7fe2a4001490 con 0x7fe2ac0cd870 2023-10-16T13:47:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.698+0000 7fe2b2483700 1 --2- 172.21.15.5:0/2691948051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac072350 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009840 tx=0x7fe29c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acc1bc9313a8f13 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b1481700 1 -- 172.21.15.5:0/2691948051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011830 con 0x7fe2ac15ba50 2023-10-16T13:47:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b1481700 1 -- 172.21.15.5:0/2691948051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c011990 con 0x7fe2ac15ba50 2023-10-16T13:47:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b1481700 1 -- 172.21.15.5:0/2691948051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011d20 con 0x7fe2ac15ba50 2023-10-16T13:47:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2691948051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac15ba50 msgr2=0x7fe2ac072350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2691948051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac072350 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009840 tx=0x7fe29c009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2691948051 shutdown_connections 2023-10-16T13:47:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2691948051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac072350 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2691948051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2691948051 >> 172.21.15.5:0/2691948051 conn(0x7fe2ac06bd70 msgr2=0x7fe2ac06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2691948051 shutdown_connections 2023-10-16T13:47:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.699+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2691948051 wait complete. 2023-10-16T13:47:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.700+0000 7fe2b46e7700 1 Processor -- start 2023-10-16T13:47:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 -- start start 2023-10-16T13:47:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 0x7fe2ac0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c9890 con 0x7fe2ac0cd870 2023-10-16T13:47:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c95b0 con 0x7fe2ac15ba50 2023-10-16T13:47:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b46e7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac15d0b0 con 0x7fe2ac0b29b0 2023-10-16T13:47:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b1c82700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 0x7fe2ac0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b1c82700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 0x7fe2ac0c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47416/0 (socket says 172.21.15.5:47416) 2023-10-16T13:47:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b1c82700 1 -- 172.21.15.5:0/2450989169 learned_addr learned my addr 172.21.15.5:0/2450989169 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.701+0000 7fe2b2483700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b2c84700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b1c82700 1 -- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 msgr2=0x7fe2ac15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b1c82700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac15db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b1c82700 1 -- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2ac15ba50 msgr2=0x7fe2ac0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b1c82700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b1c82700 1 -- 172.21.15.5:0/2450989169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0094a0 con 0x7fe2ac0cd870 2023-10-16T13:47:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b1c82700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 0x7fe2ac0c8ca0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800e810 tx=0x7fe2a800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800c070 con 0x7fe2ac0cd870 2023-10-16T13:47:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8013610 con 0x7fe2ac0cd870 2023-10-16T13:47:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac15d390 con 0x7fe2ac0cd870 2023-10-16T13:47:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80139a0 con 0x7fe2ac0cd870 2023-10-16T13:47:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.702+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac0c91e0 con 0x7fe2ac0cd870 2023-10-16T13:47:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.703+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac15e0d0 con 0x7fe2ac0cd870 2023-10-16T13:47:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.704+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fe2a8013b00 con 0x7fe2ac0cd870 2023-10-16T13:47:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.704+0000 7fe2a2ffd700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe29006b1d0 0x7fe29006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.704+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe2a80895b0 con 0x7fe2ac0cd870 2023-10-16T13:47:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.704+0000 7fe2b2483700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe29006b1d0 0x7fe29006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.705+0000 7fe2b2483700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe29006b1d0 0x7fe29006d690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0090b0 tx=0x7fe29c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.709+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2a80541a0 con 0x7fe2ac0cd870 2023-10-16T13:47:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:38.912+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2ac15cf10 con 0x7fe2ac0cd870 2023-10-16T13:47:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.736+0000 7fe2a2ffd700 1 -- 172.21.15.5:0/2450989169 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe2ac15cf10 con 0x7fe2ac0cd870 2023-10-16T13:47:39.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.739+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe29006b1d0 msgr2=0x7fe29006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:39.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.739+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe29006b1d0 0x7fe29006d690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0090b0 tx=0x7fe29c01c040 comp rx=0 tx=0).stop 2023-10-16T13:47:39.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.739+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 msgr2=0x7fe2ac0c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:39.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.739+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 0x7fe2ac0c8ca0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800e810 tx=0x7fe2a800eb20 comp rx=0 tx=0).stop 2023-10-16T13:47:39.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 shutdown_connections 2023-10-16T13:47:39.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2ac15ba50 0x7fe2ac0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe29006b1d0 0x7fe29006d690 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2ac0b29b0 0x7fe2ac15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 --2- 172.21.15.5:0/2450989169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2ac0cd870 0x7fe2ac0c8ca0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 >> 172.21.15.5:0/2450989169 conn(0x7fe2ac06bd70 msgr2=0x7fe2ac072090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 shutdown_connections 2023-10-16T13:47:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.740+0000 7fe2b46e7700 1 -- 172.21.15.5:0/2450989169 wait complete. 2023-10-16T13:47:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:47:39.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:47:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.891+0000 7fb7301a5700 1 Processor -- start 2023-10-16T13:47:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.891+0000 7fb7301a5700 1 -- start start 2023-10-16T13:47:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb7301a5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7280cdf10 0x7fb7280d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb7301a5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7280b0730 0x7fb7280ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb7301a5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb72806bd80 0x7fb72806c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb7301a5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280cbdb0 con 0x7fb72806bd80 2023-10-16T13:47:39.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb7301a5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280ce830 con 0x7fb7280cdf10 2023-10-16T13:47:39.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb7301a5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280d0b40 con 0x7fb7280b0730 2023-10-16T13:47:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb72806bd80 0x7fb72806c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb72806bd80 0x7fb72806c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47426/0 (socket says 172.21.15.5:47426) 2023-10-16T13:47:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 -- 172.21.15.5:0/2668060986 learned_addr learned my addr 172.21.15.5:0/2668060986 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72df41700 1 --2- 172.21.15.5:0/2668060986 >> v2:172.21.15.112:3300/0 conn(0x7fb7280cdf10 0x7fb7280d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72d740700 1 --2- 172.21.15.5:0/2668060986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7280b0730 0x7fb7280ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 -- 172.21.15.5:0/2668060986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7280b0730 msgr2=0x7fb7280ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 --2- 172.21.15.5:0/2668060986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7280b0730 0x7fb7280ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 -- 172.21.15.5:0/2668060986 >> v2:172.21.15.112:3300/0 conn(0x7fb7280cdf10 msgr2=0x7fb7280d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 --2- 172.21.15.5:0/2668060986 >> v2:172.21.15.112:3300/0 conn(0x7fb7280cdf10 0x7fb7280d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.892+0000 7fb72e742700 1 -- 172.21.15.5:0/2668060986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280d0e20 con 0x7fb72806bd80 2023-10-16T13:47:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb72e742700 1 --2- 172.21.15.5:0/2668060986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72806bd80 0x7fb72806c1e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb72806b7d0 tx=0x7fb72000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dd1ca1df93f8ab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb72cf3f700 1 -- 172.21.15.5:0/2668060986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000e070 con 0x7fb72806bd80 2023-10-16T13:47:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb72cf3f700 1 -- 172.21.15.5:0/2668060986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000b9c0 con 0x7fb72806bd80 2023-10-16T13:47:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb72cf3f700 1 -- 172.21.15.5:0/2668060986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000bd70 con 0x7fb72806bd80 2023-10-16T13:47:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 -- 172.21.15.5:0/2668060986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72806bd80 msgr2=0x7fb72806c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 --2- 172.21.15.5:0/2668060986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72806bd80 0x7fb72806c1e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb72806b7d0 tx=0x7fb72000b330 comp rx=0 tx=0).stop 2023-10-16T13:47:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 -- 172.21.15.5:0/2668060986 shutdown_connections 2023-10-16T13:47:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 --2- 172.21.15.5:0/2668060986 >> v2:172.21.15.112:3300/0 conn(0x7fb7280cdf10 0x7fb7280d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 --2- 172.21.15.5:0/2668060986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72806bd80 0x7fb72806c1e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 --2- 172.21.15.5:0/2668060986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7280b0730 0x7fb7280ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 -- 172.21.15.5:0/2668060986 >> 172.21.15.5:0/2668060986 conn(0x7fb7280d1530 msgr2=0x7fb7280d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.893+0000 7fb7301a5700 1 -- 172.21.15.5:0/2668060986 shutdown_connections 2023-10-16T13:47:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.894+0000 7fb7301a5700 1 -- 172.21.15.5:0/2668060986 wait complete. 2023-10-16T13:47:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 Processor -- start 2023-10-16T13:47:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 -- start start 2023-10-16T13:47:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb72806bd80 0x7fb7281e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 0x7fb72815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7280cdf10 0x7fb7280c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815b0a0 con 0x7fb7280b0730 2023-10-16T13:47:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281e76a0 con 0x7fb7280cdf10 2023-10-16T13:47:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.895+0000 7fb7301a5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281e6a90 con 0x7fb72806bd80 2023-10-16T13:47:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 0x7fb72815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 0x7fb72815ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47430/0 (socket says 172.21.15.5:47430) 2023-10-16T13:47:39.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 -- 172.21.15.5:0/3020381670 learned_addr learned my addr 172.21.15.5:0/3020381670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:39.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72df41700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb72806bd80 0x7fb7281e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72e742700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7280cdf10 0x7fb7280c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 -- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb72806bd80 msgr2=0x7fb7281e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:39.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb72806bd80 0x7fb7281e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 -- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7280cdf10 msgr2=0x7fb7280c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7280cdf10 0x7fb7280c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 -- 172.21.15.5:0/3020381670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009b30 con 0x7fb7280b0730 2023-10-16T13:47:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb72d740700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 0x7fb72815ab60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb72400d830 tx=0x7fb72400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240125f0 con 0x7fb7280b0730 2023-10-16T13:47:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724012770 con 0x7fb7280b0730 2023-10-16T13:47:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724012b20 con 0x7fb7280b0730 2023-10-16T13:47:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7281e6d70 con 0x7fb7280b0730 2023-10-16T13:47:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.896+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7281e7330 con 0x7fb7280b0730 2023-10-16T13:47:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.897+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb728067d20 con 0x7fb7280b0730 2023-10-16T13:47:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.898+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fb724012c80 con 0x7fb7280b0730 2023-10-16T13:47:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.898+0000 7fb71e7fc700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb70c06b1d0 0x7fb70c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.898+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb7240898a0 con 0x7fb7280b0730 2023-10-16T13:47:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.898+0000 7fb72df41700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb70c06b1d0 0x7fb70c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.899+0000 7fb72df41700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb70c06b1d0 0x7fb70c06d690 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb718006fd0 tx=0x7fb718008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:39.906+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb724054760 con 0x7fb7280b0730 2023-10-16T13:47:40.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.109+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb72806f7a0 con 0x7fb7280b0730 2023-10-16T13:47:40.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.738+0000 7fb71e7fc700 1 -- 172.21.15.5:0/3020381670 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb724057d80 con 0x7fb7280b0730 2023-10-16T13:47:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb70c06b1d0 msgr2=0x7fb70c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb70c06b1d0 0x7fb70c06d690 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb718006fd0 tx=0x7fb718008040 comp rx=0 tx=0).stop 2023-10-16T13:47:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 msgr2=0x7fb72815ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 0x7fb72815ab60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb72400d830 tx=0x7fb72400db40 comp rx=0 tx=0).stop 2023-10-16T13:47:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 shutdown_connections 2023-10-16T13:47:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7280cdf10 0x7fb7280c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb70c06b1d0 0x7fb70c06d690 secure :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb718006fd0 tx=0x7fb718008040 comp rx=0 tx=0).stop 2023-10-16T13:47:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb72806bd80 0x7fb7281e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 --2- 172.21.15.5:0/3020381670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7280b0730 0x7fb72815ab60 secure :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb72400d830 tx=0x7fb72400db40 comp rx=0 tx=0).stop 2023-10-16T13:47:40.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 >> 172.21.15.5:0/3020381670 conn(0x7fb7280d1530 msgr2=0x7fb72806fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:40.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 shutdown_connections 2023-10-16T13:47:40.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.743+0000 7fb7301a5700 1 -- 172.21.15.5:0/3020381670 wait complete. 2023-10-16T13:47:40.749 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:47:40.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:47:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.898+0000 7f869a9d2700 1 Processor -- start 2023-10-16T13:47:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.898+0000 7f869a9d2700 1 -- start start 2023-10-16T13:47:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f869a9d2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86940cd920 0x7f86940c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f869a9d2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869415a290 con 0x7f8694159eb0 2023-10-16T13:47:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f869a9d2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940cb7e0 con 0x7f86940cca40 2023-10-16T13:47:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f869a9d2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86940cdfd0 con 0x7f86940cd920 2023-10-16T13:47:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f86937fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86940cd920 0x7f86940c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f8693fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8694159eb0 0x7f86940cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57440/0 (socket says 172.21.15.5:57440) 2023-10-16T13:47:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f8693fff700 1 -- 172.21.15.5:0/3643887286 learned_addr learned my addr 172.21.15.5:0/3643887286 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f86937fe700 1 -- 172.21.15.5:0/3643887286 >> v1:172.21.15.112:6789/0 conn(0x7f86940cca40 legacy=0x7f86940ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f86937fe700 1 -- 172.21.15.5:0/3643887286 >> v1:172.21.15.5:6789/0 conn(0x7f8694159eb0 legacy=0x7f86940cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.900+0000 7f86937fe700 1 -- 172.21.15.5:0/3643887286 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940cabd0 con 0x7f86940cd920 2023-10-16T13:47:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.901+0000 7f86937fe700 1 --2- 172.21.15.5:0/3643887286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86940cd920 0x7f86940c9a80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f867c008840 tx=0x7f867c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8bc0a277f98984 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.902+0000 7f8692ffd700 1 -- 172.21.15.5:0/3643887286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c010070 con 0x7f86940cd920 2023-10-16T13:47:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.902+0000 7f8692ffd700 1 -- 172.21.15.5:0/3643887286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c00d9c0 con 0x7f86940cd920 2023-10-16T13:47:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.902+0000 7f8692ffd700 1 -- 172.21.15.5:0/3643887286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00dd50 con 0x7f86940cd920 2023-10-16T13:47:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.903+0000 7f869a9d2700 1 -- 172.21.15.5:0/3643887286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86940cd920 msgr2=0x7f86940c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.903+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3643887286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86940cd920 0x7f86940c9a80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f867c008840 tx=0x7f867c00d330 comp rx=0 tx=0).stop 2023-10-16T13:47:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.903+0000 7f869a9d2700 1 -- 172.21.15.5:0/3643887286 shutdown_connections 2023-10-16T13:47:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.903+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3643887286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86940cd920 0x7f86940c9a80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.903+0000 7f869a9d2700 1 -- 172.21.15.5:0/3643887286 >> 172.21.15.5:0/3643887286 conn(0x7f86940cf430 msgr2=0x7f86940cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.904+0000 7f869a9d2700 1 -- 172.21.15.5:0/3643887286 shutdown_connections 2023-10-16T13:47:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.904+0000 7f869a9d2700 1 -- 172.21.15.5:0/3643887286 wait complete. 2023-10-16T13:47:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.905+0000 7f869a9d2700 1 Processor -- start 2023-10-16T13:47:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.905+0000 7f869a9d2700 1 -- start start 2023-10-16T13:47:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f869a9d2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86940cca40 0x7f869409cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f869a9d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86940cd920 0x7f86940c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f869a9d2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 0x7f86941e2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f869a9d2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940c3440 con 0x7f8694159eb0 2023-10-16T13:47:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f869a9d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940c3720 con 0x7f86940cd920 2023-10-16T13:47:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f869a9d2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940c3a00 con 0x7f86940cca40 2023-10-16T13:47:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f8698f6f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 0x7f86941e2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f86937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86940cd920 0x7f86940c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f8698f6f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 0x7f86941e2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47446/0 (socket says 172.21.15.5:47446) 2023-10-16T13:47:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f8698f6f700 1 -- 172.21.15.5:0/3202280242 learned_addr learned my addr 172.21.15.5:0/3202280242 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.906+0000 7f8693fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86940cca40 0x7f869409cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8698f6f700 1 -- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86940cca40 msgr2=0x7f869409cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8698f6f700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86940cca40 0x7f869409cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8698f6f700 1 -- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86940cd920 msgr2=0x7f86940c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8698f6f700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86940cd920 0x7f86940c2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8698f6f700 1 -- 172.21.15.5:0/3202280242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c008520 con 0x7f8694159eb0 2023-10-16T13:47:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8698f6f700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 0x7f86941e2ea0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f868c00ca70 tx=0x7f868c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c003c00 con 0x7f8694159eb0 2023-10-16T13:47:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c003d60 con 0x7f8694159eb0 2023-10-16T13:47:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869415a420 con 0x7f8694159eb0 2023-10-16T13:47:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00aa20 con 0x7f8694159eb0 2023-10-16T13:47:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.907+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940c41b0 con 0x7f8694159eb0 2023-10-16T13:47:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.908+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869415a940 con 0x7f8694159eb0 2023-10-16T13:47:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.909+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f868c00ab80 con 0x7f8694159eb0 2023-10-16T13:47:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.909+0000 7f8690ff9700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f867406b1d0 0x7f867406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.909+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f868c089570 con 0x7f8694159eb0 2023-10-16T13:47:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.909+0000 7f8693fff700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f867406b1d0 0x7f867406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.911+0000 7f8693fff700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f867406b1d0 0x7f867406d690 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8684007fd0 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:40.914+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f869415a940 con 0x7f8694159eb0 2023-10-16T13:47:41.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.117+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f869415a940 con 0x7f8694159eb0 2023-10-16T13:47:41.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.120+0000 7f8690ff9700 1 -- 172.21.15.5:0/3202280242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f869415a940 con 0x7f8694159eb0 2023-10-16T13:47:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f867406b1d0 msgr2=0x7f867406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f867406b1d0 0x7f867406d690 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8684007fd0 tx=0x7f8684009040 comp rx=0 tx=0).stop 2023-10-16T13:47:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 msgr2=0x7f86941e2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 0x7f86941e2ea0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f868c00ca70 tx=0x7f868c00cd80 comp rx=0 tx=0).stop 2023-10-16T13:47:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 shutdown_connections 2023-10-16T13:47:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8694159eb0 0x7f86941e2ea0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f867406b1d0 0x7f867406d690 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86940cca40 0x7f869409cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 --2- 172.21.15.5:0/3202280242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86940cd920 0x7f86940c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 >> 172.21.15.5:0/3202280242 conn(0x7f86940cf430 msgr2=0x7f86940b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:41.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 shutdown_connections 2023-10-16T13:47:41.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.122+0000 7f869a9d2700 1 -- 172.21.15.5:0/3202280242 wait complete. 2023-10-16T13:47:41.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-16T13:47:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.260+0000 7fa7f0b77700 1 Processor -- start 2023-10-16T13:47:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.260+0000 7fa7f0b77700 1 -- start start 2023-10-16T13:47:41.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7f0b77700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7ec15eab0 0x7fa7ec0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7f0b77700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0d1d90 0x7fa7ec0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7f0b77700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec15ee90 con 0x7fa7ec0cf6d0 2023-10-16T13:47:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7f0b77700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0d21c0 con 0x7fa7ec15eab0 2023-10-16T13:47:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7f0b77700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0cfb60 con 0x7fa7ec0d1d90 2023-10-16T13:47:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7ea59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7ec15eab0 0x7fa7ec0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7e9d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7ec0cf6d0 0x7fa7ec0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57454/0 (socket says 172.21.15.5:57454) 2023-10-16T13:47:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7ea59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7ec15eab0 0x7fa7ec0cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47450/0 (socket says 172.21.15.5:47450) 2023-10-16T13:47:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7e9d9b700 1 -- 172.21.15.5:0/669440986 learned_addr learned my addr 172.21.15.5:0/669440986 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.261+0000 7fa7ead9d700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0d1d90 0x7fa7ec0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7ea59c700 1 -- 172.21.15.5:0/669440986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0d1d90 msgr2=0x7fa7ec0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7ea59c700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0d1d90 0x7fa7ec0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7ea59c700 1 -- 172.21.15.5:0/669440986 >> v1:172.21.15.5:6789/0 conn(0x7fa7ec0cf6d0 legacy=0x7fa7ec0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7ea59c700 1 -- 172.21.15.5:0/669440986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec158370 con 0x7fa7ec15eab0 2023-10-16T13:47:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7e959a700 1 -- 172.21.15.5:0/669440986 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167794374 0 0) 0x7fa7ec15ee90 con 0x7fa7ec0cf6d0 2023-10-16T13:47:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7ead9d700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0d1d90 0x7fa7ec0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7ea59c700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0cf190 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009840 tx=0x7fa7e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45499ce432915393 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7e959a700 1 -- 172.21.15.5:0/669440986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0011830 con 0x7fa7ec15eab0 2023-10-16T13:47:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7e959a700 1 -- 172.21.15.5:0/669440986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0011990 con 0x7fa7ec15eab0 2023-10-16T13:47:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7e959a700 1 -- 172.21.15.5:0/669440986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0011d20 con 0x7fa7ec15eab0 2023-10-16T13:47:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7f0b77700 1 -- 172.21.15.5:0/669440986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 msgr2=0x7fa7ec0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0cf190 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009840 tx=0x7fa7e0009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.262+0000 7fa7f0b77700 1 -- 172.21.15.5:0/669440986 shutdown_connections 2023-10-16T13:47:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.263+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0d1d90 0x7fa7ec0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.263+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/669440986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0cf190 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.263+0000 7fa7f0b77700 1 -- 172.21.15.5:0/669440986 >> 172.21.15.5:0/669440986 conn(0x7fa7ec0665a0 msgr2=0x7fa7ec066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.263+0000 7fa7f0b77700 1 -- 172.21.15.5:0/669440986 shutdown_connections 2023-10-16T13:47:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.263+0000 7fa7f0b77700 1 -- 172.21.15.5:0/669440986 wait complete. 2023-10-16T13:47:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.264+0000 7fa7f0b77700 1 Processor -- start 2023-10-16T13:47:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.264+0000 7fa7f0b77700 1 -- start start 2023-10-16T13:47:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7f0b77700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0cf6d0 0x7fa7ec154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7f0b77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0d1d90 0x7fa7ec0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7f0b77700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7f0b77700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec15fb20 con 0x7fa7ec15eab0 2023-10-16T13:47:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7f0b77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec15f180 con 0x7fa7ec0d1d90 2023-10-16T13:47:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7f0b77700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec15f460 con 0x7fa7ec0cf6d0 2023-10-16T13:47:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47460/0 (socket says 172.21.15.5:47460) 2023-10-16T13:47:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 -- 172.21.15.5:0/202339228 learned_addr learned my addr 172.21.15.5:0/202339228 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ea59c700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0cf6d0 0x7fa7ec154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7e9d9b700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0d1d90 0x7fa7ec0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 -- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0cf6d0 msgr2=0x7fa7ec154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0cf6d0 0x7fa7ec154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 -- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0d1d90 msgr2=0x7fa7ec0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0d1d90 0x7fa7ec0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 -- 172.21.15.5:0/202339228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00094a0 con 0x7fa7ec15eab0 2023-10-16T13:47:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7e9d9b700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0d1d90 0x7fa7ec0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7ead9d700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0c7a80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4007df0 tx=0x7fa7e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400ddd0 con 0x7fa7ec15eab0 2023-10-16T13:47:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.265+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400f040 con 0x7fa7ec15eab0 2023-10-16T13:47:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.266+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec15f740 con 0x7fa7ec15eab0 2023-10-16T13:47:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.266+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4003c60 con 0x7fa7ec15eab0 2023-10-16T13:47:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.266+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec1551f0 con 0x7fa7ec15eab0 2023-10-16T13:47:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.266+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec15fc60 con 0x7fa7ec15eab0 2023-10-16T13:47:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.267+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fa7e4004030 con 0x7fa7ec15eab0 2023-10-16T13:47:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.267+0000 7fa7daffd700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa7cc06b1d0 0x7fa7cc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.267+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa7e40899e0 con 0x7fa7ec15eab0 2023-10-16T13:47:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.268+0000 7fa7ea59c700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa7cc06b1d0 0x7fa7cc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.268+0000 7fa7ea59c700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa7cc06b1d0 0x7fa7cc06d690 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00090b0 tx=0x7fa7e0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.272+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7ec15fc60 con 0x7fa7ec15eab0 2023-10-16T13:47:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.551+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7fa7ec15fc60 con 0x7fa7ec15eab0 2023-10-16T13:47:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.748+0000 7fa7daffd700 1 -- 172.21.15.5:0/202339228 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v389) v1 ==== 158+0+0 (secure 0 0 0) 0x7fa7ec15fc60 con 0x7fa7ec15eab0 2023-10-16T13:47:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa7cc06b1d0 msgr2=0x7fa7cc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa7cc06b1d0 0x7fa7cc06d690 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00090b0 tx=0x7fa7e0008030 comp rx=0 tx=0).stop 2023-10-16T13:47:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 msgr2=0x7fa7ec0c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0c7a80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4007df0 tx=0x7fa7e400d3b0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 shutdown_connections 2023-10-16T13:47:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec15eab0 0x7fa7ec0c7a80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa7cc06b1d0 0x7fa7cc06d690 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7ec0cf6d0 0x7fa7ec154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 --2- 172.21.15.5:0/202339228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7ec0d1d90 0x7fa7ec0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 >> 172.21.15.5:0/202339228 conn(0x7fa7ec0665a0 msgr2=0x7fa7ec0b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 shutdown_connections 2023-10-16T13:47:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.751+0000 7fa7f0b77700 1 -- 172.21.15.5:0/202339228 wait complete. 2023-10-16T13:47:41.766 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command ... ok 2023-10-16T13:47:41.767 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command without subvolume group 2023-10-16T13:47:41.767 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:47:41.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.890+0000 7f0a5025e700 1 Processor -- start 2023-10-16T13:47:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a5025e700 1 -- start start 2023-10-16T13:47:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a5025e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a480d08a0 0x7f0a480d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a5025e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a480b7ab0 0x7f0a480ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a5025e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480b6610 con 0x7f0a48160e30 2023-10-16T13:47:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a5025e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a480d1da0 con 0x7f0a480b7ab0 2023-10-16T13:47:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a5025e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480d2080 con 0x7f0a480d08a0 2023-10-16T13:47:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a4dffa700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a48160e30 0x7f0a480d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57468/0 (socket says 172.21.15.5:57468) 2023-10-16T13:47:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.891+0000 7f0a4dffa700 1 -- 172.21.15.5:0/2374801432 learned_addr learned my addr 172.21.15.5:0/2374801432 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/2374801432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a480d08a0 0x7f0a480d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4e7fb700 1 --2- 172.21.15.5:0/2374801432 >> v2:172.21.15.112:3300/0 conn(0x7f0a480b7ab0 0x7f0a480ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4cff8700 1 -- 172.21.15.5:0/2374801432 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810468939 0 0) 0x7f0a480b6610 con 0x7f0a48160e30 2023-10-16T13:47:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4cff8700 1 -- 172.21.15.5:0/2374801432 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a340035b0 con 0x7f0a48160e30 2023-10-16T13:47:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4d7f9700 1 -- 172.21.15.5:0/2374801432 >> v2:172.21.15.112:3300/0 conn(0x7f0a480b7ab0 msgr2=0x7f0a480ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/2374801432 >> v2:172.21.15.112:3300/0 conn(0x7f0a480b7ab0 0x7f0a480ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4d7f9700 1 -- 172.21.15.5:0/2374801432 >> v1:172.21.15.5:6789/0 conn(0x7f0a48160e30 legacy=0x7f0a480d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4cff8700 1 -- 172.21.15.5:0/2374801432 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906888456 0 0) 0x7f0a340035b0 con 0x7f0a48160e30 2023-10-16T13:47:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4d7f9700 1 -- 172.21.15.5:0/2374801432 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480d2360 con 0x7f0a480d08a0 2023-10-16T13:47:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4e7fb700 1 --2- 172.21.15.5:0/2374801432 >> v2:172.21.15.112:3300/0 conn(0x7f0a480b7ab0 0x7f0a480ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/2374801432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a480d08a0 0x7f0a480d4200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009840 tx=0x7f0a38009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295385a2af877629 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.892+0000 7f0a4cff8700 1 -- 172.21.15.5:0/2374801432 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440017f0 con 0x7f0a480d08a0 2023-10-16T13:47:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a4cff8700 1 -- 172.21.15.5:0/2374801432 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38004030 con 0x7f0a480d08a0 2023-10-16T13:47:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a4cff8700 1 -- 172.21.15.5:0/2374801432 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380043c0 con 0x7f0a480d08a0 2023-10-16T13:47:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 -- 172.21.15.5:0/2374801432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a480d08a0 msgr2=0x7f0a480d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 --2- 172.21.15.5:0/2374801432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a480d08a0 0x7f0a480d4200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009840 tx=0x7f0a38009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 -- 172.21.15.5:0/2374801432 shutdown_connections 2023-10-16T13:47:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 --2- 172.21.15.5:0/2374801432 >> v2:172.21.15.112:3300/0 conn(0x7f0a480b7ab0 0x7f0a480ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 --2- 172.21.15.5:0/2374801432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a480d08a0 0x7f0a480d4200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 -- 172.21.15.5:0/2374801432 >> 172.21.15.5:0/2374801432 conn(0x7f0a4809cb40 msgr2=0x7f0a480d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 -- 172.21.15.5:0/2374801432 shutdown_connections 2023-10-16T13:47:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.893+0000 7f0a5025e700 1 -- 172.21.15.5:0/2374801432 wait complete. 2023-10-16T13:47:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.894+0000 7f0a5025e700 1 Processor -- start 2023-10-16T13:47:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.894+0000 7f0a5025e700 1 -- start start 2023-10-16T13:47:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a5025e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 0x7f0a4815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a5025e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a480d08a0 0x7f0a48157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a5025e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a48160e30 0x7f0a480b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a5025e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4815b300 con 0x7f0a480b7ab0 2023-10-16T13:47:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a5025e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481f3290 con 0x7f0a480d08a0 2023-10-16T13:47:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a5025e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481f6a20 con 0x7f0a48160e30 2023-10-16T13:47:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a4dffa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 0x7f0a4815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a4dffa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 0x7f0a4815d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47470/0 (socket says 172.21.15.5:47470) 2023-10-16T13:47:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.895+0000 7f0a4dffa700 1 -- 172.21.15.5:0/1378586497 learned_addr learned my addr 172.21.15.5:0/1378586497 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a480d08a0 0x7f0a48157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4e7fb700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a48160e30 0x7f0a480b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4dffa700 1 -- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a48160e30 msgr2=0x7f0a480b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4dffa700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a48160e30 0x7f0a480b84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4dffa700 1 -- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a480d08a0 msgr2=0x7f0a48157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4dffa700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a480d08a0 0x7f0a48157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4dffa700 1 -- 172.21.15.5:0/1378586497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009a70 con 0x7f0a480b7ab0 2023-10-16T13:47:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a480d08a0 0x7f0a48157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a4dffa700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 0x7f0a4815d4f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400c520 tx=0x7f0a4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440074e0 con 0x7f0a480b7ab0 2023-10-16T13:47:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a44007640 con 0x7f0a480b7ab0 2023-10-16T13:47:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a380094a0 con 0x7f0a480b7ab0 2023-10-16T13:47:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44005a70 con 0x7f0a480b7ab0 2023-10-16T13:47:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.896+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a481f6cc0 con 0x7f0a480b7ab0 2023-10-16T13:47:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.897+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a480d19c0 con 0x7f0a480b7ab0 2023-10-16T13:47:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.897+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f0a44005bd0 con 0x7f0a480b7ab0 2023-10-16T13:47:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.898+0000 7f0a3e7fc700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a2c06b1d0 0x7f0a2c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.898+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a44088e80 con 0x7f0a480b7ab0 2023-10-16T13:47:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.898+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a2c06b1d0 0x7f0a2c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.898+0000 7f0a4d7f9700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a2c06b1d0 0x7f0a2c06d690 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0a480d04c0 tx=0x7f0a38008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:41.903+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a44053d70 con 0x7f0a480b7ab0 2023-10-16T13:47:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.107+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a48067d20 con 0x7f0a480b7ab0 2023-10-16T13:47:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.108+0000 7f0a3e7fc700 1 -- 172.21.15.5:0/1378586497 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+12913 (secure 0 0 0) 0x7f0a44017070 con 0x7f0a480b7ab0 2023-10-16T13:47:42.111 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:42.111 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:40.738717+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6834/1286413980":"2023-10-17T13:47:37.500748+0000","172.21.15.5:6832/1286413980":"2023-10-17T13:47:37.500748+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:42.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a2c06b1d0 msgr2=0x7f0a2c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a2c06b1d0 0x7f0a2c06d690 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0a480d04c0 tx=0x7f0a38008030 comp rx=0 tx=0).stop 2023-10-16T13:47:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 msgr2=0x7f0a4815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 0x7f0a4815d4f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400c520 tx=0x7f0a4400c8e0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 shutdown_connections 2023-10-16T13:47:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0a2c06b1d0 0x7f0a2c06d690 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a48160e30 0x7f0a480b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a480b7ab0 0x7f0a4815d4f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 --2- 172.21.15.5:0/1378586497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a480d08a0 0x7f0a48157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 >> 172.21.15.5:0/1378586497 conn(0x7f0a4809cb40 msgr2=0x7f0a480ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 shutdown_connections 2023-10-16T13:47:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.110+0000 7f0a5025e700 1 -- 172.21.15.5:0/1378586497 wait complete. 2023-10-16T13:47:42.125 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:42.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:42.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.251+0000 7fac1e629700 1 Processor -- start 2023-10-16T13:47:42.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.251+0000 7fac1e629700 1 -- start start 2023-10-16T13:47:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac1e629700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac180d0c70 0x7fac180cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac1e629700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fac180c5110 0x7fac180ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac1e629700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac180d23e0 con 0x7fac1815b740 2023-10-16T13:47:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac1e629700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1815bb20 con 0x7fac180d0c70 2023-10-16T13:47:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac1e629700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac180cf190 con 0x7fac180c5110 2023-10-16T13:47:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac180d0c70 0x7fac180cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac180d0c70 0x7fac180cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47480/0 (socket says 172.21.15.5:47480) 2023-10-16T13:47:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 -- 172.21.15.5:0/1130280160 learned_addr learned my addr 172.21.15.5:0/1130280160 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac1cbc6700 1 --2- 172.21.15.5:0/1130280160 >> v2:172.21.15.112:3300/0 conn(0x7fac180c5110 0x7fac180ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 -- 172.21.15.5:0/1130280160 >> v2:172.21.15.112:3300/0 conn(0x7fac180c5110 msgr2=0x7fac180ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 --2- 172.21.15.5:0/1130280160 >> v2:172.21.15.112:3300/0 conn(0x7fac180c5110 0x7fac180ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 -- 172.21.15.5:0/1130280160 >> v1:172.21.15.112:6789/0 conn(0x7fac1815b740 legacy=0x7fac180d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 -- 172.21.15.5:0/1130280160 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180cbd40 con 0x7fac180d0c70 2023-10-16T13:47:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.252+0000 7fac177fe700 1 --2- 172.21.15.5:0/1130280160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac180d0c70 0x7fac180cdfd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fac180c8620 tx=0x7fac08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db111de115413de server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac16ffd700 1 -- 172.21.15.5:0/1130280160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800b870 con 0x7fac180d0c70 2023-10-16T13:47:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac16ffd700 1 -- 172.21.15.5:0/1130280160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800b9d0 con 0x7fac180d0c70 2023-10-16T13:47:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac16ffd700 1 -- 172.21.15.5:0/1130280160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800bd60 con 0x7fac180d0c70 2023-10-16T13:47:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 -- 172.21.15.5:0/1130280160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac180d0c70 msgr2=0x7fac180cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 --2- 172.21.15.5:0/1130280160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac180d0c70 0x7fac180cdfd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fac180c8620 tx=0x7fac08009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 -- 172.21.15.5:0/1130280160 shutdown_connections 2023-10-16T13:47:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 --2- 172.21.15.5:0/1130280160 >> v2:172.21.15.112:3300/0 conn(0x7fac180c5110 0x7fac180ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 --2- 172.21.15.5:0/1130280160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac180d0c70 0x7fac180cdfd0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 -- 172.21.15.5:0/1130280160 >> 172.21.15.5:0/1130280160 conn(0x7fac180665a0 msgr2=0x7fac18066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 -- 172.21.15.5:0/1130280160 shutdown_connections 2023-10-16T13:47:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.253+0000 7fac1e629700 1 -- 172.21.15.5:0/1130280160 wait complete. 2023-10-16T13:47:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.254+0000 7fac1e629700 1 Processor -- start 2023-10-16T13:47:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 -- start start 2023-10-16T13:47:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac180c5110 0x7fac1815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d0c70 0x7fac180b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 0x7fac18148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac180b7180 con 0x7fac1815b740 2023-10-16T13:47:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18149130 con 0x7fac180d0c70 2023-10-16T13:47:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1e629700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1815c360 con 0x7fac180c5110 2023-10-16T13:47:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1cbc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 0x7fac18148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1cbc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 0x7fac18148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47488/0 (socket says 172.21.15.5:47488) 2023-10-16T13:47:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.255+0000 7fac1cbc6700 1 -- 172.21.15.5:0/4050676629 learned_addr learned my addr 172.21.15.5:0/4050676629 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:42.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac177fe700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d0c70 0x7fac180b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac17fff700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac180c5110 0x7fac1815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1cbc6700 1 -- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac180c5110 msgr2=0x7fac1815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1cbc6700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac180c5110 0x7fac1815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1cbc6700 1 -- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d0c70 msgr2=0x7fac180b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1cbc6700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d0c70 0x7fac180b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1cbc6700 1 -- 172.21.15.5:0/4050676629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009550 con 0x7fac1815b740 2023-10-16T13:47:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac17fff700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac180c5110 0x7fac1815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1cbc6700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 0x7fac18148bf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fac10007e40 tx=0x7fac1000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1000eea0 con 0x7fac1815b740 2023-10-16T13:47:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac10014420 con 0x7fac1815b740 2023-10-16T13:47:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1815c640 con 0x7fac1815b740 2023-10-16T13:47:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100147b0 con 0x7fac1815b740 2023-10-16T13:47:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.256+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1815cc00 con 0x7fac1815b740 2023-10-16T13:47:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.257+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac180b1a60 con 0x7fac1815b740 2023-10-16T13:47:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.257+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fac10014910 con 0x7fac1815b740 2023-10-16T13:47:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.258+0000 7fac14ff9700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabf806b1d0 0x7fabf806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.258+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac10089f70 con 0x7fac1815b740 2023-10-16T13:47:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.258+0000 7fac17fff700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabf806b1d0 0x7fabf806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.259+0000 7fac17fff700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabf806b1d0 0x7fabf806d690 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fac181f4100 tx=0x7fac00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.263+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac10054fd0 con 0x7fac1815b740 2023-10-16T13:47:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.463+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac18067d20 con 0x7fac1815b740 2023-10-16T13:47:42.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.464+0000 7fac14ff9700 1 -- 172.21.15.5:0/4050676629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac100585f0 con 0x7fac1815b740 2023-10-16T13:47:42.467 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabf806b1d0 msgr2=0x7fabf806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabf806b1d0 0x7fabf806d690 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fac181f4100 tx=0x7fac00009040 comp rx=0 tx=0).stop 2023-10-16T13:47:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 msgr2=0x7fac18148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 0x7fac18148bf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fac10007e40 tx=0x7fac1000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 shutdown_connections 2023-10-16T13:47:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac1815b740 0x7fac18148bf0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabf806b1d0 0x7fabf806d690 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac180c5110 0x7fac1815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 --2- 172.21.15.5:0/4050676629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d0c70 0x7fac180b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 >> 172.21.15.5:0/4050676629 conn(0x7fac180665a0 msgr2=0x7fac180b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 shutdown_connections 2023-10-16T13:47:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.466+0000 7fac1e629700 1 -- 172.21.15.5:0/4050676629 wait complete. 2023-10-16T13:47:42.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-16T13:47:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.603+0000 7f36ad7b7700 1 Processor -- start 2023-10-16T13:47:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.604+0000 7f36ad7b7700 1 -- start start 2023-10-16T13:47:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36ad7b7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a8160e30 0x7f36a80d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36ad7b7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f36a8161210 0x7f36a80d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36ad7b7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36a80d06d0 0x7f36a80b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36ad7b7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80b6610 con 0x7f36a80d06d0 2023-10-16T13:47:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36ad7b7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80d0b10 con 0x7f36a8161210 2023-10-16T13:47:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36ad7b7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80d1da0 con 0x7f36a8160e30 2023-10-16T13:47:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36a80d06d0 0x7f36a80b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36a80d06d0 0x7f36a80b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47496/0 (socket says 172.21.15.5:47496) 2023-10-16T13:47:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 -- 172.21.15.5:0/3326456124 learned_addr learned my addr 172.21.15.5:0/3326456124 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a6ffd700 1 --2- 172.21.15.5:0/3326456124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a8160e30 0x7f36a80d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a67fc700 1 --2- 172.21.15.5:0/3326456124 >> v2:172.21.15.112:3300/0 conn(0x7f36a8161210 0x7f36a80d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 -- 172.21.15.5:0/3326456124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a8160e30 msgr2=0x7f36a80d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 --2- 172.21.15.5:0/3326456124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a8160e30 0x7f36a80d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 -- 172.21.15.5:0/3326456124 >> v2:172.21.15.112:3300/0 conn(0x7f36a8161210 msgr2=0x7f36a80d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 --2- 172.21.15.5:0/3326456124 >> v2:172.21.15.112:3300/0 conn(0x7f36a8161210 0x7f36a80d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 -- 172.21.15.5:0/3326456124 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80d2080 con 0x7f36a80d06d0 2023-10-16T13:47:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a67fc700 1 --2- 172.21.15.5:0/3326456124 >> v2:172.21.15.112:3300/0 conn(0x7f36a8161210 0x7f36a80d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.605+0000 7f36a77fe700 1 --2- 172.21.15.5:0/3326456124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80d06d0 0x7f36a80b6aa0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f36a808c9d0 tx=0x7f36a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ad0eb4c08ff3cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36a5ffb700 1 -- 172.21.15.5:0/3326456124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000e070 con 0x7f36a80d06d0 2023-10-16T13:47:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36a5ffb700 1 -- 172.21.15.5:0/3326456124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000b910 con 0x7f36a80d06d0 2023-10-16T13:47:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36a5ffb700 1 -- 172.21.15.5:0/3326456124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000bcc0 con 0x7f36a80d06d0 2023-10-16T13:47:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3326456124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80d06d0 msgr2=0x7f36a80b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3326456124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80d06d0 0x7f36a80b6aa0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f36a808c9d0 tx=0x7f36a000b330 comp rx=0 tx=0).stop 2023-10-16T13:47:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3326456124 shutdown_connections 2023-10-16T13:47:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3326456124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80d06d0 0x7f36a80b6aa0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3326456124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a8160e30 0x7f36a80d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3326456124 >> v2:172.21.15.112:3300/0 conn(0x7f36a8161210 0x7f36a80d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3326456124 >> 172.21.15.5:0/3326456124 conn(0x7f36a809cb40 msgr2=0x7f36a80d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:42.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3326456124 shutdown_connections 2023-10-16T13:47:42.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.606+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3326456124 wait complete. 2023-10-16T13:47:42.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.607+0000 7f36ad7b7700 1 Processor -- start 2023-10-16T13:47:42.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 -- start start 2023-10-16T13:47:42.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a80d06d0 0x7f36a80c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 0x7f36a815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a8161210 0x7f36a81f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80a1430 con 0x7f36a8160e30 2023-10-16T13:47:42.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c75f0 con 0x7f36a8161210 2023-10-16T13:47:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36ad7b7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a815ae50 con 0x7f36a80d06d0 2023-10-16T13:47:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36a67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 0x7f36a815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36a67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 0x7f36a815a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47498/0 (socket says 172.21.15.5:47498) 2023-10-16T13:47:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.608+0000 7f36a67fc700 1 -- 172.21.15.5:0/3933010561 learned_addr learned my addr 172.21.15.5:0/3933010561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a77fe700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a8161210 0x7f36a81f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a67fc700 1 -- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a80d06d0 msgr2=0x7f36a80c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a67fc700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a80d06d0 0x7f36a80c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a67fc700 1 -- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a8161210 msgr2=0x7f36a81f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a67fc700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a8161210 0x7f36a81f30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a67fc700 1 -- 172.21.15.5:0/3933010561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0009b30 con 0x7f36a8160e30 2023-10-16T13:47:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36a67fc700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 0x7f36a815a910 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f369800e810 tx=0x7f369800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800c020 con 0x7f36a8160e30 2023-10-16T13:47:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3698004250 con 0x7f36a8160e30 2023-10-16T13:47:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a80c7800 con 0x7f36a8160e30 2023-10-16T13:47:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980036a0 con 0x7f36a8160e30 2023-10-16T13:47:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.609+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a80c7dc0 con 0x7f36a8160e30 2023-10-16T13:47:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.610+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8067d20 con 0x7f36a8160e30 2023-10-16T13:47:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.610+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f3698003800 con 0x7f36a8160e30 2023-10-16T13:47:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.611+0000 7f369f7fe700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f368806b1d0 0x7f368806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.611+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3698089390 con 0x7f36a8160e30 2023-10-16T13:47:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.611+0000 7f36a6ffd700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f368806b1d0 0x7f368806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.612+0000 7f36a6ffd700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f368806b1d0 0x7f368806d690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3690009ac0 tx=0x7f3690009580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.616+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3698054200 con 0x7f36a8160e30 2023-10-16T13:47:42.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:42.901+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f36a80c6e90 con 0x7f36a8160e30 2023-10-16T13:47:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.758+0000 7f369f7fe700 1 -- 172.21.15.5:0/3933010561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v391) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3698057820 con 0x7f36a8160e30 2023-10-16T13:47:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f368806b1d0 msgr2=0x7f368806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f368806b1d0 0x7f368806d690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3690009ac0 tx=0x7f3690009580 comp rx=0 tx=0).stop 2023-10-16T13:47:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 msgr2=0x7f36a815a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 0x7f36a815a910 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f369800e810 tx=0x7f369800ebd0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 shutdown_connections 2023-10-16T13:47:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a8161210 0x7f36a81f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f368806b1d0 0x7f368806d690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36a80d06d0 0x7f36a80c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 --2- 172.21.15.5:0/3933010561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a8160e30 0x7f36a815a910 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.760+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 >> 172.21.15.5:0/3933010561 conn(0x7f36a809cb40 msgr2=0x7f36a80b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.761+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 shutdown_connections 2023-10-16T13:47:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.761+0000 7f36ad7b7700 1 -- 172.21.15.5:0/3933010561 wait complete. 2023-10-16T13:47:43.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:47:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.910+0000 7ffb12d16700 1 Processor -- start 2023-10-16T13:47:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.910+0000 7ffb12d16700 1 -- start start 2023-10-16T13:47:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb12d16700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c15e2f0 0x7ffb0c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb12d16700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb0c06a840 0x7ffb0c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb12d16700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c0b2d60 con 0x7ffb0c0cd950 2023-10-16T13:47:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb12d16700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c1619a0 con 0x7ffb0c06a840 2023-10-16T13:47:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb12d16700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c06b1f0 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb0c06a840 0x7ffb0c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb0c06a840 0x7ffb0c06acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47510/0 (socket says 172.21.15.5:47510) 2023-10-16T13:47:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 -- 172.21.15.5:0/1084716472 learned_addr learned my addr 172.21.15.5:0/1084716472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb0bfff700 1 --2- 172.21.15.5:0/1084716472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c15e2f0 0x7ffb0c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 -- 172.21.15.5:0/1084716472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c15e2f0 msgr2=0x7ffb0c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 --2- 172.21.15.5:0/1084716472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c15e2f0 0x7ffb0c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 -- 172.21.15.5:0/1084716472 >> v1:172.21.15.112:6789/0 conn(0x7ffb0c0cd950 legacy=0x7ffb0c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.911+0000 7ffb112b3700 1 -- 172.21.15.5:0/1084716472 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0cdd30 con 0x7ffb0c06a840 2023-10-16T13:47:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb112b3700 1 --2- 172.21.15.5:0/1084716472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c06a840 0x7ffb0c06acb0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009e50 tx=0x7ffb0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9477dc54406751c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb0b7fe700 1 -- 172.21.15.5:0/1084716472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400e070 con 0x7ffb0c06a840 2023-10-16T13:47:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb0b7fe700 1 -- 172.21.15.5:0/1084716472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400b9c0 con 0x7ffb0c06a840 2023-10-16T13:47:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb0b7fe700 1 -- 172.21.15.5:0/1084716472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400bd70 con 0x7ffb0c06a840 2023-10-16T13:47:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 -- 172.21.15.5:0/1084716472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c06a840 msgr2=0x7ffb0c06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 --2- 172.21.15.5:0/1084716472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c06a840 0x7ffb0c06acb0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009e50 tx=0x7ffb0400b330 comp rx=0 tx=0).stop 2023-10-16T13:47:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 -- 172.21.15.5:0/1084716472 shutdown_connections 2023-10-16T13:47:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 --2- 172.21.15.5:0/1084716472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c06a840 0x7ffb0c06acb0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 --2- 172.21.15.5:0/1084716472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c15e2f0 0x7ffb0c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 -- 172.21.15.5:0/1084716472 >> 172.21.15.5:0/1084716472 conn(0x7ffb0c06dae0 msgr2=0x7ffb0c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 -- 172.21.15.5:0/1084716472 shutdown_connections 2023-10-16T13:47:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.912+0000 7ffb12d16700 1 -- 172.21.15.5:0/1084716472 wait complete. 2023-10-16T13:47:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.913+0000 7ffb12d16700 1 Processor -- start 2023-10-16T13:47:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 -- start start 2023-10-16T13:47:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c06a840 0x7ffb0c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0cd950 0x7ffb0c14ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 0x7ffb0c14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1f3bd0 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c14e0f0 con 0x7ffb0c0cd950 2023-10-16T13:47:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb12d16700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c14e3d0 con 0x7ffb0c06a840 2023-10-16T13:47:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.914+0000 7ffb112b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 0x7ffb0c14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 0x7ffb0c14d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47516/0 (socket says 172.21.15.5:47516) 2023-10-16T13:47:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 -- 172.21.15.5:0/57085457 learned_addr learned my addr 172.21.15.5:0/57085457 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb10ab2700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c06a840 0x7ffb0c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb0bfff700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0cd950 0x7ffb0c14ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 -- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c06a840 msgr2=0x7ffb0c1f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c06a840 0x7ffb0c1f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 -- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0cd950 msgr2=0x7ffb0c14ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0cd950 0x7ffb0c14ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 -- 172.21.15.5:0/57085457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009b30 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb112b3700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 0x7ffb0c14d6a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06d4f0 tx=0x7ffb04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04004800 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04004960 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0401c680 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c1f3dc0 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.915+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c1f4b00 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.916+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c0b2420 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.917+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7ffb0401c7e0 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.917+0000 7ffb097fa700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffaf006b1d0 0x7ffaf006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.917+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb0408b390 con 0x7ffb0c15e2f0 2023-10-16T13:47:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.917+0000 7ffb10ab2700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffaf006b1d0 0x7ffaf006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.918+0000 7ffb10ab2700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffaf006b1d0 0x7ffaf006d690 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0ae200 tx=0x7ffb00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:43.922+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb04056370 con 0x7ffb0c15e2f0 2023-10-16T13:47:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.124+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffb0c067d20 con 0x7ffb0c15e2f0 2023-10-16T13:47:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.128+0000 7ffb097fa700 1 -- 172.21.15.5:0/57085457 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb04059990 con 0x7ffb0c15e2f0 2023-10-16T13:47:44.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffaf006b1d0 msgr2=0x7ffaf006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffaf006b1d0 0x7ffaf006d690 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0ae200 tx=0x7ffb00009040 comp rx=0 tx=0).stop 2023-10-16T13:47:44.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 msgr2=0x7ffb0c14d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 0x7ffb0c14d6a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06d4f0 tx=0x7ffb04004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 shutdown_connections 2023-10-16T13:47:44.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c15e2f0 0x7ffb0c14d6a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffaf006b1d0 0x7ffaf006d690 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb0c06a840 0x7ffb0c1f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 --2- 172.21.15.5:0/57085457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb0c0cd950 0x7ffb0c14ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 >> 172.21.15.5:0/57085457 conn(0x7ffb0c06dae0 msgr2=0x7ffb0c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 shutdown_connections 2023-10-16T13:47:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.130+0000 7ffb12d16700 1 -- 172.21.15.5:0/57085457 wait complete. 2023-10-16T13:47:44.145 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:47:44.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:47:44.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:47:44.234 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:47:44.234 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:44.235 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:44.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:47:44.253 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:44.253 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:44.272 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:47:44.273 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:44.273 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:44.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:47:44.310 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:44.310 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:44.331 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:47:44.331 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:47:44.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.471+0000 7f857d87c700 1 Processor -- start 2023-10-16T13:47:44.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.471+0000 7f857d87c700 1 -- start start 2023-10-16T13:47:44.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.472+0000 7f857d87c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85780cd950 0x7f857815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.472+0000 7f857d87c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cede0 0x7f857815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.472+0000 7f857d87c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780cf260 con 0x7f857806a840 2023-10-16T13:47:44.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.472+0000 7f857d87c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85781619a0 con 0x7f85780cd950 2023-10-16T13:47:44.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.472+0000 7f857d87c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b2d60 con 0x7f85780cede0 2023-10-16T13:47:44.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f85767fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cede0 0x7f857815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8576ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85780cd950 0x7f857815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f85777fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f857806a840 0x7f8578161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:48504/0 (socket says 172.21.15.5:48504) 2023-10-16T13:47:44.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f85777fe700 1 -- 172.21.15.5:0/2640993124 learned_addr learned my addr 172.21.15.5:0/2640993124 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:44.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8575ffb700 1 -- 172.21.15.5:0/2640993124 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961963169 0 0) 0x7f85780cf260 con 0x7f857806a840 2023-10-16T13:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8575ffb700 1 -- 172.21.15.5:0/2640993124 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85600035b0 con 0x7f857806a840 2023-10-16T13:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8576ffd700 1 -- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cede0 msgr2=0x7f857815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8576ffd700 1 --2- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cede0 0x7f857815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8576ffd700 1 -- 172.21.15.5:0/2640993124 >> v1:172.21.15.112:6789/0 conn(0x7f857806a840 legacy=0x7f8578161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8576ffd700 1 -- 172.21.15.5:0/2640993124 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780cdd30 con 0x7f85780cd950 2023-10-16T13:47:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f85767fc700 1 --2- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cede0 0x7f857815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8576ffd700 1 --2- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85780cd950 0x7f857815e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8568009840 tx=0x7f8568009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b8c565026c630f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8575ffb700 1 -- 172.21.15.5:0/2640993124 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011830 con 0x7f85780cd950 2023-10-16T13:47:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8575ffb700 1 -- 172.21.15.5:0/2640993124 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568011990 con 0x7f85780cd950 2023-10-16T13:47:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.473+0000 7f8575ffb700 1 -- 172.21.15.5:0/2640993124 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011d20 con 0x7f85780cd950 2023-10-16T13:47:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 -- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85780cd950 msgr2=0x7f857815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 --2- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85780cd950 0x7f857815e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8568009840 tx=0x7f8568009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:44.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 -- 172.21.15.5:0/2640993124 shutdown_connections 2023-10-16T13:47:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 --2- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85780cd950 0x7f857815e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 --2- 172.21.15.5:0/2640993124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cede0 0x7f857815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 -- 172.21.15.5:0/2640993124 >> 172.21.15.5:0/2640993124 conn(0x7f857806dae0 msgr2=0x7f857806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 -- 172.21.15.5:0/2640993124 shutdown_connections 2023-10-16T13:47:44.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.474+0000 7f857d87c700 1 -- 172.21.15.5:0/2640993124 wait complete. 2023-10-16T13:47:44.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.475+0000 7f857d87c700 1 Processor -- start 2023-10-16T13:47:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.475+0000 7f857d87c700 1 -- start start 2023-10-16T13:47:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f857d87c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857806a840 0x7f857806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f857d87c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cd950 0x7f85780c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f857d87c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 0x7f857815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f857d87c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780c47a0 con 0x7f85780cede0 2023-10-16T13:47:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f857d87c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780ca2d0 con 0x7f857806a840 2023-10-16T13:47:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f857d87c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85781f7050 con 0x7f85780cd950 2023-10-16T13:47:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f85777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 0x7f857815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f85777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 0x7f857815b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47530/0 (socket says 172.21.15.5:47530) 2023-10-16T13:47:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f85777fe700 1 -- 172.21.15.5:0/2808100037 learned_addr learned my addr 172.21.15.5:0/2808100037 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f85767fc700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cd950 0x7f85780c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.476+0000 7f8576ffd700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857806a840 0x7f857806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f85777fe700 1 -- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cd950 msgr2=0x7f85780c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f85777fe700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cd950 0x7f85780c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f85777fe700 1 -- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857806a840 msgr2=0x7f857806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f85777fe700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857806a840 0x7f857806e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f85777fe700 1 -- 172.21.15.5:0/2808100037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009430 con 0x7f85780cede0 2023-10-16T13:47:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f85777fe700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 0x7f857815b510 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f857000cb40 tx=0x7f857000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:44.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000a9e0 con 0x7f85780cede0 2023-10-16T13:47:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857000ab40 con 0x7f85780cede0 2023-10-16T13:47:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85680094a0 con 0x7f85780cede0 2023-10-16T13:47:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570012400 con 0x7f85780cede0 2023-10-16T13:47:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.477+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781f7580 con 0x7f85780cede0 2023-10-16T13:47:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.478+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780cf5a0 con 0x7f85780cede0 2023-10-16T13:47:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.478+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f857001b3b0 con 0x7f85780cede0 2023-10-16T13:47:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.479+0000 7f855ffff700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f856406b1d0 0x7f856406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.479+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85700892b0 con 0x7f85780cede0 2023-10-16T13:47:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.479+0000 7f8576ffd700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f856406b1d0 0x7f856406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.480+0000 7f8576ffd700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f856406b1d0 0x7f856406d690 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8568000c00 tx=0x7f8568008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:44.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.483+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85700543c0 con 0x7f85780cede0 2023-10-16T13:47:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.728+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85780b16d0 con 0x7f85780cede0 2023-10-16T13:47:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.728+0000 7f855ffff700 1 -- 172.21.15.5:0/2808100037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f8570017e80 con 0x7f85780cede0 2023-10-16T13:47:44.732 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:44.732 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3653372577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3653372577},{"type":"v1","addr":"172.21.15.112:6836","nonce":3653372577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/337326574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":337326574},{"type":"v1","addr":"172.21.15.112:6837","nonce":337326574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2460191460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2460191460},{"type":"v1","addr":"172.21.15.5:6835","nonce":2460191460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":6831,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1593818668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1593818668},{"type":"v1","addr":"172.21.15.5:6834","nonce":1593818668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2023-10-16T13:47:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f856406b1d0 msgr2=0x7f856406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f856406b1d0 0x7f856406d690 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8568000c00 tx=0x7f8568008030 comp rx=0 tx=0).stop 2023-10-16T13:47:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 msgr2=0x7f857815b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 0x7f857815b510 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f857000cb40 tx=0x7f857000ce50 comp rx=0 tx=0).stop 2023-10-16T13:47:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 shutdown_connections 2023-10-16T13:47:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85780cede0 0x7f857815b510 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857806a840 0x7f857806e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f856406b1d0 0x7f856406d690 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 --2- 172.21.15.5:0/2808100037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85780cd950 0x7f85780c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 >> 172.21.15.5:0/2808100037 conn(0x7f857806dae0 msgr2=0x7f85780b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:44.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 shutdown_connections 2023-10-16T13:47:44.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.731+0000 7f857d87c700 1 -- 172.21.15.5:0/2808100037 wait complete. 2023-10-16T13:47:44.737 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 53 2023-10-16T13:47:44.746 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:47:44.746 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:47:44.747 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:47:44.747 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:44.747 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:47:44.748 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:47:44.748 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:47:44.748 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:44.748 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:47:44.749 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:47:44.749 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:47:44.749 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:44.750 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:47:44.750 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:47:44.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:47:44.750 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:47:44.756 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:47:44.756 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:47:44.757 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:47:44.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:47:44.760 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:47:44.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:47:44.762 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:47:44.762 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:47:44.799 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:47:44.799 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:44.800 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:47:44.800 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:44.804 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:47:44.805 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:44.806 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:47:44.806 DEBUG:teuthology.parallel:result is None 2023-10-16T13:47:44.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:47:44.881 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:47:44.881 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:47:44.890 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:47:44.890 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:47:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.936+0000 7f1463c52700 1 Processor -- start 2023-10-16T13:47:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.936+0000 7f1463c52700 1 -- start start 2023-10-16T13:47:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f1463c52700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f145c0cbc40 0x7f145c0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f1463c52700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c0ce3b0 con 0x7f145c15a850 2023-10-16T13:47:44.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f1463c52700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c0b6290 con 0x7f145c0cd4b0 2023-10-16T13:47:44.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f1463c52700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c0cc220 con 0x7f145c0cbc40 2023-10-16T13:47:44.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f14621ef700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f145c0cbc40 0x7f145c0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f14619ee700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f145c15a850 0x7f145c0ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57562/0 (socket says 172.21.15.5:57562) 2023-10-16T13:47:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.937+0000 7f14619ee700 1 -- 172.21.15.5:0/3995547004 learned_addr learned my addr 172.21.15.5:0/3995547004 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14621ef700 1 -- 172.21.15.5:0/3995547004 >> v1:172.21.15.112:6789/0 conn(0x7f145c0cd4b0 legacy=0x7f145c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14621ef700 1 -- 172.21.15.5:0/3995547004 >> v1:172.21.15.5:6789/0 conn(0x7f145c15a850 legacy=0x7f145c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14621ef700 1 -- 172.21.15.5:0/3995547004 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c0cc500 con 0x7f145c0cbc40 2023-10-16T13:47:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14609ec700 1 -- 172.21.15.5:0/3995547004 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337917495 0 0) 0x7f145c0ce3b0 con 0x7f145c15a850 2023-10-16T13:47:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14621ef700 1 --2- 172.21.15.5:0/3995547004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cbc40 0x7f145c0b2940 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1454009d90 tx=0x7f145400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620697fb35af0c59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14609ec700 1 -- 172.21.15.5:0/3995547004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145400e070 con 0x7f145c0cbc40 2023-10-16T13:47:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14609ec700 1 -- 172.21.15.5:0/3995547004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145400bbd0 con 0x7f145c0cbc40 2023-10-16T13:47:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.938+0000 7f14609ec700 1 -- 172.21.15.5:0/3995547004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454012430 con 0x7f145c0cbc40 2023-10-16T13:47:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 -- 172.21.15.5:0/3995547004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cbc40 msgr2=0x7f145c0b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 --2- 172.21.15.5:0/3995547004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cbc40 0x7f145c0b2940 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1454009d90 tx=0x7f145400b330 comp rx=0 tx=0).stop 2023-10-16T13:47:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 -- 172.21.15.5:0/3995547004 shutdown_connections 2023-10-16T13:47:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 --2- 172.21.15.5:0/3995547004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cbc40 0x7f145c0b2940 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 -- 172.21.15.5:0/3995547004 >> 172.21.15.5:0/3995547004 conn(0x7f145c06dac0 msgr2=0x7f145c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:44.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 -- 172.21.15.5:0/3995547004 shutdown_connections 2023-10-16T13:47:44.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.939+0000 7f1463c52700 1 -- 172.21.15.5:0/3995547004 wait complete. 2023-10-16T13:47:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.940+0000 7f1463c52700 1 Processor -- start 2023-10-16T13:47:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.940+0000 7f1463c52700 1 -- start start 2023-10-16T13:47:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f1463c52700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f145c0cbc40 0x7f145c0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f1463c52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 0x7f145c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f1463c52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c15a850 0x7f145c0719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f1463c52700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c1557b0 con 0x7f145c0cd4b0 2023-10-16T13:47:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f1463c52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0c4e50 con 0x7f145c15a850 2023-10-16T13:47:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f1463c52700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0c5130 con 0x7f145c0cbc40 2023-10-16T13:47:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 0x7f145c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 0x7f145c155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47566/0 (socket says 172.21.15.5:47566) 2023-10-16T13:47:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 -- 172.21.15.5:0/3593272141 learned_addr learned my addr 172.21.15.5:0/3593272141 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14619ee700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f145c0cbc40 0x7f145c0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14621ef700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c15a850 0x7f145c0719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 -- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f145c0cbc40 msgr2=0x7f145c0c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f145c0cbc40 0x7f145c0c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 -- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c15a850 msgr2=0x7f145c0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c15a850 0x7f145c0719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 -- 172.21.15.5:0/3593272141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454009a70 con 0x7f145c0cd4b0 2023-10-16T13:47:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14619ee700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f145c0cbc40 0x7f145c0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14611ed700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 0x7f145c155270 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f145800c450 tx=0x7f145800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580052d0 con 0x7f145c0cd4b0 2023-10-16T13:47:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.941+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458005430 con 0x7f145c0cd4b0 2023-10-16T13:47:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.942+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c0c5410 con 0x7f145c0cd4b0 2023-10-16T13:47:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.942+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580038c0 con 0x7f145c0cd4b0 2023-10-16T13:47:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.942+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c0c4a90 con 0x7f145c0cd4b0 2023-10-16T13:47:44.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.943+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c067d20 con 0x7f145c0cd4b0 2023-10-16T13:47:44.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.943+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f1458003a20 con 0x7f145c0cd4b0 2023-10-16T13:47:44.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.943+0000 7f14527fc700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144006b1d0 0x7f144006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:44.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.944+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f14580889a0 con 0x7f145c0cd4b0 2023-10-16T13:47:44.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.944+0000 7f14619ee700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144006b1d0 0x7f144006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.944+0000 7f14619ee700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144006b1d0 0x7f144006d690 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f144c000f60 tx=0x7f144c007d00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:44.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:44.948+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1458053a90 con 0x7f145c0cd4b0 2023-10-16T13:47:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.163+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f145c0c4c20 con 0x7f145c0cd4b0 2023-10-16T13:47:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.775+0000 7f14527fc700 1 -- 172.21.15.5:0/3593272141 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7f14580570b0 con 0x7f145c0cd4b0 2023-10-16T13:47:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144006b1d0 msgr2=0x7f144006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144006b1d0 0x7f144006d690 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f144c000f60 tx=0x7f144c007d00 comp rx=0 tx=0).stop 2023-10-16T13:47:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 msgr2=0x7f145c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 0x7f145c155270 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f145800c450 tx=0x7f145800c810 comp rx=0 tx=0).stop 2023-10-16T13:47:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 shutdown_connections 2023-10-16T13:47:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c15a850 0x7f145c0719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f144006b1d0 0x7f144006d690 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f145c0cbc40 0x7f145c0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 --2- 172.21.15.5:0/3593272141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145c0cd4b0 0x7f145c155270 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 >> 172.21.15.5:0/3593272141 conn(0x7f145c06dac0 msgr2=0x7f145c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 shutdown_connections 2023-10-16T13:47:45.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.778+0000 7f1463c52700 1 -- 172.21.15.5:0/3593272141 wait complete. 2023-10-16T13:47:45.784 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:47:45.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:47:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.927+0000 7ff86f24a700 1 Processor -- start 2023-10-16T13:47:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.928+0000 7ff86f24a700 1 -- start start 2023-10-16T13:47:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.928+0000 7ff86f24a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff86815ab10 0x7ff86815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.928+0000 7ff86f24a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8680b1f50 0x7ff8680cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.928+0000 7ff86f24a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86815e7a0 con 0x7ff8680b23d0 2023-10-16T13:47:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff86f24a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86815f730 con 0x7ff8680b1f50 2023-10-16T13:47:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff86f24a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680b29a0 con 0x7ff86815ab10 2023-10-16T13:47:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8680b1f50 0x7ff8680cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8680b1f50 0x7ff8680cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47574/0 (socket says 172.21.15.5:47574) 2023-10-16T13:47:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 -- 172.21.15.5:0/1415831064 learned_addr learned my addr 172.21.15.5:0/1415831064 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff86cfe6700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff86815ab10 0x7ff86815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 -- 172.21.15.5:0/1415831064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff86815ab10 msgr2=0x7ff86815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff86815ab10 0x7ff86815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 -- 172.21.15.5:0/1415831064 >> v1:172.21.15.112:6789/0 conn(0x7ff8680b23d0 legacy=0x7ff8680cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 -- 172.21.15.5:0/1415831064 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680b2c80 con 0x7ff8680b1f50 2023-10-16T13:47:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff86cfe6700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff86815ab10 0x7ff86815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff867fff700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8680b1f50 0x7ff8680cf720 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff85400bb80 tx=0x7ff85400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da2dd30e8467067 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff8677fe700 1 -- 172.21.15.5:0/1415831064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400dd90 con 0x7ff8680b1f50 2023-10-16T13:47:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff8677fe700 1 -- 172.21.15.5:0/1415831064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff854010470 con 0x7ff8680b1f50 2023-10-16T13:47:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.929+0000 7ff8677fe700 1 -- 172.21.15.5:0/1415831064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854010800 con 0x7ff8680b1f50 2023-10-16T13:47:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 -- 172.21.15.5:0/1415831064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8680b1f50 msgr2=0x7ff8680cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8680b1f50 0x7ff8680cf720 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff85400bb80 tx=0x7ff85400be90 comp rx=0 tx=0).stop 2023-10-16T13:47:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 -- 172.21.15.5:0/1415831064 shutdown_connections 2023-10-16T13:47:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff86815ab10 0x7ff86815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 --2- 172.21.15.5:0/1415831064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8680b1f50 0x7ff8680cf720 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 -- 172.21.15.5:0/1415831064 >> 172.21.15.5:0/1415831064 conn(0x7ff86806dae0 msgr2=0x7ff86806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 -- 172.21.15.5:0/1415831064 shutdown_connections 2023-10-16T13:47:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.930+0000 7ff86f24a700 1 -- 172.21.15.5:0/1415831064 wait complete. 2023-10-16T13:47:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.931+0000 7ff86f24a700 1 Processor -- start 2023-10-16T13:47:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.931+0000 7ff86f24a700 1 -- start start 2023-10-16T13:47:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86f24a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8680b1f50 0x7ff8681f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86f24a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8680b23d0 0x7ff8680aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86f24a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 0x7ff86814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86f24a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680ad710 con 0x7ff86815ab10 2023-10-16T13:47:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86f24a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680af390 con 0x7ff8680b1f50 2023-10-16T13:47:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86f24a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c6f00 con 0x7ff8680b23d0 2023-10-16T13:47:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86d7e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 0x7ff86814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86d7e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 0x7ff86814d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47582/0 (socket says 172.21.15.5:47582) 2023-10-16T13:47:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86d7e7700 1 -- 172.21.15.5:0/3315881582 learned_addr learned my addr 172.21.15.5:0/3315881582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff867fff700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8680b23d0 0x7ff8680aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.932+0000 7ff86cfe6700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8680b1f50 0x7ff8681f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86d7e7700 1 -- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8680b23d0 msgr2=0x7ff8680aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86d7e7700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8680b23d0 0x7ff8680aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86d7e7700 1 -- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8680b1f50 msgr2=0x7ff8681f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86d7e7700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8680b1f50 0x7ff8681f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86d7e7700 1 -- 172.21.15.5:0/3315881582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85400b790 con 0x7ff86815ab10 2023-10-16T13:47:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86d7e7700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 0x7ff86814d8d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff86000cc80 tx=0x7ff86000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860003c00 con 0x7ff86815ab10 2023-10-16T13:47:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff860003d60 con 0x7ff86815ab10 2023-10-16T13:47:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8681f3a40 con 0x7ff86815ab10 2023-10-16T13:47:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000aaa0 con 0x7ff86815ab10 2023-10-16T13:47:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.933+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681f4000 con 0x7ff86815ab10 2023-10-16T13:47:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.934+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8680ad850 con 0x7ff86815ab10 2023-10-16T13:47:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.935+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7ff86000ac00 con 0x7ff86815ab10 2023-10-16T13:47:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.935+0000 7ff8657fa700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff84c06b1d0 0x7ff84c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.935+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8600896b0 con 0x7ff86815ab10 2023-10-16T13:47:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.935+0000 7ff86cfe6700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff84c06b1d0 0x7ff84c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.936+0000 7ff86cfe6700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff84c06b1d0 0x7ff84c06d690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0099d0 tx=0x7ff85c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:45.940+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8680ad850 con 0x7ff86815ab10 2023-10-16T13:47:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.226+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff8680ad850 con 0x7ff86815ab10 2023-10-16T13:47:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.227+0000 7ff8657fa700 1 -- 172.21.15.5:0/3315881582 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff8680ad850 con 0x7ff86815ab10 2023-10-16T13:47:46.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:46.230 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:47:46.230 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:47:46.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.230 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:47:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:47:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:46.232 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.232 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:47:46.232 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:47:46.233 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:46.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:46.233 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.234 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.234 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:47:46.234 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:47:46.234 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:46.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:46.235 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.235 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.236 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:47:46.236 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:47:46.236 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:47:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:47:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:47:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:47:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:47:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:47:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.243 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:47:46.243 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:47:46.243 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.244 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:47:46.245 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:47:46.245 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.246 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:47:46.246 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:47:46.246 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.248 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:47:46.248 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:47:46.248 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.249 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:47:46.249 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:47:46.250 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.250 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:47:46.250 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:47:46.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.251 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:47:46.251 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:47:46.252 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.252 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:47:46.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:47:46.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.253 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:47:46.253 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:47:46.253 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.254 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.254 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:47:46.254 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:47:46.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:47:46.254 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.255 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:47:46.255 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:47:46.255 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.255 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:47:46.256 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:47:46.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:47:46.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.257 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:47:46.257 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:47:46.257 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.257 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:47:46.257 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:47:46.258 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:47:46.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:47:46.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.259 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:47:46.259 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:47:46.259 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:47:46.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:47:46.259 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:47:46.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.260 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.260 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:47:46.260 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:47:46.261 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:47:46.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:47:46.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:47:46.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:46.262 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:47:46.262 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:47:46.262 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:47:46.262 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:47:46.263 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:47:46.263 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:47:46.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:46.263 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:47:46.263 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:47:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.228+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff84c06b1d0 msgr2=0x7ff84c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.228+0000 7ff86f24a700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff84c06b1d0 0x7ff84c06d690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0099d0 tx=0x7ff85c008040 comp rx=0 tx=0).stop 2023-10-16T13:47:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.228+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 msgr2=0x7ff86814d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.228+0000 7ff86f24a700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 0x7ff86814d8d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff86000cc80 tx=0x7ff86000cf90 comp rx=0 tx=0).stop 2023-10-16T13:47:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 shutdown_connections 2023-10-16T13:47:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86815ab10 0x7ff86814d8d0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8680b1f50 0x7ff8681f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff84c06b1d0 0x7ff84c06d690 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 --2- 172.21.15.5:0/3315881582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8680b23d0 0x7ff8680aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 >> 172.21.15.5:0/3315881582 conn(0x7ff86806dae0 msgr2=0x7ff8680cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 shutdown_connections 2023-10-16T13:47:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.229+0000 7ff86f24a700 1 -- 172.21.15.5:0/3315881582 wait complete. 2023-10-16T13:47:46.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.389+0000 7fad9efaa700 1 Processor -- start 2023-10-16T13:47:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.389+0000 7fad9efaa700 1 -- start start 2023-10-16T13:47:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad9efaa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad980728e0 0x7fad9806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad9efaa700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98070040 con 0x7fad980b2980 2023-10-16T13:47:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad9efaa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980afce0 con 0x7fad9815a8e0 2023-10-16T13:47:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad9efaa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980d0420 con 0x7fad980728e0 2023-10-16T13:47:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad97fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fad980b2980 0x7fad9815e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57592/0 (socket says 172.21.15.5:57592) 2023-10-16T13:47:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad9d547700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad980728e0 0x7fad9806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.390+0000 7fad97fff700 1 -- 172.21.15.5:0/3484920978 learned_addr learned my addr 172.21.15.5:0/3484920978 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad9d547700 1 -- 172.21.15.5:0/3484920978 >> v1:172.21.15.112:6789/0 conn(0x7fad9815a8e0 legacy=0x7fad980b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad9d547700 1 -- 172.21.15.5:0/3484920978 >> v1:172.21.15.5:6789/0 conn(0x7fad980b2980 legacy=0x7fad9815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad9d547700 1 -- 172.21.15.5:0/3484920978 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98071e00 con 0x7fad980728e0 2023-10-16T13:47:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad977fe700 1 -- 172.21.15.5:0/3484920978 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418865225 0 0) 0x7fad98070040 con 0x7fad980b2980 2023-10-16T13:47:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad9d547700 1 --2- 172.21.15.5:0/3484920978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad980728e0 0x7fad9806fb00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fad90009d90 tx=0x7fad9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe19c216a1e119a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad977fe700 1 -- 172.21.15.5:0/3484920978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000e070 con 0x7fad980728e0 2023-10-16T13:47:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad977fe700 1 -- 172.21.15.5:0/3484920978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000bbd0 con 0x7fad980728e0 2023-10-16T13:47:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.391+0000 7fad977fe700 1 -- 172.21.15.5:0/3484920978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90012430 con 0x7fad980728e0 2023-10-16T13:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 -- 172.21.15.5:0/3484920978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad980728e0 msgr2=0x7fad9806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 --2- 172.21.15.5:0/3484920978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad980728e0 0x7fad9806fb00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fad90009d90 tx=0x7fad9000b330 comp rx=0 tx=0).stop 2023-10-16T13:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 -- 172.21.15.5:0/3484920978 shutdown_connections 2023-10-16T13:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 --2- 172.21.15.5:0/3484920978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad980728e0 0x7fad9806fb00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 -- 172.21.15.5:0/3484920978 >> 172.21.15.5:0/3484920978 conn(0x7fad980cd270 msgr2=0x7fad980cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 -- 172.21.15.5:0/3484920978 shutdown_connections 2023-10-16T13:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.392+0000 7fad9efaa700 1 -- 172.21.15.5:0/3484920978 wait complete. 2023-10-16T13:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.393+0000 7fad9efaa700 1 Processor -- start 2023-10-16T13:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.393+0000 7fad9efaa700 1 -- start start 2023-10-16T13:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9efaa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad980728e0 0x7fad980c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9efaa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad980b2980 0x7fad980c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9efaa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 0x7fad980c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9efaa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c9ba0 con 0x7fad9815a8e0 2023-10-16T13:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9efaa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad981f4720 con 0x7fad980728e0 2023-10-16T13:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9efaa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad981f4a00 con 0x7fad980b2980 2023-10-16T13:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 0x7fad980c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 0x7fad980c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47596/0 (socket says 172.21.15.5:47596) 2023-10-16T13:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 -- 172.21.15.5:0/2398058586 learned_addr learned my addr 172.21.15.5:0/2398058586 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad97fff700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad980b2980 0x7fad980c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 -- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad980b2980 msgr2=0x7fad980c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad980b2980 0x7fad980c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9cd46700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad980728e0 0x7fad980c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 -- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad980728e0 msgr2=0x7fad980c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad980728e0 0x7fad980c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 -- 172.21.15.5:0/2398058586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009a70 con 0x7fad9815a8e0 2023-10-16T13:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.394+0000 7fad9d547700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 0x7fad980c64a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fad90014040 tx=0x7fad90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.395+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90012430 con 0x7fad9815a8e0 2023-10-16T13:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.395+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90020070 con 0x7fad9815a8e0 2023-10-16T13:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.395+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad981f4ce0 con 0x7fad9815a8e0 2023-10-16T13:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.395+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90004280 con 0x7fad9815a8e0 2023-10-16T13:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.395+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad981f54c0 con 0x7fad9815a8e0 2023-10-16T13:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.396+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad981f5330 con 0x7fad9815a8e0 2023-10-16T13:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.396+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fad900043e0 con 0x7fad9815a8e0 2023-10-16T13:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.397+0000 7fad957fa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7c06b200 0x7fad7c06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.397+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad90022070 con 0x7fad9815a8e0 2023-10-16T13:47:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.397+0000 7fad9cd46700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7c06b200 0x7fad7c06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.397+0000 7fad9cd46700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7c06b200 0x7fad7c06d6c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad9806c440 tx=0x7fad8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.401+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad90056800 con 0x7fad9815a8e0 2023-10-16T13:47:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.604+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad9806f550 con 0x7fad9815a8e0 2023-10-16T13:47:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.605+0000 7fad957fa700 1 -- 172.21.15.5:0/2398058586 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+12786 (secure 0 0 0) 0x7fad90059e20 con 0x7fad9815a8e0 2023-10-16T13:47:46.608 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:46.608 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:45.784957+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7c06b200 msgr2=0x7fad7c06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7c06b200 0x7fad7c06d6c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad9806c440 tx=0x7fad8c009040 comp rx=0 tx=0).stop 2023-10-16T13:47:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 msgr2=0x7fad980c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 0x7fad980c64a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fad90014040 tx=0x7fad90004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 shutdown_connections 2023-10-16T13:47:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9815a8e0 0x7fad980c64a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad980728e0 0x7fad980c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fad7c06b200 0x7fad7c06d6c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 --2- 172.21.15.5:0/2398058586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad980b2980 0x7fad980c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 >> 172.21.15.5:0/2398058586 conn(0x7fad980cd270 msgr2=0x7fad980b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 shutdown_connections 2023-10-16T13:47:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.607+0000 7fad9efaa700 1 -- 172.21.15.5:0/2398058586 wait complete. 2023-10-16T13:47:46.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:47:46.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:47:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.748+0000 7f2eafea5700 1 Processor -- start 2023-10-16T13:47:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.749+0000 7f2eafea5700 1 -- start start 2023-10-16T13:47:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.749+0000 7f2eafea5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ea815f1f0 0x7f2ea80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.749+0000 7f2eafea5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea815e7a0 con 0x7f2ea815ab10 2023-10-16T13:47:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.749+0000 7f2eafea5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80d0090 con 0x7f2ea80cfc60 2023-10-16T13:47:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.749+0000 7f2eafea5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea80b29a0 con 0x7f2ea815f1f0 2023-10-16T13:47:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eadc41700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ea815ab10 0x7f2ea80b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57604/0 (socket says 172.21.15.5:57604) 2023-10-16T13:47:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eadc41700 1 -- 172.21.15.5:0/1476637513 learned_addr learned my addr 172.21.15.5:0/1476637513 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481740477 0 0) 0x7f2ea815e7a0 con 0x7f2ea815ab10 2023-10-16T13:47:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2ead440700 1 --2- 172.21.15.5:0/1476637513 >> v2:172.21.15.112:3300/0 conn(0x7f2ea815f1f0 0x7f2ea80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e940035b0 con 0x7f2ea815ab10 2023-10-16T13:47:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1382210618 0 0) 0x7f2e940035b0 con 0x7f2ea815ab10 2023-10-16T13:47:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 >> v2:172.21.15.112:3300/0 conn(0x7f2ea815f1f0 msgr2=0x7f2ea80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 --2- 172.21.15.5:0/1476637513 >> v2:172.21.15.112:3300/0 conn(0x7f2ea815f1f0 0x7f2ea80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 >> v1:172.21.15.112:6789/0 conn(0x7f2ea80cfc60 legacy=0x7f2ea80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80b2c80 con 0x7f2ea815ab10 2023-10-16T13:47:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f2e9c001670 con 0x7f2ea815ab10 2023-10-16T13:47:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 >> v1:172.21.15.5:6789/0 conn(0x7f2ea815ab10 legacy=0x7f2ea80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e94003a00 0x7f2e94003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e94004850 0x7f2e94004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94005210 0x7f2e9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80b29a0 con 0x7f2e94004850 2023-10-16T13:47:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9400e2c0 con 0x7f2e94005210 2023-10-16T13:47:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9400e480 con 0x7f2e94003a00 2023-10-16T13:47:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2ead440700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e94004850 0x7f2e94004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eadc41700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e94003a00 0x7f2e94003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.750+0000 7f2eae442700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94005210 0x7f2e9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2ead440700 1 -- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e94003a00 msgr2=0x7f2e94003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2ead440700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e94003a00 0x7f2e94003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2ead440700 1 -- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94005210 msgr2=0x7f2e9400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2ead440700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94005210 0x7f2e9400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eae442700 1 -- 172.21.15.5:0/1476637513 reap_dead start 2023-10-16T13:47:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2ead440700 1 -- 172.21.15.5:0/1476637513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940035b0 con 0x7f2e94004850 2023-10-16T13:47:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2ead440700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e94004850 0x7f2e94004cd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009b40 tx=0x7f2e94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f58f5591546275e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4005a20 con 0x7f2e94004850 2023-10-16T13:47:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4005b80 con 0x7f2e94004850 2023-10-16T13:47:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eacc3f700 1 -- 172.21.15.5:0/1476637513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400e6c0 con 0x7f2e94004850 2023-10-16T13:47:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eafea5700 1 -- 172.21.15.5:0/1476637513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e94004850 msgr2=0x7f2e94004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eafea5700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e94004850 0x7f2e94004cd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009b40 tx=0x7f2e94005880 comp rx=0 tx=0).stop 2023-10-16T13:47:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eafea5700 1 -- 172.21.15.5:0/1476637513 shutdown_connections 2023-10-16T13:47:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eafea5700 1 --2- 172.21.15.5:0/1476637513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e94004850 0x7f2e94004cd0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.751+0000 7f2eafea5700 1 -- 172.21.15.5:0/1476637513 >> 172.21.15.5:0/1476637513 conn(0x7f2ea806dae0 msgr2=0x7f2ea806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.752+0000 7f2eafea5700 1 -- 172.21.15.5:0/1476637513 shutdown_connections 2023-10-16T13:47:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.752+0000 7f2eafea5700 1 -- 172.21.15.5:0/1476637513 wait complete. 2023-10-16T13:47:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.753+0000 7f2eafea5700 1 Processor -- start 2023-10-16T13:47:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.753+0000 7f2eafea5700 1 -- start start 2023-10-16T13:47:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94004850 0x7f2ea815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 0x7f2ea8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ea80b2fd0 0x7f2ea80b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea815b5e0 con 0x7f2ea81ef470 2023-10-16T13:47:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea815dd20 con 0x7f2e94004850 2023-10-16T13:47:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80ca530 con 0x7f2ea80b2fd0 2023-10-16T13:47:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 0x7f2ea8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 0x7f2ea8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47614/0 (socket says 172.21.15.5:47614) 2023-10-16T13:47:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 -- 172.21.15.5:0/996387375 learned_addr learned my addr 172.21.15.5:0/996387375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eae442700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ea80b2fd0 0x7f2ea80b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eadc41700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94004850 0x7f2ea815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 -- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ea80b2fd0 msgr2=0x7f2ea80b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ea80b2fd0 0x7f2ea80b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 -- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94004850 msgr2=0x7f2ea815d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94004850 0x7f2ea815d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 -- 172.21.15.5:0/996387375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8156120 con 0x7f2ea81ef470 2023-10-16T13:47:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eae442700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ea80b2fd0 0x7f2ea80b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2ead440700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 0x7f2ea8155be0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4000c00 tx=0x7f2ea40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4020070 con 0x7f2ea81ef470 2023-10-16T13:47:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4004240 con 0x7f2ea81ef470 2023-10-16T13:47:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40045d0 con 0x7f2ea81ef470 2023-10-16T13:47:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea80ca250 con 0x7f2ea81ef470 2023-10-16T13:47:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.754+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea815b270 con 0x7f2ea81ef470 2023-10-16T13:47:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.755+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea815b750 con 0x7f2ea81ef470 2023-10-16T13:47:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.756+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f2ea40036a0 con 0x7f2ea81ef470 2023-10-16T13:47:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.756+0000 7f2e9a7fc700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e8c06b1d0 0x7f2e8c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.756+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ea408aaa0 con 0x7f2ea81ef470 2023-10-16T13:47:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.756+0000 7f2eadc41700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e8c06b1d0 0x7f2e8c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.757+0000 7f2eadc41700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e8c06b1d0 0x7f2e8c06d690 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c000fb0 tx=0x7f2e9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.761+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ea4055be0 con 0x7f2ea81ef470 2023-10-16T13:47:46.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.962+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ea815b430 con 0x7f2ea81ef470 2023-10-16T13:47:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.962+0000 7f2e9a7fc700 1 -- 172.21.15.5:0/996387375 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ea4059200 con 0x7f2ea81ef470 2023-10-16T13:47:46.965 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:47:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e8c06b1d0 msgr2=0x7f2e8c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e8c06b1d0 0x7f2e8c06d690 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c000fb0 tx=0x7f2e9c009040 comp rx=0 tx=0).stop 2023-10-16T13:47:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 msgr2=0x7f2ea8155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 0x7f2ea8155be0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4000c00 tx=0x7f2ea40047c0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 shutdown_connections 2023-10-16T13:47:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2e8c06b1d0 0x7f2e8c06d690 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ea80b2fd0 0x7f2ea80b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94004850 0x7f2ea815d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 --2- 172.21.15.5:0/996387375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ea81ef470 0x7f2ea8155be0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 >> 172.21.15.5:0/996387375 conn(0x7f2ea806dae0 msgr2=0x7f2ea80aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 shutdown_connections 2023-10-16T13:47:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:46.964+0000 7f2eafea5700 1 -- 172.21.15.5:0/996387375 wait complete. 2023-10-16T13:47:46.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:47:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.101+0000 7f17ab99c700 1 Processor -- start 2023-10-16T13:47:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.101+0000 7f17ab99c700 1 -- start start 2023-10-16T13:47:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.102+0000 7f17ab99c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.102+0000 7f17ab99c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40cf260 con 0x7f17a406a840 2023-10-16T13:47:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.102+0000 7f17ab99c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40b2d60 con 0x7f17a40cede0 2023-10-16T13:47:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.102+0000 7f17ab99c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41619a0 con 0x7f17a40cd950 2023-10-16T13:47:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.102+0000 7f17a9f39700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17a406a840 0x7f17a4161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57632/0 (socket says 172.21.15.5:57632) 2023-10-16T13:47:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.102+0000 7f17a9f39700 1 -- 172.21.15.5:0/3025277379 learned_addr learned my addr 172.21.15.5:0/3025277379 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f17a9738700 1 --2- 172.21.15.5:0/3025277379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f179bfff700 1 -- 172.21.15.5:0/3025277379 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977200146 0 0) 0x7f17a40cf260 con 0x7f17a406a840 2023-10-16T13:47:47.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f179bfff700 1 -- 172.21.15.5:0/3025277379 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17900035b0 con 0x7f17a406a840 2023-10-16T13:47:47.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f179bfff700 1 -- 172.21.15.5:0/3025277379 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3078897879 0 0) 0x7f17900035b0 con 0x7f17a406a840 2023-10-16T13:47:47.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f17a9738700 1 -- 172.21.15.5:0/3025277379 >> v1:172.21.15.112:6789/0 conn(0x7f17a40cede0 legacy=0x7f17a415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f17a9738700 1 -- 172.21.15.5:0/3025277379 >> v1:172.21.15.5:6789/0 conn(0x7f17a406a840 legacy=0x7f17a4161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f17a9738700 1 -- 172.21.15.5:0/3025277379 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40cdd30 con 0x7f17a40cd950 2023-10-16T13:47:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f17a9738700 1 --2- 172.21.15.5:0/3025277379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a415e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1794009870 tx=0x7f1794009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5459e73b6351a6d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f179bfff700 1 -- 172.21.15.5:0/3025277379 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0019f0 con 0x7f17a40cd950 2023-10-16T13:47:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f179bfff700 1 -- 172.21.15.5:0/3025277379 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1794004030 con 0x7f17a40cd950 2023-10-16T13:47:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.103+0000 7f179bfff700 1 -- 172.21.15.5:0/3025277379 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17940043a0 con 0x7f17a40cd950 2023-10-16T13:47:47.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 -- 172.21.15.5:0/3025277379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 msgr2=0x7f17a415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 --2- 172.21.15.5:0/3025277379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a415e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1794009870 tx=0x7f1794009b80 comp rx=0 tx=0).stop 2023-10-16T13:47:47.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 -- 172.21.15.5:0/3025277379 shutdown_connections 2023-10-16T13:47:47.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 --2- 172.21.15.5:0/3025277379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a415e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 -- 172.21.15.5:0/3025277379 >> 172.21.15.5:0/3025277379 conn(0x7f17a406dae0 msgr2=0x7f17a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:47.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 -- 172.21.15.5:0/3025277379 shutdown_connections 2023-10-16T13:47:47.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.104+0000 7f17ab99c700 1 -- 172.21.15.5:0/3025277379 wait complete. 2023-10-16T13:47:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.105+0000 7f17ab99c700 1 Processor -- start 2023-10-16T13:47:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.105+0000 7f17ab99c700 1 -- start start 2023-10-16T13:47:47.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17ab99c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 0x7f17a41f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17ab99c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a40b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17ab99c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17a40cede0 0x7f17a40b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17ab99c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41f3f10 con 0x7f17a406a840 2023-10-16T13:47:47.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17ab99c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41f6fc0 con 0x7f17a40cede0 2023-10-16T13:47:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17ab99c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41f71d0 con 0x7f17a40cd950 2023-10-16T13:47:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 0x7f17a41f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 0x7f17a41f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47630/0 (socket says 172.21.15.5:47630) 2023-10-16T13:47:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 -- 172.21.15.5:0/236579988 learned_addr learned my addr 172.21.15.5:0/236579988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a8f37700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a40b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9f39700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17a40cede0 0x7f17a40b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 -- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 msgr2=0x7f17a40b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a40b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 -- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17a40cede0 msgr2=0x7f17a40b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17a40cede0 0x7f17a40b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.106+0000 7f17a9738700 1 -- 172.21.15.5:0/236579988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940094a0 con 0x7f17a406a840 2023-10-16T13:47:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.107+0000 7f17a9738700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 0x7f17a41f39d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1794000c00 tx=0x7f1794004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.107+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794010790 con 0x7f17a406a840 2023-10-16T13:47:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.107+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1794010910 con 0x7f17a406a840 2023-10-16T13:47:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.107+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a41f74b0 con 0x7f17a406a840 2023-10-16T13:47:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.107+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794010cc0 con 0x7f17a406a840 2023-10-16T13:47:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.107+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a41f7a70 con 0x7f17a406a840 2023-10-16T13:47:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.108+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a40b2630 con 0x7f17a406a840 2023-10-16T13:47:47.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.108+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f179401c420 con 0x7f17a406a840 2023-10-16T13:47:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.109+0000 7f1799ffb700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f178806b1d0 0x7f178806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.109+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f179408b3e0 con 0x7f17a406a840 2023-10-16T13:47:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.109+0000 7f17a8f37700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f178806b1d0 0x7f178806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.109+0000 7f17a8f37700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f178806b1d0 0x7f178806d690 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f17a0007fd0 tx=0x7f17a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.113+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1794056600 con 0x7f17a406a840 2023-10-16T13:47:47.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.318+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f17a40b2100 con 0x7f17a406a840 2023-10-16T13:47:47.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.319+0000 7f1799ffb700 1 -- 172.21.15.5:0/236579988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1794059c20 con 0x7f17a406a840 2023-10-16T13:47:47.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:47.322 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:47:47.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:47.323 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:47:47.323 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:47:47.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:47.323 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:47:47.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f178806b1d0 msgr2=0x7f178806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f178806b1d0 0x7f178806d690 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f17a0007fd0 tx=0x7f17a0009040 comp rx=0 tx=0).stop 2023-10-16T13:47:47.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 msgr2=0x7f17a41f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 0x7f17a41f39d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1794000c00 tx=0x7f1794004750 comp rx=0 tx=0).stop 2023-10-16T13:47:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 shutdown_connections 2023-10-16T13:47:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17a40cede0 0x7f17a40b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17a406a840 0x7f17a41f39d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f178806b1d0 0x7f178806d690 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 --2- 172.21.15.5:0/236579988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17a40cd950 0x7f17a40b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 >> 172.21.15.5:0/236579988 conn(0x7f17a406dae0 msgr2=0x7f17a406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 shutdown_connections 2023-10-16T13:47:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.321+0000 7f17ab99c700 1 -- 172.21.15.5:0/236579988 wait complete. 2023-10-16T13:47:47.335 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:47:47.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:47:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.462+0000 7f13361d3700 1 Processor -- start 2023-10-16T13:47:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.462+0000 7f13361d3700 1 -- start start 2023-10-16T13:47:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.462+0000 7f13361d3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13300cdf40 0x7f13300d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f13361d3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300b0d30 0x7f13300b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f13361d3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300d05e0 con 0x7f13300cf430 2023-10-16T13:47:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f13361d3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13300b08d0 con 0x7f13300cdf40 2023-10-16T13:47:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f13361d3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13300cfcb0 con 0x7f13300b0d30 2023-10-16T13:47:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13300cdf40 0x7f13300d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13300cdf40 0x7f13300d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47638/0 (socket says 172.21.15.5:47638) 2023-10-16T13:47:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 -- 172.21.15.5:0/967780744 learned_addr learned my addr 172.21.15.5:0/967780744 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132ffff700 1 --2- 172.21.15.5:0/967780744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300b0d30 0x7f13300b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 -- 172.21.15.5:0/967780744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300b0d30 msgr2=0x7f13300b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 --2- 172.21.15.5:0/967780744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300b0d30 0x7f13300b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 -- 172.21.15.5:0/967780744 >> v1:172.21.15.112:6789/0 conn(0x7f13300cf430 legacy=0x7f13300ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 -- 172.21.15.5:0/967780744 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300cff90 con 0x7f13300cdf40 2023-10-16T13:47:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132f7fe700 1 --2- 172.21.15.5:0/967780744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300cdf40 0x7f13300d2050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1324006fd0 tx=0x7f1324009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41e9ea99c0d4f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132e7fc700 1 -- 172.21.15.5:0/967780744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324005e30 con 0x7f13300cdf40 2023-10-16T13:47:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132e7fc700 1 -- 172.21.15.5:0/967780744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324006030 con 0x7f13300cdf40 2023-10-16T13:47:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.463+0000 7f132e7fc700 1 -- 172.21.15.5:0/967780744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240063c0 con 0x7f13300cdf40 2023-10-16T13:47:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 -- 172.21.15.5:0/967780744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300cdf40 msgr2=0x7f13300d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 --2- 172.21.15.5:0/967780744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300cdf40 0x7f13300d2050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1324006fd0 tx=0x7f1324009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 -- 172.21.15.5:0/967780744 shutdown_connections 2023-10-16T13:47:47.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 --2- 172.21.15.5:0/967780744 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300b0d30 0x7f13300b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 --2- 172.21.15.5:0/967780744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300cdf40 0x7f13300d2050 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 -- 172.21.15.5:0/967780744 >> 172.21.15.5:0/967780744 conn(0x7f13300d1530 msgr2=0x7f13300d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:47.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 -- 172.21.15.5:0/967780744 shutdown_connections 2023-10-16T13:47:47.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.464+0000 7f13361d3700 1 -- 172.21.15.5:0/967780744 wait complete. 2023-10-16T13:47:47.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.465+0000 7f13361d3700 1 Processor -- start 2023-10-16T13:47:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.465+0000 7f13361d3700 1 -- start start 2023-10-16T13:47:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f13361d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 0x7f13301e3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f13361d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13300cdf40 0x7f13301e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f13361d3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300cf430 0x7f1330150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f13361d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300c6d30 con 0x7f13300b0d30 2023-10-16T13:47:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f13361d3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13301f4ae0 con 0x7f13300cdf40 2023-10-16T13:47:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f13361d3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13301f4dc0 con 0x7f13300cf430 2023-10-16T13:47:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 0x7f13301e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 0x7f13301e3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47642/0 (socket says 172.21.15.5:47642) 2023-10-16T13:47:47.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 -- 172.21.15.5:0/2852321601 learned_addr learned my addr 172.21.15.5:0/2852321601 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132ffff700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300cf430 0x7f1330150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132effd700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13300cdf40 0x7f13301e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 -- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300cf430 msgr2=0x7f1330150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300cf430 0x7f1330150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 -- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13300cdf40 msgr2=0x7f13301e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13300cdf40 0x7f13301e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132f7fe700 1 -- 172.21.15.5:0/2852321601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324009500 con 0x7f13300b0d30 2023-10-16T13:47:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.466+0000 7f132effd700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13300cdf40 0x7f13301e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.467+0000 7f132f7fe700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 0x7f13301e3240 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1324000c00 tx=0x7f1324004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.467+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324006930 con 0x7f13300b0d30 2023-10-16T13:47:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.467+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324020070 con 0x7f13300b0d30 2023-10-16T13:47:47.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.467+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13301f50a0 con 0x7f13300b0d30 2023-10-16T13:47:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.467+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324025670 con 0x7f13300b0d30 2023-10-16T13:47:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.467+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13301f4320 con 0x7f13300b0d30 2023-10-16T13:47:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.468+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1330067d20 con 0x7f13300b0d30 2023-10-16T13:47:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.468+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f1324022030 con 0x7f13300b0d30 2023-10-16T13:47:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.469+0000 7f1317fff700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f131c06b1d0 0x7f131c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.469+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f132408ac60 con 0x7f13300b0d30 2023-10-16T13:47:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.469+0000 7f132effd700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f131c06b1d0 0x7f131c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.469+0000 7f132effd700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f131c06b1d0 0x7f131c06d690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1320006fd0 tx=0x7f1320008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.474+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1324055da0 con 0x7f13300b0d30 2023-10-16T13:47:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.673+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f13301e5920 con 0x7f13300b0d30 2023-10-16T13:47:47.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.776+0000 7f1317fff700 1 -- 172.21.15.5:0/2852321601 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1324006c80 con 0x7f13300b0d30 2023-10-16T13:47:47.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f131c06b1d0 msgr2=0x7f131c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f131c06b1d0 0x7f131c06d690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1320006fd0 tx=0x7f1320008040 comp rx=0 tx=0).stop 2023-10-16T13:47:47.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 msgr2=0x7f13301e3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 0x7f13301e3240 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1324000c00 tx=0x7f1324004750 comp rx=0 tx=0).stop 2023-10-16T13:47:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 shutdown_connections 2023-10-16T13:47:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f131c06b1d0 0x7f131c06d690 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13300cf430 0x7f1330150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13300b0d30 0x7f13301e3240 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 --2- 172.21.15.5:0/2852321601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13300cdf40 0x7f13301e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 >> 172.21.15.5:0/2852321601 conn(0x7f13300d1530 msgr2=0x7f13300b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 shutdown_connections 2023-10-16T13:47:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.778+0000 7f13361d3700 1 -- 172.21.15.5:0/2852321601 wait complete. 2023-10-16T13:47:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:47:47.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:47:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.925+0000 7f99e17ab700 1 Processor -- start 2023-10-16T13:47:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.925+0000 7f99e17ab700 1 -- start start 2023-10-16T13:47:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99e17ab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99e17ab700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99dc0d2410 0x7f99dc0d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99e17ab700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc0cf8c0 con 0x7f99dc0d0650 2023-10-16T13:47:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99e17ab700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99dc0d0ae0 con 0x7f99dc0d2410 2023-10-16T13:47:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99e17ab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0cecb0 con 0x7f99dc15dc90 2023-10-16T13:47:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99da7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99dc0d2410 0x7f99dc0d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99daffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99da7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99dc0d2410 0x7f99dc0d0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43546/0 (socket says 172.21.15.5:43546) 2023-10-16T13:47:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99daffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45554/0 (socket says 172.21.15.5:45554) 2023-10-16T13:47:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99da7fc700 1 -- 172.21.15.5:0/3854997965 learned_addr learned my addr 172.21.15.5:0/3854997965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.926+0000 7f99db7fe700 1 --1- 172.21.15.5:0/3854997965 >> v1:172.21.15.112:6789/0 conn(0x7f99dc0d0650 0x7f99dc161810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:48632/0 (socket says 172.21.15.5:48632) 2023-10-16T13:47:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99da7fc700 1 -- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 msgr2=0x7f99dc0ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99da7fc700 1 --2- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99da7fc700 1 -- 172.21.15.5:0/3854997965 >> v1:172.21.15.112:6789/0 conn(0x7f99dc0d0650 legacy=0x7f99dc161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99da7fc700 1 -- 172.21.15.5:0/3854997965 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0cef90 con 0x7f99dc0d2410 2023-10-16T13:47:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99daffd700 1 --2- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99da7fc700 1 --2- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d2410 0x7f99dc0d0110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0098f0 tx=0x7f99cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfe0140fc1257d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99d9ffb700 1 -- 172.21.15.5:0/3854997965 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc011830 con 0x7f99dc0d2410 2023-10-16T13:47:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99d9ffb700 1 -- 172.21.15.5:0/3854997965 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc011990 con 0x7f99dc0d2410 2023-10-16T13:47:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.927+0000 7f99d9ffb700 1 -- 172.21.15.5:0/3854997965 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc011d20 con 0x7f99dc0d2410 2023-10-16T13:47:47.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 -- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d2410 msgr2=0x7f99dc0d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 --2- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d2410 0x7f99dc0d0110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0098f0 tx=0x7f99cc009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:47.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 -- 172.21.15.5:0/3854997965 shutdown_connections 2023-10-16T13:47:47.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 --2- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 --2- 172.21.15.5:0/3854997965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d2410 0x7f99dc0d0110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 -- 172.21.15.5:0/3854997965 >> 172.21.15.5:0/3854997965 conn(0x7f99dc0d37e0 msgr2=0x7f99dc0d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 -- 172.21.15.5:0/3854997965 shutdown_connections 2023-10-16T13:47:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.928+0000 7f99e17ab700 1 -- 172.21.15.5:0/3854997965 wait complete. 2023-10-16T13:47:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.929+0000 7f99e17ab700 1 Processor -- start 2023-10-16T13:47:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.929+0000 7f99e17ab700 1 -- start start 2023-10-16T13:47:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99e17ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d0650 0x7f99dc0b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99e17ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 0x7f99dc0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99e17ab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99e17ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0cd8f0 con 0x7f99dc0d2410 2023-10-16T13:47:47.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99e17ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0cd000 con 0x7f99dc0d0650 2023-10-16T13:47:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99e17ab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc14d220 con 0x7f99dc15dc90 2023-10-16T13:47:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 0x7f99dc0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 0x7f99dc0b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47656/0 (socket says 172.21.15.5:47656) 2023-10-16T13:47:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 -- 172.21.15.5:0/109684130 learned_addr learned my addr 172.21.15.5:0/109684130 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99db7fe700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99daffd700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d0650 0x7f99dc0b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 -- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 msgr2=0x7f99dc0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 -- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d0650 msgr2=0x7f99dc0b91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d0650 0x7f99dc0b91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.930+0000 7f99da7fc700 1 -- 172.21.15.5:0/109684130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0009430 con 0x7f99dc0d2410 2023-10-16T13:47:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.931+0000 7f99da7fc700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 0x7f99dc0b8500 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009c40 tx=0x7f99cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.931+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc004550 con 0x7f99dc0d2410 2023-10-16T13:47:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.931+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc01f070 con 0x7f99dc0d2410 2023-10-16T13:47:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.931+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0038e0 con 0x7f99dc0d2410 2023-10-16T13:47:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.931+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc009550 con 0x7f99dc0d2410 2023-10-16T13:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.931+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc0cd580 con 0x7f99dc0d2410 2023-10-16T13:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.932+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc0cdaa0 con 0x7f99dc0d2410 2023-10-16T13:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.932+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f99cc003a40 con 0x7f99dc0d2410 2023-10-16T13:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.933+0000 7f99c37fe700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99c806b1d0 0x7f99c806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.933+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f99cc021070 con 0x7f99dc0d2410 2023-10-16T13:47:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.933+0000 7f99daffd700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99c806b1d0 0x7f99c806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.934+0000 7f99daffd700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99c806b1d0 0x7f99c806d690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009d50 tx=0x7f99d00091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:47.938+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99dc0cdaa0 con 0x7f99dc0d2410 2023-10-16T13:47:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.135+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99dc04ebb0 con 0x7f99dc0d2410 2023-10-16T13:47:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.783+0000 7f99c37fe700 1 -- 172.21.15.5:0/109684130 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) v1 ==== 170+0+0 (secure 0 0 0) 0x7f99cc02b020 con 0x7f99dc0d2410 2023-10-16T13:47:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.791+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99c806b1d0 msgr2=0x7f99c806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.791+0000 7f99e17ab700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99c806b1d0 0x7f99c806d690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009d50 tx=0x7f99d00091c0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.791+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 msgr2=0x7f99dc0b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.791+0000 7f99e17ab700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 0x7f99dc0b8500 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009c40 tx=0x7f99cc004750 comp rx=0 tx=0).stop 2023-10-16T13:47:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.792+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 shutdown_connections 2023-10-16T13:47:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.792+0000 7f99e17ab700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99c806b1d0 0x7f99c806d690 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.792+0000 7f99e17ab700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99dc15dc90 0x7f99dc0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.792+0000 7f99e17ab700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99dc0d0650 0x7f99dc0b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.792+0000 7f99e17ab700 1 --2- 172.21.15.5:0/109684130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99dc0d2410 0x7f99dc0b8500 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.792+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 >> 172.21.15.5:0/109684130 conn(0x7f99dc0d37e0 msgr2=0x7f99dc0d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.793+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 shutdown_connections 2023-10-16T13:47:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.793+0000 7f99e17ab700 1 -- 172.21.15.5:0/109684130 wait complete. 2023-10-16T13:47:48.802 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:47:48.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:47:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.946+0000 7f68285fb700 1 Processor -- start 2023-10-16T13:47:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.946+0000 7f68285fb700 1 -- start start 2023-10-16T13:47:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f68285fb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68200d0c70 0x7f68200cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f68285fb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200d23e0 con 0x7f682015b740 2023-10-16T13:47:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f68285fb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200cf190 con 0x7f68200c5110 2023-10-16T13:47:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f68285fb700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682015bb20 con 0x7f68200d0c70 2023-10-16T13:47:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f6826397700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f682015b740 0x7f68200d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57666/0 (socket says 172.21.15.5:57666) 2023-10-16T13:47:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f6826397700 1 -- 172.21.15.5:0/2105009509 learned_addr learned my addr 172.21.15.5:0/2105009509 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f6825b96700 1 --2- 172.21.15.5:0/2105009509 >> v2:172.21.15.112:3300/0 conn(0x7f68200d0c70 0x7f68200cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204721513 0 0) 0x7f681c001110 con 0x7f682015b740 2023-10-16T13:47:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c0035b0 con 0x7f682015b740 2023-10-16T13:47:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.947+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4100824673 0 0) 0x7f680c0035b0 con 0x7f682015b740 2023-10-16T13:47:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 >> v2:172.21.15.112:3300/0 conn(0x7f68200d0c70 msgr2=0x7f68200cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 --2- 172.21.15.5:0/2105009509 >> v2:172.21.15.112:3300/0 conn(0x7f68200d0c70 0x7f68200cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 >> v1:172.21.15.112:6789/0 conn(0x7f68200c5110 legacy=0x7f68200cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200cbd40 con 0x7f682015b740 2023-10-16T13:47:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f681c001800 con 0x7f682015b740 2023-10-16T13:47:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 >> v1:172.21.15.5:6789/0 conn(0x7f682015b740 legacy=0x7f68200d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f680c003a00 0x7f680c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f680c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f680c005330 0x7f680c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682015bb20 con 0x7f680c004850 2023-10-16T13:47:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c00c200 con 0x7f680c003a00 2023-10-16T13:47:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c00c3c0 con 0x7f680c005330 2023-10-16T13:47:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f680c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6826397700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f680c003a00 0x7f680c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6826b98700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f680c005330 0x7f680c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 -- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f680c005330 msgr2=0x7f680c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f680c005330 0x7f680c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 -- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f680c003a00 msgr2=0x7f680c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f680c003a00 0x7f680c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 -- 172.21.15.5:0/2105009509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0035b0 con 0x7f680c004850 2023-10-16T13:47:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6826b98700 1 -- 172.21.15.5:0/2105009509 reap_dead start 2023-10-16T13:47:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825b96700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f680c004cd0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6810009b30 tx=0x7f680c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ac86ff38f79071 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.948+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000e6c0 con 0x7f680c004850 2023-10-16T13:47:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681000e820 con 0x7f680c004850 2023-10-16T13:47:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f6825395700 1 -- 172.21.15.5:0/2105009509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000eb90 con 0x7f680c004850 2023-10-16T13:47:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 -- 172.21.15.5:0/2105009509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 msgr2=0x7f680c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f680c004cd0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6810009b30 tx=0x7f680c005880 comp rx=0 tx=0).stop 2023-10-16T13:47:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 -- 172.21.15.5:0/2105009509 shutdown_connections 2023-10-16T13:47:48.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 --2- 172.21.15.5:0/2105009509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f680c004cd0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 -- 172.21.15.5:0/2105009509 >> 172.21.15.5:0/2105009509 conn(0x7f68200665a0 msgr2=0x7f6820066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:48.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 -- 172.21.15.5:0/2105009509 shutdown_connections 2023-10-16T13:47:48.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.949+0000 7f68285fb700 1 -- 172.21.15.5:0/2105009509 wait complete. 2023-10-16T13:47:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.950+0000 7f68285fb700 1 Processor -- start 2023-10-16T13:47:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.950+0000 7f68285fb700 1 -- start start 2023-10-16T13:47:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f68285fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f682014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f68285fb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68201f39c0 0x7f6820159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f68285fb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6820159fe0 0x7f68200b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f68285fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682015a460 con 0x7f680c004850 2023-10-16T13:47:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f68285fb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6820151740 con 0x7f68201f39c0 2023-10-16T13:47:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f68285fb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6820150b30 con 0x7f6820159fe0 2023-10-16T13:47:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f6826397700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f682014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f6826397700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f682014fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47674/0 (socket says 172.21.15.5:47674) 2023-10-16T13:47:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f6826397700 1 -- 172.21.15.5:0/1092219610 learned_addr learned my addr 172.21.15.5:0/1092219610 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f6826b98700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6820159fe0 0x7f68200b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f6825b96700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68201f39c0 0x7f6820159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.951+0000 7f6826397700 1 -- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6820159fe0 msgr2=0x7f68200b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6826397700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6820159fe0 0x7f68200b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6826397700 1 -- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68201f39c0 msgr2=0x7f6820159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6826397700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68201f39c0 0x7f6820159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6826397700 1 -- 172.21.15.5:0/1092219610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820150e10 con 0x7f680c004850 2023-10-16T13:47:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6825b96700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68201f39c0 0x7f6820159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6826397700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f682014fbd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f681c004f80 tx=0x7f681c007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c011580 con 0x7f680c004850 2023-10-16T13:47:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c0116e0 con 0x7f680c004850 2023-10-16T13:47:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68201510f0 con 0x7f680c004850 2023-10-16T13:47:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c011a90 con 0x7f680c004850 2023-10-16T13:47:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.952+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68201f3e40 con 0x7f680c004850 2023-10-16T13:47:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.953+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682006b950 con 0x7f680c004850 2023-10-16T13:47:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.953+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f681c011bf0 con 0x7f680c004850 2023-10-16T13:47:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.954+0000 7f6816ffd700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f680406b1d0 0x7f680406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.954+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f681c0896a0 con 0x7f680c004850 2023-10-16T13:47:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.954+0000 7f6825b96700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f680406b1d0 0x7f680406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.955+0000 7f6825b96700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f680406b1d0 0x7f680406d690 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f68100090b0 tx=0x7f6810008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:48.959+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f681c0545e0 con 0x7f680c004850 2023-10-16T13:47:49.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.205+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68200d23e0 con 0x7f680c004850 2023-10-16T13:47:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.809+0000 7f6816ffd700 1 -- 172.21.15.5:0/1092219610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f68200d23e0 con 0x7f680c004850 2023-10-16T13:47:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f680406b1d0 msgr2=0x7f680406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f680406b1d0 0x7f680406d690 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f68100090b0 tx=0x7f6810008030 comp rx=0 tx=0).stop 2023-10-16T13:47:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 msgr2=0x7f682014fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f682014fbd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f681c004f80 tx=0x7f681c007340 comp rx=0 tx=0).stop 2023-10-16T13:47:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 shutdown_connections 2023-10-16T13:47:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f680406b1d0 0x7f680406d690 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6820159fe0 0x7f68200b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f680c004850 0x7f682014fbd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 --2- 172.21.15.5:0/1092219610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68201f39c0 0x7f6820159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.813+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 >> 172.21.15.5:0/1092219610 conn(0x7f68200665a0 msgr2=0x7f68200c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.814+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 shutdown_connections 2023-10-16T13:47:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.814+0000 7f68285fb700 1 -- 172.21.15.5:0/1092219610 wait complete. 2023-10-16T13:47:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 14 and data pool 15 2023-10-16T13:47:49.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:49.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.961+0000 7f2f3522b700 1 Processor -- start 2023-10-16T13:47:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.961+0000 7f2f3522b700 1 -- start start 2023-10-16T13:47:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.961+0000 7f2f3522b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f300cd950 0x7f2f3015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.961+0000 7f2f3522b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f3015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.961+0000 7f2f3522b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f3006a840 0x7f2f3006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f3522b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f301619a0 con 0x7f2f300cd950 2023-10-16T13:47:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f3522b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3006b1f0 con 0x7f2f3006a840 2023-10-16T13:47:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f3522b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300cf260 con 0x7f2f300cede0 2023-10-16T13:47:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f300cd950 0x7f2f3015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f300cd950 0x7f2f3015e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47696/0 (socket says 172.21.15.5:47696) 2023-10-16T13:47:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 -- 172.21.15.5:0/4034547754 learned_addr learned my addr 172.21.15.5:0/4034547754 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2e59c700 1 --2- 172.21.15.5:0/4034547754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f3015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2f59e700 1 --2- 172.21.15.5:0/4034547754 >> v2:172.21.15.112:3300/0 conn(0x7f2f3006a840 0x7f2f3006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 -- 172.21.15.5:0/4034547754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 msgr2=0x7f2f3015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 --2- 172.21.15.5:0/4034547754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f3015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 -- 172.21.15.5:0/4034547754 >> v2:172.21.15.112:3300/0 conn(0x7f2f3006a840 msgr2=0x7f2f3006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 --2- 172.21.15.5:0/4034547754 >> v2:172.21.15.112:3300/0 conn(0x7f2f3006a840 0x7f2f3006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 -- 172.21.15.5:0/4034547754 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300b2d60 con 0x7f2f300cd950 2023-10-16T13:47:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2f59e700 1 --2- 172.21.15.5:0/4034547754 >> v2:172.21.15.112:3300/0 conn(0x7f2f3006a840 0x7f2f3006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2ed9d700 1 --2- 172.21.15.5:0/4034547754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f3015e2f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2f3006ebc0 tx=0x7f2f20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a456184c0f549fba server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2dd9b700 1 -- 172.21.15.5:0/4034547754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000b870 con 0x7f2f300cd950 2023-10-16T13:47:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2dd9b700 1 -- 172.21.15.5:0/4034547754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2000b9d0 con 0x7f2f300cd950 2023-10-16T13:47:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.962+0000 7f2f2dd9b700 1 -- 172.21.15.5:0/4034547754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000bd60 con 0x7f2f300cd950 2023-10-16T13:47:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 -- 172.21.15.5:0/4034547754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 msgr2=0x7f2f3015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 --2- 172.21.15.5:0/4034547754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f3015e2f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2f3006ebc0 tx=0x7f2f20009bd0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 -- 172.21.15.5:0/4034547754 shutdown_connections 2023-10-16T13:47:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 --2- 172.21.15.5:0/4034547754 >> v2:172.21.15.112:3300/0 conn(0x7f2f3006a840 0x7f2f3006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 --2- 172.21.15.5:0/4034547754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f3015e2f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 --2- 172.21.15.5:0/4034547754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f3015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 -- 172.21.15.5:0/4034547754 >> 172.21.15.5:0/4034547754 conn(0x7f2f3006dae0 msgr2=0x7f2f3006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 -- 172.21.15.5:0/4034547754 shutdown_connections 2023-10-16T13:47:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.963+0000 7f2f3522b700 1 -- 172.21.15.5:0/4034547754 wait complete. 2023-10-16T13:47:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.964+0000 7f2f3522b700 1 Processor -- start 2023-10-16T13:47:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.964+0000 7f2f3522b700 1 -- start start 2023-10-16T13:47:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f3522b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f3006a840 0x7f2f301f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f3522b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f301541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f3522b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f301566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f3522b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301f3860 con 0x7f2f300cd950 2023-10-16T13:47:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f3522b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f30154ce0 con 0x7f2f3006a840 2023-10-16T13:47:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f3522b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f30154fc0 con 0x7f2f300cede0 2023-10-16T13:47:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f2e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f301541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f2e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f301541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47702/0 (socket says 172.21.15.5:47702) 2023-10-16T13:47:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f2e59c700 1 -- 172.21.15.5:0/808917233 learned_addr learned my addr 172.21.15.5:0/808917233 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f2f59e700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f301566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.965+0000 7f2f2ed9d700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f3006a840 0x7f2f301f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f2e59c700 1 -- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 msgr2=0x7f2f301566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f2e59c700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f301566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f2e59c700 1 -- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f3006a840 msgr2=0x7f2f301f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f2e59c700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f3006a840 0x7f2f301f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f2e59c700 1 -- 172.21.15.5:0/808917233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009550 con 0x7f2f300cd950 2023-10-16T13:47:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f2e59c700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f301541e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d7d0 tx=0x7f2f2400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24017070 con 0x7f2f300cd950 2023-10-16T13:47:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24005a20 con 0x7f2f300cd950 2023-10-16T13:47:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f301552a0 con 0x7f2f300cd950 2023-10-16T13:47:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24005bd0 con 0x7f2f300cd950 2023-10-16T13:47:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.966+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f30155860 con 0x7f2f300cd950 2023-10-16T13:47:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.967+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f30155a20 con 0x7f2f300cd950 2023-10-16T13:47:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.968+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f2f24005d30 con 0x7f2f300cd950 2023-10-16T13:47:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.968+0000 7f2f177fe700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f1c06b1d0 0x7f2f1c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.968+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f24089dd0 con 0x7f2f300cd950 2023-10-16T13:47:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.968+0000 7f2f2ed9d700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f1c06b1d0 0x7f2f1c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.969+0000 7f2f2ed9d700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f1c06b1d0 0x7f2f1c06d690 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f20008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:49.973+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f24054c30 con 0x7f2f300cd950 2023-10-16T13:47:50.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.176+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f30067d20 con 0x7f2f300cd950 2023-10-16T13:47:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.177+0000 7f2f177fe700 1 -- 172.21.15.5:0/808917233 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16449 (secure 0 0 0) 0x7f2f24058250 con 0x7f2f300cd950 2023-10-16T13:47:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:50.180 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:49.206753+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f1c06b1d0 msgr2=0x7f2f1c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f1c06b1d0 0x7f2f1c06d690 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f20008030 comp rx=0 tx=0).stop 2023-10-16T13:47:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 msgr2=0x7f2f301541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f301541e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d7d0 tx=0x7f2f2400dae0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 shutdown_connections 2023-10-16T13:47:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f1c06b1d0 0x7f2f1c06d690 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f300cede0 0x7f2f301566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f3006a840 0x7f2f301f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 --2- 172.21.15.5:0/808917233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f300cd950 0x7f2f301541e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 >> 172.21.15.5:0/808917233 conn(0x7f2f3006dae0 msgr2=0x7f2f3006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:50.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 shutdown_connections 2023-10-16T13:47:50.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.179+0000 7f2f3522b700 1 -- 172.21.15.5:0/808917233 wait complete. 2023-10-16T13:47:50.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.317+0000 7f7b1f98c700 1 Processor -- start 2023-10-16T13:47:50.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.317+0000 7f7b1f98c700 1 -- start start 2023-10-16T13:47:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1f98c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 0x7f7b1815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1f98c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b18158120 con 0x7f7b1815e290 2023-10-16T13:47:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1f98c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1806a840 con 0x7f7b18157d40 2023-10-16T13:47:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1f98c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1806e560 con 0x7f7b180cee90 2023-10-16T13:47:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1df29700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7b1815e290 0x7f7b180cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57716/0 (socket says 172.21.15.5:57716) 2023-10-16T13:47:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1df29700 1 -- 172.21.15.5:0/1756600555 learned_addr learned my addr 172.21.15.5:0/1756600555 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b1cf27700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 0x7f7b1815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542054306 0 0) 0x7f7b18158120 con 0x7f7b1815e290 2023-10-16T13:47:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b040035b0 con 0x7f7b1815e290 2023-10-16T13:47:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4071339104 0 0) 0x7f7b040035b0 con 0x7f7b1815e290 2023-10-16T13:47:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 msgr2=0x7f7b1815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 0x7f7b1815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 >> v1:172.21.15.112:6789/0 conn(0x7f7b18157d40 legacy=0x7f7b1806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180caef0 con 0x7f7b1815e290 2023-10-16T13:47:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f7b100019f0 con 0x7f7b1815e290 2023-10-16T13:47:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 >> v1:172.21.15.5:6789/0 conn(0x7f7b1815e290 legacy=0x7f7b180cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.318+0000 7f7b0ffff700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04003a30 0x7f7b04003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 0x7f7b04004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b04004d90 0x7f7b04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0400ba10 con 0x7f7b04004d90 2023-10-16T13:47:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0400bb50 con 0x7f7b04003a30 2023-10-16T13:47:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0400bd10 con 0x7f7b180cee90 2023-10-16T13:47:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b04004d90 0x7f7b04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1d728700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04003a30 0x7f7b04003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1cf27700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 0x7f7b04004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 -- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 msgr2=0x7f7b04004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180cee90 0x7f7b04004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 -- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04003a30 msgr2=0x7f7b04003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04003a30 0x7f7b04003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 -- 172.21.15.5:0/1756600555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040035b0 con 0x7f7b04004d90 2023-10-16T13:47:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b1df29700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b04004d90 0x7f7b04005210 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000a830 tx=0x7f7b04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5028827fe7d00c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10012600 con 0x7f7b04004d90 2023-10-16T13:47:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b10012780 con 0x7f7b04004d90 2023-10-16T13:47:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.319+0000 7f7b0ffff700 1 -- 172.21.15.5:0/1756600555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10012b30 con 0x7f7b04004d90 2023-10-16T13:47:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1f98c700 1 -- 172.21.15.5:0/1756600555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b04004d90 msgr2=0x7f7b04005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/1756600555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b04004d90 0x7f7b04005210 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000a830 tx=0x7f7b04005880 comp rx=0 tx=0).stop 2023-10-16T13:47:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1df29700 1 -- 172.21.15.5:0/1756600555 reap_dead start 2023-10-16T13:47:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1f98c700 1 -- 172.21.15.5:0/1756600555 shutdown_connections 2023-10-16T13:47:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1f98c700 1 -- 172.21.15.5:0/1756600555 >> 172.21.15.5:0/1756600555 conn(0x7f7b180cc6f0 msgr2=0x7f7b180ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1f98c700 1 -- 172.21.15.5:0/1756600555 shutdown_connections 2023-10-16T13:47:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.320+0000 7f7b1f98c700 1 -- 172.21.15.5:0/1756600555 wait complete. 2023-10-16T13:47:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.321+0000 7f7b1f98c700 1 Processor -- start 2023-10-16T13:47:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.321+0000 7f7b1f98c700 1 -- start start 2023-10-16T13:47:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1f98c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04004d90 0x7f7b1815cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1f98c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180c7750 0x7f7b1814c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1f98c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 0x7f7b1814d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1f98c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180c8c20 con 0x7f7b1814cc60 2023-10-16T13:47:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1f98c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180c7fa0 con 0x7f7b04004d90 2023-10-16T13:47:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1f98c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180c8280 con 0x7f7b180c7750 2023-10-16T13:47:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 0x7f7b1814d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 0x7f7b1814d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47724/0 (socket says 172.21.15.5:47724) 2023-10-16T13:47:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 -- 172.21.15.5:0/3903134305 learned_addr learned my addr 172.21.15.5:0/3903134305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1cf27700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180c7750 0x7f7b1814c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1d728700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04004d90 0x7f7b1815cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 -- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180c7750 msgr2=0x7f7b1814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180c7750 0x7f7b1814c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 -- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04004d90 msgr2=0x7f7b1815cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04004d90 0x7f7b1815cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.322+0000 7f7b1df29700 1 -- 172.21.15.5:0/3903134305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180c8560 con 0x7f7b1814cc60 2023-10-16T13:47:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.323+0000 7f7b1df29700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 0x7f7b1814d790 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7b10001cb0 tx=0x7f7b10001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.323+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100019b0 con 0x7f7b1814cc60 2023-10-16T13:47:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.323+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b10022070 con 0x7f7b1814cc60 2023-10-16T13:47:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.323+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b180c8840 con 0x7f7b1814cc60 2023-10-16T13:47:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.323+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1001e650 con 0x7f7b1814cc60 2023-10-16T13:47:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.323+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1814dcd0 con 0x7f7b1814cc60 2023-10-16T13:47:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.324+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b180c8d60 con 0x7f7b1814cc60 2023-10-16T13:47:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.324+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f7b1001e7b0 con 0x7f7b1814cc60 2023-10-16T13:47:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.325+0000 7f7b0dffb700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7afc06b1d0 0x7f7afc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.325+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b1008c310 con 0x7f7b1814cc60 2023-10-16T13:47:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.325+0000 7f7b1d728700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7afc06b1d0 0x7f7afc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.326+0000 7f7b1d728700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7afc06b1d0 0x7f7afc06d690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7b1815d9d0 tx=0x7f7b14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.330+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b180c8d60 con 0x7f7b1814cc60 2023-10-16T13:47:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.530+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b180c8d60 con 0x7f7b1814cc60 2023-10-16T13:47:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.531+0000 7f7b0dffb700 1 -- 172.21.15.5:0/3903134305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16449 (secure 0 0 0) 0x7f7b180c8d60 con 0x7f7b1814cc60 2023-10-16T13:47:50.535 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:50.535 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:49.206753+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7afc06b1d0 msgr2=0x7f7afc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7afc06b1d0 0x7f7afc06d690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7b1815d9d0 tx=0x7f7b14009040 comp rx=0 tx=0).stop 2023-10-16T13:47:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 msgr2=0x7f7b1814d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 0x7f7b1814d790 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7b10001cb0 tx=0x7f7b10001d80 comp rx=0 tx=0).stop 2023-10-16T13:47:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 shutdown_connections 2023-10-16T13:47:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1814cc60 0x7f7b1814d790 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b04004d90 0x7f7b1815cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7afc06b1d0 0x7f7afc06d690 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 --2- 172.21.15.5:0/3903134305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7b180c7750 0x7f7b1814c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 >> 172.21.15.5:0/3903134305 conn(0x7f7b180cc6f0 msgr2=0x7f7b1806b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 shutdown_connections 2023-10-16T13:47:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.533+0000 7f7b1f98c700 1 -- 172.21.15.5:0/3903134305 wait complete. 2023-10-16T13:47:50.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:47:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.674+0000 7f7df3121700 1 Processor -- start 2023-10-16T13:47:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.674+0000 7f7df3121700 1 -- start start 2023-10-16T13:47:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df3121700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0b7050 0x7f7dec15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df3121700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec15e4e0 con 0x7f7dec15dbc0 2023-10-16T13:47:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df3121700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec0d28e0 con 0x7f7dec0d3fc0 2023-10-16T13:47:50.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df3121700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0b7560 con 0x7f7dec0b7050 2023-10-16T13:47:50.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df0ebd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7dec15dbc0 0x7f7dec0d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57732/0 (socket says 172.21.15.5:57732) 2023-10-16T13:47:50.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df0ebd700 1 -- 172.21.15.5:0/856172793 learned_addr learned my addr 172.21.15.5:0/856172793 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7df16be700 1 --2- 172.21.15.5:0/856172793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0b7050 0x7f7dec15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7deb7fe700 1 -- 172.21.15.5:0/856172793 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797750695 0 0) 0x7f7dec15e4e0 con 0x7f7dec15dbc0 2023-10-16T13:47:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.675+0000 7f7deb7fe700 1 -- 172.21.15.5:0/856172793 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc0035b0 con 0x7f7dec15dbc0 2023-10-16T13:47:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7df16be700 1 -- 172.21.15.5:0/856172793 >> v1:172.21.15.112:6789/0 conn(0x7f7dec0d3fc0 legacy=0x7f7dec0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7df16be700 1 -- 172.21.15.5:0/856172793 >> v1:172.21.15.5:6789/0 conn(0x7f7dec15dbc0 legacy=0x7f7dec0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7deb7fe700 1 -- 172.21.15.5:0/856172793 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050417069 0 0) 0x7f7dec0d28e0 con 0x7f7dec0d3fc0 2023-10-16T13:47:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7df16be700 1 -- 172.21.15.5:0/856172793 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0b7840 con 0x7f7dec0b7050 2023-10-16T13:47:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7df16be700 1 --2- 172.21.15.5:0/856172793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0b7050 0x7f7dec15dfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009dc0 tx=0x7f7de400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e7f1c5e5c6487c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7deb7fe700 1 -- 172.21.15.5:0/856172793 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de400e070 con 0x7f7dec0b7050 2023-10-16T13:47:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7deb7fe700 1 -- 172.21.15.5:0/856172793 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4003a20 con 0x7f7dec0b7050 2023-10-16T13:47:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.676+0000 7f7deb7fe700 1 -- 172.21.15.5:0/856172793 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00017f0 con 0x7f7dec0b7050 2023-10-16T13:47:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 -- 172.21.15.5:0/856172793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0b7050 msgr2=0x7f7dec15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 --2- 172.21.15.5:0/856172793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0b7050 0x7f7dec15dfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009dc0 tx=0x7f7de400b330 comp rx=0 tx=0).stop 2023-10-16T13:47:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 -- 172.21.15.5:0/856172793 shutdown_connections 2023-10-16T13:47:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 --2- 172.21.15.5:0/856172793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0b7050 0x7f7dec15dfa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 -- 172.21.15.5:0/856172793 >> 172.21.15.5:0/856172793 conn(0x7f7dec09cb40 msgr2=0x7f7dec0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 -- 172.21.15.5:0/856172793 shutdown_connections 2023-10-16T13:47:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.677+0000 7f7df3121700 1 -- 172.21.15.5:0/856172793 wait complete. 2023-10-16T13:47:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.678+0000 7f7df3121700 1 Processor -- start 2023-10-16T13:47:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.678+0000 7f7df3121700 1 -- start start 2023-10-16T13:47:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df3121700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 0x7f7dec151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df3121700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0d3fc0 0x7f7dec1e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df3121700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dec15dbc0 0x7f7dec1e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df3121700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0cc3a0 con 0x7f7dec0b7050 2023-10-16T13:47:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df3121700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec155af0 con 0x7f7dec15dbc0 2023-10-16T13:47:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df3121700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec1e8430 con 0x7f7dec0d3fc0 2023-10-16T13:47:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 0x7f7dec151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 0x7f7dec151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47734/0 (socket says 172.21.15.5:47734) 2023-10-16T13:47:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 -- 172.21.15.5:0/1809406425 learned_addr learned my addr 172.21.15.5:0/1809406425 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df16be700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dec15dbc0 0x7f7dec1e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7debfff700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0d3fc0 0x7f7dec1e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 -- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0d3fc0 msgr2=0x7f7dec1e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0d3fc0 0x7f7dec1e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 -- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dec15dbc0 msgr2=0x7f7dec1e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dec15dbc0 0x7f7dec1e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 -- 172.21.15.5:0/1809406425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4009a70 con 0x7f7dec0b7050 2023-10-16T13:47:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7df0ebd700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 0x7f7dec151b70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7de000c780 tx=0x7f7de000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.679+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0005c40 con 0x7f7dec0b7050 2023-10-16T13:47:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.680+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de0005da0 con 0x7f7dec0b7050 2023-10-16T13:47:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.680+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0007290 con 0x7f7dec0b7050 2023-10-16T13:47:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.680+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec0cba70 con 0x7f7dec0b7050 2023-10-16T13:47:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.680+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec0cc030 con 0x7f7dec0b7050 2023-10-16T13:47:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.681+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec15dfa0 con 0x7f7dec0b7050 2023-10-16T13:47:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.681+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f7de00073f0 con 0x7f7dec0b7050 2023-10-16T13:47:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.681+0000 7f7de97fa700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7dd006b1d0 0x7f7dd006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.682+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7de0089010 con 0x7f7dec0b7050 2023-10-16T13:47:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.682+0000 7f7debfff700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7dd006b1d0 0x7f7dd006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.682+0000 7f7debfff700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7dd006b1d0 0x7f7dd006d690 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0cb920 tx=0x7f7dd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.686+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7de0053d70 con 0x7f7dec0b7050 2023-10-16T13:47:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:50.935+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7dec04ebb0 con 0x7f7dec0b7050 2023-10-16T13:47:51.779 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-10-16T13:47:51.776+0000 7f559fccd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:47:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.827+0000 7f7de97fa700 1 -- 172.21.15.5:0/1809406425 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7de0017020 con 0x7f7dec0b7050 2023-10-16T13:47:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7dd006b1d0 msgr2=0x7f7dd006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7dd006b1d0 0x7f7dd006d690 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0cb920 tx=0x7f7dd8009040 comp rx=0 tx=0).stop 2023-10-16T13:47:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 msgr2=0x7f7dec151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 0x7f7dec151b70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7de000c780 tx=0x7f7de000cb40 comp rx=0 tx=0).stop 2023-10-16T13:47:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 shutdown_connections 2023-10-16T13:47:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dec15dbc0 0x7f7dec1e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dec0b7050 0x7f7dec151b70 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7dd006b1d0 0x7f7dd006d690 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 --2- 172.21.15.5:0/1809406425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7dec0d3fc0 0x7f7dec1e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 >> 172.21.15.5:0/1809406425 conn(0x7f7dec09cb40 msgr2=0x7f7dec15cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 shutdown_connections 2023-10-16T13:47:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.830+0000 7f7df3121700 1 -- 172.21.15.5:0/1809406425 wait complete. 2023-10-16T13:47:51.848 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:47:51.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:47:51.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.981+0000 7ffa6b4c0700 1 Processor -- start 2023-10-16T13:47:51.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.982+0000 7ffa6b4c0700 1 -- start start 2023-10-16T13:47:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.982+0000 7ffa6b4c0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffa6415f1f0 0x7ffa640cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.982+0000 7ffa6b4c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa640cfc60 0x7ffa640cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.982+0000 7ffa6b4c0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6415e7a0 con 0x7ffa6415ab10 2023-10-16T13:47:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.982+0000 7ffa6b4c0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640d0090 con 0x7ffa640cfc60 2023-10-16T13:47:51.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa6b4c0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640b29a0 con 0x7ffa6415f1f0 2023-10-16T13:47:51.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa6925c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa6415ab10 0x7ffa640b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57746/0 (socket says 172.21.15.5:57746) 2023-10-16T13:47:51.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa6925c700 1 -- 172.21.15.5:0/457858534 learned_addr learned my addr 172.21.15.5:0/457858534 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:51.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa69a5d700 1 --2- 172.21.15.5:0/457858534 >> v2:172.21.15.5:3300/0 conn(0x7ffa640cfc60 0x7ffa640cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:51.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa57fff700 1 -- 172.21.15.5:0/457858534 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456249055 0 0) 0x7ffa6415e7a0 con 0x7ffa6415ab10 2023-10-16T13:47:51.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa57fff700 1 -- 172.21.15.5:0/457858534 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa500035b0 con 0x7ffa6415ab10 2023-10-16T13:47:51.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa68a5b700 1 --2- 172.21.15.5:0/457858534 >> v2:172.21.15.112:3300/0 conn(0x7ffa6415f1f0 0x7ffa640cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:51.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa69a5d700 1 -- 172.21.15.5:0/457858534 >> v2:172.21.15.112:3300/0 conn(0x7ffa6415f1f0 msgr2=0x7ffa640cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:51.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa69a5d700 1 --2- 172.21.15.5:0/457858534 >> v2:172.21.15.112:3300/0 conn(0x7ffa6415f1f0 0x7ffa640cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa69a5d700 1 -- 172.21.15.5:0/457858534 >> v1:172.21.15.5:6789/0 conn(0x7ffa6415ab10 legacy=0x7ffa640b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:51.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa69a5d700 1 -- 172.21.15.5:0/457858534 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640b2c80 con 0x7ffa640cfc60 2023-10-16T13:47:51.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa69a5d700 1 --2- 172.21.15.5:0/457858534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640cbf40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ffa6406d470 tx=0x7ffa5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe5938332dc64aa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:51.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa57fff700 1 -- 172.21.15.5:0/457858534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00e070 con 0x7ffa640cfc60 2023-10-16T13:47:51.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa57fff700 1 -- 172.21.15.5:0/457858534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00bb20 con 0x7ffa640cfc60 2023-10-16T13:47:51.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.983+0000 7ffa57fff700 1 -- 172.21.15.5:0/457858534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c012430 con 0x7ffa640cfc60 2023-10-16T13:47:51.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/457858534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 msgr2=0x7ffa640cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:51.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/457858534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640cbf40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ffa6406d470 tx=0x7ffa5c00b330 comp rx=0 tx=0).stop 2023-10-16T13:47:51.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/457858534 shutdown_connections 2023-10-16T13:47:51.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/457858534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640cbf40 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/457858534 >> v2:172.21.15.112:3300/0 conn(0x7ffa6415f1f0 0x7ffa640cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/457858534 >> 172.21.15.5:0/457858534 conn(0x7ffa6406dae0 msgr2=0x7ffa6406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:51.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/457858534 shutdown_connections 2023-10-16T13:47:51.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.984+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/457858534 wait complete. 2023-10-16T13:47:51.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.985+0000 7ffa6b4c0700 1 Processor -- start 2023-10-16T13:47:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.985+0000 7ffa6b4c0700 1 -- start start 2023-10-16T13:47:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6b4c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6b4c0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa6415ab10 0x7ffa640c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6b4c0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa6415f1f0 0x7ffa6415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6b4c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641f1070 con 0x7ffa640cfc60 2023-10-16T13:47:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6b4c0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6415df40 con 0x7ffa6415f1f0 2023-10-16T13:47:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6b4c0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6415d160 con 0x7ffa6415ab10 2023-10-16T13:47:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47748/0 (socket says 172.21.15.5:47748) 2023-10-16T13:47:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 -- 172.21.15.5:0/3846480449 learned_addr learned my addr 172.21.15.5:0/3846480449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 -- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa6415ab10 msgr2=0x7ffa640c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa68a5b700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa6415ab10 0x7ffa640c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa69a5d700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa6415f1f0 0x7ffa6415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa6415ab10 0x7ffa640c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 -- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa6415f1f0 msgr2=0x7ffa6415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa6415f1f0 0x7ffa6415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.986+0000 7ffa6925c700 1 -- 172.21.15.5:0/3846480449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009a70 con 0x7ffa640cfc60 2023-10-16T13:47:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.987+0000 7ffa6925c700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640c4000 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ffa60001eb0 tx=0x7ffa6000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.987+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60005d70 con 0x7ffa640cfc60 2023-10-16T13:47:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.987+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa600070d0 con 0x7ffa640cfc60 2023-10-16T13:47:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.987+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6415d440 con 0x7ffa640cfc60 2023-10-16T13:47:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.987+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007460 con 0x7ffa640cfc60 2023-10-16T13:47:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.987+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa640c66a0 con 0x7ffa640cfc60 2023-10-16T13:47:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.988+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa64067d20 con 0x7ffa640cfc60 2023-10-16T13:47:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.988+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7ffa600075c0 con 0x7ffa640cfc60 2023-10-16T13:47:52.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.989+0000 7ffa55ffb700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa4806b1d0 0x7ffa4806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:52.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.989+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa60089050 con 0x7ffa640cfc60 2023-10-16T13:47:52.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.989+0000 7ffa68a5b700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa4806b1d0 0x7ffa4806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:52.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.990+0000 7ffa68a5b700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa4806b1d0 0x7ffa4806d690 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffa58006fd0 tx=0x7ffa58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:51.994+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa60053cd0 con 0x7ffa640cfc60 2023-10-16T13:47:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.243+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffa640afc10 con 0x7ffa640cfc60 2023-10-16T13:47:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.832+0000 7ffa55ffb700 1 -- 172.21.15.5:0/3846480449 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffa600572f0 con 0x7ffa640cfc60 2023-10-16T13:47:52.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa4806b1d0 msgr2=0x7ffa4806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:52.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa4806b1d0 0x7ffa4806d690 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffa58006fd0 tx=0x7ffa58008040 comp rx=0 tx=0).stop 2023-10-16T13:47:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 msgr2=0x7ffa640c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640c4000 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ffa60001eb0 tx=0x7ffa6000c860 comp rx=0 tx=0).stop 2023-10-16T13:47:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 shutdown_connections 2023-10-16T13:47:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa6415f1f0 0x7ffa6415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640cfc60 0x7ffa640c4000 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffa4806b1d0 0x7ffa4806d690 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 --2- 172.21.15.5:0/3846480449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa6415ab10 0x7ffa640c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 >> 172.21.15.5:0/3846480449 conn(0x7ffa6406dae0 msgr2=0x7ffa64159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 shutdown_connections 2023-10-16T13:47:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.835+0000 7ffa6b4c0700 1 -- 172.21.15.5:0/3846480449 wait complete. 2023-10-16T13:47:52.853 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:47:52.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:52.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.983+0000 7f0ecb602700 1 Processor -- start 2023-10-16T13:47:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.983+0000 7f0ecb602700 1 -- start start 2023-10-16T13:47:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ecb602700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 0x7f0ec40d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ecb602700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec40cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ecb602700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40cf190 con 0x7f0ec40c5110 2023-10-16T13:47:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ecb602700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec415bb20 con 0x7f0ec415b740 2023-10-16T13:47:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ecb602700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40cbd40 con 0x7f0ec40d0c70 2023-10-16T13:47:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ec8b9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec40cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ec939e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 0x7f0ec40d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ec939e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 0x7f0ec40d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43652/0 (socket says 172.21.15.5:43652) 2023-10-16T13:47:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ec939e700 1 -- 172.21.15.5:0/940546600 learned_addr learned my addr 172.21.15.5:0/940546600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.984+0000 7f0ec8b9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec40cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45662/0 (socket says 172.21.15.5:45662) 2023-10-16T13:47:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ec8b9d700 1 -- 172.21.15.5:0/940546600 >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 msgr2=0x7f0ec40d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ec8b9d700 1 --2- 172.21.15.5:0/940546600 >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 0x7f0ec40d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ec8b9d700 1 -- 172.21.15.5:0/940546600 >> v1:172.21.15.112:6789/0 conn(0x7f0ec40c5110 legacy=0x7f0ec40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ec8b9d700 1 -- 172.21.15.5:0/940546600 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40cc020 con 0x7f0ec40d0c70 2023-10-16T13:47:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ec939e700 1 --2- 172.21.15.5:0/940546600 >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 0x7f0ec40d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ec8b9d700 1 --2- 172.21.15.5:0/940546600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec40cdfd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009840 tx=0x7f0eb4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c2b6e18fe0a3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ebbfff700 1 -- 172.21.15.5:0/940546600 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4011830 con 0x7f0ec40d0c70 2023-10-16T13:47:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ebbfff700 1 -- 172.21.15.5:0/940546600 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4011990 con 0x7f0ec40d0c70 2023-10-16T13:47:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ebbfff700 1 -- 172.21.15.5:0/940546600 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4011d20 con 0x7f0ec40d0c70 2023-10-16T13:47:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ecb602700 1 -- 172.21.15.5:0/940546600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 msgr2=0x7f0ec40cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.985+0000 7f0ecb602700 1 --2- 172.21.15.5:0/940546600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec40cdfd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009840 tx=0x7f0eb4009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.986+0000 7f0ecb602700 1 -- 172.21.15.5:0/940546600 shutdown_connections 2023-10-16T13:47:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.986+0000 7f0ecb602700 1 --2- 172.21.15.5:0/940546600 >> v2:172.21.15.112:3300/0 conn(0x7f0ec415b740 0x7f0ec40d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.986+0000 7f0ecb602700 1 --2- 172.21.15.5:0/940546600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec40cdfd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.986+0000 7f0ecb602700 1 -- 172.21.15.5:0/940546600 >> 172.21.15.5:0/940546600 conn(0x7f0ec40665a0 msgr2=0x7f0ec4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.986+0000 7f0ecb602700 1 -- 172.21.15.5:0/940546600 shutdown_connections 2023-10-16T13:47:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.986+0000 7f0ecb602700 1 -- 172.21.15.5:0/940546600 wait complete. 2023-10-16T13:47:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.987+0000 7f0ecb602700 1 Processor -- start 2023-10-16T13:47:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.987+0000 7f0ecb602700 1 -- start start 2023-10-16T13:47:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.987+0000 7f0ecb602700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 0x7f0ec4159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ecb602700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec41f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ecb602700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ec415b740 0x7f0ec40c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ecb602700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec41595b0 con 0x7f0ec40c5110 2023-10-16T13:47:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ecb602700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40c90a0 con 0x7f0ec415b740 2023-10-16T13:47:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ecb602700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40c95d0 con 0x7f0ec40d0c70 2023-10-16T13:47:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 0x7f0ec4159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 0x7f0ec4159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47762/0 (socket says 172.21.15.5:47762) 2023-10-16T13:47:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 -- 172.21.15.5:0/2574427259 learned_addr learned my addr 172.21.15.5:0/2574427259 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec8b9d700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec41f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec9b9f700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ec415b740 0x7f0ec40c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 -- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 msgr2=0x7f0ec41f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec41f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 -- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ec415b740 msgr2=0x7f0ec40c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ec415b740 0x7f0ec40c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 -- 172.21.15.5:0/2574427259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0009550 con 0x7f0ec40c5110 2023-10-16T13:47:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ec939e700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 0x7f0ec4159740 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000e9b0 tx=0x7f0ec000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000ee50 con 0x7f0ec40c5110 2023-10-16T13:47:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000c850 con 0x7f0ec40c5110 2023-10-16T13:47:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb40094a0 con 0x7f0ec40c5110 2023-10-16T13:47:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.988+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000cbc0 con 0x7f0ec40c5110 2023-10-16T13:47:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.989+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec415e3a0 con 0x7f0ec40c5110 2023-10-16T13:47:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.990+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4067d20 con 0x7f0ec40c5110 2023-10-16T13:47:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.990+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f0ec000cd20 con 0x7f0ec40c5110 2023-10-16T13:47:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.990+0000 7f0eb9ffb700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ea806b1d0 0x7f0ea806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.991+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ec0089940 con 0x7f0ec40c5110 2023-10-16T13:47:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.991+0000 7f0ec8b9d700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ea806b1d0 0x7f0ea806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.991+0000 7f0ec8b9d700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ea806b1d0 0x7f0ea806d690 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4000c00 tx=0x7f0eb4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:52.996+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ec0054730 con 0x7f0ec40c5110 2023-10-16T13:47:53.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.239+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ec415acd0 con 0x7f0ec40c5110 2023-10-16T13:47:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.240+0000 7f0eb9ffb700 1 -- 172.21.15.5:0/2574427259 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f0ec0057d50 con 0x7f0ec40c5110 2023-10-16T13:47:53.243 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:53.243 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:49.207070+0000","modified":"2023-10-16T13:47:52.244374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3043002184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3043002184},{"type":"v1","addr":"172.21.15.5:6834","nonce":3043002184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-16T13:47:53.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ea806b1d0 msgr2=0x7f0ea806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ea806b1d0 0x7f0ea806d690 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4000c00 tx=0x7f0eb4008030 comp rx=0 tx=0).stop 2023-10-16T13:47:53.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 msgr2=0x7f0ec4159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 0x7f0ec4159740 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000e9b0 tx=0x7f0ec000ecc0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 shutdown_connections 2023-10-16T13:47:53.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ec415b740 0x7f0ec40c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec40c5110 0x7f0ec4159740 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ea806b1d0 0x7f0ea806d690 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 --2- 172.21.15.5:0/2574427259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ec40d0c70 0x7f0ec41f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.242+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 >> 172.21.15.5:0/2574427259 conn(0x7f0ec40665a0 msgr2=0x7f0ec40cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:53.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.243+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 shutdown_connections 2023-10-16T13:47:53.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.243+0000 7f0ecb602700 1 -- 172.21.15.5:0/2574427259 wait complete. 2023-10-16T13:47:53.248 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2023-10-16T13:47:53.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:47:53.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.379+0000 7f7d6bf4c700 1 Processor -- start 2023-10-16T13:47:53.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.379+0000 7f7d6bf4c700 1 -- start start 2023-10-16T13:47:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.380+0000 7f7d6bf4c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 0x7f7d640cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.380+0000 7f7d6bf4c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d640b28b0 0x7f7d6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.380+0000 7f7d6bf4c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640b3530 con 0x7f7d6406ad80 2023-10-16T13:47:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.380+0000 7f7d6bf4c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640cde00 con 0x7f7d640b28b0 2023-10-16T13:47:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.380+0000 7f7d6bf4c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6406b1b0 con 0x7f7d6415f130 2023-10-16T13:47:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d640b28b0 0x7f7d6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d69ce8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 0x7f7d640cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d69ce8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 0x7f7d640cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45674/0 (socket says 172.21.15.5:45674) 2023-10-16T13:47:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d640b28b0 0x7f7d6406a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43668/0 (socket says 172.21.15.5:43668) 2023-10-16T13:47:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d69ce8700 1 -- 172.21.15.5:0/1369190696 learned_addr learned my addr 172.21.15.5:0/1369190696 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 -- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 msgr2=0x7f7d640cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 --2- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 0x7f7d640cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 -- 172.21.15.5:0/1369190696 >> v1:172.21.15.112:6789/0 conn(0x7f7d6406ad80 legacy=0x7f7d64071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 -- 172.21.15.5:0/1369190696 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640cd180 con 0x7f7d640b28b0 2023-10-16T13:47:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d69ce8700 1 --2- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 0x7f7d640cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d694e7700 1 --2- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d640b28b0 0x7f7d6406a840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009820 tx=0x7f7d60009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95614df3f9070b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d68ce6700 1 -- 172.21.15.5:0/1369190696 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60005e30 con 0x7f7d640b28b0 2023-10-16T13:47:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d68ce6700 1 -- 172.21.15.5:0/1369190696 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60006030 con 0x7f7d640b28b0 2023-10-16T13:47:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.381+0000 7f7d68ce6700 1 -- 172.21.15.5:0/1369190696 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d600063c0 con 0x7f7d640b28b0 2023-10-16T13:47:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d640b28b0 msgr2=0x7f7d6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d640b28b0 0x7f7d6406a840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009820 tx=0x7f7d60009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/1369190696 shutdown_connections 2023-10-16T13:47:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d6415f130 0x7f7d640cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/1369190696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d640b28b0 0x7f7d6406a840 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/1369190696 >> 172.21.15.5:0/1369190696 conn(0x7f7d6406dae0 msgr2=0x7f7d6406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/1369190696 shutdown_connections 2023-10-16T13:47:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.382+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/1369190696 wait complete. 2023-10-16T13:47:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.383+0000 7f7d6bf4c700 1 Processor -- start 2023-10-16T13:47:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.383+0000 7f7d6bf4c700 1 -- start start 2023-10-16T13:47:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6bf4c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 0x7f7d64156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6bf4c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d640b28b0 0x7f7d640b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6bf4c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d6415f130 0x7f7d640d0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6bf4c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640b4d70 con 0x7f7d6406ad80 2023-10-16T13:47:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6bf4c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640b5050 con 0x7f7d6415f130 2023-10-16T13:47:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6bf4c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640b5330 con 0x7f7d640b28b0 2023-10-16T13:47:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 0x7f7d64156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 0x7f7d64156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47776/0 (socket says 172.21.15.5:47776) 2023-10-16T13:47:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 -- 172.21.15.5:0/3095530193 learned_addr learned my addr 172.21.15.5:0/3095530193 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d694e7700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d640b28b0 0x7f7d640b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d6a4e9700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d6415f130 0x7f7d640d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 -- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d640b28b0 msgr2=0x7f7d640b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d640b28b0 0x7f7d640b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 -- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d6415f130 msgr2=0x7f7d640d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d6415f130 0x7f7d640d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.384+0000 7f7d69ce8700 1 -- 172.21.15.5:0/3095530193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54009550 con 0x7f7d6406ad80 2023-10-16T13:47:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.385+0000 7f7d69ce8700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 0x7f7d64156dc0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400ebe0 tx=0x7f7d54009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.385+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400c8b0 con 0x7f7d6406ad80 2023-10-16T13:47:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.385+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5400ca10 con 0x7f7d6406ad80 2023-10-16T13:47:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.385+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400cd80 con 0x7f7d6406ad80 2023-10-16T13:47:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.385+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d60009430 con 0x7f7d6406ad80 2023-10-16T13:47:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.385+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d640b4940 con 0x7f7d6406ad80 2023-10-16T13:47:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.386+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d640caf20 con 0x7f7d6406ad80 2023-10-16T13:47:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.386+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f7d54013470 con 0x7f7d6406ad80 2023-10-16T13:47:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.387+0000 7f7d5a7fc700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7d4806b1d0 0x7f7d4806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.387+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d54089c90 con 0x7f7d6406ad80 2023-10-16T13:47:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.387+0000 7f7d694e7700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7d4806b1d0 0x7f7d4806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.387+0000 7f7d694e7700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7d4806b1d0 0x7f7d4806d690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d60000c00 tx=0x7f7d60008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.391+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d5408f020 con 0x7f7d6406ad80 2023-10-16T13:47:53.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.593+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d640b5980 con 0x7f7d6406ad80 2023-10-16T13:47:53.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.594+0000 7f7d5a7fc700 1 -- 172.21.15.5:0/3095530193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16436 (secure 0 0 0) 0x7f7d54054970 con 0x7f7d6406ad80 2023-10-16T13:47:53.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:53.597 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:50.785531+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:47:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7d4806b1d0 msgr2=0x7f7d4806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7d4806b1d0 0x7f7d4806d690 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d60000c00 tx=0x7f7d60008070 comp rx=0 tx=0).stop 2023-10-16T13:47:53.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 msgr2=0x7f7d64156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 0x7f7d64156dc0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400ebe0 tx=0x7f7d54009e70 comp rx=0 tx=0).stop 2023-10-16T13:47:53.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 shutdown_connections 2023-10-16T13:47:53.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d6415f130 0x7f7d640d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d6406ad80 0x7f7d64156dc0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7d4806b1d0 0x7f7d4806d690 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 --2- 172.21.15.5:0/3095530193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d640b28b0 0x7f7d640b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 >> 172.21.15.5:0/3095530193 conn(0x7f7d6406dae0 msgr2=0x7f7d640aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 shutdown_connections 2023-10-16T13:47:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.596+0000 7f7d6bf4c700 1 -- 172.21.15.5:0/3095530193 wait complete. 2023-10-16T13:47:53.611 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:47:53.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:47:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.734+0000 7f82c4b73700 1 Processor -- start 2023-10-16T13:47:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.734+0000 7f82c4b73700 1 -- start start 2023-10-16T13:47:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82c4b73700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82c015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82c4b73700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f82c00b1f50 0x7f82c00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82c4b73700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c015e7a0 con 0x7f82c00b23d0 2023-10-16T13:47:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82c4b73700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c015f730 con 0x7f82c00b1f50 2023-10-16T13:47:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82c4b73700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00b29a0 con 0x7f82c015ab10 2023-10-16T13:47:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82bed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82c00b23d0 0x7f82c00cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57792/0 (socket says 172.21.15.5:57792) 2023-10-16T13:47:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82bed9d700 1 -- 172.21.15.5:0/2000474854 learned_addr learned my addr 172.21.15.5:0/2000474854 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82bdd9b700 1 --2- 172.21.15.5:0/2000474854 >> v2:172.21.15.112:3300/0 conn(0x7f82c00b1f50 0x7f82c00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82be59c700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82c015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703988688 0 0) 0x7f82c015e7a0 con 0x7f82c00b23d0 2023-10-16T13:47:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.735+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a80035b0 con 0x7f82c00b23d0 2023-10-16T13:47:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794281300 0 0) 0x7f82a80035b0 con 0x7f82c00b23d0 2023-10-16T13:47:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 msgr2=0x7f82c015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82c015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 >> v2:172.21.15.112:3300/0 conn(0x7f82c00b1f50 msgr2=0x7f82c00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 --2- 172.21.15.5:0/2000474854 >> v2:172.21.15.112:3300/0 conn(0x7f82c00b1f50 0x7f82c00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00b2c80 con 0x7f82c00b23d0 2023-10-16T13:47:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f82b80019f0 con 0x7f82c00b23d0 2023-10-16T13:47:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bdd9b700 1 --2- 172.21.15.5:0/2000474854 >> v2:172.21.15.112:3300/0 conn(0x7f82c00b1f50 0x7f82c00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82be59c700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82c015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 >> v1:172.21.15.5:6789/0 conn(0x7f82c00b23d0 legacy=0x7f82c00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8003a00 0x7f82a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a8004d90 0x7f82a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c015f730 con 0x7f82a8004d90 2023-10-16T13:47:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00b29a0 con 0x7f82a8003a00 2023-10-16T13:47:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a800ba10 con 0x7f82c015ab10 2023-10-16T13:47:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a8004d90 0x7f82a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82be59c700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8003a00 0x7f82a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bdd9b700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 -- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 msgr2=0x7f82a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015ab10 0x7f82a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 -- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8003a00 msgr2=0x7f82a8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8003a00 0x7f82a8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 -- 172.21.15.5:0/2000474854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40094a0 con 0x7f82a8004d90 2023-10-16T13:47:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bed9d700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a8004d90 0x7f82a8005210 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f82b800a860 tx=0x7f82a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1760d9dc517b28df server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8012600 con 0x7f82a8004d90 2023-10-16T13:47:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.736+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8012780 con 0x7f82a8004d90 2023-10-16T13:47:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82bd59a700 1 -- 172.21.15.5:0/2000474854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8012b30 con 0x7f82a8004d90 2023-10-16T13:47:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82c4b73700 1 -- 172.21.15.5:0/2000474854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a8004d90 msgr2=0x7f82a8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2000474854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a8004d90 0x7f82a8005210 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f82b800a860 tx=0x7f82a8005880 comp rx=0 tx=0).stop 2023-10-16T13:47:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82bed9d700 1 -- 172.21.15.5:0/2000474854 reap_dead start 2023-10-16T13:47:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82c4b73700 1 -- 172.21.15.5:0/2000474854 shutdown_connections 2023-10-16T13:47:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82c4b73700 1 -- 172.21.15.5:0/2000474854 >> 172.21.15.5:0/2000474854 conn(0x7f82c006dae0 msgr2=0x7f82c006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82c4b73700 1 -- 172.21.15.5:0/2000474854 shutdown_connections 2023-10-16T13:47:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.737+0000 7f82c4b73700 1 -- 172.21.15.5:0/2000474854 wait complete. 2023-10-16T13:47:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.738+0000 7f82c4b73700 1 Processor -- start 2023-10-16T13:47:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 -- start start 2023-10-16T13:47:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8004d90 0x7f82c01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 0x7f82c00ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015c210 0x7f82c015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00ace30 con 0x7f82c00ad250 2023-10-16T13:47:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c015cbd0 con 0x7f82a8004d90 2023-10-16T13:47:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82c4b73700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0156ef0 con 0x7f82c015c210 2023-10-16T13:47:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82bdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 0x7f82c00ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82bdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 0x7f82c00ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47798/0 (socket says 172.21.15.5:47798) 2023-10-16T13:47:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.739+0000 7f82bdd9b700 1 -- 172.21.15.5:0/2814266154 learned_addr learned my addr 172.21.15.5:0/2814266154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82be59c700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8004d90 0x7f82c01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bed9d700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015c210 0x7f82c015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bdd9b700 1 -- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015c210 msgr2=0x7f82c015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bdd9b700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015c210 0x7f82c015c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bdd9b700 1 -- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8004d90 msgr2=0x7f82c01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bdd9b700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8004d90 0x7f82c01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bdd9b700 1 -- 172.21.15.5:0/2814266154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00b49e0 con 0x7f82c00ad250 2023-10-16T13:47:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82be59c700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8004d90 0x7f82c01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82bdd9b700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 0x7f82c00ad6d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f82b0011cd0 tx=0x7f82b000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0011e70 con 0x7f82c00ad250 2023-10-16T13:47:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b000fd40 con 0x7f82c00ad250 2023-10-16T13:47:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c00b3b40 con 0x7f82c00ad250 2023-10-16T13:47:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0004240 con 0x7f82c00ad250 2023-10-16T13:47:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.740+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c00aca50 con 0x7f82c00ad250 2023-10-16T13:47:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.741+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c00ac8b0 con 0x7f82c00ad250 2023-10-16T13:47:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.742+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f82b00043a0 con 0x7f82c00ad250 2023-10-16T13:47:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.742+0000 7f82aeffd700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82a006b1d0 0x7f82a006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.742+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82b008a130 con 0x7f82c00ad250 2023-10-16T13:47:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.742+0000 7f82be59c700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82a006b1d0 0x7f82a006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.743+0000 7f82be59c700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82a006b1d0 0x7f82a006d690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009df0 tx=0x7f82b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.747+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82c00ac8b0 con 0x7f82c00ad250 2023-10-16T13:47:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.942+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82c015ecd0 con 0x7f82a006b1d0 2023-10-16T13:47:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.951+0000 7f82aeffd700 1 -- 172.21.15.5:0/2814266154 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289678 (secure 0 0 0) 0x7f82b4009a40 con 0x7f82a006b1d0 2023-10-16T13:47:53.957 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82a006b1d0 msgr2=0x7f82a006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82a006b1d0 0x7f82a006d690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009df0 tx=0x7f82b4008040 comp rx=0 tx=0).stop 2023-10-16T13:47:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 msgr2=0x7f82c00ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 0x7f82c00ad6d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f82b0011cd0 tx=0x7f82b000f520 comp rx=0 tx=0).stop 2023-10-16T13:47:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 shutdown_connections 2023-10-16T13:47:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82a006b1d0 0x7f82a006d690 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c015c210 0x7f82c015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82a8004d90 0x7f82c01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 --2- 172.21.15.5:0/2814266154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c00ad250 0x7f82c00ad6d0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 >> 172.21.15.5:0/2814266154 conn(0x7f82c006dae0 msgr2=0x7f82c00cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 shutdown_connections 2023-10-16T13:47:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:53.954+0000 7f82c4b73700 1 -- 172.21.15.5:0/2814266154 wait complete. 2023-10-16T13:47:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:47:53.969 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2023-10-16T13:47:53.602287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259100,"kb_used_data":9632,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715620,"statfs":{"total":773094113280,"available":772828794880,"internally_reserved":0,"allocated":9863168,"data_stored":4920774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824340"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501515+0000","last_change":"2023-10-16T13:47:49.803911+0000","last_active":"2023-10-16T13:47:51.501515+0000","last_peered":"2023-10-16T13:47:51.501515+0000","last_clean":"2023-10-16T13:47:51.501515+0000","last_became_active":"2023-10-16T13:47:49.803378+0000","last_became_peered":"2023-10-16T13:47:49.803378+0000","last_unstale":"2023-10-16T13:47:51.501515+0000","last_undegraded":"2023-10-16T13:47:51.501515+0000","last_fullsized":"2023-10-16T13:47:51.501515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:01.855567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937311+0000","last_change":"2023-10-16T13:47:49.806218+0000","last_active":"2023-10-16T13:47:50.937311+0000","last_peered":"2023-10-16T13:47:50.937311+0000","last_clean":"2023-10-16T13:47:50.937311+0000","last_became_active":"2023-10-16T13:47:49.805496+0000","last_became_peered":"2023-10-16T13:47:49.805496+0000","last_unstale":"2023-10-16T13:47:50.937311+0000","last_undegraded":"2023-10-16T13:47:50.937311+0000","last_fullsized":"2023-10-16T13:47:50.937311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:56.823933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501603+0000","last_change":"2023-10-16T13:47:49.804447+0000","last_active":"2023-10-16T13:47:51.501603+0000","last_peered":"2023-10-16T13:47:51.501603+0000","last_clean":"2023-10-16T13:47:51.501603+0000","last_became_active":"2023-10-16T13:47:49.803634+0000","last_became_peered":"2023-10-16T13:47:49.803634+0000","last_unstale":"2023-10-16T13:47:51.501603+0000","last_undegraded":"2023-10-16T13:47:51.501603+0000","last_fullsized":"2023-10-16T13:47:51.501603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:39:42.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501953+0000","last_change":"2023-10-16T13:47:49.798961+0000","last_active":"2023-10-16T13:47:51.501953+0000","last_peered":"2023-10-16T13:47:51.501953+0000","last_clean":"2023-10-16T13:47:51.501953+0000","last_became_active":"2023-10-16T13:47:49.797051+0000","last_became_peered":"2023-10-16T13:47:49.797051+0000","last_unstale":"2023-10-16T13:47:51.501953+0000","last_undegraded":"2023-10-16T13:47:51.501953+0000","last_fullsized":"2023-10-16T13:47:51.501953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:14:47.697282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501235+0000","last_change":"2023-10-16T13:47:49.798571+0000","last_active":"2023-10-16T13:47:51.501235+0000","last_peered":"2023-10-16T13:47:51.501235+0000","last_clean":"2023-10-16T13:47:51.501235+0000","last_became_active":"2023-10-16T13:47:49.798301+0000","last_became_peered":"2023-10-16T13:47:49.798301+0000","last_unstale":"2023-10-16T13:47:51.501235+0000","last_undegraded":"2023-10-16T13:47:51.501235+0000","last_fullsized":"2023-10-16T13:47:51.501235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:14.572042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790758+0000","last_change":"2023-10-16T13:47:49.800260+0000","last_active":"2023-10-16T13:47:50.790758+0000","last_peered":"2023-10-16T13:47:50.790758+0000","last_clean":"2023-10-16T13:47:50.790758+0000","last_became_active":"2023-10-16T13:47:49.799973+0000","last_became_peered":"2023-10-16T13:47:49.799973+0000","last_unstale":"2023-10-16T13:47:50.790758+0000","last_undegraded":"2023-10-16T13:47:50.790758+0000","last_fullsized":"2023-10-16T13:47:50.790758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:21.199634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790557+0000","last_change":"2023-10-16T13:47:49.798472+0000","last_active":"2023-10-16T13:47:50.790557+0000","last_peered":"2023-10-16T13:47:50.790557+0000","last_clean":"2023-10-16T13:47:50.790557+0000","last_became_active":"2023-10-16T13:47:49.798178+0000","last_became_peered":"2023-10-16T13:47:49.798178+0000","last_unstale":"2023-10-16T13:47:50.790557+0000","last_undegraded":"2023-10-16T13:47:50.790557+0000","last_fullsized":"2023-10-16T13:47:50.790557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:19.990204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937159+0000","last_change":"2023-10-16T13:47:49.810190+0000","last_active":"2023-10-16T13:47:50.937159+0000","last_peered":"2023-10-16T13:47:50.937159+0000","last_clean":"2023-10-16T13:47:50.937159+0000","last_became_active":"2023-10-16T13:47:49.809920+0000","last_became_peered":"2023-10-16T13:47:49.809920+0000","last_unstale":"2023-10-16T13:47:50.937159+0000","last_undegraded":"2023-10-16T13:47:50.937159+0000","last_fullsized":"2023-10-16T13:47:50.937159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:47.472912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794518+0000","last_change":"2023-10-16T13:47:49.802576+0000","last_active":"2023-10-16T13:47:50.794518+0000","last_peered":"2023-10-16T13:47:50.794518+0000","last_clean":"2023-10-16T13:47:50.794518+0000","last_became_active":"2023-10-16T13:47:49.802284+0000","last_became_peered":"2023-10-16T13:47:49.802284+0000","last_unstale":"2023-10-16T13:47:50.794518+0000","last_undegraded":"2023-10-16T13:47:50.794518+0000","last_fullsized":"2023-10-16T13:47:50.794518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:59.587598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501532+0000","last_change":"2023-10-16T13:47:49.809335+0000","last_active":"2023-10-16T13:47:51.501532+0000","last_peered":"2023-10-16T13:47:51.501532+0000","last_clean":"2023-10-16T13:47:51.501532+0000","last_became_active":"2023-10-16T13:47:49.809025+0000","last_became_peered":"2023-10-16T13:47:49.809025+0000","last_unstale":"2023-10-16T13:47:51.501532+0000","last_undegraded":"2023-10-16T13:47:51.501532+0000","last_fullsized":"2023-10-16T13:47:51.501532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:39:42.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790774+0000","last_change":"2023-10-16T13:47:49.806423+0000","last_active":"2023-10-16T13:47:50.790774+0000","last_peered":"2023-10-16T13:47:50.790774+0000","last_clean":"2023-10-16T13:47:50.790774+0000","last_became_active":"2023-10-16T13:47:49.805837+0000","last_became_peered":"2023-10-16T13:47:49.805837+0000","last_unstale":"2023-10-16T13:47:50.790774+0000","last_undegraded":"2023-10-16T13:47:50.790774+0000","last_fullsized":"2023-10-16T13:47:50.790774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:14.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794421+0000","last_change":"2023-10-16T13:47:49.808452+0000","last_active":"2023-10-16T13:47:50.794421+0000","last_peered":"2023-10-16T13:47:50.794421+0000","last_clean":"2023-10-16T13:47:50.794421+0000","last_became_active":"2023-10-16T13:47:49.808170+0000","last_became_peered":"2023-10-16T13:47:49.808170+0000","last_unstale":"2023-10-16T13:47:50.794421+0000","last_undegraded":"2023-10-16T13:47:50.794421+0000","last_fullsized":"2023-10-16T13:47:50.794421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:03.227713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501439+0000","last_change":"2023-10-16T13:47:49.802672+0000","last_active":"2023-10-16T13:47:51.501439+0000","last_peered":"2023-10-16T13:47:51.501439+0000","last_clean":"2023-10-16T13:47:51.501439+0000","last_became_active":"2023-10-16T13:47:49.802403+0000","last_became_peered":"2023-10-16T13:47:49.802403+0000","last_unstale":"2023-10-16T13:47:51.501439+0000","last_undegraded":"2023-10-16T13:47:51.501439+0000","last_fullsized":"2023-10-16T13:47:51.501439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:14.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493129+0000","last_change":"2023-10-16T13:47:49.801212+0000","last_active":"2023-10-16T13:47:51.493129+0000","last_peered":"2023-10-16T13:47:51.493129+0000","last_clean":"2023-10-16T13:47:51.493129+0000","last_became_active":"2023-10-16T13:47:49.800728+0000","last_became_peered":"2023-10-16T13:47:49.800728+0000","last_unstale":"2023-10-16T13:47:51.493129+0000","last_undegraded":"2023-10-16T13:47:51.493129+0000","last_fullsized":"2023-10-16T13:47:51.493129+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:14.935563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500883+0000","last_change":"2023-10-16T13:47:49.807307+0000","last_active":"2023-10-16T13:47:51.500883+0000","last_peered":"2023-10-16T13:47:51.500883+0000","last_clean":"2023-10-16T13:47:51.500883+0000","last_became_active":"2023-10-16T13:47:49.807026+0000","last_became_peered":"2023-10-16T13:47:49.807026+0000","last_unstale":"2023-10-16T13:47:51.500883+0000","last_undegraded":"2023-10-16T13:47:51.500883+0000","last_fullsized":"2023-10-16T13:47:51.500883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:19.990204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790583+0000","last_change":"2023-10-16T13:47:49.807524+0000","last_active":"2023-10-16T13:47:50.790583+0000","last_peered":"2023-10-16T13:47:50.790583+0000","last_clean":"2023-10-16T13:47:50.790583+0000","last_became_active":"2023-10-16T13:47:49.806733+0000","last_became_peered":"2023-10-16T13:47:49.806733+0000","last_unstale":"2023-10-16T13:47:50.790583+0000","last_undegraded":"2023-10-16T13:47:50.790583+0000","last_fullsized":"2023-10-16T13:47:50.790583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.948019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937409+0000","last_change":"2023-10-16T13:47:49.801917+0000","last_active":"2023-10-16T13:47:50.937409+0000","last_peered":"2023-10-16T13:47:50.937409+0000","last_clean":"2023-10-16T13:47:50.937409+0000","last_became_active":"2023-10-16T13:47:49.801632+0000","last_became_peered":"2023-10-16T13:47:49.801632+0000","last_unstale":"2023-10-16T13:47:50.937409+0000","last_undegraded":"2023-10-16T13:47:50.937409+0000","last_fullsized":"2023-10-16T13:47:50.937409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:42.431214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501695+0000","last_change":"2023-10-16T13:47:49.796375+0000","last_active":"2023-10-16T13:47:51.501695+0000","last_peered":"2023-10-16T13:47:51.501695+0000","last_clean":"2023-10-16T13:47:51.501695+0000","last_became_active":"2023-10-16T13:47:49.796102+0000","last_became_peered":"2023-10-16T13:47:49.796102+0000","last_unstale":"2023-10-16T13:47:51.501695+0000","last_undegraded":"2023-10-16T13:47:51.501695+0000","last_fullsized":"2023-10-16T13:47:51.501695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:36.808687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493406+0000","last_change":"2023-10-16T13:47:49.807110+0000","last_active":"2023-10-16T13:47:51.493406+0000","last_peered":"2023-10-16T13:47:51.493406+0000","last_clean":"2023-10-16T13:47:51.493406+0000","last_became_active":"2023-10-16T13:47:49.806788+0000","last_became_peered":"2023-10-16T13:47:49.806788+0000","last_unstale":"2023-10-16T13:47:51.493406+0000","last_undegraded":"2023-10-16T13:47:51.493406+0000","last_fullsized":"2023-10-16T13:47:51.493406+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:18.872132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794584+0000","last_change":"2023-10-16T13:47:49.803607+0000","last_active":"2023-10-16T13:47:50.794584+0000","last_peered":"2023-10-16T13:47:50.794584+0000","last_clean":"2023-10-16T13:47:50.794584+0000","last_became_active":"2023-10-16T13:47:49.803297+0000","last_became_peered":"2023-10-16T13:47:49.803297+0000","last_unstale":"2023-10-16T13:47:50.794584+0000","last_undegraded":"2023-10-16T13:47:50.794584+0000","last_fullsized":"2023-10-16T13:47:50.794584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:28.884942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493595+0000","last_change":"2023-10-16T13:47:49.798299+0000","last_active":"2023-10-16T13:47:51.493595+0000","last_peered":"2023-10-16T13:47:51.493595+0000","last_clean":"2023-10-16T13:47:51.493595+0000","last_became_active":"2023-10-16T13:47:49.798020+0000","last_became_peered":"2023-10-16T13:47:49.798020+0000","last_unstale":"2023-10-16T13:47:51.493595+0000","last_undegraded":"2023-10-16T13:47:51.493595+0000","last_fullsized":"2023-10-16T13:47:51.493595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:39:58.747420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937062+0000","last_change":"2023-10-16T13:47:49.801569+0000","last_active":"2023-10-16T13:47:50.937062+0000","last_peered":"2023-10-16T13:47:50.937062+0000","last_clean":"2023-10-16T13:47:50.937062+0000","last_became_active":"2023-10-16T13:47:49.801243+0000","last_became_peered":"2023-10-16T13:47:49.801243+0000","last_unstale":"2023-10-16T13:47:50.937062+0000","last_undegraded":"2023-10-16T13:47:50.937062+0000","last_fullsized":"2023-10-16T13:47:50.937062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:32:43.084289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937064+0000","last_change":"2023-10-16T13:47:49.803430+0000","last_active":"2023-10-16T13:47:50.937064+0000","last_peered":"2023-10-16T13:47:50.937064+0000","last_clean":"2023-10-16T13:47:50.937064+0000","last_became_active":"2023-10-16T13:47:49.803127+0000","last_became_peered":"2023-10-16T13:47:49.803127+0000","last_unstale":"2023-10-16T13:47:50.937064+0000","last_undegraded":"2023-10-16T13:47:50.937064+0000","last_fullsized":"2023-10-16T13:47:50.937064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:44:54.885779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790752+0000","last_change":"2023-10-16T13:47:49.808270+0000","last_active":"2023-10-16T13:47:50.790752+0000","last_peered":"2023-10-16T13:47:50.790752+0000","last_clean":"2023-10-16T13:47:50.790752+0000","last_became_active":"2023-10-16T13:47:49.808067+0000","last_became_peered":"2023-10-16T13:47:49.808067+0000","last_unstale":"2023-10-16T13:47:50.790752+0000","last_undegraded":"2023-10-16T13:47:50.790752+0000","last_fullsized":"2023-10-16T13:47:50.790752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:36.808687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501536+0000","last_change":"2023-10-16T13:47:49.801396+0000","last_active":"2023-10-16T13:47:51.501536+0000","last_peered":"2023-10-16T13:47:51.501536+0000","last_clean":"2023-10-16T13:47:51.501536+0000","last_became_active":"2023-10-16T13:47:49.801173+0000","last_became_peered":"2023-10-16T13:47:49.801173+0000","last_unstale":"2023-10-16T13:47:51.501536+0000","last_undegraded":"2023-10-16T13:47:51.501536+0000","last_fullsized":"2023-10-16T13:47:51.501536+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:37.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937476+0000","last_change":"2023-10-16T13:47:49.810260+0000","last_active":"2023-10-16T13:47:50.937476+0000","last_peered":"2023-10-16T13:47:50.937476+0000","last_clean":"2023-10-16T13:47:50.937476+0000","last_became_active":"2023-10-16T13:47:49.808154+0000","last_became_peered":"2023-10-16T13:47:49.808154+0000","last_unstale":"2023-10-16T13:47:50.937476+0000","last_undegraded":"2023-10-16T13:47:50.937476+0000","last_fullsized":"2023-10-16T13:47:50.937476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:30:33.792878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.791097+0000","last_change":"2023-10-16T13:47:49.801860+0000","last_active":"2023-10-16T13:47:50.791097+0000","last_peered":"2023-10-16T13:47:50.791097+0000","last_clean":"2023-10-16T13:47:50.791097+0000","last_became_active":"2023-10-16T13:47:49.801408+0000","last_became_peered":"2023-10-16T13:47:49.801408+0000","last_unstale":"2023-10-16T13:47:50.791097+0000","last_undegraded":"2023-10-16T13:47:50.791097+0000","last_fullsized":"2023-10-16T13:47:50.791097+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:30.530890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501351+0000","last_change":"2023-10-16T13:47:49.803507+0000","last_active":"2023-10-16T13:47:51.501351+0000","last_peered":"2023-10-16T13:47:51.501351+0000","last_clean":"2023-10-16T13:47:51.501351+0000","last_became_active":"2023-10-16T13:47:49.803184+0000","last_became_peered":"2023-10-16T13:47:49.803184+0000","last_unstale":"2023-10-16T13:47:51.501351+0000","last_undegraded":"2023-10-16T13:47:51.501351+0000","last_fullsized":"2023-10-16T13:47:51.501351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:41.734461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937144+0000","last_change":"2023-10-16T13:47:49.810036+0000","last_active":"2023-10-16T13:47:50.937144+0000","last_peered":"2023-10-16T13:47:50.937144+0000","last_clean":"2023-10-16T13:47:50.937144+0000","last_became_active":"2023-10-16T13:47:49.808055+0000","last_became_peered":"2023-10-16T13:47:49.808055+0000","last_unstale":"2023-10-16T13:47:50.937144+0000","last_undegraded":"2023-10-16T13:47:50.937144+0000","last_fullsized":"2023-10-16T13:47:50.937144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:15.460783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493125+0000","last_change":"2023-10-16T13:47:49.807175+0000","last_active":"2023-10-16T13:47:51.493125+0000","last_peered":"2023-10-16T13:47:51.493125+0000","last_clean":"2023-10-16T13:47:51.493125+0000","last_became_active":"2023-10-16T13:47:49.806853+0000","last_became_peered":"2023-10-16T13:47:49.806853+0000","last_unstale":"2023-10-16T13:47:51.493125+0000","last_undegraded":"2023-10-16T13:47:51.493125+0000","last_fullsized":"2023-10-16T13:47:51.493125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:09:47.891600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500901+0000","last_change":"2023-10-16T13:47:49.799923+0000","last_active":"2023-10-16T13:47:51.500901+0000","last_peered":"2023-10-16T13:47:51.500901+0000","last_clean":"2023-10-16T13:47:51.500901+0000","last_became_active":"2023-10-16T13:47:49.799459+0000","last_became_peered":"2023-10-16T13:47:49.799459+0000","last_unstale":"2023-10-16T13:47:51.500901+0000","last_undegraded":"2023-10-16T13:47:51.500901+0000","last_fullsized":"2023-10-16T13:47:51.500901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.948019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500956+0000","last_change":"2023-10-16T13:47:49.804962+0000","last_active":"2023-10-16T13:47:51.500956+0000","last_peered":"2023-10-16T13:47:51.500956+0000","last_clean":"2023-10-16T13:47:51.500956+0000","last_became_active":"2023-10-16T13:47:49.804715+0000","last_became_peered":"2023-10-16T13:47:49.804715+0000","last_unstale":"2023-10-16T13:47:51.500956+0000","last_undegraded":"2023-10-16T13:47:51.500956+0000","last_fullsized":"2023-10-16T13:47:51.500956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:37.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493559+0000","last_change":"2023-10-16T13:47:49.802536+0000","last_active":"2023-10-16T13:47:51.493559+0000","last_peered":"2023-10-16T13:47:51.493559+0000","last_clean":"2023-10-16T13:47:51.493559+0000","last_became_active":"2023-10-16T13:47:49.802244+0000","last_became_peered":"2023-10-16T13:47:49.802244+0000","last_unstale":"2023-10-16T13:47:51.493559+0000","last_undegraded":"2023-10-16T13:47:51.493559+0000","last_fullsized":"2023-10-16T13:47:51.493559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:41.677401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.824052+0000","last_change":"2023-10-16T13:47:48.800616+0000","last_active":"2023-10-16T13:47:49.824052+0000","last_peered":"2023-10-16T13:47:49.824052+0000","last_clean":"2023-10-16T13:47:49.824052+0000","last_became_active":"2023-10-16T13:47:48.800335+0000","last_became_peered":"2023-10-16T13:47:48.800335+0000","last_unstale":"2023-10-16T13:47:49.824052+0000","last_undegraded":"2023-10-16T13:47:49.824052+0000","last_fullsized":"2023-10-16T13:47:49.824052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:44.591856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501784+0000","last_change":"2023-10-16T13:47:49.803932+0000","last_active":"2023-10-16T13:47:51.501784+0000","last_peered":"2023-10-16T13:47:51.501784+0000","last_clean":"2023-10-16T13:47:51.501784+0000","last_became_active":"2023-10-16T13:47:49.803579+0000","last_became_peered":"2023-10-16T13:47:49.803579+0000","last_unstale":"2023-10-16T13:47:51.501784+0000","last_undegraded":"2023-10-16T13:47:51.501784+0000","last_fullsized":"2023-10-16T13:47:51.501784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:21.199634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821703+0000","last_change":"2023-10-16T13:47:48.803795+0000","last_active":"2023-10-16T13:47:49.821703+0000","last_peered":"2023-10-16T13:47:49.821703+0000","last_clean":"2023-10-16T13:47:49.821703+0000","last_became_active":"2023-10-16T13:47:48.803564+0000","last_became_peered":"2023-10-16T13:47:48.803564+0000","last_unstale":"2023-10-16T13:47:49.821703+0000","last_undegraded":"2023-10-16T13:47:49.821703+0000","last_fullsized":"2023-10-16T13:47:49.821703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:55.819398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.502126+0000","last_change":"2023-10-16T13:47:49.805736+0000","last_active":"2023-10-16T13:47:51.502126+0000","last_peered":"2023-10-16T13:47:51.502126+0000","last_clean":"2023-10-16T13:47:51.502126+0000","last_became_active":"2023-10-16T13:47:49.805435+0000","last_became_peered":"2023-10-16T13:47:49.805435+0000","last_unstale":"2023-10-16T13:47:51.502126+0000","last_undegraded":"2023-10-16T13:47:51.502126+0000","last_fullsized":"2023-10-16T13:47:51.502126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:27.903739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821434+0000","last_change":"2023-10-16T13:47:48.806674+0000","last_active":"2023-10-16T13:47:49.821434+0000","last_peered":"2023-10-16T13:47:49.821434+0000","last_clean":"2023-10-16T13:47:49.821434+0000","last_became_active":"2023-10-16T13:47:48.806393+0000","last_became_peered":"2023-10-16T13:47:48.806393+0000","last_unstale":"2023-10-16T13:47:49.821434+0000","last_undegraded":"2023-10-16T13:47:49.821434+0000","last_fullsized":"2023-10-16T13:47:49.821434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:02:19.799263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794503+0000","last_change":"2023-10-16T13:47:49.806266+0000","last_active":"2023-10-16T13:47:50.794503+0000","last_peered":"2023-10-16T13:47:50.794503+0000","last_clean":"2023-10-16T13:47:50.794503+0000","last_became_active":"2023-10-16T13:47:49.805898+0000","last_became_peered":"2023-10-16T13:47:49.805898+0000","last_unstale":"2023-10-16T13:47:50.794503+0000","last_undegraded":"2023-10-16T13:47:50.794503+0000","last_fullsized":"2023-10-16T13:47:50.794503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:35.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.824746+0000","last_change":"2023-10-16T13:47:48.799974+0000","last_active":"2023-10-16T13:47:49.824746+0000","last_peered":"2023-10-16T13:47:49.824746+0000","last_clean":"2023-10-16T13:47:49.824746+0000","last_became_active":"2023-10-16T13:47:48.799492+0000","last_became_peered":"2023-10-16T13:47:48.799492+0000","last_unstale":"2023-10-16T13:47:49.824746+0000","last_undegraded":"2023-10-16T13:47:49.824746+0000","last_fullsized":"2023-10-16T13:47:49.824746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:34.621759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.791657+0000","last_change":"2023-10-16T13:47:49.808008+0000","last_active":"2023-10-16T13:47:50.791657+0000","last_peered":"2023-10-16T13:47:50.791657+0000","last_clean":"2023-10-16T13:47:50.791657+0000","last_became_active":"2023-10-16T13:47:49.807697+0000","last_became_peered":"2023-10-16T13:47:49.807697+0000","last_unstale":"2023-10-16T13:47:50.791657+0000","last_undegraded":"2023-10-16T13:47:50.791657+0000","last_fullsized":"2023-10-16T13:47:50.791657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:14.572042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.820570+0000","last_change":"2023-10-16T13:47:48.798897+0000","last_active":"2023-10-16T13:47:49.820570+0000","last_peered":"2023-10-16T13:47:49.820570+0000","last_clean":"2023-10-16T13:47:49.820570+0000","last_became_active":"2023-10-16T13:47:48.798598+0000","last_became_peered":"2023-10-16T13:47:48.798598+0000","last_unstale":"2023-10-16T13:47:49.820570+0000","last_undegraded":"2023-10-16T13:47:49.820570+0000","last_fullsized":"2023-10-16T13:47:49.820570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:08.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790753+0000","last_change":"2023-10-16T13:47:49.798764+0000","last_active":"2023-10-16T13:47:50.790753+0000","last_peered":"2023-10-16T13:47:50.790753+0000","last_clean":"2023-10-16T13:47:50.790753+0000","last_became_active":"2023-10-16T13:47:49.798572+0000","last_became_peered":"2023-10-16T13:47:49.798572+0000","last_unstale":"2023-10-16T13:47:50.790753+0000","last_undegraded":"2023-10-16T13:47:50.790753+0000","last_fullsized":"2023-10-16T13:47:50.790753+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:41.963167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821308+0000","last_change":"2023-10-16T13:47:48.799525+0000","last_active":"2023-10-16T13:47:49.821308+0000","last_peered":"2023-10-16T13:47:49.821308+0000","last_clean":"2023-10-16T13:47:49.821308+0000","last_became_active":"2023-10-16T13:47:48.799229+0000","last_became_peered":"2023-10-16T13:47:48.799229+0000","last_unstale":"2023-10-16T13:47:49.821308+0000","last_undegraded":"2023-10-16T13:47:49.821308+0000","last_fullsized":"2023-10-16T13:47:49.821308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:23.837529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500840+0000","last_change":"2023-10-16T13:47:49.807231+0000","last_active":"2023-10-16T13:47:51.500840+0000","last_peered":"2023-10-16T13:47:51.500840+0000","last_clean":"2023-10-16T13:47:51.500840+0000","last_became_active":"2023-10-16T13:47:49.806940+0000","last_became_peered":"2023-10-16T13:47:49.806940+0000","last_unstale":"2023-10-16T13:47:51.500840+0000","last_undegraded":"2023-10-16T13:47:51.500840+0000","last_fullsized":"2023-10-16T13:47:51.500840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:28.884942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.799541+0000","last_change":"2023-10-16T13:47:48.799937+0000","last_active":"2023-10-16T13:47:49.799541+0000","last_peered":"2023-10-16T13:47:49.799541+0000","last_clean":"2023-10-16T13:47:49.799541+0000","last_became_active":"2023-10-16T13:47:48.799610+0000","last_became_peered":"2023-10-16T13:47:48.799610+0000","last_unstale":"2023-10-16T13:47:49.799541+0000","last_undegraded":"2023-10-16T13:47:49.799541+0000","last_fullsized":"2023-10-16T13:47:49.799541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:14:09.486864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794366+0000","last_change":"2023-10-16T13:47:49.805749+0000","last_active":"2023-10-16T13:47:50.794366+0000","last_peered":"2023-10-16T13:47:50.794366+0000","last_clean":"2023-10-16T13:47:50.794366+0000","last_became_active":"2023-10-16T13:47:49.805428+0000","last_became_peered":"2023-10-16T13:47:49.805428+0000","last_unstale":"2023-10-16T13:47:50.794366+0000","last_undegraded":"2023-10-16T13:47:50.794366+0000","last_fullsized":"2023-10-16T13:47:50.794366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:30:33.792878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.791118+0000","last_change":"2023-10-16T13:47:48.801927+0000","last_active":"2023-10-16T13:47:49.791118+0000","last_peered":"2023-10-16T13:47:49.791118+0000","last_clean":"2023-10-16T13:47:49.791118+0000","last_became_active":"2023-10-16T13:47:48.801555+0000","last_became_peered":"2023-10-16T13:47:48.801555+0000","last_unstale":"2023-10-16T13:47:49.791118+0000","last_undegraded":"2023-10-16T13:47:49.791118+0000","last_fullsized":"2023-10-16T13:47:49.791118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:41.269396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937563+0000","last_change":"2023-10-16T13:47:49.806377+0000","last_active":"2023-10-16T13:47:50.937563+0000","last_peered":"2023-10-16T13:47:50.937563+0000","last_clean":"2023-10-16T13:47:50.937563+0000","last_became_active":"2023-10-16T13:47:49.806029+0000","last_became_peered":"2023-10-16T13:47:49.806029+0000","last_unstale":"2023-10-16T13:47:50.937563+0000","last_undegraded":"2023-10-16T13:47:50.937563+0000","last_fullsized":"2023-10-16T13:47:50.937563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:35.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.793424+0000","last_change":"2023-10-16T13:47:48.795272+0000","last_active":"2023-10-16T13:47:49.793424+0000","last_peered":"2023-10-16T13:47:49.793424+0000","last_clean":"2023-10-16T13:47:49.793424+0000","last_became_active":"2023-10-16T13:47:48.795023+0000","last_became_peered":"2023-10-16T13:47:48.795023+0000","last_unstale":"2023-10-16T13:47:49.793424+0000","last_undegraded":"2023-10-16T13:47:49.793424+0000","last_fullsized":"2023-10-16T13:47:49.793424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:40.729925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794544+0000","last_change":"2023-10-16T13:47:49.805849+0000","last_active":"2023-10-16T13:47:50.794544+0000","last_peered":"2023-10-16T13:47:50.794544+0000","last_clean":"2023-10-16T13:47:50.794544+0000","last_became_active":"2023-10-16T13:47:49.805546+0000","last_became_peered":"2023-10-16T13:47:49.805546+0000","last_unstale":"2023-10-16T13:47:50.794544+0000","last_undegraded":"2023-10-16T13:47:50.794544+0000","last_fullsized":"2023-10-16T13:47:50.794544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:00.201629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.791804+0000","last_change":"2023-10-16T13:47:48.807772+0000","last_active":"2023-10-16T13:47:49.791804+0000","last_peered":"2023-10-16T13:47:49.791804+0000","last_clean":"2023-10-16T13:47:49.791804+0000","last_became_active":"2023-10-16T13:47:48.807493+0000","last_became_peered":"2023-10-16T13:47:48.807493+0000","last_unstale":"2023-10-16T13:47:49.791804+0000","last_undegraded":"2023-10-16T13:47:49.791804+0000","last_fullsized":"2023-10-16T13:47:49.791804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:58.583062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501516+0000","last_change":"2023-10-16T13:47:49.801870+0000","last_active":"2023-10-16T13:47:51.501516+0000","last_peered":"2023-10-16T13:47:51.501516+0000","last_clean":"2023-10-16T13:47:51.501516+0000","last_became_active":"2023-10-16T13:47:49.801140+0000","last_became_peered":"2023-10-16T13:47:49.801140+0000","last_unstale":"2023-10-16T13:47:51.501516+0000","last_undegraded":"2023-10-16T13:47:51.501516+0000","last_fullsized":"2023-10-16T13:47:51.501516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:01.855567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823857+0000","last_change":"2023-10-16T13:47:48.799794+0000","last_active":"2023-10-16T13:47:49.823857+0000","last_peered":"2023-10-16T13:47:49.823857+0000","last_clean":"2023-10-16T13:47:49.823857+0000","last_became_active":"2023-10-16T13:47:48.799518+0000","last_became_peered":"2023-10-16T13:47:48.799518+0000","last_unstale":"2023-10-16T13:47:49.823857+0000","last_undegraded":"2023-10-16T13:47:49.823857+0000","last_fullsized":"2023-10-16T13:47:49.823857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:59.197094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790870+0000","last_change":"2023-10-16T13:47:49.805553+0000","last_active":"2023-10-16T13:47:50.790870+0000","last_peered":"2023-10-16T13:47:50.790870+0000","last_clean":"2023-10-16T13:47:50.790870+0000","last_became_active":"2023-10-16T13:47:49.802109+0000","last_became_peered":"2023-10-16T13:47:49.802109+0000","last_unstale":"2023-10-16T13:47:50.790870+0000","last_undegraded":"2023-10-16T13:47:50.790870+0000","last_fullsized":"2023-10-16T13:47:50.790870+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:14:47.697282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.825924+0000","last_change":"2023-10-16T13:47:48.801509+0000","last_active":"2023-10-16T13:47:49.825924+0000","last_peered":"2023-10-16T13:47:49.825924+0000","last_clean":"2023-10-16T13:47:49.825924+0000","last_became_active":"2023-10-16T13:47:48.801203+0000","last_became_peered":"2023-10-16T13:47:48.801203+0000","last_unstale":"2023-10-16T13:47:49.825924+0000","last_undegraded":"2023-10-16T13:47:49.825924+0000","last_fullsized":"2023-10-16T13:47:49.825924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:46.468376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501375+0000","last_change":"2023-10-16T13:47:49.801910+0000","last_active":"2023-10-16T13:47:51.501375+0000","last_peered":"2023-10-16T13:47:51.501375+0000","last_clean":"2023-10-16T13:47:51.501375+0000","last_became_active":"2023-10-16T13:47:49.801637+0000","last_became_peered":"2023-10-16T13:47:49.801637+0000","last_unstale":"2023-10-16T13:47:51.501375+0000","last_undegraded":"2023-10-16T13:47:51.501375+0000","last_fullsized":"2023-10-16T13:47:51.501375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:41.963167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.824158+0000","last_change":"2023-10-16T13:47:48.804978+0000","last_active":"2023-10-16T13:47:49.824158+0000","last_peered":"2023-10-16T13:47:49.824158+0000","last_clean":"2023-10-16T13:47:49.824158+0000","last_became_active":"2023-10-16T13:47:48.803846+0000","last_became_peered":"2023-10-16T13:47:48.803846+0000","last_unstale":"2023-10-16T13:47:49.824158+0000","last_undegraded":"2023-10-16T13:47:49.824158+0000","last_fullsized":"2023-10-16T13:47:49.824158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:54.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501783+0000","last_change":"2023-10-16T13:47:49.806419+0000","last_active":"2023-10-16T13:47:51.501783+0000","last_peered":"2023-10-16T13:47:51.501783+0000","last_clean":"2023-10-16T13:47:51.501783+0000","last_became_active":"2023-10-16T13:47:49.805994+0000","last_became_peered":"2023-10-16T13:47:49.805994+0000","last_unstale":"2023-10-16T13:47:51.501783+0000","last_undegraded":"2023-10-16T13:47:51.501783+0000","last_fullsized":"2023-10-16T13:47:51.501783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:32:28.013788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.792800+0000","last_change":"2023-10-16T13:47:48.804575+0000","last_active":"2023-10-16T13:47:49.792800+0000","last_peered":"2023-10-16T13:47:49.792800+0000","last_clean":"2023-10-16T13:47:49.792800+0000","last_became_active":"2023-10-16T13:47:48.804034+0000","last_became_peered":"2023-10-16T13:47:48.804034+0000","last_unstale":"2023-10-16T13:47:49.792800+0000","last_undegraded":"2023-10-16T13:47:49.792800+0000","last_fullsized":"2023-10-16T13:47:49.792800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:47.233336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794186+0000","last_change":"2023-10-16T13:47:49.801348+0000","last_active":"2023-10-16T13:47:50.794186+0000","last_peered":"2023-10-16T13:47:50.794186+0000","last_clean":"2023-10-16T13:47:50.794186+0000","last_became_active":"2023-10-16T13:47:49.801053+0000","last_became_peered":"2023-10-16T13:47:49.801053+0000","last_unstale":"2023-10-16T13:47:50.794186+0000","last_undegraded":"2023-10-16T13:47:50.794186+0000","last_fullsized":"2023-10-16T13:47:50.794186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:42.431214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.796853+0000","last_change":"2023-10-16T13:47:48.801738+0000","last_active":"2023-10-16T13:47:49.796853+0000","last_peered":"2023-10-16T13:47:49.796853+0000","last_clean":"2023-10-16T13:47:49.796853+0000","last_became_active":"2023-10-16T13:47:48.801515+0000","last_became_peered":"2023-10-16T13:47:48.801515+0000","last_unstale":"2023-10-16T13:47:49.796853+0000","last_undegraded":"2023-10-16T13:47:49.796853+0000","last_fullsized":"2023-10-16T13:47:49.796853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:14.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493070+0000","last_change":"2023-10-16T13:47:49.805265+0000","last_active":"2023-10-16T13:47:51.493070+0000","last_peered":"2023-10-16T13:47:51.493070+0000","last_clean":"2023-10-16T13:47:51.493070+0000","last_became_active":"2023-10-16T13:47:49.804868+0000","last_became_peered":"2023-10-16T13:47:49.804868+0000","last_unstale":"2023-10-16T13:47:51.493070+0000","last_undegraded":"2023-10-16T13:47:51.493070+0000","last_fullsized":"2023-10-16T13:47:51.493070+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:22.588668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.825019+0000","last_change":"2023-10-16T13:47:48.796841+0000","last_active":"2023-10-16T13:47:49.825019+0000","last_peered":"2023-10-16T13:47:49.825019+0000","last_clean":"2023-10-16T13:47:49.825019+0000","last_became_active":"2023-10-16T13:47:48.796542+0000","last_became_peered":"2023-10-16T13:47:48.796542+0000","last_unstale":"2023-10-16T13:47:49.825019+0000","last_undegraded":"2023-10-16T13:47:49.825019+0000","last_fullsized":"2023-10-16T13:47:49.825019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:44.746703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501595+0000","last_change":"2023-10-16T13:47:49.805134+0000","last_active":"2023-10-16T13:47:51.501595+0000","last_peered":"2023-10-16T13:47:51.501595+0000","last_clean":"2023-10-16T13:47:51.501595+0000","last_became_active":"2023-10-16T13:47:49.804774+0000","last_became_peered":"2023-10-16T13:47:49.804774+0000","last_unstale":"2023-10-16T13:47:51.501595+0000","last_undegraded":"2023-10-16T13:47:51.501595+0000","last_fullsized":"2023-10-16T13:47:51.501595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:36.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823218+0000","last_change":"2023-10-16T13:47:48.805246+0000","last_active":"2023-10-16T13:47:49.823218+0000","last_peered":"2023-10-16T13:47:49.823218+0000","last_clean":"2023-10-16T13:47:49.823218+0000","last_became_active":"2023-10-16T13:47:48.804979+0000","last_became_peered":"2023-10-16T13:47:48.804979+0000","last_unstale":"2023-10-16T13:47:49.823218+0000","last_undegraded":"2023-10-16T13:47:49.823218+0000","last_fullsized":"2023-10-16T13:47:49.823218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:23.837529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.791820+0000","last_change":"2023-10-16T13:47:49.805633+0000","last_active":"2023-10-16T13:47:50.791820+0000","last_peered":"2023-10-16T13:47:50.791820+0000","last_clean":"2023-10-16T13:47:50.791820+0000","last_became_active":"2023-10-16T13:47:49.805385+0000","last_became_peered":"2023-10-16T13:47:49.805385+0000","last_unstale":"2023-10-16T13:47:50.791820+0000","last_undegraded":"2023-10-16T13:47:50.791820+0000","last_fullsized":"2023-10-16T13:47:50.791820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:45.751239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.820707+0000","last_change":"2023-10-16T13:47:48.797817+0000","last_active":"2023-10-16T13:47:49.820707+0000","last_peered":"2023-10-16T13:47:49.820707+0000","last_clean":"2023-10-16T13:47:49.820707+0000","last_became_active":"2023-10-16T13:47:48.797491+0000","last_became_peered":"2023-10-16T13:47:48.797491+0000","last_unstale":"2023-10-16T13:47:49.820707+0000","last_undegraded":"2023-10-16T13:47:49.820707+0000","last_fullsized":"2023-10-16T13:47:49.820707+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:20:06.104860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790952+0000","last_change":"2023-10-16T13:47:49.807766+0000","last_active":"2023-10-16T13:47:50.790952+0000","last_peered":"2023-10-16T13:47:50.790952+0000","last_clean":"2023-10-16T13:47:50.790952+0000","last_became_active":"2023-10-16T13:47:49.807179+0000","last_became_peered":"2023-10-16T13:47:49.807179+0000","last_unstale":"2023-10-16T13:47:50.790952+0000","last_undegraded":"2023-10-16T13:47:50.790952+0000","last_fullsized":"2023-10-16T13:47:50.790952+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:15.935105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798360+0000","last_change":"2023-10-16T13:47:48.797865+0000","last_active":"2023-10-16T13:47:49.798360+0000","last_peered":"2023-10-16T13:47:49.798360+0000","last_clean":"2023-10-16T13:47:49.798360+0000","last_became_active":"2023-10-16T13:47:48.797576+0000","last_became_peered":"2023-10-16T13:47:48.797576+0000","last_unstale":"2023-10-16T13:47:49.798360+0000","last_undegraded":"2023-10-16T13:47:49.798360+0000","last_fullsized":"2023-10-16T13:47:49.798360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:42.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493310+0000","last_change":"2023-10-16T13:47:49.801014+0000","last_active":"2023-10-16T13:47:51.493310+0000","last_peered":"2023-10-16T13:47:51.493310+0000","last_clean":"2023-10-16T13:47:51.493310+0000","last_became_active":"2023-10-16T13:47:49.800344+0000","last_became_peered":"2023-10-16T13:47:49.800344+0000","last_unstale":"2023-10-16T13:47:51.493310+0000","last_undegraded":"2023-10-16T13:47:51.493310+0000","last_fullsized":"2023-10-16T13:47:51.493310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:40.043071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821420+0000","last_change":"2023-10-16T13:47:48.805717+0000","last_active":"2023-10-16T13:47:49.821420+0000","last_peered":"2023-10-16T13:47:49.821420+0000","last_clean":"2023-10-16T13:47:49.821420+0000","last_became_active":"2023-10-16T13:47:48.805405+0000","last_became_peered":"2023-10-16T13:47:48.805405+0000","last_unstale":"2023-10-16T13:47:49.821420+0000","last_undegraded":"2023-10-16T13:47:49.821420+0000","last_fullsized":"2023-10-16T13:47:49.821420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:54.638855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493302+0000","last_change":"2023-10-16T13:47:49.799634+0000","last_active":"2023-10-16T13:47:51.493302+0000","last_peered":"2023-10-16T13:47:51.493302+0000","last_clean":"2023-10-16T13:47:51.493302+0000","last_became_active":"2023-10-16T13:47:49.799300+0000","last_became_peered":"2023-10-16T13:47:49.799300+0000","last_unstale":"2023-10-16T13:47:51.493302+0000","last_undegraded":"2023-10-16T13:47:51.493302+0000","last_fullsized":"2023-10-16T13:47:51.493302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:28.056496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795665+0000","last_change":"2023-10-16T13:47:48.796153+0000","last_active":"2023-10-16T13:47:49.795665+0000","last_peered":"2023-10-16T13:47:49.795665+0000","last_clean":"2023-10-16T13:47:49.795665+0000","last_became_active":"2023-10-16T13:47:48.795850+0000","last_became_peered":"2023-10-16T13:47:48.795850+0000","last_unstale":"2023-10-16T13:47:49.795665+0000","last_undegraded":"2023-10-16T13:47:49.795665+0000","last_fullsized":"2023-10-16T13:47:49.795665+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:41.269396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493038+0000","last_change":"2023-10-16T13:47:49.800599+0000","last_active":"2023-10-16T13:47:51.493038+0000","last_peered":"2023-10-16T13:47:51.493038+0000","last_clean":"2023-10-16T13:47:51.493038+0000","last_became_active":"2023-10-16T13:47:49.800291+0000","last_became_peered":"2023-10-16T13:47:49.800291+0000","last_unstale":"2023-10-16T13:47:51.493038+0000","last_undegraded":"2023-10-16T13:47:51.493038+0000","last_fullsized":"2023-10-16T13:47:51.493038+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:40.549795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795420+0000","last_change":"2023-10-16T13:47:48.801155+0000","last_active":"2023-10-16T13:47:49.795420+0000","last_peered":"2023-10-16T13:47:49.795420+0000","last_clean":"2023-10-16T13:47:49.795420+0000","last_became_active":"2023-10-16T13:47:48.800843+0000","last_became_peered":"2023-10-16T13:47:48.800843+0000","last_unstale":"2023-10-16T13:47:49.795420+0000","last_undegraded":"2023-10-16T13:47:49.795420+0000","last_fullsized":"2023-10-16T13:47:49.795420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:20:06.104860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501301+0000","last_change":"2023-10-16T13:47:49.809428+0000","last_active":"2023-10-16T13:47:51.501301+0000","last_peered":"2023-10-16T13:47:51.501301+0000","last_clean":"2023-10-16T13:47:51.501301+0000","last_became_active":"2023-10-16T13:47:49.808945+0000","last_became_peered":"2023-10-16T13:47:49.808945+0000","last_unstale":"2023-10-16T13:47:51.501301+0000","last_undegraded":"2023-10-16T13:47:51.501301+0000","last_fullsized":"2023-10-16T13:47:51.501301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:45.751239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798666+0000","last_change":"2023-10-16T13:47:48.795914+0000","last_active":"2023-10-16T13:47:49.798666+0000","last_peered":"2023-10-16T13:47:49.798666+0000","last_clean":"2023-10-16T13:47:49.798666+0000","last_became_active":"2023-10-16T13:47:48.795573+0000","last_became_peered":"2023-10-16T13:47:48.795573+0000","last_unstale":"2023-10-16T13:47:49.798666+0000","last_undegraded":"2023-10-16T13:47:49.798666+0000","last_fullsized":"2023-10-16T13:47:49.798666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:32.028025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937513+0000","last_change":"2023-10-16T13:47:49.805691+0000","last_active":"2023-10-16T13:47:50.937513+0000","last_peered":"2023-10-16T13:47:50.937513+0000","last_clean":"2023-10-16T13:47:50.937513+0000","last_became_active":"2023-10-16T13:47:49.804859+0000","last_became_peered":"2023-10-16T13:47:49.804859+0000","last_unstale":"2023-10-16T13:47:50.937513+0000","last_undegraded":"2023-10-16T13:47:50.937513+0000","last_fullsized":"2023-10-16T13:47:50.937513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:03.227713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823771+0000","last_change":"2023-10-16T13:47:48.798907+0000","last_active":"2023-10-16T13:47:49.823771+0000","last_peered":"2023-10-16T13:47:49.823771+0000","last_clean":"2023-10-16T13:47:49.823771+0000","last_became_active":"2023-10-16T13:47:48.798492+0000","last_became_peered":"2023-10-16T13:47:48.798492+0000","last_unstale":"2023-10-16T13:47:49.823771+0000","last_undegraded":"2023-10-16T13:47:49.823771+0000","last_fullsized":"2023-10-16T13:47:49.823771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:54.176565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501660+0000","last_change":"2023-10-16T13:47:49.805155+0000","last_active":"2023-10-16T13:47:51.501660+0000","last_peered":"2023-10-16T13:47:51.501660+0000","last_clean":"2023-10-16T13:47:51.501660+0000","last_became_active":"2023-10-16T13:47:49.803973+0000","last_became_peered":"2023-10-16T13:47:49.803973+0000","last_unstale":"2023-10-16T13:47:51.501660+0000","last_undegraded":"2023-10-16T13:47:51.501660+0000","last_fullsized":"2023-10-16T13:47:51.501660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:36.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798577+0000","last_change":"2023-10-16T13:47:48.804481+0000","last_active":"2023-10-16T13:47:49.798577+0000","last_peered":"2023-10-16T13:47:49.798577+0000","last_clean":"2023-10-16T13:47:49.798577+0000","last_became_active":"2023-10-16T13:47:48.804187+0000","last_became_peered":"2023-10-16T13:47:48.804187+0000","last_unstale":"2023-10-16T13:47:49.798577+0000","last_undegraded":"2023-10-16T13:47:49.798577+0000","last_fullsized":"2023-10-16T13:47:49.798577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:18:32.167165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.502100+0000","last_change":"2023-10-16T13:47:49.806701+0000","last_active":"2023-10-16T13:47:51.502100+0000","last_peered":"2023-10-16T13:47:51.502100+0000","last_clean":"2023-10-16T13:47:51.502100+0000","last_became_active":"2023-10-16T13:47:49.806235+0000","last_became_peered":"2023-10-16T13:47:49.806235+0000","last_unstale":"2023-10-16T13:47:51.502100+0000","last_undegraded":"2023-10-16T13:47:51.502100+0000","last_fullsized":"2023-10-16T13:47:51.502100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:22.270448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798227+0000","last_change":"2023-10-16T13:47:48.799864+0000","last_active":"2023-10-16T13:47:49.798227+0000","last_peered":"2023-10-16T13:47:49.798227+0000","last_clean":"2023-10-16T13:47:49.798227+0000","last_became_active":"2023-10-16T13:47:48.799553+0000","last_became_peered":"2023-10-16T13:47:48.799553+0000","last_unstale":"2023-10-16T13:47:49.798227+0000","last_undegraded":"2023-10-16T13:47:49.798227+0000","last_fullsized":"2023-10-16T13:47:49.798227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:12.741379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501470+0000","last_change":"2023-10-16T13:47:49.802734+0000","last_active":"2023-10-16T13:47:51.501470+0000","last_peered":"2023-10-16T13:47:51.501470+0000","last_clean":"2023-10-16T13:47:51.501470+0000","last_became_active":"2023-10-16T13:47:49.802440+0000","last_became_peered":"2023-10-16T13:47:49.802440+0000","last_unstale":"2023-10-16T13:47:51.501470+0000","last_undegraded":"2023-10-16T13:47:51.501470+0000","last_fullsized":"2023-10-16T13:47:51.501470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:09.179927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.797265+0000","last_change":"2023-10-16T13:47:48.799838+0000","last_active":"2023-10-16T13:47:49.797265+0000","last_peered":"2023-10-16T13:47:49.797265+0000","last_clean":"2023-10-16T13:47:49.797265+0000","last_became_active":"2023-10-16T13:47:48.797351+0000","last_became_peered":"2023-10-16T13:47:48.797351+0000","last_unstale":"2023-10-16T13:47:49.797265+0000","last_undegraded":"2023-10-16T13:47:49.797265+0000","last_fullsized":"2023-10-16T13:47:49.797265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:54.176565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493405+0000","last_change":"2023-10-16T13:47:49.807965+0000","last_active":"2023-10-16T13:47:51.493405+0000","last_peered":"2023-10-16T13:47:51.493405+0000","last_clean":"2023-10-16T13:47:51.493405+0000","last_became_active":"2023-10-16T13:47:49.807669+0000","last_became_peered":"2023-10-16T13:47:49.807669+0000","last_unstale":"2023-10-16T13:47:51.493405+0000","last_undegraded":"2023-10-16T13:47:51.493405+0000","last_fullsized":"2023-10-16T13:47:51.493405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:02.133168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798463+0000","last_change":"2023-10-16T13:47:48.801278+0000","last_active":"2023-10-16T13:47:49.798463+0000","last_peered":"2023-10-16T13:47:49.798463+0000","last_clean":"2023-10-16T13:47:49.798463+0000","last_became_active":"2023-10-16T13:47:48.800907+0000","last_became_peered":"2023-10-16T13:47:48.800907+0000","last_unstale":"2023-10-16T13:47:49.798463+0000","last_undegraded":"2023-10-16T13:47:49.798463+0000","last_fullsized":"2023-10-16T13:47:49.798463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:21:39.451082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794656+0000","last_change":"2023-10-16T13:47:49.802147+0000","last_active":"2023-10-16T13:47:50.794656+0000","last_peered":"2023-10-16T13:47:50.794656+0000","last_clean":"2023-10-16T13:47:50.794656+0000","last_became_active":"2023-10-16T13:47:49.801805+0000","last_became_peered":"2023-10-16T13:47:49.801805+0000","last_unstale":"2023-10-16T13:47:50.794656+0000","last_undegraded":"2023-10-16T13:47:50.794656+0000","last_fullsized":"2023-10-16T13:47:50.794656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:19.990204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795214+0000","last_change":"2023-10-16T13:47:48.805977+0000","last_active":"2023-10-16T13:47:49.795214+0000","last_peered":"2023-10-16T13:47:49.795214+0000","last_clean":"2023-10-16T13:47:49.795214+0000","last_became_active":"2023-10-16T13:47:48.805675+0000","last_became_peered":"2023-10-16T13:47:48.805675+0000","last_unstale":"2023-10-16T13:47:49.795214+0000","last_undegraded":"2023-10-16T13:47:49.795214+0000","last_fullsized":"2023-10-16T13:47:49.795214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:24:06.014991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493060+0000","last_change":"2023-10-16T13:47:49.807923+0000","last_active":"2023-10-16T13:47:51.493060+0000","last_peered":"2023-10-16T13:47:51.493060+0000","last_clean":"2023-10-16T13:47:51.493060+0000","last_became_active":"2023-10-16T13:47:49.807652+0000","last_became_peered":"2023-10-16T13:47:49.807652+0000","last_unstale":"2023-10-16T13:47:51.493060+0000","last_undegraded":"2023-10-16T13:47:51.493060+0000","last_fullsized":"2023-10-16T13:47:51.493060+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:11:08.898428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.790628+0000","last_change":"2023-10-16T13:47:48.806895+0000","last_active":"2023-10-16T13:47:49.790628+0000","last_peered":"2023-10-16T13:47:49.790628+0000","last_clean":"2023-10-16T13:47:49.790628+0000","last_became_active":"2023-10-16T13:47:48.806633+0000","last_became_peered":"2023-10-16T13:47:48.806633+0000","last_unstale":"2023-10-16T13:47:49.790628+0000","last_undegraded":"2023-10-16T13:47:49.790628+0000","last_fullsized":"2023-10-16T13:47:49.790628+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:55.819398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501127+0000","last_change":"2023-10-16T13:47:49.799414+0000","last_active":"2023-10-16T13:47:51.501127+0000","last_peered":"2023-10-16T13:47:51.501127+0000","last_clean":"2023-10-16T13:47:51.501127+0000","last_became_active":"2023-10-16T13:47:49.799231+0000","last_became_peered":"2023-10-16T13:47:49.799231+0000","last_unstale":"2023-10-16T13:47:51.501127+0000","last_undegraded":"2023-10-16T13:47:51.501127+0000","last_fullsized":"2023-10-16T13:47:51.501127+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:42.273931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.792612+0000","last_change":"2023-10-16T13:47:48.800526+0000","last_active":"2023-10-16T13:47:49.792612+0000","last_peered":"2023-10-16T13:47:49.792612+0000","last_clean":"2023-10-16T13:47:49.792612+0000","last_became_active":"2023-10-16T13:47:48.800240+0000","last_became_peered":"2023-10-16T13:47:48.800240+0000","last_unstale":"2023-10-16T13:47:49.792612+0000","last_undegraded":"2023-10-16T13:47:49.792612+0000","last_fullsized":"2023-10-16T13:47:49.792612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:38.342944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493545+0000","last_change":"2023-10-16T13:47:49.801024+0000","last_active":"2023-10-16T13:47:51.493545+0000","last_peered":"2023-10-16T13:47:51.493545+0000","last_clean":"2023-10-16T13:47:51.493545+0000","last_became_active":"2023-10-16T13:47:49.800396+0000","last_became_peered":"2023-10-16T13:47:49.800396+0000","last_unstale":"2023-10-16T13:47:51.493545+0000","last_undegraded":"2023-10-16T13:47:51.493545+0000","last_fullsized":"2023-10-16T13:47:51.493545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:46.312115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823570+0000","last_change":"2023-10-16T13:47:48.800119+0000","last_active":"2023-10-16T13:47:49.823570+0000","last_peered":"2023-10-16T13:47:49.823570+0000","last_clean":"2023-10-16T13:47:49.823570+0000","last_became_active":"2023-10-16T13:47:48.799820+0000","last_became_peered":"2023-10-16T13:47:48.799820+0000","last_unstale":"2023-10-16T13:47:49.823570+0000","last_undegraded":"2023-10-16T13:47:49.823570+0000","last_fullsized":"2023-10-16T13:47:49.823570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:30:32.788342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":224,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795199+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:47:49.795199+0000","last_peered":"2023-10-16T13:47:49.795199+0000","last_clean":"2023-10-16T13:47:49.795199+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:47:49.795199+0000","last_undegraded":"2023-10-16T13:47:49.795199+0000","last_fullsized":"2023-10-16T13:47:49.795199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1679360,"data_stored":1057637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.82699999999999996},"last":0.60799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.83099999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.53600000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.751,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48999999999999999,"15min":0.53700000000000003},"min":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.51100000000000001,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54700000000000004,"15min":0.58699999999999997},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.625},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.752}]},{"osd":6,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.82899999999999996},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":467809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.23100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86099999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.157,"15min":1.157},"last":0.53600000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.85699999999999998},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":10.964},"last":0.629},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.39000000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.754},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.41699999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.036},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":467157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.317,"15min":0.33300000000000002},"min":{"1min":0.23699999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.35099999999999998},"min":{"1min":0.25900000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.752},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.378,"15min":0.41099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.88},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.40500000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.905},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":1.879},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.84399999999999997,"15min":0.89000000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84099999999999997,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":0.90400000000000003,"15min":1.925},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.872,"15min":1.085},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1671168,"data_stored":1057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.32900000000000001,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.254,"15min":0.23699999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59499999999999997,"5min":0.624,"15min":3.8849999999999998},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.36599999999999999,"15min":0.38100000000000001},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.439},"min":{"1min":0.35999999999999999,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58099999999999996,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":4.0650000000000004},"last":0.624}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.36799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":4.0369999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.753}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.626,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":4.2359999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.2119999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":4.2649999999999997},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.316,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.186},"max":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.99199999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.78700000000000003},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51800000000000002,"5min":0.60599999999999998,"15min":0.67800000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.436,"5min":0.39400000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55100000000000005,"5min":0.57699999999999996,"15min":1.153},"last":0.621}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.054},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.623},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.379},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":0.98199999999999998,"15min":1.395},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.875,"5min":0.93000000000000005,"15min":6.0499999999999998},"last":0.83899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":468791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.46899999999999997},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":5.8890000000000002},"last":0.433},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.40699999999999997},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.181},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.35299999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.89100000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":2.3519999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.29599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":2.4820000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84399999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.754},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.753},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85599999999999998,"5min":0.97099999999999997,"15min":5.7560000000000002},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.74399999999999999},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.95399999999999996,"15min":5.8559999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.67200000000000004},"min":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.96199999999999997,"15min":2.2999999999999998},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.90800000000000003,"15min":2.4039999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":2.2799999999999998},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.77600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.90700000000000003,"15min":5.8179999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":2.4430000000000001},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":468893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63400000000000001,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.46800000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63800000000000001,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69499999999999995,"5min":0.77900000000000003,"15min":0.88},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51300000000000001,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":0.81200000000000006},"last":0.40000000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":0.94199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59399999999999997,"15min":0.63400000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.60899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":467227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.503},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.28599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.318}]},{"osd":1,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.35599999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.80500000000000005},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.84399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.433}]},{"osd":4,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.82299999999999995,"15min":1.141},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.58999999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.84299999999999997,"15min":1.3700000000000001},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69799999999999995,"5min":0.80200000000000005,"15min":0.879},"last":0.40799999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.90700000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.64000000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.755,"5min":0.87,"15min":0.87},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:47:53.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:47:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.131+0000 7fc87d674700 1 Processor -- start 2023-10-16T13:47:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.131+0000 7fc87d674700 1 -- start start 2023-10-16T13:47:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc87d674700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc87815e2f0 0x7fc8780cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc87d674700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780b2d60 con 0x7fc87806a840 2023-10-16T13:47:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc87d674700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780cdd30 con 0x7fc8780cd950 2023-10-16T13:47:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc87d674700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8781619a0 con 0x7fc87815e2f0 2023-10-16T13:47:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc8767fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc87815e2f0 0x7fc8780cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc8777fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc87806a840 0x7fc87806ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57812/0 (socket says 172.21.15.5:57812) 2023-10-16T13:47:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.132+0000 7fc8777fe700 1 -- 172.21.15.5:0/2153582740 learned_addr learned my addr 172.21.15.5:0/2153582740 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc8767fc700 1 -- 172.21.15.5:0/2153582740 >> v1:172.21.15.112:6789/0 conn(0x7fc8780cd950 legacy=0x7fc87815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc8767fc700 1 -- 172.21.15.5:0/2153582740 >> v1:172.21.15.5:6789/0 conn(0x7fc87806a840 legacy=0x7fc87806ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc8767fc700 1 -- 172.21.15.5:0/2153582740 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87815e920 con 0x7fc87815e2f0 2023-10-16T13:47:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc8767fc700 1 --2- 172.21.15.5:0/2153582740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87815e2f0 0x7fc8780cede0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc868009820 tx=0x7fc868009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac84d927d988fbb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc875ffb700 1 -- 172.21.15.5:0/2153582740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868005e30 con 0x7fc87815e2f0 2023-10-16T13:47:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc875ffb700 1 -- 172.21.15.5:0/2153582740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868006030 con 0x7fc87815e2f0 2023-10-16T13:47:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.133+0000 7fc875ffb700 1 -- 172.21.15.5:0/2153582740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680063e0 con 0x7fc87815e2f0 2023-10-16T13:47:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 -- 172.21.15.5:0/2153582740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87815e2f0 msgr2=0x7fc8780cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 --2- 172.21.15.5:0/2153582740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87815e2f0 0x7fc8780cede0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc868009820 tx=0x7fc868009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 -- 172.21.15.5:0/2153582740 shutdown_connections 2023-10-16T13:47:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 --2- 172.21.15.5:0/2153582740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87815e2f0 0x7fc8780cede0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 -- 172.21.15.5:0/2153582740 >> 172.21.15.5:0/2153582740 conn(0x7fc87806dae0 msgr2=0x7fc87806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 -- 172.21.15.5:0/2153582740 shutdown_connections 2023-10-16T13:47:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.134+0000 7fc87d674700 1 -- 172.21.15.5:0/2153582740 wait complete. 2023-10-16T13:47:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.135+0000 7fc87d674700 1 Processor -- start 2023-10-16T13:47:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.135+0000 7fc87d674700 1 -- start start 2023-10-16T13:47:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc87d674700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc87806a840 0x7fc8780acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc87d674700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 0x7fc8780c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc87d674700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc87815e2f0 0x7fc8781f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc87d674700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780c6150 con 0x7fc8780cd950 2023-10-16T13:47:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc87d674700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780c50b0 con 0x7fc87806a840 2023-10-16T13:47:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc87d674700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780c5390 con 0x7fc87815e2f0 2023-10-16T13:47:54.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 0x7fc8780c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 0x7fc8780c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47812/0 (socket says 172.21.15.5:47812) 2023-10-16T13:47:54.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 -- 172.21.15.5:0/1856599493 learned_addr learned my addr 172.21.15.5:0/1856599493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:54.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc876ffd700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc87806a840 0x7fc8780acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8777fe700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc87815e2f0 0x7fc8781f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 -- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc87815e2f0 msgr2=0x7fc8781f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc87815e2f0 0x7fc8781f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 -- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc87806a840 msgr2=0x7fc8780acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc87806a840 0x7fc8780acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.136+0000 7fc8767fc700 1 -- 172.21.15.5:0/1856599493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009430 con 0x7fc8780cd950 2023-10-16T13:47:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.137+0000 7fc8767fc700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 0x7fc8780c4660 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc868000c00 tx=0x7fc868004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.137+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868004240 con 0x7fc8780cd950 2023-10-16T13:47:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.137+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8680043a0 con 0x7fc8780cd950 2023-10-16T13:47:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.137+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8780c5670 con 0x7fc8780cd950 2023-10-16T13:47:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.137+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868006960 con 0x7fc8780cd950 2023-10-16T13:47:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.137+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8780c5c30 con 0x7fc8780cd950 2023-10-16T13:47:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.138+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8780b2630 con 0x7fc8780cd950 2023-10-16T13:47:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.138+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fc868022070 con 0x7fc8780cd950 2023-10-16T13:47:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.139+0000 7fc85f7fe700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc86406b1d0 0x7fc86406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.139+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc86808b2b0 con 0x7fc8780cd950 2023-10-16T13:47:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.139+0000 7fc876ffd700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc86406b1d0 0x7fc86406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.140+0000 7fc876ffd700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc86406b1d0 0x7fc86406d690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc86c000f60 tx=0x7fc86c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.144+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8680560a0 con 0x7fc8780cd950 2023-10-16T13:47:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.342+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc87815eee0 con 0x7fc86406b1d0 2023-10-16T13:47:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.351+0000 7fc85f7fe700 1 -- 172.21.15.5:0/1856599493 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289678 (secure 0 0 0) 0x7fc86c0015a0 con 0x7fc86406b1d0 2023-10-16T13:47:54.357 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc86406b1d0 msgr2=0x7fc86406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc86406b1d0 0x7fc86406d690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc86c000f60 tx=0x7fc86c009040 comp rx=0 tx=0).stop 2023-10-16T13:47:54.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 msgr2=0x7fc8780c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 0x7fc8780c4660 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc868000c00 tx=0x7fc868004750 comp rx=0 tx=0).stop 2023-10-16T13:47:54.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 shutdown_connections 2023-10-16T13:47:54.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc86406b1d0 0x7fc86406d690 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc87815e2f0 0x7fc8781f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc87806a840 0x7fc8780acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 --2- 172.21.15.5:0/1856599493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780cd950 0x7fc8780c4660 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 >> 172.21.15.5:0/1856599493 conn(0x7fc87806dae0 msgr2=0x7fc87815fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:54.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 shutdown_connections 2023-10-16T13:47:54.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.354+0000 7fc87d674700 1 -- 172.21.15.5:0/1856599493 wait complete. 2023-10-16T13:47:54.363 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:47:54.369 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2023-10-16T13:47:53.602287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259100,"kb_used_data":9632,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715620,"statfs":{"total":773094113280,"available":772828794880,"internally_reserved":0,"allocated":9863168,"data_stored":4920774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824340"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501515+0000","last_change":"2023-10-16T13:47:49.803911+0000","last_active":"2023-10-16T13:47:51.501515+0000","last_peered":"2023-10-16T13:47:51.501515+0000","last_clean":"2023-10-16T13:47:51.501515+0000","last_became_active":"2023-10-16T13:47:49.803378+0000","last_became_peered":"2023-10-16T13:47:49.803378+0000","last_unstale":"2023-10-16T13:47:51.501515+0000","last_undegraded":"2023-10-16T13:47:51.501515+0000","last_fullsized":"2023-10-16T13:47:51.501515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:01.855567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937311+0000","last_change":"2023-10-16T13:47:49.806218+0000","last_active":"2023-10-16T13:47:50.937311+0000","last_peered":"2023-10-16T13:47:50.937311+0000","last_clean":"2023-10-16T13:47:50.937311+0000","last_became_active":"2023-10-16T13:47:49.805496+0000","last_became_peered":"2023-10-16T13:47:49.805496+0000","last_unstale":"2023-10-16T13:47:50.937311+0000","last_undegraded":"2023-10-16T13:47:50.937311+0000","last_fullsized":"2023-10-16T13:47:50.937311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:56.823933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501603+0000","last_change":"2023-10-16T13:47:49.804447+0000","last_active":"2023-10-16T13:47:51.501603+0000","last_peered":"2023-10-16T13:47:51.501603+0000","last_clean":"2023-10-16T13:47:51.501603+0000","last_became_active":"2023-10-16T13:47:49.803634+0000","last_became_peered":"2023-10-16T13:47:49.803634+0000","last_unstale":"2023-10-16T13:47:51.501603+0000","last_undegraded":"2023-10-16T13:47:51.501603+0000","last_fullsized":"2023-10-16T13:47:51.501603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:39:42.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501953+0000","last_change":"2023-10-16T13:47:49.798961+0000","last_active":"2023-10-16T13:47:51.501953+0000","last_peered":"2023-10-16T13:47:51.501953+0000","last_clean":"2023-10-16T13:47:51.501953+0000","last_became_active":"2023-10-16T13:47:49.797051+0000","last_became_peered":"2023-10-16T13:47:49.797051+0000","last_unstale":"2023-10-16T13:47:51.501953+0000","last_undegraded":"2023-10-16T13:47:51.501953+0000","last_fullsized":"2023-10-16T13:47:51.501953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:14:47.697282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501235+0000","last_change":"2023-10-16T13:47:49.798571+0000","last_active":"2023-10-16T13:47:51.501235+0000","last_peered":"2023-10-16T13:47:51.501235+0000","last_clean":"2023-10-16T13:47:51.501235+0000","last_became_active":"2023-10-16T13:47:49.798301+0000","last_became_peered":"2023-10-16T13:47:49.798301+0000","last_unstale":"2023-10-16T13:47:51.501235+0000","last_undegraded":"2023-10-16T13:47:51.501235+0000","last_fullsized":"2023-10-16T13:47:51.501235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:14.572042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790758+0000","last_change":"2023-10-16T13:47:49.800260+0000","last_active":"2023-10-16T13:47:50.790758+0000","last_peered":"2023-10-16T13:47:50.790758+0000","last_clean":"2023-10-16T13:47:50.790758+0000","last_became_active":"2023-10-16T13:47:49.799973+0000","last_became_peered":"2023-10-16T13:47:49.799973+0000","last_unstale":"2023-10-16T13:47:50.790758+0000","last_undegraded":"2023-10-16T13:47:50.790758+0000","last_fullsized":"2023-10-16T13:47:50.790758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:21.199634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790557+0000","last_change":"2023-10-16T13:47:49.798472+0000","last_active":"2023-10-16T13:47:50.790557+0000","last_peered":"2023-10-16T13:47:50.790557+0000","last_clean":"2023-10-16T13:47:50.790557+0000","last_became_active":"2023-10-16T13:47:49.798178+0000","last_became_peered":"2023-10-16T13:47:49.798178+0000","last_unstale":"2023-10-16T13:47:50.790557+0000","last_undegraded":"2023-10-16T13:47:50.790557+0000","last_fullsized":"2023-10-16T13:47:50.790557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:19.990204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937159+0000","last_change":"2023-10-16T13:47:49.810190+0000","last_active":"2023-10-16T13:47:50.937159+0000","last_peered":"2023-10-16T13:47:50.937159+0000","last_clean":"2023-10-16T13:47:50.937159+0000","last_became_active":"2023-10-16T13:47:49.809920+0000","last_became_peered":"2023-10-16T13:47:49.809920+0000","last_unstale":"2023-10-16T13:47:50.937159+0000","last_undegraded":"2023-10-16T13:47:50.937159+0000","last_fullsized":"2023-10-16T13:47:50.937159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:47.472912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794518+0000","last_change":"2023-10-16T13:47:49.802576+0000","last_active":"2023-10-16T13:47:50.794518+0000","last_peered":"2023-10-16T13:47:50.794518+0000","last_clean":"2023-10-16T13:47:50.794518+0000","last_became_active":"2023-10-16T13:47:49.802284+0000","last_became_peered":"2023-10-16T13:47:49.802284+0000","last_unstale":"2023-10-16T13:47:50.794518+0000","last_undegraded":"2023-10-16T13:47:50.794518+0000","last_fullsized":"2023-10-16T13:47:50.794518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:59.587598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501532+0000","last_change":"2023-10-16T13:47:49.809335+0000","last_active":"2023-10-16T13:47:51.501532+0000","last_peered":"2023-10-16T13:47:51.501532+0000","last_clean":"2023-10-16T13:47:51.501532+0000","last_became_active":"2023-10-16T13:47:49.809025+0000","last_became_peered":"2023-10-16T13:47:49.809025+0000","last_unstale":"2023-10-16T13:47:51.501532+0000","last_undegraded":"2023-10-16T13:47:51.501532+0000","last_fullsized":"2023-10-16T13:47:51.501532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:39:42.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790774+0000","last_change":"2023-10-16T13:47:49.806423+0000","last_active":"2023-10-16T13:47:50.790774+0000","last_peered":"2023-10-16T13:47:50.790774+0000","last_clean":"2023-10-16T13:47:50.790774+0000","last_became_active":"2023-10-16T13:47:49.805837+0000","last_became_peered":"2023-10-16T13:47:49.805837+0000","last_unstale":"2023-10-16T13:47:50.790774+0000","last_undegraded":"2023-10-16T13:47:50.790774+0000","last_fullsized":"2023-10-16T13:47:50.790774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:14.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794421+0000","last_change":"2023-10-16T13:47:49.808452+0000","last_active":"2023-10-16T13:47:50.794421+0000","last_peered":"2023-10-16T13:47:50.794421+0000","last_clean":"2023-10-16T13:47:50.794421+0000","last_became_active":"2023-10-16T13:47:49.808170+0000","last_became_peered":"2023-10-16T13:47:49.808170+0000","last_unstale":"2023-10-16T13:47:50.794421+0000","last_undegraded":"2023-10-16T13:47:50.794421+0000","last_fullsized":"2023-10-16T13:47:50.794421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:03.227713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501439+0000","last_change":"2023-10-16T13:47:49.802672+0000","last_active":"2023-10-16T13:47:51.501439+0000","last_peered":"2023-10-16T13:47:51.501439+0000","last_clean":"2023-10-16T13:47:51.501439+0000","last_became_active":"2023-10-16T13:47:49.802403+0000","last_became_peered":"2023-10-16T13:47:49.802403+0000","last_unstale":"2023-10-16T13:47:51.501439+0000","last_undegraded":"2023-10-16T13:47:51.501439+0000","last_fullsized":"2023-10-16T13:47:51.501439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:14.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493129+0000","last_change":"2023-10-16T13:47:49.801212+0000","last_active":"2023-10-16T13:47:51.493129+0000","last_peered":"2023-10-16T13:47:51.493129+0000","last_clean":"2023-10-16T13:47:51.493129+0000","last_became_active":"2023-10-16T13:47:49.800728+0000","last_became_peered":"2023-10-16T13:47:49.800728+0000","last_unstale":"2023-10-16T13:47:51.493129+0000","last_undegraded":"2023-10-16T13:47:51.493129+0000","last_fullsized":"2023-10-16T13:47:51.493129+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:14.935563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500883+0000","last_change":"2023-10-16T13:47:49.807307+0000","last_active":"2023-10-16T13:47:51.500883+0000","last_peered":"2023-10-16T13:47:51.500883+0000","last_clean":"2023-10-16T13:47:51.500883+0000","last_became_active":"2023-10-16T13:47:49.807026+0000","last_became_peered":"2023-10-16T13:47:49.807026+0000","last_unstale":"2023-10-16T13:47:51.500883+0000","last_undegraded":"2023-10-16T13:47:51.500883+0000","last_fullsized":"2023-10-16T13:47:51.500883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:19.990204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790583+0000","last_change":"2023-10-16T13:47:49.807524+0000","last_active":"2023-10-16T13:47:50.790583+0000","last_peered":"2023-10-16T13:47:50.790583+0000","last_clean":"2023-10-16T13:47:50.790583+0000","last_became_active":"2023-10-16T13:47:49.806733+0000","last_became_peered":"2023-10-16T13:47:49.806733+0000","last_unstale":"2023-10-16T13:47:50.790583+0000","last_undegraded":"2023-10-16T13:47:50.790583+0000","last_fullsized":"2023-10-16T13:47:50.790583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.948019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937409+0000","last_change":"2023-10-16T13:47:49.801917+0000","last_active":"2023-10-16T13:47:50.937409+0000","last_peered":"2023-10-16T13:47:50.937409+0000","last_clean":"2023-10-16T13:47:50.937409+0000","last_became_active":"2023-10-16T13:47:49.801632+0000","last_became_peered":"2023-10-16T13:47:49.801632+0000","last_unstale":"2023-10-16T13:47:50.937409+0000","last_undegraded":"2023-10-16T13:47:50.937409+0000","last_fullsized":"2023-10-16T13:47:50.937409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:42.431214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501695+0000","last_change":"2023-10-16T13:47:49.796375+0000","last_active":"2023-10-16T13:47:51.501695+0000","last_peered":"2023-10-16T13:47:51.501695+0000","last_clean":"2023-10-16T13:47:51.501695+0000","last_became_active":"2023-10-16T13:47:49.796102+0000","last_became_peered":"2023-10-16T13:47:49.796102+0000","last_unstale":"2023-10-16T13:47:51.501695+0000","last_undegraded":"2023-10-16T13:47:51.501695+0000","last_fullsized":"2023-10-16T13:47:51.501695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:36.808687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493406+0000","last_change":"2023-10-16T13:47:49.807110+0000","last_active":"2023-10-16T13:47:51.493406+0000","last_peered":"2023-10-16T13:47:51.493406+0000","last_clean":"2023-10-16T13:47:51.493406+0000","last_became_active":"2023-10-16T13:47:49.806788+0000","last_became_peered":"2023-10-16T13:47:49.806788+0000","last_unstale":"2023-10-16T13:47:51.493406+0000","last_undegraded":"2023-10-16T13:47:51.493406+0000","last_fullsized":"2023-10-16T13:47:51.493406+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:18.872132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794584+0000","last_change":"2023-10-16T13:47:49.803607+0000","last_active":"2023-10-16T13:47:50.794584+0000","last_peered":"2023-10-16T13:47:50.794584+0000","last_clean":"2023-10-16T13:47:50.794584+0000","last_became_active":"2023-10-16T13:47:49.803297+0000","last_became_peered":"2023-10-16T13:47:49.803297+0000","last_unstale":"2023-10-16T13:47:50.794584+0000","last_undegraded":"2023-10-16T13:47:50.794584+0000","last_fullsized":"2023-10-16T13:47:50.794584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:28.884942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493595+0000","last_change":"2023-10-16T13:47:49.798299+0000","last_active":"2023-10-16T13:47:51.493595+0000","last_peered":"2023-10-16T13:47:51.493595+0000","last_clean":"2023-10-16T13:47:51.493595+0000","last_became_active":"2023-10-16T13:47:49.798020+0000","last_became_peered":"2023-10-16T13:47:49.798020+0000","last_unstale":"2023-10-16T13:47:51.493595+0000","last_undegraded":"2023-10-16T13:47:51.493595+0000","last_fullsized":"2023-10-16T13:47:51.493595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:39:58.747420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937062+0000","last_change":"2023-10-16T13:47:49.801569+0000","last_active":"2023-10-16T13:47:50.937062+0000","last_peered":"2023-10-16T13:47:50.937062+0000","last_clean":"2023-10-16T13:47:50.937062+0000","last_became_active":"2023-10-16T13:47:49.801243+0000","last_became_peered":"2023-10-16T13:47:49.801243+0000","last_unstale":"2023-10-16T13:47:50.937062+0000","last_undegraded":"2023-10-16T13:47:50.937062+0000","last_fullsized":"2023-10-16T13:47:50.937062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:32:43.084289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937064+0000","last_change":"2023-10-16T13:47:49.803430+0000","last_active":"2023-10-16T13:47:50.937064+0000","last_peered":"2023-10-16T13:47:50.937064+0000","last_clean":"2023-10-16T13:47:50.937064+0000","last_became_active":"2023-10-16T13:47:49.803127+0000","last_became_peered":"2023-10-16T13:47:49.803127+0000","last_unstale":"2023-10-16T13:47:50.937064+0000","last_undegraded":"2023-10-16T13:47:50.937064+0000","last_fullsized":"2023-10-16T13:47:50.937064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:44:54.885779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790752+0000","last_change":"2023-10-16T13:47:49.808270+0000","last_active":"2023-10-16T13:47:50.790752+0000","last_peered":"2023-10-16T13:47:50.790752+0000","last_clean":"2023-10-16T13:47:50.790752+0000","last_became_active":"2023-10-16T13:47:49.808067+0000","last_became_peered":"2023-10-16T13:47:49.808067+0000","last_unstale":"2023-10-16T13:47:50.790752+0000","last_undegraded":"2023-10-16T13:47:50.790752+0000","last_fullsized":"2023-10-16T13:47:50.790752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:53:36.808687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501536+0000","last_change":"2023-10-16T13:47:49.801396+0000","last_active":"2023-10-16T13:47:51.501536+0000","last_peered":"2023-10-16T13:47:51.501536+0000","last_clean":"2023-10-16T13:47:51.501536+0000","last_became_active":"2023-10-16T13:47:49.801173+0000","last_became_peered":"2023-10-16T13:47:49.801173+0000","last_unstale":"2023-10-16T13:47:51.501536+0000","last_undegraded":"2023-10-16T13:47:51.501536+0000","last_fullsized":"2023-10-16T13:47:51.501536+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:37.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937476+0000","last_change":"2023-10-16T13:47:49.810260+0000","last_active":"2023-10-16T13:47:50.937476+0000","last_peered":"2023-10-16T13:47:50.937476+0000","last_clean":"2023-10-16T13:47:50.937476+0000","last_became_active":"2023-10-16T13:47:49.808154+0000","last_became_peered":"2023-10-16T13:47:49.808154+0000","last_unstale":"2023-10-16T13:47:50.937476+0000","last_undegraded":"2023-10-16T13:47:50.937476+0000","last_fullsized":"2023-10-16T13:47:50.937476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:30:33.792878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.791097+0000","last_change":"2023-10-16T13:47:49.801860+0000","last_active":"2023-10-16T13:47:50.791097+0000","last_peered":"2023-10-16T13:47:50.791097+0000","last_clean":"2023-10-16T13:47:50.791097+0000","last_became_active":"2023-10-16T13:47:49.801408+0000","last_became_peered":"2023-10-16T13:47:49.801408+0000","last_unstale":"2023-10-16T13:47:50.791097+0000","last_undegraded":"2023-10-16T13:47:50.791097+0000","last_fullsized":"2023-10-16T13:47:50.791097+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:30.530890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501351+0000","last_change":"2023-10-16T13:47:49.803507+0000","last_active":"2023-10-16T13:47:51.501351+0000","last_peered":"2023-10-16T13:47:51.501351+0000","last_clean":"2023-10-16T13:47:51.501351+0000","last_became_active":"2023-10-16T13:47:49.803184+0000","last_became_peered":"2023-10-16T13:47:49.803184+0000","last_unstale":"2023-10-16T13:47:51.501351+0000","last_undegraded":"2023-10-16T13:47:51.501351+0000","last_fullsized":"2023-10-16T13:47:51.501351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:41.734461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937144+0000","last_change":"2023-10-16T13:47:49.810036+0000","last_active":"2023-10-16T13:47:50.937144+0000","last_peered":"2023-10-16T13:47:50.937144+0000","last_clean":"2023-10-16T13:47:50.937144+0000","last_became_active":"2023-10-16T13:47:49.808055+0000","last_became_peered":"2023-10-16T13:47:49.808055+0000","last_unstale":"2023-10-16T13:47:50.937144+0000","last_undegraded":"2023-10-16T13:47:50.937144+0000","last_fullsized":"2023-10-16T13:47:50.937144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:15.460783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493125+0000","last_change":"2023-10-16T13:47:49.807175+0000","last_active":"2023-10-16T13:47:51.493125+0000","last_peered":"2023-10-16T13:47:51.493125+0000","last_clean":"2023-10-16T13:47:51.493125+0000","last_became_active":"2023-10-16T13:47:49.806853+0000","last_became_peered":"2023-10-16T13:47:49.806853+0000","last_unstale":"2023-10-16T13:47:51.493125+0000","last_undegraded":"2023-10-16T13:47:51.493125+0000","last_fullsized":"2023-10-16T13:47:51.493125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:09:47.891600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500901+0000","last_change":"2023-10-16T13:47:49.799923+0000","last_active":"2023-10-16T13:47:51.500901+0000","last_peered":"2023-10-16T13:47:51.500901+0000","last_clean":"2023-10-16T13:47:51.500901+0000","last_became_active":"2023-10-16T13:47:49.799459+0000","last_became_peered":"2023-10-16T13:47:49.799459+0000","last_unstale":"2023-10-16T13:47:51.500901+0000","last_undegraded":"2023-10-16T13:47:51.500901+0000","last_fullsized":"2023-10-16T13:47:51.500901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:48:48.948019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500956+0000","last_change":"2023-10-16T13:47:49.804962+0000","last_active":"2023-10-16T13:47:51.500956+0000","last_peered":"2023-10-16T13:47:51.500956+0000","last_clean":"2023-10-16T13:47:51.500956+0000","last_became_active":"2023-10-16T13:47:49.804715+0000","last_became_peered":"2023-10-16T13:47:49.804715+0000","last_unstale":"2023-10-16T13:47:51.500956+0000","last_undegraded":"2023-10-16T13:47:51.500956+0000","last_fullsized":"2023-10-16T13:47:51.500956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:30:37.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493559+0000","last_change":"2023-10-16T13:47:49.802536+0000","last_active":"2023-10-16T13:47:51.493559+0000","last_peered":"2023-10-16T13:47:51.493559+0000","last_clean":"2023-10-16T13:47:51.493559+0000","last_became_active":"2023-10-16T13:47:49.802244+0000","last_became_peered":"2023-10-16T13:47:49.802244+0000","last_unstale":"2023-10-16T13:47:51.493559+0000","last_undegraded":"2023-10-16T13:47:51.493559+0000","last_fullsized":"2023-10-16T13:47:51.493559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:41.677401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.824052+0000","last_change":"2023-10-16T13:47:48.800616+0000","last_active":"2023-10-16T13:47:49.824052+0000","last_peered":"2023-10-16T13:47:49.824052+0000","last_clean":"2023-10-16T13:47:49.824052+0000","last_became_active":"2023-10-16T13:47:48.800335+0000","last_became_peered":"2023-10-16T13:47:48.800335+0000","last_unstale":"2023-10-16T13:47:49.824052+0000","last_undegraded":"2023-10-16T13:47:49.824052+0000","last_fullsized":"2023-10-16T13:47:49.824052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:44.591856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501784+0000","last_change":"2023-10-16T13:47:49.803932+0000","last_active":"2023-10-16T13:47:51.501784+0000","last_peered":"2023-10-16T13:47:51.501784+0000","last_clean":"2023-10-16T13:47:51.501784+0000","last_became_active":"2023-10-16T13:47:49.803579+0000","last_became_peered":"2023-10-16T13:47:49.803579+0000","last_unstale":"2023-10-16T13:47:51.501784+0000","last_undegraded":"2023-10-16T13:47:51.501784+0000","last_fullsized":"2023-10-16T13:47:51.501784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:21.199634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821703+0000","last_change":"2023-10-16T13:47:48.803795+0000","last_active":"2023-10-16T13:47:49.821703+0000","last_peered":"2023-10-16T13:47:49.821703+0000","last_clean":"2023-10-16T13:47:49.821703+0000","last_became_active":"2023-10-16T13:47:48.803564+0000","last_became_peered":"2023-10-16T13:47:48.803564+0000","last_unstale":"2023-10-16T13:47:49.821703+0000","last_undegraded":"2023-10-16T13:47:49.821703+0000","last_fullsized":"2023-10-16T13:47:49.821703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:55.819398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.502126+0000","last_change":"2023-10-16T13:47:49.805736+0000","last_active":"2023-10-16T13:47:51.502126+0000","last_peered":"2023-10-16T13:47:51.502126+0000","last_clean":"2023-10-16T13:47:51.502126+0000","last_became_active":"2023-10-16T13:47:49.805435+0000","last_became_peered":"2023-10-16T13:47:49.805435+0000","last_unstale":"2023-10-16T13:47:51.502126+0000","last_undegraded":"2023-10-16T13:47:51.502126+0000","last_fullsized":"2023-10-16T13:47:51.502126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:27.903739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821434+0000","last_change":"2023-10-16T13:47:48.806674+0000","last_active":"2023-10-16T13:47:49.821434+0000","last_peered":"2023-10-16T13:47:49.821434+0000","last_clean":"2023-10-16T13:47:49.821434+0000","last_became_active":"2023-10-16T13:47:48.806393+0000","last_became_peered":"2023-10-16T13:47:48.806393+0000","last_unstale":"2023-10-16T13:47:49.821434+0000","last_undegraded":"2023-10-16T13:47:49.821434+0000","last_fullsized":"2023-10-16T13:47:49.821434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:02:19.799263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794503+0000","last_change":"2023-10-16T13:47:49.806266+0000","last_active":"2023-10-16T13:47:50.794503+0000","last_peered":"2023-10-16T13:47:50.794503+0000","last_clean":"2023-10-16T13:47:50.794503+0000","last_became_active":"2023-10-16T13:47:49.805898+0000","last_became_peered":"2023-10-16T13:47:49.805898+0000","last_unstale":"2023-10-16T13:47:50.794503+0000","last_undegraded":"2023-10-16T13:47:50.794503+0000","last_fullsized":"2023-10-16T13:47:50.794503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:35.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.824746+0000","last_change":"2023-10-16T13:47:48.799974+0000","last_active":"2023-10-16T13:47:49.824746+0000","last_peered":"2023-10-16T13:47:49.824746+0000","last_clean":"2023-10-16T13:47:49.824746+0000","last_became_active":"2023-10-16T13:47:48.799492+0000","last_became_peered":"2023-10-16T13:47:48.799492+0000","last_unstale":"2023-10-16T13:47:49.824746+0000","last_undegraded":"2023-10-16T13:47:49.824746+0000","last_fullsized":"2023-10-16T13:47:49.824746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:34.621759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.791657+0000","last_change":"2023-10-16T13:47:49.808008+0000","last_active":"2023-10-16T13:47:50.791657+0000","last_peered":"2023-10-16T13:47:50.791657+0000","last_clean":"2023-10-16T13:47:50.791657+0000","last_became_active":"2023-10-16T13:47:49.807697+0000","last_became_peered":"2023-10-16T13:47:49.807697+0000","last_unstale":"2023-10-16T13:47:50.791657+0000","last_undegraded":"2023-10-16T13:47:50.791657+0000","last_fullsized":"2023-10-16T13:47:50.791657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:14.572042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.820570+0000","last_change":"2023-10-16T13:47:48.798897+0000","last_active":"2023-10-16T13:47:49.820570+0000","last_peered":"2023-10-16T13:47:49.820570+0000","last_clean":"2023-10-16T13:47:49.820570+0000","last_became_active":"2023-10-16T13:47:48.798598+0000","last_became_peered":"2023-10-16T13:47:48.798598+0000","last_unstale":"2023-10-16T13:47:49.820570+0000","last_undegraded":"2023-10-16T13:47:49.820570+0000","last_fullsized":"2023-10-16T13:47:49.820570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:08.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790753+0000","last_change":"2023-10-16T13:47:49.798764+0000","last_active":"2023-10-16T13:47:50.790753+0000","last_peered":"2023-10-16T13:47:50.790753+0000","last_clean":"2023-10-16T13:47:50.790753+0000","last_became_active":"2023-10-16T13:47:49.798572+0000","last_became_peered":"2023-10-16T13:47:49.798572+0000","last_unstale":"2023-10-16T13:47:50.790753+0000","last_undegraded":"2023-10-16T13:47:50.790753+0000","last_fullsized":"2023-10-16T13:47:50.790753+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:41.963167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821308+0000","last_change":"2023-10-16T13:47:48.799525+0000","last_active":"2023-10-16T13:47:49.821308+0000","last_peered":"2023-10-16T13:47:49.821308+0000","last_clean":"2023-10-16T13:47:49.821308+0000","last_became_active":"2023-10-16T13:47:48.799229+0000","last_became_peered":"2023-10-16T13:47:48.799229+0000","last_unstale":"2023-10-16T13:47:49.821308+0000","last_undegraded":"2023-10-16T13:47:49.821308+0000","last_fullsized":"2023-10-16T13:47:49.821308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:23.837529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.500840+0000","last_change":"2023-10-16T13:47:49.807231+0000","last_active":"2023-10-16T13:47:51.500840+0000","last_peered":"2023-10-16T13:47:51.500840+0000","last_clean":"2023-10-16T13:47:51.500840+0000","last_became_active":"2023-10-16T13:47:49.806940+0000","last_became_peered":"2023-10-16T13:47:49.806940+0000","last_unstale":"2023-10-16T13:47:51.500840+0000","last_undegraded":"2023-10-16T13:47:51.500840+0000","last_fullsized":"2023-10-16T13:47:51.500840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:28.884942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.799541+0000","last_change":"2023-10-16T13:47:48.799937+0000","last_active":"2023-10-16T13:47:49.799541+0000","last_peered":"2023-10-16T13:47:49.799541+0000","last_clean":"2023-10-16T13:47:49.799541+0000","last_became_active":"2023-10-16T13:47:48.799610+0000","last_became_peered":"2023-10-16T13:47:48.799610+0000","last_unstale":"2023-10-16T13:47:49.799541+0000","last_undegraded":"2023-10-16T13:47:49.799541+0000","last_fullsized":"2023-10-16T13:47:49.799541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:14:09.486864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794366+0000","last_change":"2023-10-16T13:47:49.805749+0000","last_active":"2023-10-16T13:47:50.794366+0000","last_peered":"2023-10-16T13:47:50.794366+0000","last_clean":"2023-10-16T13:47:50.794366+0000","last_became_active":"2023-10-16T13:47:49.805428+0000","last_became_peered":"2023-10-16T13:47:49.805428+0000","last_unstale":"2023-10-16T13:47:50.794366+0000","last_undegraded":"2023-10-16T13:47:50.794366+0000","last_fullsized":"2023-10-16T13:47:50.794366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:30:33.792878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.791118+0000","last_change":"2023-10-16T13:47:48.801927+0000","last_active":"2023-10-16T13:47:49.791118+0000","last_peered":"2023-10-16T13:47:49.791118+0000","last_clean":"2023-10-16T13:47:49.791118+0000","last_became_active":"2023-10-16T13:47:48.801555+0000","last_became_peered":"2023-10-16T13:47:48.801555+0000","last_unstale":"2023-10-16T13:47:49.791118+0000","last_undegraded":"2023-10-16T13:47:49.791118+0000","last_fullsized":"2023-10-16T13:47:49.791118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:41.269396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937563+0000","last_change":"2023-10-16T13:47:49.806377+0000","last_active":"2023-10-16T13:47:50.937563+0000","last_peered":"2023-10-16T13:47:50.937563+0000","last_clean":"2023-10-16T13:47:50.937563+0000","last_became_active":"2023-10-16T13:47:49.806029+0000","last_became_peered":"2023-10-16T13:47:49.806029+0000","last_unstale":"2023-10-16T13:47:50.937563+0000","last_undegraded":"2023-10-16T13:47:50.937563+0000","last_fullsized":"2023-10-16T13:47:50.937563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:27:35.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.793424+0000","last_change":"2023-10-16T13:47:48.795272+0000","last_active":"2023-10-16T13:47:49.793424+0000","last_peered":"2023-10-16T13:47:49.793424+0000","last_clean":"2023-10-16T13:47:49.793424+0000","last_became_active":"2023-10-16T13:47:48.795023+0000","last_became_peered":"2023-10-16T13:47:48.795023+0000","last_unstale":"2023-10-16T13:47:49.793424+0000","last_undegraded":"2023-10-16T13:47:49.793424+0000","last_fullsized":"2023-10-16T13:47:49.793424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:40.729925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794544+0000","last_change":"2023-10-16T13:47:49.805849+0000","last_active":"2023-10-16T13:47:50.794544+0000","last_peered":"2023-10-16T13:47:50.794544+0000","last_clean":"2023-10-16T13:47:50.794544+0000","last_became_active":"2023-10-16T13:47:49.805546+0000","last_became_peered":"2023-10-16T13:47:49.805546+0000","last_unstale":"2023-10-16T13:47:50.794544+0000","last_undegraded":"2023-10-16T13:47:50.794544+0000","last_fullsized":"2023-10-16T13:47:50.794544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:00.201629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.791804+0000","last_change":"2023-10-16T13:47:48.807772+0000","last_active":"2023-10-16T13:47:49.791804+0000","last_peered":"2023-10-16T13:47:49.791804+0000","last_clean":"2023-10-16T13:47:49.791804+0000","last_became_active":"2023-10-16T13:47:48.807493+0000","last_became_peered":"2023-10-16T13:47:48.807493+0000","last_unstale":"2023-10-16T13:47:49.791804+0000","last_undegraded":"2023-10-16T13:47:49.791804+0000","last_fullsized":"2023-10-16T13:47:49.791804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:58.583062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501516+0000","last_change":"2023-10-16T13:47:49.801870+0000","last_active":"2023-10-16T13:47:51.501516+0000","last_peered":"2023-10-16T13:47:51.501516+0000","last_clean":"2023-10-16T13:47:51.501516+0000","last_became_active":"2023-10-16T13:47:49.801140+0000","last_became_peered":"2023-10-16T13:47:49.801140+0000","last_unstale":"2023-10-16T13:47:51.501516+0000","last_undegraded":"2023-10-16T13:47:51.501516+0000","last_fullsized":"2023-10-16T13:47:51.501516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:01.855567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823857+0000","last_change":"2023-10-16T13:47:48.799794+0000","last_active":"2023-10-16T13:47:49.823857+0000","last_peered":"2023-10-16T13:47:49.823857+0000","last_clean":"2023-10-16T13:47:49.823857+0000","last_became_active":"2023-10-16T13:47:48.799518+0000","last_became_peered":"2023-10-16T13:47:48.799518+0000","last_unstale":"2023-10-16T13:47:49.823857+0000","last_undegraded":"2023-10-16T13:47:49.823857+0000","last_fullsized":"2023-10-16T13:47:49.823857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:59.197094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790870+0000","last_change":"2023-10-16T13:47:49.805553+0000","last_active":"2023-10-16T13:47:50.790870+0000","last_peered":"2023-10-16T13:47:50.790870+0000","last_clean":"2023-10-16T13:47:50.790870+0000","last_became_active":"2023-10-16T13:47:49.802109+0000","last_became_peered":"2023-10-16T13:47:49.802109+0000","last_unstale":"2023-10-16T13:47:50.790870+0000","last_undegraded":"2023-10-16T13:47:50.790870+0000","last_fullsized":"2023-10-16T13:47:50.790870+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:14:47.697282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.825924+0000","last_change":"2023-10-16T13:47:48.801509+0000","last_active":"2023-10-16T13:47:49.825924+0000","last_peered":"2023-10-16T13:47:49.825924+0000","last_clean":"2023-10-16T13:47:49.825924+0000","last_became_active":"2023-10-16T13:47:48.801203+0000","last_became_peered":"2023-10-16T13:47:48.801203+0000","last_unstale":"2023-10-16T13:47:49.825924+0000","last_undegraded":"2023-10-16T13:47:49.825924+0000","last_fullsized":"2023-10-16T13:47:49.825924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:46.468376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501375+0000","last_change":"2023-10-16T13:47:49.801910+0000","last_active":"2023-10-16T13:47:51.501375+0000","last_peered":"2023-10-16T13:47:51.501375+0000","last_clean":"2023-10-16T13:47:51.501375+0000","last_became_active":"2023-10-16T13:47:49.801637+0000","last_became_peered":"2023-10-16T13:47:49.801637+0000","last_unstale":"2023-10-16T13:47:51.501375+0000","last_undegraded":"2023-10-16T13:47:51.501375+0000","last_fullsized":"2023-10-16T13:47:51.501375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:34:41.963167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.824158+0000","last_change":"2023-10-16T13:47:48.804978+0000","last_active":"2023-10-16T13:47:49.824158+0000","last_peered":"2023-10-16T13:47:49.824158+0000","last_clean":"2023-10-16T13:47:49.824158+0000","last_became_active":"2023-10-16T13:47:48.803846+0000","last_became_peered":"2023-10-16T13:47:48.803846+0000","last_unstale":"2023-10-16T13:47:49.824158+0000","last_undegraded":"2023-10-16T13:47:49.824158+0000","last_fullsized":"2023-10-16T13:47:49.824158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:54.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501783+0000","last_change":"2023-10-16T13:47:49.806419+0000","last_active":"2023-10-16T13:47:51.501783+0000","last_peered":"2023-10-16T13:47:51.501783+0000","last_clean":"2023-10-16T13:47:51.501783+0000","last_became_active":"2023-10-16T13:47:49.805994+0000","last_became_peered":"2023-10-16T13:47:49.805994+0000","last_unstale":"2023-10-16T13:47:51.501783+0000","last_undegraded":"2023-10-16T13:47:51.501783+0000","last_fullsized":"2023-10-16T13:47:51.501783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:32:28.013788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.792800+0000","last_change":"2023-10-16T13:47:48.804575+0000","last_active":"2023-10-16T13:47:49.792800+0000","last_peered":"2023-10-16T13:47:49.792800+0000","last_clean":"2023-10-16T13:47:49.792800+0000","last_became_active":"2023-10-16T13:47:48.804034+0000","last_became_peered":"2023-10-16T13:47:48.804034+0000","last_unstale":"2023-10-16T13:47:49.792800+0000","last_undegraded":"2023-10-16T13:47:49.792800+0000","last_fullsized":"2023-10-16T13:47:49.792800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:34:47.233336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794186+0000","last_change":"2023-10-16T13:47:49.801348+0000","last_active":"2023-10-16T13:47:50.794186+0000","last_peered":"2023-10-16T13:47:50.794186+0000","last_clean":"2023-10-16T13:47:50.794186+0000","last_became_active":"2023-10-16T13:47:49.801053+0000","last_became_peered":"2023-10-16T13:47:49.801053+0000","last_unstale":"2023-10-16T13:47:50.794186+0000","last_undegraded":"2023-10-16T13:47:50.794186+0000","last_fullsized":"2023-10-16T13:47:50.794186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:42.431214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.796853+0000","last_change":"2023-10-16T13:47:48.801738+0000","last_active":"2023-10-16T13:47:49.796853+0000","last_peered":"2023-10-16T13:47:49.796853+0000","last_clean":"2023-10-16T13:47:49.796853+0000","last_became_active":"2023-10-16T13:47:48.801515+0000","last_became_peered":"2023-10-16T13:47:48.801515+0000","last_unstale":"2023-10-16T13:47:49.796853+0000","last_undegraded":"2023-10-16T13:47:49.796853+0000","last_fullsized":"2023-10-16T13:47:49.796853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:14.456248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493070+0000","last_change":"2023-10-16T13:47:49.805265+0000","last_active":"2023-10-16T13:47:51.493070+0000","last_peered":"2023-10-16T13:47:51.493070+0000","last_clean":"2023-10-16T13:47:51.493070+0000","last_became_active":"2023-10-16T13:47:49.804868+0000","last_became_peered":"2023-10-16T13:47:49.804868+0000","last_unstale":"2023-10-16T13:47:51.493070+0000","last_undegraded":"2023-10-16T13:47:51.493070+0000","last_fullsized":"2023-10-16T13:47:51.493070+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:50:22.588668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.825019+0000","last_change":"2023-10-16T13:47:48.796841+0000","last_active":"2023-10-16T13:47:49.825019+0000","last_peered":"2023-10-16T13:47:49.825019+0000","last_clean":"2023-10-16T13:47:49.825019+0000","last_became_active":"2023-10-16T13:47:48.796542+0000","last_became_peered":"2023-10-16T13:47:48.796542+0000","last_unstale":"2023-10-16T13:47:49.825019+0000","last_undegraded":"2023-10-16T13:47:49.825019+0000","last_fullsized":"2023-10-16T13:47:49.825019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:44.746703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501595+0000","last_change":"2023-10-16T13:47:49.805134+0000","last_active":"2023-10-16T13:47:51.501595+0000","last_peered":"2023-10-16T13:47:51.501595+0000","last_clean":"2023-10-16T13:47:51.501595+0000","last_became_active":"2023-10-16T13:47:49.804774+0000","last_became_peered":"2023-10-16T13:47:49.804774+0000","last_unstale":"2023-10-16T13:47:51.501595+0000","last_undegraded":"2023-10-16T13:47:51.501595+0000","last_fullsized":"2023-10-16T13:47:51.501595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:36.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823218+0000","last_change":"2023-10-16T13:47:48.805246+0000","last_active":"2023-10-16T13:47:49.823218+0000","last_peered":"2023-10-16T13:47:49.823218+0000","last_clean":"2023-10-16T13:47:49.823218+0000","last_became_active":"2023-10-16T13:47:48.804979+0000","last_became_peered":"2023-10-16T13:47:48.804979+0000","last_unstale":"2023-10-16T13:47:49.823218+0000","last_undegraded":"2023-10-16T13:47:49.823218+0000","last_fullsized":"2023-10-16T13:47:49.823218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:23.837529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.791820+0000","last_change":"2023-10-16T13:47:49.805633+0000","last_active":"2023-10-16T13:47:50.791820+0000","last_peered":"2023-10-16T13:47:50.791820+0000","last_clean":"2023-10-16T13:47:50.791820+0000","last_became_active":"2023-10-16T13:47:49.805385+0000","last_became_peered":"2023-10-16T13:47:49.805385+0000","last_unstale":"2023-10-16T13:47:50.791820+0000","last_undegraded":"2023-10-16T13:47:50.791820+0000","last_fullsized":"2023-10-16T13:47:50.791820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:45.751239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.820707+0000","last_change":"2023-10-16T13:47:48.797817+0000","last_active":"2023-10-16T13:47:49.820707+0000","last_peered":"2023-10-16T13:47:49.820707+0000","last_clean":"2023-10-16T13:47:49.820707+0000","last_became_active":"2023-10-16T13:47:48.797491+0000","last_became_peered":"2023-10-16T13:47:48.797491+0000","last_unstale":"2023-10-16T13:47:49.820707+0000","last_undegraded":"2023-10-16T13:47:49.820707+0000","last_fullsized":"2023-10-16T13:47:49.820707+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:20:06.104860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.790952+0000","last_change":"2023-10-16T13:47:49.807766+0000","last_active":"2023-10-16T13:47:50.790952+0000","last_peered":"2023-10-16T13:47:50.790952+0000","last_clean":"2023-10-16T13:47:50.790952+0000","last_became_active":"2023-10-16T13:47:49.807179+0000","last_became_peered":"2023-10-16T13:47:49.807179+0000","last_unstale":"2023-10-16T13:47:50.790952+0000","last_undegraded":"2023-10-16T13:47:50.790952+0000","last_fullsized":"2023-10-16T13:47:50.790952+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:15.935105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798360+0000","last_change":"2023-10-16T13:47:48.797865+0000","last_active":"2023-10-16T13:47:49.798360+0000","last_peered":"2023-10-16T13:47:49.798360+0000","last_clean":"2023-10-16T13:47:49.798360+0000","last_became_active":"2023-10-16T13:47:48.797576+0000","last_became_peered":"2023-10-16T13:47:48.797576+0000","last_unstale":"2023-10-16T13:47:49.798360+0000","last_undegraded":"2023-10-16T13:47:49.798360+0000","last_fullsized":"2023-10-16T13:47:49.798360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:42.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493310+0000","last_change":"2023-10-16T13:47:49.801014+0000","last_active":"2023-10-16T13:47:51.493310+0000","last_peered":"2023-10-16T13:47:51.493310+0000","last_clean":"2023-10-16T13:47:51.493310+0000","last_became_active":"2023-10-16T13:47:49.800344+0000","last_became_peered":"2023-10-16T13:47:49.800344+0000","last_unstale":"2023-10-16T13:47:51.493310+0000","last_undegraded":"2023-10-16T13:47:51.493310+0000","last_fullsized":"2023-10-16T13:47:51.493310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:40.043071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.821420+0000","last_change":"2023-10-16T13:47:48.805717+0000","last_active":"2023-10-16T13:47:49.821420+0000","last_peered":"2023-10-16T13:47:49.821420+0000","last_clean":"2023-10-16T13:47:49.821420+0000","last_became_active":"2023-10-16T13:47:48.805405+0000","last_became_peered":"2023-10-16T13:47:48.805405+0000","last_unstale":"2023-10-16T13:47:49.821420+0000","last_undegraded":"2023-10-16T13:47:49.821420+0000","last_fullsized":"2023-10-16T13:47:49.821420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:54.638855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493302+0000","last_change":"2023-10-16T13:47:49.799634+0000","last_active":"2023-10-16T13:47:51.493302+0000","last_peered":"2023-10-16T13:47:51.493302+0000","last_clean":"2023-10-16T13:47:51.493302+0000","last_became_active":"2023-10-16T13:47:49.799300+0000","last_became_peered":"2023-10-16T13:47:49.799300+0000","last_unstale":"2023-10-16T13:47:51.493302+0000","last_undegraded":"2023-10-16T13:47:51.493302+0000","last_fullsized":"2023-10-16T13:47:51.493302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:28.056496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795665+0000","last_change":"2023-10-16T13:47:48.796153+0000","last_active":"2023-10-16T13:47:49.795665+0000","last_peered":"2023-10-16T13:47:49.795665+0000","last_clean":"2023-10-16T13:47:49.795665+0000","last_became_active":"2023-10-16T13:47:48.795850+0000","last_became_peered":"2023-10-16T13:47:48.795850+0000","last_unstale":"2023-10-16T13:47:49.795665+0000","last_undegraded":"2023-10-16T13:47:49.795665+0000","last_fullsized":"2023-10-16T13:47:49.795665+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:41.269396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493038+0000","last_change":"2023-10-16T13:47:49.800599+0000","last_active":"2023-10-16T13:47:51.493038+0000","last_peered":"2023-10-16T13:47:51.493038+0000","last_clean":"2023-10-16T13:47:51.493038+0000","last_became_active":"2023-10-16T13:47:49.800291+0000","last_became_peered":"2023-10-16T13:47:49.800291+0000","last_unstale":"2023-10-16T13:47:51.493038+0000","last_undegraded":"2023-10-16T13:47:51.493038+0000","last_fullsized":"2023-10-16T13:47:51.493038+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:40.549795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795420+0000","last_change":"2023-10-16T13:47:48.801155+0000","last_active":"2023-10-16T13:47:49.795420+0000","last_peered":"2023-10-16T13:47:49.795420+0000","last_clean":"2023-10-16T13:47:49.795420+0000","last_became_active":"2023-10-16T13:47:48.800843+0000","last_became_peered":"2023-10-16T13:47:48.800843+0000","last_unstale":"2023-10-16T13:47:49.795420+0000","last_undegraded":"2023-10-16T13:47:49.795420+0000","last_fullsized":"2023-10-16T13:47:49.795420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:20:06.104860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501301+0000","last_change":"2023-10-16T13:47:49.809428+0000","last_active":"2023-10-16T13:47:51.501301+0000","last_peered":"2023-10-16T13:47:51.501301+0000","last_clean":"2023-10-16T13:47:51.501301+0000","last_became_active":"2023-10-16T13:47:49.808945+0000","last_became_peered":"2023-10-16T13:47:49.808945+0000","last_unstale":"2023-10-16T13:47:51.501301+0000","last_undegraded":"2023-10-16T13:47:51.501301+0000","last_fullsized":"2023-10-16T13:47:51.501301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:45.751239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798666+0000","last_change":"2023-10-16T13:47:48.795914+0000","last_active":"2023-10-16T13:47:49.798666+0000","last_peered":"2023-10-16T13:47:49.798666+0000","last_clean":"2023-10-16T13:47:49.798666+0000","last_became_active":"2023-10-16T13:47:48.795573+0000","last_became_peered":"2023-10-16T13:47:48.795573+0000","last_unstale":"2023-10-16T13:47:49.798666+0000","last_undegraded":"2023-10-16T13:47:49.798666+0000","last_fullsized":"2023-10-16T13:47:49.798666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:32.028025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.937513+0000","last_change":"2023-10-16T13:47:49.805691+0000","last_active":"2023-10-16T13:47:50.937513+0000","last_peered":"2023-10-16T13:47:50.937513+0000","last_clean":"2023-10-16T13:47:50.937513+0000","last_became_active":"2023-10-16T13:47:49.804859+0000","last_became_peered":"2023-10-16T13:47:49.804859+0000","last_unstale":"2023-10-16T13:47:50.937513+0000","last_undegraded":"2023-10-16T13:47:50.937513+0000","last_fullsized":"2023-10-16T13:47:50.937513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:03.227713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823771+0000","last_change":"2023-10-16T13:47:48.798907+0000","last_active":"2023-10-16T13:47:49.823771+0000","last_peered":"2023-10-16T13:47:49.823771+0000","last_clean":"2023-10-16T13:47:49.823771+0000","last_became_active":"2023-10-16T13:47:48.798492+0000","last_became_peered":"2023-10-16T13:47:48.798492+0000","last_unstale":"2023-10-16T13:47:49.823771+0000","last_undegraded":"2023-10-16T13:47:49.823771+0000","last_fullsized":"2023-10-16T13:47:49.823771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:54.176565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501660+0000","last_change":"2023-10-16T13:47:49.805155+0000","last_active":"2023-10-16T13:47:51.501660+0000","last_peered":"2023-10-16T13:47:51.501660+0000","last_clean":"2023-10-16T13:47:51.501660+0000","last_became_active":"2023-10-16T13:47:49.803973+0000","last_became_peered":"2023-10-16T13:47:49.803973+0000","last_unstale":"2023-10-16T13:47:51.501660+0000","last_undegraded":"2023-10-16T13:47:51.501660+0000","last_fullsized":"2023-10-16T13:47:51.501660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:52:36.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798577+0000","last_change":"2023-10-16T13:47:48.804481+0000","last_active":"2023-10-16T13:47:49.798577+0000","last_peered":"2023-10-16T13:47:49.798577+0000","last_clean":"2023-10-16T13:47:49.798577+0000","last_became_active":"2023-10-16T13:47:48.804187+0000","last_became_peered":"2023-10-16T13:47:48.804187+0000","last_unstale":"2023-10-16T13:47:49.798577+0000","last_undegraded":"2023-10-16T13:47:49.798577+0000","last_fullsized":"2023-10-16T13:47:49.798577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:18:32.167165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.502100+0000","last_change":"2023-10-16T13:47:49.806701+0000","last_active":"2023-10-16T13:47:51.502100+0000","last_peered":"2023-10-16T13:47:51.502100+0000","last_clean":"2023-10-16T13:47:51.502100+0000","last_became_active":"2023-10-16T13:47:49.806235+0000","last_became_peered":"2023-10-16T13:47:49.806235+0000","last_unstale":"2023-10-16T13:47:51.502100+0000","last_undegraded":"2023-10-16T13:47:51.502100+0000","last_fullsized":"2023-10-16T13:47:51.502100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:22.270448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798227+0000","last_change":"2023-10-16T13:47:48.799864+0000","last_active":"2023-10-16T13:47:49.798227+0000","last_peered":"2023-10-16T13:47:49.798227+0000","last_clean":"2023-10-16T13:47:49.798227+0000","last_became_active":"2023-10-16T13:47:48.799553+0000","last_became_peered":"2023-10-16T13:47:48.799553+0000","last_unstale":"2023-10-16T13:47:49.798227+0000","last_undegraded":"2023-10-16T13:47:49.798227+0000","last_fullsized":"2023-10-16T13:47:49.798227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:12.741379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501470+0000","last_change":"2023-10-16T13:47:49.802734+0000","last_active":"2023-10-16T13:47:51.501470+0000","last_peered":"2023-10-16T13:47:51.501470+0000","last_clean":"2023-10-16T13:47:51.501470+0000","last_became_active":"2023-10-16T13:47:49.802440+0000","last_became_peered":"2023-10-16T13:47:49.802440+0000","last_unstale":"2023-10-16T13:47:51.501470+0000","last_undegraded":"2023-10-16T13:47:51.501470+0000","last_fullsized":"2023-10-16T13:47:51.501470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:37:09.179927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.797265+0000","last_change":"2023-10-16T13:47:48.799838+0000","last_active":"2023-10-16T13:47:49.797265+0000","last_peered":"2023-10-16T13:47:49.797265+0000","last_clean":"2023-10-16T13:47:49.797265+0000","last_became_active":"2023-10-16T13:47:48.797351+0000","last_became_peered":"2023-10-16T13:47:48.797351+0000","last_unstale":"2023-10-16T13:47:49.797265+0000","last_undegraded":"2023-10-16T13:47:49.797265+0000","last_fullsized":"2023-10-16T13:47:49.797265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:03:54.176565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493405+0000","last_change":"2023-10-16T13:47:49.807965+0000","last_active":"2023-10-16T13:47:51.493405+0000","last_peered":"2023-10-16T13:47:51.493405+0000","last_clean":"2023-10-16T13:47:51.493405+0000","last_became_active":"2023-10-16T13:47:49.807669+0000","last_became_peered":"2023-10-16T13:47:49.807669+0000","last_unstale":"2023-10-16T13:47:51.493405+0000","last_undegraded":"2023-10-16T13:47:51.493405+0000","last_fullsized":"2023-10-16T13:47:51.493405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:02.133168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.798463+0000","last_change":"2023-10-16T13:47:48.801278+0000","last_active":"2023-10-16T13:47:49.798463+0000","last_peered":"2023-10-16T13:47:49.798463+0000","last_clean":"2023-10-16T13:47:49.798463+0000","last_became_active":"2023-10-16T13:47:48.800907+0000","last_became_peered":"2023-10-16T13:47:48.800907+0000","last_unstale":"2023-10-16T13:47:49.798463+0000","last_undegraded":"2023-10-16T13:47:49.798463+0000","last_fullsized":"2023-10-16T13:47:49.798463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:21:39.451082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:50.794656+0000","last_change":"2023-10-16T13:47:49.802147+0000","last_active":"2023-10-16T13:47:50.794656+0000","last_peered":"2023-10-16T13:47:50.794656+0000","last_clean":"2023-10-16T13:47:50.794656+0000","last_became_active":"2023-10-16T13:47:49.801805+0000","last_became_peered":"2023-10-16T13:47:49.801805+0000","last_unstale":"2023-10-16T13:47:50.794656+0000","last_undegraded":"2023-10-16T13:47:50.794656+0000","last_fullsized":"2023-10-16T13:47:50.794656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:19.990204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795214+0000","last_change":"2023-10-16T13:47:48.805977+0000","last_active":"2023-10-16T13:47:49.795214+0000","last_peered":"2023-10-16T13:47:49.795214+0000","last_clean":"2023-10-16T13:47:49.795214+0000","last_became_active":"2023-10-16T13:47:48.805675+0000","last_became_peered":"2023-10-16T13:47:48.805675+0000","last_unstale":"2023-10-16T13:47:49.795214+0000","last_undegraded":"2023-10-16T13:47:49.795214+0000","last_fullsized":"2023-10-16T13:47:49.795214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:24:06.014991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493060+0000","last_change":"2023-10-16T13:47:49.807923+0000","last_active":"2023-10-16T13:47:51.493060+0000","last_peered":"2023-10-16T13:47:51.493060+0000","last_clean":"2023-10-16T13:47:51.493060+0000","last_became_active":"2023-10-16T13:47:49.807652+0000","last_became_peered":"2023-10-16T13:47:49.807652+0000","last_unstale":"2023-10-16T13:47:51.493060+0000","last_undegraded":"2023-10-16T13:47:51.493060+0000","last_fullsized":"2023-10-16T13:47:51.493060+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:11:08.898428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.790628+0000","last_change":"2023-10-16T13:47:48.806895+0000","last_active":"2023-10-16T13:47:49.790628+0000","last_peered":"2023-10-16T13:47:49.790628+0000","last_clean":"2023-10-16T13:47:49.790628+0000","last_became_active":"2023-10-16T13:47:48.806633+0000","last_became_peered":"2023-10-16T13:47:48.806633+0000","last_unstale":"2023-10-16T13:47:49.790628+0000","last_undegraded":"2023-10-16T13:47:49.790628+0000","last_fullsized":"2023-10-16T13:47:49.790628+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:33:55.819398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.501127+0000","last_change":"2023-10-16T13:47:49.799414+0000","last_active":"2023-10-16T13:47:51.501127+0000","last_peered":"2023-10-16T13:47:51.501127+0000","last_clean":"2023-10-16T13:47:51.501127+0000","last_became_active":"2023-10-16T13:47:49.799231+0000","last_became_peered":"2023-10-16T13:47:49.799231+0000","last_unstale":"2023-10-16T13:47:51.501127+0000","last_undegraded":"2023-10-16T13:47:51.501127+0000","last_fullsized":"2023-10-16T13:47:51.501127+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:52:42.273931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.792612+0000","last_change":"2023-10-16T13:47:48.800526+0000","last_active":"2023-10-16T13:47:49.792612+0000","last_peered":"2023-10-16T13:47:49.792612+0000","last_clean":"2023-10-16T13:47:49.792612+0000","last_became_active":"2023-10-16T13:47:48.800240+0000","last_became_peered":"2023-10-16T13:47:48.800240+0000","last_unstale":"2023-10-16T13:47:49.792612+0000","last_undegraded":"2023-10-16T13:47:49.792612+0000","last_fullsized":"2023-10-16T13:47:49.792612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:47:38.342944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-16T13:47:51.493545+0000","last_change":"2023-10-16T13:47:49.801024+0000","last_active":"2023-10-16T13:47:51.493545+0000","last_peered":"2023-10-16T13:47:51.493545+0000","last_clean":"2023-10-16T13:47:51.493545+0000","last_became_active":"2023-10-16T13:47:49.800396+0000","last_became_peered":"2023-10-16T13:47:49.800396+0000","last_unstale":"2023-10-16T13:47:51.493545+0000","last_undegraded":"2023-10-16T13:47:51.493545+0000","last_fullsized":"2023-10-16T13:47:51.493545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:48.777322+0000","last_clean_scrub_stamp":"2023-10-16T13:47:48.777322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:46.312115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.823570+0000","last_change":"2023-10-16T13:47:48.800119+0000","last_active":"2023-10-16T13:47:49.823570+0000","last_peered":"2023-10-16T13:47:49.823570+0000","last_clean":"2023-10-16T13:47:49.823570+0000","last_became_active":"2023-10-16T13:47:48.799820+0000","last_became_peered":"2023-10-16T13:47:48.799820+0000","last_unstale":"2023-10-16T13:47:49.823570+0000","last_undegraded":"2023-10-16T13:47:49.823570+0000","last_fullsized":"2023-10-16T13:47:49.823570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:47:47.772786+0000","last_clean_scrub_stamp":"2023-10-16T13:47:47.772786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:30:32.788342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":224,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-16T13:47:49.795199+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:47:49.795199+0000","last_peered":"2023-10-16T13:47:49.795199+0000","last_clean":"2023-10-16T13:47:49.795199+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:47:49.795199+0000","last_undegraded":"2023-10-16T13:47:49.795199+0000","last_fullsized":"2023-10-16T13:47:49.795199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1679360,"data_stored":1057637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.82699999999999996},"last":0.60799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.83099999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.53600000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.751,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48999999999999999,"15min":0.53700000000000003},"min":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.51100000000000001,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54700000000000004,"15min":0.58699999999999997},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.625},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.752}]},{"osd":6,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.82899999999999996},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":467809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.23100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86099999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.157,"15min":1.157},"last":0.53600000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.85699999999999998},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":10.964},"last":0.629},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.39000000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.754},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.41699999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.036},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":467157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.317,"15min":0.33300000000000002},"min":{"1min":0.23699999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.35099999999999998},"min":{"1min":0.25900000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.752},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.378,"15min":0.41099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.88},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.40500000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.905},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":1.879},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.84399999999999997,"15min":0.89000000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84099999999999997,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":0.90400000000000003,"15min":1.925},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.872,"15min":1.085},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1671168,"data_stored":1057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.32900000000000001,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.254,"15min":0.23699999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59499999999999997,"5min":0.624,"15min":3.8849999999999998},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.36599999999999999,"15min":0.38100000000000001},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.439},"min":{"1min":0.35999999999999999,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58099999999999996,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":4.0650000000000004},"last":0.624}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.36799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":4.0369999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.753}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.626,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":4.2359999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.2119999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":4.2649999999999997},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":466172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.316,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.186},"max":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.99199999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.78700000000000003},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51800000000000002,"5min":0.60599999999999998,"15min":0.67800000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.436,"5min":0.39400000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55100000000000005,"5min":0.57699999999999996,"15min":1.153},"last":0.621}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.054},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.623},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.379},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":0.98199999999999998,"15min":1.395},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.875,"5min":0.93000000000000005,"15min":6.0499999999999998},"last":0.83899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":468791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.46899999999999997},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":5.8890000000000002},"last":0.433},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.40699999999999997},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.181},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.35299999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.89100000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":2.3519999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.29599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":2.4820000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84399999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.754},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.753},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85599999999999998,"5min":0.97099999999999997,"15min":5.7560000000000002},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.74399999999999999},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.95399999999999996,"15min":5.8559999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.67200000000000004},"min":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.96199999999999997,"15min":2.2999999999999998},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.90800000000000003,"15min":2.4039999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":2.2799999999999998},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.77600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.90700000000000003,"15min":5.8179999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":2.4430000000000001},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":468893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63400000000000001,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.46800000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63800000000000001,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69499999999999995,"5min":0.77900000000000003,"15min":0.88},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51300000000000001,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":0.81200000000000006},"last":0.40000000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":0.94199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59399999999999997,"15min":0.63400000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.60899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":467227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.503},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.28599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.318}]},{"osd":1,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.35599999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.80500000000000005},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.84399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.433}]},{"osd":4,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.82299999999999995,"15min":1.141},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.58999999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.84299999999999997,"15min":1.3700000000000001},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69799999999999995,"5min":0.80200000000000005,"15min":0.879},"last":0.40799999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.90700000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.64000000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.755,"5min":0.87,"15min":0.87},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:47:54.375 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:47:54.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:47:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.539+0000 7f6f76520700 1 Processor -- start 2023-10-16T13:47:54.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.539+0000 7f6f76520700 1 -- start start 2023-10-16T13:47:54.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f76520700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f700b03d0 0x7f6f700cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f76520700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f700b0c30 con 0x7f6f7015de80 2023-10-16T13:47:54.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f76520700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7015f040 con 0x7f6f7006d070 2023-10-16T13:47:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f76520700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7015f320 con 0x7f6f700b03d0 2023-10-16T13:47:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f700b03d0 0x7f6f700cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f7015de80 0x7f6f7006c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57822/0 (socket says 172.21.15.5:57822) 2023-10-16T13:47:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6ffff700 1 -- 172.21.15.5:0/475142867 learned_addr learned my addr 172.21.15.5:0/475142867 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:54.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/475142867 >> v1:172.21.15.112:6789/0 conn(0x7f6f7006d070 legacy=0x7f6f700cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:54.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/475142867 >> v1:172.21.15.5:6789/0 conn(0x7f6f7015de80 legacy=0x7f6f7006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/475142867 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7006c160 con 0x7f6f700b03d0 2023-10-16T13:47:54.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6effd700 1 -- 172.21.15.5:0/475142867 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589869166 0 0) 0x7f6f700b0c30 con 0x7f6f7015de80 2023-10-16T13:47:54.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6f7fe700 1 --2- 172.21.15.5:0/475142867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f700cbbe0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009840 tx=0x7f6f64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de815818017b33a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6effd700 1 -- 172.21.15.5:0/475142867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64004230 con 0x7f6f700b03d0 2023-10-16T13:47:54.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6effd700 1 -- 172.21.15.5:0/475142867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64004390 con 0x7f6f700b03d0 2023-10-16T13:47:54.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.540+0000 7f6f6effd700 1 -- 172.21.15.5:0/475142867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640036a0 con 0x7f6f700b03d0 2023-10-16T13:47:54.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 -- 172.21.15.5:0/475142867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 msgr2=0x7f6f700cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 --2- 172.21.15.5:0/475142867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f700cbbe0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009840 tx=0x7f6f64009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:54.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 -- 172.21.15.5:0/475142867 shutdown_connections 2023-10-16T13:47:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 --2- 172.21.15.5:0/475142867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f700cbbe0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 -- 172.21.15.5:0/475142867 >> 172.21.15.5:0/475142867 conn(0x7f6f700d1590 msgr2=0x7f6f700d1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 -- 172.21.15.5:0/475142867 shutdown_connections 2023-10-16T13:47:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.541+0000 7f6f76520700 1 -- 172.21.15.5:0/475142867 wait complete. 2023-10-16T13:47:54.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.542+0000 7f6f76520700 1 Processor -- start 2023-10-16T13:47:54.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.542+0000 7f6f76520700 1 -- start start 2023-10-16T13:47:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f76520700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7006d070 0x7f6f70158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f76520700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f7014fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f76520700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f7015de80 0x7f6f700c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f76520700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70158830 con 0x7f6f700b03d0 2023-10-16T13:47:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f76520700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70159190 con 0x7f6f7006d070 2023-10-16T13:47:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f76520700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700c7cf0 con 0x7f6f7015de80 2023-10-16T13:47:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f6f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f7014fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f6f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f7014fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47826/0 (socket says 172.21.15.5:47826) 2023-10-16T13:47:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/612757912 learned_addr learned my addr 172.21.15.5:0/612757912 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f74abd700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f7015de80 0x7f6f700c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.543+0000 7f6f6ffff700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7006d070 0x7f6f70158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f7015de80 msgr2=0x7f6f700c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6f7fe700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f7015de80 0x7f6f700c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7006d070 msgr2=0x7f6f70158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6f7fe700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7006d070 0x7f6f70158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6f7fe700 1 -- 172.21.15.5:0/612757912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640094a0 con 0x7f6f700b03d0 2023-10-16T13:47:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6ffff700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7006d070 0x7f6f70158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6f7fe700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f7014fc30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f6f640090b0 tx=0x7f6f64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011830 con 0x7f6f700b03d0 2023-10-16T13:47:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6401e070 con 0x7f6f700b03d0 2023-10-16T13:47:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f70158170 con 0x7f6f700b03d0 2023-10-16T13:47:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011bf0 con 0x7f6f700b03d0 2023-10-16T13:47:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.544+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f70150170 con 0x7f6f700b03d0 2023-10-16T13:47:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.545+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f70158970 con 0x7f6f700b03d0 2023-10-16T13:47:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.545+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f6f64011d50 con 0x7f6f700b03d0 2023-10-16T13:47:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.546+0000 7f6f6cff9700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f5c06b1d0 0x7f6f5c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.546+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f6408ad30 con 0x7f6f700b03d0 2023-10-16T13:47:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.546+0000 7f6f6ffff700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f5c06b1d0 0x7f6f5c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.547+0000 7f6f6ffff700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f5c06b1d0 0x7f6f5c06d690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6f60000f60 tx=0x7f6f60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.551+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f70158970 con 0x7f6f700b03d0 2023-10-16T13:47:54.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.832+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6f70158970 con 0x7f6f700b03d0 2023-10-16T13:47:54.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.835+0000 7f6f6cff9700 1 -- 172.21.15.5:0/612757912 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6f70158970 con 0x7f6f700b03d0 2023-10-16T13:47:54.838 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:47:54.838 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:47:54.838 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:47:54.838 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:47:54.838 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:47:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f5c06b1d0 msgr2=0x7f6f5c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f5c06b1d0 0x7f6f5c06d690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6f60000f60 tx=0x7f6f60009040 comp rx=0 tx=0).stop 2023-10-16T13:47:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 msgr2=0x7f6f7014fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f7014fc30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f6f640090b0 tx=0x7f6f64004750 comp rx=0 tx=0).stop 2023-10-16T13:47:54.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 shutdown_connections 2023-10-16T13:47:54.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f5c06b1d0 0x7f6f5c06d690 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f7015de80 0x7f6f700c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7006d070 0x7f6f70158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 --2- 172.21.15.5:0/612757912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f700b03d0 0x7f6f7014fc30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 >> 172.21.15.5:0/612757912 conn(0x7f6f700d1590 msgr2=0x7f6f7006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:54.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 shutdown_connections 2023-10-16T13:47:54.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.837+0000 7f6f76520700 1 -- 172.21.15.5:0/612757912 wait complete. 2023-10-16T13:47:54.843 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:47:54.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:47:54.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.977+0000 7f39356ea700 1 Processor -- start 2023-10-16T13:47:54.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.977+0000 7f39356ea700 1 -- start start 2023-10-16T13:47:54.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.977+0000 7f39356ea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f393015de40 0x7f39300cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f39356ea700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39300d2560 0x7f39300b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f39356ea700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300cf580 con 0x7f39300d1650 2023-10-16T13:47:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f39356ea700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300cf820 con 0x7f39300d2560 2023-10-16T13:47:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f39356ea700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300b0430 con 0x7f393015de40 2023-10-16T13:47:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39300d2560 0x7f39300b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392e7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39300d1650 0x7f39300d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57838/0 (socket says 172.21.15.5:57838) 2023-10-16T13:47:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392e7fc700 1 -- 172.21.15.5:0/1193685049 learned_addr learned my addr 172.21.15.5:0/1193685049 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392effd700 1 --2- 172.21.15.5:0/1193685049 >> v2:172.21.15.112:3300/0 conn(0x7f393015de40 0x7f39300cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392f7fe700 1 -- 172.21.15.5:0/1193685049 >> v2:172.21.15.112:3300/0 conn(0x7f393015de40 msgr2=0x7f39300cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392f7fe700 1 --2- 172.21.15.5:0/1193685049 >> v2:172.21.15.112:3300/0 conn(0x7f393015de40 0x7f39300cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392f7fe700 1 -- 172.21.15.5:0/1193685049 >> v1:172.21.15.5:6789/0 conn(0x7f39300d1650 legacy=0x7f39300d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392f7fe700 1 -- 172.21.15.5:0/1193685049 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300b0710 con 0x7f39300d2560 2023-10-16T13:47:54.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392dffb700 1 -- 172.21.15.5:0/1193685049 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094313656 0 0) 0x7f39300cf580 con 0x7f39300d1650 2023-10-16T13:47:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392f7fe700 1 --2- 172.21.15.5:0/1193685049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39300d2560 0x7f39300b11f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f39300d4970 tx=0x7f392800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b79beb19debb1f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392dffb700 1 -- 172.21.15.5:0/1193685049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800e070 con 0x7f39300d2560 2023-10-16T13:47:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392dffb700 1 -- 172.21.15.5:0/1193685049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392800bbd0 con 0x7f39300d2560 2023-10-16T13:47:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.978+0000 7f392dffb700 1 -- 172.21.15.5:0/1193685049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928012430 con 0x7f39300d2560 2023-10-16T13:47:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 -- 172.21.15.5:0/1193685049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39300d2560 msgr2=0x7f39300b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 --2- 172.21.15.5:0/1193685049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39300d2560 0x7f39300b11f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f39300d4970 tx=0x7f392800b330 comp rx=0 tx=0).stop 2023-10-16T13:47:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 -- 172.21.15.5:0/1193685049 shutdown_connections 2023-10-16T13:47:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 --2- 172.21.15.5:0/1193685049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39300d2560 0x7f39300b11f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 --2- 172.21.15.5:0/1193685049 >> v2:172.21.15.112:3300/0 conn(0x7f393015de40 0x7f39300cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 -- 172.21.15.5:0/1193685049 >> 172.21.15.5:0/1193685049 conn(0x7f39300d3900 msgr2=0x7f39300d3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 -- 172.21.15.5:0/1193685049 shutdown_connections 2023-10-16T13:47:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.979+0000 7f39356ea700 1 -- 172.21.15.5:0/1193685049 wait complete. 2023-10-16T13:47:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.981+0000 7f39356ea700 1 Processor -- start 2023-10-16T13:47:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.981+0000 7f39356ea700 1 -- start start 2023-10-16T13:47:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39300d1650 0x7f393015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39300d2560 0x7f393009e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 0x7f39300b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393015c800 con 0x7f393015de40 2023-10-16T13:47:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393009d850 con 0x7f39300d1650 2023-10-16T13:47:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393009db30 con 0x7f39300d2560 2023-10-16T13:47:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 0x7f39300b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 0x7f39300b8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47842/0 (socket says 172.21.15.5:47842) 2023-10-16T13:47:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 -- 172.21.15.5:0/2633179689 learned_addr learned my addr 172.21.15.5:0/2633179689 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392effd700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39300d1650 0x7f393015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392e7fc700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39300d2560 0x7f393009e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 -- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39300d2560 msgr2=0x7f393009e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39300d2560 0x7f393009e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 -- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39300d1650 msgr2=0x7f393015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39300d1650 0x7f393015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 -- 172.21.15.5:0/2633179689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009a70 con 0x7f393015de40 2023-10-16T13:47:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392e7fc700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39300d2560 0x7f393009e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f392f7fe700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 0x7f39300b8e40 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3928013000 tx=0x7f3928004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928012430 con 0x7f393015de40 2023-10-16T13:47:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928020070 con 0x7f393015de40 2023-10-16T13:47:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393009de10 con 0x7f393015de40 2023-10-16T13:47:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.982+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928004280 con 0x7f393015de40 2023-10-16T13:47:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.983+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393009e3d0 con 0x7f393015de40 2023-10-16T13:47:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.983+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393004ebb0 con 0x7f393015de40 2023-10-16T13:47:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.984+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f39280043e0 con 0x7f393015de40 2023-10-16T13:47:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.984+0000 7f39177fe700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f391c06b1d0 0x7f391c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.984+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3928022070 con 0x7f393015de40 2023-10-16T13:47:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.985+0000 7f392effd700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f391c06b1d0 0x7f391c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.985+0000 7f392effd700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f391c06b1d0 0x7f391c06d690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f39300a1250 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:54.989+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39280569c0 con 0x7f393015de40 2023-10-16T13:47:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.236+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39300d1c30 con 0x7f393015de40 2023-10-16T13:47:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.237+0000 7f39177fe700 1 -- 172.21.15.5:0/2633179689 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f3928059fe0 con 0x7f393015de40 2023-10-16T13:47:55.240 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:47:55.240 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:49.207070+0000","modified":"2023-10-16T13:47:52.244374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3043002184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3043002184},{"type":"v1","addr":"172.21.15.5:6834","nonce":3043002184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-16T13:47:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f391c06b1d0 msgr2=0x7f391c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f391c06b1d0 0x7f391c06d690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f39300a1250 tx=0x7f3920008040 comp rx=0 tx=0).stop 2023-10-16T13:47:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 msgr2=0x7f39300b8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 0x7f39300b8e40 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3928013000 tx=0x7f3928004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 shutdown_connections 2023-10-16T13:47:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f393015de40 0x7f39300b8e40 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39300d1650 0x7f393015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f391c06b1d0 0x7f391c06d690 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 --2- 172.21.15.5:0/2633179689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39300d2560 0x7f393009e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 >> 172.21.15.5:0/2633179689 conn(0x7f39300d3900 msgr2=0x7f39300d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 shutdown_connections 2023-10-16T13:47:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.239+0000 7f39356ea700 1 -- 172.21.15.5:0/2633179689 wait complete. 2023-10-16T13:47:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2023-10-16T13:47:55.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:47:49.207070+0000', 'modified': '2023-10-16T13:47:52.244374+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6903}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6903': {'gid': 6903, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/3043002184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3043002184}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 3043002184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:47:55.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:47:55.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T13:47:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.786+0000 7ff2a9ad4700 1 Processor -- start 2023-10-16T13:47:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.786+0000 7ff2a9ad4700 1 -- start start 2023-10-16T13:47:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a9ad4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2a40cd4b0 0x7ff2a40cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a9ad4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40ce3b0 con 0x7ff2a415a850 2023-10-16T13:47:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a9ad4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40b6290 con 0x7ff2a40b2940 2023-10-16T13:47:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a9ad4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40cc220 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2a40cd4b0 0x7ff2a40cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2a415a850 0x7ff2a40ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57850/0 (socket says 172.21.15.5:57850) 2023-10-16T13:47:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a37fe700 1 -- 172.21.15.5:0/4082119659 learned_addr learned my addr 172.21.15.5:0/4082119659 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a27fc700 1 -- 172.21.15.5:0/4082119659 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858200020 0 0) 0x7ff2a40ce3b0 con 0x7ff2a415a850 2023-10-16T13:47:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a27fc700 1 -- 172.21.15.5:0/4082119659 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff28c0035b0 con 0x7ff2a415a850 2023-10-16T13:47:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/4082119659 >> v1:172.21.15.112:6789/0 conn(0x7ff2a40b2940 legacy=0x7ff2a40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/4082119659 >> v1:172.21.15.5:6789/0 conn(0x7ff2a415a850 legacy=0x7ff2a40ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/4082119659 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40cc500 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/4082119659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a40cbc40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff298009840 tx=0x7ff298009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbe3384815b6971 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a27fc700 1 -- 172.21.15.5:0/4082119659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298004230 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a27fc700 1 -- 172.21.15.5:0/4082119659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298004390 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.787+0000 7ff2a27fc700 1 -- 172.21.15.5:0/4082119659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980036c0 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/4082119659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 msgr2=0x7ff2a40cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/4082119659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a40cbc40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff298009840 tx=0x7ff298009b50 comp rx=0 tx=0).stop 2023-10-16T13:47:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/4082119659 shutdown_connections 2023-10-16T13:47:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/4082119659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a40cbc40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/4082119659 >> 172.21.15.5:0/4082119659 conn(0x7ff2a406dac0 msgr2=0x7ff2a406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/4082119659 shutdown_connections 2023-10-16T13:47:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.788+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/4082119659 wait complete. 2023-10-16T13:47:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.789+0000 7ff2a9ad4700 1 Processor -- start 2023-10-16T13:47:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.789+0000 7ff2a9ad4700 1 -- start start 2023-10-16T13:47:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a9ad4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2a40b2940 0x7ff2a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a9ad4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a406ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a9ad4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a415a850 0x7ff2a415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a9ad4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a41f7510 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a9ad4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415cc20 con 0x7ff2a415a850 2023-10-16T13:47:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a9ad4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415c940 con 0x7ff2a40b2940 2023-10-16T13:47:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a406ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a406ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47854/0 (socket says 172.21.15.5:47854) 2023-10-16T13:47:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2335794376 learned_addr learned my addr 172.21.15.5:0/2335794376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2a40b2940 0x7ff2a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.790+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a415a850 0x7ff2a415bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2a40b2940 msgr2=0x7ff2a406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2a40b2940 0x7ff2a406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a415a850 msgr2=0x7ff2a415bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a415a850 0x7ff2a415bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2335794376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980094a0 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a406ad80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff2980090b0 tx=0x7ff298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff28bfff700 1 -- 172.21.15.5:0/2335794376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298011630 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff28bfff700 1 -- 172.21.15.5:0/2335794376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298011790 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff28bfff700 1 -- 172.21.15.5:0/2335794376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298011b00 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a41f6e50 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.791+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a4157090 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.792+0000 7ff28bfff700 1 -- 172.21.15.5:0/2335794376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7ff298018040 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.793+0000 7ff28bfff700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff29006b1d0 0x7ff29006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.793+0000 7ff28bfff700 1 -- 172.21.15.5:0/2335794376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff29808a320 con 0x7ff2a40cd4b0 2023-10-16T13:47:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.793+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff29006b1d0 0x7ff29006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.794+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff29006b1d0 0x7ff29006d690 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff294005910 tx=0x7ff294009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.795+0000 7ff2b5cbeb80 1 Processor -- start 2023-10-16T13:47:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.795+0000 7ff2b5cbeb80 1 -- start start 2023-10-16T13:47:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb9da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb9b630 0x5597abb9dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abb716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597abae7c20 con 0x5597abb96220 2023-10-16T13:47:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597abaccc10 con 0x5597abb9b630 2023-10-16T13:47:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597abaca530 con 0x5597abb71010 2023-10-16T13:47:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb9da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb9da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47860/0 (socket says 172.21.15.5:47860) 2023-10-16T13:47:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 -- 172.21.15.5:0/2477571336 learned_addr learned my addr 172.21.15.5:0/2477571336 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 -- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 msgr2=0x5597abb716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb9b630 0x5597abb9dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abb716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 -- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb9b630 msgr2=0x5597abb9dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb9b630 0x5597abb9dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 -- 172.21.15.5:0/2477571336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597aba833a0 con 0x5597abb96220 2023-10-16T13:47:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb9da70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff294005990 tx=0x7ff294011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65da29eb9485514b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2897fa700 1 -- 172.21.15.5:0/2477571336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294007560 con 0x5597abb96220 2023-10-16T13:47:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.796+0000 7ff2897fa700 1 -- 172.21.15.5:0/2477571336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2940076c0 con 0x5597abb96220 2023-10-16T13:47:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2897fa700 1 -- 172.21.15.5:0/2477571336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400e820 con 0x5597abb96220 2023-10-16T13:47:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2477571336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 msgr2=0x5597abb9da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb9da70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff294005990 tx=0x7ff294011000 comp rx=0 tx=0).stop 2023-10-16T13:47:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2477571336 shutdown_connections 2023-10-16T13:47:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abb716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb9da70 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2477571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb9b630 0x5597abb9dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2477571336 >> 172.21.15.5:0/2477571336 conn(0x5597abaa0d80 msgr2=0x5597abbbbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2477571336 shutdown_connections 2023-10-16T13:47:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.797+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2477571336 wait complete. 2023-10-16T13:47:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.798+0000 7ff2b5cbeb80 1 -- start start 2023-10-16T13:47:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.798+0000 7ff2b5cbeb80 1 Processor -- start 2023-10-16T13:47:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb95690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb99480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb9b630 0x5597abb999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597abac5e20 con 0x5597abb96220 2023-10-16T13:47:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597aba626c0 con 0x5597abb71010 2023-10-16T13:47:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597aba62360 con 0x5597abb9b630 2023-10-16T13:47:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 10 client.0 _ll_register_callbacks cb 0x5597ab8bf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:47:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb99480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47868/0 (socket says 172.21.15.5:47868) 2023-10-16T13:47:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2192547336 learned_addr learned my addr 172.21.15.5:0/2192547336 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb95690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb9b630 0x5597abb999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb9b630 msgr2=0x5597abb999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb9b630 0x5597abb999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 msgr2=0x5597abb95690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb95690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 -- 172.21.15.5:0/2192547336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29400f040 con 0x5597abb96220 2023-10-16T13:47:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb9b630 0x5597abb999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:47:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb99480 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff298009ea0 tx=0x7ff298058830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3532d91665c9fddf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2827fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:47:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2827fc700 1 -- 172.21.15.5:0/2192547336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298059230 con 0x5597abb96220 2023-10-16T13:47:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2827fc700 1 -- 172.21.15.5:0/2192547336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff298058dd0 con 0x5597abb96220 2023-10-16T13:47:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.799+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597abb665b0 con 0x5597abb96220 2023-10-16T13:47:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2827fc700 1 -- 172.21.15.5:0/2192547336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff29805cf20 con 0x5597abb96220 2023-10-16T13:47:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 10 client.7053 fetch_fsmap learned FSMap version 60 2023-10-16T13:47:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5597ab8f0d90 con 0x5597abb96220 2023-10-16T13:47:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2827fc700 1 -- 172.21.15.5:0/2192547336 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597abb665b0 con 0x5597abb96220 2023-10-16T13:47:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2827fc700 1 -- 172.21.15.5:0/2192547336 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2980582c0 con 0x5597abb96220 2023-10-16T13:47:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 10 client.7053 fetch_fsmap finished waiting for FSMap version 60 2023-10-16T13:47:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 10 client.7053 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:47:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 20 client.7053 populate_metadata read hostname 'smithi005' 2023-10-16T13:47:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abb73ef0 0x5597abb9ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 4 client.7053 mds_command: new command op to 6903 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:47:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 --> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597ababee00 con 0x5597abb73ef0 2023-10-16T13:47:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abb73ef0 0x5597abb9ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2827fc700 10 client.7053 ms_handle_connect on v2:172.21.15.5:6832/3043002184 2023-10-16T13:47:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.800+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abb73ef0 0x5597abb9ee90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=303139a19eb901ea server_cookie=a10f9f0c0ce9cfde in_seq=0 out_seq=0 2023-10-16T13:47:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2827fc700 1 -- 172.21.15.5:0/2192547336 <== mds.0 v2:172.21.15.5:6832/3043002184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5597ababee00 con 0x5597abb73ef0 2023-10-16T13:47:55.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2827fc700 10 client.7053 handle_command_reply: tid=0 2023-10-16T13:47:55.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 client.7053 shutdown 2023-10-16T13:47:55.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 msgr2=0x5597abb99480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb99480 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff298009ea0 tx=0x7ff298058830 comp rx=0 tx=0).stop 2023-10-16T13:47:55.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 shutdown_connections 2023-10-16T13:47:55.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abb73ef0 0x5597abb9ee90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb9b630 0x5597abb999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2827fc700 0 client.7053 ms_handle_reset on v2:172.21.15.5:6832/3043002184 2023-10-16T13:47:55.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb95690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2192547336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb96220 0x5597abb99480 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 >> 172.21.15.5:0/2192547336 conn(0x5597abaa0d80 msgr2=0x5597abbbbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 shutdown_connections 2023-10-16T13:47:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2192547336 wait complete. 2023-10-16T13:47:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.801+0000 7ff2b5cbeb80 20 client.7053 trim_cache size 0 max 16384 2023-10-16T13:47:55.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.819+0000 7ff2b5cbeb80 1 Processor -- start 2023-10-16T13:47:55.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.819+0000 7ff2b5cbeb80 1 -- start start 2023-10-16T13:47:55.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb9b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb96220 0x5597abb954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597ab9468d0 con 0x5597abb9b630 2023-10-16T13:47:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597abbb2b90 con 0x5597abb71010 2023-10-16T13:47:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597abb680e0 con 0x5597abb96220 2023-10-16T13:47:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47876/0 (socket says 172.21.15.5:47876) 2023-10-16T13:47:55.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 -- 172.21.15.5:0/2213189527 learned_addr learned my addr 172.21.15.5:0/2213189527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb96220 0x5597abb954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb9b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 -- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb96220 msgr2=0x5597abb954a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb96220 0x5597abb954a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 -- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 msgr2=0x5597abb9b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb9b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.820+0000 7ff2a3fff700 1 -- 172.21.15.5:0/2213189527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597abb6fb20 con 0x5597abb9b630 2023-10-16T13:47:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb959e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00adf0 tx=0x7ff29c00d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2949510e754c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff289ffb700 1 -- 172.21.15.5:0/2213189527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c012070 con 0x5597abb9b630 2023-10-16T13:47:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff289ffb700 1 -- 172.21.15.5:0/2213189527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00d2e0 con 0x5597abb9b630 2023-10-16T13:47:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff289ffb700 1 -- 172.21.15.5:0/2213189527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00b650 con 0x5597abb9b630 2023-10-16T13:47:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2213189527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 msgr2=0x5597abb959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb959e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00adf0 tx=0x7ff29c00d750 comp rx=0 tx=0).stop 2023-10-16T13:47:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2213189527 shutdown_connections 2023-10-16T13:47:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb959e0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb71010 0x5597abb9b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/2213189527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb96220 0x5597abb954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2213189527 >> 172.21.15.5:0/2213189527 conn(0x5597abaa0d80 msgr2=0x5597abbda6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2213189527 shutdown_connections 2023-10-16T13:47:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.821+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/2213189527 wait complete. 2023-10-16T13:47:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.822+0000 7ff2b5cbeb80 1 -- start start 2023-10-16T13:47:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.822+0000 7ff2b5cbeb80 1 Processor -- start 2023-10-16T13:47:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abc162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb96220 0x5597abb937c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb93d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597abc213b0 con 0x5597abb9b630 2023-10-16T13:47:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597abb727d0 con 0x5597abb96220 2023-10-16T13:47:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597abc16830 con 0x5597abb71010 2023-10-16T13:47:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2b5cbeb80 10 client.0 _ll_register_callbacks cb 0x5597ab8bf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:47:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb93d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb93d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47884/0 (socket says 172.21.15.5:47884) 2023-10-16T13:47:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 -- 172.21.15.5:0/249747086 learned_addr learned my addr 172.21.15.5:0/249747086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abc162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb96220 0x5597abb937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 -- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 msgr2=0x5597abc162f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abc162f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 -- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb96220 msgr2=0x5597abb937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb96220 0x5597abb937c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 -- 172.21.15.5:0/249747086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c00aa70 con 0x5597abb9b630 2023-10-16T13:47:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a2ffd700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb96220 0x5597abb937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2a3fff700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb93d00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x5597abb752c0 tx=0x7ff29c004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67aa0ba1fb4ffd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.823+0000 7ff2827fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:47:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2827fc700 1 -- 172.21.15.5:0/249747086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00a820 con 0x5597abb9b630 2023-10-16T13:47:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597abba18a0 con 0x5597abb9b630 2023-10-16T13:47:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2827fc700 1 -- 172.21.15.5:0/249747086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff29c004560 con 0x5597abb9b630 2023-10-16T13:47:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2827fc700 1 -- 172.21.15.5:0/249747086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff29c004760 con 0x5597abb9b630 2023-10-16T13:47:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 10 client.7059 fetch_fsmap learned FSMap version 60 2023-10-16T13:47:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5597ab8d9c10 con 0x5597abb9b630 2023-10-16T13:47:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2827fc700 1 -- 172.21.15.5:0/249747086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597abba18a0 con 0x5597abb9b630 2023-10-16T13:47:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2827fc700 1 -- 172.21.15.5:0/249747086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff29c00b450 con 0x5597abb9b630 2023-10-16T13:47:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 10 client.7059 fetch_fsmap finished waiting for FSMap version 60 2023-10-16T13:47:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 10 client.7059 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:47:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 20 client.7059 populate_metadata read hostname 'smithi005' 2023-10-16T13:47:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abba0650 0x5597abba0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 4 client.7059 mds_command: new command op to 6903 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:47:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 --> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff2940076c0 con 0x5597abba0650 2023-10-16T13:47:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.824+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abba0650 0x5597abba0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2827fc700 10 client.7059 ms_handle_connect on v2:172.21.15.5:6832/3043002184 2023-10-16T13:47:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2a37fe700 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abba0650 0x5597abba0a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f1b441df1f48eb server_cookie=3c8211828c8f9896 in_seq=0 out_seq=0 2023-10-16T13:47:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2827fc700 1 -- 172.21.15.5:0/249747086 <== mds.0 v2:172.21.15.5:6832/3043002184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7ff2940076c0 con 0x5597abba0650 2023-10-16T13:47:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2827fc700 10 client.7059 handle_command_reply: tid=0 2023-10-16T13:47:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 client.7059 shutdown 2023-10-16T13:47:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 msgr2=0x5597abb93d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb93d00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x5597abb752c0 tx=0x7ff29c004a90 comp rx=0 tx=0).stop 2023-10-16T13:47:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 shutdown_connections 2023-10-16T13:47:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:6832/3043002184,v1:172.21.15.5:6834/3043002184] conn(0x5597abba0650 0x5597abba0a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597abb9b630 0x5597abb93d00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5597abb71010 0x5597abc162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 --2- 172.21.15.5:0/249747086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5597abb96220 0x5597abb937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2827fc700 0 client.7059 ms_handle_reset on v2:172.21.15.5:6832/3043002184 2023-10-16T13:47:55.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 >> 172.21.15.5:0/249747086 conn(0x5597abaa0d80 msgr2=0x5597abb954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 shutdown_connections 2023-10-16T13:47:55.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 1 -- 172.21.15.5:0/249747086 wait complete. 2023-10-16T13:47:55.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.825+0000 7ff2b5cbeb80 20 client.7059 trim_cache size 0 max 16384 2023-10-16T13:47:55.854 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:47:55.854 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:47:55.854 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:47:55.855 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6903, 2023-10-16T13:47:55.855 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:47:55.855 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:47:55.855 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:47:55.856 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.0154471750000003, 2023-10-16T13:47:55.856 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 60, 2023-10-16T13:47:55.856 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2023-10-16T13:47:55.856 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-16T13:47:55.856 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.944729578 2023-10-16T13:47:55.856 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:47:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff29006b1d0 msgr2=0x7ff29006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff29006b1d0 0x7ff29006d690 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff294005910 tx=0x7ff294009040 comp rx=0 tx=0).stop 2023-10-16T13:47:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 msgr2=0x7ff2a406ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a406ad80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff2980090b0 tx=0x7ff298004750 comp rx=0 tx=0).stop 2023-10-16T13:47:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 shutdown_connections 2023-10-16T13:47:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a415a850 0x7ff2a415bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff29006b1d0 0x7ff29006d690 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2a40b2940 0x7ff2a406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 --2- 172.21.15.5:0/2335794376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a40cd4b0 0x7ff2a406ad80 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 >> 172.21.15.5:0/2335794376 conn(0x7ff2a406dac0 msgr2=0x7ff2a40b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 shutdown_connections 2023-10-16T13:47:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.826+0000 7ff2a9ad4700 1 -- 172.21.15.5:0/2335794376 wait complete. 2023-10-16T13:47:55.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:47:55.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.983+0000 7f06addbd700 1 Processor -- start 2023-10-16T13:47:55.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.983+0000 7f06addbd700 1 -- start start 2023-10-16T13:47:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06addbd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 0x7f06a815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06addbd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06a80b7050 0x7f06a80d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06addbd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a815e4e0 con 0x7f06a80d3fc0 2023-10-16T13:47:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06addbd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a80b7560 con 0x7f06a80b7050 2023-10-16T13:47:55.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06addbd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80b7840 con 0x7f06a815dbc0 2023-10-16T13:47:55.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06a77fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 0x7f06a815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06a7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06a80b7050 0x7f06a80d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06a77fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 0x7f06a815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45792/0 (socket says 172.21.15.5:45792) 2023-10-16T13:47:55.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06a77fe700 1 -- 172.21.15.5:0/1691149749 learned_addr learned my addr 172.21.15.5:0/1691149749 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.984+0000 7f06a7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06a80b7050 0x7f06a80d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:43788/0 (socket says 172.21.15.5:43788) 2023-10-16T13:47:55.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a7fff700 1 -- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 msgr2=0x7f06a815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:55.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a7fff700 1 --2- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 0x7f06a815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a7fff700 1 -- 172.21.15.5:0/1691149749 >> v1:172.21.15.112:6789/0 conn(0x7f06a80d3fc0 legacy=0x7f06a80d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a7fff700 1 -- 172.21.15.5:0/1691149749 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80b7b20 con 0x7f06a80b7050 2023-10-16T13:47:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a77fe700 1 --2- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 0x7f06a815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a7fff700 1 --2- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80d21d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0698009d90 tx=0x7f069800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8adc16a04334c43a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a67fc700 1 -- 172.21.15.5:0/1691149749 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800e070 con 0x7f06a80b7050 2023-10-16T13:47:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a67fc700 1 -- 172.21.15.5:0/1691149749 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069800bb20 con 0x7f06a80b7050 2023-10-16T13:47:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.985+0000 7f06a67fc700 1 -- 172.21.15.5:0/1691149749 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698012430 con 0x7f06a80b7050 2023-10-16T13:47:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 -- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 msgr2=0x7f06a80d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 --2- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80d21d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0698009d90 tx=0x7f069800b330 comp rx=0 tx=0).stop 2023-10-16T13:47:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 -- 172.21.15.5:0/1691149749 shutdown_connections 2023-10-16T13:47:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 --2- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80d21d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 --2- 172.21.15.5:0/1691149749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a815dbc0 0x7f06a815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 -- 172.21.15.5:0/1691149749 >> 172.21.15.5:0/1691149749 conn(0x7f06a809cb40 msgr2=0x7f06a80d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 -- 172.21.15.5:0/1691149749 shutdown_connections 2023-10-16T13:47:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.986+0000 7f06addbd700 1 -- 172.21.15.5:0/1691149749 wait complete. 2023-10-16T13:47:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.987+0000 7f06addbd700 1 Processor -- start 2023-10-16T13:47:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.988+0000 7f06addbd700 1 -- start start 2023-10-16T13:47:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.988+0000 7f06addbd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.988+0000 7f06addbd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80d3fc0 0x7f06a8150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.988+0000 7f06addbd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 0x7f06a80c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06addbd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80c8c80 con 0x7f06a815dbc0 2023-10-16T13:47:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06addbd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80c8180 con 0x7f06a80b7050 2023-10-16T13:47:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06addbd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80c83e0 con 0x7f06a80d3fc0 2023-10-16T13:47:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 0x7f06a80c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 0x7f06a80c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47898/0 (socket says 172.21.15.5:47898) 2023-10-16T13:47:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 -- 172.21.15.5:0/928750987 learned_addr learned my addr 172.21.15.5:0/928750987 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a6ffd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80d3fc0 0x7f06a8150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 -- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80d3fc0 msgr2=0x7f06a8150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80d3fc0 0x7f06a8150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 -- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 msgr2=0x7f06a80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 -- 172.21.15.5:0/928750987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0009500 con 0x7f06a815dbc0 2023-10-16T13:47:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06a7fff700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 0x7f06a80c7c40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0698014040 tx=0x7f0698004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698012430 con 0x7f06a815dbc0 2023-10-16T13:47:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698020070 con 0x7f06a815dbc0 2023-10-16T13:47:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0698009a70 con 0x7f06a815dbc0 2023-10-16T13:47:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698004280 con 0x7f06a815dbc0 2023-10-16T13:47:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.989+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a80c89a0 con 0x7f06a815dbc0 2023-10-16T13:47:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.990+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a804ebb0 con 0x7f06a815dbc0 2023-10-16T13:47:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.991+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f06980043e0 con 0x7f06a815dbc0 2023-10-16T13:47:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.991+0000 7f069ffff700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f068806b1d0 0x7f068806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.991+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0698022070 con 0x7f06a815dbc0 2023-10-16T13:47:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.991+0000 7f06a77fe700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f068806b1d0 0x7f068806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.992+0000 7f06a77fe700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f068806b1d0 0x7f068806d690 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f06a80ca7b0 tx=0x7f06a0009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:55.996+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06980567c0 con 0x7f06a815dbc0 2023-10-16T13:47:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.241+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06a80c7070 con 0x7f06a815dbc0 2023-10-16T13:47:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.241+0000 7f069ffff700 1 -- 172.21.15.5:0/928750987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0698059de0 con 0x7f06a815dbc0 2023-10-16T13:47:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:47:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f068806b1d0 msgr2=0x7f068806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f068806b1d0 0x7f068806d690 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f06a80ca7b0 tx=0x7f06a0009290 comp rx=0 tx=0).stop 2023-10-16T13:47:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 msgr2=0x7f06a80c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 0x7f06a80c7c40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0698014040 tx=0x7f0698004ad0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 shutdown_connections 2023-10-16T13:47:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a815dbc0 0x7f06a80c7c40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a80b7050 0x7f06a80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f068806b1d0 0x7f068806d690 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 --2- 172.21.15.5:0/928750987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80d3fc0 0x7f06a8150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 >> 172.21.15.5:0/928750987 conn(0x7f06a809cb40 msgr2=0x7f06a815cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 shutdown_connections 2023-10-16T13:47:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:56.243+0000 7f06addbd700 1 -- 172.21.15.5:0/928750987 wait complete. 2023-10-16T13:47:56.258 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:47:56.259 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:47:56.259 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:47:56.259 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:47:56.260 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:56.260 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:47:56.260 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:47:56.261 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:47:56.261 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:47:56.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.262 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:47:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:47:56.280 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:47:56.280 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:47:56.280 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.280 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:47:56.281 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:56.281 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:56.281 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:47:56.282 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:56.282 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:47:56.282 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41826sec preferred_lft 41826sec 2023-10-16T13:47:56.282 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:47:56.283 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:56.283 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:47:56.283 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:56.283 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:47:56.284 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.284 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:47:56.284 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:56.284 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:47:56.285 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:47:56.285 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:56.285 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:47:56.285 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:47:56.286 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:56.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.286 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:47:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:47:56.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.347 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:47:56.405 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:47:56.405 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:47:56.406 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:47:56.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:47:56.406 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:47:56.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.407 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:47:56.407 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:47:56.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:47:56.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:47:56.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:47:56.408 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:47:56.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.513 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:47:56.530 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:47:56.531 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:47:56.531 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:47:56.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:47:56.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:56.598 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:56.655 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:47:56.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:56.656 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:56.712 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:47:56.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:56.800 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:56.800 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:56.832 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:56.832 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:56.832 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:56.833 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:56.833 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:56.833 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:56.833 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:56.834 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:56.906 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:56.906 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:56.907 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:56.907 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:56.907 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:56.907 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:56.907 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:56.908 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:56.908 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:47:56.908 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:47:56.908 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:47:56.909 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:47:56.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:47:56.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:56.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:47:57.022 INFO:teuthology.orchestra.run.smithi005.stdout:client6017 2023-10-16T13:47:57.023 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:47:57.023 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:57.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:47:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.243+0000 7fb858c4f700 1 Processor -- start 2023-10-16T13:47:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.243+0000 7fb858c4f700 1 -- start start 2023-10-16T13:47:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb858c4f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb85406e750 0x7fb8540ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb858c4f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 0x7fb8540cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb858c4f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8540b5c70 con 0x7fb85406eb30 2023-10-16T13:47:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb858c4f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540b5990 con 0x7fb85406e750 2023-10-16T13:47:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb858c4f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85415b2b0 con 0x7fb8540b54f0 2023-10-16T13:47:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb852d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 0x7fb8540cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb85259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb85406e750 0x7fb8540ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb852d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 0x7fb8540cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45814/0 (socket says 172.21.15.5:45814) 2023-10-16T13:47:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.244+0000 7fb852d9d700 1 -- 172.21.15.5:0/4224240044 learned_addr learned my addr 172.21.15.5:0/4224240044 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85259c700 1 -- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 msgr2=0x7fb8540cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85259c700 1 --2- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 0x7fb8540cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85259c700 1 -- 172.21.15.5:0/4224240044 >> v1:172.21.15.112:6789/0 conn(0x7fb85406eb30 legacy=0x7fb85415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85259c700 1 -- 172.21.15.5:0/4224240044 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85415b590 con 0x7fb85406e750 2023-10-16T13:47:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb852d9d700 1 --2- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 0x7fb8540cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:47:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85259c700 1 --2- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb85406e750 0x7fb8540ceec0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb848009870 tx=0x7fb848009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db9d5a8700dbed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85159a700 1 -- 172.21.15.5:0/4224240044 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011830 con 0x7fb85406e750 2023-10-16T13:47:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85159a700 1 -- 172.21.15.5:0/4224240044 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848011990 con 0x7fb85406e750 2023-10-16T13:47:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.245+0000 7fb85159a700 1 -- 172.21.15.5:0/4224240044 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011d20 con 0x7fb85406e750 2023-10-16T13:47:57.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 -- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb85406e750 msgr2=0x7fb8540ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 --2- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb85406e750 0x7fb8540ceec0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb848009870 tx=0x7fb848009b80 comp rx=0 tx=0).stop 2023-10-16T13:47:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 -- 172.21.15.5:0/4224240044 shutdown_connections 2023-10-16T13:47:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 --2- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb85406e750 0x7fb8540ceec0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 --2- 172.21.15.5:0/4224240044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8540b54f0 0x7fb8540cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 -- 172.21.15.5:0/4224240044 >> 172.21.15.5:0/4224240044 conn(0x7fb8540cc6f0 msgr2=0x7fb8540ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:57.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 -- 172.21.15.5:0/4224240044 shutdown_connections 2023-10-16T13:47:57.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.246+0000 7fb858c4f700 1 -- 172.21.15.5:0/4224240044 wait complete. 2023-10-16T13:47:57.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.247+0000 7fb858c4f700 1 Processor -- start 2023-10-16T13:47:57.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.247+0000 7fb858c4f700 1 -- start start 2023-10-16T13:47:57.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb858c4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 0x7fb8540b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:57.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb858c4f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb85406eb30 0x7fb8540c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:57.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb858c4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8540b54f0 0x7fb8540c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:57.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb858c4f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854158770 con 0x7fb85406e750 2023-10-16T13:47:57.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb858c4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540b2d80 con 0x7fb8540b54f0 2023-10-16T13:47:57.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb858c4f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540b3060 con 0x7fb85406eb30 2023-10-16T13:47:57.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 0x7fb8540b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:57.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 0x7fb8540b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47912/0 (socket says 172.21.15.5:47912) 2023-10-16T13:47:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 -- 172.21.15.5:0/2548084025 learned_addr learned my addr 172.21.15.5:0/2548084025 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb851d9b700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb85406eb30 0x7fb8540c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb852d9d700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8540b54f0 0x7fb8540c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 -- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb85406eb30 msgr2=0x7fb8540c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb85406eb30 0x7fb8540c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 -- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8540b54f0 msgr2=0x7fb8540c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:57.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8540b54f0 0x7fb8540c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 -- 172.21.15.5:0/2548084025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c00bd40 con 0x7fb85406e750 2023-10-16T13:47:57.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.248+0000 7fb85259c700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 0x7fb8540b3e20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb848000c00 tx=0x7fb848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:57.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.249+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480036a0 con 0x7fb85406e750 2023-10-16T13:47:57.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.249+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84801f070 con 0x7fb85406e750 2023-10-16T13:47:57.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.249+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480094a0 con 0x7fb85406e750 2023-10-16T13:47:57.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.249+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848003a00 con 0x7fb85406e750 2023-10-16T13:47:57.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.249+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540b3620 con 0x7fb85406e750 2023-10-16T13:47:57.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.250+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854067d20 con 0x7fb85406e750 2023-10-16T13:47:57.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.250+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fb848003b60 con 0x7fb85406e750 2023-10-16T13:47:57.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.251+0000 7fb842ffd700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb83406b1d0 0x7fb83406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:57.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.251+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb848021070 con 0x7fb85406e750 2023-10-16T13:47:57.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.251+0000 7fb851d9b700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb83406b1d0 0x7fb83406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:57.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.251+0000 7fb851d9b700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb83406b1d0 0x7fb83406d690 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb8541f2940 tx=0x7fb844009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:57.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.255+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8480560f0 con 0x7fb85406e750 2023-10-16T13:47:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.501+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8540b1640 con 0x7fb85406e750 2023-10-16T13:47:57.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.502+0000 7fb842ffd700 1 -- 172.21.15.5:0/2548084025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb848059710 con 0x7fb85406e750 2023-10-16T13:47:57.505 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:47:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.503+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb83406b1d0 msgr2=0x7fb83406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.503+0000 7fb858c4f700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb83406b1d0 0x7fb83406d690 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb8541f2940 tx=0x7fb844009040 comp rx=0 tx=0).stop 2023-10-16T13:47:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.503+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 msgr2=0x7fb8540b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.503+0000 7fb858c4f700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 0x7fb8540b3e20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb848000c00 tx=0x7fb848004750 comp rx=0 tx=0).stop 2023-10-16T13:47:57.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 shutdown_connections 2023-10-16T13:47:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8540b54f0 0x7fb8540c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85406e750 0x7fb8540b3e20 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb83406b1d0 0x7fb83406d690 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 --2- 172.21.15.5:0/2548084025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb85406eb30 0x7fb8540c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:57.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 >> 172.21.15.5:0/2548084025 conn(0x7fb8540cc6f0 msgr2=0x7fb854071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:57.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 shutdown_connections 2023-10-16T13:47:57.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:57.504+0000 7fb858c4f700 1 -- 172.21.15.5:0/2548084025 wait complete. 2023-10-16T13:47:57.518 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:47:57.519 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:47:57.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:47:57.520 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:47:57.520 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:57.520 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:47:57.520 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:47:57.521 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:47:57.521 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:47:57.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.522 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:47:57.543 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:47:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:47:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:47:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:47:57.544 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.544 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:57.545 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:57.545 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:47:57.545 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:57.546 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:47:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:47:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 41840sec preferred_lft 41840sec 2023-10-16T13:47:57.546 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:47:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.547 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:47:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:47:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:47:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:47:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.548 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:47:57.548 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:47:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.549 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:47:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:47:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:47:57.549 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:47:57.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.550 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:47:57.613 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:47:57.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.615 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:47:57.676 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:47:57.676 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:47:57.676 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:47:57.676 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:47:57.677 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:47:57.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.678 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:47:57.678 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:47:57.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:47:57.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:47:57.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:47:57.680 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:47:57.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.787 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:47:57.805 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:47:57.805 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:47:57.805 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:47:57.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.806 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:47:57.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:57.873 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:57.929 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:47:57.929 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:47:57.930 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:57.985 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:47:57.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:57.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:58.070 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:58.070 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:58.096 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:58.096 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:58.096 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:58.097 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:58.097 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:58.097 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:58.097 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:58.097 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:58.126 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:47:58.126 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:47:58.126 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:47:58.126 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:47:58.127 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:47:58.127 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:47:58.127 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:47:58.127 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:47:58.127 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:47:58.127 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:47:58.128 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:47:58.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:47:58.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:58.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:47:58.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:47:58.159 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:47:58.231 INFO:teuthology.orchestra.run.smithi112.stdout:client6643 2023-10-16T13:47:58.231 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:47:58.232 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:47:58.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:47:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.429+0000 7fe8b8060700 1 Processor -- start 2023-10-16T13:47:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.429+0000 7fe8b8060700 1 -- start start 2023-10-16T13:47:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b8060700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8b015d7f0 0x7fe8b00d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b8060700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b00cf8b0 con 0x7fe8b00d23f0 2023-10-16T13:47:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b8060700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b00cf5d0 con 0x7fe8b015dbd0 2023-10-16T13:47:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b8060700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b00b6710 con 0x7fe8b015d7f0 2023-10-16T13:47:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b5dfc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8b015d7f0 0x7fe8b00d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b65fd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8b00d23f0 0x7fe8b00b71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57928/0 (socket says 172.21.15.5:57928) 2023-10-16T13:47:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b5dfc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8b015d7f0 0x7fe8b00d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47920/0 (socket says 172.21.15.5:47920) 2023-10-16T13:47:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.430+0000 7fe8b65fd700 1 -- 172.21.15.5:0/53093861 learned_addr learned my addr 172.21.15.5:0/53093861 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b5dfc700 1 -- 172.21.15.5:0/53093861 >> v1:172.21.15.112:6789/0 conn(0x7fe8b015dbd0 legacy=0x7fe8b00d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b5dfc700 1 -- 172.21.15.5:0/53093861 >> v1:172.21.15.5:6789/0 conn(0x7fe8b00d23f0 legacy=0x7fe8b00b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b4dfa700 1 -- 172.21.15.5:0/53093861 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827581898 0 0) 0x7fe8b00cf8b0 con 0x7fe8b00d23f0 2023-10-16T13:47:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b5dfc700 1 -- 172.21.15.5:0/53093861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00b69f0 con 0x7fe8b015d7f0 2023-10-16T13:47:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b5dfc700 1 --2- 172.21.15.5:0/53093861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015d7f0 0x7fe8b00d1630 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009820 tx=0x7fe8ac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08009df8a1401ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b4dfa700 1 -- 172.21.15.5:0/53093861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac005e30 con 0x7fe8b015d7f0 2023-10-16T13:47:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b4dfa700 1 -- 172.21.15.5:0/53093861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac006030 con 0x7fe8b015d7f0 2023-10-16T13:47:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.431+0000 7fe8b4dfa700 1 -- 172.21.15.5:0/53093861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0063e0 con 0x7fe8b015d7f0 2023-10-16T13:47:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 -- 172.21.15.5:0/53093861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015d7f0 msgr2=0x7fe8b00d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 --2- 172.21.15.5:0/53093861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015d7f0 0x7fe8b00d1630 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009820 tx=0x7fe8ac009b30 comp rx=0 tx=0).stop 2023-10-16T13:47:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 -- 172.21.15.5:0/53093861 shutdown_connections 2023-10-16T13:47:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 --2- 172.21.15.5:0/53093861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015d7f0 0x7fe8b00d1630 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 -- 172.21.15.5:0/53093861 >> 172.21.15.5:0/53093861 conn(0x7fe8b009ca60 msgr2=0x7fe8b00d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 -- 172.21.15.5:0/53093861 shutdown_connections 2023-10-16T13:47:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.432+0000 7fe8b8060700 1 -- 172.21.15.5:0/53093861 wait complete. 2023-10-16T13:47:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.433+0000 7fe8b8060700 1 Processor -- start 2023-10-16T13:47:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.433+0000 7fe8b8060700 1 -- start start 2023-10-16T13:47:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b8060700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b00d23f0 0x7fe8b00a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b8060700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8b015d7f0 0x7fe8b0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b8060700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 0x7fe8b009ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b8060700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b00a1440 con 0x7fe8b015dbd0 2023-10-16T13:47:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b8060700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b014d250 con 0x7fe8b00d23f0 2023-10-16T13:47:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b8060700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b014d4a0 con 0x7fe8b015d7f0 2023-10-16T13:47:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 0x7fe8b009ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 0x7fe8b009ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47930/0 (socket says 172.21.15.5:47930) 2023-10-16T13:47:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 -- 172.21.15.5:0/267606800 learned_addr learned my addr 172.21.15.5:0/267606800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b5dfc700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b00d23f0 0x7fe8b00a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b55fb700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8b015d7f0 0x7fe8b0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 -- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8b015d7f0 msgr2=0x7fe8b0150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8b015d7f0 0x7fe8b0150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 -- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b00d23f0 msgr2=0x7fe8b00a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b00d23f0 0x7fe8b00a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 -- 172.21.15.5:0/267606800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac009430 con 0x7fe8b015dbd0 2023-10-16T13:47:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.434+0000 7fe8b65fd700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 0x7fe8b009ddb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800cc70 tx=0x7fe8a800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.435+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800aa60 con 0x7fe8b015dbd0 2023-10-16T13:47:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.435+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800abe0 con 0x7fe8b015dbd0 2023-10-16T13:47:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.435+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b014d780 con 0x7fe8b015dbd0 2023-10-16T13:47:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.435+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80070d0 con 0x7fe8b015dbd0 2023-10-16T13:47:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.435+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b014dd40 con 0x7fe8b015dbd0 2023-10-16T13:47:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.436+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b0067d20 con 0x7fe8b015dbd0 2023-10-16T13:47:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.436+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fe8a8007230 con 0x7fe8b015dbd0 2023-10-16T13:47:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.437+0000 7fe8a67fc700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe89406b1d0 0x7fe89406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.437+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8a80897e0 con 0x7fe8b015dbd0 2023-10-16T13:47:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.437+0000 7fe8b5dfc700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe89406b1d0 0x7fe89406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.438+0000 7fe8b5dfc700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe89406b1d0 0x7fe89406d690 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac013040 tx=0x7fe8ac008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.442+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8a8054540 con 0x7fe8b015dbd0 2023-10-16T13:47:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.687+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe8b00b5f60 con 0x7fe8b015dbd0 2023-10-16T13:47:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.859+0000 7fe8a67fc700 1 -- 172.21.15.5:0/267606800 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 136+0+0 (secure 0 0 0) 0x7fe8a8057b60 con 0x7fe8b015dbd0 2023-10-16T13:47:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.861+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe89406b1d0 msgr2=0x7fe89406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.861+0000 7fe8b8060700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe89406b1d0 0x7fe89406d690 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac013040 tx=0x7fe8ac008070 comp rx=0 tx=0).stop 2023-10-16T13:47:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.861+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 msgr2=0x7fe8b009ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.861+0000 7fe8b8060700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 0x7fe8b009ddb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800cc70 tx=0x7fe8a800cf80 comp rx=0 tx=0).stop 2023-10-16T13:47:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 shutdown_connections 2023-10-16T13:47:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b015dbd0 0x7fe8b009ddb0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b00d23f0 0x7fe8b00a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe89406b1d0 0x7fe89406d690 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 --2- 172.21.15.5:0/267606800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8b015d7f0 0x7fe8b0150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 >> 172.21.15.5:0/267606800 conn(0x7fe8b009ca60 msgr2=0x7fe8b00b8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 shutdown_connections 2023-10-16T13:47:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:58.862+0000 7fe8b8060700 1 -- 172.21.15.5:0/267606800 wait complete. 2023-10-16T13:47:58.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:47:58.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:47:58.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:47:59.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 Processor -- start 2023-10-16T13:47:59.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 -- start start 2023-10-16T13:47:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 0x7f42240d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f422415bfa0 0x7f42240b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240cce60 con 0x7f422415bbc0 2023-10-16T13:47:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42240cd4e0 con 0x7f422415bfa0 2023-10-16T13:47:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.004+0000 7f422a12b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b2ba0 con 0x7f42240ce4c0 2023-10-16T13:47:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 0x7f42240d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4223fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f422415bfa0 0x7f42240b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 0x7f42240d20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:45840/0 (socket says 172.21.15.5:45840) 2023-10-16T13:47:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 -- 172.21.15.5:0/1119909055 learned_addr learned my addr 172.21.15.5:0/1119909055 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 -- 172.21.15.5:0/1119909055 >> v2:172.21.15.112:3300/0 conn(0x7f422415bfa0 msgr2=0x7f42240b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 --2- 172.21.15.5:0/1119909055 >> v2:172.21.15.112:3300/0 conn(0x7f422415bfa0 0x7f42240b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 -- 172.21.15.5:0/1119909055 >> v1:172.21.15.112:6789/0 conn(0x7f422415bbc0 legacy=0x7f42240cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 -- 172.21.15.5:0/1119909055 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240cd100 con 0x7f42240ce4c0 2023-10-16T13:47:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f4222ffd700 1 --2- 172.21.15.5:0/1119909055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 0x7f42240d20e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42180098f0 tx=0x7f4218009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6c7b255861944a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f42227fc700 1 -- 172.21.15.5:0/1119909055 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218011830 con 0x7f42240ce4c0 2023-10-16T13:47:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f42227fc700 1 -- 172.21.15.5:0/1119909055 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218011990 con 0x7f42240ce4c0 2023-10-16T13:47:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.005+0000 7f42227fc700 1 -- 172.21.15.5:0/1119909055 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218011d20 con 0x7f42240ce4c0 2023-10-16T13:47:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 -- 172.21.15.5:0/1119909055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 msgr2=0x7f42240d20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 --2- 172.21.15.5:0/1119909055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 0x7f42240d20e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42180098f0 tx=0x7f4218009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 -- 172.21.15.5:0/1119909055 shutdown_connections 2023-10-16T13:47:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 --2- 172.21.15.5:0/1119909055 >> v2:172.21.15.112:3300/0 conn(0x7f422415bfa0 0x7f42240b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 --2- 172.21.15.5:0/1119909055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42240ce4c0 0x7f42240d20e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 -- 172.21.15.5:0/1119909055 >> 172.21.15.5:0/1119909055 conn(0x7f42240d15f0 msgr2=0x7f42240d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 -- 172.21.15.5:0/1119909055 shutdown_connections 2023-10-16T13:47:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.006+0000 7f422a12b700 1 -- 172.21.15.5:0/1119909055 wait complete. 2023-10-16T13:47:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.007+0000 7f422a12b700 1 Processor -- start 2023-10-16T13:47:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.007+0000 7f422a12b700 1 -- start start 2023-10-16T13:47:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f422a12b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42240ce4c0 0x7f42240c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f422a12b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 0x7f4224158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f422a12b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f422415bfa0 0x7f42240c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f422a12b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b41c0 con 0x7f422415bbc0 2023-10-16T13:47:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f422a12b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b6fa0 con 0x7f42240ce4c0 2023-10-16T13:47:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f422a12b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b6cc0 con 0x7f422415bfa0 2023-10-16T13:47:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f4222ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 0x7f4224158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f4222ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 0x7f4224158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47944/0 (socket says 172.21.15.5:47944) 2023-10-16T13:47:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f4222ffd700 1 -- 172.21.15.5:0/2240196819 learned_addr learned my addr 172.21.15.5:0/2240196819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f42237fe700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42240ce4c0 0x7f42240c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.008+0000 7f4223fff700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f422415bfa0 0x7f42240c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f4222ffd700 1 -- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f422415bfa0 msgr2=0x7f42240c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f4222ffd700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f422415bfa0 0x7f42240c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f4222ffd700 1 -- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42240ce4c0 msgr2=0x7f42240c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f4222ffd700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42240ce4c0 0x7f42240c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f4222ffd700 1 -- 172.21.15.5:0/2240196819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009550 con 0x7f422415bbc0 2023-10-16T13:47:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f4222ffd700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 0x7f4224158740 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4218000c00 tx=0x7f4218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218004400 con 0x7f422415bbc0 2023-10-16T13:47:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421801f070 con 0x7f422415bbc0 2023-10-16T13:47:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180038e0 con 0x7f422415bbc0 2023-10-16T13:47:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240aec60 con 0x7f422415bbc0 2023-10-16T13:47:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.009+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240af220 con 0x7f422415bbc0 2023-10-16T13:47:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.010+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422406dfb0 con 0x7f422415bbc0 2023-10-16T13:47:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.011+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f4218021030 con 0x7f422415bbc0 2023-10-16T13:47:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.011+0000 7f420bfff700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.011+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f421808ad50 con 0x7f422415bbc0 2023-10-16T13:47:59.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.011+0000 7f42237fe700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.012+0000 7f42237fe700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4214007fd0 tx=0x7f4214009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.016+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4218055be0 con 0x7f422415bbc0 2023-10-16T13:47:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.244+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f42240b2e80 con 0x7f421006b1d0 2023-10-16T13:47:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.246+0000 7f420bfff700 1 -- 172.21.15.5:0/2240196819 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4214001d60 con 0x7f421006b1d0 2023-10-16T13:47:59.249 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:47:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:47:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:47:59.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:47:59.250 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:47:59.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 msgr2=0x7f421006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4214007fd0 tx=0x7f4214009040 comp rx=0 tx=0).stop 2023-10-16T13:47:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 msgr2=0x7f4224158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 0x7f4224158740 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4218000c00 tx=0x7f4218004750 comp rx=0 tx=0).stop 2023-10-16T13:47:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 shutdown_connections 2023-10-16T13:47:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f421006b1d0 0x7f421006d690 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f422415bfa0 0x7f42240c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42240ce4c0 0x7f42240c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 --2- 172.21.15.5:0/2240196819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422415bbc0 0x7f4224158740 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 >> 172.21.15.5:0/2240196819 conn(0x7f42240d15f0 msgr2=0x7f42240d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 shutdown_connections 2023-10-16T13:47:59.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.248+0000 7f422a12b700 1 -- 172.21.15.5:0/2240196819 wait complete. 2023-10-16T13:47:59.263 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:47:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.389+0000 7fd702885700 1 Processor -- start 2023-10-16T13:47:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.389+0000 7fd702885700 1 -- start start 2023-10-16T13:47:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd702885700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6fc15ab10 0x7fd6fc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd702885700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc15e7a0 con 0x7fd6fc0cfe30 2023-10-16T13:47:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd702885700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc15f730 con 0x7fd6fc0b1f50 2023-10-16T13:47:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd702885700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b29a0 con 0x7fd6fc15ab10 2023-10-16T13:47:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd700e22700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd6fc0cfe30 0x7fd6fc0cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57956/0 (socket says 172.21.15.5:57956) 2023-10-16T13:47:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd700e22700 1 -- 172.21.15.5:0/2420995690 learned_addr learned my addr 172.21.15.5:0/2420995690 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:47:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6fbfff700 1 --2- 172.21.15.5:0/2420995690 >> v2:172.21.15.112:3300/0 conn(0x7fd6fc15ab10 0x7fd6fc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163039533 0 0) 0x7fd6fc15e7a0 con 0x7fd6fc0cfe30 2023-10-16T13:47:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e80035b0 con 0x7fd6fc0cfe30 2023-10-16T13:47:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3478191546 0 0) 0x7fd6e80035b0 con 0x7fd6fc0cfe30 2023-10-16T13:47:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 >> v2:172.21.15.112:3300/0 conn(0x7fd6fc15ab10 msgr2=0x7fd6fc15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 --2- 172.21.15.5:0/2420995690 >> v2:172.21.15.112:3300/0 conn(0x7fd6fc15ab10 0x7fd6fc15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 >> v1:172.21.15.112:6789/0 conn(0x7fd6fc0b1f50 legacy=0x7fd6fc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0b2c80 con 0x7fd6fc0cfe30 2023-10-16T13:47:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fd6f40019f0 con 0x7fd6fc0cfe30 2023-10-16T13:47:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 >> v1:172.21.15.5:6789/0 conn(0x7fd6fc0cfe30 legacy=0x7fd6fc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6e8003a00 0x7fd6e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.390+0000 7fd6faffd700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6e8004850 0x7fd6e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8005210 0x7fd6e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b29a0 con 0x7fd6e8004850 2023-10-16T13:47:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e800c0b0 con 0x7fd6e8005210 2023-10-16T13:47:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e800c270 con 0x7fd6e8003a00 2023-10-16T13:47:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6e8004850 0x7fd6e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fbfff700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6e8003a00 0x7fd6e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd700e22700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8005210 0x7fd6e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6e8003a00 msgr2=0x7fd6e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6e8003a00 0x7fd6e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8005210 msgr2=0x7fd6e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8005210 0x7fd6e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2420995690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80035b0 con 0x7fd6e8004850 2023-10-16T13:47:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd700e22700 1 -- 172.21.15.5:0/2420995690 reap_dead start 2023-10-16T13:47:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6e8004850 0x7fd6e8004cd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4001820 tx=0x7fd6e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5832de13875104 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40012e0 con 0x7fd6e8004850 2023-10-16T13:47:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40052d0 con 0x7fd6e8004850 2023-10-16T13:47:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.391+0000 7fd6faffd700 1 -- 172.21.15.5:0/2420995690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40036d0 con 0x7fd6e8004850 2023-10-16T13:47:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 -- 172.21.15.5:0/2420995690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6e8004850 msgr2=0x7fd6e8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6e8004850 0x7fd6e8004cd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4001820 tx=0x7fd6e8005880 comp rx=0 tx=0).stop 2023-10-16T13:47:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 -- 172.21.15.5:0/2420995690 shutdown_connections 2023-10-16T13:47:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 --2- 172.21.15.5:0/2420995690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6e8004850 0x7fd6e8004cd0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 -- 172.21.15.5:0/2420995690 >> 172.21.15.5:0/2420995690 conn(0x7fd6fc06dae0 msgr2=0x7fd6fc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 -- 172.21.15.5:0/2420995690 shutdown_connections 2023-10-16T13:47:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.392+0000 7fd702885700 1 -- 172.21.15.5:0/2420995690 wait complete. 2023-10-16T13:47:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.393+0000 7fd702885700 1 Processor -- start 2023-10-16T13:47:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.393+0000 7fd702885700 1 -- start start 2023-10-16T13:47:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd702885700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8004850 0x7fd6fc15d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd702885700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 0x7fd6fc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd702885700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6fc0c75a0 0x7fd6fc0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd702885700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0ae190 con 0x7fd6fc0cd290 2023-10-16T13:47:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd702885700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc156f80 con 0x7fd6e8004850 2023-10-16T13:47:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd702885700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc15db50 con 0x7fd6fc0c75a0 2023-10-16T13:47:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 0x7fd6fc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 0x7fd6fc156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47962/0 (socket says 172.21.15.5:47962) 2023-10-16T13:47:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2380315587 learned_addr learned my addr 172.21.15.5:0/2380315587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fbfff700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8004850 0x7fd6fc15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd700e22700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6fc0c75a0 0x7fd6fc0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6fc0c75a0 msgr2=0x7fd6fc0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6fc0c75a0 0x7fd6fc0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8004850 msgr2=0x7fd6fc15d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8004850 0x7fd6fc15d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fb7fe700 1 -- 172.21.15.5:0/2380315587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0adad0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd700e22700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6fc0c75a0 0x7fd6fc0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.394+0000 7fd6fbfff700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8004850 0x7fd6fc15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:47:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.395+0000 7fd6fb7fe700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 0x7fd6fc156a40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.395+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40012e0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.395+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40050d0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.395+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0addb0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.395+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e401d420 con 0x7fd6fc0cd290 2023-10-16T13:47:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.395+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc15c0a0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.396+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc0ae2d0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.396+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fd6e401d580 con 0x7fd6fc0cd290 2023-10-16T13:47:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.397+0000 7fd6f8ff9700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6dc06b200 0x7fd6dc06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.397+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6e408a3b0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.397+0000 7fd6fbfff700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6dc06b200 0x7fd6dc06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.397+0000 7fd6fbfff700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6dc06b200 0x7fd6dc06d6c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009be0 tx=0x7fd6ec009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.401+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6fc0ae2d0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.603+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd6fc0ae2d0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.603+0000 7fd6f8ff9700 1 -- 172.21.15.5:0/2380315587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6fc0ae2d0 con 0x7fd6fc0cd290 2023-10-16T13:47:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6dc06b200 msgr2=0x7fd6dc06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6dc06b200 0x7fd6dc06d6c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009be0 tx=0x7fd6ec009210 comp rx=0 tx=0).stop 2023-10-16T13:47:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 msgr2=0x7fd6fc156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 0x7fd6fc156a40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4001170 comp rx=0 tx=0).stop 2023-10-16T13:47:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 shutdown_connections 2023-10-16T13:47:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd6dc06b200 0x7fd6dc06d6c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd6fc0c75a0 0x7fd6fc0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6e8004850 0x7fd6fc15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 --2- 172.21.15.5:0/2380315587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6fc0cd290 0x7fd6fc156a40 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 >> 172.21.15.5:0/2380315587 conn(0x7fd6fc06dae0 msgr2=0x7fd6fc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 shutdown_connections 2023-10-16T13:47:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.605+0000 7fd702885700 1 -- 172.21.15.5:0/2380315587 wait complete. 2023-10-16T13:47:59.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-16T13:47:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.745+0000 7f9d19c60700 1 Processor -- start 2023-10-16T13:47:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.745+0000 7f9d19c60700 1 -- start start 2023-10-16T13:47:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d19c60700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d140d08a0 0x7f9d140d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d19c60700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d140ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d19c60700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d140b6610 con 0x7f9d14160e30 2023-10-16T13:47:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d19c60700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140d1da0 con 0x7f9d140d08a0 2023-10-16T13:47:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d19c60700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140d2080 con 0x7f9d140b7ab0 2023-10-16T13:47:59.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d140d08a0 0x7f9d140d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d140d08a0 0x7f9d140d4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47970/0 (socket says 172.21.15.5:47970) 2023-10-16T13:47:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 -- 172.21.15.5:0/2716079971 learned_addr learned my addr 172.21.15.5:0/2716079971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d13fff700 1 --2- 172.21.15.5:0/2716079971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d140ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 -- 172.21.15.5:0/2716079971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 msgr2=0x7f9d140ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:47:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 --2- 172.21.15.5:0/2716079971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d140ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 -- 172.21.15.5:0/2716079971 >> v1:172.21.15.112:6789/0 conn(0x7f9d14160e30 legacy=0x7f9d140d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 -- 172.21.15.5:0/2716079971 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140d2360 con 0x7f9d140d08a0 2023-10-16T13:47:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.746+0000 7f9d12ffd700 1 --2- 172.21.15.5:0/2716079971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d140d08a0 0x7f9d140d4200 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098f0 tx=0x7f9d08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54724abc65496d35 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d127fc700 1 -- 172.21.15.5:0/2716079971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08011830 con 0x7f9d140d08a0 2023-10-16T13:47:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d127fc700 1 -- 172.21.15.5:0/2716079971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08011990 con 0x7f9d140d08a0 2023-10-16T13:47:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d127fc700 1 -- 172.21.15.5:0/2716079971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08011d20 con 0x7f9d140d08a0 2023-10-16T13:47:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 -- 172.21.15.5:0/2716079971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d140d08a0 msgr2=0x7f9d140d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 --2- 172.21.15.5:0/2716079971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d140d08a0 0x7f9d140d4200 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098f0 tx=0x7f9d08009c00 comp rx=0 tx=0).stop 2023-10-16T13:47:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 -- 172.21.15.5:0/2716079971 shutdown_connections 2023-10-16T13:47:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 --2- 172.21.15.5:0/2716079971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d140ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 --2- 172.21.15.5:0/2716079971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d140d08a0 0x7f9d140d4200 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 -- 172.21.15.5:0/2716079971 >> 172.21.15.5:0/2716079971 conn(0x7f9d1409cb40 msgr2=0x7f9d140d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:47:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 -- 172.21.15.5:0/2716079971 shutdown_connections 2023-10-16T13:47:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.747+0000 7f9d19c60700 1 -- 172.21.15.5:0/2716079971 wait complete. 2023-10-16T13:47:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.748+0000 7f9d19c60700 1 Processor -- start 2023-10-16T13:47:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 -- start start 2023-10-16T13:47:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d14155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d140d08a0 0x7f9d140cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 0x7f9d14158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d141555d0 con 0x7f9d14160e30 2023-10-16T13:47:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140cda30 con 0x7f9d140d08a0 2023-10-16T13:47:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d19c60700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14156d40 con 0x7f9d140b7ab0 2023-10-16T13:47:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d13fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 0x7f9d14158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d13fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 0x7f9d14158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47978/0 (socket says 172.21.15.5:47978) 2023-10-16T13:47:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.749+0000 7f9d13fff700 1 -- 172.21.15.5:0/83490489 learned_addr learned my addr 172.21.15.5:0/83490489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:47:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d137fe700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d14155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d12ffd700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d140d08a0 0x7f9d140cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d13fff700 1 -- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 msgr2=0x7f9d14155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d13fff700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d14155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d13fff700 1 -- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d140d08a0 msgr2=0x7f9d140cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:47:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d13fff700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d140d08a0 0x7f9d140cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:47:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d13fff700 1 -- 172.21.15.5:0/83490489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009550 con 0x7f9d14160e30 2023-10-16T13:47:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d13fff700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 0x7f9d14158880 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00efc0 tx=0x7f9d0c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c009b20 con 0x7f9d14160e30 2023-10-16T13:47:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00f040 con 0x7f9d14160e30 2023-10-16T13:47:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d14156fe0 con 0x7f9d14160e30 2023-10-16T13:47:59.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00cc90 con 0x7f9d14160e30 2023-10-16T13:47:59.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.750+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d14159830 con 0x7f9d14160e30 2023-10-16T13:47:59.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.751+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d140b95a0 con 0x7f9d14160e30 2023-10-16T13:47:59.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.752+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f9d0c014480 con 0x7f9d14160e30 2023-10-16T13:47:59.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.752+0000 7f9cfbfff700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0006b1d0 0x7f9d0006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:47:59.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.752+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d0c08a510 con 0x7f9d14160e30 2023-10-16T13:47:59.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.752+0000 7f9d137fe700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0006b1d0 0x7f9d0006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:47:59.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.753+0000 7f9d137fe700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0006b1d0 0x7f9d0006d690 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d04000fb0 tx=0x7f9d04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:47:59.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.757+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d0c0551f0 con 0x7f9d14160e30 2023-10-16T13:47:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:47:59.990+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9d140d2640 con 0x7f9d0006b1d0 2023-10-16T13:47:59.999 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:59.996+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:59.999 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:59.996+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:59.999 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:59.996+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:47:59.999 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:59.996+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:00.000 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:47:59.996+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:00.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.003+0000 7f9cfbfff700 1 -- 172.21.15.5:0/83490489 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+469 (secure 0 0 0) 0x7f9d04001570 con 0x7f9d0006b1d0 2023-10-16T13:48:00.006 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:48:00.007 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_addrs": [ 2023-10-16T13:48:00.007 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.5:6789", 2023-10-16T13:48:00.007 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6789", 2023-10-16T13:48:00.007 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6790" 2023-10-16T13:48:00.007 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:48:00.007 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": { 2023-10-16T13:48:00.008 INFO:teuthology.orchestra.run.smithi005.stdout: "data": [ 2023-10-16T13:48:00.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:00.008 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": " 341G", 2023-10-16T13:48:00.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_data", 2023-10-16T13:48:00.009 INFO:teuthology.orchestra.run.smithi005.stdout: "used": " 0 " 2023-10-16T13:48:00.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:00.009 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:48:00.009 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": [ 2023-10-16T13:48:00.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:00.010 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": " 341G", 2023-10-16T13:48:00.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_metadata", 2023-10-16T13:48:00.010 INFO:teuthology.orchestra.run.smithi005.stdout: "used": "64.0k" 2023-10-16T13:48:00.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:00.010 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:48:00.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:00.011 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:48:00.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0006b1d0 msgr2=0x7f9d0006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0006b1d0 0x7f9d0006d690 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d04000fb0 tx=0x7f9d04009040 comp rx=0 tx=0).stop 2023-10-16T13:48:00.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 msgr2=0x7f9d14158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 0x7f9d14158880 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00efc0 tx=0x7f9d0c009f60 comp rx=0 tx=0).stop 2023-10-16T13:48:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 shutdown_connections 2023-10-16T13:48:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d14160e30 0x7f9d14158880 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0006b1d0 0x7f9d0006d690 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d140b7ab0 0x7f9d14155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 --2- 172.21.15.5:0/83490489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d140d08a0 0x7f9d140cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 >> 172.21.15.5:0/83490489 conn(0x7f9d1409cb40 msgr2=0x7f9d140cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:00.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 shutdown_connections 2023-10-16T13:48:00.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.006+0000 7f9d19c60700 1 -- 172.21.15.5:0/83490489 wait complete. 2023-10-16T13:48:00.021 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:48:00.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:00.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:00.116 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:48:00.117 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:00.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:00.135 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:00.135 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:00.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.355+0000 7f5ea2959700 1 Processor -- start 2023-10-16T13:48:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.355+0000 7f5ea2959700 1 -- start start 2023-10-16T13:48:00.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5ea2959700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5e9c15e2f0 0x7f5e9c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5ea2959700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e9c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5ea2959700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c0b2d60 con 0x7f5e9c0cd950 2023-10-16T13:48:00.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5ea2959700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c1619a0 con 0x7f5e9c15e2f0 2023-10-16T13:48:00.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5ea2959700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c06b1f0 con 0x7f5e9c06a840 2023-10-16T13:48:00.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e9c0cd950 0x7f5e9c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57986/0 (socket says 172.21.15.5:57986) 2023-10-16T13:48:00.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9bfff700 1 -- 172.21.15.5:0/1378428737 learned_addr learned my addr 172.21.15.5:0/1378428737 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:00.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914004721 0 0) 0x7f5e9c0b2d60 con 0x7f5e9c0cd950 2023-10-16T13:48:00.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5ea0ef6700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e9c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/1378428737 >> v2:172.21.15.112:3300/0 conn(0x7f5e9c15e2f0 0x7f5e9c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e880035b0 con 0x7f5e9c0cd950 2023-10-16T13:48:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720813558 0 0) 0x7f5e880035b0 con 0x7f5e9c0cd950 2023-10-16T13:48:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 msgr2=0x7f5e9c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e9c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 >> v2:172.21.15.112:3300/0 conn(0x7f5e9c15e2f0 msgr2=0x7f5e9c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1378428737 >> v2:172.21.15.112:3300/0 conn(0x7f5e9c15e2f0 0x7f5e9c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0cdd30 con 0x7f5e9c0cd950 2023-10-16T13:48:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.356+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5e84001670 con 0x7f5e9c0cd950 2023-10-16T13:48:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 >> v1:172.21.15.5:6789/0 conn(0x7f5e9c0cd950 legacy=0x7f5e9c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e88003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e88004850 0x7f5e88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e88005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c1619a0 con 0x7f5e88003a00 2023-10-16T13:48:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c06b1f0 con 0x7f5e88004850 2023-10-16T13:48:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8800ba10 con 0x7f5e9c06a840 2023-10-16T13:48:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e88003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e88004850 0x7f5e88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5ea0ef6700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e88005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 -- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 msgr2=0x7f5e88005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:00.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e88005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 -- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e88004850 msgr2=0x7f5e88004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:00.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e88004850 0x7f5e88004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 -- 172.21.15.5:0/1378428737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880035b0 con 0x7f5e88003a00 2023-10-16T13:48:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5ea0ef6700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c06a840 0x7f5e88005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e88003e40 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400c320 tx=0x7f5e88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1815ea46312c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84007c40 con 0x7f5e88003a00 2023-10-16T13:48:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400ce20 con 0x7f5e88003a00 2023-10-16T13:48:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.357+0000 7f5e9affd700 1 -- 172.21.15.5:0/1378428737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84005ba0 con 0x7f5e88003a00 2023-10-16T13:48:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea2959700 1 -- 172.21.15.5:0/1378428737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 msgr2=0x7f5e88003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea2959700 1 --2- 172.21.15.5:0/1378428737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e88003e40 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400c320 tx=0x7f5e88005880 comp rx=0 tx=0).stop 2023-10-16T13:48:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea0ef6700 1 -- 172.21.15.5:0/1378428737 reap_dead start 2023-10-16T13:48:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea2959700 1 -- 172.21.15.5:0/1378428737 shutdown_connections 2023-10-16T13:48:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea2959700 1 -- 172.21.15.5:0/1378428737 >> 172.21.15.5:0/1378428737 conn(0x7f5e9c06dae0 msgr2=0x7f5e9c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea2959700 1 -- 172.21.15.5:0/1378428737 shutdown_connections 2023-10-16T13:48:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.358+0000 7f5ea2959700 1 -- 172.21.15.5:0/1378428737 wait complete. 2023-10-16T13:48:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.359+0000 7f5ea2959700 1 Processor -- start 2023-10-16T13:48:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.359+0000 7f5ea2959700 1 -- start start 2023-10-16T13:48:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea2959700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e9c1f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea2959700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e9c0ac8b0 0x7f5e9c1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea2959700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c0acd30 0x7f5e9c06def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea2959700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c8890 con 0x7f5e88003a00 2023-10-16T13:48:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea2959700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0ad1b0 con 0x7f5e9c0ac8b0 2023-10-16T13:48:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea2959700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0ad490 con 0x7f5e9c0acd30 2023-10-16T13:48:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5e9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e9c1f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5e9bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e9c1f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47994/0 (socket says 172.21.15.5:47994) 2023-10-16T13:48:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5e9bfff700 1 -- 172.21.15.5:0/259649106 learned_addr learned my addr 172.21.15.5:0/259649106 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5ea0ef6700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c0acd30 0x7f5e9c06def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e9c0ac8b0 0x7f5e9c1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.360+0000 7f5e9bfff700 1 -- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c0acd30 msgr2=0x7f5e9c06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c0acd30 0x7f5e9c06def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e9bfff700 1 -- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e9c0ac8b0 msgr2=0x7f5e9c1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e9c0ac8b0 0x7f5e9c1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e9bfff700 1 -- 172.21.15.5:0/259649106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0ad770 con 0x7f5e88003a00 2023-10-16T13:48:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e9c0ac8b0 0x7f5e9c1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e9bfff700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e9c1f4db0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5e84001930 tx=0x7f5e9c0b2ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840070d0 con 0x7f5e88003a00 2023-10-16T13:48:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e84007250 con 0x7f5e88003a00 2023-10-16T13:48:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c1f52f0 con 0x7f5e88003a00 2023-10-16T13:48:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84007600 con 0x7f5e88003a00 2023-10-16T13:48:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.361+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c1f4a40 con 0x7f5e88003a00 2023-10-16T13:48:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.362+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c0ad9b0 con 0x7f5e88003a00 2023-10-16T13:48:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.362+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f5e8401e430 con 0x7f5e88003a00 2023-10-16T13:48:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.363+0000 7f5e98ff9700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5e7c06b1d0 0x7f5e7c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.363+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e8408ac30 con 0x7f5e88003a00 2023-10-16T13:48:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.363+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5e7c06b1d0 0x7f5e7c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.363+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5e7c06b1d0 0x7f5e7c06d690 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c06b630 tx=0x7f5e8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.367+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e9c0ad9b0 con 0x7f5e88003a00 2023-10-16T13:48:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.568+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e9c0c85f0 con 0x7f5e88003a00 2023-10-16T13:48:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.569+0000 7f5e98ff9700 1 -- 172.21.15.5:0/259649106 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16436 (secure 0 0 0) 0x7f5e9c0c85f0 con 0x7f5e88003a00 2023-10-16T13:48:00.572 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:00.572 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:50.785531+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5e7c06b1d0 msgr2=0x7f5e7c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5e7c06b1d0 0x7f5e7c06d690 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c06b630 tx=0x7f5e8c008040 comp rx=0 tx=0).stop 2023-10-16T13:48:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 msgr2=0x7f5e9c1f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e9c1f4db0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5e84001930 tx=0x7f5e9c0b2ef0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 shutdown_connections 2023-10-16T13:48:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5e7c06b1d0 0x7f5e7c06d690 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e9c0acd30 0x7f5e9c06def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e88003a00 0x7f5e9c1f4db0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 --2- 172.21.15.5:0/259649106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e9c0ac8b0 0x7f5e9c1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 >> 172.21.15.5:0/259649106 conn(0x7f5e9c06dae0 msgr2=0x7f5e9c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 shutdown_connections 2023-10-16T13:48:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.571+0000 7f5ea2959700 1 -- 172.21.15.5:0/259649106 wait complete. 2023-10-16T13:48:00.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:47:47.704922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:47:48.167141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:00.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.712+0000 7f989cdcc700 1 Processor -- start 2023-10-16T13:48:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.712+0000 7f989cdcc700 1 -- start start 2023-10-16T13:48:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.713+0000 7f989cdcc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f989815ab10 0x7f989815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.713+0000 7f989cdcc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98980b1f50 0x7f98980cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.713+0000 7f989cdcc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989815e7a0 con 0x7f98980b2400 2023-10-16T13:48:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.713+0000 7f989cdcc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989815f730 con 0x7f989815ab10 2023-10-16T13:48:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.713+0000 7f989cdcc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980b29a0 con 0x7f98980b1f50 2023-10-16T13:48:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.713+0000 7f989659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f989815ab10 0x7f989815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f989815ab10 0x7f989815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48002/0 (socket says 172.21.15.5:48002) 2023-10-16T13:48:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 -- 172.21.15.5:0/68801206 learned_addr learned my addr 172.21.15.5:0/68801206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f9895d9b700 1 --2- 172.21.15.5:0/68801206 >> v2:172.21.15.112:3300/0 conn(0x7f98980b1f50 0x7f98980cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 -- 172.21.15.5:0/68801206 >> v2:172.21.15.112:3300/0 conn(0x7f98980b1f50 msgr2=0x7f98980cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 --2- 172.21.15.5:0/68801206 >> v2:172.21.15.112:3300/0 conn(0x7f98980b1f50 0x7f98980cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 -- 172.21.15.5:0/68801206 >> v1:172.21.15.112:6789/0 conn(0x7f98980b2400 legacy=0x7f98980cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 -- 172.21.15.5:0/68801206 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980b2c80 con 0x7f989815ab10 2023-10-16T13:48:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989659c700 1 --2- 172.21.15.5:0/68801206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989815ab10 0x7f989815f1f0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f989806d470 tx=0x7f988c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351313c11aa03287 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989559a700 1 -- 172.21.15.5:0/68801206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c004230 con 0x7f989815ab10 2023-10-16T13:48:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989559a700 1 -- 172.21.15.5:0/68801206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c004390 con 0x7f989815ab10 2023-10-16T13:48:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.714+0000 7f989559a700 1 -- 172.21.15.5:0/68801206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0036a0 con 0x7f989815ab10 2023-10-16T13:48:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 -- 172.21.15.5:0/68801206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989815ab10 msgr2=0x7f989815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 --2- 172.21.15.5:0/68801206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989815ab10 0x7f989815f1f0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f989806d470 tx=0x7f988c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 -- 172.21.15.5:0/68801206 shutdown_connections 2023-10-16T13:48:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 --2- 172.21.15.5:0/68801206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989815ab10 0x7f989815f1f0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 --2- 172.21.15.5:0/68801206 >> v2:172.21.15.112:3300/0 conn(0x7f98980b1f50 0x7f98980cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 -- 172.21.15.5:0/68801206 >> 172.21.15.5:0/68801206 conn(0x7f989806dae0 msgr2=0x7f989806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 -- 172.21.15.5:0/68801206 shutdown_connections 2023-10-16T13:48:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.715+0000 7f989cdcc700 1 -- 172.21.15.5:0/68801206 wait complete. 2023-10-16T13:48:00.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.716+0000 7f989cdcc700 1 Processor -- start 2023-10-16T13:48:00.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.716+0000 7f989cdcc700 1 -- start start 2023-10-16T13:48:00.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989cdcc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b1f50 0x7f98980cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989cdcc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 0x7f989814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989cdcc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f989815ab10 0x7f989814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989cdcc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989814e3e0 con 0x7f98980b2400 2023-10-16T13:48:00.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989cdcc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980b3030 con 0x7f98980b1f50 2023-10-16T13:48:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989cdcc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989815d430 con 0x7f989815ab10 2023-10-16T13:48:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 0x7f989814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 0x7f989814d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48010/0 (socket says 172.21.15.5:48010) 2023-10-16T13:48:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 -- 172.21.15.5:0/4114205469 learned_addr learned my addr 172.21.15.5:0/4114205469 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989659c700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b1f50 0x7f98980cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9896d9d700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f989815ab10 0x7f989814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 -- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f989815ab10 msgr2=0x7f989814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f989815ab10 0x7f989814dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 -- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b1f50 msgr2=0x7f98980cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b1f50 0x7f98980cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f9895d9b700 1 -- 172.21.15.5:0/4114205469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c009550 con 0x7f98980b2400 2023-10-16T13:48:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.717+0000 7f989659c700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b1f50 0x7f98980cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.718+0000 7f9895d9b700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 0x7f989814d960 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f988800d800 tx=0x7f988800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.718+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880125f0 con 0x7f98980b2400 2023-10-16T13:48:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.718+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888012750 con 0x7f98980b2400 2023-10-16T13:48:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.718+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989815d710 con 0x7f98980b2400 2023-10-16T13:48:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.718+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888012b00 con 0x7f98980b2400 2023-10-16T13:48:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.718+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989815dcd0 con 0x7f98980b2400 2023-10-16T13:48:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.719+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980720f0 con 0x7f98980b2400 2023-10-16T13:48:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.719+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f9888012c60 con 0x7f98980b2400 2023-10-16T13:48:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.720+0000 7f9886ffd700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f987806b1d0 0x7f987806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.720+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9888089bb0 con 0x7f98980b2400 2023-10-16T13:48:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.720+0000 7f989659c700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f987806b1d0 0x7f987806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.720+0000 7f989659c700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f987806b1d0 0x7f987806d690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f988c009c10 tx=0x7f988c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.724+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9888054910 con 0x7f98980b2400 2023-10-16T13:48:00.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.922+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9898067d20 con 0x7f98980b2400 2023-10-16T13:48:00.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.922+0000 7f9886ffd700 1 -- 172.21.15.5:0/4114205469 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9888057f30 con 0x7f98980b2400 2023-10-16T13:48:00.926 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.924+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f987806b1d0 msgr2=0x7f987806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.924+0000 7f989cdcc700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f987806b1d0 0x7f987806d690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f988c009c10 tx=0x7f988c008030 comp rx=0 tx=0).stop 2023-10-16T13:48:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.924+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 msgr2=0x7f989814d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.924+0000 7f989cdcc700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 0x7f989814d960 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f988800d800 tx=0x7f988800dbc0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 shutdown_connections 2023-10-16T13:48:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f987806b1d0 0x7f987806d690 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f989815ab10 0x7f989814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98980b1f50 0x7f98980cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 --2- 172.21.15.5:0/4114205469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98980b2400 0x7f989814d960 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 >> 172.21.15.5:0/4114205469 conn(0x7f989806dae0 msgr2=0x7f989806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:00.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 shutdown_connections 2023-10-16T13:48:00.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:00.925+0000 7f989cdcc700 1 -- 172.21.15.5:0/4114205469 wait complete. 2023-10-16T13:48:00.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:48:01.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.065+0000 7f468ec2b700 1 Processor -- start 2023-10-16T13:48:01.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.065+0000 7f468ec2b700 1 -- start start 2023-10-16T13:48:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.065+0000 7f468ec2b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f46880cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.065+0000 7f468ec2b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468815e7a0 con 0x7f468815f1f0 2023-10-16T13:48:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.065+0000 7f468ec2b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880b29a0 con 0x7f468815ab10 2023-10-16T13:48:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.065+0000 7f468ec2b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880b2c80 con 0x7f46880cfe30 2023-10-16T13:48:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f4687fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f468815f1f0 0x7f46880cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58020/0 (socket says 172.21.15.5:58020) 2023-10-16T13:48:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f4687fff700 1 -- 172.21.15.5:0/1228663489 learned_addr learned my addr 172.21.15.5:0/1228663489 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:01.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f468d1c8700 1 --2- 172.21.15.5:0/1228663489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f46880cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677651787 0 0) 0x7f468815e7a0 con 0x7f468815f1f0 2023-10-16T13:48:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46780035b0 con 0x7f468815f1f0 2023-10-16T13:48:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769918154 0 0) 0x7f46880b29a0 con 0x7f468815ab10 2023-10-16T13:48:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468815e7a0 con 0x7f468815ab10 2023-10-16T13:48:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385197289 0 0) 0x7f46780035b0 con 0x7f468815f1f0 2023-10-16T13:48:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f468d1c8700 1 -- 172.21.15.5:0/1228663489 >> v1:172.21.15.112:6789/0 conn(0x7f468815ab10 legacy=0x7f46880b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f468d1c8700 1 -- 172.21.15.5:0/1228663489 >> v1:172.21.15.5:6789/0 conn(0x7f468815f1f0 legacy=0x7f46880cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f468d1c8700 1 -- 172.21.15.5:0/1228663489 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468815e9f0 con 0x7f46880cfe30 2023-10-16T13:48:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.066+0000 7f468d1c8700 1 --2- 172.21.15.5:0/1228663489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f46880cbf40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4680009dc0 tx=0x7f468000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cf1eefcab3aeb7a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468000e070 con 0x7f46880cfe30 2023-10-16T13:48:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680003a20 con 0x7f46880cfe30 2023-10-16T13:48:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f46877fe700 1 -- 172.21.15.5:0/1228663489 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740017f0 con 0x7f46880cfe30 2023-10-16T13:48:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 -- 172.21.15.5:0/1228663489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 msgr2=0x7f46880cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 --2- 172.21.15.5:0/1228663489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f46880cbf40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4680009dc0 tx=0x7f468000b330 comp rx=0 tx=0).stop 2023-10-16T13:48:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 -- 172.21.15.5:0/1228663489 shutdown_connections 2023-10-16T13:48:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 --2- 172.21.15.5:0/1228663489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f46880cbf40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 -- 172.21.15.5:0/1228663489 >> 172.21.15.5:0/1228663489 conn(0x7f468806dae0 msgr2=0x7f468806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 -- 172.21.15.5:0/1228663489 shutdown_connections 2023-10-16T13:48:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.067+0000 7f468ec2b700 1 -- 172.21.15.5:0/1228663489 wait complete. 2023-10-16T13:48:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.068+0000 7f468ec2b700 1 Processor -- start 2023-10-16T13:48:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 -- start start 2023-10-16T13:48:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f468814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 0x7f46880c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f468815f1f0 0x7f46880c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468814ef90 con 0x7f468815ab10 2023-10-16T13:48:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468815cfc0 con 0x7f468815f1f0 2023-10-16T13:48:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.069+0000 7f468ec2b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468815d2a0 con 0x7f46880cfe30 2023-10-16T13:48:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 0x7f46880c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 0x7f46880c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48022/0 (socket says 172.21.15.5:48022) 2023-10-16T13:48:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 -- 172.21.15.5:0/171564571 learned_addr learned my addr 172.21.15.5:0/171564571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f468d1c8700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f468815f1f0 0x7f46880c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f468c9c7700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f468814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 -- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 msgr2=0x7f468814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f468814ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 -- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f468815f1f0 msgr2=0x7f46880c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f468815f1f0 0x7f46880c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 -- 172.21.15.5:0/171564571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680009a70 con 0x7f468815ab10 2023-10-16T13:48:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f468d1c8700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f468815f1f0 0x7f46880c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f468c9c7700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f468814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f4687fff700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 0x7f46880c7e10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f467400c780 tx=0x7f467400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740074e0 con 0x7f468815ab10 2023-10-16T13:48:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674007640 con 0x7f468815ab10 2023-10-16T13:48:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468815d580 con 0x7f468815ab10 2023-10-16T13:48:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674005a70 con 0x7f468815ab10 2023-10-16T13:48:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.070+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468815db40 con 0x7f468815ab10 2023-10-16T13:48:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.071+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4688067d20 con 0x7f468815ab10 2023-10-16T13:48:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.072+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7f4674005bd0 con 0x7f468815ab10 2023-10-16T13:48:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.072+0000 7f46857fa700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f466c06b1d0 0x7f466c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.072+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4674089040 con 0x7f468815ab10 2023-10-16T13:48:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.072+0000 7f468c9c7700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f466c06b1d0 0x7f466c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.073+0000 7f468c9c7700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f466c06b1d0 0x7f466c06d690 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f467c0011e0 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.077+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4674053da0 con 0x7f468815ab10 2023-10-16T13:48:01.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.276+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46880afc10 con 0x7f468815ab10 2023-10-16T13:48:01.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.276+0000 7f46857fa700 1 -- 172.21.15.5:0/171564571 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4674017020 con 0x7f468815ab10 2023-10-16T13:48:01.280 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:48:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.278+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f466c06b1d0 msgr2=0x7f466c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.278+0000 7f468ec2b700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f466c06b1d0 0x7f466c06d690 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f467c0011e0 tx=0x7f467c009040 comp rx=0 tx=0).stop 2023-10-16T13:48:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 msgr2=0x7f46880c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 0x7f46880c7e10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f467400c780 tx=0x7f467400cb40 comp rx=0 tx=0).stop 2023-10-16T13:48:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 shutdown_connections 2023-10-16T13:48:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f468815f1f0 0x7f46880c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f466c06b1d0 0x7f466c06d690 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46880cfe30 0x7f468814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 --2- 172.21.15.5:0/171564571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f468815ab10 0x7f46880c7e10 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 >> 172.21.15.5:0/171564571 conn(0x7f468806dae0 msgr2=0x7f46880cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:01.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 shutdown_connections 2023-10-16T13:48:01.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.279+0000 7f468ec2b700 1 -- 172.21.15.5:0/171564571 wait complete. 2023-10-16T13:48:01.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:48:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.419+0000 7fb42fe20700 1 Processor -- start 2023-10-16T13:48:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.419+0000 7fb42fe20700 1 -- start start 2023-10-16T13:48:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42fe20700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb42815b740 0x7fb4280d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42fe20700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4280d0c70 0x7fb4280cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42fe20700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280cf190 con 0x7fb4280c5110 2023-10-16T13:48:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42fe20700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42815bb20 con 0x7fb4280d0c70 2023-10-16T13:48:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42fe20700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280cbd40 con 0x7fb42815b740 2023-10-16T13:48:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42d3bb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4280d0c70 0x7fb4280cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42e3bd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4280c5110 0x7fb4280cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58036/0 (socket says 172.21.15.5:58036) 2023-10-16T13:48:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42e3bd700 1 -- 172.21.15.5:0/903648585 learned_addr learned my addr 172.21.15.5:0/903648585 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42dbbc700 1 --2- 172.21.15.5:0/903648585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb42815b740 0x7fb4280d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42d3bb700 1 -- 172.21.15.5:0/903648585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb42815b740 msgr2=0x7fb4280d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42d3bb700 1 --2- 172.21.15.5:0/903648585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb42815b740 0x7fb4280d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42d3bb700 1 -- 172.21.15.5:0/903648585 >> v1:172.21.15.5:6789/0 conn(0x7fb4280c5110 legacy=0x7fb4280cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42d3bb700 1 -- 172.21.15.5:0/903648585 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280cc020 con 0x7fb4280d0c70 2023-10-16T13:48:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42cbba700 1 -- 172.21.15.5:0/903648585 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098320641 0 0) 0x7fb4280cf190 con 0x7fb4280c5110 2023-10-16T13:48:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.420+0000 7fb42d3bb700 1 --2- 172.21.15.5:0/903648585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4280d0c70 0x7fb4280cdfd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb418009840 tx=0x7fb418009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458d31685b19ce00 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42cbba700 1 -- 172.21.15.5:0/903648585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011830 con 0x7fb4280d0c70 2023-10-16T13:48:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42cbba700 1 -- 172.21.15.5:0/903648585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418011990 con 0x7fb4280d0c70 2023-10-16T13:48:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42cbba700 1 -- 172.21.15.5:0/903648585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011d20 con 0x7fb4280d0c70 2023-10-16T13:48:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 -- 172.21.15.5:0/903648585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4280d0c70 msgr2=0x7fb4280cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 --2- 172.21.15.5:0/903648585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4280d0c70 0x7fb4280cdfd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb418009840 tx=0x7fb418009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 -- 172.21.15.5:0/903648585 shutdown_connections 2023-10-16T13:48:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 --2- 172.21.15.5:0/903648585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb42815b740 0x7fb4280d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 --2- 172.21.15.5:0/903648585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4280d0c70 0x7fb4280cdfd0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 -- 172.21.15.5:0/903648585 >> 172.21.15.5:0/903648585 conn(0x7fb4280665a0 msgr2=0x7fb428066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 -- 172.21.15.5:0/903648585 shutdown_connections 2023-10-16T13:48:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.421+0000 7fb42fe20700 1 -- 172.21.15.5:0/903648585 wait complete. 2023-10-16T13:48:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.422+0000 7fb42fe20700 1 Processor -- start 2023-10-16T13:48:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 -- start start 2023-10-16T13:48:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280c5110 0x7fb4280caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4280d0c70 0x7fb4280b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 0x7fb428159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42815c8f0 con 0x7fb42815b740 2023-10-16T13:48:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280b5540 con 0x7fb4280c5110 2023-10-16T13:48:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42fe20700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280b57e0 con 0x7fb4280d0c70 2023-10-16T13:48:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42e3bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 0x7fb428159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42e3bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 0x7fb428159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48038/0 (socket says 172.21.15.5:48038) 2023-10-16T13:48:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.423+0000 7fb42e3bd700 1 -- 172.21.15.5:0/1473987557 learned_addr learned my addr 172.21.15.5:0/1473987557 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42e3bd700 1 -- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4280d0c70 msgr2=0x7fb4280b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42d3bb700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4280d0c70 0x7fb4280b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42dbbc700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280c5110 0x7fb4280caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42e3bd700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4280d0c70 0x7fb4280b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42e3bd700 1 -- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280c5110 msgr2=0x7fb4280caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42e3bd700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280c5110 0x7fb4280caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42e3bd700 1 -- 172.21.15.5:0/1473987557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180094a0 con 0x7fb42815b740 2023-10-16T13:48:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42dbbc700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280c5110 0x7fb4280caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42e3bd700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 0x7fb428159460 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb42000cc70 tx=0x7fb42000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000ad80 con 0x7fb42815b740 2023-10-16T13:48:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42000ce70 con 0x7fb42815b740 2023-10-16T13:48:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4280b5ac0 con 0x7fb42815b740 2023-10-16T13:48:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200072f0 con 0x7fb42815b740 2023-10-16T13:48:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.424+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4280b6080 con 0x7fb42815b740 2023-10-16T13:48:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.425+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42815c650 con 0x7fb42815b740 2023-10-16T13:48:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.425+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fb420007450 con 0x7fb42815b740 2023-10-16T13:48:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.426+0000 7fb41e7fc700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb40c06b1d0 0x7fb40c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.426+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb420089920 con 0x7fb42815b740 2023-10-16T13:48:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.426+0000 7fb42dbbc700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb40c06b1d0 0x7fb40c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.427+0000 7fb42dbbc700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb40c06b1d0 0x7fb40c06d690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb424009820 tx=0x7fb424008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.431+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb42815c650 con 0x7fb42815b740 2023-10-16T13:48:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.630+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb42815ca30 con 0x7fb42815b740 2023-10-16T13:48:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.630+0000 7fb41e7fc700 1 -- 172.21.15.5:0/1473987557 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb42815ca30 con 0x7fb42815b740 2023-10-16T13:48:01.633 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:48:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb40c06b1d0 msgr2=0x7fb40c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb40c06b1d0 0x7fb40c06d690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb424009820 tx=0x7fb424008040 comp rx=0 tx=0).stop 2023-10-16T13:48:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 msgr2=0x7fb428159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 0x7fb428159460 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb42000cc70 tx=0x7fb42000a340 comp rx=0 tx=0).stop 2023-10-16T13:48:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 shutdown_connections 2023-10-16T13:48:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb42815b740 0x7fb428159460 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280c5110 0x7fb4280caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb40c06b1d0 0x7fb40c06d690 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 --2- 172.21.15.5:0/1473987557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4280d0c70 0x7fb4280b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 >> 172.21.15.5:0/1473987557 conn(0x7fb4280665a0 msgr2=0x7fb42815a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 shutdown_connections 2023-10-16T13:48:01.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.632+0000 7fb42fe20700 1 -- 172.21.15.5:0/1473987557 wait complete. 2023-10-16T13:48:01.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:48:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.770+0000 7fea050a3700 1 Processor -- start 2023-10-16T13:48:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.770+0000 7fea050a3700 1 -- start start 2023-10-16T13:48:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fea050a3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea0015a850 0x7fea000cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fea050a3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fea000b2940 0x7fea000ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fea050a3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000cd2e0 0x7fea00071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fea050a3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000ce3b0 con 0x7fea0015a850 2023-10-16T13:48:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fea050a3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000b2df0 con 0x7fea000b2940 2023-10-16T13:48:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fea050a3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000b6290 con 0x7fea000cd2e0 2023-10-16T13:48:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fe9fed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea0015a850 0x7fea000cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fe9fed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea0015a850 0x7fea000cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48042/0 (socket says 172.21.15.5:48042) 2023-10-16T13:48:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fe9fed9d700 1 -- 172.21.15.5:0/2697229766 learned_addr learned my addr 172.21.15.5:0/2697229766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fe9ff59e700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000cd2e0 0x7fea00071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.771+0000 7fe9fe59c700 1 --2- 172.21.15.5:0/2697229766 >> v2:172.21.15.112:3300/0 conn(0x7fea000b2940 0x7fea000ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fed9d700 1 -- 172.21.15.5:0/2697229766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000cd2e0 msgr2=0x7fea00071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fed9d700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000cd2e0 0x7fea00071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fed9d700 1 -- 172.21.15.5:0/2697229766 >> v2:172.21.15.112:3300/0 conn(0x7fea000b2940 msgr2=0x7fea000ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fed9d700 1 --2- 172.21.15.5:0/2697229766 >> v2:172.21.15.112:3300/0 conn(0x7fea000b2940 0x7fea000ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fed9d700 1 -- 172.21.15.5:0/2697229766 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000cc220 con 0x7fea0015a850 2023-10-16T13:48:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fe59c700 1 --2- 172.21.15.5:0/2697229766 >> v2:172.21.15.112:3300/0 conn(0x7fea000b2940 0x7fea000ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9ff59e700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000cd2e0 0x7fea00071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fed9d700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0015a850 0x7fea000cbc40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fea000caa90 tx=0x7fe9f400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be593e5330b38f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fdd9b700 1 -- 172.21.15.5:0/2697229766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400dd30 con 0x7fea0015a850 2023-10-16T13:48:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fdd9b700 1 -- 172.21.15.5:0/2697229766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400de90 con 0x7fea0015a850 2023-10-16T13:48:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fe9fdd9b700 1 -- 172.21.15.5:0/2697229766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4010690 con 0x7fea0015a850 2023-10-16T13:48:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fea050a3700 1 -- 172.21.15.5:0/2697229766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0015a850 msgr2=0x7fea000cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.772+0000 7fea050a3700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0015a850 0x7fea000cbc40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fea000caa90 tx=0x7fe9f400be70 comp rx=0 tx=0).stop 2023-10-16T13:48:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 -- 172.21.15.5:0/2697229766 shutdown_connections 2023-10-16T13:48:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000cd2e0 0x7fea00071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 --2- 172.21.15.5:0/2697229766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0015a850 0x7fea000cbc40 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 --2- 172.21.15.5:0/2697229766 >> v2:172.21.15.112:3300/0 conn(0x7fea000b2940 0x7fea000ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 -- 172.21.15.5:0/2697229766 >> 172.21.15.5:0/2697229766 conn(0x7fea0006dac0 msgr2=0x7fea0006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 -- 172.21.15.5:0/2697229766 shutdown_connections 2023-10-16T13:48:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.773+0000 7fea050a3700 1 -- 172.21.15.5:0/2697229766 wait complete. 2023-10-16T13:48:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.774+0000 7fea050a3700 1 Processor -- start 2023-10-16T13:48:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.774+0000 7fea050a3700 1 -- start start 2023-10-16T13:48:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fea050a3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000b2940 0x7fea000c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fea050a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 0x7fea001ec660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fea050a3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015a850 0x7fea001f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fea050a3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c7b70 con 0x7fea000cd2e0 2023-10-16T13:48:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fea050a3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea001ecba0 con 0x7fea0015a850 2023-10-16T13:48:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fea050a3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0015c8c0 con 0x7fea000b2940 2023-10-16T13:48:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 0x7fea001ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 0x7fea001ec660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48052/0 (socket says 172.21.15.5:48052) 2023-10-16T13:48:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 -- 172.21.15.5:0/1849527674 learned_addr learned my addr 172.21.15.5:0/1849527674 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fed9d700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000b2940 0x7fea000c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9ff59e700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015a850 0x7fea001f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 -- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000b2940 msgr2=0x7fea000c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000b2940 0x7fea000c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 -- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015a850 msgr2=0x7fea001f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015a850 0x7fea001f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.775+0000 7fe9fe59c700 1 -- 172.21.15.5:0/1849527674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f400b7f0 con 0x7fea000cd2e0 2023-10-16T13:48:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.776+0000 7fe9fe59c700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 0x7fea001ec660 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000d800 tx=0x7fe9f000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.776+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0004030 con 0x7fea000cd2e0 2023-10-16T13:48:01.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.776+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f0004190 con 0x7fea000cd2e0 2023-10-16T13:48:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.776+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0015cba0 con 0x7fea000cd2e0 2023-10-16T13:48:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.776+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0004520 con 0x7fea000cd2e0 2023-10-16T13:48:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.776+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0015d160 con 0x7fea000cd2e0 2023-10-16T13:48:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.777+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea000d1190 con 0x7fea000cd2e0 2023-10-16T13:48:01.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.777+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 10) v1 ==== 89484+0+0 (secure 0 0 0) 0x7fe9f00036a0 con 0x7fea000cd2e0 2023-10-16T13:48:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.778+0000 7fe9e77fe700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe9ec06b1d0 0x7fe9ec06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.778+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f0088fe0 con 0x7fea000cd2e0 2023-10-16T13:48:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.778+0000 7fe9fed9d700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe9ec06b1d0 0x7fe9ec06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.778+0000 7fe9fed9d700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe9ec06b1d0 0x7fe9ec06d690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400beb0 tx=0x7fe9f4012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:01.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.783+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe9f00bbca0 con 0x7fea000cd2e0 2023-10-16T13:48:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:01.874+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fe9f00541c0 con 0x7fea000cd2e0 2023-10-16T13:48:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.005+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fea00067d20 con 0x7fea000cd2e0 2023-10-16T13:48:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.005+0000 7fe9e77fe700 1 -- 172.21.15.5:0/1849527674 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe9f00727e0 con 0x7fea000cd2e0 2023-10-16T13:48:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe9ec06b1d0 msgr2=0x7fe9ec06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe9ec06b1d0 0x7fe9ec06d690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400beb0 tx=0x7fe9f4012000 comp rx=0 tx=0).stop 2023-10-16T13:48:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 msgr2=0x7fea001ec660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 0x7fea001ec660 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000d800 tx=0x7fe9f000db10 comp rx=0 tx=0).stop 2023-10-16T13:48:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 shutdown_connections 2023-10-16T13:48:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea0015a850 0x7fea001f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe9ec06b1d0 0x7fe9ec06d690 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea000b2940 0x7fea000c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 --2- 172.21.15.5:0/1849527674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea000cd2e0 0x7fea001ec660 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 >> 172.21.15.5:0/1849527674 conn(0x7fea0006dac0 msgr2=0x7fea00158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 shutdown_connections 2023-10-16T13:48:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.007+0000 7fea050a3700 1 -- 172.21.15.5:0/1849527674 wait complete. 2023-10-16T13:48:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:48:02.022 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:48:02.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:02.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:02.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:48:02.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:02.062 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:48:02.118 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:02.119 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:02.139 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:02.139 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:02.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.321+0000 7f0d92342700 1 Processor -- start 2023-10-16T13:48:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.321+0000 7f0d92342700 1 -- start start 2023-10-16T13:48:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d92342700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 0x7f0d8c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d92342700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c15e7a0 con 0x7f0d8c15ab10 2023-10-16T13:48:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d92342700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c0b29a0 con 0x7f0d8c15f1f0 2023-10-16T13:48:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d92342700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0b2c80 con 0x7f0d8c0cfe30 2023-10-16T13:48:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0d8c15ab10 0x7f0d8c0b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58060/0 (socket says 172.21.15.5:58060) 2023-10-16T13:48:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8bfff700 1 -- 172.21.15.5:0/1085386351 learned_addr learned my addr 172.21.15.5:0/1085386351 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d908df700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 0x7f0d8c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252610589 0 0) 0x7f0d8c15e7a0 con 0x7f0d8c15ab10 2023-10-16T13:48:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d740057c0 con 0x7f0d8c15ab10 2023-10-16T13:48:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073720867 0 0) 0x7f0d740057c0 con 0x7f0d8c15ab10 2023-10-16T13:48:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 msgr2=0x7f0d8c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 0x7f0d8c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 >> v1:172.21.15.112:6789/0 conn(0x7f0d8c15f1f0 legacy=0x7f0d8c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c15e9f0 con 0x7f0d8c15ab10 2023-10-16T13:48:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f0d7c001670 con 0x7f0d8c15ab10 2023-10-16T13:48:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 >> v1:172.21.15.5:6789/0 conn(0x7f0d8c15ab10 legacy=0x7f0d8c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d74005c40 0x7f0d74006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 0x7f0d74006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d74006fa0 0x7f0d74007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0b2c80 con 0x7f0d74006fa0 2023-10-16T13:48:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7400dd00 con 0x7f0d74005c40 2023-10-16T13:48:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.322+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7400dec0 con 0x7f0d8c0cfe30 2023-10-16T13:48:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d74006fa0 0x7f0d74007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d8bfff700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d74005c40 0x7f0d74006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d8b7fe700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 0x7f0d74006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 -- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 msgr2=0x7f0d74006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c0cfe30 0x7f0d74006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 -- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d74005c40 msgr2=0x7f0d74006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d74005c40 0x7f0d74006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 -- 172.21.15.5:0/1085386351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740057c0 con 0x7f0d74006fa0 2023-10-16T13:48:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d908df700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d74006fa0 0x7f0d74007420 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0aff00 tx=0x7f0d74007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41359cb748ee3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400eba0 con 0x7f0d74006fa0 2023-10-16T13:48:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400f040 con 0x7f0d74006fa0 2023-10-16T13:48:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.323+0000 7f0d8affd700 1 -- 172.21.15.5:0/1085386351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84014480 con 0x7f0d74006fa0 2023-10-16T13:48:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d92342700 1 -- 172.21.15.5:0/1085386351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d74006fa0 msgr2=0x7f0d74007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d92342700 1 --2- 172.21.15.5:0/1085386351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d74006fa0 0x7f0d74007420 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0aff00 tx=0x7f0d74007a90 comp rx=0 tx=0).stop 2023-10-16T13:48:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d908df700 1 -- 172.21.15.5:0/1085386351 reap_dead start 2023-10-16T13:48:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d92342700 1 -- 172.21.15.5:0/1085386351 shutdown_connections 2023-10-16T13:48:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d92342700 1 -- 172.21.15.5:0/1085386351 >> 172.21.15.5:0/1085386351 conn(0x7f0d8c06dae0 msgr2=0x7f0d8c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d92342700 1 -- 172.21.15.5:0/1085386351 shutdown_connections 2023-10-16T13:48:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.324+0000 7f0d92342700 1 -- 172.21.15.5:0/1085386351 wait complete. 2023-10-16T13:48:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.325+0000 7f0d92342700 1 Processor -- start 2023-10-16T13:48:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.325+0000 7f0d92342700 1 -- start start 2023-10-16T13:48:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d92342700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c154a00 0x7f0d8c0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d92342700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 0x7f0d8c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d92342700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d8c157ef0 0x7f0d8c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d92342700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c158380 con 0x7f0d8c0af110 2023-10-16T13:48:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d92342700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c4000 con 0x7f0d8c157ef0 2023-10-16T13:48:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d92342700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c15c8e0 con 0x7f0d8c154a00 2023-10-16T13:48:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 0x7f0d8c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 0x7f0d8c1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48070/0 (socket says 172.21.15.5:48070) 2023-10-16T13:48:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 -- 172.21.15.5:0/4170919581 learned_addr learned my addr 172.21.15.5:0/4170919581 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:02.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d908df700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d8c157ef0 0x7f0d8c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8bfff700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c154a00 0x7f0d8c0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 -- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c154a00 msgr2=0x7f0d8c0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c154a00 0x7f0d8c0aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 -- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d8c157ef0 msgr2=0x7f0d8c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d8c157ef0 0x7f0d8c0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 -- 172.21.15.5:0/4170919581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c15c5b0 con 0x7f0d8c0af110 2023-10-16T13:48:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.326+0000 7f0d8b7fe700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 0x7f0d8c1579b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000f820 tx=0x7f0d8000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.327+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800052e0 con 0x7f0d8c0af110 2023-10-16T13:48:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.327+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80005440 con 0x7f0d8c0af110 2023-10-16T13:48:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.327+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800055b0 con 0x7f0d8c0af110 2023-10-16T13:48:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.327+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c0ad630 con 0x7f0d8c0af110 2023-10-16T13:48:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.327+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c0adbf0 con 0x7f0d8c0af110 2023-10-16T13:48:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.328+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c15ca90 con 0x7f0d8c0af110 2023-10-16T13:48:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.328+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f0d80003910 con 0x7f0d8c0af110 2023-10-16T13:48:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.328+0000 7f0d88ff9700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d7806b1d0 0x7f0d7806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.329+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d80089620 con 0x7f0d8c0af110 2023-10-16T13:48:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.329+0000 7f0d8bfff700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d7806b1d0 0x7f0d7806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.329+0000 7f0d8bfff700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d7806b1d0 0x7f0d7806d690 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0017a0 tx=0x7f0d7c0014b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.333+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d8c15ca90 con 0x7f0d8c0af110 2023-10-16T13:48:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.534+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d8c15ca50 con 0x7f0d8c0af110 2023-10-16T13:48:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.535+0000 7f0d88ff9700 1 -- 172.21.15.5:0/4170919581 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16436 (secure 0 0 0) 0x7f0d80054430 con 0x7f0d8c0af110 2023-10-16T13:48:02.538 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:02.538 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:50.785531+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d7806b1d0 msgr2=0x7f0d7806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d7806b1d0 0x7f0d7806d690 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0017a0 tx=0x7f0d7c0014b0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 msgr2=0x7f0d8c1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 0x7f0d8c1579b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000f820 tx=0x7f0d8000fb30 comp rx=0 tx=0).stop 2023-10-16T13:48:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 shutdown_connections 2023-10-16T13:48:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d8c157ef0 0x7f0d8c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0d7806b1d0 0x7f0d7806d690 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d8c154a00 0x7f0d8c0aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 --2- 172.21.15.5:0/4170919581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0af110 0x7f0d8c1579b0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 >> 172.21.15.5:0/4170919581 conn(0x7f0d8c06dae0 msgr2=0x7f0d8c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 shutdown_connections 2023-10-16T13:48:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.537+0000 7f0d92342700 1 -- 172.21.15.5:0/4170919581 wait complete. 2023-10-16T13:48:02.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:47:47.704922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:47:48.167141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:02.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:02.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.678+0000 7fa609b6a700 1 Processor -- start 2023-10-16T13:48:02.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.678+0000 7fa609b6a700 1 -- start start 2023-10-16T13:48:02.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa609b6a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa60415f130 0x7fa6040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa609b6a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60406af50 0x7fa6040b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa609b6a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6040b3530 con 0x7fa6040b28b0 2023-10-16T13:48:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa609b6a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6040cde00 con 0x7fa60415f130 2023-10-16T13:48:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa609b6a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040cd180 con 0x7fa60406af50 2023-10-16T13:48:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa602ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6040b28b0 0x7fa60406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58080/0 (socket says 172.21.15.5:58080) 2023-10-16T13:48:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa602ffd700 1 -- 172.21.15.5:0/4258583599 learned_addr learned my addr 172.21.15.5:0/4258583599 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6037fe700 1 --2- 172.21.15.5:0/4258583599 >> v2:172.21.15.112:3300/0 conn(0x7fa60415f130 0x7fa6040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa603fff700 1 --2- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60406af50 0x7fa6040b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6027fc700 1 -- 172.21.15.5:0/4258583599 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216575263 0 0) 0x7fa6040b3530 con 0x7fa6040b28b0 2023-10-16T13:48:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6027fc700 1 -- 172.21.15.5:0/4258583599 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ec0035b0 con 0x7fa6040b28b0 2023-10-16T13:48:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6037fe700 1 -- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60406af50 msgr2=0x7fa6040b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6037fe700 1 --2- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60406af50 0x7fa6040b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6037fe700 1 -- 172.21.15.5:0/4258583599 >> v1:172.21.15.5:6789/0 conn(0x7fa6040b28b0 legacy=0x7fa60406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6027fc700 1 -- 172.21.15.5:0/4258583599 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69641734 0 0) 0x7fa5ec0035b0 con 0x7fa6040b28b0 2023-10-16T13:48:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.679+0000 7fa6037fe700 1 -- 172.21.15.5:0/4258583599 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040cd460 con 0x7fa60415f130 2023-10-16T13:48:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa6037fe700 1 --2- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60415f130 0x7fa6040cede0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009840 tx=0x7fa5f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4027e872777ccf5b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa6027fc700 1 -- 172.21.15.5:0/4258583599 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40017f0 con 0x7fa60415f130 2023-10-16T13:48:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa6027fc700 1 -- 172.21.15.5:0/4258583599 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f8004030 con 0x7fa60415f130 2023-10-16T13:48:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa6027fc700 1 -- 172.21.15.5:0/4258583599 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80043c0 con 0x7fa60415f130 2023-10-16T13:48:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 -- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60415f130 msgr2=0x7fa6040cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 --2- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60415f130 0x7fa6040cede0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009840 tx=0x7fa5f8009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 -- 172.21.15.5:0/4258583599 shutdown_connections 2023-10-16T13:48:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 --2- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60406af50 0x7fa6040b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 --2- 172.21.15.5:0/4258583599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60415f130 0x7fa6040cede0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 -- 172.21.15.5:0/4258583599 >> 172.21.15.5:0/4258583599 conn(0x7fa60406dae0 msgr2=0x7fa60406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 -- 172.21.15.5:0/4258583599 shutdown_connections 2023-10-16T13:48:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.680+0000 7fa609b6a700 1 -- 172.21.15.5:0/4258583599 wait complete. 2023-10-16T13:48:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.682+0000 7fa609b6a700 1 Processor -- start 2023-10-16T13:48:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.682+0000 7fa609b6a700 1 -- start start 2023-10-16T13:48:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.682+0000 7fa609b6a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60406af50 0x7fa6040c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.682+0000 7fa609b6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 0x7fa6040aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa609b6a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60415f130 0x7fa60414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa609b6a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040af360 con 0x7fa6040b28b0 2023-10-16T13:48:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa609b6a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040ac8b0 con 0x7fa60406af50 2023-10-16T13:48:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa609b6a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040cbd80 con 0x7fa60415f130 2023-10-16T13:48:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 0x7fa6040aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 0x7fa6040aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48084/0 (socket says 172.21.15.5:48084) 2023-10-16T13:48:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 -- 172.21.15.5:0/274108952 learned_addr learned my addr 172.21.15.5:0/274108952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa6037fe700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60406af50 0x7fa6040c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa603fff700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60415f130 0x7fa60414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 -- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60415f130 msgr2=0x7fa60414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60415f130 0x7fa60414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 -- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60406af50 msgr2=0x7fa6040c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60406af50 0x7fa6040c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 -- 172.21.15.5:0/274108952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f80094a0 con 0x7fa6040b28b0 2023-10-16T13:48:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa602ffd700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 0x7fa6040aee20 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c780 tx=0x7fa5f400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40074e0 con 0x7fa6040b28b0 2023-10-16T13:48:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4007640 con 0x7fa6040b28b0 2023-10-16T13:48:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6040cc060 con 0x7fa6040b28b0 2023-10-16T13:48:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4005a30 con 0x7fa6040b28b0 2023-10-16T13:48:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.683+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60414ee00 con 0x7fa6040b28b0 2023-10-16T13:48:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.684+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa604067d20 con 0x7fa6040b28b0 2023-10-16T13:48:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.685+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fa5f4005b90 con 0x7fa6040b28b0 2023-10-16T13:48:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.685+0000 7fa5ebfff700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5f006b260 0x7fa5f006d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.686+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5f40890c0 con 0x7fa6040b28b0 2023-10-16T13:48:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.686+0000 7fa6037fe700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5f006b260 0x7fa5f006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.686+0000 7fa6037fe700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5f006b260 0x7fa5f006d720 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80090b0 tx=0x7fa5f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:02.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.690+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5f4053c00 con 0x7fa6040b28b0 2023-10-16T13:48:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.890+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6040cd710 con 0x7fa6040b28b0 2023-10-16T13:48:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.891+0000 7fa5ebfff700 1 -- 172.21.15.5:0/274108952 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5f4057220 con 0x7fa6040b28b0 2023-10-16T13:48:02.894 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:02.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5f006b260 msgr2=0x7fa5f006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5f006b260 0x7fa5f006d720 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80090b0 tx=0x7fa5f8008030 comp rx=0 tx=0).stop 2023-10-16T13:48:02.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 msgr2=0x7fa6040aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:02.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 0x7fa6040aee20 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c780 tx=0x7fa5f400ca90 comp rx=0 tx=0).stop 2023-10-16T13:48:02.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 shutdown_connections 2023-10-16T13:48:02.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa5f006b260 0x7fa5f006d720 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60415f130 0x7fa60414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa60406af50 0x7fa6040c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 --2- 172.21.15.5:0/274108952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6040b28b0 0x7fa6040aee20 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:02.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 >> 172.21.15.5:0/274108952 conn(0x7fa60406dae0 msgr2=0x7fa6040b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:02.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 shutdown_connections 2023-10-16T13:48:02.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:02.893+0000 7fa609b6a700 1 -- 172.21.15.5:0/274108952 wait complete. 2023-10-16T13:48:02.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:48:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.033+0000 7f2c183bd700 1 Processor -- start 2023-10-16T13:48:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.033+0000 7f2c183bd700 1 -- start start 2023-10-16T13:48:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c183bd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c1015f1f0 0x7f2c100cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c183bd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1015e7a0 con 0x7f2c1015ab10 2023-10-16T13:48:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c183bd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100d0090 con 0x7f2c100cfc60 2023-10-16T13:48:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c183bd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100b29a0 con 0x7f2c1015f1f0 2023-10-16T13:48:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c16159700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2c1015ab10 0x7f2c100b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58094/0 (socket says 172.21.15.5:58094) 2023-10-16T13:48:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c16159700 1 -- 172.21.15.5:0/963217164 learned_addr learned my addr 172.21.15.5:0/963217164 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:03.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15958700 1 --2- 172.21.15.5:0/963217164 >> v2:172.21.15.112:3300/0 conn(0x7f2c1015f1f0 0x7f2c100cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747009874 0 0) 0x7f2c1015e7a0 con 0x7f2c1015ab10 2023-10-16T13:48:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bfc0035b0 con 0x7f2c1015ab10 2023-10-16T13:48:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867689265 0 0) 0x7f2bfc0035b0 con 0x7f2c1015ab10 2023-10-16T13:48:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 >> v2:172.21.15.112:3300/0 conn(0x7f2c1015f1f0 msgr2=0x7f2c100cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 --2- 172.21.15.5:0/963217164 >> v2:172.21.15.112:3300/0 conn(0x7f2c1015f1f0 0x7f2c100cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 >> v1:172.21.15.112:6789/0 conn(0x7f2c100cfc60 legacy=0x7f2c100cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100b2c80 con 0x7f2c1015ab10 2023-10-16T13:48:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f2c0c001670 con 0x7f2c1015ab10 2023-10-16T13:48:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 >> v1:172.21.15.5:6789/0 conn(0x7f2c1015ab10 legacy=0x7f2c100b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2bfc003a00 0x7f2bfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc004400 0x7f2bfc0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2bfc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b29a0 con 0x7f2bfc0050d0 2023-10-16T13:48:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc00c030 con 0x7f2bfc004400 2023-10-16T13:48:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.034+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc00c1f0 con 0x7f2bfc003a00 2023-10-16T13:48:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2bfc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c16159700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2bfc003a00 0x7f2bfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c15958700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc004400 0x7f2bfc0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 -- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2bfc003a00 msgr2=0x7f2bfc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2bfc003a00 0x7f2bfc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 -- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc004400 msgr2=0x7f2bfc0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc004400 0x7f2bfc0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 -- 172.21.15.5:0/963217164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0035b0 con 0x7f2bfc0050d0 2023-10-16T13:48:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 -- 172.21.15.5:0/963217164 reap_dead start 2023-10-16T13:48:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c1695a700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2bfc00ba10 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c290 tx=0x7f2bfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa2bf738d11ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08001e70 con 0x7f2bfc0050d0 2023-10-16T13:48:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800ce70 con 0x7f2bfc0050d0 2023-10-16T13:48:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.035+0000 7f2c15157700 1 -- 172.21.15.5:0/963217164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08003c20 con 0x7f2bfc0050d0 2023-10-16T13:48:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 -- 172.21.15.5:0/963217164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 msgr2=0x7f2bfc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2bfc00ba10 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c290 tx=0x7f2bfc005880 comp rx=0 tx=0).stop 2023-10-16T13:48:03.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 -- 172.21.15.5:0/963217164 shutdown_connections 2023-10-16T13:48:03.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 --2- 172.21.15.5:0/963217164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2bfc00ba10 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 -- 172.21.15.5:0/963217164 >> 172.21.15.5:0/963217164 conn(0x7f2c1006dae0 msgr2=0x7f2c1006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:03.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 -- 172.21.15.5:0/963217164 shutdown_connections 2023-10-16T13:48:03.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.036+0000 7f2c183bd700 1 -- 172.21.15.5:0/963217164 wait complete. 2023-10-16T13:48:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.037+0000 7f2c183bd700 1 Processor -- start 2023-10-16T13:48:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.037+0000 7f2c183bd700 1 -- start start 2023-10-16T13:48:03.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c183bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2c10151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c183bd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c100b0a60 0x7f2c100b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c183bd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1015d410 0x7f2c1015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c183bd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100ae520 con 0x7f2bfc0050d0 2023-10-16T13:48:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c183bd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1015de00 con 0x7f2c1015d410 2023-10-16T13:48:03.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c183bd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10151590 con 0x7f2c100b0a60 2023-10-16T13:48:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2c10151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2c10151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48102/0 (socket says 172.21.15.5:48102) 2023-10-16T13:48:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 -- 172.21.15.5:0/1653518496 learned_addr learned my addr 172.21.15.5:0/1653518496 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c15958700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c100b0a60 0x7f2c100b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c1695a700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1015d410 0x7f2c1015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 -- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c100b0a60 msgr2=0x7f2c100b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c100b0a60 0x7f2c100b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 -- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1015d410 msgr2=0x7f2c1015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1015d410 0x7f2c1015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 -- 172.21.15.5:0/1653518496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100b3d80 con 0x7f2bfc0050d0 2023-10-16T13:48:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c1695a700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1015d410 0x7f2c1015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.038+0000 7f2c16159700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2c10151050 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007290 tx=0x7f2c0c0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.039+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00f6c0 con 0x7f2bfc0050d0 2023-10-16T13:48:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.039+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00f820 con 0x7f2bfc0050d0 2023-10-16T13:48:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.039+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c100b1d60 con 0x7f2bfc0050d0 2023-10-16T13:48:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.039+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00fbb0 con 0x7f2bfc0050d0 2023-10-16T13:48:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.039+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c100b3a10 con 0x7f2bfc0050d0 2023-10-16T13:48:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.040+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c100b3590 con 0x7f2bfc0050d0 2023-10-16T13:48:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.040+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f2c0c00fd10 con 0x7f2bfc0050d0 2023-10-16T13:48:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.041+0000 7f2c06ffd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2bf406b290 0x7f2bf406d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.041+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c0c0899f0 con 0x7f2bfc0050d0 2023-10-16T13:48:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.041+0000 7f2c15958700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2bf406b290 0x7f2bf406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.041+0000 7f2c15958700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2bf406b290 0x7f2bf406d750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2c100b0e60 tx=0x7f2c000091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.045+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c100b3590 con 0x7f2bfc0050d0 2023-10-16T13:48:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.248+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c100b3590 con 0x7f2bfc0050d0 2023-10-16T13:48:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.249+0000 7f2c06ffd700 1 -- 172.21.15.5:0/1653518496 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c100b3590 con 0x7f2bfc0050d0 2023-10-16T13:48:03.252 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:48:03.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2bf406b290 msgr2=0x7f2bf406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2bf406b290 0x7f2bf406d750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2c100b0e60 tx=0x7f2c000091c0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 msgr2=0x7f2c10151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2c10151050 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007290 tx=0x7f2c0c0075a0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 shutdown_connections 2023-10-16T13:48:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1015d410 0x7f2c1015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bfc0050d0 0x7f2c10151050 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2bf406b290 0x7f2bf406d750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 --2- 172.21.15.5:0/1653518496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c100b0a60 0x7f2c100b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 >> 172.21.15.5:0/1653518496 conn(0x7f2c1006dae0 msgr2=0x7f2c1006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 shutdown_connections 2023-10-16T13:48:03.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.251+0000 7f2c183bd700 1 -- 172.21.15.5:0/1653518496 wait complete. 2023-10-16T13:48:03.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:48:03.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.391+0000 7fb6777ab700 1 Processor -- start 2023-10-16T13:48:03.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.391+0000 7fb6777ab700 1 -- start start 2023-10-16T13:48:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb6777ab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6700cd950 0x7fb67015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb6777ab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb67006a840 0x7fb67006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb6777ab700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6700cf260 con 0x7fb6700cede0 2023-10-16T13:48:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb6777ab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6701619a0 con 0x7fb67006a840 2023-10-16T13:48:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb6777ab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67006b1f0 con 0x7fb6700cd950 2023-10-16T13:48:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb675d48700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb67006a840 0x7fb67006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb674d46700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6700cede0 0x7fb67015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58114/0 (socket says 172.21.15.5:58114) 2023-10-16T13:48:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb674d46700 1 -- 172.21.15.5:0/1244905420 learned_addr learned my addr 172.21.15.5:0/1244905420 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.392+0000 7fb675547700 1 --2- 172.21.15.5:0/1244905420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6700cd950 0x7fb67015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb675d48700 1 -- 172.21.15.5:0/1244905420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6700cd950 msgr2=0x7fb67015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb675d48700 1 --2- 172.21.15.5:0/1244905420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6700cd950 0x7fb67015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb675d48700 1 -- 172.21.15.5:0/1244905420 >> v1:172.21.15.5:6789/0 conn(0x7fb6700cede0 legacy=0x7fb67015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb675d48700 1 -- 172.21.15.5:0/1244905420 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700b2d60 con 0x7fb67006a840 2023-10-16T13:48:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb667fff700 1 -- 172.21.15.5:0/1244905420 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183014904 0 0) 0x7fb6700cf260 con 0x7fb6700cede0 2023-10-16T13:48:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb675d48700 1 --2- 172.21.15.5:0/1244905420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67006a840 0x7fb67006acb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb668009d90 tx=0x7fb66800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd747705dc99a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb667fff700 1 -- 172.21.15.5:0/1244905420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800e070 con 0x7fb67006a840 2023-10-16T13:48:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb667fff700 1 -- 172.21.15.5:0/1244905420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800bbd0 con 0x7fb67006a840 2023-10-16T13:48:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb667fff700 1 -- 172.21.15.5:0/1244905420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668012430 con 0x7fb67006a840 2023-10-16T13:48:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb6777ab700 1 -- 172.21.15.5:0/1244905420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67006a840 msgr2=0x7fb67006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb6777ab700 1 --2- 172.21.15.5:0/1244905420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67006a840 0x7fb67006acb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb668009d90 tx=0x7fb66800b330 comp rx=0 tx=0).stop 2023-10-16T13:48:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb6777ab700 1 -- 172.21.15.5:0/1244905420 shutdown_connections 2023-10-16T13:48:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb6777ab700 1 --2- 172.21.15.5:0/1244905420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67006a840 0x7fb67006acb0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.393+0000 7fb6777ab700 1 --2- 172.21.15.5:0/1244905420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6700cd950 0x7fb67015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.394+0000 7fb6777ab700 1 -- 172.21.15.5:0/1244905420 >> 172.21.15.5:0/1244905420 conn(0x7fb67006dae0 msgr2=0x7fb67006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.394+0000 7fb6777ab700 1 -- 172.21.15.5:0/1244905420 shutdown_connections 2023-10-16T13:48:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.394+0000 7fb6777ab700 1 -- 172.21.15.5:0/1244905420 wait complete. 2023-10-16T13:48:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.395+0000 7fb6777ab700 1 Processor -- start 2023-10-16T13:48:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.395+0000 7fb6777ab700 1 -- start start 2023-10-16T13:48:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb67006a840 0x7fb670160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 0x7fb6700ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6700cede0 0x7fb6700acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701f6c80 con 0x7fb6700cd950 2023-10-16T13:48:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701f6f60 con 0x7fb6700cede0 2023-10-16T13:48:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701f7240 con 0x7fb67006a840 2023-10-16T13:48:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 0x7fb6700ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 0x7fb6700ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48118/0 (socket says 172.21.15.5:48118) 2023-10-16T13:48:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 -- 172.21.15.5:0/3012852238 learned_addr learned my addr 172.21.15.5:0/3012852238 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb675547700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb67006a840 0x7fb670160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb675d48700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6700cede0 0x7fb6700acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 -- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb67006a840 msgr2=0x7fb670160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb67006a840 0x7fb670160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 -- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6700cede0 msgr2=0x7fb6700acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6700cede0 0x7fb6700acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 -- 172.21.15.5:0/3012852238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009a70 con 0x7fb6700cd950 2023-10-16T13:48:03.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb674d46700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 0x7fb6700ac8b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c700 tx=0x7fb66c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0074e0 con 0x7fb6700cd950 2023-10-16T13:48:03.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c007640 con 0x7fb6700cd950 2023-10-16T13:48:03.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6701f7520 con 0x7fb6700cd950 2023-10-16T13:48:03.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.396+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c005a30 con 0x7fb6700cd950 2023-10-16T13:48:03.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.397+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6700af880 con 0x7fb6700cd950 2023-10-16T13:48:03.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.397+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6701f6dc0 con 0x7fb6700cd950 2023-10-16T13:48:03.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.398+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fb66c005b90 con 0x7fb6700cd950 2023-10-16T13:48:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.398+0000 7fb665ffb700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb65406b260 0x7fb65406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.399+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb66c088db0 con 0x7fb6700cd950 2023-10-16T13:48:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.399+0000 7fb675547700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb65406b260 0x7fb65406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.399+0000 7fb675547700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb65406b260 0x7fb65406d720 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb6700b1cb0 tx=0x7fb660008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.403+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6701f6dc0 con 0x7fb6700cd950 2023-10-16T13:48:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.603+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6701f6dc0 con 0x7fb6700cd950 2023-10-16T13:48:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.603+0000 7fb665ffb700 1 -- 172.21.15.5:0/3012852238 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6701f6dc0 con 0x7fb6700cd950 2023-10-16T13:48:03.607 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:48:03.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb65406b260 msgr2=0x7fb65406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb65406b260 0x7fb65406d720 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb6700b1cb0 tx=0x7fb660008040 comp rx=0 tx=0).stop 2023-10-16T13:48:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 msgr2=0x7fb6700ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 0x7fb6700ac8b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c700 tx=0x7fb66c00ca10 comp rx=0 tx=0).stop 2023-10-16T13:48:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 shutdown_connections 2023-10-16T13:48:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6700cede0 0x7fb6700acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb65406b260 0x7fb65406d720 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb67006a840 0x7fb670160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 --2- 172.21.15.5:0/3012852238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6700cd950 0x7fb6700ac8b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 >> 172.21.15.5:0/3012852238 conn(0x7fb67006dae0 msgr2=0x7fb67015d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 shutdown_connections 2023-10-16T13:48:03.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.605+0000 7fb6777ab700 1 -- 172.21.15.5:0/3012852238 wait complete. 2023-10-16T13:48:03.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:48:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.744+0000 7f44b1951700 1 Processor -- start 2023-10-16T13:48:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.744+0000 7f44b1951700 1 -- start start 2023-10-16T13:48:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.744+0000 7f44b1951700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44ac0cc3f0 0x7f44ac0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.744+0000 7f44b1951700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44ac06af50 0x7f44ac071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44b1951700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac071ab0 con 0x7f44ac161670 2023-10-16T13:48:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44b1951700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac161bc0 con 0x7f44ac0cc3f0 2023-10-16T13:48:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44b1951700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac161ea0 con 0x7f44ac06af50 2023-10-16T13:48:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44ac0cc3f0 0x7f44ac0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44ac0cc3f0 0x7f44ac0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48124/0 (socket says 172.21.15.5:48124) 2023-10-16T13:48:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 -- 172.21.15.5:0/577796074 learned_addr learned my addr 172.21.15.5:0/577796074 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44ab7fe700 1 --2- 172.21.15.5:0/577796074 >> v2:172.21.15.112:3300/0 conn(0x7f44ac06af50 0x7f44ac071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 -- 172.21.15.5:0/577796074 >> v2:172.21.15.112:3300/0 conn(0x7f44ac06af50 msgr2=0x7f44ac071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 --2- 172.21.15.5:0/577796074 >> v2:172.21.15.112:3300/0 conn(0x7f44ac06af50 0x7f44ac071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 -- 172.21.15.5:0/577796074 >> v1:172.21.15.112:6789/0 conn(0x7f44ac161670 legacy=0x7f44ac06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 -- 172.21.15.5:0/577796074 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac162180 con 0x7f44ac0cc3f0 2023-10-16T13:48:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44aaffd700 1 --2- 172.21.15.5:0/577796074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cc7d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0c3c80 tx=0x7f449c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c5092472a62256 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44a9ffb700 1 -- 172.21.15.5:0/577796074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00b870 con 0x7f44ac0cc3f0 2023-10-16T13:48:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44a9ffb700 1 -- 172.21.15.5:0/577796074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00b9d0 con 0x7f44ac0cc3f0 2023-10-16T13:48:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.745+0000 7f44a9ffb700 1 -- 172.21.15.5:0/577796074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00bd60 con 0x7f44ac0cc3f0 2023-10-16T13:48:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 -- 172.21.15.5:0/577796074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac0cc3f0 msgr2=0x7f44ac0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 --2- 172.21.15.5:0/577796074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cc7d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0c3c80 tx=0x7f449c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 -- 172.21.15.5:0/577796074 shutdown_connections 2023-10-16T13:48:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 --2- 172.21.15.5:0/577796074 >> v2:172.21.15.112:3300/0 conn(0x7f44ac06af50 0x7f44ac071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 --2- 172.21.15.5:0/577796074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cc7d0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 -- 172.21.15.5:0/577796074 >> 172.21.15.5:0/577796074 conn(0x7f44ac06dac0 msgr2=0x7f44ac06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:03.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 -- 172.21.15.5:0/577796074 shutdown_connections 2023-10-16T13:48:03.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.746+0000 7f44b1951700 1 -- 172.21.15.5:0/577796074 wait complete. 2023-10-16T13:48:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.747+0000 7f44b1951700 1 Processor -- start 2023-10-16T13:48:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.747+0000 7f44b1951700 1 -- start start 2023-10-16T13:48:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44b1951700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44ac06af50 0x7f44ac1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44b1951700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44b1951700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 0x7f44ac0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44b1951700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0c8df0 con 0x7f44ac161670 2023-10-16T13:48:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44b1951700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac153e30 con 0x7f44ac0cc3f0 2023-10-16T13:48:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44b1951700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b3740 con 0x7f44ac06af50 2023-10-16T13:48:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 0x7f44ac0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 0x7f44ac0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48134/0 (socket says 172.21.15.5:48134) 2023-10-16T13:48:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 -- 172.21.15.5:0/3988623088 learned_addr learned my addr 172.21.15.5:0/3988623088 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44aa7fc700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44aaffd700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44ac06af50 0x7f44ac1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 -- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44ac06af50 msgr2=0x7f44ac1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44ac06af50 0x7f44ac1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 -- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44ac0cc3f0 msgr2=0x7f44ac0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44ab7fe700 1 -- 172.21.15.5:0/3988623088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009550 con 0x7f44ac161670 2023-10-16T13:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44aaffd700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44ac06af50 0x7f44ac1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.748+0000 7f44aa7fc700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.749+0000 7f44ab7fe700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 0x7f44ac0cb6c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f44a4007e90 tx=0x7f44a400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.749+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400ede0 con 0x7f44ac161670 2023-10-16T13:48:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.749+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4014420 con 0x7f44ac161670 2023-10-16T13:48:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.749+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac0c8270 con 0x7f44ac161670 2023-10-16T13:48:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.749+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a40147d0 con 0x7f44ac161670 2023-10-16T13:48:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.749+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac0c8830 con 0x7f44ac161670 2023-10-16T13:48:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.750+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac0b3940 con 0x7f44ac161670 2023-10-16T13:48:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.750+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f44a4014930 con 0x7f44ac161670 2023-10-16T13:48:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.751+0000 7f4493fff700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f449806b260 0x7f449806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.751+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44a408a2a0 con 0x7f44ac161670 2023-10-16T13:48:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.751+0000 7f44aaffd700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f449806b260 0x7f449806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.752+0000 7f44aaffd700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f449806b260 0x7f449806d720 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f449c009130 tx=0x7f449c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.756+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44ac0b3940 con 0x7f44ac161670 2023-10-16T13:48:03.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.972+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f44ac0b3900 con 0x7f44ac161670 2023-10-16T13:48:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.973+0000 7f4493fff700 1 -- 172.21.15.5:0/3988623088 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) v1 ==== 80+0+0 (secure 0 0 0) 0x7f44a4054f00 con 0x7f44ac161670 2023-10-16T13:48:03.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f449806b260 msgr2=0x7f449806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f449806b260 0x7f449806d720 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f449c009130 tx=0x7f449c008030 comp rx=0 tx=0).stop 2023-10-16T13:48:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 msgr2=0x7f44ac0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 0x7f44ac0cb6c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f44a4007e90 tx=0x7f44a400e3c0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 shutdown_connections 2023-10-16T13:48:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac161670 0x7f44ac0cb6c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f449806b260 0x7f449806d720 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f44ac06af50 0x7f44ac1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 --2- 172.21.15.5:0/3988623088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44ac0cc3f0 0x7f44ac0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 >> 172.21.15.5:0/3988623088 conn(0x7f44ac06dac0 msgr2=0x7f44ac15ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 shutdown_connections 2023-10-16T13:48:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:03.975+0000 7f44b1951700 1 -- 172.21.15.5:0/3988623088 wait complete. 2023-10-16T13:48:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:48:03.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:48:03.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:03.992 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:04.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:48:04.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:04.039 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:48:04.058 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:04.058 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:04.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:48:04.076 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:04.077 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:04.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:48:04.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.239+0000 7f60ff039700 1 Processor -- start 2023-10-16T13:48:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60ff039700 1 -- start start 2023-10-16T13:48:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60ff039700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f60f80728e0 0x7f60f806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60ff039700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f8070040 con 0x7f60f80b2980 2023-10-16T13:48:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60ff039700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80afce0 con 0x7f60f815a8e0 2023-10-16T13:48:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60ff039700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f80d0420 con 0x7f60f80728e0 2023-10-16T13:48:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60f7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60f80b2980 0x7f60f815e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58142/0 (socket says 172.21.15.5:58142) 2023-10-16T13:48:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.240+0000 7f60f7fff700 1 -- 172.21.15.5:0/2195925369 learned_addr learned my addr 172.21.15.5:0/2195925369 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60fd5d6700 1 --2- 172.21.15.5:0/2195925369 >> v2:172.21.15.112:3300/0 conn(0x7f60f80728e0 0x7f60f806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139288880 0 0) 0x7f60f8070040 con 0x7f60f80b2980 2023-10-16T13:48:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e80035b0 con 0x7f60f80b2980 2023-10-16T13:48:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4098070173 0 0) 0x7f60e80035b0 con 0x7f60f80b2980 2023-10-16T13:48:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 >> v2:172.21.15.112:3300/0 conn(0x7f60f80728e0 msgr2=0x7f60f806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 --2- 172.21.15.5:0/2195925369 >> v2:172.21.15.112:3300/0 conn(0x7f60f80728e0 0x7f60f806fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 >> v1:172.21.15.112:6789/0 conn(0x7f60f815a8e0 legacy=0x7f60f80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f8071e00 con 0x7f60f80b2980 2023-10-16T13:48:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f60e4001670 con 0x7f60f80b2980 2023-10-16T13:48:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 >> v1:172.21.15.5:6789/0 conn(0x7f60f80b2980 legacy=0x7f60f815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e8003a00 0x7f60e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e8005210 0x7f60e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80d0420 con 0x7f60e8004850 2023-10-16T13:48:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e800c0b0 con 0x7f60e8005210 2023-10-16T13:48:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e800c270 con 0x7f60e8003a00 2023-10-16T13:48:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60f7fff700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60fd5d6700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e8005210 0x7f60e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.241+0000 7f60fcdd5700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e8003a00 0x7f60e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f7fff700 1 -- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e8003a00 msgr2=0x7f60e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f7fff700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e8003a00 0x7f60e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f7fff700 1 -- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e8005210 msgr2=0x7f60e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f7fff700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e8005210 0x7f60e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f7fff700 1 -- 172.21.15.5:0/2195925369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80035b0 con 0x7f60e8004850 2023-10-16T13:48:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60fd5d6700 1 -- 172.21.15.5:0/2195925369 reap_dead start 2023-10-16T13:48:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f7fff700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60e8004cd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f60e400e450 tx=0x7f60e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687e6125603ff8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400ee50 con 0x7f60e8004850 2023-10-16T13:48:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400d070 con 0x7f60e8004850 2023-10-16T13:48:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60f77fe700 1 -- 172.21.15.5:0/2195925369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4017d90 con 0x7f60e8004850 2023-10-16T13:48:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60ff039700 1 -- 172.21.15.5:0/2195925369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 msgr2=0x7f60e8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60ff039700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60e8004cd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f60e400e450 tx=0x7f60e8005880 comp rx=0 tx=0).stop 2023-10-16T13:48:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60ff039700 1 -- 172.21.15.5:0/2195925369 shutdown_connections 2023-10-16T13:48:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60ff039700 1 --2- 172.21.15.5:0/2195925369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60e8004cd0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.242+0000 7f60ff039700 1 -- 172.21.15.5:0/2195925369 >> 172.21.15.5:0/2195925369 conn(0x7f60f80cd270 msgr2=0x7f60f80cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.243+0000 7f60ff039700 1 -- 172.21.15.5:0/2195925369 shutdown_connections 2023-10-16T13:48:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.243+0000 7f60ff039700 1 -- 172.21.15.5:0/2195925369 wait complete. 2023-10-16T13:48:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.244+0000 7f60ff039700 1 Processor -- start 2023-10-16T13:48:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.244+0000 7f60ff039700 1 -- start start 2023-10-16T13:48:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60f81ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60f815b140 0x7f60f80c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f8157330 0x7f60f8157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815b940 con 0x7f60e8004850 2023-10-16T13:48:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815bc20 con 0x7f60f8157330 2023-10-16T13:48:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8157cd0 con 0x7f60f815b140 2023-10-16T13:48:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60f81ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60f81ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48150/0 (socket says 172.21.15.5:48150) 2023-10-16T13:48:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 -- 172.21.15.5:0/3130366005 learned_addr learned my addr 172.21.15.5:0/3130366005 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60f7fff700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60f815b140 0x7f60f80c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fd5d6700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f8157330 0x7f60f8157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 -- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60f815b140 msgr2=0x7f60f80c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60f815b140 0x7f60f80c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 -- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f8157330 msgr2=0x7f60f8157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f8157330 0x7f60f8157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 -- 172.21.15.5:0/3130366005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f81584d0 con 0x7f60e8004850 2023-10-16T13:48:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60f7fff700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60f815b140 0x7f60f80c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60fcdd5700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60f81ef7b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0018c0 tx=0x7f60ec001c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0052d0 con 0x7f60e8004850 2023-10-16T13:48:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00d040 con 0x7f60e8004850 2023-10-16T13:48:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f815d900 con 0x7f60e8004850 2023-10-16T13:48:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0036d0 con 0x7f60e8004850 2023-10-16T13:48:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.245+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f815d5b0 con 0x7f60e8004850 2023-10-16T13:48:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.246+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f815ddc0 con 0x7f60e8004850 2023-10-16T13:48:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.247+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f60ec016020 con 0x7f60e8004850 2023-10-16T13:48:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.247+0000 7f60f57fa700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60dc06b260 0x7f60dc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.247+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60ec088f60 con 0x7f60e8004850 2023-10-16T13:48:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.247+0000 7f60f7fff700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60dc06b260 0x7f60dc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.248+0000 7f60f7fff700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60dc06b260 0x7f60dc06d720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f60f80b57b0 tx=0x7f60e4007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.252+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60ec053b90 con 0x7f60e8004850 2023-10-16T13:48:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.494+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60f815b720 con 0x7f60e8004850 2023-10-16T13:48:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.495+0000 7f60f57fa700 1 -- 172.21.15.5:0/3130366005 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f60ec01e070 con 0x7f60e8004850 2023-10-16T13:48:04.498 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:04.498 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:49.207070+0000","modified":"2023-10-16T13:47:52.244374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3043002184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3043002184},{"type":"v1","addr":"172.21.15.5:6834","nonce":3043002184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-16T13:48:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60dc06b260 msgr2=0x7f60dc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60dc06b260 0x7f60dc06d720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f60f80b57b0 tx=0x7f60e4007000 comp rx=0 tx=0).stop 2023-10-16T13:48:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 msgr2=0x7f60f81ef7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60f81ef7b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0018c0 tx=0x7f60ec001c80 comp rx=0 tx=0).stop 2023-10-16T13:48:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 shutdown_connections 2023-10-16T13:48:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f8157330 0x7f60f8157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e8004850 0x7f60f81ef7b0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f60dc06b260 0x7f60dc06d720 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 --2- 172.21.15.5:0/3130366005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60f815b140 0x7f60f80c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 >> 172.21.15.5:0/3130366005 conn(0x7f60f80cd270 msgr2=0x7f60f80b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 shutdown_connections 2023-10-16T13:48:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.497+0000 7f60ff039700 1 -- 172.21.15.5:0/3130366005 wait complete. 2023-10-16T13:48:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 61 2023-10-16T13:48:04.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:04.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.634+0000 7f0a1814b700 1 Processor -- start 2023-10-16T13:48:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.634+0000 7f0a1814b700 1 -- start start 2023-10-16T13:48:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a1814b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a1015b740 0x7f0a100d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a1814b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a100d0c70 0x7f0a100cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a1814b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a100cf190 con 0x7f0a100c5110 2023-10-16T13:48:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a1814b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1015bb20 con 0x7f0a100d0c70 2023-10-16T13:48:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a1814b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a100cbd40 con 0x7f0a1015b740 2023-10-16T13:48:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a100d0c70 0x7f0a100cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a100d0c70 0x7f0a100cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48160/0 (socket says 172.21.15.5:48160) 2023-10-16T13:48:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 -- 172.21.15.5:0/116123109 learned_addr learned my addr 172.21.15.5:0/116123109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a15ee7700 1 --2- 172.21.15.5:0/116123109 >> v2:172.21.15.112:3300/0 conn(0x7f0a1015b740 0x7f0a100d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 -- 172.21.15.5:0/116123109 >> v2:172.21.15.112:3300/0 conn(0x7f0a1015b740 msgr2=0x7f0a100d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 --2- 172.21.15.5:0/116123109 >> v2:172.21.15.112:3300/0 conn(0x7f0a1015b740 0x7f0a100d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 -- 172.21.15.5:0/116123109 >> v1:172.21.15.112:6789/0 conn(0x7f0a100c5110 legacy=0x7f0a100cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a156e6700 1 -- 172.21.15.5:0/116123109 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100cc020 con 0x7f0a100d0c70 2023-10-16T13:48:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.635+0000 7f0a15ee7700 1 --2- 172.21.15.5:0/116123109 >> v2:172.21.15.112:3300/0 conn(0x7f0a1015b740 0x7f0a100d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a156e6700 1 --2- 172.21.15.5:0/116123109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a100d0c70 0x7f0a100cdfd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0a100cee60 tx=0x7f0a0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b63565c4026fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a14ee5700 1 -- 172.21.15.5:0/116123109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c004230 con 0x7f0a100d0c70 2023-10-16T13:48:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a14ee5700 1 -- 172.21.15.5:0/116123109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c004390 con 0x7f0a100d0c70 2023-10-16T13:48:04.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a14ee5700 1 -- 172.21.15.5:0/116123109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0036a0 con 0x7f0a100d0c70 2023-10-16T13:48:04.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 -- 172.21.15.5:0/116123109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a100d0c70 msgr2=0x7f0a100cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 --2- 172.21.15.5:0/116123109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a100d0c70 0x7f0a100cdfd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0a100cee60 tx=0x7f0a0c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 -- 172.21.15.5:0/116123109 shutdown_connections 2023-10-16T13:48:04.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 --2- 172.21.15.5:0/116123109 >> v2:172.21.15.112:3300/0 conn(0x7f0a1015b740 0x7f0a100d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 --2- 172.21.15.5:0/116123109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a100d0c70 0x7f0a100cdfd0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 -- 172.21.15.5:0/116123109 >> 172.21.15.5:0/116123109 conn(0x7f0a100665a0 msgr2=0x7f0a10066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:04.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 -- 172.21.15.5:0/116123109 shutdown_connections 2023-10-16T13:48:04.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.636+0000 7f0a1814b700 1 -- 172.21.15.5:0/116123109 wait complete. 2023-10-16T13:48:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.638+0000 7f0a1814b700 1 Processor -- start 2023-10-16T13:48:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.638+0000 7f0a1814b700 1 -- start start 2023-10-16T13:48:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a1814b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a100c5110 0x7f0a1014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a1814b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a100d0c70 0x7f0a100b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a1814b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 0x7f0a100b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a1814b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1015d6c0 con 0x7f0a1015b740 2023-10-16T13:48:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a1814b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1015d9a0 con 0x7f0a100d0c70 2023-10-16T13:48:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a1814b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1015dc80 con 0x7f0a100c5110 2023-10-16T13:48:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 0x7f0a100b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 0x7f0a100b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48168/0 (socket says 172.21.15.5:48168) 2023-10-16T13:48:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 -- 172.21.15.5:0/3080841549 learned_addr learned my addr 172.21.15.5:0/3080841549 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a15ee7700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a100c5110 0x7f0a1014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a156e6700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a100d0c70 0x7f0a100b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 -- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a100c5110 msgr2=0x7f0a1014dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a100c5110 0x7f0a1014dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 -- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a100d0c70 msgr2=0x7f0a100b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a100d0c70 0x7f0a100b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a166e8700 1 -- 172.21.15.5:0/3080841549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009550 con 0x7f0a1015b740 2023-10-16T13:48:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.639+0000 7f0a156e6700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a100d0c70 0x7f0a100b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.640+0000 7f0a166e8700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 0x7f0a100b64d0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800cc10 tx=0x7f0a0800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.640+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0800ab10 con 0x7f0a1015b740 2023-10-16T13:48:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.640+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0800ac70 con 0x7f0a1015b740 2023-10-16T13:48:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.640+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1015df60 con 0x7f0a1015b740 2023-10-16T13:48:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.640+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08012420 con 0x7f0a1015b740 2023-10-16T13:48:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.640+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1015e760 con 0x7f0a1015b740 2023-10-16T13:48:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.641+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1015e480 con 0x7f0a1015b740 2023-10-16T13:48:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.641+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f0a08012580 con 0x7f0a1015b740 2023-10-16T13:48:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.642+0000 7f0a067fc700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f09f406b290 0x7f09f406d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.642+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a08089ed0 con 0x7f0a1015b740 2023-10-16T13:48:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.642+0000 7f0a15ee7700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f09f406b290 0x7f09f406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.642+0000 7f0a15ee7700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f09f406b290 0x7f09f406d750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c940 tx=0x7f0a00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.646+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a1015e480 con 0x7f0a1015b740 2023-10-16T13:48:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.848+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a1015e480 con 0x7f0a1015b740 2023-10-16T13:48:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.849+0000 7f0a067fc700 1 -- 172.21.15.5:0/3080841549 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16436 (secure 0 0 0) 0x7f0a1015e480 con 0x7f0a1015b740 2023-10-16T13:48:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:04.852 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:50.785531+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:04.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f09f406b290 msgr2=0x7f09f406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f09f406b290 0x7f09f406d750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c940 tx=0x7f0a00008040 comp rx=0 tx=0).stop 2023-10-16T13:48:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 msgr2=0x7f0a100b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 0x7f0a100b64d0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800cc10 tx=0x7f0a0800cf20 comp rx=0 tx=0).stop 2023-10-16T13:48:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 shutdown_connections 2023-10-16T13:48:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1015b740 0x7f0a100b64d0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f09f406b290 0x7f09f406d750 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a100c5110 0x7f0a1014dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 --2- 172.21.15.5:0/3080841549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a100d0c70 0x7f0a100b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 >> 172.21.15.5:0/3080841549 conn(0x7f0a100665a0 msgr2=0x7f0a10159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 shutdown_connections 2023-10-16T13:48:04.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.851+0000 7f0a1814b700 1 -- 172.21.15.5:0/3080841549 wait complete. 2023-10-16T13:48:04.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:47:47.704922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:47:48.167141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:04.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.995+0000 7f22ca372700 1 Processor -- start 2023-10-16T13:48:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.995+0000 7f22ca372700 1 -- start start 2023-10-16T13:48:05.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22ca372700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22c415b740 0x7f22c40d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22ca372700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22ca372700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c40cf190 con 0x7f22c40d0c70 2023-10-16T13:48:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22ca372700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c415bb20 con 0x7f22c415b740 2023-10-16T13:48:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22ca372700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40cbd40 con 0x7f22c40ce6e0 2023-10-16T13:48:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22c415b740 0x7f22c40d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:46080/0 (socket says 172.21.15.5:46080) 2023-10-16T13:48:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 -- 172.21.15.5:0/2815603602 learned_addr learned my addr 172.21.15.5:0/2815603602 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 -- 172.21.15.5:0/2815603602 >> v2:172.21.15.112:3300/0 conn(0x7f22c415b740 msgr2=0x7f22c40d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 --2- 172.21.15.5:0/2815603602 >> v2:172.21.15.112:3300/0 conn(0x7f22c415b740 0x7f22c40d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 -- 172.21.15.5:0/2815603602 >> v1:172.21.15.112:6789/0 conn(0x7f22c40d0c70 legacy=0x7f22c40cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 -- 172.21.15.5:0/2815603602 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c40cc020 con 0x7f22c40ce6e0 2023-10-16T13:48:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.996+0000 7f22c890f700 1 --2- 172.21.15.5:0/2815603602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40cf690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22c415bc60 tx=0x7f22bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57230aa81e99806 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22c2ffd700 1 -- 172.21.15.5:0/2815603602 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00e070 con 0x7f22c40ce6e0 2023-10-16T13:48:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22c2ffd700 1 -- 172.21.15.5:0/2815603602 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc003a20 con 0x7f22c40ce6e0 2023-10-16T13:48:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22c2ffd700 1 -- 172.21.15.5:0/2815603602 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc003dd0 con 0x7f22c40ce6e0 2023-10-16T13:48:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 -- 172.21.15.5:0/2815603602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 msgr2=0x7f22c40cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 --2- 172.21.15.5:0/2815603602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40cf690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22c415bc60 tx=0x7f22bc00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 -- 172.21.15.5:0/2815603602 shutdown_connections 2023-10-16T13:48:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 --2- 172.21.15.5:0/2815603602 >> v2:172.21.15.112:3300/0 conn(0x7f22c415b740 0x7f22c40d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 --2- 172.21.15.5:0/2815603602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40cf690 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 -- 172.21.15.5:0/2815603602 >> 172.21.15.5:0/2815603602 conn(0x7f22c40665a0 msgr2=0x7f22c4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 -- 172.21.15.5:0/2815603602 shutdown_connections 2023-10-16T13:48:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.997+0000 7f22ca372700 1 -- 172.21.15.5:0/2815603602 wait complete. 2023-10-16T13:48:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.998+0000 7f22ca372700 1 Processor -- start 2023-10-16T13:48:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 -- start start 2023-10-16T13:48:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 0x7f22c4157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c415b740 0x7f22c40c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40b6990 con 0x7f22c40d0c70 2023-10-16T13:48:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4157940 con 0x7f22c415b740 2023-10-16T13:48:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:04.999+0000 7f22ca372700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4157e20 con 0x7f22c40ce6e0 2023-10-16T13:48:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 0x7f22c4157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c3fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 0x7f22c4157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48180/0 (socket says 172.21.15.5:48180) 2023-10-16T13:48:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 -- 172.21.15.5:0/1231514977 learned_addr learned my addr 172.21.15.5:0/1231514977 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c890f700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c415b740 0x7f22c40c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 -- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 msgr2=0x7f22c40b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 -- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c415b740 msgr2=0x7f22c40c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c415b740 0x7f22c40c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 -- 172.21.15.5:0/1231514977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009b30 con 0x7f22c40d0c70 2023-10-16T13:48:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c3fff700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c890f700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c415b740 0x7f22c40c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c37fe700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 0x7f22c4157400 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c4e0 tx=0x7f22b800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b80052d0 con 0x7f22c40d0c70 2023-10-16T13:48:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b800ce90 con 0x7f22c40d0c70 2023-10-16T13:48:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c40b53b0 con 0x7f22c40d0c70 2023-10-16T13:48:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8003680 con 0x7f22c40d0c70 2023-10-16T13:48:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.000+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c40b5970 con 0x7f22c40d0c70 2023-10-16T13:48:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.001+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c4067d20 con 0x7f22c40d0c70 2023-10-16T13:48:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.002+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f22b80037e0 con 0x7f22c40d0c70 2023-10-16T13:48:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.002+0000 7f22c0ff9700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f22b006b260 0x7f22b006d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.002+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22b8088e30 con 0x7f22c40d0c70 2023-10-16T13:48:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.003+0000 7f22c3fff700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f22b006b260 0x7f22b006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.003+0000 7f22c3fff700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f22b006b260 0x7f22b006d720 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009f30 tx=0x7f22b4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.007+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22b8053ad0 con 0x7f22c40d0c70 2023-10-16T13:48:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.207+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22c4066b20 con 0x7f22c40d0c70 2023-10-16T13:48:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.207+0000 7f22c0ff9700 1 -- 172.21.15.5:0/1231514977 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22b80170a0 con 0x7f22c40d0c70 2023-10-16T13:48:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f22b006b260 msgr2=0x7f22b006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f22b006b260 0x7f22b006d720 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009f30 tx=0x7f22b4009210 comp rx=0 tx=0).stop 2023-10-16T13:48:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 msgr2=0x7f22c4157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 0x7f22c4157400 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c4e0 tx=0x7f22b800c7f0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 shutdown_connections 2023-10-16T13:48:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c415b740 0x7f22c40c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f22b006b260 0x7f22b006d720 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c40ce6e0 0x7f22c40b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 --2- 172.21.15.5:0/1231514977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c40d0c70 0x7f22c4157400 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 >> 172.21.15.5:0/1231514977 conn(0x7f22c40665a0 msgr2=0x7f22c40c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:05.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 shutdown_connections 2023-10-16T13:48:05.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.210+0000 7f22ca372700 1 -- 172.21.15.5:0/1231514977 wait complete. 2023-10-16T13:48:05.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:48:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.350+0000 7f767cc53700 1 Processor -- start 2023-10-16T13:48:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.350+0000 7f767cc53700 1 -- start start 2023-10-16T13:48:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767cc53700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 0x7f767815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767cc53700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f767815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767cc53700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780cf260 con 0x7f767806a840 2023-10-16T13:48:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767cc53700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76781619a0 con 0x7f76780cd950 2023-10-16T13:48:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767cc53700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b2d60 con 0x7f76780cede0 2023-10-16T13:48:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 0x7f767815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f7675d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f767815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 0x7f767815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44082/0 (socket says 172.21.15.5:44082) 2023-10-16T13:48:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.351+0000 7f767659c700 1 -- 172.21.15.5:0/3577177773 learned_addr learned my addr 172.21.15.5:0/3577177773 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f7675d9b700 1 -- 172.21.15.5:0/3577177773 >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 msgr2=0x7f767815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f7675d9b700 1 --2- 172.21.15.5:0/3577177773 >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 0x7f767815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f7675d9b700 1 -- 172.21.15.5:0/3577177773 >> v1:172.21.15.112:6789/0 conn(0x7f767806a840 legacy=0x7f7678161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f7675d9b700 1 -- 172.21.15.5:0/3577177773 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76780cdd30 con 0x7f76780cede0 2023-10-16T13:48:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f767659c700 1 --2- 172.21.15.5:0/3577177773 >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 0x7f767815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f7675d9b700 1 --2- 172.21.15.5:0/3577177773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f767815f570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f766c009820 tx=0x7f766c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ff38ab3fc88a81 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f767559a700 1 -- 172.21.15.5:0/3577177773 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c005e30 con 0x7f76780cede0 2023-10-16T13:48:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f767559a700 1 -- 172.21.15.5:0/3577177773 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c006030 con 0x7f76780cede0 2023-10-16T13:48:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.352+0000 7f767559a700 1 -- 172.21.15.5:0/3577177773 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0063c0 con 0x7f76780cede0 2023-10-16T13:48:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 -- 172.21.15.5:0/3577177773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 msgr2=0x7f767815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 --2- 172.21.15.5:0/3577177773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f767815f570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f766c009820 tx=0x7f766c009b30 comp rx=0 tx=0).stop 2023-10-16T13:48:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 -- 172.21.15.5:0/3577177773 shutdown_connections 2023-10-16T13:48:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 --2- 172.21.15.5:0/3577177773 >> v2:172.21.15.112:3300/0 conn(0x7f76780cd950 0x7f767815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 --2- 172.21.15.5:0/3577177773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f767815f570 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 -- 172.21.15.5:0/3577177773 >> 172.21.15.5:0/3577177773 conn(0x7f767806dae0 msgr2=0x7f767806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 -- 172.21.15.5:0/3577177773 shutdown_connections 2023-10-16T13:48:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.353+0000 7f767cc53700 1 -- 172.21.15.5:0/3577177773 wait complete. 2023-10-16T13:48:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.354+0000 7f767cc53700 1 Processor -- start 2023-10-16T13:48:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.354+0000 7f767cc53700 1 -- start start 2023-10-16T13:48:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767cc53700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f767806a840 0x7f7678150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767cc53700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 0x7f767814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767cc53700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f76780c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767cc53700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c6060 con 0x7f76780cd950 2023-10-16T13:48:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767cc53700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c5470 con 0x7f767806a840 2023-10-16T13:48:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767cc53700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c5730 con 0x7f76780cede0 2023-10-16T13:48:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 0x7f767814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 0x7f767814f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48194/0 (socket says 172.21.15.5:48194) 2023-10-16T13:48:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 -- 172.21.15.5:0/3998436781 learned_addr learned my addr 172.21.15.5:0/3998436781 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f767659c700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f767806a840 0x7f7678150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7676d9d700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f76780c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 -- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 msgr2=0x7f76780c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f76780c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 -- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f767806a840 msgr2=0x7f7678150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f767806a840 0x7f7678150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.355+0000 7f7675d9b700 1 -- 172.21.15.5:0/3998436781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668009550 con 0x7f76780cd950 2023-10-16T13:48:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.356+0000 7f7675d9b700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 0x7f767814f830 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c00 tx=0x7f766c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.356+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0061a0 con 0x7f76780cd950 2023-10-16T13:48:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.356+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c020070 con 0x7f76780cd950 2023-10-16T13:48:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.356+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c006540 con 0x7f76780cd950 2023-10-16T13:48:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.356+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c009430 con 0x7f76780cd950 2023-10-16T13:48:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.356+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780c5cf0 con 0x7f76780cd950 2023-10-16T13:48:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.357+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76780c61d0 con 0x7f76780cd950 2023-10-16T13:48:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.357+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f766c022030 con 0x7f76780cd950 2023-10-16T13:48:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.358+0000 7f7666ffd700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f765806b260 0x7f765806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.358+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f766c08af00 con 0x7f76780cd950 2023-10-16T13:48:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.358+0000 7f767659c700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f765806b260 0x7f765806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.358+0000 7f767659c700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f765806b260 0x7f765806d720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7668006d30 tx=0x7f76680092c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.362+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f766c055c30 con 0x7f76780cd950 2023-10-16T13:48:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.561+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7678067d20 con 0x7f76780cd950 2023-10-16T13:48:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.562+0000 7f7666ffd700 1 -- 172.21.15.5:0/3998436781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f766c059250 con 0x7f76780cd950 2023-10-16T13:48:05.565 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:48:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f765806b260 msgr2=0x7f765806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f765806b260 0x7f765806d720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7668006d30 tx=0x7f76680092c0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 msgr2=0x7f767814f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 0x7f767814f830 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c00 tx=0x7f766c004750 comp rx=0 tx=0).stop 2023-10-16T13:48:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 shutdown_connections 2023-10-16T13:48:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f765806b260 0x7f765806d720 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f76780cede0 0x7f76780c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f767806a840 0x7f7678150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 --2- 172.21.15.5:0/3998436781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76780cd950 0x7f767814f830 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 >> 172.21.15.5:0/3998436781 conn(0x7f767806dae0 msgr2=0x7f7678072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 shutdown_connections 2023-10-16T13:48:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.564+0000 7f767cc53700 1 -- 172.21.15.5:0/3998436781 wait complete. 2023-10-16T13:48:05.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:48:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.705+0000 7f169261f700 1 Processor -- start 2023-10-16T13:48:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.705+0000 7f169261f700 1 -- start start 2023-10-16T13:48:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f169261f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f168c06af50 0x7f168c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f169261f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f168c0b28b0 0x7f168c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f169261f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0b3530 con 0x7f168c15f130 2023-10-16T13:48:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f169261f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0cde00 con 0x7f168c06af50 2023-10-16T13:48:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f169261f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0cd180 con 0x7f168c0b28b0 2023-10-16T13:48:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f168c06af50 0x7f168c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f168c15f130 0x7f168c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58204/0 (socket says 172.21.15.5:58204) 2023-10-16T13:48:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168bfff700 1 -- 172.21.15.5:0/3863184141 learned_addr learned my addr 172.21.15.5:0/3863184141 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f1690bbc700 1 --2- 172.21.15.5:0/3863184141 >> v2:172.21.15.112:3300/0 conn(0x7f168c0b28b0 0x7f168c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168b7fe700 1 -- 172.21.15.5:0/3863184141 >> v2:172.21.15.112:3300/0 conn(0x7f168c0b28b0 msgr2=0x7f168c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168b7fe700 1 --2- 172.21.15.5:0/3863184141 >> v2:172.21.15.112:3300/0 conn(0x7f168c0b28b0 0x7f168c0b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168b7fe700 1 -- 172.21.15.5:0/3863184141 >> v1:172.21.15.5:6789/0 conn(0x7f168c15f130 legacy=0x7f168c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168b7fe700 1 -- 172.21.15.5:0/3863184141 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0cd460 con 0x7f168c06af50 2023-10-16T13:48:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168affd700 1 -- 172.21.15.5:0/3863184141 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66257329 0 0) 0x7f168c0b3530 con 0x7f168c15f130 2023-10-16T13:48:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.706+0000 7f168b7fe700 1 --2- 172.21.15.5:0/3863184141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c06af50 0x7f168c0cede0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f168c0d02d0 tx=0x7f167c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdcbe8eed53fa3f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f168affd700 1 -- 172.21.15.5:0/3863184141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c005e30 con 0x7f168c06af50 2023-10-16T13:48:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f168affd700 1 -- 172.21.15.5:0/3863184141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c006030 con 0x7f168c06af50 2023-10-16T13:48:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f168affd700 1 -- 172.21.15.5:0/3863184141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c0063c0 con 0x7f168c06af50 2023-10-16T13:48:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 -- 172.21.15.5:0/3863184141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c06af50 msgr2=0x7f168c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 --2- 172.21.15.5:0/3863184141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c06af50 0x7f168c0cede0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f168c0d02d0 tx=0x7f167c009b00 comp rx=0 tx=0).stop 2023-10-16T13:48:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 -- 172.21.15.5:0/3863184141 shutdown_connections 2023-10-16T13:48:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 --2- 172.21.15.5:0/3863184141 >> v2:172.21.15.112:3300/0 conn(0x7f168c0b28b0 0x7f168c0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 --2- 172.21.15.5:0/3863184141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c06af50 0x7f168c0cede0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 -- 172.21.15.5:0/3863184141 >> 172.21.15.5:0/3863184141 conn(0x7f168c06dae0 msgr2=0x7f168c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 -- 172.21.15.5:0/3863184141 shutdown_connections 2023-10-16T13:48:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.707+0000 7f169261f700 1 -- 172.21.15.5:0/3863184141 wait complete. 2023-10-16T13:48:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.708+0000 7f169261f700 1 Processor -- start 2023-10-16T13:48:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 -- start start 2023-10-16T13:48:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f168c06af50 0x7f168c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 0x7f168c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f168c15f130 0x7f168c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0cbb60 con 0x7f168c0b28b0 2023-10-16T13:48:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0cbe40 con 0x7f168c06af50 2023-10-16T13:48:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f169261f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0cc120 con 0x7f168c15f130 2023-10-16T13:48:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f168b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 0x7f168c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f168b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 0x7f168c0cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48206/0 (socket says 172.21.15.5:48206) 2023-10-16T13:48:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.709+0000 7f168b7fe700 1 -- 172.21.15.5:0/4253248483 learned_addr learned my addr 172.21.15.5:0/4253248483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168bfff700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f168c06af50 0x7f168c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f1690bbc700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f168c15f130 0x7f168c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168b7fe700 1 -- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f168c15f130 msgr2=0x7f168c0ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168b7fe700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f168c15f130 0x7f168c0ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168b7fe700 1 -- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f168c06af50 msgr2=0x7f168c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168b7fe700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f168c06af50 0x7f168c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168b7fe700 1 -- 172.21.15.5:0/4253248483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c009430 con 0x7f168c0b28b0 2023-10-16T13:48:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168bfff700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f168c06af50 0x7f168c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f168b7fe700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 0x7f168c0cb0a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f167c000c00 tx=0x7f167c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c004240 con 0x7f168c0b28b0 2023-10-16T13:48:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c0043c0 con 0x7f168c0b28b0 2023-10-16T13:48:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c0cc400 con 0x7f168c0b28b0 2023-10-16T13:48:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c0036a0 con 0x7f168c0b28b0 2023-10-16T13:48:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.710+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c158740 con 0x7f168c0b28b0 2023-10-16T13:48:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.711+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c067d20 con 0x7f168c0b28b0 2023-10-16T13:48:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.712+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f167c022070 con 0x7f168c0b28b0 2023-10-16T13:48:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.712+0000 7f1688ff9700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f166c06b260 0x7f166c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.712+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f167c08b3f0 con 0x7f168c0b28b0 2023-10-16T13:48:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.712+0000 7f168bfff700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f166c06b260 0x7f166c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.713+0000 7f168bfff700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f166c06b260 0x7f166c06d720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.717+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f167c056120 con 0x7f168c0b28b0 2023-10-16T13:48:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.920+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f168c06cb60 con 0x7f168c0b28b0 2023-10-16T13:48:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.921+0000 7f1688ff9700 1 -- 172.21.15.5:0/4253248483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f167c059740 con 0x7f168c0b28b0 2023-10-16T13:48:05.924 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:48:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f166c06b260 msgr2=0x7f166c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f166c06b260 0x7f166c06d720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674007ca0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 msgr2=0x7f168c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 0x7f168c0cb0a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f167c000c00 tx=0x7f167c004750 comp rx=0 tx=0).stop 2023-10-16T13:48:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 shutdown_connections 2023-10-16T13:48:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f166c06b260 0x7f166c06d720 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f168c15f130 0x7f168c0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f168c06af50 0x7f168c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 --2- 172.21.15.5:0/4253248483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f168c0b28b0 0x7f168c0cb0a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 >> 172.21.15.5:0/4253248483 conn(0x7f168c06dae0 msgr2=0x7f168c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 shutdown_connections 2023-10-16T13:48:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:05.923+0000 7f169261f700 1 -- 172.21.15.5:0/4253248483 wait complete. 2023-10-16T13:48:05.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.060+0000 7ff07b4d4700 1 Processor -- start 2023-10-16T13:48:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.060+0000 7ff07b4d4700 1 -- start start 2023-10-16T13:48:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff07b4d4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff07415ab10 0x7ff07415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff07b4d4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0740b1f50 0x7ff0740cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff07b4d4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07415e7a0 con 0x7ff0740b23d0 2023-10-16T13:48:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff07b4d4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07415f730 con 0x7ff0740b1f50 2023-10-16T13:48:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff07b4d4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b29a0 con 0x7ff07415ab10 2023-10-16T13:48:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff078a6f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0740b1f50 0x7ff0740cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff078a6f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0740b1f50 0x7ff0740cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48214/0 (socket says 172.21.15.5:48214) 2023-10-16T13:48:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff078a6f700 1 -- 172.21.15.5:0/2186135286 learned_addr learned my addr 172.21.15.5:0/2186135286 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.061+0000 7ff079270700 1 --2- 172.21.15.5:0/2186135286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff07415ab10 0x7ff07415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff078a6f700 1 -- 172.21.15.5:0/2186135286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff07415ab10 msgr2=0x7ff07415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff078a6f700 1 --2- 172.21.15.5:0/2186135286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff07415ab10 0x7ff07415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff078a6f700 1 -- 172.21.15.5:0/2186135286 >> v1:172.21.15.112:6789/0 conn(0x7ff0740b23d0 legacy=0x7ff0740cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff078a6f700 1 -- 172.21.15.5:0/2186135286 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740b2c80 con 0x7ff0740b1f50 2023-10-16T13:48:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff078a6f700 1 --2- 172.21.15.5:0/2186135286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0740b1f50 0x7ff0740cf720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7ff070006fd0 tx=0x7ff070009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98ec5bb72778a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff06bfff700 1 -- 172.21.15.5:0/2186135286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070005e30 con 0x7ff0740b1f50 2023-10-16T13:48:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff06bfff700 1 -- 172.21.15.5:0/2186135286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070004030 con 0x7ff0740b1f50 2023-10-16T13:48:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff06bfff700 1 -- 172.21.15.5:0/2186135286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700043e0 con 0x7ff0740b1f50 2023-10-16T13:48:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.062+0000 7ff07b4d4700 1 -- 172.21.15.5:0/2186135286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0740b1f50 msgr2=0x7ff0740cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/2186135286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0740b1f50 0x7ff0740cf720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7ff070006fd0 tx=0x7ff070009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 -- 172.21.15.5:0/2186135286 shutdown_connections 2023-10-16T13:48:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/2186135286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff07415ab10 0x7ff07415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/2186135286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0740b1f50 0x7ff0740cf720 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 -- 172.21.15.5:0/2186135286 >> 172.21.15.5:0/2186135286 conn(0x7ff07406dae0 msgr2=0x7ff07406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 -- 172.21.15.5:0/2186135286 shutdown_connections 2023-10-16T13:48:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.063+0000 7ff07b4d4700 1 -- 172.21.15.5:0/2186135286 wait complete. 2023-10-16T13:48:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.064+0000 7ff07b4d4700 1 Processor -- start 2023-10-16T13:48:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.064+0000 7ff07b4d4700 1 -- start start 2023-10-16T13:48:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff07b4d4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0740b1f50 0x7ff074154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff07b4d4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0740b23d0 0x7ff0740c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff07b4d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 0x7ff0740c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff07b4d4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740c4000 con 0x7ff07415ab10 2023-10-16T13:48:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff07b4d4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740c6e60 con 0x7ff0740b23d0 2023-10-16T13:48:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff07b4d4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740c4250 con 0x7ff0740b1f50 2023-10-16T13:48:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff079a71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 0x7ff0740c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff079a71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 0x7ff0740c4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48224/0 (socket says 172.21.15.5:48224) 2023-10-16T13:48:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.065+0000 7ff079a71700 1 -- 172.21.15.5:0/1296672284 learned_addr learned my addr 172.21.15.5:0/1296672284 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff078a6f700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0740b23d0 0x7ff0740c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079270700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0740b1f50 0x7ff074154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079a71700 1 -- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0740b1f50 msgr2=0x7ff074154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079a71700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0740b1f50 0x7ff074154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079a71700 1 -- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0740b23d0 msgr2=0x7ff0740c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079a71700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0740b23d0 0x7ff0740c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079a71700 1 -- 172.21.15.5:0/1296672284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009500 con 0x7ff07415ab10 2023-10-16T13:48:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079270700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0740b1f50 0x7ff074154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff078a6f700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0740b23d0 0x7ff0740c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff079a71700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 0x7ff0740c4d30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00cb50 tx=0x7ff06c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c003c00 con 0x7ff07415ab10 2023-10-16T13:48:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c003d60 con 0x7ff07415ab10 2023-10-16T13:48:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0740c4530 con 0x7ff07415ab10 2023-10-16T13:48:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00ab70 con 0x7ff07415ab10 2023-10-16T13:48:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.066+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0740c6a30 con 0x7ff07415ab10 2023-10-16T13:48:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.067+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0740c4a50 con 0x7ff07415ab10 2023-10-16T13:48:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.068+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7ff06c00acd0 con 0x7ff07415ab10 2023-10-16T13:48:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.068+0000 7ff069ffb700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff05806b260 0x7ff05806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.069+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff06c089be0 con 0x7ff07415ab10 2023-10-16T13:48:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.069+0000 7ff079270700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff05806b260 0x7ff05806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.069+0000 7ff079270700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff05806b260 0x7ff05806d720 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff064009c30 tx=0x7ff064008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.073+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0740c4a50 con 0x7ff07415ab10 2023-10-16T13:48:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.317+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0740c4a50 con 0x7ff07415ab10 2023-10-16T13:48:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.318+0000 7ff069ffb700 1 -- 172.21.15.5:0/1296672284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4909 (secure 0 0 0) 0x7ff0740c4a50 con 0x7ff07415ab10 2023-10-16T13:48:06.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:06.321 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:49.207070+0000","modified":"2023-10-16T13:47:52.244374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3043002184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3043002184},{"type":"v1","addr":"172.21.15.5:6834","nonce":3043002184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-16T13:48:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff05806b260 msgr2=0x7ff05806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff05806b260 0x7ff05806d720 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff064009c30 tx=0x7ff064008040 comp rx=0 tx=0).stop 2023-10-16T13:48:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 msgr2=0x7ff0740c4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 0x7ff0740c4d30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00cb50 tx=0x7ff06c00cf10 comp rx=0 tx=0).stop 2023-10-16T13:48:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 shutdown_connections 2023-10-16T13:48:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff07415ab10 0x7ff0740c4d30 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff05806b260 0x7ff05806d720 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0740b1f50 0x7ff074154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 --2- 172.21.15.5:0/1296672284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0740b23d0 0x7ff0740c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 >> 172.21.15.5:0/1296672284 conn(0x7ff07406dae0 msgr2=0x7ff0740cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:06.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 shutdown_connections 2023-10-16T13:48:06.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.320+0000 7ff07b4d4700 1 -- 172.21.15.5:0/1296672284 wait complete. 2023-10-16T13:48:06.326 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 61 2023-10-16T13:48:06.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:06.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.457+0000 7f2b014a7700 1 Processor -- start 2023-10-16T13:48:06.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.458+0000 7f2b014a7700 1 -- start start 2023-10-16T13:48:06.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.458+0000 7f2b014a7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc15dbc0 0x7f2afc15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.458+0000 7f2b014a7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc15e4e0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.458+0000 7f2b014a7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc0d28e0 con 0x7f2afc0b7050 2023-10-16T13:48:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.458+0000 7f2b014a7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0b7560 con 0x7f2afc15dbc0 2023-10-16T13:48:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afa7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2afc0d3fc0 0x7f2afc0d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58232/0 (socket says 172.21.15.5:58232) 2023-10-16T13:48:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afa7fc700 1 -- 172.21.15.5:0/2051963884 learned_addr learned my addr 172.21.15.5:0/2051963884 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afaffd700 1 --2- 172.21.15.5:0/2051963884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc15dbc0 0x7f2afc15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2af9ffb700 1 -- 172.21.15.5:0/2051963884 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686019048 0 0) 0x7f2afc15e4e0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2af9ffb700 1 -- 172.21.15.5:0/2051963884 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae80035b0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afaffd700 1 -- 172.21.15.5:0/2051963884 >> v1:172.21.15.112:6789/0 conn(0x7f2afc0b7050 legacy=0x7f2afc0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2af9ffb700 1 -- 172.21.15.5:0/2051963884 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231198149 0 0) 0x7f2afc0d28e0 con 0x7f2afc0b7050 2023-10-16T13:48:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afaffd700 1 -- 172.21.15.5:0/2051963884 >> v1:172.21.15.5:6789/0 conn(0x7f2afc0d3fc0 legacy=0x7f2afc0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afaffd700 1 -- 172.21.15.5:0/2051963884 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0b7840 con 0x7f2afc15dbc0 2023-10-16T13:48:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2afaffd700 1 --2- 172.21.15.5:0/2051963884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc15dbc0 0x7f2afc15dfa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009850 tx=0x7f2aec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8001cd93ece6d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2af9ffb700 1 -- 172.21.15.5:0/2051963884 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec005e30 con 0x7f2afc15dbc0 2023-10-16T13:48:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.459+0000 7f2af9ffb700 1 -- 172.21.15.5:0/2051963884 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec006030 con 0x7f2afc15dbc0 2023-10-16T13:48:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2af9ffb700 1 -- 172.21.15.5:0/2051963884 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0063a0 con 0x7f2afc15dbc0 2023-10-16T13:48:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 -- 172.21.15.5:0/2051963884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc15dbc0 msgr2=0x7f2afc15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2051963884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc15dbc0 0x7f2afc15dfa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009850 tx=0x7f2aec009b60 comp rx=0 tx=0).stop 2023-10-16T13:48:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 -- 172.21.15.5:0/2051963884 shutdown_connections 2023-10-16T13:48:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2051963884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc15dbc0 0x7f2afc15dfa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 -- 172.21.15.5:0/2051963884 >> 172.21.15.5:0/2051963884 conn(0x7f2afc09cb40 msgr2=0x7f2afc0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 -- 172.21.15.5:0/2051963884 shutdown_connections 2023-10-16T13:48:06.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.460+0000 7f2b014a7700 1 -- 172.21.15.5:0/2051963884 wait complete. 2023-10-16T13:48:06.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.461+0000 7f2b014a7700 1 Processor -- start 2023-10-16T13:48:06.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.461+0000 7f2b014a7700 1 -- start start 2023-10-16T13:48:06.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2b014a7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc0b7050 0x7f2afc1e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2b014a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 0x7f2afc1e5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2b014a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2afc15dbc0 0x7f2afc151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2b014a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0ccfd0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2b014a7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cb990 con 0x7f2afc15dbc0 2023-10-16T13:48:06.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2b014a7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cc210 con 0x7f2afc0b7050 2023-10-16T13:48:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2afa7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 0x7f2afc1e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2afa7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 0x7f2afc1e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48236/0 (socket says 172.21.15.5:48236) 2023-10-16T13:48:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2afa7fc700 1 -- 172.21.15.5:0/2986576910 learned_addr learned my addr 172.21.15.5:0/2986576910 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2afaffd700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc0b7050 0x7f2afc1e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.462+0000 7f2afb7fe700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2afc15dbc0 0x7f2afc151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afa7fc700 1 -- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc0b7050 msgr2=0x7f2afc1e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afa7fc700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc0b7050 0x7f2afc1e7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afa7fc700 1 -- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2afc15dbc0 msgr2=0x7f2afc151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afa7fc700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2afc15dbc0 0x7f2afc151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afa7fc700 1 -- 172.21.15.5:0/2986576910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009430 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afb7fe700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2afc15dbc0 0x7f2afc151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2afa7fc700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 0x7f2afc1e5450 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400c4d0 tx=0x7f2ae400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4005d70 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae40070d0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4007440 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc0cc4f0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.463+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc0ccab0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.464+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc04ebb0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.464+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f2ae40075a0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.465+0000 7f2af37fe700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2adc06b260 0x7f2adc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.465+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ae4088fc0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.465+0000 7f2afaffd700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2adc06b260 0x7f2adc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.466+0000 7f2afaffd700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2adc06b260 0x7f2adc06d720 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0a1680 tx=0x7f2aec008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.470+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ae4053bd0 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.669+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2afc0ccc70 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.670+0000 7f2af37fe700 1 -- 172.21.15.5:0/2986576910 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16436 (secure 0 0 0) 0x7f2ae4017020 con 0x7f2afc0d3fc0 2023-10-16T13:48:06.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:06.674 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:50.785531+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2adc06b260 msgr2=0x7f2adc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2adc06b260 0x7f2adc06d720 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0a1680 tx=0x7f2aec008070 comp rx=0 tx=0).stop 2023-10-16T13:48:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 msgr2=0x7f2afc1e5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 0x7f2afc1e5450 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400c4d0 tx=0x7f2ae400c7e0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 shutdown_connections 2023-10-16T13:48:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2afc15dbc0 0x7f2afc151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2adc06b260 0x7f2adc06d720 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2afc0b7050 0x7f2afc1e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 --2- 172.21.15.5:0/2986576910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0d3fc0 0x7f2afc1e5450 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 >> 172.21.15.5:0/2986576910 conn(0x7f2afc09cb40 msgr2=0x7f2afc06c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:06.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.672+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 shutdown_connections 2023-10-16T13:48:06.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.673+0000 7f2b014a7700 1 -- 172.21.15.5:0/2986576910 wait complete. 2023-10-16T13:48:06.687 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:48:06.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.811+0000 7fdf96523700 1 Processor -- start 2023-10-16T13:48:06.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.811+0000 7fdf96523700 1 -- start start 2023-10-16T13:48:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.811+0000 7fdf96523700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf90160e30 0x7fdf900d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf96523700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf90161210 0x7fdf900d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf96523700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf900d06d0 0x7fdf900b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf96523700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900d0b60 con 0x7fdf90161210 2023-10-16T13:48:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf96523700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900b6610 con 0x7fdf90160e30 2023-10-16T13:48:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf96523700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900d1da0 con 0x7fdf900d06d0 2023-10-16T13:48:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf90161210 0x7fdf900d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf90161210 0x7fdf900d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48242/0 (socket says 172.21.15.5:48242) 2023-10-16T13:48:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 -- 172.21.15.5:0/4121512664 learned_addr learned my addr 172.21.15.5:0/4121512664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf94ac0700 1 --2- 172.21.15.5:0/4121512664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf900d06d0 0x7fdf900b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8ffff700 1 --2- 172.21.15.5:0/4121512664 >> v2:172.21.15.112:3300/0 conn(0x7fdf90160e30 0x7fdf900d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 -- 172.21.15.5:0/4121512664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf900d06d0 msgr2=0x7fdf900b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/4121512664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf900d06d0 0x7fdf900b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 -- 172.21.15.5:0/4121512664 >> v2:172.21.15.112:3300/0 conn(0x7fdf90160e30 msgr2=0x7fdf900d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/4121512664 >> v2:172.21.15.112:3300/0 conn(0x7fdf90160e30 0x7fdf900d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 -- 172.21.15.5:0/4121512664 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900d2080 con 0x7fdf90161210 2023-10-16T13:48:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/4121512664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90161210 0x7fdf900d0190 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdf9008c920 tx=0x7fdf84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaad90692714359d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8effd700 1 -- 172.21.15.5:0/4121512664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84011830 con 0x7fdf90161210 2023-10-16T13:48:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8effd700 1 -- 172.21.15.5:0/4121512664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84011990 con 0x7fdf90161210 2023-10-16T13:48:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.812+0000 7fdf8effd700 1 -- 172.21.15.5:0/4121512664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84011d20 con 0x7fdf90161210 2023-10-16T13:48:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 -- 172.21.15.5:0/4121512664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90161210 msgr2=0x7fdf900d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 --2- 172.21.15.5:0/4121512664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90161210 0x7fdf900d0190 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdf9008c920 tx=0x7fdf84009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 -- 172.21.15.5:0/4121512664 shutdown_connections 2023-10-16T13:48:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 --2- 172.21.15.5:0/4121512664 >> v2:172.21.15.112:3300/0 conn(0x7fdf90160e30 0x7fdf900d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 --2- 172.21.15.5:0/4121512664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf900d06d0 0x7fdf900b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 --2- 172.21.15.5:0/4121512664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90161210 0x7fdf900d0190 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 -- 172.21.15.5:0/4121512664 >> 172.21.15.5:0/4121512664 conn(0x7fdf9009cb40 msgr2=0x7fdf900d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 -- 172.21.15.5:0/4121512664 shutdown_connections 2023-10-16T13:48:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.813+0000 7fdf96523700 1 -- 172.21.15.5:0/4121512664 wait complete. 2023-10-16T13:48:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.815+0000 7fdf96523700 1 Processor -- start 2023-10-16T13:48:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.815+0000 7fdf96523700 1 -- start start 2023-10-16T13:48:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf96523700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 0x7fdf901f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf96523700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90160e30 0x7fdf90151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf96523700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf90161210 0x7fdf900ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf96523700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c7230 con 0x7fdf900d06d0 2023-10-16T13:48:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf96523700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf901f4340 con 0x7fdf90160e30 2023-10-16T13:48:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf96523700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c74f0 con 0x7fdf90161210 2023-10-16T13:48:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 0x7fdf901f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 0x7fdf901f4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48248/0 (socket says 172.21.15.5:48248) 2023-10-16T13:48:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 -- 172.21.15.5:0/1777002096 learned_addr learned my addr 172.21.15.5:0/1777002096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf94ac0700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf90161210 0x7fdf900ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90160e30 0x7fdf90151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 -- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf90161210 msgr2=0x7fdf900ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf90161210 0x7fdf900ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 -- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90160e30 msgr2=0x7fdf90151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90160e30 0x7fdf90151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 -- 172.21.15.5:0/1777002096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009550 con 0x7fdf900d06d0 2023-10-16T13:48:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90160e30 0x7fdf90151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8ffff700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 0x7fdf901f4760 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000e990 tx=0x7fdf8000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.816+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800096f0 con 0x7fdf900d06d0 2023-10-16T13:48:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.817+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000c850 con 0x7fdf900d06d0 2023-10-16T13:48:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.817+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900c77d0 con 0x7fdf900d06d0 2023-10-16T13:48:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.817+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000eee0 con 0x7fdf900d06d0 2023-10-16T13:48:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.817+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf900cafb0 con 0x7fdf900d06d0 2023-10-16T13:48:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.817+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf90067d20 con 0x7fdf900d06d0 2023-10-16T13:48:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.818+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fdf8000cbc0 con 0x7fdf900d06d0 2023-10-16T13:48:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.818+0000 7fdf8cff9700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7c06b260 0x7fdf7c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:06.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.818+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf80089e50 con 0x7fdf900d06d0 2023-10-16T13:48:06.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.819+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7c06b260 0x7fdf7c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:06.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.819+0000 7fdf8f7fe700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7c06b260 0x7fdf7c06d720 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdf9008c920 tx=0x7fdf84008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:06.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:06.823+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf80054b80 con 0x7fdf900d06d0 2023-10-16T13:48:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.071+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf900cb1a0 con 0x7fdf900d06d0 2023-10-16T13:48:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.072+0000 7fdf8cff9700 1 -- 172.21.15.5:0/1777002096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4909 (secure 0 0 0) 0x7fdf80021090 con 0x7fdf900d06d0 2023-10-16T13:48:07.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:07.075 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:49.207070+0000","modified":"2023-10-16T13:47:52.244374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3043002184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3043002184},{"type":"v1","addr":"172.21.15.5:6834","nonce":3043002184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-16T13:48:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7c06b260 msgr2=0x7fdf7c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7c06b260 0x7fdf7c06d720 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdf9008c920 tx=0x7fdf84008030 comp rx=0 tx=0).stop 2023-10-16T13:48:07.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 msgr2=0x7fdf901f4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 0x7fdf901f4760 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000e990 tx=0x7fdf8000eca0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 shutdown_connections 2023-10-16T13:48:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdf7c06b260 0x7fdf7c06d720 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf90161210 0x7fdf900ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf900d06d0 0x7fdf901f4760 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 --2- 172.21.15.5:0/1777002096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf90160e30 0x7fdf90151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 >> 172.21.15.5:0/1777002096 conn(0x7fdf9009cb40 msgr2=0x7fdf900cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 shutdown_connections 2023-10-16T13:48:07.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.074+0000 7fdf96523700 1 -- 172.21.15.5:0/1777002096 wait complete. 2023-10-16T13:48:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 61 2023-10-16T13:48:07.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.211+0000 7f5f3c00b700 1 Processor -- start 2023-10-16T13:48:07.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.211+0000 7f5f3c00b700 1 -- start start 2023-10-16T13:48:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3c00b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f340cd950 0x7f5f3415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3c00b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cede0 0x7f5f3415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3c00b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f3406a840 0x7f5f3406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3c00b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f341619a0 con 0x7f5f3406a840 2023-10-16T13:48:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3c00b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3406b1f0 con 0x7f5f340cd950 2023-10-16T13:48:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3c00b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340cf260 con 0x7f5f340cede0 2023-10-16T13:48:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f3406a840 0x7f5f3406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f3406a840 0x7f5f3406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48260/0 (socket says 172.21.15.5:48260) 2023-10-16T13:48:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/3516004613 learned_addr learned my addr 172.21.15.5:0/3516004613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f395a6700 1 --2- 172.21.15.5:0/3516004613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cede0 0x7f5f3415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f39da7700 1 --2- 172.21.15.5:0/3516004613 >> v2:172.21.15.112:3300/0 conn(0x7f5f340cd950 0x7f5f3415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/3516004613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cede0 msgr2=0x7f5f3415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 --2- 172.21.15.5:0/3516004613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cede0 0x7f5f3415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/3516004613 >> v2:172.21.15.112:3300/0 conn(0x7f5f340cd950 msgr2=0x7f5f3415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 --2- 172.21.15.5:0/3516004613 >> v2:172.21.15.112:3300/0 conn(0x7f5f340cd950 0x7f5f3415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/3516004613 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340b2d60 con 0x7f5f3406a840 2023-10-16T13:48:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f39da7700 1 --2- 172.21.15.5:0/3516004613 >> v2:172.21.15.112:3300/0 conn(0x7f5f340cd950 0x7f5f3415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.212+0000 7f5f3a5a8700 1 --2- 172.21.15.5:0/3516004613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f3406a840 0x7f5f3406acb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5f340d0430 tx=0x7f5f2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf2d936af5c69cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f38da5700 1 -- 172.21.15.5:0/3516004613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00e070 con 0x7f5f3406a840 2023-10-16T13:48:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f38da5700 1 -- 172.21.15.5:0/3516004613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c00b910 con 0x7f5f3406a840 2023-10-16T13:48:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f38da5700 1 -- 172.21.15.5:0/3516004613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00bcc0 con 0x7f5f3406a840 2023-10-16T13:48:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 -- 172.21.15.5:0/3516004613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f3406a840 msgr2=0x7f5f3406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/3516004613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f3406a840 0x7f5f3406acb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5f340d0430 tx=0x7f5f2c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 -- 172.21.15.5:0/3516004613 shutdown_connections 2023-10-16T13:48:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/3516004613 >> v2:172.21.15.112:3300/0 conn(0x7f5f340cd950 0x7f5f3415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/3516004613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f3406a840 0x7f5f3406acb0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/3516004613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cede0 0x7f5f3415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 -- 172.21.15.5:0/3516004613 >> 172.21.15.5:0/3516004613 conn(0x7f5f3406dae0 msgr2=0x7f5f3406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 -- 172.21.15.5:0/3516004613 shutdown_connections 2023-10-16T13:48:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.213+0000 7f5f3c00b700 1 -- 172.21.15.5:0/3516004613 wait complete. 2023-10-16T13:48:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.214+0000 7f5f3c00b700 1 Processor -- start 2023-10-16T13:48:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.214+0000 7f5f3c00b700 1 -- start start 2023-10-16T13:48:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3c00b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f3406a840 0x7f5f340ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3c00b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cd950 0x7f5f3415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3c00b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 0x7f5f340ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3c00b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415ba80 con 0x7f5f340cede0 2023-10-16T13:48:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3c00b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340ad300 con 0x7f5f3406a840 2023-10-16T13:48:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3c00b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340ad5e0 con 0x7f5f340cd950 2023-10-16T13:48:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3a5a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 0x7f5f340ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3a5a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 0x7f5f340ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48266/0 (socket says 172.21.15.5:48266) 2023-10-16T13:48:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/286537821 learned_addr learned my addr 172.21.15.5:0/286537821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f395a6700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cd950 0x7f5f3415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.215+0000 7f5f39da7700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f3406a840 0x7f5f340ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cd950 msgr2=0x7f5f3415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3a5a8700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cd950 0x7f5f3415b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f3406a840 msgr2=0x7f5f340ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3a5a8700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f3406a840 0x7f5f340ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3a5a8700 1 -- 172.21.15.5:0/286537821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009b30 con 0x7f5f340cede0 2023-10-16T13:48:07.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3a5a8700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 0x7f5f340ac8b0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406d4f0 tx=0x7f5f2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0092e0 con 0x7f5f340cede0 2023-10-16T13:48:07.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c004250 con 0x7f5f340cede0 2023-10-16T13:48:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340ad8c0 con 0x7f5f340cede0 2023-10-16T13:48:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004620 con 0x7f5f340cede0 2023-10-16T13:48:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.216+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f340ade80 con 0x7f5f340cede0 2023-10-16T13:48:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.217+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f34067d20 con 0x7f5f340cede0 2023-10-16T13:48:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.217+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f5f2c004780 con 0x7f5f340cede0 2023-10-16T13:48:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.218+0000 7f5f2a7fc700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f1806b290 0x7f5f1806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.218+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f2c08af60 con 0x7f5f340cede0 2023-10-16T13:48:07.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.218+0000 7f5f39da7700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f1806b290 0x7f5f1806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.218+0000 7f5f39da7700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f1806b290 0x7f5f1806d750 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5f300045f0 tx=0x7f5f30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.223+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f2c055b80 con 0x7f5f340cede0 2023-10-16T13:48:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.467+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f340b2630 con 0x7f5f340cede0 2023-10-16T13:48:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.468+0000 7f5f2a7fc700 1 -- 172.21.15.5:0/286537821 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f5f2c02a090 con 0x7f5f340cede0 2023-10-16T13:48:07.471 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:07.471 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:47:49.207070+0000","modified":"2023-10-16T13:47:52.244374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6903":{"gid":6903,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3043002184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3043002184},{"type":"v1","addr":"172.21.15.5:6834","nonce":3043002184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-16T13:48:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f1806b290 msgr2=0x7f5f1806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f1806b290 0x7f5f1806d750 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5f300045f0 tx=0x7f5f30008040 comp rx=0 tx=0).stop 2023-10-16T13:48:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 msgr2=0x7f5f340ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 0x7f5f340ac8b0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406d4f0 tx=0x7f5f2c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 shutdown_connections 2023-10-16T13:48:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f340cede0 0x7f5f340ac8b0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f3406a840 0x7f5f340ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f1806b290 0x7f5f1806d750 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 --2- 172.21.15.5:0/286537821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f340cd950 0x7f5f3415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 >> 172.21.15.5:0/286537821 conn(0x7f5f3406dae0 msgr2=0x7f5f3415d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 shutdown_connections 2023-10-16T13:48:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.470+0000 7f5f3c00b700 1 -- 172.21.15.5:0/286537821 wait complete. 2023-10-16T13:48:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 61 2023-10-16T13:48:07.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.607+0000 7fb37e97d700 1 Processor -- start 2023-10-16T13:48:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.607+0000 7fb37e97d700 1 -- start start 2023-10-16T13:48:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37e97d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37815e2f0 0x7fb3780cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37e97d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb37806a840 0x7fb37806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37e97d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780b2d60 con 0x7fb3780cd950 2023-10-16T13:48:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37e97d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3781619a0 con 0x7fb37806a840 2023-10-16T13:48:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37e97d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37806b1f0 con 0x7fb37815e2f0 2023-10-16T13:48:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb37806a840 0x7fb37806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb37806a840 0x7fb37806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48274/0 (socket says 172.21.15.5:48274) 2023-10-16T13:48:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 -- 172.21.15.5:0/2675722287 learned_addr learned my addr 172.21.15.5:0/2675722287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 -- 172.21.15.5:0/2675722287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37815e2f0 msgr2=0x7fb3780cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 --2- 172.21.15.5:0/2675722287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37815e2f0 0x7fb3780cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 -- 172.21.15.5:0/2675722287 >> v1:172.21.15.112:6789/0 conn(0x7fb3780cd950 legacy=0x7fb37815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.608+0000 7fb37cf1a700 1 -- 172.21.15.5:0/2675722287 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780cdd30 con 0x7fb37806a840 2023-10-16T13:48:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37cf1a700 1 --2- 172.21.15.5:0/2675722287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb37806acb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb370009e50 tx=0x7fb37000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a32e97100371d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb376ffd700 1 -- 172.21.15.5:0/2675722287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000e070 con 0x7fb37806a840 2023-10-16T13:48:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb376ffd700 1 -- 172.21.15.5:0/2675722287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370003a20 con 0x7fb37806a840 2023-10-16T13:48:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb376ffd700 1 -- 172.21.15.5:0/2675722287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370003dd0 con 0x7fb37806a840 2023-10-16T13:48:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 -- 172.21.15.5:0/2675722287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 msgr2=0x7fb37806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 --2- 172.21.15.5:0/2675722287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb37806acb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb370009e50 tx=0x7fb37000b330 comp rx=0 tx=0).stop 2023-10-16T13:48:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 -- 172.21.15.5:0/2675722287 shutdown_connections 2023-10-16T13:48:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 --2- 172.21.15.5:0/2675722287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb37806acb0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 --2- 172.21.15.5:0/2675722287 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37815e2f0 0x7fb3780cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 -- 172.21.15.5:0/2675722287 >> 172.21.15.5:0/2675722287 conn(0x7fb37806dae0 msgr2=0x7fb37806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 -- 172.21.15.5:0/2675722287 shutdown_connections 2023-10-16T13:48:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.609+0000 7fb37e97d700 1 -- 172.21.15.5:0/2675722287 wait complete. 2023-10-16T13:48:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.611+0000 7fb37e97d700 1 Processor -- start 2023-10-16T13:48:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.611+0000 7fb37e97d700 1 -- start start 2023-10-16T13:48:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb3781f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3780cd950 0x7fb3780c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37815e2f0 0x7fb3780c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780b5430 con 0x7fb37806a840 2023-10-16T13:48:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780b5710 con 0x7fb37815e2f0 2023-10-16T13:48:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780b59f0 con 0x7fb3780cd950 2023-10-16T13:48:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb3781f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb3781f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48276/0 (socket says 172.21.15.5:48276) 2023-10-16T13:48:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 -- 172.21.15.5:0/942715980 learned_addr learned my addr 172.21.15.5:0/942715980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb3777fe700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3780cd950 0x7fb3780c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37cf1a700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37815e2f0 0x7fb3780c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 -- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3780cd950 msgr2=0x7fb3780c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3780cd950 0x7fb3780c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 -- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37815e2f0 msgr2=0x7fb3780c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37815e2f0 0x7fb3780c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 -- 172.21.15.5:0/942715980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370009b30 con 0x7fb37806a840 2023-10-16T13:48:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb377fff700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb3781f3060 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c4a0 tx=0x7fb36800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680054e0 con 0x7fb37806a840 2023-10-16T13:48:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368003680 con 0x7fb37806a840 2023-10-16T13:48:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3780b5cd0 con 0x7fb37806a840 2023-10-16T13:48:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368003a30 con 0x7fb37806a840 2023-10-16T13:48:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.612+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3780b46e0 con 0x7fb37806a840 2023-10-16T13:48:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.613+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3780b2630 con 0x7fb37806a840 2023-10-16T13:48:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.614+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fb368003b90 con 0x7fb37806a840 2023-10-16T13:48:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.614+0000 7fb374ff9700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35806b260 0x7fb35806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.614+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb368088fa0 con 0x7fb37806a840 2023-10-16T13:48:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.615+0000 7fb3777fe700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35806b260 0x7fb35806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.615+0000 7fb3777fe700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35806b260 0x7fb35806d720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb37815f1d0 tx=0x7fb360008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.619+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb368053cd0 con 0x7fb37806a840 2023-10-16T13:48:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.821+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb37815d030 con 0x7fb37806a840 2023-10-16T13:48:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.823+0000 7fb374ff9700 1 -- 172.21.15.5:0/942715980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16436 (secure 0 0 0) 0x7fb368017020 con 0x7fb37806a840 2023-10-16T13:48:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:07.826 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:47:50.785531+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:47:47.704922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-16T13:47:48.167141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35806b260 msgr2=0x7fb35806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35806b260 0x7fb35806d720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb37815f1d0 tx=0x7fb360008040 comp rx=0 tx=0).stop 2023-10-16T13:48:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 msgr2=0x7fb3781f3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb3781f3060 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c4a0 tx=0x7fb36800c860 comp rx=0 tx=0).stop 2023-10-16T13:48:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 shutdown_connections 2023-10-16T13:48:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37815e2f0 0x7fb3780c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb37806a840 0x7fb3781f3060 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb35806b260 0x7fb35806d720 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 --2- 172.21.15.5:0/942715980 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3780cd950 0x7fb3780c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 >> 172.21.15.5:0/942715980 conn(0x7fb37806dae0 msgr2=0x7fb37815f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 shutdown_connections 2023-10-16T13:48:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.825+0000 7fb37e97d700 1 -- 172.21.15.5:0/942715980 wait complete. 2023-10-16T13:48:07.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:48:07.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.964+0000 7f7e68bc5700 1 Processor -- start 2023-10-16T13:48:07.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.964+0000 7f7e68bc5700 1 -- start start 2023-10-16T13:48:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e68bc5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e6406bf60 0x7f7e640c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e68bc5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e640ca280 con 0x7f7e640cb290 2023-10-16T13:48:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e68bc5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e640ca4d0 con 0x7f7e6415b860 2023-10-16T13:48:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e68bc5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640ca7b0 con 0x7f7e6406bf60 2023-10-16T13:48:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e61d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e640cb290 0x7f7e6406b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58290/0 (socket says 172.21.15.5:58290) 2023-10-16T13:48:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e61d9b700 1 -- 172.21.15.5:0/1213233312 learned_addr learned my addr 172.21.15.5:0/1213233312 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e62d9d700 1 --2- 172.21.15.5:0/1213233312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e6406bf60 0x7f7e640c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643863491 0 0) 0x7f7e640ca280 con 0x7f7e640cb290 2023-10-16T13:48:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e4c0035b0 con 0x7f7e640cb290 2023-10-16T13:48:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699345104 0 0) 0x7f7e640ca4d0 con 0x7f7e6415b860 2023-10-16T13:48:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e640ca280 con 0x7f7e6415b860 2023-10-16T13:48:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e62d9d700 1 -- 172.21.15.5:0/1213233312 >> v1:172.21.15.112:6789/0 conn(0x7f7e6415b860 legacy=0x7f7e6406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442155180 0 0) 0x7f7e4c0035b0 con 0x7f7e640cb290 2023-10-16T13:48:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e62d9d700 1 -- 172.21.15.5:0/1213233312 >> v1:172.21.15.5:6789/0 conn(0x7f7e640cb290 legacy=0x7f7e6406b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.966+0000 7f7e62d9d700 1 -- 172.21.15.5:0/1213233312 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640caa90 con 0x7f7e6406bf60 2023-10-16T13:48:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e62d9d700 1 --2- 172.21.15.5:0/1213233312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e6406bf60 0x7f7e640c4ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009dc0 tx=0x7f7e5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d294de4a8ccbc987 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00e070 con 0x7f7e6406bf60 2023-10-16T13:48:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c003a20 con 0x7f7e6406bf60 2023-10-16T13:48:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e6159a700 1 -- 172.21.15.5:0/1213233312 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54001670 con 0x7f7e6406bf60 2023-10-16T13:48:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 -- 172.21.15.5:0/1213233312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e6406bf60 msgr2=0x7f7e640c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/1213233312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e6406bf60 0x7f7e640c4ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009dc0 tx=0x7f7e5c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 -- 172.21.15.5:0/1213233312 shutdown_connections 2023-10-16T13:48:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/1213233312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e6406bf60 0x7f7e640c4ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 -- 172.21.15.5:0/1213233312 >> 172.21.15.5:0/1213233312 conn(0x7f7e64071310 msgr2=0x7f7e64071720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 -- 172.21.15.5:0/1213233312 shutdown_connections 2023-10-16T13:48:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.967+0000 7f7e68bc5700 1 -- 172.21.15.5:0/1213233312 wait complete. 2023-10-16T13:48:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.969+0000 7f7e68bc5700 1 Processor -- start 2023-10-16T13:48:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.969+0000 7f7e68bc5700 1 -- start start 2023-10-16T13:48:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e68bc5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e6406bf60 0x7f7e641558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e68bc5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e640cb290 0x7f7e64157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e68bc5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 0x7f7e6414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e68bc5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641f0ce0 con 0x7f7e6415b860 2023-10-16T13:48:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e68bc5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641f0fc0 con 0x7f7e6406bf60 2023-10-16T13:48:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e68bc5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641f12a0 con 0x7f7e640cb290 2023-10-16T13:48:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e62d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 0x7f7e6414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e62d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 0x7f7e6414c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48294/0 (socket says 172.21.15.5:48294) 2023-10-16T13:48:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e62d9d700 1 -- 172.21.15.5:0/2524906566 learned_addr learned my addr 172.21.15.5:0/2524906566 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e61d9b700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e640cb290 0x7f7e64157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.970+0000 7f7e6259c700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e6406bf60 0x7f7e641558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e62d9d700 1 -- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e640cb290 msgr2=0x7f7e64157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e62d9d700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e640cb290 0x7f7e64157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e62d9d700 1 -- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e6406bf60 msgr2=0x7f7e641558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e62d9d700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e6406bf60 0x7f7e641558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e62d9d700 1 -- 172.21.15.5:0/2524906566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009a70 con 0x7f7e6415b860 2023-10-16T13:48:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e6259c700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e6406bf60 0x7f7e641558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e61d9b700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e640cb290 0x7f7e64157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e62d9d700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 0x7f7e6414c560 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009d90 tx=0x7f7e5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0043c0 con 0x7f7e6415b860 2023-10-16T13:48:07.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c004540 con 0x7f7e6415b860 2023-10-16T13:48:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0048f0 con 0x7f7e6415b860 2023-10-16T13:48:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e641f1580 con 0x7f7e6415b860 2023-10-16T13:48:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.971+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64157960 con 0x7f7e6415b860 2023-10-16T13:48:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.972+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e641f1100 con 0x7f7e6415b860 2023-10-16T13:48:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.972+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f7e5c01c460 con 0x7f7e6415b860 2023-10-16T13:48:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.973+0000 7f7e52ffd700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e4406b260 0x7f7e4406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.973+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e5c08b350 con 0x7f7e6415b860 2023-10-16T13:48:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.973+0000 7f7e6259c700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e4406b260 0x7f7e4406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.974+0000 7f7e6259c700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e4406b260 0x7f7e4406d720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e58007fd0 tx=0x7f7e58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:07.977+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e641f1100 con 0x7f7e6415b860 2023-10-16T13:48:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.220+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7e641f1100 con 0x7f7e6415b860 2023-10-16T13:48:08.223 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:48:08.221+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:48:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.222+0000 7f7e52ffd700 1 -- 172.21.15.5:0/2524906566 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7e641f1100 con 0x7f7e6415b860 2023-10-16T13:48:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.225+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e4406b260 msgr2=0x7f7e4406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.225+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e4406b260 0x7f7e4406d720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e58007fd0 tx=0x7f7e58009040 comp rx=0 tx=0).stop 2023-10-16T13:48:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 msgr2=0x7f7e6414c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 0x7f7e6414c560 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009d90 tx=0x7f7e5c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 shutdown_connections 2023-10-16T13:48:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415b860 0x7f7e6414c560 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e6406bf60 0x7f7e641558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e4406b260 0x7f7e4406d720 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 --2- 172.21.15.5:0/2524906566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e640cb290 0x7f7e64157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 >> 172.21.15.5:0/2524906566 conn(0x7f7e64071310 msgr2=0x7f7e6406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 shutdown_connections 2023-10-16T13:48:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.226+0000 7f7e68bc5700 1 -- 172.21.15.5:0/2524906566 wait complete. 2023-10-16T13:48:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:48:08.232 INFO:tasks.ceph.mds.a.smithi005.stderr: -3484> 2023-10-16T13:47:51.776+0000 7f559fccd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:48:08.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:48:08.258 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:48:08.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.367+0000 7f86eaae0700 1 Processor -- start 2023-10-16T13:48:08.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.367+0000 7f86eaae0700 1 -- start start 2023-10-16T13:48:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86eaae0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e415eab0 0x7f86e40cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86eaae0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f86e40cf6d0 0x7f86e40d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86eaae0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40ccc20 con 0x7f86e40d1bc0 2023-10-16T13:48:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86eaae0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40cfb60 con 0x7f86e415eab0 2023-10-16T13:48:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86eaae0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e415ee90 con 0x7f86e40cf6d0 2023-10-16T13:48:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e887c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e415eab0 0x7f86e40cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e907d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86e40d1bc0 0x7f86e4161510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58314/0 (socket says 172.21.15.5:58314) 2023-10-16T13:48:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e907d700 1 -- 172.21.15.5:0/2461841506 learned_addr learned my addr 172.21.15.5:0/2461841506 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e3fff700 1 --2- 172.21.15.5:0/2461841506 >> v2:172.21.15.112:3300/0 conn(0x7f86e40cf6d0 0x7f86e40d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e887c700 1 -- 172.21.15.5:0/2461841506 >> v2:172.21.15.112:3300/0 conn(0x7f86e40cf6d0 msgr2=0x7f86e40d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e887c700 1 --2- 172.21.15.5:0/2461841506 >> v2:172.21.15.112:3300/0 conn(0x7f86e40cf6d0 0x7f86e40d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e887c700 1 -- 172.21.15.5:0/2461841506 >> v1:172.21.15.5:6789/0 conn(0x7f86e40d1bc0 legacy=0x7f86e4161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:08.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e887c700 1 -- 172.21.15.5:0/2461841506 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4158370 con 0x7f86e415eab0 2023-10-16T13:48:08.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.368+0000 7f86e887c700 1 --2- 172.21.15.5:0/2461841506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40cf190 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f86e406da90 tx=0x7f86d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dde6f2c153d2b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:08.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86e37fe700 1 -- 172.21.15.5:0/2461841506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8011830 con 0x7f86e415eab0 2023-10-16T13:48:08.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86e37fe700 1 -- 172.21.15.5:0/2461841506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8011990 con 0x7f86e415eab0 2023-10-16T13:48:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86e37fe700 1 -- 172.21.15.5:0/2461841506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8011d20 con 0x7f86e415eab0 2023-10-16T13:48:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 -- 172.21.15.5:0/2461841506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 msgr2=0x7f86e40cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 --2- 172.21.15.5:0/2461841506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40cf190 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f86e406da90 tx=0x7f86d8009b20 comp rx=0 tx=0).stop 2023-10-16T13:48:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 -- 172.21.15.5:0/2461841506 shutdown_connections 2023-10-16T13:48:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 --2- 172.21.15.5:0/2461841506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40cf190 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 --2- 172.21.15.5:0/2461841506 >> v2:172.21.15.112:3300/0 conn(0x7f86e40cf6d0 0x7f86e40d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 -- 172.21.15.5:0/2461841506 >> 172.21.15.5:0/2461841506 conn(0x7f86e40665a0 msgr2=0x7f86e4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 -- 172.21.15.5:0/2461841506 shutdown_connections 2023-10-16T13:48:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.369+0000 7f86eaae0700 1 -- 172.21.15.5:0/2461841506 wait complete. 2023-10-16T13:48:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.370+0000 7f86eaae0700 1 Processor -- start 2023-10-16T13:48:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.370+0000 7f86eaae0700 1 -- start start 2023-10-16T13:48:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86eaae0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e40cf6d0 0x7f86e4148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86eaae0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86e40d1bc0 0x7f86e40b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86eaae0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86eaae0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40cc290 con 0x7f86e415eab0 2023-10-16T13:48:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86eaae0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4146e50 con 0x7f86e40cf6d0 2023-10-16T13:48:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86eaae0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4149320 con 0x7f86e40d1bc0 2023-10-16T13:48:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86e907d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.371+0000 7f86e907d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48314/0 (socket says 172.21.15.5:48314) 2023-10-16T13:48:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 -- 172.21.15.5:0/48484353 learned_addr learned my addr 172.21.15.5:0/48484353 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e887c700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e40cf6d0 0x7f86e4148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e3fff700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86e40d1bc0 0x7f86e40b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 -- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86e40d1bc0 msgr2=0x7f86e40b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86e40d1bc0 0x7f86e40b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 -- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e40cf6d0 msgr2=0x7f86e4148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e40cf6d0 0x7f86e4148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 -- 172.21.15.5:0/48484353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80094a0 con 0x7f86e415eab0 2023-10-16T13:48:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e907d700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40b5e80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00cbf0 tx=0x7f86dc00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00aa60 con 0x7f86e415eab0 2023-10-16T13:48:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00abc0 con 0x7f86e415eab0 2023-10-16T13:48:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4146520 con 0x7f86e415eab0 2023-10-16T13:48:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc012400 con 0x7f86e415eab0 2023-10-16T13:48:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.372+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4146ae0 con 0x7f86e415eab0 2023-10-16T13:48:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.373+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4147000 con 0x7f86e415eab0 2023-10-16T13:48:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.374+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f86dc01b3b0 con 0x7f86e415eab0 2023-10-16T13:48:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.374+0000 7f86e17fa700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f86c806b260 0x7f86c806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.374+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f86dc089700 con 0x7f86e415eab0 2023-10-16T13:48:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.374+0000 7f86e887c700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f86c806b260 0x7f86c806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:08.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.375+0000 7f86e887c700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f86c806b260 0x7f86c806d720 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f86d80090b0 tx=0x7f86d801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:08.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.379+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86e4147000 con 0x7f86e415eab0 2023-10-16T13:48:08.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:08.626+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86e4147000 con 0x7f86e415eab0 2023-10-16T13:48:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.224+0000 7f86e17fa700 1 -- 172.21.15.5:0/48484353 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f86e4147000 con 0x7f86e415eab0 2023-10-16T13:48:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f86c806b260 msgr2=0x7f86c806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f86c806b260 0x7f86c806d720 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f86d80090b0 tx=0x7f86d801c040 comp rx=0 tx=0).stop 2023-10-16T13:48:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 msgr2=0x7f86e40b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40b5e80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00cbf0 tx=0x7f86dc00cf00 comp rx=0 tx=0).stop 2023-10-16T13:48:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 shutdown_connections 2023-10-16T13:48:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e415eab0 0x7f86e40b5e80 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e40cf6d0 0x7f86e4148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f86c806b260 0x7f86c806d720 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 --2- 172.21.15.5:0/48484353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86e40d1bc0 0x7f86e40b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 >> 172.21.15.5:0/48484353 conn(0x7f86e40665a0 msgr2=0x7f86e415dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 shutdown_connections 2023-10-16T13:48:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.227+0000 7f86eaae0700 1 -- 172.21.15.5:0/48484353 wait complete. 2023-10-16T13:48:09.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:48:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.420+0000 7ff75426c700 1 Processor -- start 2023-10-16T13:48:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.420+0000 7ff75426c700 1 -- start start 2023-10-16T13:48:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.421+0000 7ff75426c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 0x7ff74c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.421+0000 7ff75426c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c06b520 con 0x7ff74c06d320 2023-10-16T13:48:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.421+0000 7ff75426c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c06abf0 con 0x7ff74c150ee0 2023-10-16T13:48:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.421+0000 7ff75426c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c15b300 con 0x7ff74c0cbf90 2023-10-16T13:48:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751807700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff74c06d320 0x7ff74c1507d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58326/0 (socket says 172.21.15.5:58326) 2023-10-16T13:48:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751807700 1 -- 172.21.15.5:0/789039319 learned_addr learned my addr 172.21.15.5:0/789039319 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff752008700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 0x7ff74c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282929655 0 0) 0x7ff74c06b520 con 0x7ff74c06d320 2023-10-16T13:48:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7380035b0 con 0x7ff74c06d320 2023-10-16T13:48:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115011794 0 0) 0x7ff7380035b0 con 0x7ff74c06d320 2023-10-16T13:48:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 msgr2=0x7ff74c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 0x7ff74c06b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 >> v1:172.21.15.112:6789/0 conn(0x7ff74c150ee0 legacy=0x7ff74c15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c06aed0 con 0x7ff74c06d320 2023-10-16T13:48:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7ff748001670 con 0x7ff74c06d320 2023-10-16T13:48:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 >> v1:172.21.15.5:6789/0 conn(0x7ff74c06d320 legacy=0x7ff74c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 0x7ff738003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff738003f70 0x7ff738004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff738005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c15b300 con 0x7ff738004d90 2023-10-16T13:48:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73800ba70 con 0x7ff738003f70 2023-10-16T13:48:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73800bc30 con 0x7ff74c0cbf90 2023-10-16T13:48:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff752809700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff738005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff751807700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff738003f70 0x7ff738004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.422+0000 7ff752008700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 0x7ff738003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff752809700 1 -- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 msgr2=0x7ff738003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff752809700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c0cbf90 0x7ff738003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff752809700 1 -- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff738003f70 msgr2=0x7ff738004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff752809700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff738003f70 0x7ff738004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff752809700 1 -- 172.21.15.5:0/789039319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380035b0 con 0x7ff738004d90 2023-10-16T13:48:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff752809700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff738005210 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff74400c290 tx=0x7ff738005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91386e07dadb005 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744001e70 con 0x7ff738004d90 2023-10-16T13:48:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74400ce50 con 0x7ff738004d90 2023-10-16T13:48:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.423+0000 7ff751006700 1 -- 172.21.15.5:0/789039319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744012660 con 0x7ff738004d90 2023-10-16T13:48:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff75426c700 1 -- 172.21.15.5:0/789039319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 msgr2=0x7ff738005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff75426c700 1 --2- 172.21.15.5:0/789039319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff738005210 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff74400c290 tx=0x7ff738005880 comp rx=0 tx=0).stop 2023-10-16T13:48:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff752809700 1 -- 172.21.15.5:0/789039319 reap_dead start 2023-10-16T13:48:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff75426c700 1 -- 172.21.15.5:0/789039319 shutdown_connections 2023-10-16T13:48:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff75426c700 1 -- 172.21.15.5:0/789039319 >> 172.21.15.5:0/789039319 conn(0x7ff74c0cfc10 msgr2=0x7ff74c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff75426c700 1 -- 172.21.15.5:0/789039319 shutdown_connections 2023-10-16T13:48:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.424+0000 7ff75426c700 1 -- 172.21.15.5:0/789039319 wait complete. 2023-10-16T13:48:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.425+0000 7ff75426c700 1 Processor -- start 2023-10-16T13:48:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.425+0000 7ff75426c700 1 -- start start 2023-10-16T13:48:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff75426c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff74c168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff75426c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c168700 0x7ff74c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff75426c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff74c0b4b50 0x7ff74c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff75426c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c149f10 con 0x7ff738004d90 2023-10-16T13:48:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff75426c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b3720 con 0x7ff74c0b4b50 2023-10-16T13:48:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff75426c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b2850 con 0x7ff74c168700 2023-10-16T13:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff74c168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff74c168190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48334/0 (socket says 172.21.15.5:48334) 2023-10-16T13:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 -- 172.21.15.5:0/218912943 learned_addr learned my addr 172.21.15.5:0/218912943 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752809700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff74c0b4b50 0x7ff74c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 -- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c168700 msgr2=0x7ff74c1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c168700 0x7ff74c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 -- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff74c0b4b50 msgr2=0x7ff74c0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:09.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff74c0b4b50 0x7ff74c0b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:09.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 -- 172.21.15.5:0/218912943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0b2b10 con 0x7ff738004d90 2023-10-16T13:48:09.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff752008700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff74c168190 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff73c011aa0 tx=0x7ff73c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:09.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.426+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00f980 con 0x7ff738004d90 2023-10-16T13:48:09.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.427+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c00fae0 con 0x7ff738004d90 2023-10-16T13:48:09.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.427+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00fe90 con 0x7ff738004d90 2023-10-16T13:48:09.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.427+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c0b2df0 con 0x7ff738004d90 2023-10-16T13:48:09.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.427+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c0b33b0 con 0x7ff738004d90 2023-10-16T13:48:09.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.428+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c067d20 con 0x7ff738004d90 2023-10-16T13:48:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.428+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7ff73c014440 con 0x7ff738004d90 2023-10-16T13:48:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.428+0000 7ff742ffd700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff73006b260 0x7ff73006d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.429+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff73c08a380 con 0x7ff738004d90 2023-10-16T13:48:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.429+0000 7ff751807700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff73006b260 0x7ff73006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:09.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.429+0000 7ff751807700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff73006b260 0x7ff73006d720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff748001050 tx=0x7ff748001b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:09.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.433+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff73c055040 con 0x7ff738004d90 2023-10-16T13:48:09.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:09.634+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff74c15b440 con 0x7ff738004d90 2023-10-16T13:48:10.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.232+0000 7ff742ffd700 1 -- 172.21.15.5:0/218912943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff73c058660 con 0x7ff738004d90 2023-10-16T13:48:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff73006b260 msgr2=0x7ff73006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff73006b260 0x7ff73006d720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff748001050 tx=0x7ff748001b40 comp rx=0 tx=0).stop 2023-10-16T13:48:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 msgr2=0x7ff74c168190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff74c168190 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff73c011aa0 tx=0x7ff73c011e60 comp rx=0 tx=0).stop 2023-10-16T13:48:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 shutdown_connections 2023-10-16T13:48:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff74c0b4b50 0x7ff74c0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff738004d90 0x7ff74c168190 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff73006b260 0x7ff73006d720 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 --2- 172.21.15.5:0/218912943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff74c168700 0x7ff74c1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 >> 172.21.15.5:0/218912943 conn(0x7ff74c0cfc10 msgr2=0x7ff74c15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 shutdown_connections 2023-10-16T13:48:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.235+0000 7ff75426c700 1 -- 172.21.15.5:0/218912943 wait complete. 2023-10-16T13:48:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:48:10.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:48:10.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.387+0000 7f26e7e36700 1 Processor -- start 2023-10-16T13:48:10.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.387+0000 7f26e7e36700 1 -- start start 2023-10-16T13:48:10.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e7e36700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26e0151680 0x7f26e015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e7e36700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e7e36700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26e006da30 0x7f26e006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e7e36700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e006e420 con 0x7f26e0151680 2023-10-16T13:48:10.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e7e36700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00b2e40 con 0x7f26e006da30 2023-10-16T13:48:10.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e7e36700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e015e7c0 con 0x7f26e00727e0 2023-10-16T13:48:10.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e5bd2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26e0151680 0x7f26e015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e5bd2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26e0151680 0x7f26e015ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48342/0 (socket says 172.21.15.5:48342) 2023-10-16T13:48:10.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e5bd2700 1 -- 172.21.15.5:0/777036592 learned_addr learned my addr 172.21.15.5:0/777036592 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:10.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e53d1700 1 --2- 172.21.15.5:0/777036592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e63d3700 1 --2- 172.21.15.5:0/777036592 >> v2:172.21.15.112:3300/0 conn(0x7f26e006da30 0x7f26e006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e5bd2700 1 -- 172.21.15.5:0/777036592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 msgr2=0x7f26e00b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:10.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e5bd2700 1 --2- 172.21.15.5:0/777036592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.388+0000 7f26e5bd2700 1 -- 172.21.15.5:0/777036592 >> v2:172.21.15.112:3300/0 conn(0x7f26e006da30 msgr2=0x7f26e006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e5bd2700 1 --2- 172.21.15.5:0/777036592 >> v2:172.21.15.112:3300/0 conn(0x7f26e006da30 0x7f26e006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e5bd2700 1 -- 172.21.15.5:0/777036592 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00b2880 con 0x7f26e0151680 2023-10-16T13:48:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e63d3700 1 --2- 172.21.15.5:0/777036592 >> v2:172.21.15.112:3300/0 conn(0x7f26e006da30 0x7f26e006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e5bd2700 1 --2- 172.21.15.5:0/777036592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e015ec50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f26e0071d90 tx=0x7f26d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66302d36311164ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e4bd0700 1 -- 172.21.15.5:0/777036592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0011830 con 0x7f26e0151680 2023-10-16T13:48:10.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e4bd0700 1 -- 172.21.15.5:0/777036592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d0011990 con 0x7f26e0151680 2023-10-16T13:48:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e4bd0700 1 -- 172.21.15.5:0/777036592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0011d20 con 0x7f26e0151680 2023-10-16T13:48:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 -- 172.21.15.5:0/777036592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 msgr2=0x7f26e015ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 --2- 172.21.15.5:0/777036592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e015ec50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f26e0071d90 tx=0x7f26d0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 -- 172.21.15.5:0/777036592 shutdown_connections 2023-10-16T13:48:10.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 --2- 172.21.15.5:0/777036592 >> v2:172.21.15.112:3300/0 conn(0x7f26e006da30 0x7f26e006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 --2- 172.21.15.5:0/777036592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e015ec50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 --2- 172.21.15.5:0/777036592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.389+0000 7f26e7e36700 1 -- 172.21.15.5:0/777036592 >> 172.21.15.5:0/777036592 conn(0x7f26e006bd70 msgr2=0x7f26e006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.390+0000 7f26e7e36700 1 -- 172.21.15.5:0/777036592 shutdown_connections 2023-10-16T13:48:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.390+0000 7f26e7e36700 1 -- 172.21.15.5:0/777036592 wait complete. 2023-10-16T13:48:10.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 Processor -- start 2023-10-16T13:48:10.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 -- start start 2023-10-16T13:48:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e006da30 0x7f26e01502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e01f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00af9d0 con 0x7f26e0151680 2023-10-16T13:48:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01507f0 con 0x7f26e006da30 2023-10-16T13:48:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.391+0000 7f26e7e36700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01f3d70 con 0x7f26e00727e0 2023-10-16T13:48:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e01f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e01f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48350/0 (socket says 172.21.15.5:48350) 2023-10-16T13:48:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 -- 172.21.15.5:0/1979676367 learned_addr learned my addr 172.21.15.5:0/1979676367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e53d1700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e5bd2700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e006da30 0x7f26e01502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 -- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 msgr2=0x7f26e00ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 -- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e006da30 msgr2=0x7f26e01502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e006da30 0x7f26e01502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 -- 172.21.15.5:0/1979676367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0009550 con 0x7f26e0151680 2023-10-16T13:48:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e63d3700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e01f31b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f26d8007db0 tx=0x7f26d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800dd20 con 0x7f26e0151680 2023-10-16T13:48:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800f040 con 0x7f26e0151680 2023-10-16T13:48:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e01f4050 con 0x7f26e0151680 2023-10-16T13:48:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800dea0 con 0x7f26e0151680 2023-10-16T13:48:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.392+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e00ad060 con 0x7f26e0151680 2023-10-16T13:48:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.393+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0072e10 con 0x7f26e0151680 2023-10-16T13:48:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.394+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f26d8003c60 con 0x7f26e0151680 2023-10-16T13:48:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.394+0000 7f26d67fc700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f26c406b260 0x7f26c406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:10.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.394+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f26d80899e0 con 0x7f26e0151680 2023-10-16T13:48:10.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.394+0000 7f26e5bd2700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f26c406b260 0x7f26c406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:10.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.395+0000 7f26e5bd2700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f26c406b260 0x7f26c406d720 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009c10 tx=0x7f26d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:10.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.399+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26d80546d0 con 0x7f26e0151680 2023-10-16T13:48:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:10.609+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26e0067d20 con 0x7f26e0151680 2023-10-16T13:48:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.233+0000 7f26d67fc700 1 -- 172.21.15.5:0/1979676367 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7f26d801a0d0 con 0x7f26e0151680 2023-10-16T13:48:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f26c406b260 msgr2=0x7f26c406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f26c406b260 0x7f26c406d720 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009c10 tx=0x7f26d0008030 comp rx=0 tx=0).stop 2023-10-16T13:48:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 msgr2=0x7f26e01f31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e01f31b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f26d8007db0 tx=0x7f26d800d3b0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 shutdown_connections 2023-10-16T13:48:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e0151680 0x7f26e01f31b0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26e006da30 0x7f26e01502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f26c406b260 0x7f26c406d720 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 --2- 172.21.15.5:0/1979676367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26e00727e0 0x7f26e00ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 >> 172.21.15.5:0/1979676367 conn(0x7f26e006bd70 msgr2=0x7f26e015b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 shutdown_connections 2023-10-16T13:48:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.238+0000 7f26e7e36700 1 -- 172.21.15.5:0/1979676367 wait complete. 2023-10-16T13:48:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:48:11.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:48:11.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.391+0000 7f8ce26b3700 1 Processor -- start 2023-10-16T13:48:11.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.391+0000 7f8ce26b3700 1 -- start start 2023-10-16T13:48:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8ce26b3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8cdc15f1f0 0x7f8cdc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8ce26b3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8ce26b3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc15e7a0 con 0x7f8cdc15ab10 2023-10-16T13:48:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8ce26b3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0d00d0 con 0x7f8cdc15f1f0 2023-10-16T13:48:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8ce26b3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0b29a0 con 0x7f8cdc0cfc60 2023-10-16T13:48:11.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8cdbfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8cdc15ab10 0x7f8cdc0b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58358/0 (socket says 172.21.15.5:58358) 2023-10-16T13:48:11.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8cdbfff700 1 -- 172.21.15.5:0/148033939 learned_addr learned my addr 172.21.15.5:0/148033939 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:11.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8ce0c50700 1 --2- 172.21.15.5:0/148033939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.392+0000 7f8cdb7fe700 1 --2- 172.21.15.5:0/148033939 >> v2:172.21.15.112:3300/0 conn(0x7f8cdc15f1f0 0x7f8cdc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8cdaffd700 1 -- 172.21.15.5:0/148033939 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298215585 0 0) 0x7f8cdc15e7a0 con 0x7f8cdc15ab10 2023-10-16T13:48:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8cdaffd700 1 -- 172.21.15.5:0/148033939 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc80057c0 con 0x7f8cdc15ab10 2023-10-16T13:48:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8ce0c50700 1 -- 172.21.15.5:0/148033939 >> v2:172.21.15.112:3300/0 conn(0x7f8cdc15f1f0 msgr2=0x7f8cdc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8ce0c50700 1 --2- 172.21.15.5:0/148033939 >> v2:172.21.15.112:3300/0 conn(0x7f8cdc15f1f0 0x7f8cdc0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8ce0c50700 1 -- 172.21.15.5:0/148033939 >> v1:172.21.15.5:6789/0 conn(0x7f8cdc15ab10 legacy=0x7f8cdc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8ce0c50700 1 -- 172.21.15.5:0/148033939 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0b2c80 con 0x7f8cdc0cfc60 2023-10-16T13:48:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8cdb7fe700 1 --2- 172.21.15.5:0/148033939 >> v2:172.21.15.112:3300/0 conn(0x7f8cdc15f1f0 0x7f8cdc0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8ce0c50700 1 --2- 172.21.15.5:0/148033939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc0cbf40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009d90 tx=0x7f8cd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c849e292344f9223 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8cdaffd700 1 -- 172.21.15.5:0/148033939 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd400e070 con 0x7f8cdc0cfc60 2023-10-16T13:48:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8cdaffd700 1 -- 172.21.15.5:0/148033939 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd400bb20 con 0x7f8cdc0cfc60 2023-10-16T13:48:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.393+0000 7f8cdaffd700 1 -- 172.21.15.5:0/148033939 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd400be90 con 0x7f8cdc0cfc60 2023-10-16T13:48:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 -- 172.21.15.5:0/148033939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 msgr2=0x7f8cdc0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/148033939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc0cbf40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009d90 tx=0x7f8cd400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 -- 172.21.15.5:0/148033939 shutdown_connections 2023-10-16T13:48:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/148033939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc0cbf40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/148033939 >> v2:172.21.15.112:3300/0 conn(0x7f8cdc15f1f0 0x7f8cdc0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 -- 172.21.15.5:0/148033939 >> 172.21.15.5:0/148033939 conn(0x7f8cdc06dae0 msgr2=0x7f8cdc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:11.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 -- 172.21.15.5:0/148033939 shutdown_connections 2023-10-16T13:48:11.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.394+0000 7f8ce26b3700 1 -- 172.21.15.5:0/148033939 wait complete. 2023-10-16T13:48:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.395+0000 7f8ce26b3700 1 Processor -- start 2023-10-16T13:48:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.395+0000 7f8ce26b3700 1 -- start start 2023-10-16T13:48:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce26b3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc1ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce26b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 0x7f8cdc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce26b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cdc15f1f0 0x7f8cdc1f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce26b3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15b430 con 0x7f8cdc15ab10 2023-10-16T13:48:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce26b3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15b6e0 con 0x7f8cdc15f1f0 2023-10-16T13:48:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce26b3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15b9c0 con 0x7f8cdc0cfc60 2023-10-16T13:48:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 0x7f8cdc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 0x7f8cdc15aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48362/0 (socket says 172.21.15.5:48362) 2023-10-16T13:48:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 -- 172.21.15.5:0/404476460 learned_addr learned my addr 172.21.15.5:0/404476460 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdbfff700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc1ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8ce0c50700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cdc15f1f0 0x7f8cdc1f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 -- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 msgr2=0x7f8cdc1ef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc1ef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 -- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cdc15f1f0 msgr2=0x7f8cdc1f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cdc15f1f0 0x7f8cdc1f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdb7fe700 1 -- 172.21.15.5:0/404476460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4009430 con 0x7f8cdc15ab10 2023-10-16T13:48:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.396+0000 7f8cdbfff700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc1ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.397+0000 7f8cdb7fe700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 0x7f8cdc15aef0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400ebe0 tx=0x7f8cc4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.397+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4005a20 con 0x7f8cdc15ab10 2023-10-16T13:48:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.397+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc4005b80 con 0x7f8cdc15ab10 2023-10-16T13:48:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.397+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd4009a70 con 0x7f8cdc15ab10 2023-10-16T13:48:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.397+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400c910 con 0x7f8cdc15ab10 2023-10-16T13:48:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.397+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc1f2bf0 con 0x7f8cdc15ab10 2023-10-16T13:48:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.398+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc1f3240 con 0x7f8cdc15ab10 2023-10-16T13:48:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.398+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f8cc400ca70 con 0x7f8cdc15ab10 2023-10-16T13:48:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.399+0000 7f8cd8ff9700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cbc06b260 0x7f8cbc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.399+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8cc4089b50 con 0x7f8cdc15ab10 2023-10-16T13:48:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.399+0000 7f8cdbfff700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cbc06b260 0x7f8cbc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.400+0000 7f8cdbfff700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cbc06b260 0x7f8cbc06d720 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc005910 tx=0x7f8ccc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:11.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.403+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cc4054b40 con 0x7f8cdc15ab10 2023-10-16T13:48:11.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.604+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8cdc067d20 con 0x7f8cdc15ab10 2023-10-16T13:48:11.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.607+0000 7f8cd8ff9700 1 -- 172.21.15.5:0/404476460 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8cc4020020 con 0x7f8cdc15ab10 2023-10-16T13:48:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cbc06b260 msgr2=0x7f8cbc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cbc06b260 0x7f8cbc06d720 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc005910 tx=0x7f8ccc009040 comp rx=0 tx=0).stop 2023-10-16T13:48:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 msgr2=0x7f8cdc15aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 0x7f8cdc15aef0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400ebe0 tx=0x7f8cc4009ea0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 shutdown_connections 2023-10-16T13:48:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cdc15f1f0 0x7f8cdc1f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8cbc06b260 0x7f8cbc06d720 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cdc0cfc60 0x7f8cdc1ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 --2- 172.21.15.5:0/404476460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc15ab10 0x7f8cdc15aef0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 >> 172.21.15.5:0/404476460 conn(0x7f8cdc06dae0 msgr2=0x7f8cdc159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 shutdown_connections 2023-10-16T13:48:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.610+0000 7f8ce26b3700 1 -- 172.21.15.5:0/404476460 wait complete. 2023-10-16T13:48:11.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-16T13:48:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.748+0000 7f37acea5700 1 Processor -- start 2023-10-16T13:48:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.748+0000 7f37acea5700 1 -- start start 2023-10-16T13:48:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37acea5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37a80d0c70 0x7f37a80cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37acea5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37a80c5110 0x7f37a80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37acea5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a80d23e0 con 0x7f37a815b740 2023-10-16T13:48:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37acea5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a815bb20 con 0x7f37a80d0c70 2023-10-16T13:48:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37acea5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a80cf190 con 0x7f37a80c5110 2023-10-16T13:48:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a5d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37a80d0c70 0x7f37a80cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f37a815b740 0x7f37a80d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58372/0 (socket says 172.21.15.5:58372) 2023-10-16T13:48:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a659c700 1 -- 172.21.15.5:0/1508152112 learned_addr learned my addr 172.21.15.5:0/1508152112 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a6d9d700 1 --2- 172.21.15.5:0/1508152112 >> v2:172.21.15.112:3300/0 conn(0x7f37a80c5110 0x7f37a80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a5d9b700 1 -- 172.21.15.5:0/1508152112 >> v2:172.21.15.112:3300/0 conn(0x7f37a80c5110 msgr2=0x7f37a80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a5d9b700 1 --2- 172.21.15.5:0/1508152112 >> v2:172.21.15.112:3300/0 conn(0x7f37a80c5110 0x7f37a80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a5d9b700 1 -- 172.21.15.5:0/1508152112 >> v1:172.21.15.5:6789/0 conn(0x7f37a815b740 legacy=0x7f37a80d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37a5d9b700 1 -- 172.21.15.5:0/1508152112 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80cbd40 con 0x7f37a80d0c70 2023-10-16T13:48:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.749+0000 7f37a559a700 1 -- 172.21.15.5:0/1508152112 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161888927 0 0) 0x7f3798001110 con 0x7f37a815b740 2023-10-16T13:48:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37a5d9b700 1 --2- 172.21.15.5:0/1508152112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a80d0c70 0x7f37a80cdfd0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f37a80c8620 tx=0x7f3790009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db79f240d83abb68 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37a559a700 1 -- 172.21.15.5:0/1508152112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790011830 con 0x7f37a80d0c70 2023-10-16T13:48:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37a559a700 1 -- 172.21.15.5:0/1508152112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790011990 con 0x7f37a80d0c70 2023-10-16T13:48:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37a559a700 1 -- 172.21.15.5:0/1508152112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790011d20 con 0x7f37a80d0c70 2023-10-16T13:48:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37acea5700 1 -- 172.21.15.5:0/1508152112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a80d0c70 msgr2=0x7f37a80cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37acea5700 1 --2- 172.21.15.5:0/1508152112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a80d0c70 0x7f37a80cdfd0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f37a80c8620 tx=0x7f3790009b20 comp rx=0 tx=0).stop 2023-10-16T13:48:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37acea5700 1 -- 172.21.15.5:0/1508152112 shutdown_connections 2023-10-16T13:48:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37acea5700 1 --2- 172.21.15.5:0/1508152112 >> v2:172.21.15.112:3300/0 conn(0x7f37a80c5110 0x7f37a80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37acea5700 1 --2- 172.21.15.5:0/1508152112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a80d0c70 0x7f37a80cdfd0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.750+0000 7f37acea5700 1 -- 172.21.15.5:0/1508152112 >> 172.21.15.5:0/1508152112 conn(0x7f37a80665a0 msgr2=0x7f37a8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.751+0000 7f37acea5700 1 -- 172.21.15.5:0/1508152112 shutdown_connections 2023-10-16T13:48:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.751+0000 7f37acea5700 1 -- 172.21.15.5:0/1508152112 wait complete. 2023-10-16T13:48:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.752+0000 7f37acea5700 1 Processor -- start 2023-10-16T13:48:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.752+0000 7f37acea5700 1 -- start start 2023-10-16T13:48:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37acea5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c5110 0x7f37a81f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37acea5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37a80d0c70 0x7f37a8159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37acea5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 0x7f37a81f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37acea5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a81f3d00 con 0x7f37a815b740 2023-10-16T13:48:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37acea5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a81f3740 con 0x7f37a80c5110 2023-10-16T13:48:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37acea5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a81f3a20 con 0x7f37a80d0c70 2023-10-16T13:48:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 0x7f37a81f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 0x7f37a81f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48378/0 (socket says 172.21.15.5:48378) 2023-10-16T13:48:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 -- 172.21.15.5:0/2138183321 learned_addr learned my addr 172.21.15.5:0/2138183321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a5d9b700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37a80d0c70 0x7f37a8159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a659c700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c5110 0x7f37a81f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 -- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37a80d0c70 msgr2=0x7f37a8159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37a80d0c70 0x7f37a8159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 -- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c5110 msgr2=0x7f37a81f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c5110 0x7f37a81f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 -- 172.21.15.5:0/2138183321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900094a0 con 0x7f37a815b740 2023-10-16T13:48:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f37a6d9d700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 0x7f37a81f2d80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007e40 tx=0x7f37a000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.753+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a000eea0 con 0x7f37a815b740 2023-10-16T13:48:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.754+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a0014420 con 0x7f37a815b740 2023-10-16T13:48:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.754+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a81f64d0 con 0x7f37a815b740 2023-10-16T13:48:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.754+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a00147b0 con 0x7f37a815b740 2023-10-16T13:48:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.754+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a81f7210 con 0x7f37a815b740 2023-10-16T13:48:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.754+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a81f69f0 con 0x7f37a815b740 2023-10-16T13:48:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.755+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f37a0014910 con 0x7f37a815b740 2023-10-16T13:48:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.755+0000 7f379effd700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f378806b260 0x7f378806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.755+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f37a0089fd0 con 0x7f37a815b740 2023-10-16T13:48:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.756+0000 7f37a659c700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f378806b260 0x7f378806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.756+0000 7f37a659c700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f378806b260 0x7f378806d720 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3798000f60 tx=0x7f3798007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:11.760+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37a81f69f0 con 0x7f37a815b740 2023-10-16T13:48:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.046+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f37a81f69f0 con 0x7f37a815b740 2023-10-16T13:48:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.235+0000 7f379effd700 1 -- 172.21.15.5:0/2138183321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v419) v1 ==== 181+0+0 (secure 0 0 0) 0x7f37a81f69f0 con 0x7f37a815b740 2023-10-16T13:48:12.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f378806b260 msgr2=0x7f378806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f378806b260 0x7f378806d720 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3798000f60 tx=0x7f3798007c90 comp rx=0 tx=0).stop 2023-10-16T13:48:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 msgr2=0x7f37a81f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 0x7f37a81f2d80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007e40 tx=0x7f37a000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 shutdown_connections 2023-10-16T13:48:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a815b740 0x7f37a81f2d80 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a80c5110 0x7f37a81f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f378806b260 0x7f378806d720 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 --2- 172.21.15.5:0/2138183321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37a80d0c70 0x7f37a8159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.237+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 >> 172.21.15.5:0/2138183321 conn(0x7f37a80665a0 msgr2=0x7f37a80c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.238+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 shutdown_connections 2023-10-16T13:48:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.238+0000 7f37acea5700 1 -- 172.21.15.5:0/2138183321 wait complete. 2023-10-16T13:48:12.253 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command without subvolume group ... ok 2023-10-16T13:48:12.254 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command without subvolume group 2023-10-16T13:48:12.254 INFO:tasks.cephfs_test_runner:test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:48:12.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.380+0000 7fa84111a700 1 Processor -- start 2023-10-16T13:48:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.380+0000 7fa84111a700 1 -- start start 2023-10-16T13:48:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa84111a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa83c0cd950 0x7fa83c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa84111a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cede0 0x7fa83c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa84111a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa83c06a840 0x7fa83c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa84111a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c1619a0 con 0x7fa83c0cd950 2023-10-16T13:48:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa84111a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c06b1f0 con 0x7fa83c06a840 2023-10-16T13:48:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa84111a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0cf260 con 0x7fa83c0cede0 2023-10-16T13:48:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa83c0cd950 0x7fa83c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa83c0cd950 0x7fa83c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48382/0 (socket says 172.21.15.5:48382) 2023-10-16T13:48:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 -- 172.21.15.5:0/2089736775 learned_addr learned my addr 172.21.15.5:0/2089736775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83a59c700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cede0 0x7fa83c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83b59e700 1 --2- 172.21.15.5:0/2089736775 >> v2:172.21.15.112:3300/0 conn(0x7fa83c06a840 0x7fa83c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 -- 172.21.15.5:0/2089736775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cede0 msgr2=0x7fa83c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cede0 0x7fa83c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 -- 172.21.15.5:0/2089736775 >> v2:172.21.15.112:3300/0 conn(0x7fa83c06a840 msgr2=0x7fa83c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 --2- 172.21.15.5:0/2089736775 >> v2:172.21.15.112:3300/0 conn(0x7fa83c06a840 0x7fa83c06acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 -- 172.21.15.5:0/2089736775 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0b2d60 con 0x7fa83c0cd950 2023-10-16T13:48:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83a59c700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cede0 0x7fa83c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.381+0000 7fa83ad9d700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c0cd950 0x7fa83c15e2f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa83c06ebc0 tx=0x7fa830009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4dac54cba6c51d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa839d9b700 1 -- 172.21.15.5:0/2089736775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000b870 con 0x7fa83c0cd950 2023-10-16T13:48:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa839d9b700 1 -- 172.21.15.5:0/2089736775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000b9d0 con 0x7fa83c0cd950 2023-10-16T13:48:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa839d9b700 1 -- 172.21.15.5:0/2089736775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000bd60 con 0x7fa83c0cd950 2023-10-16T13:48:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 -- 172.21.15.5:0/2089736775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c0cd950 msgr2=0x7fa83c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c0cd950 0x7fa83c15e2f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa83c06ebc0 tx=0x7fa830009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 -- 172.21.15.5:0/2089736775 shutdown_connections 2023-10-16T13:48:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 --2- 172.21.15.5:0/2089736775 >> v2:172.21.15.112:3300/0 conn(0x7fa83c06a840 0x7fa83c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c0cd950 0x7fa83c15e2f0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 --2- 172.21.15.5:0/2089736775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cede0 0x7fa83c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 -- 172.21.15.5:0/2089736775 >> 172.21.15.5:0/2089736775 conn(0x7fa83c06dae0 msgr2=0x7fa83c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 -- 172.21.15.5:0/2089736775 shutdown_connections 2023-10-16T13:48:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.382+0000 7fa84111a700 1 -- 172.21.15.5:0/2089736775 wait complete. 2023-10-16T13:48:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 Processor -- start 2023-10-16T13:48:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 -- start start 2023-10-16T13:48:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 0x7fa83c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cd950 0x7fa83c0aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83c0cede0 0x7fa83c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c154070 con 0x7fa83c06a840 2023-10-16T13:48:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0af090 con 0x7fa83c0cede0 2023-10-16T13:48:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.384+0000 7fa84111a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0ca460 con 0x7fa83c0cd950 2023-10-16T13:48:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 0x7fa83c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 0x7fa83c153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48388/0 (socket says 172.21.15.5:48388) 2023-10-16T13:48:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 -- 172.21.15.5:0/4053262438 learned_addr learned my addr 172.21.15.5:0/4053262438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83a59c700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cd950 0x7fa83c0aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83b59e700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83c0cede0 0x7fa83c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 -- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cd950 msgr2=0x7fa83c0aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cd950 0x7fa83c0aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 -- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83c0cede0 msgr2=0x7fa83c0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83c0cede0 0x7fa83c0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 -- 172.21.15.5:0/4053262438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830009550 con 0x7fa83c06a840 2023-10-16T13:48:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83b59e700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83c0cede0 0x7fa83c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa83ad9d700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 0x7fa83c153b30 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa83c06d4f0 tx=0x7fa830004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830004310 con 0x7fa83c06a840 2023-10-16T13:48:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83001f070 con 0x7fa83c06a840 2023-10-16T13:48:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300036a0 con 0x7fa83c06a840 2023-10-16T13:48:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c0ae070 con 0x7fa83c06a840 2023-10-16T13:48:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.385+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0ae630 con 0x7fa83c06a840 2023-10-16T13:48:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.386+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c0ae850 con 0x7fa83c06a840 2023-10-16T13:48:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.387+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fa830021030 con 0x7fa83c06a840 2023-10-16T13:48:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.387+0000 7fa8237fe700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa82806b260 0x7fa82806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.387+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa83008ad10 con 0x7fa83c06a840 2023-10-16T13:48:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.387+0000 7fa83a59c700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa82806b260 0x7fa82806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.388+0000 7fa83a59c700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa82806b260 0x7fa82806d720 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0c3e10 tx=0x7fa82c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.392+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa830055e60 con 0x7fa83c06a840 2023-10-16T13:48:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.595+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa83c067d20 con 0x7fa83c06a840 2023-10-16T13:48:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.596+0000 7fa8237fe700 1 -- 172.21.15.5:0/4053262438 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+12913 (secure 0 0 0) 0x7fa830015090 con 0x7fa83c06a840 2023-10-16T13:48:12.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:12.599 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":90,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:11.233217+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6834/3043002184":"2023-10-17T13:48:08.221947+0000","172.21.15.5:6832/3043002184":"2023-10-17T13:48:08.221947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:12.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa82806b260 msgr2=0x7fa82806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa82806b260 0x7fa82806d720 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0c3e10 tx=0x7fa82c008040 comp rx=0 tx=0).stop 2023-10-16T13:48:12.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 msgr2=0x7fa83c153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 0x7fa83c153b30 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa83c06d4f0 tx=0x7fa830004750 comp rx=0 tx=0).stop 2023-10-16T13:48:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 shutdown_connections 2023-10-16T13:48:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83c0cede0 0x7fa83c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa83c06a840 0x7fa83c153b30 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa82806b260 0x7fa82806d720 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 --2- 172.21.15.5:0/4053262438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa83c0cd950 0x7fa83c0aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 >> 172.21.15.5:0/4053262438 conn(0x7fa83c06dae0 msgr2=0x7fa83c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 shutdown_connections 2023-10-16T13:48:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.598+0000 7fa84111a700 1 -- 172.21.15.5:0/4053262438 wait complete. 2023-10-16T13:48:12.613 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:12.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:12.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.739+0000 7f8566fac700 1 Processor -- start 2023-10-16T13:48:12.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.739+0000 7f8566fac700 1 -- start start 2023-10-16T13:48:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8566fac700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85600cd950 0x7f856015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8566fac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f856006a840 0x7f856006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8566fac700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600cf290 con 0x7f85600cede0 2023-10-16T13:48:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8566fac700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85601619a0 con 0x7f85600cd950 2023-10-16T13:48:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8566fac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856006b1f0 con 0x7f856006a840 2023-10-16T13:48:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85600cd950 0x7f856015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85600cd950 0x7f856015e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48396/0 (socket says 172.21.15.5:48396) 2023-10-16T13:48:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 -- 172.21.15.5:0/1250764393 learned_addr learned my addr 172.21.15.5:0/1250764393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8565549700 1 --2- 172.21.15.5:0/1250764393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f856006a840 0x7f856006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 -- 172.21.15.5:0/1250764393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f856006a840 msgr2=0x7f856006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 --2- 172.21.15.5:0/1250764393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f856006a840 0x7f856006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 -- 172.21.15.5:0/1250764393 >> v1:172.21.15.112:6789/0 conn(0x7f85600cede0 legacy=0x7f856015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 -- 172.21.15.5:0/1250764393 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600b2d60 con 0x7f85600cd950 2023-10-16T13:48:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.740+0000 7f8564d48700 1 --2- 172.21.15.5:0/1250764393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f856015e2f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f85540098f0 tx=0x7f8554009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c654fde6d55625 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f855f7fe700 1 -- 172.21.15.5:0/1250764393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400b8a0 con 0x7f85600cd950 2023-10-16T13:48:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f855f7fe700 1 -- 172.21.15.5:0/1250764393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400ba00 con 0x7f85600cd950 2023-10-16T13:48:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f855f7fe700 1 -- 172.21.15.5:0/1250764393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400bd90 con 0x7f85600cd950 2023-10-16T13:48:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 -- 172.21.15.5:0/1250764393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 msgr2=0x7f856015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 --2- 172.21.15.5:0/1250764393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f856015e2f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f85540098f0 tx=0x7f8554009c00 comp rx=0 tx=0).stop 2023-10-16T13:48:12.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 -- 172.21.15.5:0/1250764393 shutdown_connections 2023-10-16T13:48:12.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 --2- 172.21.15.5:0/1250764393 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f856006a840 0x7f856006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 --2- 172.21.15.5:0/1250764393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f856015e2f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 -- 172.21.15.5:0/1250764393 >> 172.21.15.5:0/1250764393 conn(0x7f856006dae0 msgr2=0x7f856006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:12.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 -- 172.21.15.5:0/1250764393 shutdown_connections 2023-10-16T13:48:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.741+0000 7f8566fac700 1 -- 172.21.15.5:0/1250764393 wait complete. 2023-10-16T13:48:12.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.742+0000 7f8566fac700 1 Processor -- start 2023-10-16T13:48:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.742+0000 7f8566fac700 1 -- start start 2023-10-16T13:48:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f8566fac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856006a840 0x7f85600b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f8566fac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f85601f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f8566fac700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85600cede0 0x7f85601f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f8566fac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600c8ce0 con 0x7f85600cd950 2023-10-16T13:48:12.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f8566fac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600c8690 con 0x7f856006a840 2023-10-16T13:48:12.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f8566fac700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85601f4060 con 0x7f85600cede0 2023-10-16T13:48:12.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.743+0000 7f855ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f85601f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f85601f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48402/0 (socket says 172.21.15.5:48402) 2023-10-16T13:48:12.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 -- 172.21.15.5:0/3546847391 learned_addr learned my addr 172.21.15.5:0/3546847391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f8564d48700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856006a840 0x7f85600b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f8565549700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85600cede0 0x7f85601f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 -- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85600cede0 msgr2=0x7f85601f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85600cede0 0x7f85601f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 -- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856006a840 msgr2=0x7f85600b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856006a840 0x7f85600b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 -- 172.21.15.5:0/3546847391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009550 con 0x7f85600cd950 2023-10-16T13:48:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855ffff700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f85601f0d40 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f854c00c500 tx=0x7f854c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0052d0 con 0x7f85600cd950 2023-10-16T13:48:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c005430 con 0x7f85600cd950 2023-10-16T13:48:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85600b5d40 con 0x7f85600cd950 2023-10-16T13:48:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0038f0 con 0x7f85600cd950 2023-10-16T13:48:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.744+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85600b6020 con 0x7f85600cd950 2023-10-16T13:48:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.745+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85600c8e20 con 0x7f85600cd950 2023-10-16T13:48:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.746+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f854c003a50 con 0x7f85600cd950 2023-10-16T13:48:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.746+0000 7f855d7fa700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f854406b260 0x7f854406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.746+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f854c088cb0 con 0x7f85600cd950 2023-10-16T13:48:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.747+0000 7f8564d48700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f854406b260 0x7f854406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.747+0000 7f8564d48700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f854406b260 0x7f854406d720 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8554009c40 tx=0x7f8554008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:12.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.751+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85600c8e20 con 0x7f85600cd950 2023-10-16T13:48:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.951+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85600c8e20 con 0x7f85600cd950 2023-10-16T13:48:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.952+0000 7f855d7fa700 1 -- 172.21.15.5:0/3546847391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85600c8e20 con 0x7f85600cd950 2023-10-16T13:48:12.955 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f854406b260 msgr2=0x7f854406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f854406b260 0x7f854406d720 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8554009c40 tx=0x7f8554008030 comp rx=0 tx=0).stop 2023-10-16T13:48:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 msgr2=0x7f85601f0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f85601f0d40 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f854c00c500 tx=0x7f854c00c8c0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 shutdown_connections 2023-10-16T13:48:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f854406b260 0x7f854406d720 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85600cede0 0x7f85601f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f856006a840 0x7f85600b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 --2- 172.21.15.5:0/3546847391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85600cd950 0x7f85601f0d40 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 >> 172.21.15.5:0/3546847391 conn(0x7f856006dae0 msgr2=0x7f85600aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 shutdown_connections 2023-10-16T13:48:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:12.954+0000 7f8566fac700 1 -- 172.21.15.5:0/3546847391 wait complete. 2023-10-16T13:48:12.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-16T13:48:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.092+0000 7f629efc0700 1 Processor -- start 2023-10-16T13:48:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629efc0700 1 -- start start 2023-10-16T13:48:13.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629efc0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f629815ab10 0x7f629815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629efc0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f62980b1f50 0x7f62980cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629efc0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629815e7a0 con 0x7f62980b2400 2023-10-16T13:48:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629efc0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629815f730 con 0x7f629815ab10 2023-10-16T13:48:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629efc0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980b29a0 con 0x7f62980b1f50 2023-10-16T13:48:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.093+0000 7f629cd5c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f629815ab10 0x7f629815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f629815ab10 0x7f629815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48408/0 (socket says 172.21.15.5:48408) 2023-10-16T13:48:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 -- 172.21.15.5:0/3335554495 learned_addr learned my addr 172.21.15.5:0/3335554495 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f6297fff700 1 --2- 172.21.15.5:0/3335554495 >> v2:172.21.15.112:3300/0 conn(0x7f62980b1f50 0x7f62980cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 -- 172.21.15.5:0/3335554495 >> v2:172.21.15.112:3300/0 conn(0x7f62980b1f50 msgr2=0x7f62980cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 --2- 172.21.15.5:0/3335554495 >> v2:172.21.15.112:3300/0 conn(0x7f62980b1f50 0x7f62980cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 -- 172.21.15.5:0/3335554495 >> v1:172.21.15.112:6789/0 conn(0x7f62980b2400 legacy=0x7f62980cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 -- 172.21.15.5:0/3335554495 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980b2c80 con 0x7f629815ab10 2023-10-16T13:48:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f629cd5c700 1 --2- 172.21.15.5:0/3335554495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f629815f1f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f629806d470 tx=0x7f628c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc4c5e14c24fe77 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f62977fe700 1 -- 172.21.15.5:0/3335554495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c004230 con 0x7f629815ab10 2023-10-16T13:48:13.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f62977fe700 1 -- 172.21.15.5:0/3335554495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c004390 con 0x7f629815ab10 2023-10-16T13:48:13.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.094+0000 7f62977fe700 1 -- 172.21.15.5:0/3335554495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0036a0 con 0x7f629815ab10 2023-10-16T13:48:13.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 -- 172.21.15.5:0/3335554495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 msgr2=0x7f629815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:13.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 --2- 172.21.15.5:0/3335554495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f629815f1f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f629806d470 tx=0x7f628c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 -- 172.21.15.5:0/3335554495 shutdown_connections 2023-10-16T13:48:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 --2- 172.21.15.5:0/3335554495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f629815f1f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 --2- 172.21.15.5:0/3335554495 >> v2:172.21.15.112:3300/0 conn(0x7f62980b1f50 0x7f62980cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 -- 172.21.15.5:0/3335554495 >> 172.21.15.5:0/3335554495 conn(0x7f629806dae0 msgr2=0x7f629806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 -- 172.21.15.5:0/3335554495 shutdown_connections 2023-10-16T13:48:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.095+0000 7f629efc0700 1 -- 172.21.15.5:0/3335554495 wait complete. 2023-10-16T13:48:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.096+0000 7f629efc0700 1 Processor -- start 2023-10-16T13:48:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.096+0000 7f629efc0700 1 -- start start 2023-10-16T13:48:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629efc0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62980b1f50 0x7f629815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629efc0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62980b2400 0x7f62981f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629efc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f62980c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629efc0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62980c88c0 con 0x7f629815ab10 2023-10-16T13:48:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629efc0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62980c7ae0 con 0x7f62980b1f50 2023-10-16T13:48:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629efc0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62980c7d40 con 0x7f62980b2400 2023-10-16T13:48:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f62980c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f62980c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48418/0 (socket says 172.21.15.5:48418) 2023-10-16T13:48:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 -- 172.21.15.5:0/2872287567 learned_addr learned my addr 172.21.15.5:0/2872287567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629cd5c700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62980b1f50 0x7f629815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f6297fff700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62980b2400 0x7f62981f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 -- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62980b2400 msgr2=0x7f62981f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62980b2400 0x7f62981f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 -- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62980b1f50 msgr2=0x7f629815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62980b1f50 0x7f629815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 -- 172.21.15.5:0/2872287567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c009550 con 0x7f629815ab10 2023-10-16T13:48:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.097+0000 7f629d55d700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f62980c75a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f629000b990 tx=0x7f629000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.098+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000d890 con 0x7f629815ab10 2023-10-16T13:48:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.098+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000d9f0 con 0x7f629815ab10 2023-10-16T13:48:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.098+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62980c8020 con 0x7f629815ab10 2023-10-16T13:48:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.098+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000dda0 con 0x7f629815ab10 2023-10-16T13:48:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.098+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62980c85e0 con 0x7f629815ab10 2023-10-16T13:48:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.099+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629815af80 con 0x7f629815ab10 2023-10-16T13:48:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.099+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f6290006d50 con 0x7f629815ab10 2023-10-16T13:48:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.100+0000 7f62957fa700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f627c06b290 0x7f627c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.100+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6290089880 con 0x7f629815ab10 2023-10-16T13:48:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.100+0000 7f629cd5c700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f627c06b290 0x7f627c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.101+0000 7f629cd5c700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f627c06b290 0x7f627c06d750 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f628c009130 tx=0x7f628c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.105+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f629815af80 con 0x7f629815ab10 2023-10-16T13:48:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:13.388+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f629815af80 con 0x7f629815ab10 2023-10-16T13:48:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.241+0000 7f62957fa700 1 -- 172.21.15.5:0/2872287567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v421) v1 ==== 159+0+0 (secure 0 0 0) 0x7f629815af80 con 0x7f629815ab10 2023-10-16T13:48:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f627c06b290 msgr2=0x7f627c06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f627c06b290 0x7f627c06d750 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f628c009130 tx=0x7f628c008030 comp rx=0 tx=0).stop 2023-10-16T13:48:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 msgr2=0x7f62980c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f62980c75a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f629000b990 tx=0x7f629000bca0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 shutdown_connections 2023-10-16T13:48:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629815ab10 0x7f62980c75a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62980b1f50 0x7f629815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f627c06b290 0x7f627c06d750 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 --2- 172.21.15.5:0/2872287567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62980b2400 0x7f62981f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.244+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 >> 172.21.15.5:0/2872287567 conn(0x7f629806dae0 msgr2=0x7f629806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.245+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 shutdown_connections 2023-10-16T13:48:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.245+0000 7f629efc0700 1 -- 172.21.15.5:0/2872287567 wait complete. 2023-10-16T13:48:14.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:48:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.395+0000 7fdcdbadf700 1 Processor -- start 2023-10-16T13:48:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.395+0000 7fdcdbadf700 1 -- start start 2023-10-16T13:48:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcdbadf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcd40cd950 0x7fdcd415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcdbadf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcd40cede0 0x7fdcd415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcdbadf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd406a840 0x7fdcd406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcdbadf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd41619a0 con 0x7fdcd40cd950 2023-10-16T13:48:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcdbadf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd406b1f0 con 0x7fdcd40cede0 2023-10-16T13:48:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcdbadf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40cf290 con 0x7fdcd406a840 2023-10-16T13:48:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcd40cd950 0x7fdcd415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcd40cd950 0x7fdcd415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48422/0 (socket says 172.21.15.5:48422) 2023-10-16T13:48:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 -- 172.21.15.5:0/1983291156 learned_addr learned my addr 172.21.15.5:0/1983291156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd907a700 1 --2- 172.21.15.5:0/1983291156 >> v2:172.21.15.112:3300/0 conn(0x7fdcd40cede0 0x7fdcd415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcda07c700 1 --2- 172.21.15.5:0/1983291156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd406a840 0x7fdcd406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 -- 172.21.15.5:0/1983291156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd406a840 msgr2=0x7fdcd406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 --2- 172.21.15.5:0/1983291156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd406a840 0x7fdcd406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 -- 172.21.15.5:0/1983291156 >> v2:172.21.15.112:3300/0 conn(0x7fdcd40cede0 msgr2=0x7fdcd415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 --2- 172.21.15.5:0/1983291156 >> v2:172.21.15.112:3300/0 conn(0x7fdcd40cede0 0x7fdcd415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 -- 172.21.15.5:0/1983291156 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40b2d60 con 0x7fdcd40cd950 2023-10-16T13:48:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd907a700 1 --2- 172.21.15.5:0/1983291156 >> v2:172.21.15.112:3300/0 conn(0x7fdcd40cede0 0x7fdcd415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.396+0000 7fdcd987b700 1 --2- 172.21.15.5:0/1983291156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd40cd950 0x7fdcd415e2f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdcd406b690 tx=0x7fdcd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d27c9f0ca0c278 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcd8879700 1 -- 172.21.15.5:0/1983291156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000b870 con 0x7fdcd40cd950 2023-10-16T13:48:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcd8879700 1 -- 172.21.15.5:0/1983291156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000b9d0 con 0x7fdcd40cd950 2023-10-16T13:48:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcd8879700 1 -- 172.21.15.5:0/1983291156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000bd60 con 0x7fdcd40cd950 2023-10-16T13:48:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 -- 172.21.15.5:0/1983291156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd40cd950 msgr2=0x7fdcd415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/1983291156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd40cd950 0x7fdcd415e2f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdcd406b690 tx=0x7fdcd0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 -- 172.21.15.5:0/1983291156 shutdown_connections 2023-10-16T13:48:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/1983291156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd406a840 0x7fdcd406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/1983291156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd40cd950 0x7fdcd415e2f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/1983291156 >> v2:172.21.15.112:3300/0 conn(0x7fdcd40cede0 0x7fdcd415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 -- 172.21.15.5:0/1983291156 >> 172.21.15.5:0/1983291156 conn(0x7fdcd406dae0 msgr2=0x7fdcd406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 -- 172.21.15.5:0/1983291156 shutdown_connections 2023-10-16T13:48:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.397+0000 7fdcdbadf700 1 -- 172.21.15.5:0/1983291156 wait complete. 2023-10-16T13:48:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.398+0000 7fdcdbadf700 1 Processor -- start 2023-10-16T13:48:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.398+0000 7fdcdbadf700 1 -- start start 2023-10-16T13:48:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcdbadf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 0x7fdcd40c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcdbadf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd40cd950 0x7fdcd415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcdbadf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd40cede0 0x7fdcd414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcdbadf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40ca490 con 0x7fdcd406a840 2023-10-16T13:48:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcdbadf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40c4480 con 0x7fdcd40cede0 2023-10-16T13:48:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcdbadf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40c9ed0 con 0x7fdcd40cd950 2023-10-16T13:48:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 0x7fdcd40c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 0x7fdcd40c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48426/0 (socket says 172.21.15.5:48426) 2023-10-16T13:48:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 -- 172.21.15.5:0/863949795 learned_addr learned my addr 172.21.15.5:0/863949795 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcda07c700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd40cede0 0x7fdcd414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd907a700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd40cd950 0x7fdcd415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 -- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd40cd950 msgr2=0x7fdcd415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd40cd950 0x7fdcd415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 -- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd40cede0 msgr2=0x7fdcd414a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd40cede0 0x7fdcd414a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd987b700 1 -- 172.21.15.5:0/863949795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009550 con 0x7fdcd406a840 2023-10-16T13:48:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcda07c700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd40cede0 0x7fdcd414a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.399+0000 7fdcd907a700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd40cd950 0x7fdcd415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.400+0000 7fdcd987b700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 0x7fdcd40c95f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009fd0 tx=0x7fdcd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.400+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0004310 con 0x7fdcd406a840 2023-10-16T13:48:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.400+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd001f070 con 0x7fdcd406a840 2023-10-16T13:48:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.400+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40ca1b0 con 0x7fdcd406a840 2023-10-16T13:48:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.400+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00036a0 con 0x7fdcd406a840 2023-10-16T13:48:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.400+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd40c9b30 con 0x7fdcd406a840 2023-10-16T13:48:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.401+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4067d20 con 0x7fdcd406a840 2023-10-16T13:48:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.401+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fdcd0021030 con 0x7fdcd406a840 2023-10-16T13:48:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.402+0000 7fdcca7fc700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcb806b260 0x7fdcb806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.402+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcd008ad40 con 0x7fdcd406a840 2023-10-16T13:48:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.402+0000 7fdcd907a700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcb806b260 0x7fdcb806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.403+0000 7fdcd907a700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcb806b260 0x7fdcb806d720 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4006fd0 tx=0x7fdcc4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.407+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcd0055e90 con 0x7fdcd406a840 2023-10-16T13:48:14.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.608+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdcd40b2630 con 0x7fdcd406a840 2023-10-16T13:48:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.611+0000 7fdcca7fc700 1 -- 172.21.15.5:0/863949795 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdcd00150c0 con 0x7fdcd406a840 2023-10-16T13:48:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcb806b260 msgr2=0x7fdcb806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcb806b260 0x7fdcb806d720 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4006fd0 tx=0x7fdcc4008040 comp rx=0 tx=0).stop 2023-10-16T13:48:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 msgr2=0x7fdcd40c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 0x7fdcd40c95f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009fd0 tx=0x7fdcd0004750 comp rx=0 tx=0).stop 2023-10-16T13:48:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 shutdown_connections 2023-10-16T13:48:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd40cede0 0x7fdcd414a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcd406a840 0x7fdcd40c95f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcb806b260 0x7fdcb806d720 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 --2- 172.21.15.5:0/863949795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdcd40cd950 0x7fdcd415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 >> 172.21.15.5:0/863949795 conn(0x7fdcd406dae0 msgr2=0x7fdcd406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 shutdown_connections 2023-10-16T13:48:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.613+0000 7fdcdbadf700 1 -- 172.21.15.5:0/863949795 wait complete. 2023-10-16T13:48:14.628 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:48:14.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:14.675 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:14.725 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:48:14.725 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:14.726 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:14.744 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:48:14.744 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:14.744 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:14.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:48:14.764 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:14.764 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:14.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:48:14.801 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:14.801 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:14.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:48:14.823 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:48:14.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.962+0000 7f4d59956700 1 Processor -- start 2023-10-16T13:48:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.962+0000 7f4d59956700 1 -- start start 2023-10-16T13:48:14.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d59956700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d5415dbc0 0x7f4d5415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d59956700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d540d3fc0 0x7f4d540d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d59956700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415e4e0 con 0x7f4d540b7050 2023-10-16T13:48:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d59956700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540b7560 con 0x7f4d5415dbc0 2023-10-16T13:48:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d59956700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540b7840 con 0x7f4d540d3fc0 2023-10-16T13:48:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d52ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d5415dbc0 0x7f4d5415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d537fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4d540b7050 0x7f4d540d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58442/0 (socket says 172.21.15.5:58442) 2023-10-16T13:48:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d537fe700 1 -- 172.21.15.5:0/3877902621 learned_addr learned my addr 172.21.15.5:0/3877902621 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d527fc700 1 --2- 172.21.15.5:0/3877902621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d540d3fc0 0x7f4d540d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d52ffd700 1 -- 172.21.15.5:0/3877902621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d540d3fc0 msgr2=0x7f4d540d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d52ffd700 1 --2- 172.21.15.5:0/3877902621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d540d3fc0 0x7f4d540d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d52ffd700 1 -- 172.21.15.5:0/3877902621 >> v1:172.21.15.5:6789/0 conn(0x7f4d540b7050 legacy=0x7f4d540d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d52ffd700 1 -- 172.21.15.5:0/3877902621 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540b7b20 con 0x7f4d5415dbc0 2023-10-16T13:48:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d51ffb700 1 -- 172.21.15.5:0/3877902621 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897091687 0 0) 0x7f4d5415e4e0 con 0x7f4d540b7050 2023-10-16T13:48:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.963+0000 7f4d52ffd700 1 --2- 172.21.15.5:0/3877902621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5415dbc0 0x7f4d5415dfa0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009820 tx=0x7f4d48009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3387569b29c36d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d51ffb700 1 -- 172.21.15.5:0/3877902621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48005e30 con 0x7f4d5415dbc0 2023-10-16T13:48:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d51ffb700 1 -- 172.21.15.5:0/3877902621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48006030 con 0x7f4d5415dbc0 2023-10-16T13:48:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d51ffb700 1 -- 172.21.15.5:0/3877902621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480063c0 con 0x7f4d5415dbc0 2023-10-16T13:48:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 -- 172.21.15.5:0/3877902621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5415dbc0 msgr2=0x7f4d5415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 --2- 172.21.15.5:0/3877902621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5415dbc0 0x7f4d5415dfa0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009820 tx=0x7f4d48009b30 comp rx=0 tx=0).stop 2023-10-16T13:48:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 -- 172.21.15.5:0/3877902621 shutdown_connections 2023-10-16T13:48:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 --2- 172.21.15.5:0/3877902621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d5415dbc0 0x7f4d5415dfa0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 --2- 172.21.15.5:0/3877902621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d540d3fc0 0x7f4d540d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 -- 172.21.15.5:0/3877902621 >> 172.21.15.5:0/3877902621 conn(0x7f4d5409cb40 msgr2=0x7f4d540d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 -- 172.21.15.5:0/3877902621 shutdown_connections 2023-10-16T13:48:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.964+0000 7f4d59956700 1 -- 172.21.15.5:0/3877902621 wait complete. 2023-10-16T13:48:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.965+0000 7f4d59956700 1 Processor -- start 2023-10-16T13:48:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 -- start start 2023-10-16T13:48:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 0x7f4d54150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d540d3fc0 0x7f4d54151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d5415dbc0 0x7f4d54154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541e6570 con 0x7f4d540b7050 2023-10-16T13:48:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541e73d0 con 0x7f4d540d3fc0 2023-10-16T13:48:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d59956700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541e7860 con 0x7f4d5415dbc0 2023-10-16T13:48:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d52ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 0x7f4d54150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d52ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 0x7f4d54150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48440/0 (socket says 172.21.15.5:48440) 2023-10-16T13:48:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.966+0000 7f4d52ffd700 1 -- 172.21.15.5:0/723328872 learned_addr learned my addr 172.21.15.5:0/723328872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d527fc700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d540d3fc0 0x7f4d54151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d537fe700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d5415dbc0 0x7f4d54154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d52ffd700 1 -- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d5415dbc0 msgr2=0x7f4d54154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d52ffd700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d5415dbc0 0x7f4d54154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d52ffd700 1 -- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d540d3fc0 msgr2=0x7f4d54151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d52ffd700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d540d3fc0 0x7f4d54151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d52ffd700 1 -- 172.21.15.5:0/723328872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d48009430 con 0x7f4d540b7050 2023-10-16T13:48:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d527fc700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d540d3fc0 0x7f4d54151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d52ffd700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 0x7f4d54150d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4d5406b4b0 tx=0x7f4d48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480063a0 con 0x7f4d540b7050 2023-10-16T13:48:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48020070 con 0x7f4d540b7050 2023-10-16T13:48:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d541512d0 con 0x7f4d540b7050 2023-10-16T13:48:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48006740 con 0x7f4d540b7050 2023-10-16T13:48:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.967+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541e67c0 con 0x7f4d540b7050 2023-10-16T13:48:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.968+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5404ebb0 con 0x7f4d540b7050 2023-10-16T13:48:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.968+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f4d48022030 con 0x7f4d540b7050 2023-10-16T13:48:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.969+0000 7f4d3bfff700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d4006b260 0x7f4d4006d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.969+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4d4808ad50 con 0x7f4d540b7050 2023-10-16T13:48:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.969+0000 7f4d527fc700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d4006b260 0x7f4d4006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.970+0000 7f4d527fc700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d4006b260 0x7f4d4006d720 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4d540a1680 tx=0x7f4d44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:14.974+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d48055d80 con 0x7f4d540b7050 2023-10-16T13:48:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.221+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5415d350 con 0x7f4d540b7050 2023-10-16T13:48:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.221+0000 7f4d3bfff700 1 -- 172.21.15.5:0/723328872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f4d480068a0 con 0x7f4d540b7050 2023-10-16T13:48:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:15.225 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/24607632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":24607632},{"type":"v1","addr":"172.21.15.112:6836","nonce":24607632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":5921,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3273506328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3273506328},{"type":"v1","addr":"172.21.15.112:6837","nonce":3273506328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3970932938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3970932938},{"type":"v1","addr":"172.21.15.5:6835","nonce":3970932938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2046878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2046878702},{"type":"v1","addr":"172.21.15.5:6834","nonce":2046878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[]} 2023-10-16T13:48:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.223+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d4006b260 msgr2=0x7f4d4006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.223+0000 7f4d59956700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d4006b260 0x7f4d4006d720 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4d540a1680 tx=0x7f4d44008040 comp rx=0 tx=0).stop 2023-10-16T13:48:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.223+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 msgr2=0x7f4d54150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.223+0000 7f4d59956700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 0x7f4d54150d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4d5406b4b0 tx=0x7f4d48004750 comp rx=0 tx=0).stop 2023-10-16T13:48:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 shutdown_connections 2023-10-16T13:48:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4d4006b260 0x7f4d4006d720 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d5415dbc0 0x7f4d54154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d540b7050 0x7f4d54150d90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 --2- 172.21.15.5:0/723328872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d540d3fc0 0x7f4d54151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 >> 172.21.15.5:0/723328872 conn(0x7f4d5409cb40 msgr2=0x7f4d54156020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 shutdown_connections 2023-10-16T13:48:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.224+0000 7f4d59956700 1 -- 172.21.15.5:0/723328872 wait complete. 2023-10-16T13:48:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2023-10-16T13:48:15.239 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:48:15.239 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:48:15.240 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:48:15.240 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:15.240 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:48:15.240 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:48:15.241 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:48:15.241 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:15.241 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:48:15.241 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:48:15.242 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:48:15.242 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:15.242 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:48:15.243 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:48:15.243 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:48:15.243 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:15.248 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:48:15.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:48:15.250 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:48:15.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:48:15.253 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:48:15.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:48:15.254 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:48:15.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:48:15.292 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:48:15.293 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:15.294 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:48:15.294 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:15.296 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:48:15.297 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:15.298 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:48:15.298 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:15.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:48:15.375 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:48:15.375 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:48:15.381 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:48:15.382 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:48:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.429+0000 7fb4f1f48700 1 Processor -- start 2023-10-16T13:48:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.429+0000 7fb4f1f48700 1 -- start start 2023-10-16T13:48:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.430+0000 7fb4f1f48700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb4ec15bbc0 0x7fb4ec0d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.430+0000 7fb4f1f48700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.430+0000 7fb4f1f48700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec0cce60 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.430+0000 7fb4f1f48700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec0cd4e0 con 0x7fb4ec15bbc0 2023-10-16T13:48:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.430+0000 7fb4f1f48700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0b2ba0 con 0x7fb4ec0ce4c0 2023-10-16T13:48:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eb7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb4ec15bbc0 0x7fb4ec0d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eaffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb4ec15bfa0 0x7fb4ec0cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:49452/0 (socket says 172.21.15.5:49452) 2023-10-16T13:48:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eaffd700 1 -- 172.21.15.5:0/170380289 learned_addr learned my addr 172.21.15.5:0/170380289 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eb7fe700 1 -- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 msgr2=0x7fb4ec0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eb7fe700 1 --2- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eb7fe700 1 -- 172.21.15.5:0/170380289 >> v1:172.21.15.112:6789/0 conn(0x7fb4ec15bfa0 legacy=0x7fb4ec0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eb7fe700 1 -- 172.21.15.5:0/170380289 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0cd100 con 0x7fb4ec15bbc0 2023-10-16T13:48:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4ea7fc700 1 -- 172.21.15.5:0/170380289 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104002599 0 0) 0x7fb4ec0cce60 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4ebfff700 1 --2- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4eb7fe700 1 --2- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec0d20e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009840 tx=0x7fb4dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce86953291439e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4ea7fc700 1 -- 172.21.15.5:0/170380289 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc011830 con 0x7fb4ec15bbc0 2023-10-16T13:48:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4ea7fc700 1 -- 172.21.15.5:0/170380289 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc011990 con 0x7fb4ec15bbc0 2023-10-16T13:48:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.431+0000 7fb4ea7fc700 1 -- 172.21.15.5:0/170380289 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc011d20 con 0x7fb4ec15bbc0 2023-10-16T13:48:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 -- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 msgr2=0x7fb4ec0d20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec0d20e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009840 tx=0x7fb4dc009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 -- 172.21.15.5:0/170380289 shutdown_connections 2023-10-16T13:48:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec0d20e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/170380289 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 -- 172.21.15.5:0/170380289 >> 172.21.15.5:0/170380289 conn(0x7fb4ec0d15f0 msgr2=0x7fb4ec0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 -- 172.21.15.5:0/170380289 shutdown_connections 2023-10-16T13:48:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.432+0000 7fb4f1f48700 1 -- 172.21.15.5:0/170380289 wait complete. 2023-10-16T13:48:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.433+0000 7fb4f1f48700 1 Processor -- start 2023-10-16T13:48:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.433+0000 7fb4f1f48700 1 -- start start 2023-10-16T13:48:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4f1f48700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec1e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4f1f48700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4f1f48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 0x7fb4ec158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4f1f48700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1f4600 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4f1f48700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1f48a0 con 0x7fb4ec15bbc0 2023-10-16T13:48:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4f1f48700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1f4b80 con 0x7fb4ec0ce4c0 2023-10-16T13:48:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 0x7fb4ec158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 0x7fb4ec158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48480/0 (socket says 172.21.15.5:48480) 2023-10-16T13:48:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4ebfff700 1 -- 172.21.15.5:0/3504469854 learned_addr learned my addr 172.21.15.5:0/3504469854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4eaffd700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.434+0000 7fb4eb7fe700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec1e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4ebfff700 1 -- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 msgr2=0x7fb4ec1e45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4ebfff700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec1e45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4ebfff700 1 -- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 msgr2=0x7fb4ec156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4ebfff700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4ebfff700 1 -- 172.21.15.5:0/3504469854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009a70 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4ebfff700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 0x7fb4ec158dc0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400efc0 tx=0x7fb4e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400ca90 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400f040 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400ce10 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc0094a0 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.435+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec1f5140 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.436+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec06dfb0 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.436+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fb4e4014480 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.437+0000 7fb4d3fff700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b260 0x7fb4d806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.437+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb4e408a030 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.437+0000 7fb4eb7fe700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b260 0x7fb4d806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.438+0000 7fb4eb7fe700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b260 0x7fb4d806d720 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009fd0 tx=0x7fb4dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.442+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4e40bcca0 con 0x7fb4ec15bfa0 2023-10-16T13:48:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:15.659+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb4ec067d20 con 0x7fb4ec15bfa0 2023-10-16T13:48:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.252+0000 7fb4d3fff700 1 -- 172.21.15.5:0/3504469854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb4e4058890 con 0x7fb4ec15bfa0 2023-10-16T13:48:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b260 msgr2=0x7fb4d806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b260 0x7fb4d806d720 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009fd0 tx=0x7fb4dc008030 comp rx=0 tx=0).stop 2023-10-16T13:48:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 msgr2=0x7fb4ec158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 0x7fb4ec158dc0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400efc0 tx=0x7fb4e400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 shutdown_connections 2023-10-16T13:48:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4ec15bfa0 0x7fb4ec158dc0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b260 0x7fb4d806d720 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4ec0ce4c0 0x7fb4ec1e45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 --2- 172.21.15.5:0/3504469854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4ec15bbc0 0x7fb4ec156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 >> 172.21.15.5:0/3504469854 conn(0x7fb4ec0d15f0 msgr2=0x7fb4ec0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 shutdown_connections 2023-10-16T13:48:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.256+0000 7fb4f1f48700 1 -- 172.21.15.5:0/3504469854 wait complete. 2023-10-16T13:48:16.263 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:48:16.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:48:16.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.406+0000 7fe65fa5b700 1 Processor -- start 2023-10-16T13:48:16.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.407+0000 7fe65fa5b700 1 -- start start 2023-10-16T13:48:16.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.407+0000 7fe65fa5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe658160e30 0x7fe6580d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.407+0000 7fe65fa5b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6580d08a0 0x7fe6580ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.407+0000 7fe65fa5b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6580b6610 con 0x7fe658161210 2023-10-16T13:48:16.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.407+0000 7fe65fa5b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580d1da0 con 0x7fe6580d08a0 2023-10-16T13:48:16.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.407+0000 7fe65fa5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580d2080 con 0x7fe658160e30 2023-10-16T13:48:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65cff6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe658161210 0x7fe6580d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58488/0 (socket says 172.21.15.5:58488) 2023-10-16T13:48:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65cff6700 1 -- 172.21.15.5:0/313657135 learned_addr learned my addr 172.21.15.5:0/313657135 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65dff8700 1 --2- 172.21.15.5:0/313657135 >> v2:172.21.15.5:3300/0 conn(0x7fe6580d08a0 0x7fe6580ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65d7f7700 1 --2- 172.21.15.5:0/313657135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe658160e30 0x7fe6580d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65dff8700 1 -- 172.21.15.5:0/313657135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe658160e30 msgr2=0x7fe6580d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65dff8700 1 --2- 172.21.15.5:0/313657135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe658160e30 0x7fe6580d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65dff8700 1 -- 172.21.15.5:0/313657135 >> v1:172.21.15.5:6789/0 conn(0x7fe658161210 legacy=0x7fe6580d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65dff8700 1 -- 172.21.15.5:0/313657135 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580d2360 con 0x7fe6580d08a0 2023-10-16T13:48:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe65dff8700 1 --2- 172.21.15.5:0/313657135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6580d08a0 0x7fe6580ce3d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe650009d90 tx=0x7fe65000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb01cadb7955c2f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe64ffff700 1 -- 172.21.15.5:0/313657135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000e070 con 0x7fe6580d08a0 2023-10-16T13:48:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe64ffff700 1 -- 172.21.15.5:0/313657135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65000bbd0 con 0x7fe6580d08a0 2023-10-16T13:48:16.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.408+0000 7fe64ffff700 1 -- 172.21.15.5:0/313657135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650012430 con 0x7fe6580d08a0 2023-10-16T13:48:16.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 -- 172.21.15.5:0/313657135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6580d08a0 msgr2=0x7fe6580ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/313657135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6580d08a0 0x7fe6580ce3d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe650009d90 tx=0x7fe65000b330 comp rx=0 tx=0).stop 2023-10-16T13:48:16.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 -- 172.21.15.5:0/313657135 shutdown_connections 2023-10-16T13:48:16.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/313657135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6580d08a0 0x7fe6580ce3d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/313657135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe658160e30 0x7fe6580d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 -- 172.21.15.5:0/313657135 >> 172.21.15.5:0/313657135 conn(0x7fe65809cb40 msgr2=0x7fe6580d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:16.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 -- 172.21.15.5:0/313657135 shutdown_connections 2023-10-16T13:48:16.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.409+0000 7fe65fa5b700 1 -- 172.21.15.5:0/313657135 wait complete. 2023-10-16T13:48:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.410+0000 7fe65fa5b700 1 Processor -- start 2023-10-16T13:48:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.410+0000 7fe65fa5b700 1 -- start start 2023-10-16T13:48:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65fa5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6580d08a0 0x7fe65814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65fa5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 0x7fe6580ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65fa5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe658161210 0x7fe6580cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65fa5b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65815b430 con 0x7fe658160e30 2023-10-16T13:48:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65fa5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580c8c70 con 0x7fe658161210 2023-10-16T13:48:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65fa5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580cc1c0 con 0x7fe6580d08a0 2023-10-16T13:48:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 0x7fe6580ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 0x7fe6580ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48492/0 (socket says 172.21.15.5:48492) 2023-10-16T13:48:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 -- 172.21.15.5:0/3709943038 learned_addr learned my addr 172.21.15.5:0/3709943038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65d7f7700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6580d08a0 0x7fe65814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65dff8700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe658161210 0x7fe6580cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 -- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6580d08a0 msgr2=0x7fe65814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6580d08a0 0x7fe65814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 -- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe658161210 msgr2=0x7fe6580cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe658161210 0x7fe6580cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 -- 172.21.15.5:0/3709943038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe650009a70 con 0x7fe658160e30 2023-10-16T13:48:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65dff8700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe658161210 0x7fe6580cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65d7f7700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6580d08a0 0x7fe65814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe65cff6700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 0x7fe6580ccf80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fe64800c480 tx=0x7fe64800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.411+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648005d70 con 0x7fe658160e30 2023-10-16T13:48:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.412+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480070d0 con 0x7fe658160e30 2023-10-16T13:48:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.412+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6580cc4a0 con 0x7fe658160e30 2023-10-16T13:48:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.412+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648007440 con 0x7fe658160e30 2023-10-16T13:48:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.412+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6580cca60 con 0x7fe658160e30 2023-10-16T13:48:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.413+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6580ccc50 con 0x7fe658160e30 2023-10-16T13:48:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.413+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fe6480075a0 con 0x7fe658160e30 2023-10-16T13:48:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.413+0000 7fe64dffb700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe63c06b260 0x7fe63c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.414+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe648088d00 con 0x7fe658160e30 2023-10-16T13:48:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.414+0000 7fe65d7f7700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe63c06b260 0x7fe63c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.414+0000 7fe65d7f7700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe63c06b260 0x7fe63c06d720 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe654009a00 tx=0x7fe654008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.418+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe648053cf0 con 0x7fe658160e30 2023-10-16T13:48:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.698+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe658067d20 con 0x7fe658160e30 2023-10-16T13:48:16.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.699+0000 7fe64dffb700 1 -- 172.21.15.5:0/3709943038 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe648017090 con 0x7fe658160e30 2023-10-16T13:48:16.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:16.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:48:16.703 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:48:16.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.703 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:48:16.703 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:48:16.703 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:16.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:16.704 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.705 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:48:16.705 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:48:16.705 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:16.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:16.706 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.707 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:48:16.707 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:48:16.707 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:16.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:16.708 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.709 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:48:16.709 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:48:16.709 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.709 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:16.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:16.710 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.711 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:48:16.711 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:48:16.711 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.712 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.712 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.712 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:48:16.713 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:48:16.713 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.713 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.713 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.713 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.714 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:48:16.714 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:48:16.714 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.715 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.716 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:48:16.716 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:48:16.716 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.718 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:48:16.718 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:48:16.718 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.718 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.718 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.719 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.719 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:48:16.719 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:48:16.720 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.720 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.721 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:48:16.721 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:48:16.721 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.722 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.722 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:48:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:48:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.724 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:48:16.724 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:48:16.724 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.725 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.725 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:48:16.725 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:48:16.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.726 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:48:16.726 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:48:16.726 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.726 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.726 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:48:16.727 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:48:16.727 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:48:16.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.727 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:48:16.728 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:48:16.728 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.728 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.728 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:48:16.728 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:48:16.729 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:48:16.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.729 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:48:16.729 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:48:16.730 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.730 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:16.730 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:48:16.730 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:48:16.731 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:48:16.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.731 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:48:16.731 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:48:16.732 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.732 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:48:16.732 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:16.732 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:16.732 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.733 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:48:16.733 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:48:16.733 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.733 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:48:16.734 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:48:16.734 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:16.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:16.735 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:48:16.735 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:48:16.735 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:16.735 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:48:16.735 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:48:16.735 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:16.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:16.736 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:48:16.736 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:48:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe63c06b260 msgr2=0x7fe63c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe63c06b260 0x7fe63c06d720 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe654009a00 tx=0x7fe654008040 comp rx=0 tx=0).stop 2023-10-16T13:48:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 msgr2=0x7fe6580ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 0x7fe6580ccf80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fe64800c480 tx=0x7fe64800c840 comp rx=0 tx=0).stop 2023-10-16T13:48:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 shutdown_connections 2023-10-16T13:48:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe658161210 0x7fe6580cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe63c06b260 0x7fe63c06d720 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6580d08a0 0x7fe65814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 --2- 172.21.15.5:0/3709943038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe658160e30 0x7fe6580ccf80 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 >> 172.21.15.5:0/3709943038 conn(0x7fe65809cb40 msgr2=0x7fe658160080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 shutdown_connections 2023-10-16T13:48:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.701+0000 7fe65fa5b700 1 -- 172.21.15.5:0/3709943038 wait complete. 2023-10-16T13:48:16.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.863+0000 7f101597b700 1 Processor -- start 2023-10-16T13:48:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.863+0000 7f101597b700 1 -- start start 2023-10-16T13:48:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f101597b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10100b7050 0x7f101015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f101597b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101015e4e0 con 0x7f101015dbc0 2023-10-16T13:48:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f101597b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100d28e0 con 0x7f10100d3fc0 2023-10-16T13:48:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f101597b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100b7560 con 0x7f10100b7050 2023-10-16T13:48:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10100b7050 0x7f101015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10100b7050 0x7f101015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48502/0 (socket says 172.21.15.5:48502) 2023-10-16T13:48:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100f7fe700 1 -- 172.21.15.5:0/1410638414 learned_addr learned my addr 172.21.15.5:0/1410638414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100effd700 1 --1- 172.21.15.5:0/1410638414 >> v1:172.21.15.5:6789/0 conn(0x7f101015dbc0 0x7f10100d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58502/0 (socket says 172.21.15.5:58502) 2023-10-16T13:48:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100f7fe700 1 -- 172.21.15.5:0/1410638414 >> v1:172.21.15.112:6789/0 conn(0x7f10100d3fc0 legacy=0x7f10100d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100f7fe700 1 -- 172.21.15.5:0/1410638414 >> v1:172.21.15.5:6789/0 conn(0x7f101015dbc0 legacy=0x7f10100d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100f7fe700 1 -- 172.21.15.5:0/1410638414 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100b7840 con 0x7f10100b7050 2023-10-16T13:48:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.864+0000 7f100dffb700 1 -- 172.21.15.5:0/1410638414 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378067907 0 0) 0x7f101015e4e0 con 0x7f101015dbc0 2023-10-16T13:48:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f100f7fe700 1 --2- 172.21.15.5:0/1410638414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f101015dfa0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1008009e50 tx=0x7f100800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf304fee5d1c242 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f100dffb700 1 -- 172.21.15.5:0/1410638414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e070 con 0x7f10100b7050 2023-10-16T13:48:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f100dffb700 1 -- 172.21.15.5:0/1410638414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800b9c0 con 0x7f10100b7050 2023-10-16T13:48:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f100dffb700 1 -- 172.21.15.5:0/1410638414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800bd70 con 0x7f10100b7050 2023-10-16T13:48:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 -- 172.21.15.5:0/1410638414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 msgr2=0x7f101015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 --2- 172.21.15.5:0/1410638414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f101015dfa0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1008009e50 tx=0x7f100800b330 comp rx=0 tx=0).stop 2023-10-16T13:48:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 -- 172.21.15.5:0/1410638414 shutdown_connections 2023-10-16T13:48:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 --2- 172.21.15.5:0/1410638414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f101015dfa0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 -- 172.21.15.5:0/1410638414 >> 172.21.15.5:0/1410638414 conn(0x7f101009cb40 msgr2=0x7f10100d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 -- 172.21.15.5:0/1410638414 shutdown_connections 2023-10-16T13:48:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.865+0000 7f101597b700 1 -- 172.21.15.5:0/1410638414 wait complete. 2023-10-16T13:48:16.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.867+0000 7f101597b700 1 Processor -- start 2023-10-16T13:48:16.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.867+0000 7f101597b700 1 -- start start 2023-10-16T13:48:16.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f101597b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f1010155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f101597b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10100d3fc0 0x7f10100c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f101597b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f101015dbc0 0x7f1010159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f101597b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c9c90 con 0x7f10100b7050 2023-10-16T13:48:16.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f101597b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101015a4a0 con 0x7f10100d3fc0 2023-10-16T13:48:16.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f101597b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1010157520 con 0x7f101015dbc0 2023-10-16T13:48:16.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f1010155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f1010155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48504/0 (socket says 172.21.15.5:48504) 2023-10-16T13:48:16.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 -- 172.21.15.5:0/3817213903 learned_addr learned my addr 172.21.15.5:0/3817213903 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:16.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100e7fc700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10100d3fc0 0x7f10100c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100f7fe700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f101015dbc0 0x7f1010159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 -- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f101015dbc0 msgr2=0x7f1010159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f101015dbc0 0x7f1010159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 -- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10100d3fc0 msgr2=0x7f10100c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10100d3fc0 0x7f10100c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.868+0000 7f100effd700 1 -- 172.21.15.5:0/3817213903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009b30 con 0x7f10100b7050 2023-10-16T13:48:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.869+0000 7f100effd700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f1010155bc0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f100400c480 tx=0x7f100400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.869+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040074e0 con 0x7f10100b7050 2023-10-16T13:48:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.869+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004007660 con 0x7f10100b7050 2023-10-16T13:48:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.869+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1010157800 con 0x7f10100b7050 2023-10-16T13:48:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.869+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004005a70 con 0x7f10100b7050 2023-10-16T13:48:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.869+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1010157dc0 con 0x7f10100b7050 2023-10-16T13:48:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.870+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101004ebb0 con 0x7f10100b7050 2023-10-16T13:48:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.870+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f1004005bd0 con 0x7f10100b7050 2023-10-16T13:48:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.871+0000 7f0ff7fff700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ffc06b260 0x7f0ffc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.871+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1004088c70 con 0x7f10100b7050 2023-10-16T13:48:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.871+0000 7f100e7fc700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ffc06b260 0x7f0ffc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.871+0000 7f100e7fc700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ffc06b260 0x7f0ffc06d720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1000000f60 tx=0x7f1000009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:16.876+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1004053c70 con 0x7f10100b7050 2023-10-16T13:48:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.078+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10100d0de0 con 0x7f10100b7050 2023-10-16T13:48:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.079+0000 7f0ff7fff700 1 -- 172.21.15.5:0/3817213903 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+12786 (secure 0 0 0) 0x7f1004057290 con 0x7f10100b7050 2023-10-16T13:48:17.082 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:17.082 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":94,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:16.260601+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:17.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ffc06b260 msgr2=0x7f0ffc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ffc06b260 0x7f0ffc06d720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1000000f60 tx=0x7f1000009040 comp rx=0 tx=0).stop 2023-10-16T13:48:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 msgr2=0x7f1010155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f1010155bc0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f100400c480 tx=0x7f100400c840 comp rx=0 tx=0).stop 2023-10-16T13:48:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 shutdown_connections 2023-10-16T13:48:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0ffc06b260 0x7f0ffc06d720 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f101015dbc0 0x7f1010159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10100b7050 0x7f1010155bc0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 --2- 172.21.15.5:0/3817213903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10100d3fc0 0x7f10100c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 >> 172.21.15.5:0/3817213903 conn(0x7f101009cb40 msgr2=0x7f10100c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 shutdown_connections 2023-10-16T13:48:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.081+0000 7f101597b700 1 -- 172.21.15.5:0/3817213903 wait complete. 2023-10-16T13:48:17.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:17.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.223+0000 7f600066c700 1 Processor -- start 2023-10-16T13:48:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.223+0000 7f600066c700 1 -- start start 2023-10-16T13:48:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f600066c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ff815e2f0 0x7f5ff80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f600066c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80b2d60 con 0x7f5ff80cd950 2023-10-16T13:48:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f600066c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80cdd30 con 0x7f5ff806a840 2023-10-16T13:48:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f600066c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff81619a0 con 0x7f5ff815e2f0 2023-10-16T13:48:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f5ffe408700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ff80cd950 0x7f5ff815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58516/0 (socket says 172.21.15.5:58516) 2023-10-16T13:48:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f5ffe408700 1 -- 172.21.15.5:0/3171637030 learned_addr learned my addr 172.21.15.5:0/3171637030 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/3171637030 >> v2:172.21.15.112:3300/0 conn(0x7f5ff815e2f0 0x7f5ff80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.224+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377931912 0 0) 0x7f5ff80b2d60 con 0x7f5ff80cd950 2023-10-16T13:48:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe40035b0 con 0x7f5ff80cd950 2023-10-16T13:48:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623842820 0 0) 0x7f5ff80cdd30 con 0x7f5ff806a840 2023-10-16T13:48:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff80b2d60 con 0x7f5ff806a840 2023-10-16T13:48:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227295544 0 0) 0x7f5fe40035b0 con 0x7f5ff80cd950 2023-10-16T13:48:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 >> v2:172.21.15.112:3300/0 conn(0x7f5ff815e2f0 msgr2=0x7f5ff80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 --2- 172.21.15.5:0/3171637030 >> v2:172.21.15.112:3300/0 conn(0x7f5ff815e2f0 0x7f5ff80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 >> v1:172.21.15.112:6789/0 conn(0x7f5ff806a840 legacy=0x7f5ff806ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff815e920 con 0x7f5ff80cd950 2023-10-16T13:48:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5fe8001670 con 0x7f5ff80cd950 2023-10-16T13:48:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/3171637030 >> v2:172.21.15.112:3300/0 conn(0x7f5ff815e2f0 0x7f5ff80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 >> v1:172.21.15.5:6789/0 conn(0x7f5ff80cd950 legacy=0x7f5ff815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fe4003b90 0x7f5fe4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5fe4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fe4005210 0x7f5fe400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81619a0 con 0x7f5fe4004850 2023-10-16T13:48:17.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe400c090 con 0x7f5fe4003b90 2023-10-16T13:48:17.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe400c250 con 0x7f5fe4005210 2023-10-16T13:48:17.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5fe4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffe408700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fe4003b90 0x7f5fe4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffec09700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fe4005210 0x7f5fe400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 -- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fe4005210 msgr2=0x7f5fe400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fe4005210 0x7f5fe400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 -- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fe4003b90 msgr2=0x7f5fe4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fe4003b90 0x7f5fe4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 -- 172.21.15.5:0/3171637030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40035b0 con 0x7f5fe4004850 2023-10-16T13:48:17.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffec09700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fe4005210 0x7f5fe400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:17.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffec09700 1 -- 172.21.15.5:0/3171637030 reap_dead start 2023-10-16T13:48:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.225+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5fe4004cd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009d10 tx=0x7f5fe4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a52d2461d8c4f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4009e60 con 0x7f5fe4004850 2023-10-16T13:48:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4005a20 con 0x7f5fe4004850 2023-10-16T13:48:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f5ffd406700 1 -- 172.21.15.5:0/3171637030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4005d90 con 0x7f5fe4004850 2023-10-16T13:48:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 -- 172.21.15.5:0/3171637030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 msgr2=0x7f5fe4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5fe4004cd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009d10 tx=0x7f5fe4005880 comp rx=0 tx=0).stop 2023-10-16T13:48:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 -- 172.21.15.5:0/3171637030 shutdown_connections 2023-10-16T13:48:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 --2- 172.21.15.5:0/3171637030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5fe4004cd0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 -- 172.21.15.5:0/3171637030 >> 172.21.15.5:0/3171637030 conn(0x7f5ff806dae0 msgr2=0x7f5ff806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 -- 172.21.15.5:0/3171637030 shutdown_connections 2023-10-16T13:48:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.226+0000 7f600066c700 1 -- 172.21.15.5:0/3171637030 wait complete. 2023-10-16T13:48:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.228+0000 7f600066c700 1 Processor -- start 2023-10-16T13:48:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.228+0000 7f600066c700 1 -- start start 2023-10-16T13:48:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f600066c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5ff81f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f600066c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff81f6720 0x7f5ff80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f600066c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ff80b0520 0x7f5ff80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f600066c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81f4130 con 0x7f5fe4004850 2023-10-16T13:48:17.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f600066c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80b0ef0 con 0x7f5ff81f6720 2023-10-16T13:48:17.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f600066c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80c7100 con 0x7f5ff80b0520 2023-10-16T13:48:17.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5ff81f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5ff81f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48524/0 (socket says 172.21.15.5:48524) 2023-10-16T13:48:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 -- 172.21.15.5:0/893714683 learned_addr learned my addr 172.21.15.5:0/893714683 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffec09700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ff80b0520 0x7f5ff80b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff81f6720 0x7f5ff80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 -- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ff80b0520 msgr2=0x7f5ff80b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ff80b0520 0x7f5ff80b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 -- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff81f6720 msgr2=0x7f5ff80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff81f6720 0x7f5ff80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffe408700 1 -- 172.21.15.5:0/893714683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff81f4550 con 0x7f5fe4004850 2023-10-16T13:48:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.229+0000 7f5ffec09700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ff80b0520 0x7f5ff80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.230+0000 7f5ffe408700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5ff81f77c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8007310 tx=0x7f5fe80076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.230+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80077f0 con 0x7f5fe4004850 2023-10-16T13:48:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.230+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800f8d0 con 0x7f5fe4004850 2023-10-16T13:48:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.230+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800fc80 con 0x7f5fe4004850 2023-10-16T13:48:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.230+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff81f3790 con 0x7f5fe4004850 2023-10-16T13:48:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.230+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff81f3d50 con 0x7f5fe4004850 2023-10-16T13:48:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.231+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff81f4270 con 0x7f5fe4004850 2023-10-16T13:48:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.231+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f5fe801d460 con 0x7f5fe4004850 2023-10-16T13:48:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.232+0000 7f5feeffd700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fdc06b260 0x7f5fdc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.232+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5fe80898a0 con 0x7f5fe4004850 2023-10-16T13:48:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.232+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fdc06b260 0x7f5fdc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.232+0000 7f5ffdc07700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fdc06b260 0x7f5fdc06d720 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4000c00 tx=0x7f5ff4008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.236+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ff81f4270 con 0x7f5fe4004850 2023-10-16T13:48:17.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.438+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ff81f4270 con 0x7f5fe4004850 2023-10-16T13:48:17.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.439+0000 7f5feeffd700 1 -- 172.21.15.5:0/893714683 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ff81f4270 con 0x7f5fe4004850 2023-10-16T13:48:17.442 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:17.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fdc06b260 msgr2=0x7f5fdc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fdc06b260 0x7f5fdc06d720 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4000c00 tx=0x7f5ff4008070 comp rx=0 tx=0).stop 2023-10-16T13:48:17.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 msgr2=0x7f5ff81f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5ff81f77c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8007310 tx=0x7f5fe80076d0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 shutdown_connections 2023-10-16T13:48:17.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fdc06b260 0x7f5fdc06d720 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ff80b0520 0x7f5ff80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe4004850 0x7f5ff81f77c0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 --2- 172.21.15.5:0/893714683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ff81f6720 0x7f5ff80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 >> 172.21.15.5:0/893714683 conn(0x7f5ff806dae0 msgr2=0x7f5ff80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:17.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 shutdown_connections 2023-10-16T13:48:17.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.441+0000 7f600066c700 1 -- 172.21.15.5:0/893714683 wait complete. 2023-10-16T13:48:17.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:48:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.578+0000 7fcdfae90700 1 Processor -- start 2023-10-16T13:48:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.578+0000 7fcdfae90700 1 -- start start 2023-10-16T13:48:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdfae90700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdf415f130 0x7fcdf40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdfae90700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40b3530 con 0x7fcdf40b28b0 2023-10-16T13:48:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdfae90700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40cd180 con 0x7fcdf406af50 2023-10-16T13:48:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdfae90700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf40cde00 con 0x7fcdf415f130 2023-10-16T13:48:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcdf40b28b0 0x7fcdf406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58540/0 (socket says 172.21.15.5:58540) 2023-10-16T13:48:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf3fff700 1 -- 172.21.15.5:0/1499612677 learned_addr learned my addr 172.21.15.5:0/1499612677 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf8c2c700 1 --2- 172.21.15.5:0/1499612677 >> v2:172.21.15.112:3300/0 conn(0x7fcdf415f130 0x7fcdf40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102630597 0 0) 0x7fcdf40b3530 con 0x7fcdf40b28b0 2023-10-16T13:48:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde40035b0 con 0x7fcdf40b28b0 2023-10-16T13:48:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533315270 0 0) 0x7fcdf40cd180 con 0x7fcdf406af50 2023-10-16T13:48:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.579+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf40b3530 con 0x7fcdf406af50 2023-10-16T13:48:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494228119 0 0) 0x7fcde40035b0 con 0x7fcdf40b28b0 2023-10-16T13:48:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 >> v2:172.21.15.112:3300/0 conn(0x7fcdf415f130 msgr2=0x7fcdf40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 --2- 172.21.15.5:0/1499612677 >> v2:172.21.15.112:3300/0 conn(0x7fcdf415f130 0x7fcdf40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 >> v1:172.21.15.112:6789/0 conn(0x7fcdf406af50 legacy=0x7fcdf40b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40cd460 con 0x7fcdf40b28b0 2023-10-16T13:48:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fcde00017f0 con 0x7fcdf40b28b0 2023-10-16T13:48:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 >> v1:172.21.15.5:6789/0 conn(0x7fcdf40b28b0 legacy=0x7fcdf406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde4003b90 0x7fcde4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4004850 0x7fcde4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcde400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40cde00 con 0x7fcde4005210 2023-10-16T13:48:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde400c090 con 0x7fcde4004850 2023-10-16T13:48:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde400c250 con 0x7fcde4003b90 2023-10-16T13:48:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf8c2c700 1 --2- 172.21.15.5:0/1499612677 >> v2:172.21.15.112:3300/0 conn(0x7fcdf415f130 0x7fcdf40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcde400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf3fff700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4004850 0x7fcde4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf8c2c700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde4003b90 0x7fcde4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 -- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde4003b90 msgr2=0x7fcde4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcde4003b90 0x7fcde4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 -- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4004850 msgr2=0x7fcde4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde4004850 0x7fcde4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 -- 172.21.15.5:0/1499612677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40035b0 con 0x7fcde4005210 2023-10-16T13:48:17.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 -- 172.21.15.5:0/1499612677 reap_dead start 2023-10-16T13:48:17.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf942d700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcde400ba10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c2f0 tx=0x7fcde4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81895c34bc225a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec001f30 con 0x7fcde4005210 2023-10-16T13:48:17.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec003a00 con 0x7fcde4005210 2023-10-16T13:48:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.580+0000 7fcdf37fe700 1 -- 172.21.15.5:0/1499612677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec003db0 con 0x7fcde4005210 2023-10-16T13:48:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 -- 172.21.15.5:0/1499612677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 msgr2=0x7fcde400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcde400ba10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c2f0 tx=0x7fcde4005880 comp rx=0 tx=0).stop 2023-10-16T13:48:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 -- 172.21.15.5:0/1499612677 shutdown_connections 2023-10-16T13:48:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 --2- 172.21.15.5:0/1499612677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcde400ba10 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 -- 172.21.15.5:0/1499612677 >> 172.21.15.5:0/1499612677 conn(0x7fcdf406dae0 msgr2=0x7fcdf406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 -- 172.21.15.5:0/1499612677 shutdown_connections 2023-10-16T13:48:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.581+0000 7fcdfae90700 1 -- 172.21.15.5:0/1499612677 wait complete. 2023-10-16T13:48:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.582+0000 7fcdfae90700 1 Processor -- start 2023-10-16T13:48:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.582+0000 7fcdfae90700 1 -- start start 2023-10-16T13:48:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdfae90700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcdf40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdfae90700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdf4153770 0x7fcdf40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdfae90700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdf40ad2c0 0x7fcdf40ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdfae90700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40adc80 con 0x7fcde4005210 2023-10-16T13:48:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdfae90700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40c8ac0 con 0x7fcdf4153770 2023-10-16T13:48:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdfae90700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40cad60 con 0x7fcdf40ad2c0 2023-10-16T13:48:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdf8c2c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcdf40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdf8c2c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcdf40c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48544/0 (socket says 172.21.15.5:48544) 2023-10-16T13:48:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdf8c2c700 1 -- 172.21.15.5:0/3041455482 learned_addr learned my addr 172.21.15.5:0/3041455482 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdf942d700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdf40ad2c0 0x7fcdf40ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.583+0000 7fcdf3fff700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdf4153770 0x7fcdf40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf8c2c700 1 -- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdf40ad2c0 msgr2=0x7fcdf40ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf8c2c700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdf40ad2c0 0x7fcdf40ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf8c2c700 1 -- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdf4153770 msgr2=0x7fcdf40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf8c2c700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdf4153770 0x7fcdf40c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf8c2c700 1 -- 172.21.15.5:0/3041455482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4153bf0 con 0x7fcde4005210 2023-10-16T13:48:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf8c2c700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcdf40c7e50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fcde8010a90 tx=0x7fcde8010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800e870 con 0x7fcde4005210 2023-10-16T13:48:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde800e9d0 con 0x7fcde4005210 2023-10-16T13:48:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40ca360 con 0x7fcde4005210 2023-10-16T13:48:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800ed80 con 0x7fcde4005210 2023-10-16T13:48:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.584+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf40c8ff0 con 0x7fcde4005210 2023-10-16T13:48:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.585+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf40ad130 con 0x7fcde4005210 2023-10-16T13:48:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.585+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fcde8016460 con 0x7fcde4005210 2023-10-16T13:48:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.586+0000 7fcdf17fa700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd806b260 0x7fcdd806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.586+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcde8089be0 con 0x7fcde4005210 2023-10-16T13:48:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.586+0000 7fcdf3fff700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd806b260 0x7fcdd806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.587+0000 7fcdf3fff700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd806b260 0x7fcdd806d720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcde00011d0 tx=0x7fcde0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.591+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcde8054c60 con 0x7fcde4005210 2023-10-16T13:48:17.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.791+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcdf4074460 con 0x7fcde4005210 2023-10-16T13:48:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.791+0000 7fcdf17fa700 1 -- 172.21.15.5:0/3041455482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcdf4074460 con 0x7fcde4005210 2023-10-16T13:48:17.794 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:17.795 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:48:17.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:17.795 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:48:17.795 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:48:17.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:17.796 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:48:17.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd806b260 msgr2=0x7fcdd806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd806b260 0x7fcdd806d720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcde00011d0 tx=0x7fcde0009040 comp rx=0 tx=0).stop 2023-10-16T13:48:17.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 msgr2=0x7fcdf40c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcdf40c7e50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fcde8010a90 tx=0x7fcde8010da0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 shutdown_connections 2023-10-16T13:48:17.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcdd806b260 0x7fcdd806d720 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdf40ad2c0 0x7fcdf40ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde4005210 0x7fcdf40c7e50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 --2- 172.21.15.5:0/3041455482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdf4153770 0x7fcdf40c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.793+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 >> 172.21.15.5:0/3041455482 conn(0x7fcdf406dae0 msgr2=0x7fcdf40b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:17.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.794+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 shutdown_connections 2023-10-16T13:48:17.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.794+0000 7fcdfae90700 1 -- 172.21.15.5:0/3041455482 wait complete. 2023-10-16T13:48:17.808 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:48:17.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:48:17.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.935+0000 7f673598c700 1 Processor -- start 2023-10-16T13:48:17.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.935+0000 7f673598c700 1 -- start start 2023-10-16T13:48:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f673598c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67300d2250 0x7f67300b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f673598c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67300b6190 con 0x7f67300d1760 2023-10-16T13:48:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f673598c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67300cf6c0 con 0x7f673015d940 2023-10-16T13:48:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f673598c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67300b58f0 con 0x7f67300d2250 2023-10-16T13:48:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f672effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67300d1760 0x7f67300d1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58556/0 (socket says 172.21.15.5:58556) 2023-10-16T13:48:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f672effd700 1 -- 172.21.15.5:0/2152646110 learned_addr learned my addr 172.21.15.5:0/2152646110 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2152646110 >> v2:172.21.15.112:3300/0 conn(0x7f67300d2250 0x7f67300b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147460971 0 0) 0x7f67300b6190 con 0x7f67300d1760 2023-10-16T13:48:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.936+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67180035b0 con 0x7f67300d1760 2023-10-16T13:48:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 409460270 0 0) 0x7f67180035b0 con 0x7f67300d1760 2023-10-16T13:48:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 >> v2:172.21.15.112:3300/0 conn(0x7f67300d2250 msgr2=0x7f67300b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 --2- 172.21.15.5:0/2152646110 >> v2:172.21.15.112:3300/0 conn(0x7f67300d2250 0x7f67300b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 >> v1:172.21.15.112:6789/0 conn(0x7f673015d940 legacy=0x7f673015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300b5bd0 con 0x7f67300d1760 2023-10-16T13:48:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f67240017f0 con 0x7f67300d1760 2023-10-16T13:48:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 >> v1:172.21.15.5:6789/0 conn(0x7f67300d1760 legacy=0x7f67300d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6718003a00 0x7f6718003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f67180048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67180050d0 0x7f671800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300b58f0 con 0x7f6718004400 2023-10-16T13:48:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671800c030 con 0x7f67180050d0 2023-10-16T13:48:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671800c1f0 con 0x7f6718003a00 2023-10-16T13:48:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f67180048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672f7fe700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67180050d0 0x7f671800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672effd700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6718003a00 0x7f6718003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 -- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6718003a00 msgr2=0x7f6718003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6718003a00 0x7f6718003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 -- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67180050d0 msgr2=0x7f671800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67180050d0 0x7f671800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 -- 172.21.15.5:0/2152646110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67180035b0 con 0x7f6718004400 2023-10-16T13:48:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672f7fe700 1 -- 172.21.15.5:0/2152646110 reap_dead start 2023-10-16T13:48:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.937+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f67180048d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f6720009b30 tx=0x7f6718005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b9bd6d67a02424 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672000e6c0 con 0x7f6718004400 2023-10-16T13:48:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672000e820 con 0x7f6718004400 2023-10-16T13:48:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f672dffb700 1 -- 172.21.15.5:0/2152646110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672000eb90 con 0x7f6718004400 2023-10-16T13:48:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 -- 172.21.15.5:0/2152646110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 msgr2=0x7f67180048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f67180048d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f6720009b30 tx=0x7f6718005880 comp rx=0 tx=0).stop 2023-10-16T13:48:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 -- 172.21.15.5:0/2152646110 shutdown_connections 2023-10-16T13:48:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 --2- 172.21.15.5:0/2152646110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f67180048d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 -- 172.21.15.5:0/2152646110 >> 172.21.15.5:0/2152646110 conn(0x7f67300d37a0 msgr2=0x7f67300d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 -- 172.21.15.5:0/2152646110 shutdown_connections 2023-10-16T13:48:17.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.938+0000 7f673598c700 1 -- 172.21.15.5:0/2152646110 wait complete. 2023-10-16T13:48:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.939+0000 7f673598c700 1 Processor -- start 2023-10-16T13:48:17.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 -- start start 2023-10-16T13:48:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f6730154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f673015b620 0x7f673015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67301e76d0 0x7f67301e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67301e80a0 con 0x7f6718004400 2023-10-16T13:48:17.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300b63c0 con 0x7f67301e76d0 2023-10-16T13:48:17.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f673598c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67300b66a0 con 0x7f673015b620 2023-10-16T13:48:17.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f672effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f6730154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f672effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f6730154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48564/0 (socket says 172.21.15.5:48564) 2023-10-16T13:48:17.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.940+0000 7f672effd700 1 -- 172.21.15.5:0/2066699008 learned_addr learned my addr 172.21.15.5:0/2066699008 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:17.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f673015b620 0x7f673015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672f7fe700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67301e76d0 0x7f67301e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672effd700 1 -- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f673015b620 msgr2=0x7f673015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672effd700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f673015b620 0x7f673015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672effd700 1 -- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67301e76d0 msgr2=0x7f67301e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:17.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672effd700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67301e76d0 0x7f67301e7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:17.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672effd700 1 -- 172.21.15.5:0/2066699008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300b6980 con 0x7f6718004400 2023-10-16T13:48:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f673015b620 0x7f673015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672f7fe700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67301e76d0 0x7f67301e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f672effd700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f6730154060 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f672400fae0 tx=0x7f672400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240072e0 con 0x7f6718004400 2023-10-16T13:48:17.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724007440 con 0x7f6718004400 2023-10-16T13:48:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67300b6c60 con 0x7f6718004400 2023-10-16T13:48:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724005830 con 0x7f6718004400 2023-10-16T13:48:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.941+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67300b7220 con 0x7f6718004400 2023-10-16T13:48:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.942+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67300b73b0 con 0x7f6718004400 2023-10-16T13:48:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.943+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f6724005990 con 0x7f6718004400 2023-10-16T13:48:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.943+0000 7f6717fff700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671c06b260 0x7f671c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.943+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f67240898e0 con 0x7f6718004400 2023-10-16T13:48:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.943+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671c06b260 0x7f671c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.944+0000 7f672e7fc700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671c06b260 0x7f671c06d720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f67200090b0 tx=0x7f6720008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:17.948+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6724058360 con 0x7f6718004400 2023-10-16T13:48:18.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.149+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f67300caee0 con 0x7f6718004400 2023-10-16T13:48:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.258+0000 7f6717fff700 1 -- 172.21.15.5:0/2066699008 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6724057ef0 con 0x7f6718004400 2023-10-16T13:48:18.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671c06b260 msgr2=0x7f671c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671c06b260 0x7f671c06d720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f67200090b0 tx=0x7f6720008030 comp rx=0 tx=0).stop 2023-10-16T13:48:18.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 msgr2=0x7f6730154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f6730154060 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f672400fae0 tx=0x7f672400fea0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 shutdown_connections 2023-10-16T13:48:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67301e76d0 0x7f67301e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6718004400 0x7f6730154060 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f671c06b260 0x7f671c06d720 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 --2- 172.21.15.5:0/2066699008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f673015b620 0x7f673015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 >> 172.21.15.5:0/2066699008 conn(0x7f67300d37a0 msgr2=0x7f6730155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 shutdown_connections 2023-10-16T13:48:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.261+0000 7f673598c700 1 -- 172.21.15.5:0/2066699008 wait complete. 2023-10-16T13:48:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:48:18.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:48:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.409+0000 7f937b446700 1 Processor -- start 2023-10-16T13:48:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.409+0000 7f937b446700 1 -- start start 2023-10-16T13:48:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.410+0000 7f937b446700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93740ce6b0 0x7f93740d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.410+0000 7f937b446700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740cf8c0 con 0x7f937415dc90 2023-10-16T13:48:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.410+0000 7f937b446700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740d0ac0 con 0x7f93740d0650 2023-10-16T13:48:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.410+0000 7f937b446700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93740cecb0 con 0x7f93740ce6b0 2023-10-16T13:48:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.410+0000 7f93791e2700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f937415dc90 0x7f93740d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58576/0 (socket says 172.21.15.5:58576) 2023-10-16T13:48:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.410+0000 7f93791e2700 1 -- 172.21.15.5:0/3904859627 learned_addr learned my addr 172.21.15.5:0/3904859627 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f93789e1700 1 --2- 172.21.15.5:0/3904859627 >> v2:172.21.15.112:3300/0 conn(0x7f93740ce6b0 0x7f93740d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967908756 0 0) 0x7f93740cf8c0 con 0x7f937415dc90 2023-10-16T13:48:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93600035b0 con 0x7f937415dc90 2023-10-16T13:48:18.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381937341 0 0) 0x7f93740d0ac0 con 0x7f93740d0650 2023-10-16T13:48:18.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93740cf8c0 con 0x7f93740d0650 2023-10-16T13:48:18.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657415083 0 0) 0x7f93600035b0 con 0x7f937415dc90 2023-10-16T13:48:18.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f93789e1700 1 -- 172.21.15.5:0/3904859627 >> v1:172.21.15.112:6789/0 conn(0x7f93740d0650 legacy=0x7f93740b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f93789e1700 1 -- 172.21.15.5:0/3904859627 >> v1:172.21.15.5:6789/0 conn(0x7f937415dc90 legacy=0x7f93740d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f93789e1700 1 -- 172.21.15.5:0/3904859627 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93740cef90 con 0x7f93740ce6b0 2023-10-16T13:48:18.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f93789e1700 1 --2- 172.21.15.5:0/3904859627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740d0110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9370009840 tx=0x7f9370009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a397f8fe8e5aea10 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:18.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93640017f0 con 0x7f93740ce6b0 2023-10-16T13:48:18.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370004030 con 0x7f93740ce6b0 2023-10-16T13:48:18.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.411+0000 7f936bfff700 1 -- 172.21.15.5:0/3904859627 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93700043c0 con 0x7f93740ce6b0 2023-10-16T13:48:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 -- 172.21.15.5:0/3904859627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 msgr2=0x7f93740d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 --2- 172.21.15.5:0/3904859627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740d0110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9370009840 tx=0x7f9370009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 -- 172.21.15.5:0/3904859627 shutdown_connections 2023-10-16T13:48:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 --2- 172.21.15.5:0/3904859627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740d0110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 -- 172.21.15.5:0/3904859627 >> 172.21.15.5:0/3904859627 conn(0x7f93740d37e0 msgr2=0x7f93740d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 -- 172.21.15.5:0/3904859627 shutdown_connections 2023-10-16T13:48:18.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.412+0000 7f937b446700 1 -- 172.21.15.5:0/3904859627 wait complete. 2023-10-16T13:48:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.414+0000 7f937b446700 1 Processor -- start 2023-10-16T13:48:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.414+0000 7f937b446700 1 -- start start 2023-10-16T13:48:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 0x7f93741f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:18.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937415dc90 0x7f937415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740b8fb0 con 0x7f93740d0650 2023-10-16T13:48:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93741543b0 con 0x7f93740ce6b0 2023-10-16T13:48:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93741f31e0 con 0x7f937415dc90 2023-10-16T13:48:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 0x7f93741f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:18.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 0x7f93741f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48580/0 (socket says 172.21.15.5:48580) 2023-10-16T13:48:18.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 -- 172.21.15.5:0/684824600 learned_addr learned my addr 172.21.15.5:0/684824600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:18.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93791e2700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:18.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93799e3700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937415dc90 0x7f937415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:18.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 -- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937415dc90 msgr2=0x7f937415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937415dc90 0x7f937415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 -- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 msgr2=0x7f93740b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:18.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:18.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 -- 172.21.15.5:0/684824600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93700094a0 con 0x7f93740d0650 2023-10-16T13:48:18.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93799e3700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937415dc90 0x7f937415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:18.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f93789e1700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 0x7f93741f2ca0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f937408e010 tx=0x7f9370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:18.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370003c80 con 0x7f93740d0650 2023-10-16T13:48:18.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937001f070 con 0x7f93740d0650 2023-10-16T13:48:18.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370011630 con 0x7f93740d0650 2023-10-16T13:48:18.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.415+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9374153a80 con 0x7f93740d0650 2023-10-16T13:48:18.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.416+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9374154040 con 0x7f93740d0650 2023-10-16T13:48:18.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.417+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937404ebb0 con 0x7f93740d0650 2023-10-16T13:48:18.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.417+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f9370021030 con 0x7f93740d0650 2023-10-16T13:48:18.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.418+0000 7f9369ffb700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935806b260 0x7f935806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:18.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.418+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f937008adf0 con 0x7f93740d0650 2023-10-16T13:48:18.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.418+0000 7f93791e2700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935806b260 0x7f935806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:18.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.418+0000 7f93791e2700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935806b260 0x7f935806d720 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9364006ab0 tx=0x7f9364001c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:18.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.423+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9370055c90 con 0x7f93740d0650 2023-10-16T13:48:18.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:18.625+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f937408d910 con 0x7f93740d0650 2023-10-16T13:48:19.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.261+0000 7f9369ffb700 1 -- 172.21.15.5:0/684824600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7f93700592b0 con 0x7f93740d0650 2023-10-16T13:48:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.265+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935806b260 msgr2=0x7f935806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.265+0000 7f937b446700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935806b260 0x7f935806d720 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9364006ab0 tx=0x7f9364001c90 comp rx=0 tx=0).stop 2023-10-16T13:48:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.265+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 msgr2=0x7f93741f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.265+0000 7f937b446700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 0x7f93741f2ca0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f937408e010 tx=0x7f9370004750 comp rx=0 tx=0).stop 2023-10-16T13:48:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.266+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 shutdown_connections 2023-10-16T13:48:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.266+0000 7f937b446700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f935806b260 0x7f935806d720 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.266+0000 7f937b446700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937415dc90 0x7f937415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.266+0000 7f937b446700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740ce6b0 0x7f93740b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.266+0000 7f937b446700 1 --2- 172.21.15.5:0/684824600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93740d0650 0x7f93741f2ca0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.266+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 >> 172.21.15.5:0/684824600 conn(0x7f93740d37e0 msgr2=0x7f937415cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:19.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.267+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 shutdown_connections 2023-10-16T13:48:19.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.268+0000 7f937b446700 1 -- 172.21.15.5:0/684824600 wait complete. 2023-10-16T13:48:19.284 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:48:19.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:48:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.432+0000 7f217164d700 1 Processor -- start 2023-10-16T13:48:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.432+0000 7f217164d700 1 -- start start 2023-10-16T13:48:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f217164d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 0x7f216c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f217164d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f216c0b7050 0x7f216c0d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f217164d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c15e4e0 con 0x7f216c15dbc0 2023-10-16T13:48:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f217164d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0b7560 con 0x7f216c0b7050 2023-10-16T13:48:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f217164d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b7840 con 0x7f216c0d3fc0 2023-10-16T13:48:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f216a7fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 0x7f216c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f216affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f216c15dbc0 0x7f216c0d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:49566/0 (socket says 172.21.15.5:49566) 2023-10-16T13:48:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f216b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f216c0b7050 0x7f216c0d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f216affd700 1 -- 172.21.15.5:0/1239259906 learned_addr learned my addr 172.21.15.5:0/1239259906 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.433+0000 7f216a7fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 0x7f216c15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:46492/0 (socket says 172.21.15.5:46492) 2023-10-16T13:48:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f2169ffb700 1 -- 172.21.15.5:0/1239259906 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261118395 0 0) 0x7f216c15e4e0 con 0x7f216c15dbc0 2023-10-16T13:48:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f2169ffb700 1 -- 172.21.15.5:0/1239259906 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21540035b0 con 0x7f216c15dbc0 2023-10-16T13:48:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f216a7fc700 1 -- 172.21.15.5:0/1239259906 >> v2:172.21.15.112:3300/0 conn(0x7f216c0b7050 msgr2=0x7f216c0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f216a7fc700 1 --2- 172.21.15.5:0/1239259906 >> v2:172.21.15.112:3300/0 conn(0x7f216c0b7050 0x7f216c0d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f216a7fc700 1 -- 172.21.15.5:0/1239259906 >> v1:172.21.15.112:6789/0 conn(0x7f216c15dbc0 legacy=0x7f216c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f216a7fc700 1 -- 172.21.15.5:0/1239259906 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0b7b20 con 0x7f216c0d3fc0 2023-10-16T13:48:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f216b7fe700 1 --2- 172.21.15.5:0/1239259906 >> v2:172.21.15.112:3300/0 conn(0x7f216c0b7050 0x7f216c0d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f216a7fc700 1 --2- 172.21.15.5:0/1239259906 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 0x7f216c15dfa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f215c009840 tx=0x7f215c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6ff7a8e819417c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f2169ffb700 1 -- 172.21.15.5:0/1239259906 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c011830 con 0x7f216c0d3fc0 2023-10-16T13:48:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f2169ffb700 1 -- 172.21.15.5:0/1239259906 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c011990 con 0x7f216c0d3fc0 2023-10-16T13:48:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f2169ffb700 1 -- 172.21.15.5:0/1239259906 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c011d20 con 0x7f216c0d3fc0 2023-10-16T13:48:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f217164d700 1 -- 172.21.15.5:0/1239259906 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 msgr2=0x7f216c15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.434+0000 7f217164d700 1 --2- 172.21.15.5:0/1239259906 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 0x7f216c15dfa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f215c009840 tx=0x7f215c009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.435+0000 7f217164d700 1 -- 172.21.15.5:0/1239259906 shutdown_connections 2023-10-16T13:48:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.435+0000 7f217164d700 1 --2- 172.21.15.5:0/1239259906 >> v2:172.21.15.112:3300/0 conn(0x7f216c0b7050 0x7f216c0d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.435+0000 7f217164d700 1 --2- 172.21.15.5:0/1239259906 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0d3fc0 0x7f216c15dfa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.435+0000 7f217164d700 1 -- 172.21.15.5:0/1239259906 >> 172.21.15.5:0/1239259906 conn(0x7f216c09cb40 msgr2=0x7f216c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.435+0000 7f217164d700 1 -- 172.21.15.5:0/1239259906 shutdown_connections 2023-10-16T13:48:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.435+0000 7f217164d700 1 -- 172.21.15.5:0/1239259906 wait complete. 2023-10-16T13:48:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.436+0000 7f217164d700 1 Processor -- start 2023-10-16T13:48:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.436+0000 7f217164d700 1 -- start start 2023-10-16T13:48:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0b7050 0x7f216c0c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c0d3fc0 0x7f216c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 0x7f216c1f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0cb060 con 0x7f216c15dbc0 2023-10-16T13:48:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c9ed0 con 0x7f216c0d3fc0 2023-10-16T13:48:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0ca1b0 con 0x7f216c0b7050 2023-10-16T13:48:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 0x7f216c1f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 0x7f216c1f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48596/0 (socket says 172.21.15.5:48596) 2023-10-16T13:48:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 -- 172.21.15.5:0/2100329380 learned_addr learned my addr 172.21.15.5:0/2100329380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216a7fc700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c0d3fc0 0x7f216c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216affd700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0b7050 0x7f216c0c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 -- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0b7050 msgr2=0x7f216c0c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0b7050 0x7f216c0c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 -- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c0d3fc0 msgr2=0x7f216c1f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c0d3fc0 0x7f216c1f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 -- 172.21.15.5:0/2100329380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009a70 con 0x7f216c15dbc0 2023-10-16T13:48:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f216b7fe700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 0x7f216c1f6780 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f216400ef90 tx=0x7f216400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400cc90 con 0x7f216c15dbc0 2023-10-16T13:48:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400f040 con 0x7f216c15dbc0 2023-10-16T13:48:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.437+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c0094a0 con 0x7f216c15dbc0 2023-10-16T13:48:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.438+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640146c0 con 0x7f216c15dbc0 2023-10-16T13:48:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.438+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c0cacf0 con 0x7f216c15dbc0 2023-10-16T13:48:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.438+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c0cb1d0 con 0x7f216c15dbc0 2023-10-16T13:48:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.439+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f2164014820 con 0x7f216c15dbc0 2023-10-16T13:48:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.439+0000 7f21537fe700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f215806b260 0x7f215806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.439+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f216408a7e0 con 0x7f216c15dbc0 2023-10-16T13:48:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.440+0000 7f216affd700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f215806b260 0x7f215806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.440+0000 7f216affd700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f215806b260 0x7f215806d720 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2160001230 tx=0x7f2160007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.444+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21640553d0 con 0x7f216c15dbc0 2023-10-16T13:48:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:19.691+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f216c04ebb0 con 0x7f216c15dbc0 2023-10-16T13:48:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.282+0000 7f21537fe700 1 -- 172.21.15.5:0/2100329380 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2164009d70 con 0x7f216c15dbc0 2023-10-16T13:48:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.289+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f215806b260 msgr2=0x7f215806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.289+0000 7f217164d700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f215806b260 0x7f215806d720 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2160001230 tx=0x7f2160007df0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.289+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 msgr2=0x7f216c1f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.289+0000 7f217164d700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 0x7f216c1f6780 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f216400ef90 tx=0x7f216400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.293+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 shutdown_connections 2023-10-16T13:48:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.293+0000 7f217164d700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f216c15dbc0 0x7f216c1f6780 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.293+0000 7f217164d700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f215806b260 0x7f215806d720 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.293+0000 7f217164d700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f216c0b7050 0x7f216c0c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.293+0000 7f217164d700 1 --2- 172.21.15.5:0/2100329380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c0d3fc0 0x7f216c1f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.293+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 >> 172.21.15.5:0/2100329380 conn(0x7f216c09cb40 msgr2=0x7f216c156020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.294+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 shutdown_connections 2023-10-16T13:48:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.294+0000 7f217164d700 1 -- 172.21.15.5:0/2100329380 wait complete. 2023-10-16T13:48:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 16 and data pool 17 2023-10-16T13:48:20.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:20.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.448+0000 7f9478e5b700 1 Processor -- start 2023-10-16T13:48:20.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.448+0000 7f9478e5b700 1 -- start start 2023-10-16T13:48:20.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9478e5b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f947415e2f0 0x7f94740cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9478e5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9478e5b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94740b2d60 con 0x7f94740cd950 2023-10-16T13:48:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9478e5b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94741619a0 con 0x7f947415e2f0 2023-10-16T13:48:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9478e5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947406b1f0 con 0x7f947406a840 2023-10-16T13:48:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9471d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f947415e2f0 0x7f94740cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f947259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94740cd950 0x7f947415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58618/0 (socket says 172.21.15.5:58618) 2023-10-16T13:48:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f9471d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f947415e2f0 0x7f94740cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48616/0 (socket says 172.21.15.5:48616) 2023-10-16T13:48:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.449+0000 7f947259c700 1 -- 172.21.15.5:0/1005037605 learned_addr learned my addr 172.21.15.5:0/1005037605 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f9472d9d700 1 --2- 172.21.15.5:0/1005037605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f9471d9b700 1 -- 172.21.15.5:0/1005037605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 msgr2=0x7f947406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f9471d9b700 1 --2- 172.21.15.5:0/1005037605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947406acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f9471d9b700 1 -- 172.21.15.5:0/1005037605 >> v1:172.21.15.5:6789/0 conn(0x7f94740cd950 legacy=0x7f947415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f947159a700 1 -- 172.21.15.5:0/1005037605 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579626905 0 0) 0x7f94740b2d60 con 0x7f94740cd950 2023-10-16T13:48:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f9471d9b700 1 -- 172.21.15.5:0/1005037605 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94740cdd30 con 0x7f947415e2f0 2023-10-16T13:48:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f9471d9b700 1 --2- 172.21.15.5:0/1005037605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740cede0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9474161ae0 tx=0x7f9468009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18948d981f665273 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f947159a700 1 -- 172.21.15.5:0/1005037605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468015070 con 0x7f947415e2f0 2023-10-16T13:48:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f947159a700 1 -- 172.21.15.5:0/1005037605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468005c30 con 0x7f947415e2f0 2023-10-16T13:48:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.450+0000 7f947159a700 1 -- 172.21.15.5:0/1005037605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468004020 con 0x7f947415e2f0 2023-10-16T13:48:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 -- 172.21.15.5:0/1005037605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 msgr2=0x7f94740cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1005037605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740cede0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9474161ae0 tx=0x7f9468009b00 comp rx=0 tx=0).stop 2023-10-16T13:48:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 -- 172.21.15.5:0/1005037605 shutdown_connections 2023-10-16T13:48:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1005037605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1005037605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740cede0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 -- 172.21.15.5:0/1005037605 >> 172.21.15.5:0/1005037605 conn(0x7f947406dae0 msgr2=0x7f947406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 -- 172.21.15.5:0/1005037605 shutdown_connections 2023-10-16T13:48:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.451+0000 7f9478e5b700 1 -- 172.21.15.5:0/1005037605 wait complete. 2023-10-16T13:48:20.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.452+0000 7f9478e5b700 1 Processor -- start 2023-10-16T13:48:20.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.452+0000 7f9478e5b700 1 -- start start 2023-10-16T13:48:20.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9478e5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9478e5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94740cd950 0x7f94740ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9478e5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9478e5b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94740ad200 con 0x7f947415e2f0 2023-10-16T13:48:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9478e5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94740ad4e0 con 0x7f94740cd950 2023-10-16T13:48:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9478e5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94740ad7c0 con 0x7f947406a840 2023-10-16T13:48:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48624/0 (socket says 172.21.15.5:48624) 2023-10-16T13:48:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 -- 172.21.15.5:0/1788722667 learned_addr learned my addr 172.21.15.5:0/1788722667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9471d9b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94740cd950 0x7f94740ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f947259c700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 -- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 msgr2=0x7f947415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 -- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94740cd950 msgr2=0x7f94740ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94740cd950 0x7f94740ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 -- 172.21.15.5:0/1788722667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468009430 con 0x7f947415e2f0 2023-10-16T13:48:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f947259c700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.453+0000 7f9472d9d700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740b0790 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f946400e810 tx=0x7f946400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.454+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464013610 con 0x7f947415e2f0 2023-10-16T13:48:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.454+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464013770 con 0x7f947415e2f0 2023-10-16T13:48:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.454+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464013b20 con 0x7f947415e2f0 2023-10-16T13:48:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.454+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94740adf70 con 0x7f947415e2f0 2023-10-16T13:48:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.454+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94741f4750 con 0x7f947415e2f0 2023-10-16T13:48:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.455+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94741f48e0 con 0x7f947415e2f0 2023-10-16T13:48:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.455+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f9464013c80 con 0x7f947415e2f0 2023-10-16T13:48:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.456+0000 7f9462ffd700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f945406b260 0x7f945406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.456+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9464089940 con 0x7f947415e2f0 2023-10-16T13:48:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.456+0000 7f947259c700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f945406b260 0x7f945406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.456+0000 7f947259c700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f945406b260 0x7f945406d720 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f946c0012e0 tx=0x7f946c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.460+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94741f48e0 con 0x7f947415e2f0 2023-10-16T13:48:20.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.661+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94740ae490 con 0x7f947415e2f0 2023-10-16T13:48:20.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.663+0000 7f9462ffd700 1 -- 172.21.15.5:0/1788722667 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f94740ae490 con 0x7f947415e2f0 2023-10-16T13:48:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:20.666 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":97,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:19.692329+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f945406b260 msgr2=0x7f945406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f945406b260 0x7f945406d720 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f946c0012e0 tx=0x7f946c009040 comp rx=0 tx=0).stop 2023-10-16T13:48:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 msgr2=0x7f94740b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740b0790 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f946400e810 tx=0x7f946400ebd0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 shutdown_connections 2023-10-16T13:48:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947415e2f0 0x7f94740b0790 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f945406b260 0x7f945406d720 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f947406a840 0x7f947415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 --2- 172.21.15.5:0/1788722667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94740cd950 0x7f94740ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 >> 172.21.15.5:0/1788722667 conn(0x7f947406dae0 msgr2=0x7f947415d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:20.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 shutdown_connections 2023-10-16T13:48:20.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.665+0000 7f9478e5b700 1 -- 172.21.15.5:0/1788722667 wait complete. 2023-10-16T13:48:20.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.802+0000 7f4ad7e8b700 1 Processor -- start 2023-10-16T13:48:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.802+0000 7f4ad7e8b700 1 -- start start 2023-10-16T13:48:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad7e8b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ad015ab10 0x7f4ad015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad7e8b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad015e7a0 con 0x7f4ad00cfe30 2023-10-16T13:48:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad7e8b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad015f730 con 0x7f4ad00b1f50 2023-10-16T13:48:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad7e8b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00b29a0 con 0x7f4ad015ab10 2023-10-16T13:48:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad5c27700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ad015ab10 0x7f4ad015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad6428700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ad00cfe30 0x7f4ad00cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58634/0 (socket says 172.21.15.5:58634) 2023-10-16T13:48:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad5c27700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ad015ab10 0x7f4ad015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48628/0 (socket says 172.21.15.5:48628) 2023-10-16T13:48:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.803+0000 7f4ad6428700 1 -- 172.21.15.5:0/1966377002 learned_addr learned my addr 172.21.15.5:0/1966377002 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad5c27700 1 -- 172.21.15.5:0/1966377002 >> v1:172.21.15.112:6789/0 conn(0x7f4ad00b1f50 legacy=0x7f4ad00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad5c27700 1 -- 172.21.15.5:0/1966377002 >> v1:172.21.15.5:6789/0 conn(0x7f4ad00cfe30 legacy=0x7f4ad00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad4c25700 1 -- 172.21.15.5:0/1966377002 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117064161 0 0) 0x7f4ad015e7a0 con 0x7f4ad00cfe30 2023-10-16T13:48:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad5c27700 1 -- 172.21.15.5:0/1966377002 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00b2c80 con 0x7f4ad015ab10 2023-10-16T13:48:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad5c27700 1 --2- 172.21.15.5:0/1966377002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad015ab10 0x7f4ad015f1f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009840 tx=0x7f4acc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcb9fb3bb98b7fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad4c25700 1 -- 172.21.15.5:0/1966377002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc004230 con 0x7f4ad015ab10 2023-10-16T13:48:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad4c25700 1 -- 172.21.15.5:0/1966377002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc004390 con 0x7f4ad015ab10 2023-10-16T13:48:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.804+0000 7f4ad4c25700 1 -- 172.21.15.5:0/1966377002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0036a0 con 0x7f4ad015ab10 2023-10-16T13:48:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/1966377002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad015ab10 msgr2=0x7f4ad015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/1966377002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad015ab10 0x7f4ad015f1f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009840 tx=0x7f4acc009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/1966377002 shutdown_connections 2023-10-16T13:48:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/1966377002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad015ab10 0x7f4ad015f1f0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/1966377002 >> 172.21.15.5:0/1966377002 conn(0x7f4ad006dae0 msgr2=0x7f4ad006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/1966377002 shutdown_connections 2023-10-16T13:48:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.805+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/1966377002 wait complete. 2023-10-16T13:48:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.806+0000 7f4ad7e8b700 1 Processor -- start 2023-10-16T13:48:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.806+0000 7f4ad7e8b700 1 -- start start 2023-10-16T13:48:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad7e8b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 0x7f4ad00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad7e8b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ad00cfe30 0x7f4ad01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad7e8b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ad015ab10 0x7f4ad0150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad7e8b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01f47d0 con 0x7f4ad00b1f50 2023-10-16T13:48:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad7e8b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c8950 con 0x7f4ad00cfe30 2023-10-16T13:48:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad7e8b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0151050 con 0x7f4ad015ab10 2023-10-16T13:48:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 0x7f4ad00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 0x7f4ad00b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48632/0 (socket says 172.21.15.5:48632) 2023-10-16T13:48:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 -- 172.21.15.5:0/3452342449 learned_addr learned my addr 172.21.15.5:0/3452342449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5426700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ad00cfe30 0x7f4ad01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad6428700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ad015ab10 0x7f4ad0150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 -- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ad015ab10 msgr2=0x7f4ad0150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ad015ab10 0x7f4ad0150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 -- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ad00cfe30 msgr2=0x7f4ad01505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ad00cfe30 0x7f4ad01505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 -- 172.21.15.5:0/3452342449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0094a0 con 0x7f4ad00b1f50 2023-10-16T13:48:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5426700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ad00cfe30 0x7f4ad01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.807+0000 7f4ad5c27700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 0x7f4ad00b1210 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f4acc000c00 tx=0x7f4acc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.808+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc011630 con 0x7f4ad00b1f50 2023-10-16T13:48:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.808+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc01e070 con 0x7f4ad00b1f50 2023-10-16T13:48:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.808+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad015cee0 con 0x7f4ad00b1f50 2023-10-16T13:48:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.808+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0119f0 con 0x7f4ad00b1f50 2023-10-16T13:48:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.808+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad00c8e60 con 0x7f4ad00b1f50 2023-10-16T13:48:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.808+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad00afc10 con 0x7f4ad00b1f50 2023-10-16T13:48:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.810+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f4acc011b50 con 0x7f4ad00b1f50 2023-10-16T13:48:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.810+0000 7f4ac27fc700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ab406b260 0x7f4ab406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.810+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4acc08b330 con 0x7f4ad00b1f50 2023-10-16T13:48:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.811+0000 7f4ad5426700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ab406b260 0x7f4ab406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.811+0000 7f4ad5426700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ab406b260 0x7f4ab406d720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400a8b0 tx=0x7f4ac4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:20.814+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4acc056160 con 0x7f4ad00b1f50 2023-10-16T13:48:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.014+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad00cacc0 con 0x7f4ad00b1f50 2023-10-16T13:48:21.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.015+0000 7f4ac27fc700 1 -- 172.21.15.5:0/3452342449 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f4acc032090 con 0x7f4ad00b1f50 2023-10-16T13:48:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:21.019 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":97,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:19.692329+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ab406b260 msgr2=0x7f4ab406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ab406b260 0x7f4ab406d720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400a8b0 tx=0x7f4ac4008040 comp rx=0 tx=0).stop 2023-10-16T13:48:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 msgr2=0x7f4ad00b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 0x7f4ad00b1210 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f4acc000c00 tx=0x7f4acc004750 comp rx=0 tx=0).stop 2023-10-16T13:48:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 shutdown_connections 2023-10-16T13:48:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4ab406b260 0x7f4ab406d720 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ad015ab10 0x7f4ad0150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00b1f50 0x7f4ad00b1210 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 --2- 172.21.15.5:0/3452342449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ad00cfe30 0x7f4ad01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 >> 172.21.15.5:0/3452342449 conn(0x7f4ad006dae0 msgr2=0x7f4ad00d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 shutdown_connections 2023-10-16T13:48:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.017+0000 7f4ad7e8b700 1 -- 172.21.15.5:0/3452342449 wait complete. 2023-10-16T13:48:21.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:48:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.158+0000 7f681cb94700 1 Processor -- start 2023-10-16T13:48:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.158+0000 7f681cb94700 1 -- start start 2023-10-16T13:48:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f681cb94700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68180cee90 0x7f681815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f681cb94700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681815e6e0 con 0x7f6818157d40 2023-10-16T13:48:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f681cb94700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6818158120 con 0x7f681815e290 2023-10-16T13:48:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f681cb94700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681806e560 con 0x7f68180cee90 2023-10-16T13:48:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f681659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6818157d40 0x7f681806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58644/0 (socket says 172.21.15.5:58644) 2023-10-16T13:48:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f681659c700 1 -- 172.21.15.5:0/80897777 learned_addr learned my addr 172.21.15.5:0/80897777 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f680dd9b700 1 --2- 172.21.15.5:0/80897777 >> v2:172.21.15.5:3300/0 conn(0x7f68180cee90 0x7f681815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f6815d9b700 1 -- 172.21.15.5:0/80897777 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121286841 0 0) 0x7f6808001110 con 0x7f6818157d40 2023-10-16T13:48:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f6815d9b700 1 -- 172.21.15.5:0/80897777 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68040046c0 con 0x7f6818157d40 2023-10-16T13:48:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f680dd9b700 1 -- 172.21.15.5:0/80897777 >> v1:172.21.15.112:6789/0 conn(0x7f681815e290 legacy=0x7f68180cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f680dd9b700 1 -- 172.21.15.5:0/80897777 >> v1:172.21.15.5:6789/0 conn(0x7f6818157d40 legacy=0x7f681806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.159+0000 7f680dd9b700 1 -- 172.21.15.5:0/80897777 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681806a840 con 0x7f68180cee90 2023-10-16T13:48:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f680dd9b700 1 --2- 172.21.15.5:0/80897777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180cee90 0x7f681815dd50 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f6800009840 tx=0x7f6800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a953de57dd080851 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f6815d9b700 1 -- 172.21.15.5:0/80897777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800004230 con 0x7f68180cee90 2023-10-16T13:48:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f6815d9b700 1 -- 172.21.15.5:0/80897777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800004390 con 0x7f68180cee90 2023-10-16T13:48:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f6815d9b700 1 -- 172.21.15.5:0/80897777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000036c0 con 0x7f68180cee90 2023-10-16T13:48:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 -- 172.21.15.5:0/80897777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180cee90 msgr2=0x7f681815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 --2- 172.21.15.5:0/80897777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180cee90 0x7f681815dd50 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f6800009840 tx=0x7f6800009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 -- 172.21.15.5:0/80897777 shutdown_connections 2023-10-16T13:48:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 --2- 172.21.15.5:0/80897777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180cee90 0x7f681815dd50 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 -- 172.21.15.5:0/80897777 >> 172.21.15.5:0/80897777 conn(0x7f68180cc6f0 msgr2=0x7f68180ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 -- 172.21.15.5:0/80897777 shutdown_connections 2023-10-16T13:48:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.160+0000 7f681cb94700 1 -- 172.21.15.5:0/80897777 wait complete. 2023-10-16T13:48:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.162+0000 7f681cb94700 1 Processor -- start 2023-10-16T13:48:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.162+0000 7f681cb94700 1 -- start start 2023-10-16T13:48:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f681cb94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68180cee90 0x7f68181ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f681cb94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 0x7f6818071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f681cb94700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f681815e290 0x7f68180aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f681cb94700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c3480 con 0x7f6818157d40 2023-10-16T13:48:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f681cb94700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c3760 con 0x7f68180cee90 2023-10-16T13:48:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f681cb94700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c3a40 con 0x7f681815e290 2023-10-16T13:48:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f680dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 0x7f6818071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f680dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 0x7f6818071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48648/0 (socket says 172.21.15.5:48648) 2023-10-16T13:48:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.163+0000 7f680dd9b700 1 -- 172.21.15.5:0/2660950516 learned_addr learned my addr 172.21.15.5:0/2660950516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f6816d9d700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f681815e290 0x7f68180aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f681659c700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68180cee90 0x7f68181ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680dd9b700 1 -- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f681815e290 msgr2=0x7f68180aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680dd9b700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f681815e290 0x7f68180aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680dd9b700 1 -- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68180cee90 msgr2=0x7f68181ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680dd9b700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68180cee90 0x7f68181ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680dd9b700 1 -- 172.21.15.5:0/2660950516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000094a0 con 0x7f6818157d40 2023-10-16T13:48:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680dd9b700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 0x7f6818071430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f68000090b0 tx=0x7f6800004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011630 con 0x7f6818157d40 2023-10-16T13:48:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800011790 con 0x7f6818157d40 2023-10-16T13:48:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68180c3d20 con 0x7f6818157d40 2023-10-16T13:48:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011b00 con 0x7f6818157d40 2023-10-16T13:48:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.164+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68180c42e0 con 0x7f6818157d40 2023-10-16T13:48:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.165+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6818067d20 con 0x7f6818157d40 2023-10-16T13:48:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.166+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f6800018040 con 0x7f6818157d40 2023-10-16T13:48:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.166+0000 7f680f7fe700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f67f806b260 0x7f67f806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.166+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f680008a490 con 0x7f6818157d40 2023-10-16T13:48:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.166+0000 7f681659c700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f67f806b260 0x7f67f806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.167+0000 7f681659c700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f67f806b260 0x7f67f806d720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6808005910 tx=0x7f6808009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.171+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68000550c0 con 0x7f6818157d40 2023-10-16T13:48:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:21.424+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f68180c44a0 con 0x7f6818157d40 2023-10-16T13:48:22.262 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-10-16T13:48:22.260+0000 7faf88cce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:48:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.296+0000 7f680f7fe700 1 -- 172.21.15.5:0/2660950516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f68000586e0 con 0x7f6818157d40 2023-10-16T13:48:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f67f806b260 msgr2=0x7f67f806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f67f806b260 0x7f67f806d720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6808005910 tx=0x7f6808009040 comp rx=0 tx=0).stop 2023-10-16T13:48:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 msgr2=0x7f6818071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 0x7f6818071430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f68000090b0 tx=0x7f6800004750 comp rx=0 tx=0).stop 2023-10-16T13:48:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 shutdown_connections 2023-10-16T13:48:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f67f806b260 0x7f67f806d720 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f681815e290 0x7f68180aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68180cee90 0x7f68181ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 --2- 172.21.15.5:0/2660950516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6818157d40 0x7f6818071430 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 >> 172.21.15.5:0/2660950516 conn(0x7f68180cc6f0 msgr2=0x7f6818157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 shutdown_connections 2023-10-16T13:48:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.299+0000 7f681cb94700 1 -- 172.21.15.5:0/2660950516 wait complete. 2023-10-16T13:48:22.317 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:48:22.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:48:22.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.450+0000 7fda5caa5700 1 Processor -- start 2023-10-16T13:48:22.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.450+0000 7fda5caa5700 1 -- start start 2023-10-16T13:48:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda5caa5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda5815e2f0 0x7fda580cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda5caa5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda580b2d60 con 0x7fda5806a840 2023-10-16T13:48:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda5caa5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda580cdd30 con 0x7fda580cd950 2023-10-16T13:48:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda5caa5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda581619a0 con 0x7fda5815e2f0 2023-10-16T13:48:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda56d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda5806a840 0x7fda5806ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58662/0 (socket says 172.21.15.5:58662) 2023-10-16T13:48:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda56d9d700 1 -- 172.21.15.5:0/3869962950 learned_addr learned my addr 172.21.15.5:0/3869962950 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda55d9b700 1 --2- 172.21.15.5:0/3869962950 >> v2:172.21.15.112:3300/0 conn(0x7fda5815e2f0 0x7fda580cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474023358 0 0) 0x7fda580b2d60 con 0x7fda5806a840 2023-10-16T13:48:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.451+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda400035b0 con 0x7fda5806a840 2023-10-16T13:48:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908670000 0 0) 0x7fda400035b0 con 0x7fda5806a840 2023-10-16T13:48:22.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 >> v2:172.21.15.112:3300/0 conn(0x7fda5815e2f0 msgr2=0x7fda580cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:22.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 --2- 172.21.15.5:0/3869962950 >> v2:172.21.15.112:3300/0 conn(0x7fda5815e2f0 0x7fda580cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 >> v1:172.21.15.112:6789/0 conn(0x7fda580cd950 legacy=0x7fda5815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5815e920 con 0x7fda5806a840 2023-10-16T13:48:22.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fda500019f0 con 0x7fda5806a840 2023-10-16T13:48:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 >> v1:172.21.15.5:6789/0 conn(0x7fda5806a840 legacy=0x7fda5806ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda40003a00 0x7fda40003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda40004850 0x7fda40004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40005210 0x7fda4000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda581619a0 con 0x7fda40005210 2023-10-16T13:48:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4000c0b0 con 0x7fda40004850 2023-10-16T13:48:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4000c270 con 0x7fda40003a00 2023-10-16T13:48:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda56d9d700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40005210 0x7fda4000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda40004850 0x7fda40004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda5659c700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda40003a00 0x7fda40003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 -- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda40003a00 msgr2=0x7fda40003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda40003a00 0x7fda40003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 -- 172.21.15.5:0/3869962950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40005210 msgr2=0x7fda4000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40005210 0x7fda4000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 -- 172.21.15.5:0/3869962950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda400035b0 con 0x7fda40004850 2023-10-16T13:48:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda56d9d700 1 -- 172.21.15.5:0/3869962950 reap_dead start 2023-10-16T13:48:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.452+0000 7fda55d9b700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda40004850 0x7fda40004cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda48009b40 tx=0x7fda40005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894e6bb9d1cd6881 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48005a20 con 0x7fda40004850 2023-10-16T13:48:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda48005b80 con 0x7fda40004850 2023-10-16T13:48:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5559a700 1 -- 172.21.15.5:0/3869962950 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4800e6c0 con 0x7fda40004850 2023-10-16T13:48:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 -- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda40004850 msgr2=0x7fda40004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda40004850 0x7fda40004cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda48009b40 tx=0x7fda40005880 comp rx=0 tx=0).stop 2023-10-16T13:48:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 -- 172.21.15.5:0/3869962950 shutdown_connections 2023-10-16T13:48:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 --2- 172.21.15.5:0/3869962950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda40004850 0x7fda40004cd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 -- 172.21.15.5:0/3869962950 >> 172.21.15.5:0/3869962950 conn(0x7fda5806dae0 msgr2=0x7fda5806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 -- 172.21.15.5:0/3869962950 shutdown_connections 2023-10-16T13:48:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.453+0000 7fda5caa5700 1 -- 172.21.15.5:0/3869962950 wait complete. 2023-10-16T13:48:22.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 Processor -- start 2023-10-16T13:48:22.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 -- start start 2023-10-16T13:48:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 0x7fda580ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda581f6e20 0x7fda580c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda580aee50 0x7fda580af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580ad930 con 0x7fda40004850 2023-10-16T13:48:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580b00f0 con 0x7fda580aee50 2023-10-16T13:48:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.455+0000 7fda5caa5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580acdf0 con 0x7fda581f6e20 2023-10-16T13:48:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 0x7fda580ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 0x7fda580ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48666/0 (socket says 172.21.15.5:48666) 2023-10-16T13:48:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 -- 172.21.15.5:0/823584535 learned_addr learned my addr 172.21.15.5:0/823584535 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda55d9b700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda581f6e20 0x7fda580c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda56d9d700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda580aee50 0x7fda580af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 -- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda581f6e20 msgr2=0x7fda580c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda581f6e20 0x7fda580c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 -- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda580aee50 msgr2=0x7fda580af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda580aee50 0x7fda580af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 -- 172.21.15.5:0/823584535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580ad090 con 0x7fda40004850 2023-10-16T13:48:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda56d9d700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda580aee50 0x7fda580af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda55d9b700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda581f6e20 0x7fda580c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5659c700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 0x7fda580ac8b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00f820 tx=0x7fda4c00fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005320 con 0x7fda40004850 2023-10-16T13:48:22.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c005480 con 0x7fda40004850 2023-10-16T13:48:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c006aa0 con 0x7fda40004850 2023-10-16T13:48:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda580ad370 con 0x7fda40004850 2023-10-16T13:48:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.456+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda580af810 con 0x7fda40004850 2023-10-16T13:48:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.457+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda580b03d0 con 0x7fda40004850 2023-10-16T13:48:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.458+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fda4c006c00 con 0x7fda40004850 2023-10-16T13:48:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.458+0000 7fda46ffd700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda3806b260 0x7fda3806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:22.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.458+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda4c089030 con 0x7fda40004850 2023-10-16T13:48:22.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.458+0000 7fda55d9b700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda3806b260 0x7fda3806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:22.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.459+0000 7fda55d9b700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda3806b260 0x7fda3806d720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fda580b1ae0 tx=0x7fda48008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:22.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.463+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda4c0bbca0 con 0x7fda40004850 2023-10-16T13:48:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:22.707+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fda58067d20 con 0x7fda40004850 2023-10-16T13:48:23.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.301+0000 7fda46ffd700 1 -- 172.21.15.5:0/823584535 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda4c053ce0 con 0x7fda40004850 2023-10-16T13:48:23.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda3806b260 msgr2=0x7fda3806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda3806b260 0x7fda3806d720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fda580b1ae0 tx=0x7fda48008030 comp rx=0 tx=0).stop 2023-10-16T13:48:23.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 msgr2=0x7fda580ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 0x7fda580ac8b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00f820 tx=0x7fda4c00fbe0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 shutdown_connections 2023-10-16T13:48:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda580aee50 0x7fda580af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40004850 0x7fda580ac8b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fda3806b260 0x7fda3806d720 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 --2- 172.21.15.5:0/823584535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda581f6e20 0x7fda580c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 >> 172.21.15.5:0/823584535 conn(0x7fda5806dae0 msgr2=0x7fda5806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 shutdown_connections 2023-10-16T13:48:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.304+0000 7fda5caa5700 1 -- 172.21.15.5:0/823584535 wait complete. 2023-10-16T13:48:23.322 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:48:23.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.452+0000 7f1ff8e5f700 1 Processor -- start 2023-10-16T13:48:23.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.452+0000 7f1ff8e5f700 1 -- start start 2023-10-16T13:48:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff8e5f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ff415e030 0x7f1ff40cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff8e5f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ff40ce280 0x7f1ff406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff8e5f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff406adb0 con 0x7f1ff406a840 2023-10-16T13:48:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff8e5f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff406b090 con 0x7f1ff415e030 2023-10-16T13:48:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff8e5f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff406b370 con 0x7f1ff40ce280 2023-10-16T13:48:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ff415e030 0x7f1ff40cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ff415e030 0x7f1ff40cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48674/0 (socket says 172.21.15.5:48674) 2023-10-16T13:48:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 -- 172.21.15.5:0/4979824 learned_addr learned my addr 172.21.15.5:0/4979824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff1d9b700 1 --1- 172.21.15.5:0/4979824 >> v1:172.21.15.5:6789/0 conn(0x7f1ff406a840 0x7f1ff40cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58680/0 (socket says 172.21.15.5:58680) 2023-10-16T13:48:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff2d9d700 1 --2- 172.21.15.5:0/4979824 >> v2:172.21.15.112:3300/0 conn(0x7f1ff40ce280 0x7f1ff406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 -- 172.21.15.5:0/4979824 >> v2:172.21.15.112:3300/0 conn(0x7f1ff40ce280 msgr2=0x7f1ff406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:23.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 --2- 172.21.15.5:0/4979824 >> v2:172.21.15.112:3300/0 conn(0x7f1ff40ce280 0x7f1ff406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 -- 172.21.15.5:0/4979824 >> v1:172.21.15.5:6789/0 conn(0x7f1ff406a840 legacy=0x7f1ff40cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 -- 172.21.15.5:0/4979824 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff406b650 con 0x7f1ff415e030 2023-10-16T13:48:23.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff159a700 1 -- 172.21.15.5:0/4979824 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703410802 0 0) 0x7f1ff406adb0 con 0x7f1ff406a840 2023-10-16T13:48:23.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff259c700 1 --2- 172.21.15.5:0/4979824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40cb3a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4162ac0 tx=0x7f1fe4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5f72fa3f6ddd21 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:23.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff159a700 1 -- 172.21.15.5:0/4979824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400b870 con 0x7f1ff415e030 2023-10-16T13:48:23.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.453+0000 7f1ff159a700 1 -- 172.21.15.5:0/4979824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400b9d0 con 0x7f1ff415e030 2023-10-16T13:48:23.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff159a700 1 -- 172.21.15.5:0/4979824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400bd60 con 0x7f1ff415e030 2023-10-16T13:48:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/4979824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 msgr2=0x7f1ff40cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/4979824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40cb3a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4162ac0 tx=0x7f1fe4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/4979824 shutdown_connections 2023-10-16T13:48:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/4979824 >> v2:172.21.15.112:3300/0 conn(0x7f1ff40ce280 0x7f1ff406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/4979824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40cb3a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/4979824 >> 172.21.15.5:0/4979824 conn(0x7f1ff40cc6f0 msgr2=0x7f1ff40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/4979824 shutdown_connections 2023-10-16T13:48:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.454+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/4979824 wait complete. 2023-10-16T13:48:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.455+0000 7f1ff8e5f700 1 Processor -- start 2023-10-16T13:48:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 -- start start 2023-10-16T13:48:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff406a840 0x7f1ff40b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff40ce280 0x7f1ff4158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40c3130 con 0x7f1ff415e030 2023-10-16T13:48:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40b4a10 con 0x7f1ff40ce280 2023-10-16T13:48:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff8e5f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40b4140 con 0x7f1ff406a840 2023-10-16T13:48:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48684/0 (socket says 172.21.15.5:48684) 2023-10-16T13:48:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.456+0000 7f1ff2d9d700 1 -- 172.21.15.5:0/3784702081 learned_addr learned my addr 172.21.15.5:0/3784702081 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff1d9b700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff40ce280 0x7f1ff4158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff2d9d700 1 -- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff406a840 msgr2=0x7f1ff40b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff259c700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff406a840 0x7f1ff40b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff2d9d700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff406a840 0x7f1ff40b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff2d9d700 1 -- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff40ce280 msgr2=0x7f1ff4158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff2d9d700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff40ce280 0x7f1ff4158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff2d9d700 1 -- 172.21.15.5:0/3784702081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009550 con 0x7f1ff415e030 2023-10-16T13:48:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff1d9b700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff40ce280 0x7f1ff4158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff2d9d700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40c6d40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1fec007d80 tx=0x7f1fec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00ede0 con 0x7f1ff415e030 2023-10-16T13:48:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec014420 con 0x7f1ff415e030 2023-10-16T13:48:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff40c3380 con 0x7f1ff415e030 2023-10-16T13:48:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0147d0 con 0x7f1ff415e030 2023-10-16T13:48:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.457+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff40b46a0 con 0x7f1ff415e030 2023-10-16T13:48:23.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.458+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff40b4b50 con 0x7f1ff415e030 2023-10-16T13:48:23.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.458+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f1fec014930 con 0x7f1ff415e030 2023-10-16T13:48:23.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.459+0000 7f1fe2ffd700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406b260 0x7f1fd406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.459+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fec08a2e0 con 0x7f1ff415e030 2023-10-16T13:48:23.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.459+0000 7f1ff259c700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406b260 0x7f1fd406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.460+0000 7f1ff259c700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406b260 0x7f1fd406d720 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ff406ec00 tx=0x7f1fe4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:23.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.464+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fec054f00 con 0x7f1ff415e030 2023-10-16T13:48:23.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.709+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff40c9d70 con 0x7f1ff415e030 2023-10-16T13:48:23.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.709+0000 7f1fe2ffd700 1 -- 172.21.15.5:0/3784702081 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f1fec058520 con 0x7f1ff415e030 2023-10-16T13:48:23.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:23.713 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:19.692644+0000","modified":"2023-10-16T13:48:22.708850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2462371397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2462371397},{"type":"v1","addr":"172.21.15.5:6835","nonce":2462371397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-16T13:48:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406b260 msgr2=0x7f1fd406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406b260 0x7f1fd406d720 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ff406ec00 tx=0x7f1fe4008030 comp rx=0 tx=0).stop 2023-10-16T13:48:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 msgr2=0x7f1ff40c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40c6d40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1fec007d80 tx=0x7f1fec00e3c0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 shutdown_connections 2023-10-16T13:48:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff415e030 0x7f1ff40c6d40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1fd406b260 0x7f1fd406d720 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ff406a840 0x7f1ff40b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 --2- 172.21.15.5:0/3784702081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff40ce280 0x7f1ff4158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 >> 172.21.15.5:0/3784702081 conn(0x7f1ff40cc6f0 msgr2=0x7f1ff415b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.711+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 shutdown_connections 2023-10-16T13:48:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.712+0000 7f1ff8e5f700 1 -- 172.21.15.5:0/3784702081 wait complete. 2023-10-16T13:48:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2023-10-16T13:48:23.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.849+0000 7f4bbdf97700 1 Processor -- start 2023-10-16T13:48:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.849+0000 7f4bbdf97700 1 -- start start 2023-10-16T13:48:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bbdf97700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4bb80cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bbdf97700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb8158120 con 0x7f4bb806e2b0 2023-10-16T13:48:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bbdf97700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb806a840 con 0x7f4bb806de50 2023-10-16T13:48:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bbdf97700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80caef0 con 0x7f4bb8157d40 2023-10-16T13:48:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bb7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bb806e2b0 0x7f4bb80cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58694/0 (socket says 172.21.15.5:58694) 2023-10-16T13:48:23.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bb7fff700 1 -- 172.21.15.5:0/1002791725 learned_addr learned my addr 172.21.15.5:0/1002791725 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:23.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4bb80cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420155856 0 0) 0x7f4bb8158120 con 0x7f4bb806e2b0 2023-10-16T13:48:23.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.850+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba40035b0 con 0x7f4bb806e2b0 2023-10-16T13:48:23.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111267322 0 0) 0x7f4bb806a840 con 0x7f4bb806de50 2023-10-16T13:48:23.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb8158120 con 0x7f4bb806de50 2023-10-16T13:48:23.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624573761 0 0) 0x7f4ba40035b0 con 0x7f4bb806e2b0 2023-10-16T13:48:23.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 msgr2=0x7f4bb80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:23.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4bb80cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 >> v1:172.21.15.112:6789/0 conn(0x7f4bb806de50 legacy=0x7f4bb815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb806e750 con 0x7f4bb806e2b0 2023-10-16T13:48:23.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f4bb00019f0 con 0x7f4bb806e2b0 2023-10-16T13:48:23.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4bb80cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:23.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 >> v1:172.21.15.5:6789/0 conn(0x7f4bb806e2b0 legacy=0x7f4bb80cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4ba4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba4004850 0x7f4ba4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4ba4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80caef0 con 0x7f4ba4003bc0 2023-10-16T13:48:23.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba400baf0 con 0x7f4ba4004850 2023-10-16T13:48:23.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba400bcb0 con 0x7f4bb8157d40 2023-10-16T13:48:23.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4ba4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb6ffd700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba4004850 0x7f4ba4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb7fff700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4ba4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 -- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 msgr2=0x7f4ba4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4ba4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 -- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba4004850 msgr2=0x7f4ba4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:23.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba4004850 0x7f4ba4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 -- 172.21.15.5:0/1002791725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80094a0 con 0x7f4ba4003bc0 2023-10-16T13:48:23.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb7fff700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb8157d40 0x7f4ba4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:23.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4ba4003fc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009d00 tx=0x7f4ba4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723769f15f3cf1b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:23.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.851+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8009e50 con 0x7f4ba4003bc0 2023-10-16T13:48:23.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800e9a0 con 0x7f4ba4003bc0 2023-10-16T13:48:23.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bb67fc700 1 -- 172.21.15.5:0/1002791725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800ed30 con 0x7f4ba4003bc0 2023-10-16T13:48:23.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bbdf97700 1 -- 172.21.15.5:0/1002791725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 msgr2=0x7f4ba4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/1002791725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4ba4003fc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009d00 tx=0x7f4ba4005880 comp rx=0 tx=0).stop 2023-10-16T13:48:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bb7fff700 1 -- 172.21.15.5:0/1002791725 reap_dead start 2023-10-16T13:48:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bbdf97700 1 -- 172.21.15.5:0/1002791725 shutdown_connections 2023-10-16T13:48:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bbdf97700 1 -- 172.21.15.5:0/1002791725 >> 172.21.15.5:0/1002791725 conn(0x7f4bb80cc6f0 msgr2=0x7f4bb80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bbdf97700 1 -- 172.21.15.5:0/1002791725 shutdown_connections 2023-10-16T13:48:23.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.852+0000 7f4bbdf97700 1 -- 172.21.15.5:0/1002791725 wait complete. 2023-10-16T13:48:23.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.853+0000 7f4bbdf97700 1 Processor -- start 2023-10-16T13:48:23.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 -- start start 2023-10-16T13:48:23.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4bb80c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb81582b0 0x7f4bb8158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb80c6d40 0x7f4bb80c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80c8510 con 0x7f4ba4003bc0 2023-10-16T13:48:23.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb8158c70 con 0x7f4bb80c6d40 2023-10-16T13:48:23.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bbdf97700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb81576f0 con 0x7f4bb81582b0 2023-10-16T13:48:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bb77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4bb80c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bb77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4bb80c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48698/0 (socket says 172.21.15.5:48698) 2023-10-16T13:48:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.854+0000 7f4bb77fe700 1 -- 172.21.15.5:0/3618749491 learned_addr learned my addr 172.21.15.5:0/3618749491 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb7fff700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb80c6d40 0x7f4bb80c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb6ffd700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb81582b0 0x7f4bb8158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb77fe700 1 -- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb81582b0 msgr2=0x7f4bb8158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb81582b0 0x7f4bb8158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb77fe700 1 -- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb80c6d40 msgr2=0x7f4bb80c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb80c6d40 0x7f4bb80c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb77fe700 1 -- 172.21.15.5:0/3618749491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80c4250 con 0x7f4ba4003bc0 2023-10-16T13:48:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bb77fe700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4bb80c22a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800e790 tx=0x7f4ba80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8003ab0 con 0x7f4ba4003bc0 2023-10-16T13:48:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8003c30 con 0x7f4ba4003bc0 2023-10-16T13:48:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb80c76e0 con 0x7f4ba4003bc0 2023-10-16T13:48:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8009e50 con 0x7f4ba4003bc0 2023-10-16T13:48:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.855+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb80c7f50 con 0x7f4ba4003bc0 2023-10-16T13:48:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.856+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb806d6e0 con 0x7f4ba4003bc0 2023-10-16T13:48:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.857+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f4ba8013470 con 0x7f4ba4003bc0 2023-10-16T13:48:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.857+0000 7f4baffff700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4b9806b260 0x7f4b9806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:23.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.857+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ba808b670 con 0x7f4ba4003bc0 2023-10-16T13:48:23.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.857+0000 7f4bb6ffd700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4b9806b260 0x7f4b9806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:23.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.858+0000 7f4bb6ffd700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4b9806b260 0x7f4b9806d720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80b1660 tx=0x7f4ba0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:23.862+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ba80563a0 con 0x7f4ba4003bc0 2023-10-16T13:48:24.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.062+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bb815ead0 con 0x7f4ba4003bc0 2023-10-16T13:48:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.064+0000 7f4baffff700 1 -- 172.21.15.5:0/3618749491 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16444 (secure 0 0 0) 0x7f4ba80599c0 con 0x7f4ba4003bc0 2023-10-16T13:48:24.067 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:24.067 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:21.283240+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:24.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4b9806b260 msgr2=0x7f4b9806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4b9806b260 0x7f4b9806d720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80b1660 tx=0x7f4ba0009040 comp rx=0 tx=0).stop 2023-10-16T13:48:24.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 msgr2=0x7f4bb80c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4bb80c22a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800e790 tx=0x7f4ba80047c0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 shutdown_connections 2023-10-16T13:48:24.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb80c6d40 0x7f4bb80c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba4003bc0 0x7f4bb80c22a0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4b9806b260 0x7f4b9806d720 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 --2- 172.21.15.5:0/3618749491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bb81582b0 0x7f4bb8158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 >> 172.21.15.5:0/3618749491 conn(0x7f4bb80cc6f0 msgr2=0x7f4bb8159750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:24.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 shutdown_connections 2023-10-16T13:48:24.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.066+0000 7f4bbdf97700 1 -- 172.21.15.5:0/3618749491 wait complete. 2023-10-16T13:48:24.081 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:48:24.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:48:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.204+0000 7fcd1a2ca700 1 Processor -- start 2023-10-16T13:48:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.204+0000 7fcd1a2ca700 1 -- start start 2023-10-16T13:48:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd1a2ca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd140cd950 0x7fcd1415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd1a2ca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd1406a840 0x7fcd1406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd1a2ca700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd140cf290 con 0x7fcd140cede0 2023-10-16T13:48:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd1a2ca700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd141619a0 con 0x7fcd140cd950 2023-10-16T13:48:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd1a2ca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1406b1f0 con 0x7fcd1406a840 2023-10-16T13:48:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd140cd950 0x7fcd1415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd140cd950 0x7fcd1415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48706/0 (socket says 172.21.15.5:48706) 2023-10-16T13:48:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 -- 172.21.15.5:0/1167986029 learned_addr learned my addr 172.21.15.5:0/1167986029 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd18867700 1 --2- 172.21.15.5:0/1167986029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd1406a840 0x7fcd1406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 -- 172.21.15.5:0/1167986029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd1406a840 msgr2=0x7fcd1406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 --2- 172.21.15.5:0/1167986029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd1406a840 0x7fcd1406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 -- 172.21.15.5:0/1167986029 >> v1:172.21.15.112:6789/0 conn(0x7fcd140cede0 legacy=0x7fcd1415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.205+0000 7fcd13fff700 1 -- 172.21.15.5:0/1167986029 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140b2d60 con 0x7fcd140cd950 2023-10-16T13:48:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd13fff700 1 --2- 172.21.15.5:0/1167986029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cd950 0x7fcd1415e2f0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098f0 tx=0x7fccfc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18f50ed29d96ed4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd12ffd700 1 -- 172.21.15.5:0/1167986029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00b8a0 con 0x7fcd140cd950 2023-10-16T13:48:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd12ffd700 1 -- 172.21.15.5:0/1167986029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00ba00 con 0x7fcd140cd950 2023-10-16T13:48:24.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd12ffd700 1 -- 172.21.15.5:0/1167986029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00bd90 con 0x7fcd140cd950 2023-10-16T13:48:24.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/1167986029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cd950 msgr2=0x7fcd1415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/1167986029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cd950 0x7fcd1415e2f0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098f0 tx=0x7fccfc009c00 comp rx=0 tx=0).stop 2023-10-16T13:48:24.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/1167986029 shutdown_connections 2023-10-16T13:48:24.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/1167986029 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd1406a840 0x7fcd1406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/1167986029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cd950 0x7fcd1415e2f0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/1167986029 >> 172.21.15.5:0/1167986029 conn(0x7fcd1406dae0 msgr2=0x7fcd1406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/1167986029 shutdown_connections 2023-10-16T13:48:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.206+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/1167986029 wait complete. 2023-10-16T13:48:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.208+0000 7fcd1a2ca700 1 Processor -- start 2023-10-16T13:48:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.208+0000 7fcd1a2ca700 1 -- start start 2023-10-16T13:48:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.208+0000 7fcd1a2ca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd1406a840 0x7fcd141556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.208+0000 7fcd1a2ca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd140cd950 0x7fcd140c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd1a2ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 0x7fcd140c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd1a2ca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c6c80 con 0x7fcd140cede0 2023-10-16T13:48:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd1a2ca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c6420 con 0x7fcd1406a840 2023-10-16T13:48:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd1a2ca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c66c0 con 0x7fcd140cd950 2023-10-16T13:48:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 0x7fcd140c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 0x7fcd140c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48716/0 (socket says 172.21.15.5:48716) 2023-10-16T13:48:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 -- 172.21.15.5:0/2685711298 learned_addr learned my addr 172.21.15.5:0/2685711298 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd137fe700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd140cd950 0x7fcd140c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd13fff700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd1406a840 0x7fcd141556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 -- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd140cd950 msgr2=0x7fcd140c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd140cd950 0x7fcd140c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 -- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd1406a840 msgr2=0x7fcd141556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd1406a840 0x7fcd141556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 -- 172.21.15.5:0/2685711298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009550 con 0x7fcd140cede0 2023-10-16T13:48:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd18867700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 0x7fcd140c5ee0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00cc30 tx=0x7fcd0c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00aa50 con 0x7fcd140cede0 2023-10-16T13:48:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00abb0 con 0x7fcd140cede0 2023-10-16T13:48:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd140c69a0 con 0x7fcd140cede0 2023-10-16T13:48:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c003a20 con 0x7fcd140cede0 2023-10-16T13:48:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.209+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd140c4480 con 0x7fcd140cede0 2023-10-16T13:48:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.210+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd140c3fe0 con 0x7fcd140cede0 2023-10-16T13:48:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.211+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fcd0c00f3f0 con 0x7fcd140cede0 2023-10-16T13:48:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.211+0000 7fcd10ff9700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccf406b260 0x7fccf406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.211+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd0c089dc0 con 0x7fcd140cede0 2023-10-16T13:48:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.211+0000 7fcd13fff700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccf406b260 0x7fccf406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.212+0000 7fcd13fff700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccf406b260 0x7fccf406d720 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009c40 tx=0x7fccfc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:24.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.216+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd0c054850 con 0x7fcd140cede0 2023-10-16T13:48:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.411+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd1415e920 con 0x7fccf406b260 2023-10-16T13:48:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.419+0000 7fcd10ff9700 1 -- 172.21.15.5:0/2685711298 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289647 (secure 0 0 0) 0x7fccfc00bbf0 con 0x7fccf406b260 2023-10-16T13:48:24.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:24.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccf406b260 msgr2=0x7fccf406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccf406b260 0x7fccf406d720 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009c40 tx=0x7fccfc008030 comp rx=0 tx=0).stop 2023-10-16T13:48:24.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 msgr2=0x7fcd140c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 0x7fcd140c5ee0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00cc30 tx=0x7fcd0c00cf40 comp rx=0 tx=0).stop 2023-10-16T13:48:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 shutdown_connections 2023-10-16T13:48:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd140cede0 0x7fcd140c5ee0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd1406a840 0x7fcd141556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fccf406b260 0x7fccf406d720 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 --2- 172.21.15.5:0/2685711298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd140cd950 0x7fcd140c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 >> 172.21.15.5:0/2685711298 conn(0x7fcd1406dae0 msgr2=0x7fcd14160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 shutdown_connections 2023-10-16T13:48:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.422+0000 7fcd1a2ca700 1 -- 172.21.15.5:0/2685711298 wait complete. 2023-10-16T13:48:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:48:24.437 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2023-10-16T13:48:23.609504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260248,"kb_used_data":10752,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714472,"statfs":{"total":773094113280,"available":772827619328,"internally_reserved":0,"allocated":11010048,"data_stored":5426374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.348837"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777365+0000","last_change":"2023-10-16T13:48:20.307977+0000","last_active":"2023-10-16T13:48:21.777365+0000","last_peered":"2023-10-16T13:48:21.777365+0000","last_clean":"2023-10-16T13:48:21.777365+0000","last_became_active":"2023-10-16T13:48:20.307641+0000","last_became_peered":"2023-10-16T13:48:20.307641+0000","last_unstale":"2023-10-16T13:48:21.777365+0000","last_undegraded":"2023-10-16T13:48:21.777365+0000","last_fullsized":"2023-10-16T13:48:21.777365+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:26:34.476562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300657+0000","last_change":"2023-10-16T13:48:20.296751+0000","last_active":"2023-10-16T13:48:21.300657+0000","last_peered":"2023-10-16T13:48:21.300657+0000","last_clean":"2023-10-16T13:48:21.300657+0000","last_became_active":"2023-10-16T13:48:20.296449+0000","last_became_peered":"2023-10-16T13:48:20.296449+0000","last_unstale":"2023-10-16T13:48:21.300657+0000","last_undegraded":"2023-10-16T13:48:21.300657+0000","last_fullsized":"2023-10-16T13:48:21.300657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777994+0000","last_change":"2023-10-16T13:48:20.289215+0000","last_active":"2023-10-16T13:48:21.777994+0000","last_peered":"2023-10-16T13:48:21.777994+0000","last_clean":"2023-10-16T13:48:21.777994+0000","last_became_active":"2023-10-16T13:48:20.288551+0000","last_became_peered":"2023-10-16T13:48:20.288551+0000","last_unstale":"2023-10-16T13:48:21.777994+0000","last_undegraded":"2023-10-16T13:48:21.777994+0000","last_fullsized":"2023-10-16T13:48:21.777994+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:42.878220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777308+0000","last_change":"2023-10-16T13:48:20.299369+0000","last_active":"2023-10-16T13:48:21.777308+0000","last_peered":"2023-10-16T13:48:21.777308+0000","last_clean":"2023-10-16T13:48:21.777308+0000","last_became_active":"2023-10-16T13:48:20.298980+0000","last_became_peered":"2023-10-16T13:48:20.298980+0000","last_unstale":"2023-10-16T13:48:21.777308+0000","last_undegraded":"2023-10-16T13:48:21.777308+0000","last_fullsized":"2023-10-16T13:48:21.777308+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:49:06.215331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.397276+0000","last_change":"2023-10-16T13:48:20.284785+0000","last_active":"2023-10-16T13:48:21.397276+0000","last_peered":"2023-10-16T13:48:21.397276+0000","last_clean":"2023-10-16T13:48:21.397276+0000","last_became_active":"2023-10-16T13:48:20.284493+0000","last_became_peered":"2023-10-16T13:48:20.284493+0000","last_unstale":"2023-10-16T13:48:21.397276+0000","last_undegraded":"2023-10-16T13:48:21.397276+0000","last_fullsized":"2023-10-16T13:48:21.397276+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:32:26.125908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752019+0000","last_change":"2023-10-16T13:48:20.283919+0000","last_active":"2023-10-16T13:48:21.752019+0000","last_peered":"2023-10-16T13:48:21.752019+0000","last_clean":"2023-10-16T13:48:21.752019+0000","last_became_active":"2023-10-16T13:48:20.283108+0000","last_became_peered":"2023-10-16T13:48:20.283108+0000","last_unstale":"2023-10-16T13:48:21.752019+0000","last_undegraded":"2023-10-16T13:48:21.752019+0000","last_fullsized":"2023-10-16T13:48:21.752019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:44.686693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299636+0000","last_change":"2023-10-16T13:48:20.291920+0000","last_active":"2023-10-16T13:48:21.299636+0000","last_peered":"2023-10-16T13:48:21.299636+0000","last_clean":"2023-10-16T13:48:21.299636+0000","last_became_active":"2023-10-16T13:48:20.291628+0000","last_became_peered":"2023-10-16T13:48:20.291628+0000","last_unstale":"2023-10-16T13:48:21.299636+0000","last_undegraded":"2023-10-16T13:48:21.299636+0000","last_fullsized":"2023-10-16T13:48:21.299636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:30.684147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777011+0000","last_change":"2023-10-16T13:48:20.284877+0000","last_active":"2023-10-16T13:48:21.777011+0000","last_peered":"2023-10-16T13:48:21.777011+0000","last_clean":"2023-10-16T13:48:21.777011+0000","last_became_active":"2023-10-16T13:48:20.284429+0000","last_became_peered":"2023-10-16T13:48:20.284429+0000","last_unstale":"2023-10-16T13:48:21.777011+0000","last_undegraded":"2023-10-16T13:48:21.777011+0000","last_fullsized":"2023-10-16T13:48:21.777011+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:07.506556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777280+0000","last_change":"2023-10-16T13:48:20.305005+0000","last_active":"2023-10-16T13:48:21.777280+0000","last_peered":"2023-10-16T13:48:21.777280+0000","last_clean":"2023-10-16T13:48:21.777280+0000","last_became_active":"2023-10-16T13:48:20.304687+0000","last_became_peered":"2023-10-16T13:48:20.304687+0000","last_unstale":"2023-10-16T13:48:21.777280+0000","last_undegraded":"2023-10-16T13:48:21.777280+0000","last_fullsized":"2023-10-16T13:48:21.777280+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:00.210264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777107+0000","last_change":"2023-10-16T13:48:20.296957+0000","last_active":"2023-10-16T13:48:21.777107+0000","last_peered":"2023-10-16T13:48:21.777107+0000","last_clean":"2023-10-16T13:48:21.777107+0000","last_became_active":"2023-10-16T13:48:20.296692+0000","last_became_peered":"2023-10-16T13:48:20.296692+0000","last_unstale":"2023-10-16T13:48:21.777107+0000","last_undegraded":"2023-10-16T13:48:21.777107+0000","last_fullsized":"2023-10-16T13:48:21.777107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:04.750664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300632+0000","last_change":"2023-10-16T13:48:20.293828+0000","last_active":"2023-10-16T13:48:21.300632+0000","last_peered":"2023-10-16T13:48:21.300632+0000","last_clean":"2023-10-16T13:48:21.300632+0000","last_became_active":"2023-10-16T13:48:20.292880+0000","last_became_peered":"2023-10-16T13:48:20.292880+0000","last_unstale":"2023-10-16T13:48:21.300632+0000","last_undegraded":"2023-10-16T13:48:21.300632+0000","last_fullsized":"2023-10-16T13:48:21.300632+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777211+0000","last_change":"2023-10-16T13:48:20.305071+0000","last_active":"2023-10-16T13:48:21.777211+0000","last_peered":"2023-10-16T13:48:21.777211+0000","last_clean":"2023-10-16T13:48:21.777211+0000","last_became_active":"2023-10-16T13:48:20.299651+0000","last_became_peered":"2023-10-16T13:48:20.299651+0000","last_unstale":"2023-10-16T13:48:21.777211+0000","last_undegraded":"2023-10-16T13:48:21.777211+0000","last_fullsized":"2023-10-16T13:48:21.777211+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:42.062479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777760+0000","last_change":"2023-10-16T13:48:20.285596+0000","last_active":"2023-10-16T13:48:21.777760+0000","last_peered":"2023-10-16T13:48:21.777760+0000","last_clean":"2023-10-16T13:48:21.777760+0000","last_became_active":"2023-10-16T13:48:20.285316+0000","last_became_peered":"2023-10-16T13:48:20.285316+0000","last_unstale":"2023-10-16T13:48:21.777760+0000","last_undegraded":"2023-10-16T13:48:21.777760+0000","last_fullsized":"2023-10-16T13:48:21.777760+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:22.997096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777062+0000","last_change":"2023-10-16T13:48:20.289328+0000","last_active":"2023-10-16T13:48:21.777062+0000","last_peered":"2023-10-16T13:48:21.777062+0000","last_clean":"2023-10-16T13:48:21.777062+0000","last_became_active":"2023-10-16T13:48:20.289041+0000","last_became_peered":"2023-10-16T13:48:20.289041+0000","last_unstale":"2023-10-16T13:48:21.777062+0000","last_undegraded":"2023-10-16T13:48:21.777062+0000","last_fullsized":"2023-10-16T13:48:21.777062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:27.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752036+0000","last_change":"2023-10-16T13:48:20.293909+0000","last_active":"2023-10-16T13:48:21.752036+0000","last_peered":"2023-10-16T13:48:21.752036+0000","last_clean":"2023-10-16T13:48:21.752036+0000","last_became_active":"2023-10-16T13:48:20.293629+0000","last_became_peered":"2023-10-16T13:48:20.293629+0000","last_unstale":"2023-10-16T13:48:21.752036+0000","last_undegraded":"2023-10-16T13:48:21.752036+0000","last_fullsized":"2023-10-16T13:48:21.752036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:54:07.291204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776610+0000","last_change":"2023-10-16T13:48:20.295911+0000","last_active":"2023-10-16T13:48:21.776610+0000","last_peered":"2023-10-16T13:48:21.776610+0000","last_clean":"2023-10-16T13:48:21.776610+0000","last_became_active":"2023-10-16T13:48:20.295636+0000","last_became_peered":"2023-10-16T13:48:20.295636+0000","last_unstale":"2023-10-16T13:48:21.776610+0000","last_undegraded":"2023-10-16T13:48:21.776610+0000","last_fullsized":"2023-10-16T13:48:21.776610+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299768+0000","last_change":"2023-10-16T13:48:20.293564+0000","last_active":"2023-10-16T13:48:21.299768+0000","last_peered":"2023-10-16T13:48:21.299768+0000","last_clean":"2023-10-16T13:48:21.299768+0000","last_became_active":"2023-10-16T13:48:20.293332+0000","last_became_peered":"2023-10-16T13:48:20.293332+0000","last_unstale":"2023-10-16T13:48:21.299768+0000","last_undegraded":"2023-10-16T13:48:21.299768+0000","last_fullsized":"2023-10-16T13:48:21.299768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:13:30.130837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777251+0000","last_change":"2023-10-16T13:48:20.290500+0000","last_active":"2023-10-16T13:48:21.777251+0000","last_peered":"2023-10-16T13:48:21.777251+0000","last_clean":"2023-10-16T13:48:21.777251+0000","last_became_active":"2023-10-16T13:48:20.290210+0000","last_became_peered":"2023-10-16T13:48:20.290210+0000","last_unstale":"2023-10-16T13:48:21.777251+0000","last_undegraded":"2023-10-16T13:48:21.777251+0000","last_fullsized":"2023-10-16T13:48:21.777251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:59.367459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.778019+0000","last_change":"2023-10-16T13:48:20.287584+0000","last_active":"2023-10-16T13:48:21.778019+0000","last_peered":"2023-10-16T13:48:21.778019+0000","last_clean":"2023-10-16T13:48:21.778019+0000","last_became_active":"2023-10-16T13:48:20.287308+0000","last_became_peered":"2023-10-16T13:48:20.287308+0000","last_unstale":"2023-10-16T13:48:21.778019+0000","last_undegraded":"2023-10-16T13:48:21.778019+0000","last_fullsized":"2023-10-16T13:48:21.778019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:04.750664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300603+0000","last_change":"2023-10-16T13:48:20.292821+0000","last_active":"2023-10-16T13:48:21.300603+0000","last_peered":"2023-10-16T13:48:21.300603+0000","last_clean":"2023-10-16T13:48:21.300603+0000","last_became_active":"2023-10-16T13:48:20.292529+0000","last_became_peered":"2023-10-16T13:48:20.292529+0000","last_unstale":"2023-10-16T13:48:21.300603+0000","last_undegraded":"2023-10-16T13:48:21.300603+0000","last_fullsized":"2023-10-16T13:48:21.300603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:27.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300233+0000","last_change":"2023-10-16T13:48:20.294695+0000","last_active":"2023-10-16T13:48:21.300233+0000","last_peered":"2023-10-16T13:48:21.300233+0000","last_clean":"2023-10-16T13:48:21.300233+0000","last_became_active":"2023-10-16T13:48:20.293279+0000","last_became_peered":"2023-10-16T13:48:20.293279+0000","last_unstale":"2023-10-16T13:48:21.300233+0000","last_undegraded":"2023-10-16T13:48:21.300233+0000","last_fullsized":"2023-10-16T13:48:21.300233+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:36.293674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294126+0000","last_change":"2023-10-16T13:48:20.289942+0000","last_active":"2023-10-16T13:48:21.294126+0000","last_peered":"2023-10-16T13:48:21.294126+0000","last_clean":"2023-10-16T13:48:21.294126+0000","last_became_active":"2023-10-16T13:48:20.289509+0000","last_became_peered":"2023-10-16T13:48:20.289509+0000","last_unstale":"2023-10-16T13:48:21.294126+0000","last_undegraded":"2023-10-16T13:48:21.294126+0000","last_fullsized":"2023-10-16T13:48:21.294126+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:22.997096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299871+0000","last_change":"2023-10-16T13:48:20.292153+0000","last_active":"2023-10-16T13:48:21.299871+0000","last_peered":"2023-10-16T13:48:21.299871+0000","last_clean":"2023-10-16T13:48:21.299871+0000","last_became_active":"2023-10-16T13:48:20.291850+0000","last_became_peered":"2023-10-16T13:48:20.291850+0000","last_unstale":"2023-10-16T13:48:21.299871+0000","last_undegraded":"2023-10-16T13:48:21.299871+0000","last_fullsized":"2023-10-16T13:48:21.299871+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:25.483398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.293878+0000","last_change":"2023-10-16T13:48:20.291883+0000","last_active":"2023-10-16T13:48:21.293878+0000","last_peered":"2023-10-16T13:48:21.293878+0000","last_clean":"2023-10-16T13:48:21.293878+0000","last_became_active":"2023-10-16T13:48:20.291325+0000","last_became_peered":"2023-10-16T13:48:20.291325+0000","last_unstale":"2023-10-16T13:48:21.293878+0000","last_undegraded":"2023-10-16T13:48:21.293878+0000","last_fullsized":"2023-10-16T13:48:21.293878+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:27.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299928+0000","last_change":"2023-10-16T13:48:20.293564+0000","last_active":"2023-10-16T13:48:21.299928+0000","last_peered":"2023-10-16T13:48:21.299928+0000","last_clean":"2023-10-16T13:48:21.299928+0000","last_became_active":"2023-10-16T13:48:20.292887+0000","last_became_peered":"2023-10-16T13:48:20.292887+0000","last_unstale":"2023-10-16T13:48:21.299928+0000","last_undegraded":"2023-10-16T13:48:21.299928+0000","last_fullsized":"2023-10-16T13:48:21.299928+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:16.094108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777220+0000","last_change":"2023-10-16T13:48:20.296181+0000","last_active":"2023-10-16T13:48:21.777220+0000","last_peered":"2023-10-16T13:48:21.777220+0000","last_clean":"2023-10-16T13:48:21.777220+0000","last_became_active":"2023-10-16T13:48:20.295791+0000","last_became_peered":"2023-10-16T13:48:20.295791+0000","last_unstale":"2023-10-16T13:48:21.777220+0000","last_undegraded":"2023-10-16T13:48:21.777220+0000","last_fullsized":"2023-10-16T13:48:21.777220+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:20:53.370301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752254+0000","last_change":"2023-10-16T13:48:20.296029+0000","last_active":"2023-10-16T13:48:21.752254+0000","last_peered":"2023-10-16T13:48:21.752254+0000","last_clean":"2023-10-16T13:48:21.752254+0000","last_became_active":"2023-10-16T13:48:20.295764+0000","last_became_peered":"2023-10-16T13:48:20.295764+0000","last_unstale":"2023-10-16T13:48:21.752254+0000","last_undegraded":"2023-10-16T13:48:21.752254+0000","last_fullsized":"2023-10-16T13:48:21.752254+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:51.682151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294069+0000","last_change":"2023-10-16T13:48:20.309762+0000","last_active":"2023-10-16T13:48:21.294069+0000","last_peered":"2023-10-16T13:48:21.294069+0000","last_clean":"2023-10-16T13:48:21.294069+0000","last_became_active":"2023-10-16T13:48:20.309428+0000","last_became_peered":"2023-10-16T13:48:20.309428+0000","last_unstale":"2023-10-16T13:48:21.294069+0000","last_undegraded":"2023-10-16T13:48:21.294069+0000","last_fullsized":"2023-10-16T13:48:21.294069+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:15.720458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300312+0000","last_change":"2023-10-16T13:48:20.297873+0000","last_active":"2023-10-16T13:48:21.300312+0000","last_peered":"2023-10-16T13:48:21.300312+0000","last_clean":"2023-10-16T13:48:21.300312+0000","last_became_active":"2023-10-16T13:48:20.297574+0000","last_became_peered":"2023-10-16T13:48:20.297574+0000","last_unstale":"2023-10-16T13:48:21.300312+0000","last_undegraded":"2023-10-16T13:48:21.300312+0000","last_fullsized":"2023-10-16T13:48:21.300312+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:27.518395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299943+0000","last_change":"2023-10-16T13:48:20.291799+0000","last_active":"2023-10-16T13:48:21.299943+0000","last_peered":"2023-10-16T13:48:21.299943+0000","last_clean":"2023-10-16T13:48:21.299943+0000","last_became_active":"2023-10-16T13:48:20.291322+0000","last_became_peered":"2023-10-16T13:48:20.291322+0000","last_unstale":"2023-10-16T13:48:21.299943+0000","last_undegraded":"2023-10-16T13:48:21.299943+0000","last_fullsized":"2023-10-16T13:48:21.299943+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:50.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776635+0000","last_change":"2023-10-16T13:48:20.299539+0000","last_active":"2023-10-16T13:48:21.776635+0000","last_peered":"2023-10-16T13:48:21.776635+0000","last_clean":"2023-10-16T13:48:21.776635+0000","last_became_active":"2023-10-16T13:48:20.299120+0000","last_became_peered":"2023-10-16T13:48:20.299120+0000","last_unstale":"2023-10-16T13:48:21.776635+0000","last_undegraded":"2023-10-16T13:48:21.776635+0000","last_fullsized":"2023-10-16T13:48:21.776635+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.751976+0000","last_change":"2023-10-16T13:48:20.283829+0000","last_active":"2023-10-16T13:48:21.751976+0000","last_peered":"2023-10-16T13:48:21.751976+0000","last_clean":"2023-10-16T13:48:21.751976+0000","last_became_active":"2023-10-16T13:48:20.283529+0000","last_became_peered":"2023-10-16T13:48:20.283529+0000","last_unstale":"2023-10-16T13:48:21.751976+0000","last_undegraded":"2023-10-16T13:48:21.751976+0000","last_fullsized":"2023-10-16T13:48:21.751976+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:35:12.445685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752267+0000","last_change":"2023-10-16T13:48:20.283625+0000","last_active":"2023-10-16T13:48:21.752267+0000","last_peered":"2023-10-16T13:48:21.752267+0000","last_clean":"2023-10-16T13:48:21.752267+0000","last_became_active":"2023-10-16T13:48:20.283116+0000","last_became_peered":"2023-10-16T13:48:20.283116+0000","last_unstale":"2023-10-16T13:48:21.752267+0000","last_undegraded":"2023-10-16T13:48:21.752267+0000","last_fullsized":"2023-10-16T13:48:21.752267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:18.179799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"97'4","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.308433+0000","last_change":"2023-10-16T13:48:19.279945+0000","last_active":"2023-10-16T13:48:20.308433+0000","last_peered":"2023-10-16T13:48:20.308433+0000","last_clean":"2023-10-16T13:48:20.308433+0000","last_became_active":"2023-10-16T13:48:19.279685+0000","last_became_peered":"2023-10-16T13:48:19.279685+0000","last_unstale":"2023-10-16T13:48:20.308433+0000","last_undegraded":"2023-10-16T13:48:20.308433+0000","last_fullsized":"2023-10-16T13:48:20.308433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:03.270678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777564+0000","last_change":"2023-10-16T13:48:20.294229+0000","last_active":"2023-10-16T13:48:21.777564+0000","last_peered":"2023-10-16T13:48:21.777564+0000","last_clean":"2023-10-16T13:48:21.777564+0000","last_became_active":"2023-10-16T13:48:20.293909+0000","last_became_peered":"2023-10-16T13:48:20.293909+0000","last_unstale":"2023-10-16T13:48:21.777564+0000","last_undegraded":"2023-10-16T13:48:21.777564+0000","last_fullsized":"2023-10-16T13:48:21.777564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:50.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.306135+0000","last_change":"2023-10-16T13:48:19.279814+0000","last_active":"2023-10-16T13:48:20.306135+0000","last_peered":"2023-10-16T13:48:20.306135+0000","last_clean":"2023-10-16T13:48:20.306135+0000","last_became_active":"2023-10-16T13:48:19.279522+0000","last_became_peered":"2023-10-16T13:48:19.279522+0000","last_unstale":"2023-10-16T13:48:20.306135+0000","last_undegraded":"2023-10-16T13:48:20.306135+0000","last_fullsized":"2023-10-16T13:48:20.306135+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:35.288957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752319+0000","last_change":"2023-10-16T13:48:20.284245+0000","last_active":"2023-10-16T13:48:21.752319+0000","last_peered":"2023-10-16T13:48:21.752319+0000","last_clean":"2023-10-16T13:48:21.752319+0000","last_became_active":"2023-10-16T13:48:20.283245+0000","last_became_peered":"2023-10-16T13:48:20.283245+0000","last_unstale":"2023-10-16T13:48:21.752319+0000","last_undegraded":"2023-10-16T13:48:21.752319+0000","last_fullsized":"2023-10-16T13:48:21.752319+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:01.013407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.307124+0000","last_change":"2023-10-16T13:48:19.290327+0000","last_active":"2023-10-16T13:48:20.307124+0000","last_peered":"2023-10-16T13:48:20.307124+0000","last_clean":"2023-10-16T13:48:20.307124+0000","last_became_active":"2023-10-16T13:48:19.290024+0000","last_became_peered":"2023-10-16T13:48:19.290024+0000","last_unstale":"2023-10-16T13:48:20.307124+0000","last_undegraded":"2023-10-16T13:48:20.307124+0000","last_fullsized":"2023-10-16T13:48:20.307124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:13:27.586398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.778093+0000","last_change":"2023-10-16T13:48:20.290071+0000","last_active":"2023-10-16T13:48:21.778093+0000","last_peered":"2023-10-16T13:48:21.778093+0000","last_clean":"2023-10-16T13:48:21.778093+0000","last_became_active":"2023-10-16T13:48:20.289503+0000","last_became_peered":"2023-10-16T13:48:20.289503+0000","last_unstale":"2023-10-16T13:48:21.778093+0000","last_undegraded":"2023-10-16T13:48:21.778093+0000","last_fullsized":"2023-10-16T13:48:21.778093+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:17.622282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.307985+0000","last_change":"2023-10-16T13:48:19.290456+0000","last_active":"2023-10-16T13:48:20.307985+0000","last_peered":"2023-10-16T13:48:20.307985+0000","last_clean":"2023-10-16T13:48:20.307985+0000","last_became_active":"2023-10-16T13:48:19.290106+0000","last_became_peered":"2023-10-16T13:48:19.290106+0000","last_unstale":"2023-10-16T13:48:20.307985+0000","last_undegraded":"2023-10-16T13:48:20.307985+0000","last_fullsized":"2023-10-16T13:48:20.307985+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:12.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776683+0000","last_change":"2023-10-16T13:48:20.304670+0000","last_active":"2023-10-16T13:48:21.776683+0000","last_peered":"2023-10-16T13:48:21.776683+0000","last_clean":"2023-10-16T13:48:21.776683+0000","last_became_active":"2023-10-16T13:48:20.304380+0000","last_became_peered":"2023-10-16T13:48:20.304380+0000","last_unstale":"2023-10-16T13:48:21.776683+0000","last_undegraded":"2023-10-16T13:48:21.776683+0000","last_fullsized":"2023-10-16T13:48:21.776683+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:15.720458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.306629+0000","last_change":"2023-10-16T13:48:19.281318+0000","last_active":"2023-10-16T13:48:20.306629+0000","last_peered":"2023-10-16T13:48:20.306629+0000","last_clean":"2023-10-16T13:48:20.306629+0000","last_became_active":"2023-10-16T13:48:19.281097+0000","last_became_peered":"2023-10-16T13:48:19.281097+0000","last_unstale":"2023-10-16T13:48:20.306629+0000","last_undegraded":"2023-10-16T13:48:20.306629+0000","last_fullsized":"2023-10-16T13:48:20.306629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:23:11.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300395+0000","last_change":"2023-10-16T13:48:20.296379+0000","last_active":"2023-10-16T13:48:21.300395+0000","last_peered":"2023-10-16T13:48:21.300395+0000","last_clean":"2023-10-16T13:48:21.300395+0000","last_became_active":"2023-10-16T13:48:20.295927+0000","last_became_peered":"2023-10-16T13:48:20.295927+0000","last_unstale":"2023-10-16T13:48:21.300395+0000","last_undegraded":"2023-10-16T13:48:21.300395+0000","last_fullsized":"2023-10-16T13:48:21.300395+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:57.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.311332+0000","last_change":"2023-10-16T13:48:19.278066+0000","last_active":"2023-10-16T13:48:20.311332+0000","last_peered":"2023-10-16T13:48:20.311332+0000","last_clean":"2023-10-16T13:48:20.311332+0000","last_became_active":"2023-10-16T13:48:19.277716+0000","last_became_peered":"2023-10-16T13:48:19.277716+0000","last_unstale":"2023-10-16T13:48:20.311332+0000","last_undegraded":"2023-10-16T13:48:20.311332+0000","last_fullsized":"2023-10-16T13:48:20.311332+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:35.288957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776707+0000","last_change":"2023-10-16T13:48:20.303848+0000","last_active":"2023-10-16T13:48:21.776707+0000","last_peered":"2023-10-16T13:48:21.776707+0000","last_clean":"2023-10-16T13:48:21.776707+0000","last_became_active":"2023-10-16T13:48:20.299823+0000","last_became_peered":"2023-10-16T13:48:20.299823+0000","last_unstale":"2023-10-16T13:48:21.776707+0000","last_undegraded":"2023-10-16T13:48:21.776707+0000","last_fullsized":"2023-10-16T13:48:21.776707+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:22.997096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.283869+0000","last_change":"2023-10-16T13:48:19.278207+0000","last_active":"2023-10-16T13:48:20.283869+0000","last_peered":"2023-10-16T13:48:20.283869+0000","last_clean":"2023-10-16T13:48:20.283869+0000","last_became_active":"2023-10-16T13:48:19.277948+0000","last_became_peered":"2023-10-16T13:48:19.277948+0000","last_unstale":"2023-10-16T13:48:20.283869+0000","last_undegraded":"2023-10-16T13:48:20.283869+0000","last_fullsized":"2023-10-16T13:48:20.283869+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:18.472716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299724+0000","last_change":"2023-10-16T13:48:20.292127+0000","last_active":"2023-10-16T13:48:21.299724+0000","last_peered":"2023-10-16T13:48:21.299724+0000","last_clean":"2023-10-16T13:48:21.299724+0000","last_became_active":"2023-10-16T13:48:20.291837+0000","last_became_peered":"2023-10-16T13:48:20.291837+0000","last_unstale":"2023-10-16T13:48:21.299724+0000","last_undegraded":"2023-10-16T13:48:21.299724+0000","last_fullsized":"2023-10-16T13:48:21.299724+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:59.367459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.299559+0000","last_change":"2023-10-16T13:48:19.287566+0000","last_active":"2023-10-16T13:48:20.299559+0000","last_peered":"2023-10-16T13:48:20.299559+0000","last_clean":"2023-10-16T13:48:20.299559+0000","last_became_active":"2023-10-16T13:48:19.287308+0000","last_became_peered":"2023-10-16T13:48:19.287308+0000","last_unstale":"2023-10-16T13:48:20.299559+0000","last_undegraded":"2023-10-16T13:48:20.299559+0000","last_fullsized":"2023-10-16T13:48:20.299559+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:16.276601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300259+0000","last_change":"2023-10-16T13:48:20.293619+0000","last_active":"2023-10-16T13:48:21.300259+0000","last_peered":"2023-10-16T13:48:21.300259+0000","last_clean":"2023-10-16T13:48:21.300259+0000","last_became_active":"2023-10-16T13:48:20.293347+0000","last_became_peered":"2023-10-16T13:48:20.293347+0000","last_unstale":"2023-10-16T13:48:21.300259+0000","last_undegraded":"2023-10-16T13:48:21.300259+0000","last_fullsized":"2023-10-16T13:48:21.300259+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:35:12.445685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.280214+0000","last_change":"2023-10-16T13:48:19.290003+0000","last_active":"2023-10-16T13:48:20.280214+0000","last_peered":"2023-10-16T13:48:20.280214+0000","last_clean":"2023-10-16T13:48:20.280214+0000","last_became_active":"2023-10-16T13:48:19.289671+0000","last_became_peered":"2023-10-16T13:48:19.289671+0000","last_unstale":"2023-10-16T13:48:20.280214+0000","last_undegraded":"2023-10-16T13:48:20.280214+0000","last_fullsized":"2023-10-16T13:48:20.280214+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:51.748248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777612+0000","last_change":"2023-10-16T13:48:20.295988+0000","last_active":"2023-10-16T13:48:21.777612+0000","last_peered":"2023-10-16T13:48:21.777612+0000","last_clean":"2023-10-16T13:48:21.777612+0000","last_became_active":"2023-10-16T13:48:20.295693+0000","last_became_peered":"2023-10-16T13:48:20.295693+0000","last_unstale":"2023-10-16T13:48:21.777612+0000","last_undegraded":"2023-10-16T13:48:21.777612+0000","last_fullsized":"2023-10-16T13:48:21.777612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:19.430536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.283181+0000","last_change":"2023-10-16T13:48:19.279607+0000","last_active":"2023-10-16T13:48:20.283181+0000","last_peered":"2023-10-16T13:48:20.283181+0000","last_clean":"2023-10-16T13:48:20.283181+0000","last_became_active":"2023-10-16T13:48:19.279321+0000","last_became_peered":"2023-10-16T13:48:19.279321+0000","last_unstale":"2023-10-16T13:48:20.283181+0000","last_undegraded":"2023-10-16T13:48:20.283181+0000","last_fullsized":"2023-10-16T13:48:20.283181+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:56.384221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294162+0000","last_change":"2023-10-16T13:48:20.289266+0000","last_active":"2023-10-16T13:48:21.294162+0000","last_peered":"2023-10-16T13:48:21.294162+0000","last_clean":"2023-10-16T13:48:21.294162+0000","last_became_active":"2023-10-16T13:48:20.289016+0000","last_became_peered":"2023-10-16T13:48:20.289016+0000","last_unstale":"2023-10-16T13:48:21.294162+0000","last_undegraded":"2023-10-16T13:48:21.294162+0000","last_fullsized":"2023-10-16T13:48:21.294162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:31.853350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.315423+0000","last_change":"2023-10-16T13:48:19.285108+0000","last_active":"2023-10-16T13:48:20.315423+0000","last_peered":"2023-10-16T13:48:20.315423+0000","last_clean":"2023-10-16T13:48:20.315423+0000","last_became_active":"2023-10-16T13:48:19.284787+0000","last_became_peered":"2023-10-16T13:48:19.284787+0000","last_unstale":"2023-10-16T13:48:20.315423+0000","last_undegraded":"2023-10-16T13:48:20.315423+0000","last_fullsized":"2023-10-16T13:48:20.315423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:06.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300231+0000","last_change":"2023-10-16T13:48:20.295783+0000","last_active":"2023-10-16T13:48:21.300231+0000","last_peered":"2023-10-16T13:48:21.300231+0000","last_clean":"2023-10-16T13:48:21.300231+0000","last_became_active":"2023-10-16T13:48:20.295492+0000","last_became_peered":"2023-10-16T13:48:20.295492+0000","last_unstale":"2023-10-16T13:48:21.300231+0000","last_undegraded":"2023-10-16T13:48:21.300231+0000","last_fullsized":"2023-10-16T13:48:21.300231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:19.430536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"97'6","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.317260+0000","last_change":"2023-10-16T13:48:19.286995+0000","last_active":"2023-10-16T13:48:20.317260+0000","last_peered":"2023-10-16T13:48:20.317260+0000","last_clean":"2023-10-16T13:48:20.317260+0000","last_became_active":"2023-10-16T13:48:19.286754+0000","last_became_peered":"2023-10-16T13:48:19.286754+0000","last_unstale":"2023-10-16T13:48:20.317260+0000","last_undegraded":"2023-10-16T13:48:20.317260+0000","last_fullsized":"2023-10-16T13:48:20.317260+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:26.513678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294215+0000","last_change":"2023-10-16T13:48:20.289723+0000","last_active":"2023-10-16T13:48:21.294215+0000","last_peered":"2023-10-16T13:48:21.294215+0000","last_clean":"2023-10-16T13:48:21.294215+0000","last_became_active":"2023-10-16T13:48:20.289164+0000","last_became_peered":"2023-10-16T13:48:20.289164+0000","last_unstale":"2023-10-16T13:48:21.294215+0000","last_undegraded":"2023-10-16T13:48:21.294215+0000","last_fullsized":"2023-10-16T13:48:21.294215+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:04.750664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.309448+0000","last_change":"2023-10-16T13:48:19.282197+0000","last_active":"2023-10-16T13:48:20.309448+0000","last_peered":"2023-10-16T13:48:20.309448+0000","last_clean":"2023-10-16T13:48:20.309448+0000","last_became_active":"2023-10-16T13:48:19.281887+0000","last_became_peered":"2023-10-16T13:48:19.281887+0000","last_unstale":"2023-10-16T13:48:20.309448+0000","last_undegraded":"2023-10-16T13:48:20.309448+0000","last_fullsized":"2023-10-16T13:48:20.309448+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:44.938583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294517+0000","last_change":"2023-10-16T13:48:20.291871+0000","last_active":"2023-10-16T13:48:21.294517+0000","last_peered":"2023-10-16T13:48:21.294517+0000","last_clean":"2023-10-16T13:48:21.294517+0000","last_became_active":"2023-10-16T13:48:20.291540+0000","last_became_peered":"2023-10-16T13:48:20.291540+0000","last_unstale":"2023-10-16T13:48:21.294517+0000","last_undegraded":"2023-10-16T13:48:21.294517+0000","last_fullsized":"2023-10-16T13:48:21.294517+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:17.622282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.280571+0000","last_change":"2023-10-16T13:48:19.285104+0000","last_active":"2023-10-16T13:48:20.280571+0000","last_peered":"2023-10-16T13:48:20.280571+0000","last_clean":"2023-10-16T13:48:20.280571+0000","last_became_active":"2023-10-16T13:48:19.284821+0000","last_became_peered":"2023-10-16T13:48:19.284821+0000","last_unstale":"2023-10-16T13:48:20.280571+0000","last_undegraded":"2023-10-16T13:48:20.280571+0000","last_fullsized":"2023-10-16T13:48:20.280571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:03.270678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.293940+0000","last_change":"2023-10-16T13:48:20.290872+0000","last_active":"2023-10-16T13:48:21.293940+0000","last_peered":"2023-10-16T13:48:21.293940+0000","last_clean":"2023-10-16T13:48:21.293940+0000","last_became_active":"2023-10-16T13:48:20.290417+0000","last_became_peered":"2023-10-16T13:48:20.290417+0000","last_unstale":"2023-10-16T13:48:21.293940+0000","last_undegraded":"2023-10-16T13:48:21.293940+0000","last_fullsized":"2023-10-16T13:48:21.293940+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.315388+0000","last_change":"2023-10-16T13:48:19.283184+0000","last_active":"2023-10-16T13:48:20.315388+0000","last_peered":"2023-10-16T13:48:20.315388+0000","last_clean":"2023-10-16T13:48:20.315388+0000","last_became_active":"2023-10-16T13:48:19.282801+0000","last_became_peered":"2023-10-16T13:48:19.282801+0000","last_unstale":"2023-10-16T13:48:20.315388+0000","last_undegraded":"2023-10-16T13:48:20.315388+0000","last_fullsized":"2023-10-16T13:48:20.315388+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:31.333367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.397462+0000","last_change":"2023-10-16T13:48:20.310256+0000","last_active":"2023-10-16T13:48:21.397462+0000","last_peered":"2023-10-16T13:48:21.397462+0000","last_clean":"2023-10-16T13:48:21.397462+0000","last_became_active":"2023-10-16T13:48:20.309964+0000","last_became_peered":"2023-10-16T13:48:20.309964+0000","last_unstale":"2023-10-16T13:48:21.397462+0000","last_undegraded":"2023-10-16T13:48:21.397462+0000","last_fullsized":"2023-10-16T13:48:21.397462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:36:16.078909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.314363+0000","last_change":"2023-10-16T13:48:19.284693+0000","last_active":"2023-10-16T13:48:20.314363+0000","last_peered":"2023-10-16T13:48:20.314363+0000","last_clean":"2023-10-16T13:48:20.314363+0000","last_became_active":"2023-10-16T13:48:19.284228+0000","last_became_peered":"2023-10-16T13:48:19.284228+0000","last_unstale":"2023-10-16T13:48:20.314363+0000","last_undegraded":"2023-10-16T13:48:20.314363+0000","last_fullsized":"2023-10-16T13:48:20.314363+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:26.684375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752309+0000","last_change":"2023-10-16T13:48:20.298050+0000","last_active":"2023-10-16T13:48:21.752309+0000","last_peered":"2023-10-16T13:48:21.752309+0000","last_clean":"2023-10-16T13:48:21.752309+0000","last_became_active":"2023-10-16T13:48:20.297783+0000","last_became_peered":"2023-10-16T13:48:20.297783+0000","last_unstale":"2023-10-16T13:48:21.752309+0000","last_undegraded":"2023-10-16T13:48:21.752309+0000","last_fullsized":"2023-10-16T13:48:21.752309+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:46.417622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.308632+0000","last_change":"2023-10-16T13:48:19.280370+0000","last_active":"2023-10-16T13:48:20.308632+0000","last_peered":"2023-10-16T13:48:20.308632+0000","last_clean":"2023-10-16T13:48:20.308632+0000","last_became_active":"2023-10-16T13:48:19.280000+0000","last_became_peered":"2023-10-16T13:48:19.280000+0000","last_unstale":"2023-10-16T13:48:20.308632+0000","last_undegraded":"2023-10-16T13:48:20.308632+0000","last_fullsized":"2023-10-16T13:48:20.308632+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:44:05.104094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777808+0000","last_change":"2023-10-16T13:48:20.309209+0000","last_active":"2023-10-16T13:48:21.777808+0000","last_peered":"2023-10-16T13:48:21.777808+0000","last_clean":"2023-10-16T13:48:21.777808+0000","last_became_active":"2023-10-16T13:48:20.308829+0000","last_became_peered":"2023-10-16T13:48:20.308829+0000","last_unstale":"2023-10-16T13:48:21.777808+0000","last_undegraded":"2023-10-16T13:48:21.777808+0000","last_fullsized":"2023-10-16T13:48:21.777808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:31.853350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.311609+0000","last_change":"2023-10-16T13:48:19.275443+0000","last_active":"2023-10-16T13:48:20.311609+0000","last_peered":"2023-10-16T13:48:20.311609+0000","last_clean":"2023-10-16T13:48:20.311609+0000","last_became_active":"2023-10-16T13:48:19.275137+0000","last_became_peered":"2023-10-16T13:48:19.275137+0000","last_unstale":"2023-10-16T13:48:20.311609+0000","last_undegraded":"2023-10-16T13:48:20.311609+0000","last_fullsized":"2023-10-16T13:48:20.311609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:23:11.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.778165+0000","last_change":"2023-10-16T13:48:20.290249+0000","last_active":"2023-10-16T13:48:21.778165+0000","last_peered":"2023-10-16T13:48:21.778165+0000","last_clean":"2023-10-16T13:48:21.778165+0000","last_became_active":"2023-10-16T13:48:20.289799+0000","last_became_peered":"2023-10-16T13:48:20.289799+0000","last_unstale":"2023-10-16T13:48:21.778165+0000","last_undegraded":"2023-10-16T13:48:21.778165+0000","last_fullsized":"2023-10-16T13:48:21.778165+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:42.062479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.286009+0000","last_change":"2023-10-16T13:48:19.284223+0000","last_active":"2023-10-16T13:48:20.286009+0000","last_peered":"2023-10-16T13:48:20.286009+0000","last_clean":"2023-10-16T13:48:20.286009+0000","last_became_active":"2023-10-16T13:48:19.284003+0000","last_became_peered":"2023-10-16T13:48:19.284003+0000","last_unstale":"2023-10-16T13:48:20.286009+0000","last_undegraded":"2023-10-16T13:48:20.286009+0000","last_fullsized":"2023-10-16T13:48:20.286009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:05.405603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777252+0000","last_change":"2023-10-16T13:48:20.289152+0000","last_active":"2023-10-16T13:48:21.777252+0000","last_peered":"2023-10-16T13:48:21.777252+0000","last_clean":"2023-10-16T13:48:21.777252+0000","last_became_active":"2023-10-16T13:48:20.288796+0000","last_became_peered":"2023-10-16T13:48:20.288796+0000","last_unstale":"2023-10-16T13:48:21.777252+0000","last_undegraded":"2023-10-16T13:48:21.777252+0000","last_fullsized":"2023-10-16T13:48:21.777252+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.308631+0000","last_change":"2023-10-16T13:48:19.290682+0000","last_active":"2023-10-16T13:48:20.308631+0000","last_peered":"2023-10-16T13:48:20.308631+0000","last_clean":"2023-10-16T13:48:20.308631+0000","last_became_active":"2023-10-16T13:48:19.289256+0000","last_became_peered":"2023-10-16T13:48:19.289256+0000","last_unstale":"2023-10-16T13:48:20.308631+0000","last_undegraded":"2023-10-16T13:48:20.308631+0000","last_fullsized":"2023-10-16T13:48:20.308631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:03.270678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776842+0000","last_change":"2023-10-16T13:48:20.308095+0000","last_active":"2023-10-16T13:48:21.776842+0000","last_peered":"2023-10-16T13:48:21.776842+0000","last_clean":"2023-10-16T13:48:21.776842+0000","last_became_active":"2023-10-16T13:48:20.307770+0000","last_became_peered":"2023-10-16T13:48:20.307770+0000","last_unstale":"2023-10-16T13:48:21.776842+0000","last_undegraded":"2023-10-16T13:48:21.776842+0000","last_fullsized":"2023-10-16T13:48:21.776842+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:42.878220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.279831+0000","last_change":"2023-10-16T13:48:19.290396+0000","last_active":"2023-10-16T13:48:20.279831+0000","last_peered":"2023-10-16T13:48:20.279831+0000","last_clean":"2023-10-16T13:48:20.279831+0000","last_became_active":"2023-10-16T13:48:19.289717+0000","last_became_peered":"2023-10-16T13:48:19.289717+0000","last_unstale":"2023-10-16T13:48:20.279831+0000","last_undegraded":"2023-10-16T13:48:20.279831+0000","last_fullsized":"2023-10-16T13:48:20.279831+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:53:06.115790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777252+0000","last_change":"2023-10-16T13:48:20.284701+0000","last_active":"2023-10-16T13:48:21.777252+0000","last_peered":"2023-10-16T13:48:21.777252+0000","last_clean":"2023-10-16T13:48:21.777252+0000","last_became_active":"2023-10-16T13:48:20.284091+0000","last_became_peered":"2023-10-16T13:48:20.284091+0000","last_unstale":"2023-10-16T13:48:21.777252+0000","last_undegraded":"2023-10-16T13:48:21.777252+0000","last_fullsized":"2023-10-16T13:48:21.777252+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.276029+0000","last_change":"2023-10-16T13:48:19.281853+0000","last_active":"2023-10-16T13:48:20.276029+0000","last_peered":"2023-10-16T13:48:20.276029+0000","last_clean":"2023-10-16T13:48:20.276029+0000","last_became_active":"2023-10-16T13:48:19.281587+0000","last_became_peered":"2023-10-16T13:48:19.281587+0000","last_unstale":"2023-10-16T13:48:20.276029+0000","last_undegraded":"2023-10-16T13:48:20.276029+0000","last_fullsized":"2023-10-16T13:48:20.276029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:23:11.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294167+0000","last_change":"2023-10-16T13:48:20.308801+0000","last_active":"2023-10-16T13:48:21.294167+0000","last_peered":"2023-10-16T13:48:21.294167+0000","last_clean":"2023-10-16T13:48:21.294167+0000","last_became_active":"2023-10-16T13:48:20.308362+0000","last_became_peered":"2023-10-16T13:48:20.308362+0000","last_unstale":"2023-10-16T13:48:21.294167+0000","last_undegraded":"2023-10-16T13:48:21.294167+0000","last_fullsized":"2023-10-16T13:48:21.294167+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:42.878220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.299580+0000","last_change":"2023-10-16T13:48:19.283862+0000","last_active":"2023-10-16T13:48:20.299580+0000","last_peered":"2023-10-16T13:48:20.299580+0000","last_clean":"2023-10-16T13:48:20.299580+0000","last_became_active":"2023-10-16T13:48:19.283538+0000","last_became_peered":"2023-10-16T13:48:19.283538+0000","last_unstale":"2023-10-16T13:48:20.299580+0000","last_undegraded":"2023-10-16T13:48:20.299580+0000","last_fullsized":"2023-10-16T13:48:20.299580+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:35.288957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777816+0000","last_change":"2023-10-16T13:48:20.309040+0000","last_active":"2023-10-16T13:48:21.777816+0000","last_peered":"2023-10-16T13:48:21.777816+0000","last_clean":"2023-10-16T13:48:21.777816+0000","last_became_active":"2023-10-16T13:48:20.308729+0000","last_became_peered":"2023-10-16T13:48:20.308729+0000","last_unstale":"2023-10-16T13:48:21.777816+0000","last_undegraded":"2023-10-16T13:48:21.777816+0000","last_fullsized":"2023-10-16T13:48:21.777816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:35:12.445685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.314097+0000","last_change":"2023-10-16T13:48:19.285611+0000","last_active":"2023-10-16T13:48:20.314097+0000","last_peered":"2023-10-16T13:48:20.314097+0000","last_clean":"2023-10-16T13:48:20.314097+0000","last_became_active":"2023-10-16T13:48:19.285304+0000","last_became_peered":"2023-10-16T13:48:19.285304+0000","last_unstale":"2023-10-16T13:48:20.314097+0000","last_undegraded":"2023-10-16T13:48:20.314097+0000","last_fullsized":"2023-10-16T13:48:20.314097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:06.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777332+0000","last_change":"2023-10-16T13:48:20.298203+0000","last_active":"2023-10-16T13:48:21.777332+0000","last_peered":"2023-10-16T13:48:21.777332+0000","last_clean":"2023-10-16T13:48:21.777332+0000","last_became_active":"2023-10-16T13:48:20.297909+0000","last_became_peered":"2023-10-16T13:48:20.297909+0000","last_unstale":"2023-10-16T13:48:21.777332+0000","last_undegraded":"2023-10-16T13:48:21.777332+0000","last_fullsized":"2023-10-16T13:48:21.777332+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:07:37.204752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.281733+0000","last_change":"2023-10-16T13:48:19.272696+0000","last_active":"2023-10-16T13:48:20.281733+0000","last_peered":"2023-10-16T13:48:20.281733+0000","last_clean":"2023-10-16T13:48:20.281733+0000","last_became_active":"2023-10-16T13:48:19.272390+0000","last_became_peered":"2023-10-16T13:48:19.272390+0000","last_unstale":"2023-10-16T13:48:20.281733+0000","last_undegraded":"2023-10-16T13:48:20.281733+0000","last_fullsized":"2023-10-16T13:48:20.281733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:05.405603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777115+0000","last_change":"2023-10-16T13:48:20.308259+0000","last_active":"2023-10-16T13:48:21.777115+0000","last_peered":"2023-10-16T13:48:21.777115+0000","last_clean":"2023-10-16T13:48:21.777115+0000","last_became_active":"2023-10-16T13:48:20.307924+0000","last_became_peered":"2023-10-16T13:48:20.307924+0000","last_unstale":"2023-10-16T13:48:21.777115+0000","last_undegraded":"2023-10-16T13:48:21.777115+0000","last_fullsized":"2023-10-16T13:48:21.777115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:17.622282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.302882+0000","last_change":"2023-10-16T13:48:19.277887+0000","last_active":"2023-10-16T13:48:20.302882+0000","last_peered":"2023-10-16T13:48:20.302882+0000","last_clean":"2023-10-16T13:48:20.302882+0000","last_became_active":"2023-10-16T13:48:19.277581+0000","last_became_peered":"2023-10-16T13:48:19.277581+0000","last_unstale":"2023-10-16T13:48:20.302882+0000","last_undegraded":"2023-10-16T13:48:20.302882+0000","last_fullsized":"2023-10-16T13:48:20.302882+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:56.384221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777116+0000","last_change":"2023-10-16T13:48:20.296216+0000","last_active":"2023-10-16T13:48:21.777116+0000","last_peered":"2023-10-16T13:48:21.777116+0000","last_clean":"2023-10-16T13:48:21.777116+0000","last_became_active":"2023-10-16T13:48:20.295905+0000","last_became_peered":"2023-10-16T13:48:20.295905+0000","last_unstale":"2023-10-16T13:48:21.777116+0000","last_undegraded":"2023-10-16T13:48:21.777116+0000","last_fullsized":"2023-10-16T13:48:21.777116+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:30.684147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.282882+0000","last_change":"2023-10-16T13:48:19.289985+0000","last_active":"2023-10-16T13:48:20.282882+0000","last_peered":"2023-10-16T13:48:20.282882+0000","last_clean":"2023-10-16T13:48:20.282882+0000","last_became_active":"2023-10-16T13:48:19.289706+0000","last_became_peered":"2023-10-16T13:48:19.289706+0000","last_unstale":"2023-10-16T13:48:20.282882+0000","last_undegraded":"2023-10-16T13:48:20.282882+0000","last_fullsized":"2023-10-16T13:48:20.282882+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:26.513678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300041+0000","last_change":"2023-10-16T13:48:20.287414+0000","last_active":"2023-10-16T13:48:21.300041+0000","last_peered":"2023-10-16T13:48:21.300041+0000","last_clean":"2023-10-16T13:48:21.300041+0000","last_became_active":"2023-10-16T13:48:20.287139+0000","last_became_peered":"2023-10-16T13:48:20.287139+0000","last_unstale":"2023-10-16T13:48:21.300041+0000","last_undegraded":"2023-10-16T13:48:21.300041+0000","last_fullsized":"2023-10-16T13:48:21.300041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:17.281318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.285798+0000","last_change":"2023-10-16T13:48:19.272903+0000","last_active":"2023-10-16T13:48:20.285798+0000","last_peered":"2023-10-16T13:48:20.285798+0000","last_clean":"2023-10-16T13:48:20.285798+0000","last_became_active":"2023-10-16T13:48:19.272451+0000","last_became_peered":"2023-10-16T13:48:19.272451+0000","last_unstale":"2023-10-16T13:48:20.285798+0000","last_undegraded":"2023-10-16T13:48:20.285798+0000","last_fullsized":"2023-10-16T13:48:20.285798+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:32.705512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300487+0000","last_change":"2023-10-16T13:48:20.294779+0000","last_active":"2023-10-16T13:48:21.300487+0000","last_peered":"2023-10-16T13:48:21.300487+0000","last_clean":"2023-10-16T13:48:21.300487+0000","last_became_active":"2023-10-16T13:48:20.292987+0000","last_became_peered":"2023-10-16T13:48:20.292987+0000","last_unstale":"2023-10-16T13:48:21.300487+0000","last_undegraded":"2023-10-16T13:48:21.300487+0000","last_fullsized":"2023-10-16T13:48:21.300487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:07.506556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.284214+0000","last_change":"2023-10-16T13:48:19.281370+0000","last_active":"2023-10-16T13:48:20.284214+0000","last_peered":"2023-10-16T13:48:20.284214+0000","last_clean":"2023-10-16T13:48:20.284214+0000","last_became_active":"2023-10-16T13:48:19.281013+0000","last_became_peered":"2023-10-16T13:48:19.281013+0000","last_unstale":"2023-10-16T13:48:20.284214+0000","last_undegraded":"2023-10-16T13:48:20.284214+0000","last_fullsized":"2023-10-16T13:48:20.284214+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:05:46.483972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777350+0000","last_change":"2023-10-16T13:48:20.292852+0000","last_active":"2023-10-16T13:48:21.777350+0000","last_peered":"2023-10-16T13:48:21.777350+0000","last_clean":"2023-10-16T13:48:21.777350+0000","last_became_active":"2023-10-16T13:48:20.292354+0000","last_became_peered":"2023-10-16T13:48:20.292354+0000","last_unstale":"2023-10-16T13:48:21.777350+0000","last_undegraded":"2023-10-16T13:48:21.777350+0000","last_fullsized":"2023-10-16T13:48:21.777350+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:15.720458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.279875+0000","last_change":"2023-10-16T13:48:19.291050+0000","last_active":"2023-10-16T13:48:20.279875+0000","last_peered":"2023-10-16T13:48:20.279875+0000","last_clean":"2023-10-16T13:48:20.279875+0000","last_became_active":"2023-10-16T13:48:19.289952+0000","last_became_peered":"2023-10-16T13:48:19.289952+0000","last_unstale":"2023-10-16T13:48:20.279875+0000","last_undegraded":"2023-10-16T13:48:20.279875+0000","last_fullsized":"2023-10-16T13:48:20.279875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:32:57.491588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776791+0000","last_change":"2023-10-16T13:48:20.303287+0000","last_active":"2023-10-16T13:48:21.776791+0000","last_peered":"2023-10-16T13:48:21.776791+0000","last_clean":"2023-10-16T13:48:21.776791+0000","last_became_active":"2023-10-16T13:48:20.300133+0000","last_became_peered":"2023-10-16T13:48:20.300133+0000","last_unstale":"2023-10-16T13:48:21.776791+0000","last_undegraded":"2023-10-16T13:48:21.776791+0000","last_fullsized":"2023-10-16T13:48:21.776791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:31.853350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.299446+0000","last_change":"2023-10-16T13:48:19.284503+0000","last_active":"2023-10-16T13:48:20.299446+0000","last_peered":"2023-10-16T13:48:20.299446+0000","last_clean":"2023-10-16T13:48:20.299446+0000","last_became_active":"2023-10-16T13:48:19.284167+0000","last_became_peered":"2023-10-16T13:48:19.284167+0000","last_unstale":"2023-10-16T13:48:20.299446+0000","last_undegraded":"2023-10-16T13:48:20.299446+0000","last_fullsized":"2023-10-16T13:48:20.299446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:15.089390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.293879+0000","last_change":"2023-10-16T13:48:20.292183+0000","last_active":"2023-10-16T13:48:21.293879+0000","last_peered":"2023-10-16T13:48:21.293879+0000","last_clean":"2023-10-16T13:48:21.293879+0000","last_became_active":"2023-10-16T13:48:20.291822+0000","last_became_peered":"2023-10-16T13:48:20.291822+0000","last_unstale":"2023-10-16T13:48:21.293879+0000","last_undegraded":"2023-10-16T13:48:21.293879+0000","last_fullsized":"2023-10-16T13:48:21.293879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.286031+0000","last_change":"2023-10-16T13:48:19.281758+0000","last_active":"2023-10-16T13:48:20.286031+0000","last_peered":"2023-10-16T13:48:20.286031+0000","last_clean":"2023-10-16T13:48:20.286031+0000","last_became_active":"2023-10-16T13:48:19.281499+0000","last_became_peered":"2023-10-16T13:48:19.281499+0000","last_unstale":"2023-10-16T13:48:20.286031+0000","last_undegraded":"2023-10-16T13:48:20.286031+0000","last_fullsized":"2023-10-16T13:48:20.286031+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:29.065398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.279721+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:48:20.279721+0000","last_peered":"2023-10-16T13:48:20.279721+0000","last_clean":"2023-10-16T13:48:20.279721+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:48:20.279721+0000","last_undegraded":"2023-10-16T13:48:20.279721+0000","last_fullsized":"2023-10-16T13:48:20.279721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1822720,"data_stored":1121341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.82699999999999996},"last":0.443}]},{"osd":1,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.83099999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.751,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.69999999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48999999999999999,"15min":0.53700000000000003},"min":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.51100000000000001,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54700000000000004,"15min":0.58699999999999997},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.625},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.63}]},{"osd":6,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.82899999999999996},"last":0.68400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1224704,"data_stored":530427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.23100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86099999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.505}]},{"osd":2,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.157,"15min":1.157},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.85699999999999998},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":10.964},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.438},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.754},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.036},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.39500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":530481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.317,"15min":0.33300000000000002},"min":{"1min":0.23699999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.35099999999999998},"min":{"1min":0.25900000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.437},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.752},"last":0.32400000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.378,"15min":0.41099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.88},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.40500000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.905},"last":0.751},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":1.879},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.84399999999999997,"15min":0.89000000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84099999999999997,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.625}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":0.90400000000000003,"15min":1.925},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.872,"15min":1.085},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1830912,"data_stored":1121430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.32900000000000001,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.439},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.254,"15min":0.23699999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59499999999999997,"5min":0.624,"15min":3.8849999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.36599999999999999,"15min":0.38100000000000001},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.439},"min":{"1min":0.35999999999999999,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58099999999999996,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":4.0650000000000004},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.36799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":4.0369999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.626,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":4.2359999999999998},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.2119999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":4.2649999999999997},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1216512,"data_stored":529338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.316,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.186},"max":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.99199999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.78700000000000003},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51800000000000002,"5min":0.60599999999999998,"15min":0.67800000000000005},"last":0.254},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.39400000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55100000000000005,"5min":0.57699999999999996,"15min":1.153},"last":0.37}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.054},"last":0.626},{"interface":"front","average":{"1min":0.629,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.623},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.379},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":0.98199999999999998,"15min":1.395},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.875,"5min":0.93000000000000005,"15min":6.0499999999999998},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":532039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.46899999999999997},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":5.8890000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.40699999999999997},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.181},"last":0.503}]},{"osd":1,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.35299999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.89100000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":2.3519999999999999},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.29599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":2.4820000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84399999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.753},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85599999999999998,"5min":0.97099999999999997,"15min":5.7560000000000002},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.74399999999999999},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.95399999999999996,"15min":5.8559999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.67200000000000004},"min":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.96199999999999997,"15min":2.2999999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.90800000000000003,"15min":2.4039999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":2.2799999999999998},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.77600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.90700000000000003,"15min":5.8179999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":2.4430000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1220608,"data_stored":530357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63400000000000001,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63800000000000001,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.89900000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.85099999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69499999999999995,"5min":0.77900000000000003,"15min":0.88},"last":0.58699999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51300000000000001,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":0.81200000000000006},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":0.94199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59399999999999997,"15min":0.63400000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.60899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":530961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.28599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.73699999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.35599999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.80500000000000005},"last":0.61599999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.84399999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.754}]},{"osd":4,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.82299999999999995,"15min":1.141},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.58999999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.84299999999999997,"15min":1.3700000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69799999999999995,"5min":0.80200000000000005,"15min":0.879},"last":0.499}]},{"osd":7,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.90700000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.64000000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.755,"5min":0.87,"15min":0.87},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:48:24.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:48:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.600+0000 7fdecb6cb700 1 Processor -- start 2023-10-16T13:48:24.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.600+0000 7fdecb6cb700 1 -- start start 2023-10-16T13:48:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.601+0000 7fdecb6cb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 0x7fdec40d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.601+0000 7fdecb6cb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec4070be0 con 0x7fdec415dbf0 2023-10-16T13:48:24.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.601+0000 7fdecb6cb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec406f710 con 0x7fdec4070770 2023-10-16T13:48:24.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.601+0000 7fdecb6cb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec406f9b0 con 0x7fdec415dfd0 2023-10-16T13:48:24.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.601+0000 7fdec9467700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdec415dbf0 0x7fdec40b07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58724/0 (socket says 172.21.15.5:58724) 2023-10-16T13:48:24.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.601+0000 7fdec9467700 1 -- 172.21.15.5:0/1736769269 learned_addr learned my addr 172.21.15.5:0/1736769269 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:24.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec8c66700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 0x7fdec40d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529060703 0 0) 0x7fdec4070be0 con 0x7fdec415dbf0 2023-10-16T13:48:24.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb00035b0 con 0x7fdec415dbf0 2023-10-16T13:48:24.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250027284 0 0) 0x7fdeb00035b0 con 0x7fdec415dbf0 2023-10-16T13:48:24.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 msgr2=0x7fdec40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 0x7fdec40d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 >> v1:172.21.15.112:6789/0 conn(0x7fdec4070770 legacy=0x7fdec40cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec406fc90 con 0x7fdec415dbf0 2023-10-16T13:48:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fdeb4001670 con 0x7fdec415dbf0 2023-10-16T13:48:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 >> v1:172.21.15.5:6789/0 conn(0x7fdec415dbf0 legacy=0x7fdec40b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdeb0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeb00043e0 0x7fdeb00048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 0x7fdeb0005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec406f9b0 con 0x7fdeb0003a30 2023-10-16T13:48:24.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000ba10 con 0x7fdeb00043e0 2023-10-16T13:48:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000bbd0 con 0x7fdec415dfd0 2023-10-16T13:48:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9467700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdeb0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec8c66700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeb00043e0 0x7fdeb00048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9c68700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 0x7fdeb0005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9467700 1 -- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 msgr2=0x7fdeb0005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:24.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9467700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec415dfd0 0x7fdeb0005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9467700 1 -- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeb00043e0 msgr2=0x7fdeb00048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:24.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9467700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeb00043e0 0x7fdeb00048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.602+0000 7fdec9467700 1 -- 172.21.15.5:0/1736769269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00035b0 con 0x7fdeb0003a30 2023-10-16T13:48:24.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdec9467700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdeb0003e10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c2f0 tx=0x7fdeb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfc80fe97012cb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:24.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb400ce30 con 0x7fdeb0003a30 2023-10-16T13:48:24.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4005960 con 0x7fdeb0003a30 2023-10-16T13:48:24.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdebbfff700 1 -- 172.21.15.5:0/1736769269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4005cf0 con 0x7fdeb0003a30 2023-10-16T13:48:24.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdecb6cb700 1 -- 172.21.15.5:0/1736769269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 msgr2=0x7fdeb0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/1736769269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdeb0003e10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c2f0 tx=0x7fdeb0005880 comp rx=0 tx=0).stop 2023-10-16T13:48:24.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdec9c68700 1 -- 172.21.15.5:0/1736769269 reap_dead start 2023-10-16T13:48:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdecb6cb700 1 -- 172.21.15.5:0/1736769269 shutdown_connections 2023-10-16T13:48:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdecb6cb700 1 -- 172.21.15.5:0/1736769269 >> 172.21.15.5:0/1736769269 conn(0x7fdec40d1620 msgr2=0x7fdec40d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdecb6cb700 1 -- 172.21.15.5:0/1736769269 shutdown_connections 2023-10-16T13:48:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.603+0000 7fdecb6cb700 1 -- 172.21.15.5:0/1736769269 wait complete. 2023-10-16T13:48:24.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 Processor -- start 2023-10-16T13:48:24.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 -- start start 2023-10-16T13:48:24.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdec40b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec409ec20 0x7fdec40c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec40c5690 0x7fdec415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec409e790 con 0x7fdeb0003a30 2023-10-16T13:48:24.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40b6f70 con 0x7fdec409ec20 2023-10-16T13:48:24.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdecb6cb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40c5c10 con 0x7fdec40c5690 2023-10-16T13:48:24.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdec9467700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdec40b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdec9467700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdec40b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48732/0 (socket says 172.21.15.5:48732) 2023-10-16T13:48:24.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.605+0000 7fdec9467700 1 -- 172.21.15.5:0/3800012667 learned_addr learned my addr 172.21.15.5:0/3800012667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:24.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec8c66700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec409ec20 0x7fdec40c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9c68700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec40c5690 0x7fdec415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9467700 1 -- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec40c5690 msgr2=0x7fdec415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9467700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec40c5690 0x7fdec415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9467700 1 -- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec409ec20 msgr2=0x7fdec40c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9467700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec409ec20 0x7fdec40c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9467700 1 -- 172.21.15.5:0/3800012667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40c5ef0 con 0x7fdeb0003a30 2023-10-16T13:48:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9c68700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec40c5690 0x7fdec415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdec9467700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdec40b6a30 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4001930 tx=0x7fdeb4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4001660 con 0x7fdeb0003a30 2023-10-16T13:48:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4004a80 con 0x7fdeb0003a30 2023-10-16T13:48:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec409e420 con 0x7fdeb0003a30 2023-10-16T13:48:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4004e30 con 0x7fdeb0003a30 2023-10-16T13:48:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.606+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4159d80 con 0x7fdeb0003a30 2023-10-16T13:48:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.607+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec409e5e0 con 0x7fdeb0003a30 2023-10-16T13:48:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.608+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fdeb40070d0 con 0x7fdeb0003a30 2023-10-16T13:48:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.608+0000 7fdeb9ffb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdea806b290 0x7fdea806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.608+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdeb408b160 con 0x7fdeb0003a30 2023-10-16T13:48:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.608+0000 7fdec8c66700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdea806b290 0x7fdea806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.609+0000 7fdec8c66700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdea806b290 0x7fdea806d750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdec40c6950 tx=0x7fdec0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.613+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdeb4056070 con 0x7fdeb0003a30 2023-10-16T13:48:24.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.809+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdec409e2b0 con 0x7fdea806b290 2023-10-16T13:48:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.819+0000 7fdeb9ffb700 1 -- 172.21.15.5:0/3800012667 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289647 (secure 0 0 0) 0x7fdec409e2b0 con 0x7fdea806b290 2023-10-16T13:48:24.824 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdea806b290 msgr2=0x7fdea806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdea806b290 0x7fdea806d750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdec40c6950 tx=0x7fdec0009210 comp rx=0 tx=0).stop 2023-10-16T13:48:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 msgr2=0x7fdec40b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdec40b6a30 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4001930 tx=0x7fdeb4001a00 comp rx=0 tx=0).stop 2023-10-16T13:48:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 shutdown_connections 2023-10-16T13:48:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdea806b290 0x7fdea806d750 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec40c5690 0x7fdec415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb0003a30 0x7fdec40b6a30 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 --2- 172.21.15.5:0/3800012667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec409ec20 0x7fdec40c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 >> 172.21.15.5:0/3800012667 conn(0x7fdec40d1620 msgr2=0x7fdec4160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 shutdown_connections 2023-10-16T13:48:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:24.822+0000 7fdecb6cb700 1 -- 172.21.15.5:0/3800012667 wait complete. 2023-10-16T13:48:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:48:24.837 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2023-10-16T13:48:23.609504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260248,"kb_used_data":10752,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714472,"statfs":{"total":773094113280,"available":772827619328,"internally_reserved":0,"allocated":11010048,"data_stored":5426374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.348837"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777365+0000","last_change":"2023-10-16T13:48:20.307977+0000","last_active":"2023-10-16T13:48:21.777365+0000","last_peered":"2023-10-16T13:48:21.777365+0000","last_clean":"2023-10-16T13:48:21.777365+0000","last_became_active":"2023-10-16T13:48:20.307641+0000","last_became_peered":"2023-10-16T13:48:20.307641+0000","last_unstale":"2023-10-16T13:48:21.777365+0000","last_undegraded":"2023-10-16T13:48:21.777365+0000","last_fullsized":"2023-10-16T13:48:21.777365+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:26:34.476562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300657+0000","last_change":"2023-10-16T13:48:20.296751+0000","last_active":"2023-10-16T13:48:21.300657+0000","last_peered":"2023-10-16T13:48:21.300657+0000","last_clean":"2023-10-16T13:48:21.300657+0000","last_became_active":"2023-10-16T13:48:20.296449+0000","last_became_peered":"2023-10-16T13:48:20.296449+0000","last_unstale":"2023-10-16T13:48:21.300657+0000","last_undegraded":"2023-10-16T13:48:21.300657+0000","last_fullsized":"2023-10-16T13:48:21.300657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777994+0000","last_change":"2023-10-16T13:48:20.289215+0000","last_active":"2023-10-16T13:48:21.777994+0000","last_peered":"2023-10-16T13:48:21.777994+0000","last_clean":"2023-10-16T13:48:21.777994+0000","last_became_active":"2023-10-16T13:48:20.288551+0000","last_became_peered":"2023-10-16T13:48:20.288551+0000","last_unstale":"2023-10-16T13:48:21.777994+0000","last_undegraded":"2023-10-16T13:48:21.777994+0000","last_fullsized":"2023-10-16T13:48:21.777994+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:42.878220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777308+0000","last_change":"2023-10-16T13:48:20.299369+0000","last_active":"2023-10-16T13:48:21.777308+0000","last_peered":"2023-10-16T13:48:21.777308+0000","last_clean":"2023-10-16T13:48:21.777308+0000","last_became_active":"2023-10-16T13:48:20.298980+0000","last_became_peered":"2023-10-16T13:48:20.298980+0000","last_unstale":"2023-10-16T13:48:21.777308+0000","last_undegraded":"2023-10-16T13:48:21.777308+0000","last_fullsized":"2023-10-16T13:48:21.777308+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:49:06.215331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.397276+0000","last_change":"2023-10-16T13:48:20.284785+0000","last_active":"2023-10-16T13:48:21.397276+0000","last_peered":"2023-10-16T13:48:21.397276+0000","last_clean":"2023-10-16T13:48:21.397276+0000","last_became_active":"2023-10-16T13:48:20.284493+0000","last_became_peered":"2023-10-16T13:48:20.284493+0000","last_unstale":"2023-10-16T13:48:21.397276+0000","last_undegraded":"2023-10-16T13:48:21.397276+0000","last_fullsized":"2023-10-16T13:48:21.397276+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:32:26.125908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752019+0000","last_change":"2023-10-16T13:48:20.283919+0000","last_active":"2023-10-16T13:48:21.752019+0000","last_peered":"2023-10-16T13:48:21.752019+0000","last_clean":"2023-10-16T13:48:21.752019+0000","last_became_active":"2023-10-16T13:48:20.283108+0000","last_became_peered":"2023-10-16T13:48:20.283108+0000","last_unstale":"2023-10-16T13:48:21.752019+0000","last_undegraded":"2023-10-16T13:48:21.752019+0000","last_fullsized":"2023-10-16T13:48:21.752019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:44.686693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299636+0000","last_change":"2023-10-16T13:48:20.291920+0000","last_active":"2023-10-16T13:48:21.299636+0000","last_peered":"2023-10-16T13:48:21.299636+0000","last_clean":"2023-10-16T13:48:21.299636+0000","last_became_active":"2023-10-16T13:48:20.291628+0000","last_became_peered":"2023-10-16T13:48:20.291628+0000","last_unstale":"2023-10-16T13:48:21.299636+0000","last_undegraded":"2023-10-16T13:48:21.299636+0000","last_fullsized":"2023-10-16T13:48:21.299636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:30.684147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777011+0000","last_change":"2023-10-16T13:48:20.284877+0000","last_active":"2023-10-16T13:48:21.777011+0000","last_peered":"2023-10-16T13:48:21.777011+0000","last_clean":"2023-10-16T13:48:21.777011+0000","last_became_active":"2023-10-16T13:48:20.284429+0000","last_became_peered":"2023-10-16T13:48:20.284429+0000","last_unstale":"2023-10-16T13:48:21.777011+0000","last_undegraded":"2023-10-16T13:48:21.777011+0000","last_fullsized":"2023-10-16T13:48:21.777011+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:07.506556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777280+0000","last_change":"2023-10-16T13:48:20.305005+0000","last_active":"2023-10-16T13:48:21.777280+0000","last_peered":"2023-10-16T13:48:21.777280+0000","last_clean":"2023-10-16T13:48:21.777280+0000","last_became_active":"2023-10-16T13:48:20.304687+0000","last_became_peered":"2023-10-16T13:48:20.304687+0000","last_unstale":"2023-10-16T13:48:21.777280+0000","last_undegraded":"2023-10-16T13:48:21.777280+0000","last_fullsized":"2023-10-16T13:48:21.777280+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:00.210264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777107+0000","last_change":"2023-10-16T13:48:20.296957+0000","last_active":"2023-10-16T13:48:21.777107+0000","last_peered":"2023-10-16T13:48:21.777107+0000","last_clean":"2023-10-16T13:48:21.777107+0000","last_became_active":"2023-10-16T13:48:20.296692+0000","last_became_peered":"2023-10-16T13:48:20.296692+0000","last_unstale":"2023-10-16T13:48:21.777107+0000","last_undegraded":"2023-10-16T13:48:21.777107+0000","last_fullsized":"2023-10-16T13:48:21.777107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:04.750664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300632+0000","last_change":"2023-10-16T13:48:20.293828+0000","last_active":"2023-10-16T13:48:21.300632+0000","last_peered":"2023-10-16T13:48:21.300632+0000","last_clean":"2023-10-16T13:48:21.300632+0000","last_became_active":"2023-10-16T13:48:20.292880+0000","last_became_peered":"2023-10-16T13:48:20.292880+0000","last_unstale":"2023-10-16T13:48:21.300632+0000","last_undegraded":"2023-10-16T13:48:21.300632+0000","last_fullsized":"2023-10-16T13:48:21.300632+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777211+0000","last_change":"2023-10-16T13:48:20.305071+0000","last_active":"2023-10-16T13:48:21.777211+0000","last_peered":"2023-10-16T13:48:21.777211+0000","last_clean":"2023-10-16T13:48:21.777211+0000","last_became_active":"2023-10-16T13:48:20.299651+0000","last_became_peered":"2023-10-16T13:48:20.299651+0000","last_unstale":"2023-10-16T13:48:21.777211+0000","last_undegraded":"2023-10-16T13:48:21.777211+0000","last_fullsized":"2023-10-16T13:48:21.777211+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:42.062479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777760+0000","last_change":"2023-10-16T13:48:20.285596+0000","last_active":"2023-10-16T13:48:21.777760+0000","last_peered":"2023-10-16T13:48:21.777760+0000","last_clean":"2023-10-16T13:48:21.777760+0000","last_became_active":"2023-10-16T13:48:20.285316+0000","last_became_peered":"2023-10-16T13:48:20.285316+0000","last_unstale":"2023-10-16T13:48:21.777760+0000","last_undegraded":"2023-10-16T13:48:21.777760+0000","last_fullsized":"2023-10-16T13:48:21.777760+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:22.997096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777062+0000","last_change":"2023-10-16T13:48:20.289328+0000","last_active":"2023-10-16T13:48:21.777062+0000","last_peered":"2023-10-16T13:48:21.777062+0000","last_clean":"2023-10-16T13:48:21.777062+0000","last_became_active":"2023-10-16T13:48:20.289041+0000","last_became_peered":"2023-10-16T13:48:20.289041+0000","last_unstale":"2023-10-16T13:48:21.777062+0000","last_undegraded":"2023-10-16T13:48:21.777062+0000","last_fullsized":"2023-10-16T13:48:21.777062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:27.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752036+0000","last_change":"2023-10-16T13:48:20.293909+0000","last_active":"2023-10-16T13:48:21.752036+0000","last_peered":"2023-10-16T13:48:21.752036+0000","last_clean":"2023-10-16T13:48:21.752036+0000","last_became_active":"2023-10-16T13:48:20.293629+0000","last_became_peered":"2023-10-16T13:48:20.293629+0000","last_unstale":"2023-10-16T13:48:21.752036+0000","last_undegraded":"2023-10-16T13:48:21.752036+0000","last_fullsized":"2023-10-16T13:48:21.752036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:54:07.291204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776610+0000","last_change":"2023-10-16T13:48:20.295911+0000","last_active":"2023-10-16T13:48:21.776610+0000","last_peered":"2023-10-16T13:48:21.776610+0000","last_clean":"2023-10-16T13:48:21.776610+0000","last_became_active":"2023-10-16T13:48:20.295636+0000","last_became_peered":"2023-10-16T13:48:20.295636+0000","last_unstale":"2023-10-16T13:48:21.776610+0000","last_undegraded":"2023-10-16T13:48:21.776610+0000","last_fullsized":"2023-10-16T13:48:21.776610+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299768+0000","last_change":"2023-10-16T13:48:20.293564+0000","last_active":"2023-10-16T13:48:21.299768+0000","last_peered":"2023-10-16T13:48:21.299768+0000","last_clean":"2023-10-16T13:48:21.299768+0000","last_became_active":"2023-10-16T13:48:20.293332+0000","last_became_peered":"2023-10-16T13:48:20.293332+0000","last_unstale":"2023-10-16T13:48:21.299768+0000","last_undegraded":"2023-10-16T13:48:21.299768+0000","last_fullsized":"2023-10-16T13:48:21.299768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:13:30.130837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777251+0000","last_change":"2023-10-16T13:48:20.290500+0000","last_active":"2023-10-16T13:48:21.777251+0000","last_peered":"2023-10-16T13:48:21.777251+0000","last_clean":"2023-10-16T13:48:21.777251+0000","last_became_active":"2023-10-16T13:48:20.290210+0000","last_became_peered":"2023-10-16T13:48:20.290210+0000","last_unstale":"2023-10-16T13:48:21.777251+0000","last_undegraded":"2023-10-16T13:48:21.777251+0000","last_fullsized":"2023-10-16T13:48:21.777251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:59.367459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.778019+0000","last_change":"2023-10-16T13:48:20.287584+0000","last_active":"2023-10-16T13:48:21.778019+0000","last_peered":"2023-10-16T13:48:21.778019+0000","last_clean":"2023-10-16T13:48:21.778019+0000","last_became_active":"2023-10-16T13:48:20.287308+0000","last_became_peered":"2023-10-16T13:48:20.287308+0000","last_unstale":"2023-10-16T13:48:21.778019+0000","last_undegraded":"2023-10-16T13:48:21.778019+0000","last_fullsized":"2023-10-16T13:48:21.778019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:04.750664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300603+0000","last_change":"2023-10-16T13:48:20.292821+0000","last_active":"2023-10-16T13:48:21.300603+0000","last_peered":"2023-10-16T13:48:21.300603+0000","last_clean":"2023-10-16T13:48:21.300603+0000","last_became_active":"2023-10-16T13:48:20.292529+0000","last_became_peered":"2023-10-16T13:48:20.292529+0000","last_unstale":"2023-10-16T13:48:21.300603+0000","last_undegraded":"2023-10-16T13:48:21.300603+0000","last_fullsized":"2023-10-16T13:48:21.300603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:27.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300233+0000","last_change":"2023-10-16T13:48:20.294695+0000","last_active":"2023-10-16T13:48:21.300233+0000","last_peered":"2023-10-16T13:48:21.300233+0000","last_clean":"2023-10-16T13:48:21.300233+0000","last_became_active":"2023-10-16T13:48:20.293279+0000","last_became_peered":"2023-10-16T13:48:20.293279+0000","last_unstale":"2023-10-16T13:48:21.300233+0000","last_undegraded":"2023-10-16T13:48:21.300233+0000","last_fullsized":"2023-10-16T13:48:21.300233+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:36.293674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294126+0000","last_change":"2023-10-16T13:48:20.289942+0000","last_active":"2023-10-16T13:48:21.294126+0000","last_peered":"2023-10-16T13:48:21.294126+0000","last_clean":"2023-10-16T13:48:21.294126+0000","last_became_active":"2023-10-16T13:48:20.289509+0000","last_became_peered":"2023-10-16T13:48:20.289509+0000","last_unstale":"2023-10-16T13:48:21.294126+0000","last_undegraded":"2023-10-16T13:48:21.294126+0000","last_fullsized":"2023-10-16T13:48:21.294126+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:22.997096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299871+0000","last_change":"2023-10-16T13:48:20.292153+0000","last_active":"2023-10-16T13:48:21.299871+0000","last_peered":"2023-10-16T13:48:21.299871+0000","last_clean":"2023-10-16T13:48:21.299871+0000","last_became_active":"2023-10-16T13:48:20.291850+0000","last_became_peered":"2023-10-16T13:48:20.291850+0000","last_unstale":"2023-10-16T13:48:21.299871+0000","last_undegraded":"2023-10-16T13:48:21.299871+0000","last_fullsized":"2023-10-16T13:48:21.299871+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:25.483398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.293878+0000","last_change":"2023-10-16T13:48:20.291883+0000","last_active":"2023-10-16T13:48:21.293878+0000","last_peered":"2023-10-16T13:48:21.293878+0000","last_clean":"2023-10-16T13:48:21.293878+0000","last_became_active":"2023-10-16T13:48:20.291325+0000","last_became_peered":"2023-10-16T13:48:20.291325+0000","last_unstale":"2023-10-16T13:48:21.293878+0000","last_undegraded":"2023-10-16T13:48:21.293878+0000","last_fullsized":"2023-10-16T13:48:21.293878+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:27.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299928+0000","last_change":"2023-10-16T13:48:20.293564+0000","last_active":"2023-10-16T13:48:21.299928+0000","last_peered":"2023-10-16T13:48:21.299928+0000","last_clean":"2023-10-16T13:48:21.299928+0000","last_became_active":"2023-10-16T13:48:20.292887+0000","last_became_peered":"2023-10-16T13:48:20.292887+0000","last_unstale":"2023-10-16T13:48:21.299928+0000","last_undegraded":"2023-10-16T13:48:21.299928+0000","last_fullsized":"2023-10-16T13:48:21.299928+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:16.094108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777220+0000","last_change":"2023-10-16T13:48:20.296181+0000","last_active":"2023-10-16T13:48:21.777220+0000","last_peered":"2023-10-16T13:48:21.777220+0000","last_clean":"2023-10-16T13:48:21.777220+0000","last_became_active":"2023-10-16T13:48:20.295791+0000","last_became_peered":"2023-10-16T13:48:20.295791+0000","last_unstale":"2023-10-16T13:48:21.777220+0000","last_undegraded":"2023-10-16T13:48:21.777220+0000","last_fullsized":"2023-10-16T13:48:21.777220+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:20:53.370301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752254+0000","last_change":"2023-10-16T13:48:20.296029+0000","last_active":"2023-10-16T13:48:21.752254+0000","last_peered":"2023-10-16T13:48:21.752254+0000","last_clean":"2023-10-16T13:48:21.752254+0000","last_became_active":"2023-10-16T13:48:20.295764+0000","last_became_peered":"2023-10-16T13:48:20.295764+0000","last_unstale":"2023-10-16T13:48:21.752254+0000","last_undegraded":"2023-10-16T13:48:21.752254+0000","last_fullsized":"2023-10-16T13:48:21.752254+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:51.682151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294069+0000","last_change":"2023-10-16T13:48:20.309762+0000","last_active":"2023-10-16T13:48:21.294069+0000","last_peered":"2023-10-16T13:48:21.294069+0000","last_clean":"2023-10-16T13:48:21.294069+0000","last_became_active":"2023-10-16T13:48:20.309428+0000","last_became_peered":"2023-10-16T13:48:20.309428+0000","last_unstale":"2023-10-16T13:48:21.294069+0000","last_undegraded":"2023-10-16T13:48:21.294069+0000","last_fullsized":"2023-10-16T13:48:21.294069+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:15.720458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300312+0000","last_change":"2023-10-16T13:48:20.297873+0000","last_active":"2023-10-16T13:48:21.300312+0000","last_peered":"2023-10-16T13:48:21.300312+0000","last_clean":"2023-10-16T13:48:21.300312+0000","last_became_active":"2023-10-16T13:48:20.297574+0000","last_became_peered":"2023-10-16T13:48:20.297574+0000","last_unstale":"2023-10-16T13:48:21.300312+0000","last_undegraded":"2023-10-16T13:48:21.300312+0000","last_fullsized":"2023-10-16T13:48:21.300312+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:27.518395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299943+0000","last_change":"2023-10-16T13:48:20.291799+0000","last_active":"2023-10-16T13:48:21.299943+0000","last_peered":"2023-10-16T13:48:21.299943+0000","last_clean":"2023-10-16T13:48:21.299943+0000","last_became_active":"2023-10-16T13:48:20.291322+0000","last_became_peered":"2023-10-16T13:48:20.291322+0000","last_unstale":"2023-10-16T13:48:21.299943+0000","last_undegraded":"2023-10-16T13:48:21.299943+0000","last_fullsized":"2023-10-16T13:48:21.299943+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:50.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776635+0000","last_change":"2023-10-16T13:48:20.299539+0000","last_active":"2023-10-16T13:48:21.776635+0000","last_peered":"2023-10-16T13:48:21.776635+0000","last_clean":"2023-10-16T13:48:21.776635+0000","last_became_active":"2023-10-16T13:48:20.299120+0000","last_became_peered":"2023-10-16T13:48:20.299120+0000","last_unstale":"2023-10-16T13:48:21.776635+0000","last_undegraded":"2023-10-16T13:48:21.776635+0000","last_fullsized":"2023-10-16T13:48:21.776635+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.751976+0000","last_change":"2023-10-16T13:48:20.283829+0000","last_active":"2023-10-16T13:48:21.751976+0000","last_peered":"2023-10-16T13:48:21.751976+0000","last_clean":"2023-10-16T13:48:21.751976+0000","last_became_active":"2023-10-16T13:48:20.283529+0000","last_became_peered":"2023-10-16T13:48:20.283529+0000","last_unstale":"2023-10-16T13:48:21.751976+0000","last_undegraded":"2023-10-16T13:48:21.751976+0000","last_fullsized":"2023-10-16T13:48:21.751976+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:35:12.445685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752267+0000","last_change":"2023-10-16T13:48:20.283625+0000","last_active":"2023-10-16T13:48:21.752267+0000","last_peered":"2023-10-16T13:48:21.752267+0000","last_clean":"2023-10-16T13:48:21.752267+0000","last_became_active":"2023-10-16T13:48:20.283116+0000","last_became_peered":"2023-10-16T13:48:20.283116+0000","last_unstale":"2023-10-16T13:48:21.752267+0000","last_undegraded":"2023-10-16T13:48:21.752267+0000","last_fullsized":"2023-10-16T13:48:21.752267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:18.179799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"97'4","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.308433+0000","last_change":"2023-10-16T13:48:19.279945+0000","last_active":"2023-10-16T13:48:20.308433+0000","last_peered":"2023-10-16T13:48:20.308433+0000","last_clean":"2023-10-16T13:48:20.308433+0000","last_became_active":"2023-10-16T13:48:19.279685+0000","last_became_peered":"2023-10-16T13:48:19.279685+0000","last_unstale":"2023-10-16T13:48:20.308433+0000","last_undegraded":"2023-10-16T13:48:20.308433+0000","last_fullsized":"2023-10-16T13:48:20.308433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:03.270678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777564+0000","last_change":"2023-10-16T13:48:20.294229+0000","last_active":"2023-10-16T13:48:21.777564+0000","last_peered":"2023-10-16T13:48:21.777564+0000","last_clean":"2023-10-16T13:48:21.777564+0000","last_became_active":"2023-10-16T13:48:20.293909+0000","last_became_peered":"2023-10-16T13:48:20.293909+0000","last_unstale":"2023-10-16T13:48:21.777564+0000","last_undegraded":"2023-10-16T13:48:21.777564+0000","last_fullsized":"2023-10-16T13:48:21.777564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:55:50.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.306135+0000","last_change":"2023-10-16T13:48:19.279814+0000","last_active":"2023-10-16T13:48:20.306135+0000","last_peered":"2023-10-16T13:48:20.306135+0000","last_clean":"2023-10-16T13:48:20.306135+0000","last_became_active":"2023-10-16T13:48:19.279522+0000","last_became_peered":"2023-10-16T13:48:19.279522+0000","last_unstale":"2023-10-16T13:48:20.306135+0000","last_undegraded":"2023-10-16T13:48:20.306135+0000","last_fullsized":"2023-10-16T13:48:20.306135+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:35.288957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752319+0000","last_change":"2023-10-16T13:48:20.284245+0000","last_active":"2023-10-16T13:48:21.752319+0000","last_peered":"2023-10-16T13:48:21.752319+0000","last_clean":"2023-10-16T13:48:21.752319+0000","last_became_active":"2023-10-16T13:48:20.283245+0000","last_became_peered":"2023-10-16T13:48:20.283245+0000","last_unstale":"2023-10-16T13:48:21.752319+0000","last_undegraded":"2023-10-16T13:48:21.752319+0000","last_fullsized":"2023-10-16T13:48:21.752319+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:01.013407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.307124+0000","last_change":"2023-10-16T13:48:19.290327+0000","last_active":"2023-10-16T13:48:20.307124+0000","last_peered":"2023-10-16T13:48:20.307124+0000","last_clean":"2023-10-16T13:48:20.307124+0000","last_became_active":"2023-10-16T13:48:19.290024+0000","last_became_peered":"2023-10-16T13:48:19.290024+0000","last_unstale":"2023-10-16T13:48:20.307124+0000","last_undegraded":"2023-10-16T13:48:20.307124+0000","last_fullsized":"2023-10-16T13:48:20.307124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:13:27.586398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.778093+0000","last_change":"2023-10-16T13:48:20.290071+0000","last_active":"2023-10-16T13:48:21.778093+0000","last_peered":"2023-10-16T13:48:21.778093+0000","last_clean":"2023-10-16T13:48:21.778093+0000","last_became_active":"2023-10-16T13:48:20.289503+0000","last_became_peered":"2023-10-16T13:48:20.289503+0000","last_unstale":"2023-10-16T13:48:21.778093+0000","last_undegraded":"2023-10-16T13:48:21.778093+0000","last_fullsized":"2023-10-16T13:48:21.778093+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:17.622282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.307985+0000","last_change":"2023-10-16T13:48:19.290456+0000","last_active":"2023-10-16T13:48:20.307985+0000","last_peered":"2023-10-16T13:48:20.307985+0000","last_clean":"2023-10-16T13:48:20.307985+0000","last_became_active":"2023-10-16T13:48:19.290106+0000","last_became_peered":"2023-10-16T13:48:19.290106+0000","last_unstale":"2023-10-16T13:48:20.307985+0000","last_undegraded":"2023-10-16T13:48:20.307985+0000","last_fullsized":"2023-10-16T13:48:20.307985+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:12.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776683+0000","last_change":"2023-10-16T13:48:20.304670+0000","last_active":"2023-10-16T13:48:21.776683+0000","last_peered":"2023-10-16T13:48:21.776683+0000","last_clean":"2023-10-16T13:48:21.776683+0000","last_became_active":"2023-10-16T13:48:20.304380+0000","last_became_peered":"2023-10-16T13:48:20.304380+0000","last_unstale":"2023-10-16T13:48:21.776683+0000","last_undegraded":"2023-10-16T13:48:21.776683+0000","last_fullsized":"2023-10-16T13:48:21.776683+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:15.720458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.306629+0000","last_change":"2023-10-16T13:48:19.281318+0000","last_active":"2023-10-16T13:48:20.306629+0000","last_peered":"2023-10-16T13:48:20.306629+0000","last_clean":"2023-10-16T13:48:20.306629+0000","last_became_active":"2023-10-16T13:48:19.281097+0000","last_became_peered":"2023-10-16T13:48:19.281097+0000","last_unstale":"2023-10-16T13:48:20.306629+0000","last_undegraded":"2023-10-16T13:48:20.306629+0000","last_fullsized":"2023-10-16T13:48:20.306629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:23:11.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300395+0000","last_change":"2023-10-16T13:48:20.296379+0000","last_active":"2023-10-16T13:48:21.300395+0000","last_peered":"2023-10-16T13:48:21.300395+0000","last_clean":"2023-10-16T13:48:21.300395+0000","last_became_active":"2023-10-16T13:48:20.295927+0000","last_became_peered":"2023-10-16T13:48:20.295927+0000","last_unstale":"2023-10-16T13:48:21.300395+0000","last_undegraded":"2023-10-16T13:48:21.300395+0000","last_fullsized":"2023-10-16T13:48:21.300395+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:57.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.311332+0000","last_change":"2023-10-16T13:48:19.278066+0000","last_active":"2023-10-16T13:48:20.311332+0000","last_peered":"2023-10-16T13:48:20.311332+0000","last_clean":"2023-10-16T13:48:20.311332+0000","last_became_active":"2023-10-16T13:48:19.277716+0000","last_became_peered":"2023-10-16T13:48:19.277716+0000","last_unstale":"2023-10-16T13:48:20.311332+0000","last_undegraded":"2023-10-16T13:48:20.311332+0000","last_fullsized":"2023-10-16T13:48:20.311332+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:35.288957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776707+0000","last_change":"2023-10-16T13:48:20.303848+0000","last_active":"2023-10-16T13:48:21.776707+0000","last_peered":"2023-10-16T13:48:21.776707+0000","last_clean":"2023-10-16T13:48:21.776707+0000","last_became_active":"2023-10-16T13:48:20.299823+0000","last_became_peered":"2023-10-16T13:48:20.299823+0000","last_unstale":"2023-10-16T13:48:21.776707+0000","last_undegraded":"2023-10-16T13:48:21.776707+0000","last_fullsized":"2023-10-16T13:48:21.776707+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:22.997096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.283869+0000","last_change":"2023-10-16T13:48:19.278207+0000","last_active":"2023-10-16T13:48:20.283869+0000","last_peered":"2023-10-16T13:48:20.283869+0000","last_clean":"2023-10-16T13:48:20.283869+0000","last_became_active":"2023-10-16T13:48:19.277948+0000","last_became_peered":"2023-10-16T13:48:19.277948+0000","last_unstale":"2023-10-16T13:48:20.283869+0000","last_undegraded":"2023-10-16T13:48:20.283869+0000","last_fullsized":"2023-10-16T13:48:20.283869+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:18.472716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.299724+0000","last_change":"2023-10-16T13:48:20.292127+0000","last_active":"2023-10-16T13:48:21.299724+0000","last_peered":"2023-10-16T13:48:21.299724+0000","last_clean":"2023-10-16T13:48:21.299724+0000","last_became_active":"2023-10-16T13:48:20.291837+0000","last_became_peered":"2023-10-16T13:48:20.291837+0000","last_unstale":"2023-10-16T13:48:21.299724+0000","last_undegraded":"2023-10-16T13:48:21.299724+0000","last_fullsized":"2023-10-16T13:48:21.299724+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:19:59.367459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.299559+0000","last_change":"2023-10-16T13:48:19.287566+0000","last_active":"2023-10-16T13:48:20.299559+0000","last_peered":"2023-10-16T13:48:20.299559+0000","last_clean":"2023-10-16T13:48:20.299559+0000","last_became_active":"2023-10-16T13:48:19.287308+0000","last_became_peered":"2023-10-16T13:48:19.287308+0000","last_unstale":"2023-10-16T13:48:20.299559+0000","last_undegraded":"2023-10-16T13:48:20.299559+0000","last_fullsized":"2023-10-16T13:48:20.299559+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:16.276601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300259+0000","last_change":"2023-10-16T13:48:20.293619+0000","last_active":"2023-10-16T13:48:21.300259+0000","last_peered":"2023-10-16T13:48:21.300259+0000","last_clean":"2023-10-16T13:48:21.300259+0000","last_became_active":"2023-10-16T13:48:20.293347+0000","last_became_peered":"2023-10-16T13:48:20.293347+0000","last_unstale":"2023-10-16T13:48:21.300259+0000","last_undegraded":"2023-10-16T13:48:21.300259+0000","last_fullsized":"2023-10-16T13:48:21.300259+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:35:12.445685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.280214+0000","last_change":"2023-10-16T13:48:19.290003+0000","last_active":"2023-10-16T13:48:20.280214+0000","last_peered":"2023-10-16T13:48:20.280214+0000","last_clean":"2023-10-16T13:48:20.280214+0000","last_became_active":"2023-10-16T13:48:19.289671+0000","last_became_peered":"2023-10-16T13:48:19.289671+0000","last_unstale":"2023-10-16T13:48:20.280214+0000","last_undegraded":"2023-10-16T13:48:20.280214+0000","last_fullsized":"2023-10-16T13:48:20.280214+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:15:51.748248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777612+0000","last_change":"2023-10-16T13:48:20.295988+0000","last_active":"2023-10-16T13:48:21.777612+0000","last_peered":"2023-10-16T13:48:21.777612+0000","last_clean":"2023-10-16T13:48:21.777612+0000","last_became_active":"2023-10-16T13:48:20.295693+0000","last_became_peered":"2023-10-16T13:48:20.295693+0000","last_unstale":"2023-10-16T13:48:21.777612+0000","last_undegraded":"2023-10-16T13:48:21.777612+0000","last_fullsized":"2023-10-16T13:48:21.777612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:19.430536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.283181+0000","last_change":"2023-10-16T13:48:19.279607+0000","last_active":"2023-10-16T13:48:20.283181+0000","last_peered":"2023-10-16T13:48:20.283181+0000","last_clean":"2023-10-16T13:48:20.283181+0000","last_became_active":"2023-10-16T13:48:19.279321+0000","last_became_peered":"2023-10-16T13:48:19.279321+0000","last_unstale":"2023-10-16T13:48:20.283181+0000","last_undegraded":"2023-10-16T13:48:20.283181+0000","last_fullsized":"2023-10-16T13:48:20.283181+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:56.384221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294162+0000","last_change":"2023-10-16T13:48:20.289266+0000","last_active":"2023-10-16T13:48:21.294162+0000","last_peered":"2023-10-16T13:48:21.294162+0000","last_clean":"2023-10-16T13:48:21.294162+0000","last_became_active":"2023-10-16T13:48:20.289016+0000","last_became_peered":"2023-10-16T13:48:20.289016+0000","last_unstale":"2023-10-16T13:48:21.294162+0000","last_undegraded":"2023-10-16T13:48:21.294162+0000","last_fullsized":"2023-10-16T13:48:21.294162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:31.853350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.315423+0000","last_change":"2023-10-16T13:48:19.285108+0000","last_active":"2023-10-16T13:48:20.315423+0000","last_peered":"2023-10-16T13:48:20.315423+0000","last_clean":"2023-10-16T13:48:20.315423+0000","last_became_active":"2023-10-16T13:48:19.284787+0000","last_became_peered":"2023-10-16T13:48:19.284787+0000","last_unstale":"2023-10-16T13:48:20.315423+0000","last_undegraded":"2023-10-16T13:48:20.315423+0000","last_fullsized":"2023-10-16T13:48:20.315423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:06.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300231+0000","last_change":"2023-10-16T13:48:20.295783+0000","last_active":"2023-10-16T13:48:21.300231+0000","last_peered":"2023-10-16T13:48:21.300231+0000","last_clean":"2023-10-16T13:48:21.300231+0000","last_became_active":"2023-10-16T13:48:20.295492+0000","last_became_peered":"2023-10-16T13:48:20.295492+0000","last_unstale":"2023-10-16T13:48:21.300231+0000","last_undegraded":"2023-10-16T13:48:21.300231+0000","last_fullsized":"2023-10-16T13:48:21.300231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:19.430536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"97'6","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.317260+0000","last_change":"2023-10-16T13:48:19.286995+0000","last_active":"2023-10-16T13:48:20.317260+0000","last_peered":"2023-10-16T13:48:20.317260+0000","last_clean":"2023-10-16T13:48:20.317260+0000","last_became_active":"2023-10-16T13:48:19.286754+0000","last_became_peered":"2023-10-16T13:48:19.286754+0000","last_unstale":"2023-10-16T13:48:20.317260+0000","last_undegraded":"2023-10-16T13:48:20.317260+0000","last_fullsized":"2023-10-16T13:48:20.317260+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:26.513678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294215+0000","last_change":"2023-10-16T13:48:20.289723+0000","last_active":"2023-10-16T13:48:21.294215+0000","last_peered":"2023-10-16T13:48:21.294215+0000","last_clean":"2023-10-16T13:48:21.294215+0000","last_became_active":"2023-10-16T13:48:20.289164+0000","last_became_peered":"2023-10-16T13:48:20.289164+0000","last_unstale":"2023-10-16T13:48:21.294215+0000","last_undegraded":"2023-10-16T13:48:21.294215+0000","last_fullsized":"2023-10-16T13:48:21.294215+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:04.750664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.309448+0000","last_change":"2023-10-16T13:48:19.282197+0000","last_active":"2023-10-16T13:48:20.309448+0000","last_peered":"2023-10-16T13:48:20.309448+0000","last_clean":"2023-10-16T13:48:20.309448+0000","last_became_active":"2023-10-16T13:48:19.281887+0000","last_became_peered":"2023-10-16T13:48:19.281887+0000","last_unstale":"2023-10-16T13:48:20.309448+0000","last_undegraded":"2023-10-16T13:48:20.309448+0000","last_fullsized":"2023-10-16T13:48:20.309448+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:44.938583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294517+0000","last_change":"2023-10-16T13:48:20.291871+0000","last_active":"2023-10-16T13:48:21.294517+0000","last_peered":"2023-10-16T13:48:21.294517+0000","last_clean":"2023-10-16T13:48:21.294517+0000","last_became_active":"2023-10-16T13:48:20.291540+0000","last_became_peered":"2023-10-16T13:48:20.291540+0000","last_unstale":"2023-10-16T13:48:21.294517+0000","last_undegraded":"2023-10-16T13:48:21.294517+0000","last_fullsized":"2023-10-16T13:48:21.294517+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:17.622282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.280571+0000","last_change":"2023-10-16T13:48:19.285104+0000","last_active":"2023-10-16T13:48:20.280571+0000","last_peered":"2023-10-16T13:48:20.280571+0000","last_clean":"2023-10-16T13:48:20.280571+0000","last_became_active":"2023-10-16T13:48:19.284821+0000","last_became_peered":"2023-10-16T13:48:19.284821+0000","last_unstale":"2023-10-16T13:48:20.280571+0000","last_undegraded":"2023-10-16T13:48:20.280571+0000","last_fullsized":"2023-10-16T13:48:20.280571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:03.270678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.293940+0000","last_change":"2023-10-16T13:48:20.290872+0000","last_active":"2023-10-16T13:48:21.293940+0000","last_peered":"2023-10-16T13:48:21.293940+0000","last_clean":"2023-10-16T13:48:21.293940+0000","last_became_active":"2023-10-16T13:48:20.290417+0000","last_became_peered":"2023-10-16T13:48:20.290417+0000","last_unstale":"2023-10-16T13:48:21.293940+0000","last_undegraded":"2023-10-16T13:48:21.293940+0000","last_fullsized":"2023-10-16T13:48:21.293940+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.315388+0000","last_change":"2023-10-16T13:48:19.283184+0000","last_active":"2023-10-16T13:48:20.315388+0000","last_peered":"2023-10-16T13:48:20.315388+0000","last_clean":"2023-10-16T13:48:20.315388+0000","last_became_active":"2023-10-16T13:48:19.282801+0000","last_became_peered":"2023-10-16T13:48:19.282801+0000","last_unstale":"2023-10-16T13:48:20.315388+0000","last_undegraded":"2023-10-16T13:48:20.315388+0000","last_fullsized":"2023-10-16T13:48:20.315388+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:31.333367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.397462+0000","last_change":"2023-10-16T13:48:20.310256+0000","last_active":"2023-10-16T13:48:21.397462+0000","last_peered":"2023-10-16T13:48:21.397462+0000","last_clean":"2023-10-16T13:48:21.397462+0000","last_became_active":"2023-10-16T13:48:20.309964+0000","last_became_peered":"2023-10-16T13:48:20.309964+0000","last_unstale":"2023-10-16T13:48:21.397462+0000","last_undegraded":"2023-10-16T13:48:21.397462+0000","last_fullsized":"2023-10-16T13:48:21.397462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:36:16.078909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.314363+0000","last_change":"2023-10-16T13:48:19.284693+0000","last_active":"2023-10-16T13:48:20.314363+0000","last_peered":"2023-10-16T13:48:20.314363+0000","last_clean":"2023-10-16T13:48:20.314363+0000","last_became_active":"2023-10-16T13:48:19.284228+0000","last_became_peered":"2023-10-16T13:48:19.284228+0000","last_unstale":"2023-10-16T13:48:20.314363+0000","last_undegraded":"2023-10-16T13:48:20.314363+0000","last_fullsized":"2023-10-16T13:48:20.314363+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:26.684375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.752309+0000","last_change":"2023-10-16T13:48:20.298050+0000","last_active":"2023-10-16T13:48:21.752309+0000","last_peered":"2023-10-16T13:48:21.752309+0000","last_clean":"2023-10-16T13:48:21.752309+0000","last_became_active":"2023-10-16T13:48:20.297783+0000","last_became_peered":"2023-10-16T13:48:20.297783+0000","last_unstale":"2023-10-16T13:48:21.752309+0000","last_undegraded":"2023-10-16T13:48:21.752309+0000","last_fullsized":"2023-10-16T13:48:21.752309+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:46.417622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.308632+0000","last_change":"2023-10-16T13:48:19.280370+0000","last_active":"2023-10-16T13:48:20.308632+0000","last_peered":"2023-10-16T13:48:20.308632+0000","last_clean":"2023-10-16T13:48:20.308632+0000","last_became_active":"2023-10-16T13:48:19.280000+0000","last_became_peered":"2023-10-16T13:48:19.280000+0000","last_unstale":"2023-10-16T13:48:20.308632+0000","last_undegraded":"2023-10-16T13:48:20.308632+0000","last_fullsized":"2023-10-16T13:48:20.308632+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:44:05.104094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777808+0000","last_change":"2023-10-16T13:48:20.309209+0000","last_active":"2023-10-16T13:48:21.777808+0000","last_peered":"2023-10-16T13:48:21.777808+0000","last_clean":"2023-10-16T13:48:21.777808+0000","last_became_active":"2023-10-16T13:48:20.308829+0000","last_became_peered":"2023-10-16T13:48:20.308829+0000","last_unstale":"2023-10-16T13:48:21.777808+0000","last_undegraded":"2023-10-16T13:48:21.777808+0000","last_fullsized":"2023-10-16T13:48:21.777808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:31.853350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.311609+0000","last_change":"2023-10-16T13:48:19.275443+0000","last_active":"2023-10-16T13:48:20.311609+0000","last_peered":"2023-10-16T13:48:20.311609+0000","last_clean":"2023-10-16T13:48:20.311609+0000","last_became_active":"2023-10-16T13:48:19.275137+0000","last_became_peered":"2023-10-16T13:48:19.275137+0000","last_unstale":"2023-10-16T13:48:20.311609+0000","last_undegraded":"2023-10-16T13:48:20.311609+0000","last_fullsized":"2023-10-16T13:48:20.311609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:23:11.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.778165+0000","last_change":"2023-10-16T13:48:20.290249+0000","last_active":"2023-10-16T13:48:21.778165+0000","last_peered":"2023-10-16T13:48:21.778165+0000","last_clean":"2023-10-16T13:48:21.778165+0000","last_became_active":"2023-10-16T13:48:20.289799+0000","last_became_peered":"2023-10-16T13:48:20.289799+0000","last_unstale":"2023-10-16T13:48:21.778165+0000","last_undegraded":"2023-10-16T13:48:21.778165+0000","last_fullsized":"2023-10-16T13:48:21.778165+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:42.062479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.286009+0000","last_change":"2023-10-16T13:48:19.284223+0000","last_active":"2023-10-16T13:48:20.286009+0000","last_peered":"2023-10-16T13:48:20.286009+0000","last_clean":"2023-10-16T13:48:20.286009+0000","last_became_active":"2023-10-16T13:48:19.284003+0000","last_became_peered":"2023-10-16T13:48:19.284003+0000","last_unstale":"2023-10-16T13:48:20.286009+0000","last_undegraded":"2023-10-16T13:48:20.286009+0000","last_fullsized":"2023-10-16T13:48:20.286009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:05.405603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777252+0000","last_change":"2023-10-16T13:48:20.289152+0000","last_active":"2023-10-16T13:48:21.777252+0000","last_peered":"2023-10-16T13:48:21.777252+0000","last_clean":"2023-10-16T13:48:21.777252+0000","last_became_active":"2023-10-16T13:48:20.288796+0000","last_became_peered":"2023-10-16T13:48:20.288796+0000","last_unstale":"2023-10-16T13:48:21.777252+0000","last_undegraded":"2023-10-16T13:48:21.777252+0000","last_fullsized":"2023-10-16T13:48:21.777252+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.308631+0000","last_change":"2023-10-16T13:48:19.290682+0000","last_active":"2023-10-16T13:48:20.308631+0000","last_peered":"2023-10-16T13:48:20.308631+0000","last_clean":"2023-10-16T13:48:20.308631+0000","last_became_active":"2023-10-16T13:48:19.289256+0000","last_became_peered":"2023-10-16T13:48:19.289256+0000","last_unstale":"2023-10-16T13:48:20.308631+0000","last_undegraded":"2023-10-16T13:48:20.308631+0000","last_fullsized":"2023-10-16T13:48:20.308631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:31:03.270678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776842+0000","last_change":"2023-10-16T13:48:20.308095+0000","last_active":"2023-10-16T13:48:21.776842+0000","last_peered":"2023-10-16T13:48:21.776842+0000","last_clean":"2023-10-16T13:48:21.776842+0000","last_became_active":"2023-10-16T13:48:20.307770+0000","last_became_peered":"2023-10-16T13:48:20.307770+0000","last_unstale":"2023-10-16T13:48:21.776842+0000","last_undegraded":"2023-10-16T13:48:21.776842+0000","last_fullsized":"2023-10-16T13:48:21.776842+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:42.878220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.279831+0000","last_change":"2023-10-16T13:48:19.290396+0000","last_active":"2023-10-16T13:48:20.279831+0000","last_peered":"2023-10-16T13:48:20.279831+0000","last_clean":"2023-10-16T13:48:20.279831+0000","last_became_active":"2023-10-16T13:48:19.289717+0000","last_became_peered":"2023-10-16T13:48:19.289717+0000","last_unstale":"2023-10-16T13:48:20.279831+0000","last_undegraded":"2023-10-16T13:48:20.279831+0000","last_fullsized":"2023-10-16T13:48:20.279831+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:53:06.115790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777252+0000","last_change":"2023-10-16T13:48:20.284701+0000","last_active":"2023-10-16T13:48:21.777252+0000","last_peered":"2023-10-16T13:48:21.777252+0000","last_clean":"2023-10-16T13:48:21.777252+0000","last_became_active":"2023-10-16T13:48:20.284091+0000","last_became_peered":"2023-10-16T13:48:20.284091+0000","last_unstale":"2023-10-16T13:48:21.777252+0000","last_undegraded":"2023-10-16T13:48:21.777252+0000","last_fullsized":"2023-10-16T13:48:21.777252+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:32.933390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.276029+0000","last_change":"2023-10-16T13:48:19.281853+0000","last_active":"2023-10-16T13:48:20.276029+0000","last_peered":"2023-10-16T13:48:20.276029+0000","last_clean":"2023-10-16T13:48:20.276029+0000","last_became_active":"2023-10-16T13:48:19.281587+0000","last_became_peered":"2023-10-16T13:48:19.281587+0000","last_unstale":"2023-10-16T13:48:20.276029+0000","last_undegraded":"2023-10-16T13:48:20.276029+0000","last_fullsized":"2023-10-16T13:48:20.276029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:23:11.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.294167+0000","last_change":"2023-10-16T13:48:20.308801+0000","last_active":"2023-10-16T13:48:21.294167+0000","last_peered":"2023-10-16T13:48:21.294167+0000","last_clean":"2023-10-16T13:48:21.294167+0000","last_became_active":"2023-10-16T13:48:20.308362+0000","last_became_peered":"2023-10-16T13:48:20.308362+0000","last_unstale":"2023-10-16T13:48:21.294167+0000","last_undegraded":"2023-10-16T13:48:21.294167+0000","last_fullsized":"2023-10-16T13:48:21.294167+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:42.878220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.299580+0000","last_change":"2023-10-16T13:48:19.283862+0000","last_active":"2023-10-16T13:48:20.299580+0000","last_peered":"2023-10-16T13:48:20.299580+0000","last_clean":"2023-10-16T13:48:20.299580+0000","last_became_active":"2023-10-16T13:48:19.283538+0000","last_became_peered":"2023-10-16T13:48:19.283538+0000","last_unstale":"2023-10-16T13:48:20.299580+0000","last_undegraded":"2023-10-16T13:48:20.299580+0000","last_fullsized":"2023-10-16T13:48:20.299580+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:34:35.288957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777816+0000","last_change":"2023-10-16T13:48:20.309040+0000","last_active":"2023-10-16T13:48:21.777816+0000","last_peered":"2023-10-16T13:48:21.777816+0000","last_clean":"2023-10-16T13:48:21.777816+0000","last_became_active":"2023-10-16T13:48:20.308729+0000","last_became_peered":"2023-10-16T13:48:20.308729+0000","last_unstale":"2023-10-16T13:48:21.777816+0000","last_undegraded":"2023-10-16T13:48:21.777816+0000","last_fullsized":"2023-10-16T13:48:21.777816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:35:12.445685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.314097+0000","last_change":"2023-10-16T13:48:19.285611+0000","last_active":"2023-10-16T13:48:20.314097+0000","last_peered":"2023-10-16T13:48:20.314097+0000","last_clean":"2023-10-16T13:48:20.314097+0000","last_became_active":"2023-10-16T13:48:19.285304+0000","last_became_peered":"2023-10-16T13:48:19.285304+0000","last_unstale":"2023-10-16T13:48:20.314097+0000","last_undegraded":"2023-10-16T13:48:20.314097+0000","last_fullsized":"2023-10-16T13:48:20.314097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:06.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777332+0000","last_change":"2023-10-16T13:48:20.298203+0000","last_active":"2023-10-16T13:48:21.777332+0000","last_peered":"2023-10-16T13:48:21.777332+0000","last_clean":"2023-10-16T13:48:21.777332+0000","last_became_active":"2023-10-16T13:48:20.297909+0000","last_became_peered":"2023-10-16T13:48:20.297909+0000","last_unstale":"2023-10-16T13:48:21.777332+0000","last_undegraded":"2023-10-16T13:48:21.777332+0000","last_fullsized":"2023-10-16T13:48:21.777332+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:07:37.204752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.281733+0000","last_change":"2023-10-16T13:48:19.272696+0000","last_active":"2023-10-16T13:48:20.281733+0000","last_peered":"2023-10-16T13:48:20.281733+0000","last_clean":"2023-10-16T13:48:20.281733+0000","last_became_active":"2023-10-16T13:48:19.272390+0000","last_became_peered":"2023-10-16T13:48:19.272390+0000","last_unstale":"2023-10-16T13:48:20.281733+0000","last_undegraded":"2023-10-16T13:48:20.281733+0000","last_fullsized":"2023-10-16T13:48:20.281733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:05.405603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777115+0000","last_change":"2023-10-16T13:48:20.308259+0000","last_active":"2023-10-16T13:48:21.777115+0000","last_peered":"2023-10-16T13:48:21.777115+0000","last_clean":"2023-10-16T13:48:21.777115+0000","last_became_active":"2023-10-16T13:48:20.307924+0000","last_became_peered":"2023-10-16T13:48:20.307924+0000","last_unstale":"2023-10-16T13:48:21.777115+0000","last_undegraded":"2023-10-16T13:48:21.777115+0000","last_fullsized":"2023-10-16T13:48:21.777115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:17.622282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.302882+0000","last_change":"2023-10-16T13:48:19.277887+0000","last_active":"2023-10-16T13:48:20.302882+0000","last_peered":"2023-10-16T13:48:20.302882+0000","last_clean":"2023-10-16T13:48:20.302882+0000","last_became_active":"2023-10-16T13:48:19.277581+0000","last_became_peered":"2023-10-16T13:48:19.277581+0000","last_unstale":"2023-10-16T13:48:20.302882+0000","last_undegraded":"2023-10-16T13:48:20.302882+0000","last_fullsized":"2023-10-16T13:48:20.302882+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:24:56.384221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777116+0000","last_change":"2023-10-16T13:48:20.296216+0000","last_active":"2023-10-16T13:48:21.777116+0000","last_peered":"2023-10-16T13:48:21.777116+0000","last_clean":"2023-10-16T13:48:21.777116+0000","last_became_active":"2023-10-16T13:48:20.295905+0000","last_became_peered":"2023-10-16T13:48:20.295905+0000","last_unstale":"2023-10-16T13:48:21.777116+0000","last_undegraded":"2023-10-16T13:48:21.777116+0000","last_fullsized":"2023-10-16T13:48:21.777116+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:30.684147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.282882+0000","last_change":"2023-10-16T13:48:19.289985+0000","last_active":"2023-10-16T13:48:20.282882+0000","last_peered":"2023-10-16T13:48:20.282882+0000","last_clean":"2023-10-16T13:48:20.282882+0000","last_became_active":"2023-10-16T13:48:19.289706+0000","last_became_peered":"2023-10-16T13:48:19.289706+0000","last_unstale":"2023-10-16T13:48:20.282882+0000","last_undegraded":"2023-10-16T13:48:20.282882+0000","last_fullsized":"2023-10-16T13:48:20.282882+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:26.513678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300041+0000","last_change":"2023-10-16T13:48:20.287414+0000","last_active":"2023-10-16T13:48:21.300041+0000","last_peered":"2023-10-16T13:48:21.300041+0000","last_clean":"2023-10-16T13:48:21.300041+0000","last_became_active":"2023-10-16T13:48:20.287139+0000","last_became_peered":"2023-10-16T13:48:20.287139+0000","last_unstale":"2023-10-16T13:48:21.300041+0000","last_undegraded":"2023-10-16T13:48:21.300041+0000","last_fullsized":"2023-10-16T13:48:21.300041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:17.281318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.285798+0000","last_change":"2023-10-16T13:48:19.272903+0000","last_active":"2023-10-16T13:48:20.285798+0000","last_peered":"2023-10-16T13:48:20.285798+0000","last_clean":"2023-10-16T13:48:20.285798+0000","last_became_active":"2023-10-16T13:48:19.272451+0000","last_became_peered":"2023-10-16T13:48:19.272451+0000","last_unstale":"2023-10-16T13:48:20.285798+0000","last_undegraded":"2023-10-16T13:48:20.285798+0000","last_fullsized":"2023-10-16T13:48:20.285798+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:32.705512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.300487+0000","last_change":"2023-10-16T13:48:20.294779+0000","last_active":"2023-10-16T13:48:21.300487+0000","last_peered":"2023-10-16T13:48:21.300487+0000","last_clean":"2023-10-16T13:48:21.300487+0000","last_became_active":"2023-10-16T13:48:20.292987+0000","last_became_peered":"2023-10-16T13:48:20.292987+0000","last_unstale":"2023-10-16T13:48:21.300487+0000","last_undegraded":"2023-10-16T13:48:21.300487+0000","last_fullsized":"2023-10-16T13:48:21.300487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:07.506556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.284214+0000","last_change":"2023-10-16T13:48:19.281370+0000","last_active":"2023-10-16T13:48:20.284214+0000","last_peered":"2023-10-16T13:48:20.284214+0000","last_clean":"2023-10-16T13:48:20.284214+0000","last_became_active":"2023-10-16T13:48:19.281013+0000","last_became_peered":"2023-10-16T13:48:19.281013+0000","last_unstale":"2023-10-16T13:48:20.284214+0000","last_undegraded":"2023-10-16T13:48:20.284214+0000","last_fullsized":"2023-10-16T13:48:20.284214+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:05:46.483972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.777350+0000","last_change":"2023-10-16T13:48:20.292852+0000","last_active":"2023-10-16T13:48:21.777350+0000","last_peered":"2023-10-16T13:48:21.777350+0000","last_clean":"2023-10-16T13:48:21.777350+0000","last_became_active":"2023-10-16T13:48:20.292354+0000","last_became_peered":"2023-10-16T13:48:20.292354+0000","last_unstale":"2023-10-16T13:48:21.777350+0000","last_undegraded":"2023-10-16T13:48:21.777350+0000","last_fullsized":"2023-10-16T13:48:21.777350+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:16:15.720458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.279875+0000","last_change":"2023-10-16T13:48:19.291050+0000","last_active":"2023-10-16T13:48:20.279875+0000","last_peered":"2023-10-16T13:48:20.279875+0000","last_clean":"2023-10-16T13:48:20.279875+0000","last_became_active":"2023-10-16T13:48:19.289952+0000","last_became_peered":"2023-10-16T13:48:19.289952+0000","last_unstale":"2023-10-16T13:48:20.279875+0000","last_undegraded":"2023-10-16T13:48:20.279875+0000","last_fullsized":"2023-10-16T13:48:20.279875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:32:57.491588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.776791+0000","last_change":"2023-10-16T13:48:20.303287+0000","last_active":"2023-10-16T13:48:21.776791+0000","last_peered":"2023-10-16T13:48:21.776791+0000","last_clean":"2023-10-16T13:48:21.776791+0000","last_became_active":"2023-10-16T13:48:20.300133+0000","last_became_peered":"2023-10-16T13:48:20.300133+0000","last_unstale":"2023-10-16T13:48:21.776791+0000","last_undegraded":"2023-10-16T13:48:21.776791+0000","last_fullsized":"2023-10-16T13:48:21.776791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:31.853350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.299446+0000","last_change":"2023-10-16T13:48:19.284503+0000","last_active":"2023-10-16T13:48:20.299446+0000","last_peered":"2023-10-16T13:48:20.299446+0000","last_clean":"2023-10-16T13:48:20.299446+0000","last_became_active":"2023-10-16T13:48:19.284167+0000","last_became_peered":"2023-10-16T13:48:19.284167+0000","last_unstale":"2023-10-16T13:48:20.299446+0000","last_undegraded":"2023-10-16T13:48:20.299446+0000","last_fullsized":"2023-10-16T13:48:20.299446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:15.089390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-16T13:48:21.293879+0000","last_change":"2023-10-16T13:48:20.292183+0000","last_active":"2023-10-16T13:48:21.293879+0000","last_peered":"2023-10-16T13:48:21.293879+0000","last_clean":"2023-10-16T13:48:21.293879+0000","last_became_active":"2023-10-16T13:48:20.291822+0000","last_became_peered":"2023-10-16T13:48:20.291822+0000","last_unstale":"2023-10-16T13:48:21.293879+0000","last_undegraded":"2023-10-16T13:48:21.293879+0000","last_fullsized":"2023-10-16T13:48:21.293879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:19.259839+0000","last_clean_scrub_stamp":"2023-10-16T13:48:19.259839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:11:50.574764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.286031+0000","last_change":"2023-10-16T13:48:19.281758+0000","last_active":"2023-10-16T13:48:20.286031+0000","last_peered":"2023-10-16T13:48:20.286031+0000","last_clean":"2023-10-16T13:48:20.286031+0000","last_became_active":"2023-10-16T13:48:19.281499+0000","last_became_peered":"2023-10-16T13:48:19.281499+0000","last_unstale":"2023-10-16T13:48:20.286031+0000","last_undegraded":"2023-10-16T13:48:20.286031+0000","last_fullsized":"2023-10-16T13:48:20.286031+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:18.255122+0000","last_clean_scrub_stamp":"2023-10-16T13:48:18.255122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:29.065398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-10-16T13:48:20.279721+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:48:20.279721+0000","last_peered":"2023-10-16T13:48:20.279721+0000","last_clean":"2023-10-16T13:48:20.279721+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:48:20.279721+0000","last_undegraded":"2023-10-16T13:48:20.279721+0000","last_fullsized":"2023-10-16T13:48:20.279721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1822720,"data_stored":1121341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.82699999999999996},"last":0.443}]},{"osd":1,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.83099999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69299999999999995,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.751,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.69999999999999996}]},{"osd":4,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48999999999999999,"15min":0.53700000000000003},"min":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.51100000000000001,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54700000000000004,"15min":0.58699999999999997},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.625},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.63}]},{"osd":6,"last update":"Mon Oct 16 13:47:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57499999999999996,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.82899999999999996},"last":0.68400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1224704,"data_stored":530427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.23100000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86099999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.505}]},{"osd":2,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.157,"15min":1.157},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.85699999999999998},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":10.964},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.438},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.754},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.036},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67700000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.39500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":530481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.317,"15min":0.33300000000000002},"min":{"1min":0.23699999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.35099999999999998},"min":{"1min":0.25900000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.437},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.752},"last":0.32400000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.378,"15min":0.41099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.88},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.40500000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.88,"15min":1.905},"last":0.751},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":1.879},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.84399999999999997,"15min":0.89000000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84099999999999997,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.625}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.85699999999999998,"5min":0.90400000000000003,"15min":1.925},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.872,"15min":1.085},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1830912,"data_stored":1121430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.32900000000000001,"15min":0.35499999999999998},"min":{"1min":0.247,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.439},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.254,"15min":0.23699999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.40000000000000002},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59499999999999997,"5min":0.624,"15min":3.8849999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.36599999999999999,"15min":0.38100000000000001},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.23200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.439},"min":{"1min":0.35999999999999999,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58099999999999996,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":4.0650000000000004},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.36799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":4.0369999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.626,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":4.2359999999999998},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.2119999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":4.2649999999999997},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1216512,"data_stored":529338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.316,"15min":0.33600000000000002},"min":{"1min":0.23699999999999999,"5min":0.20599999999999999,"15min":0.186},"max":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.99199999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.78700000000000003},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51800000000000002,"5min":0.60599999999999998,"15min":0.67800000000000005},"last":0.254},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53800000000000003,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.39400000000000002,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55100000000000005,"5min":0.57699999999999996,"15min":1.153},"last":0.37}]},{"osd":4,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60999999999999999,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.054},"last":0.626},{"interface":"front","average":{"1min":0.629,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.623},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.379},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":0.98199999999999998,"15min":1.395},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.875,"5min":0.93000000000000005,"15min":6.0499999999999998},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":532039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.46899999999999997},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":5.8890000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.40699999999999997},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.181},"last":0.503}]},{"osd":1,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.35299999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.89100000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":2.3519999999999999},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.29599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":2.4820000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84399999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.753},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85599999999999998,"5min":0.97099999999999997,"15min":5.7560000000000002},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.74399999999999999},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.95399999999999996,"15min":5.8559999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.67200000000000004},"min":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.96199999999999997,"15min":2.2999999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.90800000000000003,"15min":2.4039999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.66600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":2.2799999999999998},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.77600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.90700000000000003,"15min":5.8179999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":2.4430000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1220608,"data_stored":530357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51600000000000001,"15min":0.51500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63400000000000001,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63800000000000001,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.89900000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.85099999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56599999999999995,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69499999999999995,"5min":0.77900000000000003,"15min":0.88},"last":0.58699999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51300000000000001,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.748,"5min":0.75600000000000001,"15min":0.81200000000000006},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.71999999999999997,"5min":0.78000000000000003,"15min":0.94199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59399999999999997,"15min":0.63400000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.60899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79800000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60699999999999998,"15min":0.65100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":530961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.28599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.73699999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.35599999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.80500000000000005},"last":0.61599999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.84399999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.754}]},{"osd":4,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.82299999999999995,"15min":1.141},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.58999999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.84299999999999997,"15min":1.3700000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69799999999999995,"5min":0.80200000000000005,"15min":0.879},"last":0.499}]},{"osd":7,"last update":"Mon Oct 16 13:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.90700000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.64000000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.755,"5min":0.87,"15min":0.87},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:48:24.842 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:48:24.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:48:25.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.006+0000 7f41f4e84700 1 Processor -- start 2023-10-16T13:48:25.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.007+0000 7f41f4e84700 1 -- start start 2023-10-16T13:48:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.007+0000 7f41f4e84700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f00b03d0 0x7f41f00cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.007+0000 7f41f4e84700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00b0c30 con 0x7f41f006d070 2023-10-16T13:48:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41f4e84700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f015f040 con 0x7f41f015de80 2023-10-16T13:48:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41f4e84700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f015f320 con 0x7f41f00b03d0 2023-10-16T13:48:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41eed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41f006d070 0x7f41f00cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58748/0 (socket says 172.21.15.5:58748) 2023-10-16T13:48:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41eed9d700 1 -- 172.21.15.5:0/3386657303 learned_addr learned my addr 172.21.15.5:0/3386657303 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41edd9b700 1 --2- 172.21.15.5:0/3386657303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f00b03d0 0x7f41f00cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631972986 0 0) 0x7f41f00b0c30 con 0x7f41f006d070 2023-10-16T13:48:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41dc0035b0 con 0x7f41f006d070 2023-10-16T13:48:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156206480 0 0) 0x7f41f015f040 con 0x7f41f015de80 2023-10-16T13:48:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f00b0c30 con 0x7f41f015de80 2023-10-16T13:48:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41edd9b700 1 -- 172.21.15.5:0/3386657303 >> v1:172.21.15.112:6789/0 conn(0x7f41f015de80 legacy=0x7f41f006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513996868 0 0) 0x7f41dc0035b0 con 0x7f41f006d070 2023-10-16T13:48:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41edd9b700 1 -- 172.21.15.5:0/3386657303 >> v1:172.21.15.5:6789/0 conn(0x7f41f006d070 legacy=0x7f41f00cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41edd9b700 1 -- 172.21.15.5:0/3386657303 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f006c160 con 0x7f41f00b03d0 2023-10-16T13:48:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.008+0000 7f41edd9b700 1 --2- 172.21.15.5:0/3386657303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f00b03d0 0x7f41f00cbbe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009870 tx=0x7f41d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e83ae469464b87 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0001670 con 0x7f41f00b03d0 2023-10-16T13:48:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8004030 con 0x7f41f00b03d0 2023-10-16T13:48:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41ed59a700 1 -- 172.21.15.5:0/3386657303 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80043c0 con 0x7f41f00b03d0 2023-10-16T13:48:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 -- 172.21.15.5:0/3386657303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f00b03d0 msgr2=0x7f41f00cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 --2- 172.21.15.5:0/3386657303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f00b03d0 0x7f41f00cbbe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009870 tx=0x7f41d8009b80 comp rx=0 tx=0).stop 2023-10-16T13:48:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 -- 172.21.15.5:0/3386657303 shutdown_connections 2023-10-16T13:48:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 --2- 172.21.15.5:0/3386657303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f00b03d0 0x7f41f00cbbe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 -- 172.21.15.5:0/3386657303 >> 172.21.15.5:0/3386657303 conn(0x7f41f00d1590 msgr2=0x7f41f00d1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 -- 172.21.15.5:0/3386657303 shutdown_connections 2023-10-16T13:48:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.009+0000 7f41f4e84700 1 -- 172.21.15.5:0/3386657303 wait complete. 2023-10-16T13:48:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 Processor -- start 2023-10-16T13:48:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 -- start start 2023-10-16T13:48:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f006d070 0x7f41f00af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 0x7f41f0158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f015de80 0x7f41f0158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00afc20 con 0x7f41f00b03d0 2023-10-16T13:48:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00ae640 con 0x7f41f015de80 2023-10-16T13:48:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.011+0000 7f41f4e84700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00ae920 con 0x7f41f006d070 2023-10-16T13:48:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 0x7f41f0158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 0x7f41f0158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48748/0 (socket says 172.21.15.5:48748) 2023-10-16T13:48:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 -- 172.21.15.5:0/2332739816 learned_addr learned my addr 172.21.15.5:0/2332739816 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41ee59c700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f006d070 0x7f41f00af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41eed9d700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f015de80 0x7f41f0158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 -- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f006d070 msgr2=0x7f41f00af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f006d070 0x7f41f00af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 -- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f015de80 msgr2=0x7f41f0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f015de80 0x7f41f0158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 -- 172.21.15.5:0/2332739816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80094a0 con 0x7f41f00b03d0 2023-10-16T13:48:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41ee59c700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f006d070 0x7f41f00af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41edd9b700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 0x7f41f0158230 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f41d8000c00 tx=0x7f41d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:25.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8003db0 con 0x7f41f00b03d0 2023-10-16T13:48:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d801f070 con 0x7f41f00b03d0 2023-10-16T13:48:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f00aec00 con 0x7f41f00b03d0 2023-10-16T13:48:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8011870 con 0x7f41f00b03d0 2023-10-16T13:48:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.012+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00af1c0 con 0x7f41f00b03d0 2023-10-16T13:48:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.013+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f0067d20 con 0x7f41f00b03d0 2023-10-16T13:48:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.014+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f41d8021030 con 0x7f41f00b03d0 2023-10-16T13:48:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.014+0000 7f41e6ffd700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d006b260 0x7f41d006d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.014+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41d808af30 con 0x7f41f00b03d0 2023-10-16T13:48:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.014+0000 7f41ee59c700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d006b260 0x7f41d006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.015+0000 7f41ee59c700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d006b260 0x7f41d006d720 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f41e8001560 tx=0x7f41e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:25.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.019+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41d8055c80 con 0x7f41f00b03d0 2023-10-16T13:48:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.299+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f41f00c8340 con 0x7f41f00b03d0 2023-10-16T13:48:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.301+0000 7f41e6ffd700 1 -- 172.21.15.5:0/2332739816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f41d80592a0 con 0x7f41f00b03d0 2023-10-16T13:48:25.304 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:48:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:48:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:48:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:48:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:48:25.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d006b260 msgr2=0x7f41d006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d006b260 0x7f41d006d720 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f41e8001560 tx=0x7f41e8009040 comp rx=0 tx=0).stop 2023-10-16T13:48:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 msgr2=0x7f41f0158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 0x7f41f0158230 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f41d8000c00 tx=0x7f41d8004750 comp rx=0 tx=0).stop 2023-10-16T13:48:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 shutdown_connections 2023-10-16T13:48:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f015de80 0x7f41f0158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d006b260 0x7f41d006d720 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f006d070 0x7f41f00af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 --2- 172.21.15.5:0/2332739816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f00b03d0 0x7f41f0158230 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 >> 172.21.15.5:0/2332739816 conn(0x7f41f00d1590 msgr2=0x7f41f00cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:25.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 shutdown_connections 2023-10-16T13:48:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.303+0000 7f41f4e84700 1 -- 172.21.15.5:0/2332739816 wait complete. 2023-10-16T13:48:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:48:25.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.441+0000 7f389bf98700 1 Processor -- start 2023-10-16T13:48:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.441+0000 7f389bf98700 1 -- start start 2023-10-16T13:48:25.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389bf98700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38940d0c70 0x7f38940cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389bf98700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38940c5110 0x7f38940ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389bf98700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940d23e0 con 0x7f389415b740 2023-10-16T13:48:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389bf98700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389415bb20 con 0x7f38940c5110 2023-10-16T13:48:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389bf98700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940cf190 con 0x7f38940d0c70 2023-10-16T13:48:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389a535700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38940c5110 0x7f38940ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f3899d34700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f389415b740 0x7f38940d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58758/0 (socket says 172.21.15.5:58758) 2023-10-16T13:48:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f3899d34700 1 -- 172.21.15.5:0/94607059 learned_addr learned my addr 172.21.15.5:0/94607059 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f3899533700 1 --2- 172.21.15.5:0/94607059 >> v2:172.21.15.112:3300/0 conn(0x7f38940d0c70 0x7f38940cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389a535700 1 -- 172.21.15.5:0/94607059 >> v2:172.21.15.112:3300/0 conn(0x7f38940d0c70 msgr2=0x7f38940cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389a535700 1 --2- 172.21.15.5:0/94607059 >> v2:172.21.15.112:3300/0 conn(0x7f38940d0c70 0x7f38940cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389a535700 1 -- 172.21.15.5:0/94607059 >> v1:172.21.15.5:6789/0 conn(0x7f389415b740 legacy=0x7f38940d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f3898d32700 1 -- 172.21.15.5:0/94607059 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733026363 0 0) 0x7f3890001110 con 0x7f389415b740 2023-10-16T13:48:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389a535700 1 -- 172.21.15.5:0/94607059 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940cbd40 con 0x7f38940c5110 2023-10-16T13:48:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.442+0000 7f389a535700 1 --2- 172.21.15.5:0/94607059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940c5110 0x7f38940ce510 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f38940cec30 tx=0x7f388c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e87ab023fde815 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f3898d32700 1 -- 172.21.15.5:0/94607059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00e070 con 0x7f38940c5110 2023-10-16T13:48:25.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f3898d32700 1 -- 172.21.15.5:0/94607059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00bbd0 con 0x7f38940c5110 2023-10-16T13:48:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f3898d32700 1 -- 172.21.15.5:0/94607059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c012430 con 0x7f38940c5110 2023-10-16T13:48:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 -- 172.21.15.5:0/94607059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940c5110 msgr2=0x7f38940ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 --2- 172.21.15.5:0/94607059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940c5110 0x7f38940ce510 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f38940cec30 tx=0x7f388c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 -- 172.21.15.5:0/94607059 shutdown_connections 2023-10-16T13:48:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 --2- 172.21.15.5:0/94607059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940c5110 0x7f38940ce510 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 --2- 172.21.15.5:0/94607059 >> v2:172.21.15.112:3300/0 conn(0x7f38940d0c70 0x7f38940cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 -- 172.21.15.5:0/94607059 >> 172.21.15.5:0/94607059 conn(0x7f38940665a0 msgr2=0x7f3894066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 -- 172.21.15.5:0/94607059 shutdown_connections 2023-10-16T13:48:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.443+0000 7f389bf98700 1 -- 172.21.15.5:0/94607059 wait complete. 2023-10-16T13:48:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.445+0000 7f389bf98700 1 Processor -- start 2023-10-16T13:48:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.445+0000 7f389bf98700 1 -- start start 2023-10-16T13:48:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389bf98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38940c5110 0x7f38940b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389bf98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d0c70 0x7f38940b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389bf98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 0x7f38940b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389bf98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940c93a0 con 0x7f389415b740 2023-10-16T13:48:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389bf98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940c9680 con 0x7f38940d0c70 2023-10-16T13:48:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389bf98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940c9960 con 0x7f38940c5110 2023-10-16T13:48:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 0x7f38940b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 0x7f38940b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48764/0 (socket says 172.21.15.5:48764) 2023-10-16T13:48:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 -- 172.21.15.5:0/1434980710 learned_addr learned my addr 172.21.15.5:0/1434980710 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f3899d34700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38940c5110 0x7f38940b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f3899533700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d0c70 0x7f38940b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 -- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38940c5110 msgr2=0x7f38940b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38940c5110 0x7f38940b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 -- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d0c70 msgr2=0x7f38940b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d0c70 0x7f38940b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 -- 172.21.15.5:0/1434980710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009a70 con 0x7f389415b740 2023-10-16T13:48:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.446+0000 7f389a535700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 0x7f38940b1f70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f38940cee90 tx=0x7f388c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.447+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c012430 con 0x7f389415b740 2023-10-16T13:48:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.447+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c020070 con 0x7f389415b740 2023-10-16T13:48:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.447+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940c9c40 con 0x7f389415b740 2023-10-16T13:48:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.447+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0044c0 con 0x7f389415b740 2023-10-16T13:48:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.447+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38940b64d0 con 0x7f389415b740 2023-10-16T13:48:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.448+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38940b6660 con 0x7f389415b740 2023-10-16T13:48:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.448+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f388c004620 con 0x7f389415b740 2023-10-16T13:48:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.449+0000 7f388a7fc700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f387806b260 0x7f387806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.449+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f388c022070 con 0x7f389415b740 2023-10-16T13:48:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.449+0000 7f3899d34700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f387806b260 0x7f387806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.449+0000 7f3899d34700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f387806b260 0x7f387806d720 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3890000f60 tx=0x7f3890007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.454+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f388c056920 con 0x7f389415b740 2023-10-16T13:48:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.699+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3894067d20 con 0x7f389415b740 2023-10-16T13:48:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.699+0000 7f388a7fc700 1 -- 172.21.15.5:0/1434980710 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f388c059f40 con 0x7f389415b740 2023-10-16T13:48:25.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:25.703 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:19.692644+0000","modified":"2023-10-16T13:48:22.708850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2462371397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2462371397},{"type":"v1","addr":"172.21.15.5:6835","nonce":2462371397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-16T13:48:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f387806b260 msgr2=0x7f387806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f387806b260 0x7f387806d720 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3890000f60 tx=0x7f3890007c90 comp rx=0 tx=0).stop 2023-10-16T13:48:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 msgr2=0x7f38940b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 0x7f38940b1f70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f38940cee90 tx=0x7f388c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 shutdown_connections 2023-10-16T13:48:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389415b740 0x7f38940b1f70 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f387806b260 0x7f387806d720 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38940c5110 0x7f38940b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 --2- 172.21.15.5:0/1434980710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d0c70 0x7f38940b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 >> 172.21.15.5:0/1434980710 conn(0x7f38940665a0 msgr2=0x7f3894066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 shutdown_connections 2023-10-16T13:48:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:25.701+0000 7f389bf98700 1 -- 172.21.15.5:0/1434980710 wait complete. 2023-10-16T13:48:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2023-10-16T13:48:26.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:48:19.692644+0000', 'modified': '2023-10-16T13:48:22.708850+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7305': {'gid': 7305, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/2462371397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 2462371397}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 2462371397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:48:26.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:48:26.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T13:48:26.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.247+0000 7ff8317d0700 1 Processor -- start 2023-10-16T13:48:26.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.247+0000 7ff8317d0700 1 -- start start 2023-10-16T13:48:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff8317d0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c0d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff8317d0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 0x7ff82c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff8317d0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0cce60 con 0x7ff82c15bbc0 2023-10-16T13:48:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff8317d0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0cd4e0 con 0x7ff82c15bfa0 2023-10-16T13:48:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff8317d0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0b2ba0 con 0x7ff82c0ce4c0 2023-10-16T13:48:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 0x7ff82c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c0d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 0x7ff82c0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44668/0 (socket says 172.21.15.5:44668) 2023-10-16T13:48:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c0d20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:46674/0 (socket says 172.21.15.5:46674) 2023-10-16T13:48:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82b7fe700 1 -- 172.21.15.5:0/541212884 learned_addr learned my addr 172.21.15.5:0/541212884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 -- 172.21.15.5:0/541212884 >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 msgr2=0x7ff82c0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/541212884 >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 0x7ff82c0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 -- 172.21.15.5:0/541212884 >> v1:172.21.15.112:6789/0 conn(0x7ff82c15bbc0 legacy=0x7ff82c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 -- 172.21.15.5:0/541212884 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0cd100 con 0x7ff82c0ce4c0 2023-10-16T13:48:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/541212884 >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 0x7ff82c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.249+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/541212884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c0d20e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff814009840 tx=0x7ff814009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98287c86b39a4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff829ffb700 1 -- 172.21.15.5:0/541212884 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814011830 con 0x7ff82c0ce4c0 2023-10-16T13:48:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff829ffb700 1 -- 172.21.15.5:0/541212884 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814011990 con 0x7ff82c0ce4c0 2023-10-16T13:48:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff829ffb700 1 -- 172.21.15.5:0/541212884 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814011d20 con 0x7ff82c0ce4c0 2023-10-16T13:48:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 -- 172.21.15.5:0/541212884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 msgr2=0x7ff82c0d20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 --2- 172.21.15.5:0/541212884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c0d20e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff814009840 tx=0x7ff814009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 -- 172.21.15.5:0/541212884 shutdown_connections 2023-10-16T13:48:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 --2- 172.21.15.5:0/541212884 >> v2:172.21.15.112:3300/0 conn(0x7ff82c15bfa0 0x7ff82c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 --2- 172.21.15.5:0/541212884 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c0d20e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 -- 172.21.15.5:0/541212884 >> 172.21.15.5:0/541212884 conn(0x7ff82c0d15f0 msgr2=0x7ff82c0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 -- 172.21.15.5:0/541212884 shutdown_connections 2023-10-16T13:48:26.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.250+0000 7ff8317d0700 1 -- 172.21.15.5:0/541212884 wait complete. 2023-10-16T13:48:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.252+0000 7ff8317d0700 1 Processor -- start 2023-10-16T13:48:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.252+0000 7ff8317d0700 1 -- start start 2023-10-16T13:48:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff8317d0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff8317d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 0x7ff82c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff8317d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82c15bfa0 0x7ff82c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff8317d0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0c6f10 con 0x7ff82c15bbc0 2023-10-16T13:48:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff8317d0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0c71f0 con 0x7ff82c15bfa0 2023-10-16T13:48:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff8317d0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0c74d0 con 0x7ff82c0ce4c0 2023-10-16T13:48:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 0x7ff82c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 0x7ff82c0c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48778/0 (socket says 172.21.15.5:48778) 2023-10-16T13:48:26.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2318664942 learned_addr learned my addr 172.21.15.5:0/2318664942 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82affd700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82c15bfa0 0x7ff82c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 msgr2=0x7ff82c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.253+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82c15bfa0 msgr2=0x7ff82c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82c15bfa0 0x7ff82c0c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2318664942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009b30 con 0x7ff82c15bbc0 2023-10-16T13:48:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82c15bfa0 0x7ff82c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 0x7ff82c0c9300 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff8140090b0 tx=0x7ff814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff8237fe700 1 -- 172.21.15.5:0/2318664942 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140036a0 con 0x7ff82c15bbc0 2023-10-16T13:48:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff8237fe700 1 -- 172.21.15.5:0/2318664942 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81401f070 con 0x7ff82c15bbc0 2023-10-16T13:48:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140094a0 con 0x7ff82c15bbc0 2023-10-16T13:48:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff8237fe700 1 -- 172.21.15.5:0/2318664942 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814003a60 con 0x7ff82c15bbc0 2023-10-16T13:48:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.254+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0c7a90 con 0x7ff82c15bbc0 2023-10-16T13:48:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.255+0000 7ff8237fe700 1 -- 172.21.15.5:0/2318664942 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7ff814003bc0 con 0x7ff82c15bbc0 2023-10-16T13:48:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.256+0000 7ff8237fe700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff80c06b260 0x7ff80c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.256+0000 7ff8237fe700 1 -- 172.21.15.5:0/2318664942 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff814021070 con 0x7ff82c15bbc0 2023-10-16T13:48:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.256+0000 7ff82affd700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff80c06b260 0x7ff80c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.257+0000 7ff82affd700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff80c06b260 0x7ff80c06d720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff81c000f60 tx=0x7ff81c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.258+0000 7ff83d9bab80 1 Processor -- start 2023-10-16T13:48:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.258+0000 7ff83d9bab80 1 -- start start 2023-10-16T13:48:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c9933b40 0x5567c9933f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9933280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c995a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c98a7c20 con 0x5567c995af30 2023-10-16T13:48:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c988cc10 con 0x5567c9933b40 2023-10-16T13:48:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567c988a530 con 0x5567c992ef00 2023-10-16T13:48:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9933280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9933280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48784/0 (socket says 172.21.15.5:48784) 2023-10-16T13:48:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 -- 172.21.15.5:0/4171696715 learned_addr learned my addr 172.21.15.5:0/4171696715 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82affd700 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c9933b40 0x5567c9933f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c995a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 -- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 msgr2=0x5567c995a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c995a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 -- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c9933b40 msgr2=0x5567c9933f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c9933b40 0x5567c9933f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 -- 172.21.15.5:0/4171696715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567c98433a0 con 0x5567c995af30 2023-10-16T13:48:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c995a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9933280 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff814006c30 tx=0x7ff814059c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d59c4fbabc1adab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.259+0000 7ff820ff9700 1 -- 172.21.15.5:0/4171696715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814071070 con 0x5567c995af30 2023-10-16T13:48:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff820ff9700 1 -- 172.21.15.5:0/4171696715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814024380 con 0x5567c995af30 2023-10-16T13:48:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff820ff9700 1 -- 172.21.15.5:0/4171696715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81405a480 con 0x5567c995af30 2023-10-16T13:48:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 -- 172.21.15.5:0/4171696715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 msgr2=0x5567c9933280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9933280 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff814006c30 tx=0x7ff814059c50 comp rx=0 tx=0).stop 2023-10-16T13:48:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 -- 172.21.15.5:0/4171696715 shutdown_connections 2023-10-16T13:48:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c995a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c9933b40 0x5567c9933f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/4171696715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9933280 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 -- 172.21.15.5:0/4171696715 >> 172.21.15.5:0/4171696715 conn(0x5567c9860d80 msgr2=0x5567c997bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 -- 172.21.15.5:0/4171696715 shutdown_connections 2023-10-16T13:48:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.260+0000 7ff83d9bab80 1 -- 172.21.15.5:0/4171696715 wait complete. 2023-10-16T13:48:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.261+0000 7ff83d9bab80 1 -- start start 2023-10-16T13:48:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.261+0000 7ff83d9bab80 1 Processor -- start 2023-10-16T13:48:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c99743c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c992e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c995af30 0x5567c9976590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c9885e20 con 0x5567c9933b40 2023-10-16T13:48:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c98226c0 con 0x5567c992ef00 2023-10-16T13:48:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567c9822360 con 0x5567c995af30 2023-10-16T13:48:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 10 client.0 _ll_register_callbacks cb 0x5567c967f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:48:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c992e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c992e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48790/0 (socket says 172.21.15.5:48790) 2023-10-16T13:48:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2990787871 learned_addr learned my addr 172.21.15.5:0/2990787871 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82affd700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c99743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c995af30 0x5567c9976590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c995af30 msgr2=0x5567c9976590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c995af30 0x5567c9976590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 msgr2=0x5567c99743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c99743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 -- 172.21.15.5:0/2990787871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0c7a90 con 0x5567c9933b40 2023-10-16T13:48:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c995af30 0x5567c9976590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c992e1a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff8140580d0 tx=0x7ff814009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bf83bd6bc86f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff809ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:48:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff809ffb700 1 -- 172.21.15.5:0/2990787871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814071040 con 0x5567c9933b40 2023-10-16T13:48:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff809ffb700 1 -- 172.21.15.5:0/2990787871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff814059d80 con 0x5567c9933b40 2023-10-16T13:48:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.262+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567c99265b0 con 0x5567c9933b40 2023-10-16T13:48:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff809ffb700 1 -- 172.21.15.5:0/2990787871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff81405ded0 con 0x5567c9933b40 2023-10-16T13:48:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 10 client.7449 fetch_fsmap learned FSMap version 70 2023-10-16T13:48:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5567c96b0d90 con 0x5567c9933b40 2023-10-16T13:48:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff809ffb700 1 -- 172.21.15.5:0/2990787871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81407c020 con 0x5567c9933b40 2023-10-16T13:48:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff809ffb700 1 -- 172.21.15.5:0/2990787871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff814059270 con 0x5567c9933b40 2023-10-16T13:48:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 10 client.7449 fetch_fsmap finished waiting for FSMap version 70 2023-10-16T13:48:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 10 client.7449 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:48:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 20 client.7449 populate_metadata read hostname 'smithi005' 2023-10-16T13:48:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c9954350 0x5567c9954730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 4 client.7449 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:48:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 --> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567c987ee00 con 0x5567c9954350 2023-10-16T13:48:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff82affd700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c9954350 0x5567c9954730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff82affd700 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c9954350 0x5567c9954730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dca4232fc589222 server_cookie=b83cc06fd80bba8c in_seq=0 out_seq=0 2023-10-16T13:48:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.263+0000 7ff809ffb700 10 client.7449 ms_handle_connect on v2:172.21.15.5:6833/2462371397 2023-10-16T13:48:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff809ffb700 1 -- 172.21.15.5:0/2990787871 <== mds.0 v2:172.21.15.5:6833/2462371397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5567c987ee00 con 0x5567c9954350 2023-10-16T13:48:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff809ffb700 10 client.7449 handle_command_reply: tid=0 2023-10-16T13:48:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 client.7449 shutdown 2023-10-16T13:48:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 msgr2=0x5567c992e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c992e1a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff8140580d0 tx=0x7ff814009210 comp rx=0 tx=0).stop 2023-10-16T13:48:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 shutdown_connections 2023-10-16T13:48:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c9954350 0x5567c9954730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c995af30 0x5567c9976590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c99743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/2990787871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c992e1a0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff809ffb700 0 client.7449 ms_handle_reset on v2:172.21.15.5:6833/2462371397 2023-10-16T13:48:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 >> 172.21.15.5:0/2990787871 conn(0x5567c9860d80 msgr2=0x5567c9928420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 shutdown_connections 2023-10-16T13:48:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.264+0000 7ff83d9bab80 1 -- 172.21.15.5:0/2990787871 wait complete. 2023-10-16T13:48:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.265+0000 7ff83d9bab80 20 client.7449 trim_cache size 0 max 16384 2023-10-16T13:48:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.282+0000 7ff83d9bab80 1 Processor -- start 2023-10-16T13:48:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.282+0000 7ff83d9bab80 1 -- start start 2023-10-16T13:48:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c995a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c9933b40 0x5567c9976590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c97068d0 con 0x5567c995af30 2023-10-16T13:48:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c9954960 con 0x5567c992ef00 2023-10-16T13:48:26.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567c995da60 con 0x5567c9933b40 2023-10-16T13:48:26.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48800/0 (socket says 172.21.15.5:48800) 2023-10-16T13:48:26.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 -- 172.21.15.5:0/3990139556 learned_addr learned my addr 172.21.15.5:0/3990139556 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 -- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c9933b40 msgr2=0x5567c9976590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c9933b40 0x5567c9976590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 -- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 msgr2=0x5567c995a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82affd700 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c995a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c995a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.283+0000 7ff82b7fe700 1 -- 172.21.15.5:0/3990139556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567c99341f0 con 0x5567c995af30 2023-10-16T13:48:26.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff82b7fe700 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9978ef0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0cbbf0 tx=0x7ff82400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b647300d2088fc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff8217fa700 1 -- 172.21.15.5:0/3990139556 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824007e00 con 0x5567c995af30 2023-10-16T13:48:26.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff8217fa700 1 -- 172.21.15.5:0/3990139556 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400f070 con 0x5567c995af30 2023-10-16T13:48:26.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff8217fa700 1 -- 172.21.15.5:0/3990139556 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240155f0 con 0x5567c995af30 2023-10-16T13:48:26.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 -- 172.21.15.5:0/3990139556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 msgr2=0x5567c9978ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9978ef0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0cbbf0 tx=0x7ff82400b040 comp rx=0 tx=0).stop 2023-10-16T13:48:26.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 -- 172.21.15.5:0/3990139556 shutdown_connections 2023-10-16T13:48:26.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c992ef00 0x5567c995a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/3990139556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c9933b40 0x5567c9976590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 -- 172.21.15.5:0/3990139556 >> 172.21.15.5:0/3990139556 conn(0x5567c9860d80 msgr2=0x5567c992f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 -- 172.21.15.5:0/3990139556 shutdown_connections 2023-10-16T13:48:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.284+0000 7ff83d9bab80 1 -- 172.21.15.5:0/3990139556 wait complete. 2023-10-16T13:48:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.285+0000 7ff83d9bab80 1 -- start start 2023-10-16T13:48:26.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.285+0000 7ff83d9bab80 1 Processor -- start 2023-10-16T13:48:26.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c99849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c9952030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c996f470 con 0x5567c9933b40 2023-10-16T13:48:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567c9972fe0 con 0x5567c995af30 2023-10-16T13:48:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567c999f060 con 0x5567c992ef00 2023-10-16T13:48:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff83d9bab80 10 client.0 _ll_register_callbacks cb 0x7ff814009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:48:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c9952030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c9952030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48804/0 (socket says 172.21.15.5:48804) 2023-10-16T13:48:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 -- 172.21.15.5:0/1701033703 learned_addr learned my addr 172.21.15.5:0/1701033703 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 -- 172.21.15.5:0/1701033703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 msgr2=0x5567c99849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c99849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 -- 172.21.15.5:0/1701033703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c995af30 msgr2=0x5567c9978ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 -- 172.21.15.5:0/1701033703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8240090b0 con 0x5567c9933b40 2023-10-16T13:48:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff82a7fc700 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c9952030 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff814006ce0 tx=0x7ff814060050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaeac5138ab9b53d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff809ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:48:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.286+0000 7ff809ffb700 1 -- 172.21.15.5:0/1701033703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814071040 con 0x5567c9933b40 2023-10-16T13:48:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff809ffb700 1 -- 172.21.15.5:0/1701033703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff81407d080 con 0x5567c9933b40 2023-10-16T13:48:26.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff814024380 con 0x5567c9933b40 2023-10-16T13:48:26.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff809ffb700 1 -- 172.21.15.5:0/1701033703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8140598c0 con 0x5567c9933b40 2023-10-16T13:48:26.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 10 client.7455 fetch_fsmap learned FSMap version 70 2023-10-16T13:48:26.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5567c9699c10 con 0x5567c9933b40 2023-10-16T13:48:26.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff809ffb700 1 -- 172.21.15.5:0/1701033703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814024380 con 0x5567c9933b40 2023-10-16T13:48:26.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff809ffb700 1 -- 172.21.15.5:0/1701033703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff8140830d0 con 0x5567c9933b40 2023-10-16T13:48:26.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 10 client.7455 fetch_fsmap finished waiting for FSMap version 70 2023-10-16T13:48:26.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 10 client.7455 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:48:26.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 20 client.7455 populate_metadata read hostname 'smithi005' 2023-10-16T13:48:26.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c99e7890 0x5567c9979430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 4 client.7455 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:48:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 --> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5567c987eb20 con 0x5567c99e7890 2023-10-16T13:48:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff82affd700 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c99e7890 0x5567c9979430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff809ffb700 10 client.7455 ms_handle_connect on v2:172.21.15.5:6833/2462371397 2023-10-16T13:48:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.287+0000 7ff82affd700 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c99e7890 0x5567c9979430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3980ccb587fd904 server_cookie=daef024a17463a19 in_seq=0 out_seq=0 2023-10-16T13:48:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff809ffb700 1 -- 172.21.15.5:0/1701033703 <== mds.0 v2:172.21.15.5:6833/2462371397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5567c987eb20 con 0x5567c99e7890 2023-10-16T13:48:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff809ffb700 10 client.7455 handle_command_reply: tid=0 2023-10-16T13:48:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 client.7455 shutdown 2023-10-16T13:48:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 msgr2=0x5567c9952030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c9952030 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff814006ce0 tx=0x7ff814060050 comp rx=0 tx=0).stop 2023-10-16T13:48:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 shutdown_connections 2023-10-16T13:48:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:6833/2462371397,v1:172.21.15.5:6835/2462371397] conn(0x5567c99e7890 0x5567c9979430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5567c995af30 0x5567c9978ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff809ffb700 0 client.7455 ms_handle_reset on v2:172.21.15.5:6833/2462371397 2023-10-16T13:48:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5567c992ef00 0x5567c99849b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 --2- 172.21.15.5:0/1701033703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567c9933b40 0x5567c9952030 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 >> 172.21.15.5:0/1701033703 conn(0x5567c9860d80 msgr2=0x5567c9976590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 shutdown_connections 2023-10-16T13:48:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 1 -- 172.21.15.5:0/1701033703 wait complete. 2023-10-16T13:48:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff83d9bab80 20 client.7455 trim_cache size 0 max 16384 2023-10-16T13:48:26.311 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:48:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:48:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:48:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7305, 2023-10-16T13:48:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:48:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:48:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:48:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.0045493639999998, 2023-10-16T13:48:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 70, 2023-10-16T13:48:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 98, 2023-10-16T13:48:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 98, 2023-10-16T13:48:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.913589156 2023-10-16T13:48:26.313 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:48:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff80c06b260 msgr2=0x7ff80c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff80c06b260 0x7ff80c06d720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff81c000f60 tx=0x7ff81c009040 comp rx=0 tx=0).stop 2023-10-16T13:48:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 msgr2=0x7ff82c0c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 0x7ff82c0c9300 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff8140090b0 tx=0x7ff814004750 comp rx=0 tx=0).stop 2023-10-16T13:48:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 shutdown_connections 2023-10-16T13:48:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82c15bfa0 0x7ff82c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff80c06b260 0x7ff80c06d720 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff82c0ce4c0 0x7ff82c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 --2- 172.21.15.5:0/2318664942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c15bbc0 0x7ff82c0c9300 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.288+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 >> 172.21.15.5:0/2318664942 conn(0x7ff82c0d15f0 msgr2=0x7ff82c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.289+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 shutdown_connections 2023-10-16T13:48:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.289+0000 7ff8317d0700 1 -- 172.21.15.5:0/2318664942 wait complete. 2023-10-16T13:48:26.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:48:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.440+0000 7f2628c79700 1 Processor -- start 2023-10-16T13:48:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.440+0000 7f2628c79700 1 -- start start 2023-10-16T13:48:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f2628c79700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262406af50 0x7f26240cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f2628c79700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240b2d60 con 0x7f26240cd950 2023-10-16T13:48:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f2628c79700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240cdd30 con 0x7f262415e2f0 2023-10-16T13:48:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f2628c79700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26241619a0 con 0x7f262406af50 2023-10-16T13:48:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f262259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26240cd950 0x7f262415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58814/0 (socket says 172.21.15.5:58814) 2023-10-16T13:48:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f262259c700 1 -- 172.21.15.5:0/230977400 learned_addr learned my addr 172.21.15.5:0/230977400 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f2622d9d700 1 --2- 172.21.15.5:0/230977400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262406af50 0x7f26240cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852769797 0 0) 0x7f26240b2d60 con 0x7f26240cd950 2023-10-16T13:48:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c0035b0 con 0x7f26240cd950 2023-10-16T13:48:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028461147 0 0) 0x7f26240cdd30 con 0x7f262415e2f0 2023-10-16T13:48:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.441+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26240b2d60 con 0x7f262415e2f0 2023-10-16T13:48:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f2622d9d700 1 -- 172.21.15.5:0/230977400 >> v1:172.21.15.112:6789/0 conn(0x7f262415e2f0 legacy=0x7f262406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f2622d9d700 1 -- 172.21.15.5:0/230977400 >> v1:172.21.15.5:6789/0 conn(0x7f26240cd950 legacy=0x7f262415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741212527 0 0) 0x7f260c0035b0 con 0x7f26240cd950 2023-10-16T13:48:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f2622d9d700 1 -- 172.21.15.5:0/230977400 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262415e920 con 0x7f262406af50 2023-10-16T13:48:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f2622d9d700 1 --2- 172.21.15.5:0/230977400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262406af50 0x7f26240cede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f261c009dc0 tx=0x7f261c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3abf7672f52a262 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00e070 con 0x7f262406af50 2023-10-16T13:48:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c003a20 con 0x7f262406af50 2023-10-16T13:48:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f262159a700 1 -- 172.21.15.5:0/230977400 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618001670 con 0x7f262406af50 2023-10-16T13:48:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f2628c79700 1 -- 172.21.15.5:0/230977400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262406af50 msgr2=0x7f26240cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.442+0000 7f2628c79700 1 --2- 172.21.15.5:0/230977400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262406af50 0x7f26240cede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f261c009dc0 tx=0x7f261c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.443+0000 7f2628c79700 1 -- 172.21.15.5:0/230977400 shutdown_connections 2023-10-16T13:48:26.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.443+0000 7f2628c79700 1 --2- 172.21.15.5:0/230977400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262406af50 0x7f26240cede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.443+0000 7f2628c79700 1 -- 172.21.15.5:0/230977400 >> 172.21.15.5:0/230977400 conn(0x7f262406dae0 msgr2=0x7f262406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.443+0000 7f2628c79700 1 -- 172.21.15.5:0/230977400 shutdown_connections 2023-10-16T13:48:26.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.443+0000 7f2628c79700 1 -- 172.21.15.5:0/230977400 wait complete. 2023-10-16T13:48:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.444+0000 7f2628c79700 1 Processor -- start 2023-10-16T13:48:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.444+0000 7f2628c79700 1 -- start start 2023-10-16T13:48:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2628c79700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 0x7f262406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2628c79700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26240cd950 0x7f26240ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2628c79700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262415e2f0 0x7f26240ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2628c79700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c4da0 con 0x7f262406af50 2023-10-16T13:48:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2628c79700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240ad300 con 0x7f26240cd950 2023-10-16T13:48:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2628c79700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240ad5e0 con 0x7f262415e2f0 2023-10-16T13:48:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 0x7f262406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 0x7f262406e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48816/0 (socket says 172.21.15.5:48816) 2023-10-16T13:48:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 -- 172.21.15.5:0/505862159 learned_addr learned my addr 172.21.15.5:0/505862159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2622d9d700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262415e2f0 0x7f26240ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2621d9b700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26240cd950 0x7f26240ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 -- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262415e2f0 msgr2=0x7f26240ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262415e2f0 0x7f26240ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 -- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26240cd950 msgr2=0x7f26240ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26240cd950 0x7f26240ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 -- 172.21.15.5:0/505862159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009a70 con 0x7f262406af50 2023-10-16T13:48:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2622d9d700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262415e2f0 0x7f26240ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2621d9b700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26240cd950 0x7f26240ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f262259c700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 0x7f262406e130 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f261800c770 tx=0x7f261800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.445+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618007560 con 0x7f262406af50 2023-10-16T13:48:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.446+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26180076c0 con 0x7f262406af50 2023-10-16T13:48:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.446+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618004a70 con 0x7f262406af50 2023-10-16T13:48:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.446+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26240ad8c0 con 0x7f262406af50 2023-10-16T13:48:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.446+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26240b5ad0 con 0x7f262406af50 2023-10-16T13:48:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.446+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26240b2630 con 0x7f262406af50 2023-10-16T13:48:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.447+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f2618004bd0 con 0x7f262406af50 2023-10-16T13:48:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.447+0000 7f2612ffd700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b260 0x7f260406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.448+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2618088ce0 con 0x7f262406af50 2023-10-16T13:48:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.448+0000 7f2621d9b700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b260 0x7f260406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.448+0000 7f2621d9b700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b260 0x7f260406d720 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2614001230 tx=0x7f2614009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:26.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.452+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2618053a10 con 0x7f262406af50 2023-10-16T13:48:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.697+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f26240b2100 con 0x7f262406af50 2023-10-16T13:48:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.697+0000 7f2612ffd700 1 -- 172.21.15.5:0/505862159 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2618018070 con 0x7f262406af50 2023-10-16T13:48:26.700 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:48:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b260 msgr2=0x7f260406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b260 0x7f260406d720 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2614001230 tx=0x7f2614009040 comp rx=0 tx=0).stop 2023-10-16T13:48:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 msgr2=0x7f262406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 0x7f262406e130 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f261800c770 tx=0x7f261800cb30 comp rx=0 tx=0).stop 2023-10-16T13:48:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 shutdown_connections 2023-10-16T13:48:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f260406b260 0x7f260406d720 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f262415e2f0 0x7f26240ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262406af50 0x7f262406e130 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 --2- 172.21.15.5:0/505862159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26240cd950 0x7f26240ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 >> 172.21.15.5:0/505862159 conn(0x7f262406dae0 msgr2=0x7f262406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 shutdown_connections 2023-10-16T13:48:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:26.699+0000 7f2628c79700 1 -- 172.21.15.5:0/505862159 wait complete. 2023-10-16T13:48:26.714 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:48:26.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:48:26.715 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:48:26.715 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:48:26.716 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:26.716 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:48:26.716 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:48:26.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:48:26.717 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:48:26.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:26.718 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:48:26.735 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:48:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:48:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:48:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:48:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.737 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:26.737 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:26.737 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:48:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:48:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41796sec preferred_lft 41796sec 2023-10-16T13:48:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:48:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.739 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:26.739 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:48:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:48:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:48:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.740 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:48:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:48:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.741 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:48:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:48:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:26.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:26.742 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:48:26.801 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:48:26.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:26.803 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:48:26.861 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:48:26.861 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:48:26.861 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:48:26.861 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:48:26.862 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:48:26.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:26.863 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:48:26.863 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:48:26.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:48:26.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:48:26.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:48:26.864 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:48:26.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:26.969 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:48:26.987 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:48:26.987 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:48:26.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:48:26.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:26.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:48:27.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:27.055 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:27.112 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:48:27.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:27.113 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:27.169 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:48:27.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:27.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:27.256 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:27.256 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:27.287 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:27.287 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:27.287 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:27.287 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:27.287 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:27.288 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:27.288 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:27.288 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:48:27.360 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:27.360 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:27.360 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:27.361 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:27.361 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:27.361 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:27.361 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:27.361 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:48:27.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:48:27.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:48:27.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:48:27.363 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:48:27.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:27.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:27.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:27.392 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:48:27.475 INFO:teuthology.orchestra.run.smithi005.stdout:client6970 2023-10-16T13:48:27.475 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:27.475 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:27.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:48:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.695+0000 7f378196e700 1 Processor -- start 2023-10-16T13:48:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.695+0000 7f378196e700 1 -- start start 2023-10-16T13:48:27.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f378196e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:27.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f378196e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f377c0b7050 0x7f377c0d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f378196e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c15e4e0 con 0x7f377c15dbc0 2023-10-16T13:48:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f378196e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0b7560 con 0x7f377c0b7050 2023-10-16T13:48:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f378196e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0b7840 con 0x7f377c0d3fc0 2023-10-16T13:48:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f377c0b7050 0x7f377c0d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f377c0b7050 0x7f377c0d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48832/0 (socket says 172.21.15.5:48832) 2023-10-16T13:48:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 -- 172.21.15.5:0/2524664400 learned_addr learned my addr 172.21.15.5:0/2524664400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377a7fc700 1 --2- 172.21.15.5:0/2524664400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 -- 172.21.15.5:0/2524664400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 msgr2=0x7f377c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 --2- 172.21.15.5:0/2524664400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 -- 172.21.15.5:0/2524664400 >> v1:172.21.15.112:6789/0 conn(0x7f377c15dbc0 legacy=0x7f377c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 -- 172.21.15.5:0/2524664400 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0b7b20 con 0x7f377c0b7050 2023-10-16T13:48:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f377b7fe700 1 --2- 172.21.15.5:0/2524664400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c0d21d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3774009e50 tx=0x7f377400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e4a6ab9563b13f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f3779ffb700 1 -- 172.21.15.5:0/2524664400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400e070 con 0x7f377c0b7050 2023-10-16T13:48:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f3779ffb700 1 -- 172.21.15.5:0/2524664400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400b910 con 0x7f377c0b7050 2023-10-16T13:48:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.696+0000 7f3779ffb700 1 -- 172.21.15.5:0/2524664400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400bcc0 con 0x7f377c0b7050 2023-10-16T13:48:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 -- 172.21.15.5:0/2524664400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 msgr2=0x7f377c0d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 --2- 172.21.15.5:0/2524664400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c0d21d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3774009e50 tx=0x7f377400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 -- 172.21.15.5:0/2524664400 shutdown_connections 2023-10-16T13:48:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 --2- 172.21.15.5:0/2524664400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c0d21d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 --2- 172.21.15.5:0/2524664400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 -- 172.21.15.5:0/2524664400 >> 172.21.15.5:0/2524664400 conn(0x7f377c09cb40 msgr2=0x7f377c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 -- 172.21.15.5:0/2524664400 shutdown_connections 2023-10-16T13:48:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.697+0000 7f378196e700 1 -- 172.21.15.5:0/2524664400 wait complete. 2023-10-16T13:48:27.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.698+0000 7f378196e700 1 Processor -- start 2023-10-16T13:48:27.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.698+0000 7f378196e700 1 -- start start 2023-10-16T13:48:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f378196e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c09d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f378196e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f378196e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c15dbc0 0x7f377c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f378196e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c09e6a0 con 0x7f377c0b7050 2023-10-16T13:48:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f378196e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c09da90 con 0x7f377c15dbc0 2023-10-16T13:48:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f378196e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c09dd70 con 0x7f377c0d3fc0 2023-10-16T13:48:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f377affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c09d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f377affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c09d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48834/0 (socket says 172.21.15.5:48834) 2023-10-16T13:48:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.699+0000 7f377affd700 1 -- 172.21.15.5:0/754814025 learned_addr learned my addr 172.21.15.5:0/754814025 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377b7fe700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c15dbc0 0x7f377c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377affd700 1 -- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 msgr2=0x7f377c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377a7fc700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377affd700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377affd700 1 -- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c15dbc0 msgr2=0x7f377c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377affd700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c15dbc0 0x7f377c0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377affd700 1 -- 172.21.15.5:0/754814025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774009b30 con 0x7f377c0b7050 2023-10-16T13:48:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377b7fe700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c15dbc0 0x7f377c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f377affd700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c09d4b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c430 tx=0x7f376c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0052d0 con 0x7f377c0b7050 2023-10-16T13:48:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c005450 con 0x7f377c0b7050 2023-10-16T13:48:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c006af0 con 0x7f377c0b7050 2023-10-16T13:48:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c09e050 con 0x7f377c0b7050 2023-10-16T13:48:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.700+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c15b290 con 0x7f377c0b7050 2023-10-16T13:48:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.701+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c04ebb0 con 0x7f377c0b7050 2023-10-16T13:48:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.701+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f376c0036d0 con 0x7f377c0b7050 2023-10-16T13:48:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.702+0000 7f3763fff700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f376806b290 0x7f376806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.702+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f376c088d50 con 0x7f377c0b7050 2023-10-16T13:48:27.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.702+0000 7f377a7fc700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f376806b290 0x7f376806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:27.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.703+0000 7f377a7fc700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f376806b290 0x7f376806d750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b4cc0 tx=0x7f3770008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:27.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.707+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f376c0539f0 con 0x7f377c0b7050 2023-10-16T13:48:27.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.955+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f377c0b6c40 con 0x7f377c0b7050 2023-10-16T13:48:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.956+0000 7f3763fff700 1 -- 172.21.15.5:0/754814025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f376c057010 con 0x7f377c0b7050 2023-10-16T13:48:27.959 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:48:27.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f376806b290 msgr2=0x7f376806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:27.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f376806b290 0x7f376806d750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b4cc0 tx=0x7f3770008040 comp rx=0 tx=0).stop 2023-10-16T13:48:27.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 msgr2=0x7f377c09d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:27.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c09d4b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c430 tx=0x7f376c00c7f0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 shutdown_connections 2023-10-16T13:48:27.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c15dbc0 0x7f377c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f377c0b7050 0x7f377c09d4b0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f376806b290 0x7f376806d750 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 --2- 172.21.15.5:0/754814025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c0d3fc0 0x7f377c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:27.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 >> 172.21.15.5:0/754814025 conn(0x7f377c09cb40 msgr2=0x7f377c06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:27.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 shutdown_connections 2023-10-16T13:48:27.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:27.958+0000 7f378196e700 1 -- 172.21.15.5:0/754814025 wait complete. 2023-10-16T13:48:27.973 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:48:27.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:48:27.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:48:27.974 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:48:27.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:27.975 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:48:27.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:48:27.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:48:27.976 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:48:27.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:27.976 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:48:27.998 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:48:27.998 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:48:27.998 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:48:27.999 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:27.999 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:48:27.999 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:27.999 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:27.999 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:28.000 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:28.000 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:28.000 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:28.000 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:28.000 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:48:28.001 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:28.001 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:48:28.001 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 41810sec preferred_lft 41810sec 2023-10-16T13:48:28.001 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:48:28.001 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:28.002 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:48:28.002 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:28.002 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:48:28.002 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:28.002 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:48:28.002 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:28.003 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:28.003 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:48:28.003 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:48:28.003 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:28.003 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:28.004 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:48:28.004 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:48:28.004 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:28.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.005 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:48:28.069 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:48:28.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.071 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:48:28.132 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:48:28.132 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:48:28.132 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:48:28.133 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:48:28.133 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:48:28.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.133 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:48:28.134 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:48:28.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:48:28.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:48:28.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:48:28.135 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:48:28.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.246 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:48:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:48:28.264 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:48:28.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:48:28.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:48:28.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:28.332 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:28.389 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:48:28.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:28.390 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:28.446 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:48:28.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:28.531 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:28.532 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:28.556 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:28.556 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:28.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:28.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:28.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:28.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:28.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:28.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:48:28.587 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:28.587 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:28.587 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:28.587 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:28.588 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:28.588 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:28.588 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:28.588 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:48:28.588 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:48:28.589 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:48:28.589 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:48:28.591 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:48:28.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:28.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:28.620 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:48:28.692 INFO:teuthology.orchestra.run.smithi112.stdout:client6976 2023-10-16T13:48:28.692 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:28.693 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:28.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:48:28.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.890+0000 7f5d07dad700 1 Processor -- start 2023-10-16T13:48:28.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.890+0000 7f5d07dad700 1 -- start start 2023-10-16T13:48:28.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d07dad700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:28.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d07dad700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d000cf430 0x7f5d000ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d07dad700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000d05e0 con 0x7f5d000cc320 2023-10-16T13:48:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d07dad700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d000ce860 con 0x7f5d000cf430 2023-10-16T13:48:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d07dad700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000b08d0 con 0x7f5d000cdf40 2023-10-16T13:48:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d000cf430 0x7f5d000ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d000cf430 0x7f5d000ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48842/0 (socket says 172.21.15.5:48842) 2023-10-16T13:48:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 -- 172.21.15.5:0/2742430802 learned_addr learned my addr 172.21.15.5:0/2742430802 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05b49700 1 --2- 172.21.15.5:0/2742430802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 -- 172.21.15.5:0/2742430802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 msgr2=0x7f5d000d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 --2- 172.21.15.5:0/2742430802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 -- 172.21.15.5:0/2742430802 >> v1:172.21.15.112:6789/0 conn(0x7f5d000cc320 legacy=0x7f5d000cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 -- 172.21.15.5:0/2742430802 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000cfcb0 con 0x7f5d000cf430 2023-10-16T13:48:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.891+0000 7f5d05348700 1 --2- 172.21.15.5:0/2742430802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000ce320 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5156352820202f97 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d04b47700 1 -- 172.21.15.5:0/2742430802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011830 con 0x7f5d000cf430 2023-10-16T13:48:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d04b47700 1 -- 172.21.15.5:0/2742430802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf0011990 con 0x7f5d000cf430 2023-10-16T13:48:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d04b47700 1 -- 172.21.15.5:0/2742430802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011d20 con 0x7f5d000cf430 2023-10-16T13:48:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 -- 172.21.15.5:0/2742430802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 msgr2=0x7f5d000ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 --2- 172.21.15.5:0/2742430802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000ce320 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0009c00 comp rx=0 tx=0).stop 2023-10-16T13:48:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 -- 172.21.15.5:0/2742430802 shutdown_connections 2023-10-16T13:48:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 --2- 172.21.15.5:0/2742430802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 --2- 172.21.15.5:0/2742430802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000ce320 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 -- 172.21.15.5:0/2742430802 >> 172.21.15.5:0/2742430802 conn(0x7f5d000d1530 msgr2=0x7f5d000d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 -- 172.21.15.5:0/2742430802 shutdown_connections 2023-10-16T13:48:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.892+0000 7f5d07dad700 1 -- 172.21.15.5:0/2742430802 wait complete. 2023-10-16T13:48:28.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.893+0000 7f5d07dad700 1 Processor -- start 2023-10-16T13:48:28.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 -- start start 2023-10-16T13:48:28.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cc320 0x7f5d001e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:28.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:28.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:28.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00157840 con 0x7f5d000cf430 2023-10-16T13:48:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00157b20 con 0x7f5d000cc320 2023-10-16T13:48:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d07dad700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00157e00 con 0x7f5d000cdf40 2023-10-16T13:48:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d0634a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d0634a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48852/0 (socket says 172.21.15.5:48852) 2023-10-16T13:48:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.894+0000 7f5d0634a700 1 -- 172.21.15.5:0/1022153713 learned_addr learned my addr 172.21.15.5:0/1022153713 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d05348700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d05b49700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cc320 0x7f5d001e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d0634a700 1 -- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 msgr2=0x7f5d000b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d0634a700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d0634a700 1 -- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cc320 msgr2=0x7f5d001e59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d0634a700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cc320 0x7f5d001e59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d0634a700 1 -- 172.21.15.5:0/1022153713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009550 con 0x7f5d000cf430 2023-10-16T13:48:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d05b49700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cc320 0x7f5d001e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d0634a700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000b1d30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800cb40 tx=0x7f5cf800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8003c00 con 0x7f5d000cf430 2023-10-16T13:48:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8003d60 con 0x7f5d000cf430 2023-10-16T13:48:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800aae0 con 0x7f5d000cf430 2023-10-16T13:48:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d001580e0 con 0x7f5d000cf430 2023-10-16T13:48:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.895+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d001e5ee0 con 0x7f5d000cf430 2023-10-16T13:48:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.896+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d00158600 con 0x7f5d000cf430 2023-10-16T13:48:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.897+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f5cf800ac40 con 0x7f5d000cf430 2023-10-16T13:48:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.897+0000 7f5cf67fc700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406b260 0x7f5ce406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.897+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cf8089c10 con 0x7f5d000cf430 2023-10-16T13:48:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.898+0000 7f5d05b49700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406b260 0x7f5ce406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.898+0000 7f5d05b49700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406b260 0x7f5ce406d720 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009c10 tx=0x7f5cfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:28.902+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d00158600 con 0x7f5d000cf430 2023-10-16T13:48:29.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:48:29.048 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:48:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.150+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d00158600 con 0x7f5d000cf430 2023-10-16T13:48:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.321+0000 7f5cf67fc700 1 -- 172.21.15.5:0/1022153713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5d00158600 con 0x7f5d000cf430 2023-10-16T13:48:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406b260 msgr2=0x7f5ce406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406b260 0x7f5ce406d720 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009c10 tx=0x7f5cfc008040 comp rx=0 tx=0).stop 2023-10-16T13:48:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 msgr2=0x7f5d000b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000b1d30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800cb40 tx=0x7f5cf800ce50 comp rx=0 tx=0).stop 2023-10-16T13:48:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 shutdown_connections 2023-10-16T13:48:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d000cf430 0x7f5d000b1d30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d000cc320 0x7f5d001e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5ce406b260 0x7f5ce406d720 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 --2- 172.21.15.5:0/1022153713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d000cdf40 0x7f5d000b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 >> 172.21.15.5:0/1022153713 conn(0x7f5d000d1530 msgr2=0x7f5d0015a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 shutdown_connections 2023-10-16T13:48:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.323+0000 7f5d07dad700 1 -- 172.21.15.5:0/1022153713 wait complete. 2023-10-16T13:48:29.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:48:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.463+0000 7f1e9eab0700 1 Processor -- start 2023-10-16T13:48:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.463+0000 7f1e9eab0700 1 -- start start 2023-10-16T13:48:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9eab0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e980cf1a0 0x7f1e980cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9eab0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980ce100 con 0x7f1e980cdb40 2023-10-16T13:48:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9eab0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980ce3e0 con 0x7f1e9815ac90 2023-10-16T13:48:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9eab0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980ce6c0 con 0x7f1e980cf1a0 2023-10-16T13:48:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e97fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e980cdb40 0x7f1e980b2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58862/0 (socket says 172.21.15.5:58862) 2023-10-16T13:48:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e97fff700 1 -- 172.21.15.5:0/1130807109 learned_addr learned my addr 172.21.15.5:0/1130807109 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9d04d700 1 --2- 172.21.15.5:0/1130807109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e980cf1a0 0x7f1e980cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259451388 0 0) 0x7f1e980ce100 con 0x7f1e980cdb40 2023-10-16T13:48:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e880035b0 con 0x7f1e980cdb40 2023-10-16T13:48:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534318201 0 0) 0x7f1e980ce3e0 con 0x7f1e9815ac90 2023-10-16T13:48:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e980ce100 con 0x7f1e9815ac90 2023-10-16T13:48:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9d04d700 1 -- 172.21.15.5:0/1130807109 >> v1:172.21.15.112:6789/0 conn(0x7f1e9815ac90 legacy=0x7f1e9806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9d04d700 1 -- 172.21.15.5:0/1130807109 >> v1:172.21.15.5:6789/0 conn(0x7f1e980cdb40 legacy=0x7f1e980b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.464+0000 7f1e9d04d700 1 -- 172.21.15.5:0/1130807109 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980ce9a0 con 0x7f1e980cf1a0 2023-10-16T13:48:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9d04d700 1 --2- 172.21.15.5:0/1130807109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e980cf1a0 0x7f1e980cf630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009dc0 tx=0x7f1e9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d82a469a21118b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000e070 con 0x7f1e980cf1a0 2023-10-16T13:48:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9000bb20 con 0x7f1e980cf1a0 2023-10-16T13:48:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e977fe700 1 -- 172.21.15.5:0/1130807109 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90012430 con 0x7f1e980cf1a0 2023-10-16T13:48:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 -- 172.21.15.5:0/1130807109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e980cf1a0 msgr2=0x7f1e980cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/1130807109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e980cf1a0 0x7f1e980cf630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009dc0 tx=0x7f1e9000b330 comp rx=0 tx=0).stop 2023-10-16T13:48:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 -- 172.21.15.5:0/1130807109 shutdown_connections 2023-10-16T13:48:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/1130807109 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e980cf1a0 0x7f1e980cf630 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 -- 172.21.15.5:0/1130807109 >> 172.21.15.5:0/1130807109 conn(0x7f1e980cfc40 msgr2=0x7f1e980d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 -- 172.21.15.5:0/1130807109 shutdown_connections 2023-10-16T13:48:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.465+0000 7f1e9eab0700 1 -- 172.21.15.5:0/1130807109 wait complete. 2023-10-16T13:48:29.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.467+0000 7f1e9eab0700 1 Processor -- start 2023-10-16T13:48:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.467+0000 7f1e9eab0700 1 -- start start 2023-10-16T13:48:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 0x7f1e98153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e980cf1a0 0x7f1e9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e9815ac90 0x7f1e9806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980ae590 con 0x7f1e980cdb40 2023-10-16T13:48:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e981538c0 con 0x7f1e980cf1a0 2023-10-16T13:48:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980ad910 con 0x7f1e9815ac90 2023-10-16T13:48:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 0x7f1e98153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 0x7f1e98153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48862/0 (socket says 172.21.15.5:48862) 2023-10-16T13:48:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 -- 172.21.15.5:0/3060525876 learned_addr learned my addr 172.21.15.5:0/3060525876 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9d04d700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e9815ac90 0x7f1e9806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e97fff700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e980cf1a0 0x7f1e9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 -- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e9815ac90 msgr2=0x7f1e9806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e9815ac90 0x7f1e9806d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 -- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e980cf1a0 msgr2=0x7f1e9806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e980cf1a0 0x7f1e9806d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 -- 172.21.15.5:0/3060525876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009a70 con 0x7f1e980cdb40 2023-10-16T13:48:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e97fff700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e980cf1a0 0x7f1e9806d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9d04d700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e9815ac90 0x7f1e9806d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9c84c700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 0x7f1e98153380 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c500 tx=0x7f1e8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0052d0 con 0x7f1e980cdb40 2023-10-16T13:48:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c005450 con 0x7f1e980cdb40 2023-10-16T13:48:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.468+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e980adbf0 con 0x7f1e980cdb40 2023-10-16T13:48:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.469+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0038c0 con 0x7f1e980cdb40 2023-10-16T13:48:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.469+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e980ae1b0 con 0x7f1e980cdb40 2023-10-16T13:48:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.469+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e98067d20 con 0x7f1e980cdb40 2023-10-16T13:48:29.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.470+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f1e8c003a20 con 0x7f1e980cdb40 2023-10-16T13:48:29.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.470+0000 7f1e957fa700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1e7c06b260 0x7f1e7c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.470+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e8c088f70 con 0x7f1e980cdb40 2023-10-16T13:48:29.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.470+0000 7f1e97fff700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1e7c06b260 0x7f1e7c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.471+0000 7f1e97fff700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1e7c06b260 0x7f1e7c06d720 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1e980b0b20 tx=0x7f1e84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.475+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e8c053ca0 con 0x7f1e980cdb40 2023-10-16T13:48:29.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.704+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e980cec80 con 0x7f1e7c06b260 2023-10-16T13:48:29.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.706+0000 7f1e957fa700 1 -- 172.21.15.5:0/3060525876 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1e840014f0 con 0x7f1e7c06b260 2023-10-16T13:48:29.710 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:48:29.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:48:29.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:29.711 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:48:29.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1e7c06b260 msgr2=0x7f1e7c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1e7c06b260 0x7f1e7c06d720 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1e980b0b20 tx=0x7f1e84009040 comp rx=0 tx=0).stop 2023-10-16T13:48:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 msgr2=0x7f1e98153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 0x7f1e98153380 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c500 tx=0x7f1e8c00c8c0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 shutdown_connections 2023-10-16T13:48:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1e7c06b260 0x7f1e7c06d720 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e9815ac90 0x7f1e9806d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980cdb40 0x7f1e98153380 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 --2- 172.21.15.5:0/3060525876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e980cf1a0 0x7f1e9806d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 >> 172.21.15.5:0/3060525876 conn(0x7f1e980cfc40 msgr2=0x7f1e980cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 shutdown_connections 2023-10-16T13:48:29.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.708+0000 7f1e9eab0700 1 -- 172.21.15.5:0/3060525876 wait complete. 2023-10-16T13:48:29.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:48:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.848+0000 7f99db0d1700 1 Processor -- start 2023-10-16T13:48:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.848+0000 7f99db0d1700 1 -- start start 2023-10-16T13:48:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.849+0000 7f99db0d1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d4159f10 0x7f99d40cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.849+0000 7f99db0d1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99d40cbcb0 0x7f99d40cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.849+0000 7f99db0d1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40cc630 con 0x7f99d40cd1c0 2023-10-16T13:48:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.849+0000 7f99db0d1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40cff60 con 0x7f99d40cbcb0 2023-10-16T13:48:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.849+0000 7f99db0d1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40ca440 con 0x7f99d4159f10 2023-10-16T13:48:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.849+0000 7f99d966e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99d40cbcb0 0x7f99d40cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d8e6d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f99d40cd1c0 0x7f99d40cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:49850/0 (socket says 172.21.15.5:49850) 2023-10-16T13:48:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d4159f10 0x7f99d40cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d8e6d700 1 -- 172.21.15.5:0/2117858131 learned_addr learned my addr 172.21.15.5:0/2117858131 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d37fe700 1 -- 172.21.15.5:0/2117858131 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406413851 0 0) 0x7f99d40cc630 con 0x7f99d40cd1c0 2023-10-16T13:48:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d3fff700 1 -- 172.21.15.5:0/2117858131 >> v2:172.21.15.112:3300/0 conn(0x7f99d40cbcb0 msgr2=0x7f99d40cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d3fff700 1 --2- 172.21.15.5:0/2117858131 >> v2:172.21.15.112:3300/0 conn(0x7f99d40cbcb0 0x7f99d40cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d3fff700 1 -- 172.21.15.5:0/2117858131 >> v1:172.21.15.112:6789/0 conn(0x7f99d40cd1c0 legacy=0x7f99d40cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d3fff700 1 -- 172.21.15.5:0/2117858131 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d415a3c0 con 0x7f99d4159f10 2023-10-16T13:48:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d966e700 1 --2- 172.21.15.5:0/2117858131 >> v2:172.21.15.112:3300/0 conn(0x7f99d40cbcb0 0x7f99d40cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d3fff700 1 --2- 172.21.15.5:0/2117858131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d4159f10 0x7f99d40cea10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009840 tx=0x7f99c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf42ef2e89f4cf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d37fe700 1 -- 172.21.15.5:0/2117858131 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011830 con 0x7f99d4159f10 2023-10-16T13:48:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d37fe700 1 -- 172.21.15.5:0/2117858131 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0011990 con 0x7f99d4159f10 2023-10-16T13:48:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.850+0000 7f99d37fe700 1 -- 172.21.15.5:0/2117858131 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011d20 con 0x7f99d4159f10 2023-10-16T13:48:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 -- 172.21.15.5:0/2117858131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d4159f10 msgr2=0x7f99d40cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2117858131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d4159f10 0x7f99d40cea10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009840 tx=0x7f99c0009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 -- 172.21.15.5:0/2117858131 shutdown_connections 2023-10-16T13:48:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2117858131 >> v2:172.21.15.112:3300/0 conn(0x7f99d40cbcb0 0x7f99d40cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2117858131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d4159f10 0x7f99d40cea10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 -- 172.21.15.5:0/2117858131 >> 172.21.15.5:0/2117858131 conn(0x7f99d406ac60 msgr2=0x7f99d406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 -- 172.21.15.5:0/2117858131 shutdown_connections 2023-10-16T13:48:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.851+0000 7f99db0d1700 1 -- 172.21.15.5:0/2117858131 wait complete. 2023-10-16T13:48:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.852+0000 7f99db0d1700 1 Processor -- start 2023-10-16T13:48:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.852+0000 7f99db0d1700 1 -- start start 2023-10-16T13:48:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99db0d1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d40cbcb0 0x7f99d4158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99db0d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 0x7f99d41e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99db0d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4159f10 0x7f99d409c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99db0d1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d409a080 con 0x7f99d40cd1c0 2023-10-16T13:48:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99db0d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d409a2d0 con 0x7f99d4159f10 2023-10-16T13:48:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99db0d1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d409a5b0 con 0x7f99d40cbcb0 2023-10-16T13:48:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 0x7f99d41e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 0x7f99d41e0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48876/0 (socket says 172.21.15.5:48876) 2023-10-16T13:48:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99d3fff700 1 -- 172.21.15.5:0/2369847122 learned_addr learned my addr 172.21.15.5:0/2369847122 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99d966e700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4159f10 0x7f99d409c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.853+0000 7f99d8e6d700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d40cbcb0 0x7f99d4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d3fff700 1 -- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d40cbcb0 msgr2=0x7f99d4158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d3fff700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d40cbcb0 0x7f99d4158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d3fff700 1 -- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4159f10 msgr2=0x7f99d409c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d3fff700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4159f10 0x7f99d409c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d3fff700 1 -- 172.21.15.5:0/2369847122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009a70 con 0x7f99d40cd1c0 2023-10-16T13:48:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d3fff700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 0x7f99d41e0ad0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009fd0 tx=0x7f99c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00038a0 con 0x7f99d40cd1c0 2023-10-16T13:48:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c001f070 con 0x7f99d40cd1c0 2023-10-16T13:48:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c00094a0 con 0x7f99d40cd1c0 2023-10-16T13:48:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0003c40 con 0x7f99d40cd1c0 2023-10-16T13:48:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.854+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d409ab70 con 0x7f99d40cd1c0 2023-10-16T13:48:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.855+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d404ebb0 con 0x7f99d40cd1c0 2023-10-16T13:48:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.855+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f99c0026480 con 0x7f99d40cd1c0 2023-10-16T13:48:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.856+0000 7f99d17fa700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99b806b260 0x7f99b806d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.856+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99c0021070 con 0x7f99d40cd1c0 2023-10-16T13:48:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.856+0000 7f99d8e6d700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99b806b260 0x7f99b806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.856+0000 7f99d8e6d700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99b806b260 0x7f99b806d720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000f60 tx=0x7f99c8007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:29.860+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99c00560c0 con 0x7f99d40cd1c0 2023-10-16T13:48:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.063+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f99d40715b0 con 0x7f99d40cd1c0 2023-10-16T13:48:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.063+0000 7f99d17fa700 1 -- 172.21.15.5:0/2369847122 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f99c00596e0 con 0x7f99d40cd1c0 2023-10-16T13:48:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99b806b260 msgr2=0x7f99b806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99b806b260 0x7f99b806d720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000f60 tx=0x7f99c8007c00 comp rx=0 tx=0).stop 2023-10-16T13:48:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 msgr2=0x7f99d41e0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 0x7f99d41e0ad0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009fd0 tx=0x7f99c0004750 comp rx=0 tx=0).stop 2023-10-16T13:48:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 shutdown_connections 2023-10-16T13:48:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4159f10 0x7f99d409c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f99b806b260 0x7f99b806d720 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99d40cbcb0 0x7f99d4158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 --2- 172.21.15.5:0/2369847122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d40cd1c0 0x7f99d41e0ad0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 >> 172.21.15.5:0/2369847122 conn(0x7f99d406ac60 msgr2=0x7f99d4070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:30.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 shutdown_connections 2023-10-16T13:48:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.065+0000 7f99db0d1700 1 -- 172.21.15.5:0/2369847122 wait complete. 2023-10-16T13:48:30.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-16T13:48:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.204+0000 7f8a502c5700 1 Processor -- start 2023-10-16T13:48:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.204+0000 7f8a502c5700 1 -- start start 2023-10-16T13:48:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a502c5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8a480cd950 0x7f8a4815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a502c5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cede0 0x7f8a4815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a502c5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480cf260 con 0x7f8a4806a840 2023-10-16T13:48:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a502c5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a481619a0 con 0x7f8a480cd950 2023-10-16T13:48:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a502c5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b2d60 con 0x7f8a480cede0 2023-10-16T13:48:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a4e862700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a4806a840 0x7f8a48161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58892/0 (socket says 172.21.15.5:58892) 2023-10-16T13:48:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.205+0000 7f8a4e862700 1 -- 172.21.15.5:0/1094432596 learned_addr learned my addr 172.21.15.5:0/1094432596 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4e061700 1 --2- 172.21.15.5:0/1094432596 >> v2:172.21.15.112:3300/0 conn(0x7f8a480cd950 0x7f8a4815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d860700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cede0 0x7f8a4815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d05f700 1 -- 172.21.15.5:0/1094432596 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471853809 0 0) 0x7f8a480cf260 con 0x7f8a4806a840 2023-10-16T13:48:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d05f700 1 -- 172.21.15.5:0/1094432596 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a340035b0 con 0x7f8a4806a840 2023-10-16T13:48:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4e061700 1 -- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cede0 msgr2=0x7f8a4815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4e061700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cede0 0x7f8a4815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4e061700 1 -- 172.21.15.5:0/1094432596 >> v1:172.21.15.5:6789/0 conn(0x7f8a4806a840 legacy=0x7f8a48161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4e061700 1 -- 172.21.15.5:0/1094432596 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480cdd30 con 0x7f8a480cd950 2023-10-16T13:48:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d860700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cede0 0x7f8a4815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4e061700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cd950 0x7f8a4815e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009840 tx=0x7f8a38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63057844ec217f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d05f700 1 -- 172.21.15.5:0/1094432596 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38011830 con 0x7f8a480cd950 2023-10-16T13:48:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d05f700 1 -- 172.21.15.5:0/1094432596 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38011990 con 0x7f8a480cd950 2023-10-16T13:48:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.206+0000 7f8a4d05f700 1 -- 172.21.15.5:0/1094432596 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38011d20 con 0x7f8a480cd950 2023-10-16T13:48:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 -- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cd950 msgr2=0x7f8a4815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cd950 0x7f8a4815e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009840 tx=0x7f8a38009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 -- 172.21.15.5:0/1094432596 shutdown_connections 2023-10-16T13:48:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cd950 0x7f8a4815e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 --2- 172.21.15.5:0/1094432596 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cede0 0x7f8a4815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 -- 172.21.15.5:0/1094432596 >> 172.21.15.5:0/1094432596 conn(0x7f8a4806dae0 msgr2=0x7f8a4806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 -- 172.21.15.5:0/1094432596 shutdown_connections 2023-10-16T13:48:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.207+0000 7f8a502c5700 1 -- 172.21.15.5:0/1094432596 wait complete. 2023-10-16T13:48:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.208+0000 7f8a502c5700 1 Processor -- start 2023-10-16T13:48:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.208+0000 7f8a502c5700 1 -- start start 2023-10-16T13:48:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a502c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 0x7f8a481e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a502c5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cd950 0x7f8a4815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a502c5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cede0 0x7f8a4815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a502c5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48154510 con 0x7f8a4806a840 2023-10-16T13:48:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a502c5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4815c500 con 0x7f8a480cede0 2023-10-16T13:48:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a502c5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481e7c00 con 0x7f8a480cd950 2023-10-16T13:48:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 0x7f8a481e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 0x7f8a481e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48890/0 (socket says 172.21.15.5:48890) 2023-10-16T13:48:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 -- 172.21.15.5:0/117060779 learned_addr learned my addr 172.21.15.5:0/117060779 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 -- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cd950 msgr2=0x7f8a4815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cd950 0x7f8a4815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 -- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cede0 msgr2=0x7f8a4815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cede0 0x7f8a4815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.209+0000 7f8a4e061700 1 -- 172.21.15.5:0/117060779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44009430 con 0x7f8a4806a840 2023-10-16T13:48:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.210+0000 7f8a4e061700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 0x7f8a481e8090 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.210+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380036a0 con 0x7f8a4806a840 2023-10-16T13:48:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.210+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3801f070 con 0x7f8a4806a840 2023-10-16T13:48:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.210+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a380094a0 con 0x7f8a4806a840 2023-10-16T13:48:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.210+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003a60 con 0x7f8a4806a840 2023-10-16T13:48:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.210+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a481e75b0 con 0x7f8a4806a840 2023-10-16T13:48:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.211+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a48067d20 con 0x7f8a4806a840 2023-10-16T13:48:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.211+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f8a38003bc0 con 0x7f8a4806a840 2023-10-16T13:48:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.212+0000 7f8a3effd700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8a2c06b260 0x7f8a2c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.212+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a38021070 con 0x7f8a4806a840 2023-10-16T13:48:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.212+0000 7f8a4d860700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8a2c06b260 0x7f8a2c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.213+0000 7f8a4d860700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8a2c06b260 0x7f8a2c06d720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8a44006eb0 tx=0x7f8a44006e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.217+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a380560b0 con 0x7f8a4806a840 2023-10-16T13:48:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.446+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4815ec00 con 0x7f8a2c06b260 2023-10-16T13:48:30.456 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:48:30.453+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:30.456 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:48:30.453+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:30.456 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:48:30.453+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:30.456 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:48:30.453+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:30.456 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:48:30.453+0000 7fdd0965a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-16T13:48:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.459+0000 7f8a3effd700 1 -- 172.21.15.5:0/117060779 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+471 (secure 0 0 0) 0x7f8a44009850 con 0x7f8a2c06b260 2023-10-16T13:48:30.463 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:48:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_addrs": [ 2023-10-16T13:48:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.5:6789", 2023-10-16T13:48:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6789", 2023-10-16T13:48:30.463 INFO:teuthology.orchestra.run.smithi005.stdout: "172.21.15.112:6790" 2023-10-16T13:48:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:48:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": { 2023-10-16T13:48:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: "data": [ 2023-10-16T13:48:30.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": 367084666880, 2023-10-16T13:48:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_data", 2023-10-16T13:48:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "used": 0 2023-10-16T13:48:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-16T13:48:30.465 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": [ 2023-10-16T13:48:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "avail": 367084666880, 2023-10-16T13:48:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs_metadata", 2023-10-16T13:48:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: "used": 65536 2023-10-16T13:48:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:48:30.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:30.467 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:48:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8a2c06b260 msgr2=0x7f8a2c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8a2c06b260 0x7f8a2c06d720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8a44006eb0 tx=0x7f8a44006e00 comp rx=0 tx=0).stop 2023-10-16T13:48:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 msgr2=0x7f8a481e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 0x7f8a481e8090 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38004750 comp rx=0 tx=0).stop 2023-10-16T13:48:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 shutdown_connections 2023-10-16T13:48:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a480cede0 0x7f8a4815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a4806a840 0x7f8a481e8090 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8a2c06b260 0x7f8a2c06d720 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 --2- 172.21.15.5:0/117060779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8a480cd950 0x7f8a4815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 >> 172.21.15.5:0/117060779 conn(0x7f8a4806dae0 msgr2=0x7f8a48156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:30.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 shutdown_connections 2023-10-16T13:48:30.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.461+0000 7f8a502c5700 1 -- 172.21.15.5:0/117060779 wait complete. 2023-10-16T13:48:30.476 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:48:30.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:30.522 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:30.566 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:48:30.567 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:30.567 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:30.585 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:30.585 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:30.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.803+0000 7fa91038a700 1 Processor -- start 2023-10-16T13:48:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.803+0000 7fa91038a700 1 -- start start 2023-10-16T13:48:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa91038a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa90815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa91038a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9080b1f50 0x7fa9080cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa91038a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9080b23d0 0x7fa9080cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa91038a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90815e7a0 con 0x7fa9080b1f50 2023-10-16T13:48:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa91038a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90815f730 con 0x7fa9080b23d0 2023-10-16T13:48:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa91038a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080b29a0 con 0x7fa90815ab10 2023-10-16T13:48:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9080b1f50 0x7fa9080cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9080b1f50 0x7fa9080cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48900/0 (socket says 172.21.15.5:48900) 2023-10-16T13:48:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 -- 172.21.15.5:0/3228255367 learned_addr learned my addr 172.21.15.5:0/3228255367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90e126700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa90815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90e927700 1 --2- 172.21.15.5:0/3228255367 >> v2:172.21.15.112:3300/0 conn(0x7fa9080b23d0 0x7fa9080cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 -- 172.21.15.5:0/3228255367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 msgr2=0x7fa90815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa90815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 -- 172.21.15.5:0/3228255367 >> v2:172.21.15.112:3300/0 conn(0x7fa9080b23d0 msgr2=0x7fa9080cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 --2- 172.21.15.5:0/3228255367 >> v2:172.21.15.112:3300/0 conn(0x7fa9080b23d0 0x7fa9080cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 -- 172.21.15.5:0/3228255367 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080b2c80 con 0x7fa9080b1f50 2023-10-16T13:48:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90e126700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa90815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90e927700 1 --2- 172.21.15.5:0/3228255367 >> v2:172.21.15.112:3300/0 conn(0x7fa9080b23d0 0x7fa9080cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d925700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa9080cf720 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa908072ef0 tx=0x7fa8f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a55a73f315895fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.804+0000 7fa90d124700 1 -- 172.21.15.5:0/3228255367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8005e30 con 0x7fa9080b1f50 2023-10-16T13:48:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa90d124700 1 -- 172.21.15.5:0/3228255367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8004030 con 0x7fa9080b1f50 2023-10-16T13:48:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa90d124700 1 -- 172.21.15.5:0/3228255367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80043e0 con 0x7fa9080b1f50 2023-10-16T13:48:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 -- 172.21.15.5:0/3228255367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 msgr2=0x7fa9080cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa9080cf720 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa908072ef0 tx=0x7fa8f8009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 -- 172.21.15.5:0/3228255367 shutdown_connections 2023-10-16T13:48:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 --2- 172.21.15.5:0/3228255367 >> v2:172.21.15.112:3300/0 conn(0x7fa9080b23d0 0x7fa9080cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa90815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 --2- 172.21.15.5:0/3228255367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa9080cf720 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 -- 172.21.15.5:0/3228255367 >> 172.21.15.5:0/3228255367 conn(0x7fa90806dae0 msgr2=0x7fa90806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 -- 172.21.15.5:0/3228255367 shutdown_connections 2023-10-16T13:48:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.805+0000 7fa91038a700 1 -- 172.21.15.5:0/3228255367 wait complete. 2023-10-16T13:48:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.806+0000 7fa91038a700 1 Processor -- start 2023-10-16T13:48:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.806+0000 7fa91038a700 1 -- start start 2023-10-16T13:48:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa91038a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa90815c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa91038a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9080b23d0 0x7fa90815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa91038a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa908156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa91038a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90815d440 con 0x7fa9080b1f50 2023-10-16T13:48:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa91038a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ca240 con 0x7fa9080b23d0 2023-10-16T13:48:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa91038a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080c8de0 con 0x7fa90815ab10 2023-10-16T13:48:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa90e126700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa90815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa90e126700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa90815c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48904/0 (socket says 172.21.15.5:48904) 2023-10-16T13:48:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.807+0000 7fa90e126700 1 -- 172.21.15.5:0/3002658226 learned_addr learned my addr 172.21.15.5:0/3002658226 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90d925700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9080b23d0 0x7fa90815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e927700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa908156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e126700 1 -- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 msgr2=0x7fa908156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e126700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa908156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e126700 1 -- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9080b23d0 msgr2=0x7fa90815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e126700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9080b23d0 0x7fa90815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e126700 1 -- 172.21.15.5:0/3002658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009500 con 0x7fa9080b1f50 2023-10-16T13:48:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa90e126700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa90815c930 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e810 tx=0x7fa90400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904004230 con 0x7fa9080b1f50 2023-10-16T13:48:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904004390 con 0x7fa9080b1f50 2023-10-16T13:48:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040036a0 con 0x7fa9080b1f50 2023-10-16T13:48:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa908156f80 con 0x7fa9080b1f50 2023-10-16T13:48:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.808+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9080ca4c0 con 0x7fa9080b1f50 2023-10-16T13:48:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.809+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa908158f60 con 0x7fa9080b1f50 2023-10-16T13:48:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.810+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7fa904003800 con 0x7fa9080b1f50 2023-10-16T13:48:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.810+0000 7fa8feffd700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa8ec06b260 0x7fa8ec06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.810+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa904089680 con 0x7fa9080b1f50 2023-10-16T13:48:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.810+0000 7fa90d925700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa8ec06b260 0x7fa8ec06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.811+0000 7fa90d925700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa8ec06b260 0x7fa8ec06d720 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa908072ef0 tx=0x7fa8f8008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:30.815+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa904054210 con 0x7fa9080b1f50 2023-10-16T13:48:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.016+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa908158d90 con 0x7fa9080b1f50 2023-10-16T13:48:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.017+0000 7fa8feffd700 1 -- 172.21.15.5:0/3002658226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16444 (secure 0 0 0) 0x7fa9040094c0 con 0x7fa9080b1f50 2023-10-16T13:48:31.021 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:31.022 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:21.283240+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa8ec06b260 msgr2=0x7fa8ec06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa8ec06b260 0x7fa8ec06d720 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa908072ef0 tx=0x7fa8f8008070 comp rx=0 tx=0).stop 2023-10-16T13:48:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 msgr2=0x7fa90815c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa90815c930 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e810 tx=0x7fa90400ebd0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 shutdown_connections 2023-10-16T13:48:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa8ec06b260 0x7fa8ec06d720 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90815ab10 0x7fa908156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9080b1f50 0x7fa90815c930 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 --2- 172.21.15.5:0/3002658226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9080b23d0 0x7fa90815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 >> 172.21.15.5:0/3002658226 conn(0x7fa90806dae0 msgr2=0x7fa90806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 shutdown_connections 2023-10-16T13:48:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.019+0000 7fa91038a700 1 -- 172.21.15.5:0/3002658226 wait complete. 2023-10-16T13:48:31.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:48:18.181024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:48:18.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:31.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.159+0000 7f38c7657700 1 Processor -- start 2023-10-16T13:48:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c7657700 1 -- start start 2023-10-16T13:48:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c7657700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38c0160e30 0x7f38c00d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c7657700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38c00d08a0 0x7f38c00ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c7657700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00b6610 con 0x7f38c0161210 2023-10-16T13:48:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c7657700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c00d1da0 con 0x7f38c0160e30 2023-10-16T13:48:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c7657700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c00d2080 con 0x7f38c00d08a0 2023-10-16T13:48:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.160+0000 7f38c53f3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38c0160e30 0x7f38c00d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c4bf2700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38c0161210 0x7f38c00d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58916/0 (socket says 172.21.15.5:58916) 2023-10-16T13:48:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c4bf2700 1 -- 172.21.15.5:0/2107749021 learned_addr learned my addr 172.21.15.5:0/2107749021 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c5bf4700 1 --2- 172.21.15.5:0/2107749021 >> v2:172.21.15.112:3300/0 conn(0x7f38c00d08a0 0x7f38c00ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c53f3700 1 -- 172.21.15.5:0/2107749021 >> v2:172.21.15.112:3300/0 conn(0x7f38c00d08a0 msgr2=0x7f38c00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c53f3700 1 --2- 172.21.15.5:0/2107749021 >> v2:172.21.15.112:3300/0 conn(0x7f38c00d08a0 0x7f38c00ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c53f3700 1 -- 172.21.15.5:0/2107749021 >> v1:172.21.15.5:6789/0 conn(0x7f38c0161210 legacy=0x7f38c00d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c53f3700 1 -- 172.21.15.5:0/2107749021 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00d2360 con 0x7f38c0160e30 2023-10-16T13:48:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38b7fff700 1 -- 172.21.15.5:0/2107749021 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912355607 0 0) 0x7f38c00b6610 con 0x7f38c0161210 2023-10-16T13:48:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c5bf4700 1 --2- 172.21.15.5:0/2107749021 >> v2:172.21.15.112:3300/0 conn(0x7f38c00d08a0 0x7f38c00ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38c53f3700 1 --2- 172.21.15.5:0/2107749021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0160e30 0x7f38c00d4200 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f38c00b4630 tx=0x7f38b0009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2974c8d6beafbb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38b7fff700 1 -- 172.21.15.5:0/2107749021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0005e30 con 0x7f38c0160e30 2023-10-16T13:48:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38b7fff700 1 -- 172.21.15.5:0/2107749021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b0006030 con 0x7f38c0160e30 2023-10-16T13:48:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.161+0000 7f38b7fff700 1 -- 172.21.15.5:0/2107749021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00063c0 con 0x7f38c0160e30 2023-10-16T13:48:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 -- 172.21.15.5:0/2107749021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0160e30 msgr2=0x7f38c00d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 --2- 172.21.15.5:0/2107749021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0160e30 0x7f38c00d4200 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f38c00b4630 tx=0x7f38b0009b00 comp rx=0 tx=0).stop 2023-10-16T13:48:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 -- 172.21.15.5:0/2107749021 shutdown_connections 2023-10-16T13:48:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 --2- 172.21.15.5:0/2107749021 >> v2:172.21.15.112:3300/0 conn(0x7f38c00d08a0 0x7f38c00ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 --2- 172.21.15.5:0/2107749021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0160e30 0x7f38c00d4200 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 -- 172.21.15.5:0/2107749021 >> 172.21.15.5:0/2107749021 conn(0x7f38c009cb40 msgr2=0x7f38c00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 -- 172.21.15.5:0/2107749021 shutdown_connections 2023-10-16T13:48:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.162+0000 7f38c7657700 1 -- 172.21.15.5:0/2107749021 wait complete. 2023-10-16T13:48:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.163+0000 7f38c7657700 1 Processor -- start 2023-10-16T13:48:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.163+0000 7f38c7657700 1 -- start start 2023-10-16T13:48:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c7657700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c00d08a0 0x7f38c01597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c7657700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c0160e30 0x7f38c015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c7657700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 0x7f38c01f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c7657700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0159d10 con 0x7f38c0161210 2023-10-16T13:48:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c7657700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c015bf80 con 0x7f38c0160e30 2023-10-16T13:48:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c7657700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c015c260 con 0x7f38c00d08a0 2023-10-16T13:48:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 0x7f38c01f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 0x7f38c01f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48922/0 (socket says 172.21.15.5:48922) 2023-10-16T13:48:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 -- 172.21.15.5:0/3977472348 learned_addr learned my addr 172.21.15.5:0/3977472348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c4bf2700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c0160e30 0x7f38c015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c53f3700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c00d08a0 0x7f38c01597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 -- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c00d08a0 msgr2=0x7f38c01597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c00d08a0 0x7f38c01597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 -- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c0160e30 msgr2=0x7f38c015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c0160e30 0x7f38c015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 -- 172.21.15.5:0/3977472348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b0009430 con 0x7f38c0161210 2023-10-16T13:48:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c53f3700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c00d08a0 0x7f38c01597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.164+0000 7f38c5bf4700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 0x7f38c01f6960 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f38b800cd50 tx=0x7f38b800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.165+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800f480 con 0x7f38c0161210 2023-10-16T13:48:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.165+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800f600 con 0x7f38c0161210 2023-10-16T13:48:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.165+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c015c540 con 0x7f38c0161210 2023-10-16T13:48:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.165+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800f9b0 con 0x7f38c0161210 2023-10-16T13:48:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.165+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c015cb00 con 0x7f38c0161210 2023-10-16T13:48:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.166+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c015cd20 con 0x7f38c0161210 2023-10-16T13:48:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.166+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 89535+0+0 (secure 0 0 0) 0x7f38b800b040 con 0x7f38c0161210 2023-10-16T13:48:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.167+0000 7f38b5ffb700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f38a406b260 0x7f38a406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.167+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38b808a540 con 0x7f38c0161210 2023-10-16T13:48:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.167+0000 7f38c53f3700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f38a406b260 0x7f38a406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.167+0000 7f38c53f3700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f38a406b260 0x7f38a406d720 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f38b0013040 tx=0x7f38b0008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.172+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38b8054fd0 con 0x7f38c0161210 2023-10-16T13:48:31.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.333+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f38b80553a0 con 0x7f38c0161210 2023-10-16T13:48:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.373+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38c0067d20 con 0x7f38c0161210 2023-10-16T13:48:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.373+0000 7f38b5ffb700 1 -- 172.21.15.5:0/3977472348 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38b80746a0 con 0x7f38c0161210 2023-10-16T13:48:31.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.375+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f38a406b260 msgr2=0x7f38a406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.375+0000 7f38c7657700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f38a406b260 0x7f38a406d720 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f38b0013040 tx=0x7f38b0008070 comp rx=0 tx=0).stop 2023-10-16T13:48:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.375+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 msgr2=0x7f38c01f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.375+0000 7f38c7657700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 0x7f38c01f6960 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f38b800cd50 tx=0x7f38b800a560 comp rx=0 tx=0).stop 2023-10-16T13:48:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 shutdown_connections 2023-10-16T13:48:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c0161210 0x7f38c01f6960 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f38a406b260 0x7f38a406d720 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c00d08a0 0x7f38c01597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 --2- 172.21.15.5:0/3977472348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c0160e30 0x7f38c015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 >> 172.21.15.5:0/3977472348 conn(0x7f38c009cb40 msgr2=0x7f38c006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:31.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 shutdown_connections 2023-10-16T13:48:31.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.376+0000 7f38c7657700 1 -- 172.21.15.5:0/3977472348 wait complete. 2023-10-16T13:48:31.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:48:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.516+0000 7f32e50bc700 1 Processor -- start 2023-10-16T13:48:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.516+0000 7f32e50bc700 1 -- start start 2023-10-16T13:48:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32e50bc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 0x7f32e015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32e50bc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e00cf260 con 0x7f32e00cede0 2023-10-16T13:48:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32e50bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e00b2d60 con 0x7f32e006a840 2023-10-16T13:48:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32e50bc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01619a0 con 0x7f32e00cd950 2023-10-16T13:48:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32de59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f32e00cede0 0x7f32e015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58930/0 (socket says 172.21.15.5:58930) 2023-10-16T13:48:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32de59c700 1 -- 172.21.15.5:0/1471747602 learned_addr learned my addr 172.21.15.5:0/1471747602 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32ded9d700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 0x7f32e015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.517+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575706311 0 0) 0x7f32e00cf260 con 0x7f32e00cede0 2023-10-16T13:48:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c80035b0 con 0x7f32e00cede0 2023-10-16T13:48:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1940841299 0 0) 0x7f32c80035b0 con 0x7f32e00cede0 2023-10-16T13:48:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 msgr2=0x7f32e015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 0x7f32e015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 >> v1:172.21.15.112:6789/0 conn(0x7f32e006a840 legacy=0x7f32e0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00cdd30 con 0x7f32e00cede0 2023-10-16T13:48:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f32d00017f0 con 0x7f32e00cede0 2023-10-16T13:48:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 >> v1:172.21.15.5:6789/0 conn(0x7f32e00cede0 legacy=0x7f32e015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8003a30 0x7f32c8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8004850 0x7f32c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 0x7f32c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01619a0 con 0x7f32c8003a30 2023-10-16T13:48:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c800bac0 con 0x7f32c8004850 2023-10-16T13:48:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c800bc80 con 0x7f32e00cd950 2023-10-16T13:48:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ded9d700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8003a30 0x7f32c8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32de59c700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8004850 0x7f32c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32df59e700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 0x7f32c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ded9d700 1 -- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 msgr2=0x7f32c8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ded9d700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00cd950 0x7f32c8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ded9d700 1 -- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8004850 msgr2=0x7f32c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ded9d700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8004850 0x7f32c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.518+0000 7f32ded9d700 1 -- 172.21.15.5:0/1471747602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80035b0 con 0x7f32c8003a30 2023-10-16T13:48:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32ded9d700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8003a30 0x7f32c8003e50 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009b30 tx=0x7f32c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3c8077353c61c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400e6c0 con 0x7f32c8003a30 2023-10-16T13:48:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400e820 con 0x7f32c8003a30 2023-10-16T13:48:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32ddd9b700 1 -- 172.21.15.5:0/1471747602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400eb90 con 0x7f32c8003a30 2023-10-16T13:48:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32e50bc700 1 -- 172.21.15.5:0/1471747602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8003a30 msgr2=0x7f32c8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32e50bc700 1 --2- 172.21.15.5:0/1471747602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c8003a30 0x7f32c8003e50 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009b30 tx=0x7f32c8005880 comp rx=0 tx=0).stop 2023-10-16T13:48:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32df59e700 1 -- 172.21.15.5:0/1471747602 reap_dead start 2023-10-16T13:48:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32e50bc700 1 -- 172.21.15.5:0/1471747602 shutdown_connections 2023-10-16T13:48:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32e50bc700 1 -- 172.21.15.5:0/1471747602 >> 172.21.15.5:0/1471747602 conn(0x7f32e006dae0 msgr2=0x7f32e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32e50bc700 1 -- 172.21.15.5:0/1471747602 shutdown_connections 2023-10-16T13:48:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.519+0000 7f32e50bc700 1 -- 172.21.15.5:0/1471747602 wait complete. 2023-10-16T13:48:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.521+0000 7f32e50bc700 1 Processor -- start 2023-10-16T13:48:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.521+0000 7f32e50bc700 1 -- start start 2023-10-16T13:48:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32e50bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8003a30 0x7f32e00ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32e50bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 0x7f32e00b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32e50bc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00b4dd0 0x7f32e00aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32e50bc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0154270 con 0x7f32e00ac8b0 2023-10-16T13:48:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32e50bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00b6000 con 0x7f32c8003a30 2023-10-16T13:48:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32e50bc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00ca3a0 con 0x7f32e00b4dd0 2023-10-16T13:48:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 0x7f32e00b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 0x7f32e00b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48940/0 (socket says 172.21.15.5:48940) 2023-10-16T13:48:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 -- 172.21.15.5:0/3098656362 learned_addr learned my addr 172.21.15.5:0/3098656362 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32ded9d700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8003a30 0x7f32e00ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32df59e700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00b4dd0 0x7f32e00aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 -- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00b4dd0 msgr2=0x7f32e00aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00b4dd0 0x7f32e00aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 -- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8003a30 msgr2=0x7f32e00ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8003a30 0x7f32e00ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 -- 172.21.15.5:0/3098656362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00c7640 con 0x7f32e00ac8b0 2023-10-16T13:48:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32df59e700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00b4dd0 0x7f32e00aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32de59c700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 0x7f32e00b5ac0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f32d000f8f0 tx=0x7f32d000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.522+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00072e0 con 0x7f32e00ac8b0 2023-10-16T13:48:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.523+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0007440 con 0x7f32e00ac8b0 2023-10-16T13:48:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.523+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00b5320 con 0x7f32e00ac8b0 2023-10-16T13:48:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.523+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0005830 con 0x7f32e00ac8b0 2023-10-16T13:48:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.523+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e00c7b90 con 0x7f32e00ac8b0 2023-10-16T13:48:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.524+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0067d20 con 0x7f32e00ac8b0 2023-10-16T13:48:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.524+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f32d0005990 con 0x7f32e00ac8b0 2023-10-16T13:48:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.524+0000 7f32c77fe700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32cc06b2f0 0x7f32cc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.525+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32d0089c10 con 0x7f32e00ac8b0 2023-10-16T13:48:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.525+0000 7f32ded9d700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32cc06b2f0 0x7f32cc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.525+0000 7f32ded9d700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32cc06b2f0 0x7f32cc06d7b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f32d40090b0 tx=0x7f32d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.529+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32d00546e0 con 0x7f32e00ac8b0 2023-10-16T13:48:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.730+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32e00b2630 con 0x7f32e00ac8b0 2023-10-16T13:48:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.731+0000 7f32c77fe700 1 -- 172.21.15.5:0/3098656362 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32d0057d00 con 0x7f32e00ac8b0 2023-10-16T13:48:31.735 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:48:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.732+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32cc06b2f0 msgr2=0x7f32cc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.732+0000 7f32e50bc700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32cc06b2f0 0x7f32cc06d7b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f32d40090b0 tx=0x7f32d4008030 comp rx=0 tx=0).stop 2023-10-16T13:48:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 msgr2=0x7f32e00b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 0x7f32e00b5ac0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f32d000f8f0 tx=0x7f32d000fc00 comp rx=0 tx=0).stop 2023-10-16T13:48:31.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 shutdown_connections 2023-10-16T13:48:31.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f32cc06b2f0 0x7f32cc06d7b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32e00b4dd0 0x7f32e00aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c8003a30 0x7f32e00ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 --2- 172.21.15.5:0/3098656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32e00ac8b0 0x7f32e00b5ac0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 >> 172.21.15.5:0/3098656362 conn(0x7f32e006dae0 msgr2=0x7f32e015fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 shutdown_connections 2023-10-16T13:48:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.733+0000 7f32e50bc700 1 -- 172.21.15.5:0/3098656362 wait complete. 2023-10-16T13:48:31.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:48:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.873+0000 7f1a07dca700 1 Processor -- start 2023-10-16T13:48:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.873+0000 7f1a07dca700 1 -- start start 2023-10-16T13:48:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a07dca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f1a0015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a07dca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0015e7a0 con 0x7f1a000b1f50 2023-10-16T13:48:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a07dca700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0015f730 con 0x7f1a000cfe30 2023-10-16T13:48:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a07dca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b29a0 con 0x7f1a0015ab10 2023-10-16T13:48:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a05365700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1a000b1f50 0x7f1a000cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58950/0 (socket says 172.21.15.5:58950) 2023-10-16T13:48:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a05365700 1 -- 172.21.15.5:0/2605750234 learned_addr learned my addr 172.21.15.5:0/2605750234 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a05b66700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f1a0015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804587954 0 0) 0x7f1a0015e7a0 con 0x7f1a000b1f50 2023-10-16T13:48:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.874+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ec0035b0 con 0x7f1a000b1f50 2023-10-16T13:48:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974506965 0 0) 0x7f1a0015f730 con 0x7f1a000cfe30 2023-10-16T13:48:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a0015e7a0 con 0x7f1a000cfe30 2023-10-16T13:48:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219643105 0 0) 0x7f19ec0035b0 con 0x7f1a000b1f50 2023-10-16T13:48:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 msgr2=0x7f1a0015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f1a0015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 >> v1:172.21.15.112:6789/0 conn(0x7f1a000cfe30 legacy=0x7f1a000cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000b2c80 con 0x7f1a000b1f50 2023-10-16T13:48:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f19fc0017f0 con 0x7f1a000b1f50 2023-10-16T13:48:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05b66700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f1a0015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 >> v1:172.21.15.5:6789/0 conn(0x7f1a000b1f50 legacy=0x7f1a000cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f19ec003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec004100 0x7f19ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec004d90 0x7f19ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b29a0 con 0x7f19ec004100 2023-10-16T13:48:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec00bac0 con 0x7f19ec004d90 2023-10-16T13:48:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec00bc80 con 0x7f1a0015ab10 2023-10-16T13:48:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec004100 0x7f19ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05b66700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f19ec003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a06367700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec004d90 0x7f19ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 -- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 msgr2=0x7f19ec003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a0015ab10 0x7f19ec003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 -- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec004d90 msgr2=0x7f19ec005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec004d90 0x7f19ec005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 -- 172.21.15.5:0/2605750234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00094a0 con 0x7f19ec004100 2023-10-16T13:48:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.875+0000 7f1a05365700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec004100 0x7f19ec004850 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c240 tx=0x7f19ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9eb4f24278759f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00cd80 con 0x7f19ec004100 2023-10-16T13:48:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc001c70 con 0x7f19ec004100 2023-10-16T13:48:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a04b64700 1 -- 172.21.15.5:0/2605750234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc007310 con 0x7f19ec004100 2023-10-16T13:48:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a07dca700 1 -- 172.21.15.5:0/2605750234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec004100 msgr2=0x7f19ec004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a07dca700 1 --2- 172.21.15.5:0/2605750234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec004100 0x7f19ec004850 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c240 tx=0x7f19ec005880 comp rx=0 tx=0).stop 2023-10-16T13:48:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a06367700 1 -- 172.21.15.5:0/2605750234 reap_dead start 2023-10-16T13:48:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a07dca700 1 -- 172.21.15.5:0/2605750234 shutdown_connections 2023-10-16T13:48:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a07dca700 1 -- 172.21.15.5:0/2605750234 >> 172.21.15.5:0/2605750234 conn(0x7f1a0006dae0 msgr2=0x7f1a0006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a07dca700 1 -- 172.21.15.5:0/2605750234 shutdown_connections 2023-10-16T13:48:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.876+0000 7f1a07dca700 1 -- 172.21.15.5:0/2605750234 wait complete. 2023-10-16T13:48:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.877+0000 7f1a07dca700 1 Processor -- start 2023-10-16T13:48:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 -- start start 2023-10-16T13:48:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec004100 0x7f1a000c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a00156b20 0x7f1a001554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 0x7f1a000c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3e60 con 0x7f1a000c7c30 2023-10-16T13:48:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00155f50 con 0x7f1a00156b20 2023-10-16T13:48:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a07dca700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00155a00 con 0x7f19ec004100 2023-10-16T13:48:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a06367700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 0x7f1a000c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a06367700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 0x7f1a000c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48962/0 (socket says 172.21.15.5:48962) 2023-10-16T13:48:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.878+0000 7f1a06367700 1 -- 172.21.15.5:0/1310271217 learned_addr learned my addr 172.21.15.5:0/1310271217 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a05b66700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec004100 0x7f1a000c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a05365700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a00156b20 0x7f1a001554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a06367700 1 -- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec004100 msgr2=0x7f1a000c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a06367700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec004100 0x7f1a000c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a06367700 1 -- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a00156b20 msgr2=0x7f1a001554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a06367700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a00156b20 0x7f1a001554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a06367700 1 -- 172.21.15.5:0/1310271217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a001578f0 con 0x7f1a000c7c30 2023-10-16T13:48:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a05b66700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec004100 0x7f1a000c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a05365700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a00156b20 0x7f1a001554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a06367700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 0x7f1a000c6010 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1a000aff00 tx=0x7f19f800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8003c10 con 0x7f1a000c7c30 2023-10-16T13:48:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8003d70 con 0x7f1a000c7c30 2023-10-16T13:48:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a00157050 con 0x7f1a000c7c30 2023-10-16T13:48:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f800dbd0 con 0x7f1a000c7c30 2023-10-16T13:48:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.879+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a00157610 con 0x7f1a000c7c30 2023-10-16T13:48:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.880+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a00067d20 con 0x7f1a000c7c30 2023-10-16T13:48:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.880+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f19f800dd30 con 0x7f1a000c7c30 2023-10-16T13:48:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.881+0000 7f19f67fc700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f19e406b320 0x7f19e406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.881+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19f8089fb0 con 0x7f1a000c7c30 2023-10-16T13:48:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.881+0000 7f1a05b66700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f19e406b320 0x7f19e406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.882+0000 7f1a05b66700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f19e406b320 0x7f19e406d7e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009d10 tx=0x7f19f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:31.886+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19f8054b10 con 0x7f1a000c7c30 2023-10-16T13:48:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.086+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a000afc10 con 0x7f1a000c7c30 2023-10-16T13:48:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.087+0000 7f19f67fc700 1 -- 172.21.15.5:0/1310271217 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19f8058130 con 0x7f1a000c7c30 2023-10-16T13:48:32.091 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:48:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f19e406b320 msgr2=0x7f19e406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f19e406b320 0x7f19e406d7e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009d10 tx=0x7f19f0008040 comp rx=0 tx=0).stop 2023-10-16T13:48:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 msgr2=0x7f1a000c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 0x7f1a000c6010 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1a000aff00 tx=0x7f19f800d430 comp rx=0 tx=0).stop 2023-10-16T13:48:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 shutdown_connections 2023-10-16T13:48:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a000c7c30 0x7f1a000c6010 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f19e406b320 0x7f19e406d7e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec004100 0x7f1a000c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 --2- 172.21.15.5:0/1310271217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a00156b20 0x7f1a001554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 >> 172.21.15.5:0/1310271217 conn(0x7f1a0006dae0 msgr2=0x7f1a000b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 shutdown_connections 2023-10-16T13:48:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.089+0000 7f1a07dca700 1 -- 172.21.15.5:0/1310271217 wait complete. 2023-10-16T13:48:32.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:48:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.227+0000 7fab5b0e0700 1 Processor -- start 2023-10-16T13:48:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.227+0000 7fab5b0e0700 1 -- start start 2023-10-16T13:48:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab5b0e0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab5415a850 0x7fab540cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab5b0e0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab540b2940 0x7fab540ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab5b0e0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab540ce3b0 con 0x7fab540cd2e0 2023-10-16T13:48:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab5b0e0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540b2df0 con 0x7fab540b2940 2023-10-16T13:48:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab5b0e0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540b6290 con 0x7fab5415a850 2023-10-16T13:48:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab53fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab540b2940 0x7fab540ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab53fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab540b2940 0x7fab540ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48968/0 (socket says 172.21.15.5:48968) 2023-10-16T13:48:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.228+0000 7fab53fff700 1 -- 172.21.15.5:0/61502493 learned_addr learned my addr 172.21.15.5:0/61502493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab58e7c700 1 --2- 172.21.15.5:0/61502493 >> v2:172.21.15.112:3300/0 conn(0x7fab5415a850 0x7fab540cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab53fff700 1 -- 172.21.15.5:0/61502493 >> v2:172.21.15.112:3300/0 conn(0x7fab5415a850 msgr2=0x7fab540cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab53fff700 1 --2- 172.21.15.5:0/61502493 >> v2:172.21.15.112:3300/0 conn(0x7fab5415a850 0x7fab540cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab53fff700 1 -- 172.21.15.5:0/61502493 >> v1:172.21.15.112:6789/0 conn(0x7fab540cd2e0 legacy=0x7fab54071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab53fff700 1 -- 172.21.15.5:0/61502493 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540cc220 con 0x7fab540b2940 2023-10-16T13:48:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab58e7c700 1 --2- 172.21.15.5:0/61502493 >> v2:172.21.15.112:3300/0 conn(0x7fab5415a850 0x7fab540cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab53fff700 1 --2- 172.21.15.5:0/61502493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab540b2940 0x7fab540ccda0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fab5406f5b0 tx=0x7fab40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94daa7c46b107088 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab537fe700 1 -- 172.21.15.5:0/61502493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000b870 con 0x7fab540b2940 2023-10-16T13:48:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab537fe700 1 -- 172.21.15.5:0/61502493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000b9d0 con 0x7fab540b2940 2023-10-16T13:48:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.229+0000 7fab537fe700 1 -- 172.21.15.5:0/61502493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000bd60 con 0x7fab540b2940 2023-10-16T13:48:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 -- 172.21.15.5:0/61502493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab540b2940 msgr2=0x7fab540ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/61502493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab540b2940 0x7fab540ccda0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fab5406f5b0 tx=0x7fab40009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 -- 172.21.15.5:0/61502493 shutdown_connections 2023-10-16T13:48:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/61502493 >> v2:172.21.15.112:3300/0 conn(0x7fab5415a850 0x7fab540cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/61502493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab540b2940 0x7fab540ccda0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 -- 172.21.15.5:0/61502493 >> 172.21.15.5:0/61502493 conn(0x7fab5406dac0 msgr2=0x7fab5406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 -- 172.21.15.5:0/61502493 shutdown_connections 2023-10-16T13:48:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.230+0000 7fab5b0e0700 1 -- 172.21.15.5:0/61502493 wait complete. 2023-10-16T13:48:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.231+0000 7fab5b0e0700 1 Processor -- start 2023-10-16T13:48:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.231+0000 7fab5b0e0700 1 -- start start 2023-10-16T13:48:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5b0e0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab540b2940 0x7fab540c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5b0e0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab540cd2e0 0x7fab540c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5b0e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 0x7fab540b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5b0e0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540c9c30 con 0x7fab5415a850 2023-10-16T13:48:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5b0e0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b4290 con 0x7fab540cd2e0 2023-10-16T13:48:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5b0e0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b4570 con 0x7fab540b2940 2023-10-16T13:48:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 0x7fab540b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 0x7fab540b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48976/0 (socket says 172.21.15.5:48976) 2023-10-16T13:48:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 -- 172.21.15.5:0/989105781 learned_addr learned my addr 172.21.15.5:0/989105781 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab58e7c700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab540b2940 0x7fab540c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab53fff700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab540cd2e0 0x7fab540c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 -- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab540b2940 msgr2=0x7fab540c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab540b2940 0x7fab540c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 -- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab540cd2e0 msgr2=0x7fab540c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab540cd2e0 0x7fab540c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 -- 172.21.15.5:0/989105781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009550 con 0x7fab5415a850 2023-10-16T13:48:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.232+0000 7fab5967d700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 0x7fab540b5330 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00cb50 tx=0x7fab4c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.233+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c003c00 con 0x7fab5415a850 2023-10-16T13:48:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.233+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c003d60 con 0x7fab5415a850 2023-10-16T13:48:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.233+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab540b4850 con 0x7fab5415a850 2023-10-16T13:48:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.233+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00aa20 con 0x7fab5415a850 2023-10-16T13:48:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.233+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab540b4e10 con 0x7fab5415a850 2023-10-16T13:48:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.234+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab54067d20 con 0x7fab5415a850 2023-10-16T13:48:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.234+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fab4c00ab80 con 0x7fab5415a850 2023-10-16T13:48:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.234+0000 7fab517fa700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fab3806b2c0 0x7fab3806d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.235+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab4c089c60 con 0x7fab5415a850 2023-10-16T13:48:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.235+0000 7fab58e7c700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fab3806b2c0 0x7fab3806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.235+0000 7fab58e7c700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fab3806b2c0 0x7fab3806d780 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab48006f10 tx=0x7fab48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.240+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab4c0547c0 con 0x7fab5415a850 2023-10-16T13:48:32.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.457+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab540cc7b0 con 0x7fab5415a850 2023-10-16T13:48:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.457+0000 7fab517fa700 1 -- 172.21.15.5:0/989105781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab4c057de0 con 0x7fab5415a850 2023-10-16T13:48:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fab3806b2c0 msgr2=0x7fab3806d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fab3806b2c0 0x7fab3806d780 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab48006f10 tx=0x7fab48008040 comp rx=0 tx=0).stop 2023-10-16T13:48:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 msgr2=0x7fab540b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 0x7fab540b5330 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00cb50 tx=0x7fab4c00ce60 comp rx=0 tx=0).stop 2023-10-16T13:48:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 shutdown_connections 2023-10-16T13:48:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5415a850 0x7fab540b5330 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fab3806b2c0 0x7fab3806d780 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab540b2940 0x7fab540c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 --2- 172.21.15.5:0/989105781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab540cd2e0 0x7fab540c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 >> 172.21.15.5:0/989105781 conn(0x7fab5406dac0 msgr2=0x7fab54150400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 shutdown_connections 2023-10-16T13:48:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.460+0000 7fab5b0e0700 1 -- 172.21.15.5:0/989105781 wait complete. 2023-10-16T13:48:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:48:32.475 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:48:32.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:32.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:32.520 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:48:32.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:32.520 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:48:32.576 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:32.577 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:32.598 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:32.599 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:32.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:32.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 Processor -- start 2023-10-16T13:48:32.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 -- start start 2023-10-16T13:48:32.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc9a415ab10 0x7fc9a415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b1f50 0x7fc9a40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9a40b23d0 0x7fc9a40cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a415e7a0 con 0x7fc9a40b23d0 2023-10-16T13:48:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a415f730 con 0x7fc9a415ab10 2023-10-16T13:48:32.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.780+0000 7fc9a9b36700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40b29a0 con 0x7fc9a40b1f50 2023-10-16T13:48:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9a40b23d0 0x7fc9a40cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9a40b23d0 0x7fc9a40cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48984/0 (socket says 172.21.15.5:48984) 2023-10-16T13:48:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 -- 172.21.15.5:0/1506071270 learned_addr learned my addr 172.21.15.5:0/1506071270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a2ffd700 1 --2- 172.21.15.5:0/1506071270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b1f50 0x7fc9a40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a37fe700 1 --2- 172.21.15.5:0/1506071270 >> v2:172.21.15.112:3300/0 conn(0x7fc9a415ab10 0x7fc9a415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 -- 172.21.15.5:0/1506071270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b1f50 msgr2=0x7fc9a40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 --2- 172.21.15.5:0/1506071270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b1f50 0x7fc9a40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 -- 172.21.15.5:0/1506071270 >> v2:172.21.15.112:3300/0 conn(0x7fc9a415ab10 msgr2=0x7fc9a415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 --2- 172.21.15.5:0/1506071270 >> v2:172.21.15.112:3300/0 conn(0x7fc9a415ab10 0x7fc9a415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 -- 172.21.15.5:0/1506071270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40b2c80 con 0x7fc9a40b23d0 2023-10-16T13:48:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a3fff700 1 --2- 172.21.15.5:0/1506071270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b23d0 0x7fc9a40cfc60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40d0430 tx=0x7fc99c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa26bcb221c5b5d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a27fc700 1 -- 172.21.15.5:0/1506071270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00e070 con 0x7fc9a40b23d0 2023-10-16T13:48:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a27fc700 1 -- 172.21.15.5:0/1506071270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00b9c0 con 0x7fc9a40b23d0 2023-10-16T13:48:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.781+0000 7fc9a27fc700 1 -- 172.21.15.5:0/1506071270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00bd70 con 0x7fc9a40b23d0 2023-10-16T13:48:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1506071270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b23d0 msgr2=0x7fc9a40cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1506071270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b23d0 0x7fc9a40cfc60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40d0430 tx=0x7fc99c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1506071270 shutdown_connections 2023-10-16T13:48:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1506071270 >> v2:172.21.15.112:3300/0 conn(0x7fc9a415ab10 0x7fc9a415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1506071270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b23d0 0x7fc9a40cfc60 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1506071270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b1f50 0x7fc9a40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1506071270 >> 172.21.15.5:0/1506071270 conn(0x7fc9a406dae0 msgr2=0x7fc9a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1506071270 shutdown_connections 2023-10-16T13:48:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.782+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1506071270 wait complete. 2023-10-16T13:48:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.783+0000 7fc9a9b36700 1 Processor -- start 2023-10-16T13:48:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.783+0000 7fc9a9b36700 1 -- start start 2023-10-16T13:48:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a9b36700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 0x7fc9a4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a9b36700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b23d0 0x7fc9a4157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a9b36700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9a415ab10 0x7fc9a4157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a9b36700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a41571c0 con 0x7fc9a40b1f50 2023-10-16T13:48:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a9b36700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c9840 con 0x7fc9a415ab10 2023-10-16T13:48:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a9b36700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c9b20 con 0x7fc9a40b23d0 2023-10-16T13:48:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 0x7fc9a4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 0x7fc9a4156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48986/0 (socket says 172.21.15.5:48986) 2023-10-16T13:48:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 -- 172.21.15.5:0/1944276588 learned_addr learned my addr 172.21.15.5:0/1944276588 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a3fff700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9a415ab10 0x7fc9a4157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a2ffd700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b23d0 0x7fc9a4157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 -- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b23d0 msgr2=0x7fc9a4157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b23d0 0x7fc9a4157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 -- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9a415ab10 msgr2=0x7fc9a4157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9a415ab10 0x7fc9a4157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 -- 172.21.15.5:0/1944276588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009b30 con 0x7fc9a40b1f50 2023-10-16T13:48:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a2ffd700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b23d0 0x7fc9a4157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a3fff700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9a415ab10 0x7fc9a4157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.784+0000 7fc9a37fe700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 0x7fc9a4156c80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fc99400d800 tx=0x7fc99400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.785+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940125f0 con 0x7fc9a40b1f50 2023-10-16T13:48:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.785+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994012750 con 0x7fc9a40b1f50 2023-10-16T13:48:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.785+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a40c9e00 con 0x7fc9a40b1f50 2023-10-16T13:48:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.785+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994012b00 con 0x7fc9a40b1f50 2023-10-16T13:48:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.785+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a40ca3c0 con 0x7fc9a40b1f50 2023-10-16T13:48:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.786+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a4067d20 con 0x7fc9a40b1f50 2023-10-16T13:48:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.786+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fc994012c60 con 0x7fc9a40b1f50 2023-10-16T13:48:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.786+0000 7fc98bfff700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc99006b320 0x7fc99006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.787+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc994089ff0 con 0x7fc9a40b1f50 2023-10-16T13:48:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.787+0000 7fc9a2ffd700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc99006b320 0x7fc99006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.787+0000 7fc9a2ffd700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc99006b320 0x7fc99006d7e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc9a406ab90 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.791+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc994054b50 con 0x7fc9a40b1f50 2023-10-16T13:48:32.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.991+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a415f510 con 0x7fc9a40b1f50 2023-10-16T13:48:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.993+0000 7fc98bfff700 1 -- 172.21.15.5:0/1944276588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16444 (secure 0 0 0) 0x7fc994058170 con 0x7fc9a40b1f50 2023-10-16T13:48:32.996 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:32.996 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:21.283240+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc99006b320 msgr2=0x7fc99006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc99006b320 0x7fc99006d7e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc9a406ab90 tx=0x7fc998008040 comp rx=0 tx=0).stop 2023-10-16T13:48:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 msgr2=0x7fc9a4156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 0x7fc9a4156c80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fc99400d800 tx=0x7fc99400dbc0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 shutdown_connections 2023-10-16T13:48:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9a415ab10 0x7fc9a4157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a40b1f50 0x7fc9a4156c80 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc99006b320 0x7fc99006d7e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 --2- 172.21.15.5:0/1944276588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9a40b23d0 0x7fc9a4157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 >> 172.21.15.5:0/1944276588 conn(0x7fc9a406dae0 msgr2=0x7fc9a406ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:33.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 shutdown_connections 2023-10-16T13:48:33.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:32.995+0000 7fc9a9b36700 1 -- 172.21.15.5:0/1944276588 wait complete. 2023-10-16T13:48:33.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:48:18.181024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:48:18.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:33.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.136+0000 7f1d8e3a8700 1 Processor -- start 2023-10-16T13:48:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.136+0000 7f1d8e3a8700 1 -- start start 2023-10-16T13:48:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d8e3a8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d880cd950 0x7f1d8815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d8e3a8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d880cede0 0x7f1d8815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d8e3a8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880cf290 con 0x7f1d8806a840 2023-10-16T13:48:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d8e3a8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d881619a0 con 0x7f1d880cede0 2023-10-16T13:48:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d8e3a8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880b2d60 con 0x7f1d880cd950 2023-10-16T13:48:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d880cede0 0x7f1d8815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d880cede0 0x7f1d8815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48994/0 (socket says 172.21.15.5:48994) 2023-10-16T13:48:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 -- 172.21.15.5:0/1786839886 learned_addr learned my addr 172.21.15.5:0/1786839886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d87fff700 1 --2- 172.21.15.5:0/1786839886 >> v2:172.21.15.112:3300/0 conn(0x7f1d880cd950 0x7f1d8815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 -- 172.21.15.5:0/1786839886 >> v2:172.21.15.112:3300/0 conn(0x7f1d880cd950 msgr2=0x7f1d8815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 --2- 172.21.15.5:0/1786839886 >> v2:172.21.15.112:3300/0 conn(0x7f1d880cd950 0x7f1d8815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 -- 172.21.15.5:0/1786839886 >> v1:172.21.15.112:6789/0 conn(0x7f1d8806a840 legacy=0x7f1d88161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 -- 172.21.15.5:0/1786839886 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880cdd30 con 0x7f1d880cede0 2023-10-16T13:48:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d877fe700 1 --2- 172.21.15.5:0/1786839886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880cede0 0x7f1d8815f570 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1d88161ae0 tx=0x7f1d78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5556ecb626794a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.137+0000 7f1d86ffd700 1 -- 172.21.15.5:0/1786839886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78005e30 con 0x7f1d880cede0 2023-10-16T13:48:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d86ffd700 1 -- 172.21.15.5:0/1786839886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78004030 con 0x7f1d880cede0 2023-10-16T13:48:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d86ffd700 1 -- 172.21.15.5:0/1786839886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780043e0 con 0x7f1d880cede0 2023-10-16T13:48:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/1786839886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880cede0 msgr2=0x7f1d8815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/1786839886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880cede0 0x7f1d8815f570 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1d88161ae0 tx=0x7f1d78009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/1786839886 shutdown_connections 2023-10-16T13:48:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/1786839886 >> v2:172.21.15.112:3300/0 conn(0x7f1d880cd950 0x7f1d8815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/1786839886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880cede0 0x7f1d8815f570 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/1786839886 >> 172.21.15.5:0/1786839886 conn(0x7f1d8806dae0 msgr2=0x7f1d8806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/1786839886 shutdown_connections 2023-10-16T13:48:33.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.138+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/1786839886 wait complete. 2023-10-16T13:48:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.140+0000 7f1d8e3a8700 1 Processor -- start 2023-10-16T13:48:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.140+0000 7f1d8e3a8700 1 -- start start 2023-10-16T13:48:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8e3a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 0x7f1d880ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8e3a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d880cd950 0x7f1d880c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8e3a8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d880cede0 0x7f1d880c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8e3a8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880ade40 con 0x7f1d8806a840 2023-10-16T13:48:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8e3a8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880ae8d0 con 0x7f1d880cd950 2023-10-16T13:48:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8e3a8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880c5360 con 0x7f1d880cede0 2023-10-16T13:48:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 0x7f1d880ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 0x7f1d880ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49000/0 (socket says 172.21.15.5:49000) 2023-10-16T13:48:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 -- 172.21.15.5:0/3184136684 learned_addr learned my addr 172.21.15.5:0/3184136684 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d877fe700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d880cd950 0x7f1d880c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8c945700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d880cede0 0x7f1d880c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 -- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d880cede0 msgr2=0x7f1d880c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d880cede0 0x7f1d880c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 -- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d880cd950 msgr2=0x7f1d880c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d880cd950 0x7f1d880c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 -- 172.21.15.5:0/3184136684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009500 con 0x7f1d8806a840 2023-10-16T13:48:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d8c945700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d880cede0 0x7f1d880c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.141+0000 7f1d87fff700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 0x7f1d880ad900 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e840 tx=0x7f1d7000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.142+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70013610 con 0x7f1d8806a840 2023-10-16T13:48:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.142+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d70013770 con 0x7f1d8806a840 2023-10-16T13:48:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.142+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70013b20 con 0x7f1d8806a840 2023-10-16T13:48:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.142+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d880b47e0 con 0x7f1d8806a840 2023-10-16T13:48:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.142+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d880c6f80 con 0x7f1d8806a840 2023-10-16T13:48:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.143+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d880b49d0 con 0x7f1d8806a840 2023-10-16T13:48:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.143+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f1d70013c80 con 0x7f1d8806a840 2023-10-16T13:48:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.143+0000 7f1d84ff9700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d6806b2f0 0x7f1d6806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.144+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d70089a10 con 0x7f1d8806a840 2023-10-16T13:48:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.144+0000 7f1d877fe700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d6806b2f0 0x7f1d6806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.144+0000 7f1d877fe700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d6806b2f0 0x7f1d6806d7b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1d78013000 tx=0x7f1d78008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.148+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d700543e0 con 0x7f1d8806a840 2023-10-16T13:48:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.347+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d88067d20 con 0x7f1d8806a840 2023-10-16T13:48:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.348+0000 7f1d84ff9700 1 -- 172.21.15.5:0/3184136684 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d70057a00 con 0x7f1d8806a840 2023-10-16T13:48:33.351 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d6806b2f0 msgr2=0x7f1d6806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d6806b2f0 0x7f1d6806d7b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1d78013000 tx=0x7f1d78008070 comp rx=0 tx=0).stop 2023-10-16T13:48:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 msgr2=0x7f1d880ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 0x7f1d880ad900 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e840 tx=0x7f1d7000eb50 comp rx=0 tx=0).stop 2023-10-16T13:48:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 shutdown_connections 2023-10-16T13:48:33.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1d6806b2f0 0x7f1d6806d7b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d880cede0 0x7f1d880c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8806a840 0x7f1d880ad900 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 --2- 172.21.15.5:0/3184136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d880cd950 0x7f1d880c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 >> 172.21.15.5:0/3184136684 conn(0x7f1d8806dae0 msgr2=0x7f1d880b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 shutdown_connections 2023-10-16T13:48:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.350+0000 7f1d8e3a8700 1 -- 172.21.15.5:0/3184136684 wait complete. 2023-10-16T13:48:33.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:48:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.491+0000 7f5572cbe700 1 Processor -- start 2023-10-16T13:48:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.491+0000 7f5572cbe700 1 -- start start 2023-10-16T13:48:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5572cbe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 0x7f556c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5572cbe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f556c0cede0 0x7f556c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5572cbe700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c0cf260 con 0x7f556c06a840 2023-10-16T13:48:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5572cbe700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c1619a0 con 0x7f556c0cede0 2023-10-16T13:48:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5572cbe700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0b2d60 con 0x7f556c0cd950 2023-10-16T13:48:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f556c0cede0 0x7f556c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5570a5a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 0x7f556c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f556c0cede0 0x7f556c15f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:44904/0 (socket says 172.21.15.5:44904) 2023-10-16T13:48:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5570a5a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 0x7f556c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:46912/0 (socket says 172.21.15.5:46912) 2023-10-16T13:48:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f557125b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f556c06a840 0x7f556c161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:49992/0 (socket says 172.21.15.5:49992) 2023-10-16T13:48:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 -- 172.21.15.5:0/1108374525 learned_addr learned my addr 172.21.15.5:0/1108374525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556b7fe700 1 -- 172.21.15.5:0/1108374525 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918574688 0 0) 0x7f556c0cf260 con 0x7f556c06a840 2023-10-16T13:48:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556b7fe700 1 -- 172.21.15.5:0/1108374525 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f555c0035b0 con 0x7f556c06a840 2023-10-16T13:48:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 -- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 msgr2=0x7f556c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 --2- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 0x7f556c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 -- 172.21.15.5:0/1108374525 >> v1:172.21.15.112:6789/0 conn(0x7f556c06a840 legacy=0x7f556c161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f556bfff700 1 -- 172.21.15.5:0/1108374525 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0cdd30 con 0x7f556c0cede0 2023-10-16T13:48:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.492+0000 7f5570a5a700 1 --2- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 0x7f556c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f556bfff700 1 --2- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c0cede0 0x7f556c15f570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5558006fd0 tx=0x7f5558009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95568b9bf47793d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f556b7fe700 1 -- 172.21.15.5:0/1108374525 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558005e30 con 0x7f556c0cede0 2023-10-16T13:48:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f556b7fe700 1 -- 172.21.15.5:0/1108374525 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558004030 con 0x7f556c0cede0 2023-10-16T13:48:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f556b7fe700 1 -- 172.21.15.5:0/1108374525 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55580043e0 con 0x7f556c0cede0 2023-10-16T13:48:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f5572cbe700 1 -- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c0cede0 msgr2=0x7f556c15f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f5572cbe700 1 --2- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c0cede0 0x7f556c15f570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5558006fd0 tx=0x7f5558009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f5572cbe700 1 -- 172.21.15.5:0/1108374525 shutdown_connections 2023-10-16T13:48:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f5572cbe700 1 --2- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cd950 0x7f556c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f5572cbe700 1 --2- 172.21.15.5:0/1108374525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c0cede0 0x7f556c15f570 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.493+0000 7f5572cbe700 1 -- 172.21.15.5:0/1108374525 >> 172.21.15.5:0/1108374525 conn(0x7f556c06dae0 msgr2=0x7f556c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.494+0000 7f5572cbe700 1 -- 172.21.15.5:0/1108374525 shutdown_connections 2023-10-16T13:48:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.494+0000 7f5572cbe700 1 -- 172.21.15.5:0/1108374525 wait complete. 2023-10-16T13:48:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.495+0000 7f5572cbe700 1 Processor -- start 2023-10-16T13:48:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.495+0000 7f5572cbe700 1 -- start start 2023-10-16T13:48:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5572cbe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c06a840 0x7f556c15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5572cbe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 0x7f556c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5572cbe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cede0 0x7f556c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5572cbe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c15c430 con 0x7f556c0cd950 2023-10-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5572cbe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0c62e0 con 0x7f556c06a840 2023-10-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5572cbe700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0c5710 con 0x7f556c0cede0 2023-10-16T13:48:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 0x7f556c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 0x7f556c0adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49016/0 (socket says 172.21.15.5:49016) 2023-10-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 -- 172.21.15.5:0/121223584 learned_addr learned my addr 172.21.15.5:0/121223584 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f5570a5a700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c06a840 0x7f556c15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f557125b700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cede0 0x7f556c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 -- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cede0 msgr2=0x7f556c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cede0 0x7f556c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 -- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c06a840 msgr2=0x7f556c15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c06a840 0x7f556c15c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 -- 172.21.15.5:0/121223584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600094a0 con 0x7f556c0cd950 2023-10-16T13:48:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f557125b700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cede0 0x7f556c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f556bfff700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 0x7f556c0adde0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5558000c00 tx=0x7f5558004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.496+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558003c70 con 0x7f556c0cd950 2023-10-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.497+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558003dd0 con 0x7f556c0cd950 2023-10-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.497+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5558009500 con 0x7f556c0cd950 2023-10-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.497+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555801c640 con 0x7f556c0cd950 2023-10-16T13:48:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.497+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c0c5c90 con 0x7f556c0cd950 2023-10-16T13:48:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.497+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c0c6470 con 0x7f556c0cd950 2023-10-16T13:48:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.498+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f555801c7a0 con 0x7f556c0cd950 2023-10-16T13:48:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.498+0000 7f55697fa700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f555006b2f0 0x7f555006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.498+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f555808ac80 con 0x7f556c0cd950 2023-10-16T13:48:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.499+0000 7f5570a5a700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f555006b2f0 0x7f555006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.499+0000 7f5570a5a700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f555006b2f0 0x7f555006d7b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5560009d70 tx=0x7f5560009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.503+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55580557e0 con 0x7f556c0cd950 2023-10-16T13:48:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.703+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f556c067d20 con 0x7f556c0cd950 2023-10-16T13:48:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.704+0000 7f55697fa700 1 -- 172.21.15.5:0/121223584 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5558058e00 con 0x7f556c0cd950 2023-10-16T13:48:33.707 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:48:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.705+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f555006b2f0 msgr2=0x7f555006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.705+0000 7f5572cbe700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f555006b2f0 0x7f555006d7b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5560009d70 tx=0x7f5560009210 comp rx=0 tx=0).stop 2023-10-16T13:48:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.705+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 msgr2=0x7f556c0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.705+0000 7f5572cbe700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 0x7f556c0adde0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5558000c00 tx=0x7f5558004750 comp rx=0 tx=0).stop 2023-10-16T13:48:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 shutdown_connections 2023-10-16T13:48:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f555006b2f0 0x7f555006d7b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f556c0cede0 0x7f556c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c06a840 0x7f556c15c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 --2- 172.21.15.5:0/121223584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f556c0cd950 0x7f556c0adde0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 >> 172.21.15.5:0/121223584 conn(0x7f556c06dae0 msgr2=0x7f556c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 shutdown_connections 2023-10-16T13:48:33.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.706+0000 7f5572cbe700 1 -- 172.21.15.5:0/121223584 wait complete. 2023-10-16T13:48:33.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:48:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.845+0000 7fd793d38700 1 Processor -- start 2023-10-16T13:48:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.845+0000 7fd793d38700 1 -- start start 2023-10-16T13:48:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd793d38700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd78c15e2f0 0x7fd78c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd793d38700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c06a840 0x7fd78c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd793d38700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0b2d60 con 0x7fd78c0cd950 2023-10-16T13:48:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd793d38700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c1619a0 con 0x7fd78c15e2f0 2023-10-16T13:48:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd793d38700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c06b1f0 con 0x7fd78c06a840 2023-10-16T13:48:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd791ad4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd78c0cd950 0x7fd78c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59026/0 (socket says 172.21.15.5:59026) 2023-10-16T13:48:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.846+0000 7fd791ad4700 1 -- 172.21.15.5:0/4272746145 learned_addr learned my addr 172.21.15.5:0/4272746145 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7912d3700 1 --2- 172.21.15.5:0/4272746145 >> v2:172.21.15.112:3300/0 conn(0x7fd78c15e2f0 0x7fd78c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c06a840 0x7fd78c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793568192 0 0) 0x7fd78c0b2d60 con 0x7fd78c0cd950 2023-10-16T13:48:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7780035b0 con 0x7fd78c0cd950 2023-10-16T13:48:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1045370527 0 0) 0x7fd7780035b0 con 0x7fd78c0cd950 2023-10-16T13:48:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c06a840 msgr2=0x7fd78c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c06a840 0x7fd78c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 >> v2:172.21.15.112:3300/0 conn(0x7fd78c15e2f0 msgr2=0x7fd78c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 --2- 172.21.15.5:0/4272746145 >> v2:172.21.15.112:3300/0 conn(0x7fd78c15e2f0 0x7fd78c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0cdd30 con 0x7fd78c0cd950 2023-10-16T13:48:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fd77c001670 con 0x7fd78c0cd950 2023-10-16T13:48:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 >> v1:172.21.15.5:6789/0 conn(0x7fd78c0cd950 legacy=0x7fd78c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd778003a00 0x7fd778003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd778004850 0x7fd778004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd778005210 0x7fd77800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1619a0 con 0x7fd778005210 2023-10-16T13:48:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c06b1f0 con 0x7fd778003a00 2023-10-16T13:48:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77800bf50 con 0x7fd778004850 2023-10-16T13:48:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7912d3700 1 --2- 172.21.15.5:0/4272746145 >> v2:172.21.15.112:3300/0 conn(0x7fd78c15e2f0 0x7fd78c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c06a840 0x7fd78c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd778005210 0x7fd77800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd791ad4700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd778003a00 0x7fd778003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7912d3700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd778004850 0x7fd778004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 -- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd778004850 msgr2=0x7fd778004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd778004850 0x7fd778004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 -- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd778003a00 msgr2=0x7fd778003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd778003a00 0x7fd778003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.847+0000 7fd7922d5700 1 -- 172.21.15.5:0/4272746145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780035b0 con 0x7fd778005210 2023-10-16T13:48:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd7922d5700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd778005210 0x7fd77800ba10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd78c06ac20 tx=0x7fd778005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6baa1085290bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003c20 con 0x7fd778005210 2023-10-16T13:48:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78400f040 con 0x7fd778005210 2023-10-16T13:48:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd790ad2700 1 -- 172.21.15.5:0/4272746145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400ea60 con 0x7fd778005210 2023-10-16T13:48:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd793d38700 1 -- 172.21.15.5:0/4272746145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd778005210 msgr2=0x7fd77800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd793d38700 1 --2- 172.21.15.5:0/4272746145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd778005210 0x7fd77800ba10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd78c06ac20 tx=0x7fd778005880 comp rx=0 tx=0).stop 2023-10-16T13:48:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd7922d5700 1 -- 172.21.15.5:0/4272746145 reap_dead start 2023-10-16T13:48:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd793d38700 1 -- 172.21.15.5:0/4272746145 shutdown_connections 2023-10-16T13:48:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd793d38700 1 -- 172.21.15.5:0/4272746145 >> 172.21.15.5:0/4272746145 conn(0x7fd78c06dae0 msgr2=0x7fd78c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd793d38700 1 -- 172.21.15.5:0/4272746145 shutdown_connections 2023-10-16T13:48:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.848+0000 7fd793d38700 1 -- 172.21.15.5:0/4272746145 wait complete. 2023-10-16T13:48:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 Processor -- start 2023-10-16T13:48:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 -- start start 2023-10-16T13:48:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 0x7fd78c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c0c9740 0x7fd78c0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd78c0ae600 0x7fd78c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1f3930 con 0x7fd78c0ae220 2023-10-16T13:48:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0aefc0 con 0x7fd78c0ae600 2023-10-16T13:48:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.850+0000 7fd793d38700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0ca0e0 con 0x7fd78c0c9740 2023-10-16T13:48:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 0x7fd78c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 0x7fd78c0c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49034/0 (socket says 172.21.15.5:49034) 2023-10-16T13:48:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 -- 172.21.15.5:0/227150421 learned_addr learned my addr 172.21.15.5:0/227150421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd7922d5700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd78c0ae600 0x7fd78c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd7912d3700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c0c9740 0x7fd78c0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 -- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c0c9740 msgr2=0x7fd78c0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c0c9740 0x7fd78c0c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 -- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd78c0ae600 msgr2=0x7fd78c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd78c0ae600 0x7fd78c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 -- 172.21.15.5:0/227150421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0c8590 con 0x7fd78c0ae220 2023-10-16T13:48:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd791ad4700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 0x7fd78c0c8a20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0073a0 tx=0x7fd77c0076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00f660 con 0x7fd78c0ae220 2023-10-16T13:48:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c00f7e0 con 0x7fd78c0ae220 2023-10-16T13:48:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c0c7980 con 0x7fd78c0ae220 2023-10-16T13:48:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00fb90 con 0x7fd78c0ae220 2023-10-16T13:48:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.851+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c0c7f40 con 0x7fd78c0ae220 2023-10-16T13:48:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.852+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c067d20 con 0x7fd78c0ae220 2023-10-16T13:48:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.853+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fd77c00fcf0 con 0x7fd78c0ae220 2023-10-16T13:48:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.853+0000 7fd7827fc700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd77006b320 0x7fd77006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.853+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd77c0895e0 con 0x7fd78c0ae220 2023-10-16T13:48:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.853+0000 7fd7912d3700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd77006b320 0x7fd77006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.854+0000 7fd7912d3700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd77006b320 0x7fd77006d7e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0af920 tx=0x7fd7880091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:33.858+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd77c057bc0 con 0x7fd78c0ae220 2023-10-16T13:48:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.058+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd78c15f1b0 con 0x7fd78c0ae220 2023-10-16T13:48:34.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.059+0000 7fd7827fc700 1 -- 172.21.15.5:0/227150421 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd77c057750 con 0x7fd78c0ae220 2023-10-16T13:48:34.062 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:48:34.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd77006b320 msgr2=0x7fd77006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd77006b320 0x7fd77006d7e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0af920 tx=0x7fd7880091c0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 msgr2=0x7fd78c0c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 0x7fd78c0c8a20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0073a0 tx=0x7fd77c0076b0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 shutdown_connections 2023-10-16T13:48:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd78c0ae600 0x7fd78c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c0ae220 0x7fd78c0c8a20 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd77006b320 0x7fd77006d7e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 --2- 172.21.15.5:0/227150421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c0c9740 0x7fd78c0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 >> 172.21.15.5:0/227150421 conn(0x7fd78c06dae0 msgr2=0x7fd78c0cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:34.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 shutdown_connections 2023-10-16T13:48:34.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.061+0000 7fd793d38700 1 -- 172.21.15.5:0/227150421 wait complete. 2023-10-16T13:48:34.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:48:34.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.198+0000 7f6c0a1e1700 1 Processor -- start 2023-10-16T13:48:34.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.198+0000 7f6c0a1e1700 1 -- start start 2023-10-16T13:48:34.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c0a1e1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6c0415d9e0 0x7f6c0415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c0a1e1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c04161f10 0x7f6c040d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c0a1e1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040ce350 con 0x7f6c040d1fc0 2023-10-16T13:48:34.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c0a1e1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040b5140 con 0x7f6c04161f10 2023-10-16T13:48:34.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c0a1e1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c04162630 con 0x7f6c0415d9e0 2023-10-16T13:48:34.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c03fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c04161f10 0x7f6c040d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c03fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c04161f10 0x7f6c040d2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49046/0 (socket says 172.21.15.5:49046) 2023-10-16T13:48:34.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c03fff700 1 -- 172.21.15.5:0/2348618710 learned_addr learned my addr 172.21.15.5:0/2348618710 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:34.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.199+0000 7f6c02ffd700 1 --1- 172.21.15.5:0/2348618710 >> v1:172.21.15.5:6789/0 conn(0x7f6c040d1fc0 0x7f6c04161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59046/0 (socket says 172.21.15.5:59046) 2023-10-16T13:48:34.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c037fe700 1 --2- 172.21.15.5:0/2348618710 >> v2:172.21.15.112:3300/0 conn(0x7f6c0415d9e0 0x7f6c0415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c03fff700 1 -- 172.21.15.5:0/2348618710 >> v2:172.21.15.112:3300/0 conn(0x7f6c0415d9e0 msgr2=0x7f6c0415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:34.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c03fff700 1 --2- 172.21.15.5:0/2348618710 >> v2:172.21.15.112:3300/0 conn(0x7f6c0415d9e0 0x7f6c0415ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c03fff700 1 -- 172.21.15.5:0/2348618710 >> v1:172.21.15.5:6789/0 conn(0x7f6c040d1fc0 legacy=0x7f6c04161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c027fc700 1 -- 172.21.15.5:0/2348618710 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057901529 0 0) 0x7f6c040ce350 con 0x7f6c040d1fc0 2023-10-16T13:48:34.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c03fff700 1 -- 172.21.15.5:0/2348618710 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040ce5f0 con 0x7f6c04161f10 2023-10-16T13:48:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c037fe700 1 --2- 172.21.15.5:0/2348618710 >> v2:172.21.15.112:3300/0 conn(0x7f6c0415d9e0 0x7f6c0415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c03fff700 1 --2- 172.21.15.5:0/2348618710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c04161f10 0x7f6c040d2440 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6c040b63c0 tx=0x7f6bfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16357032c3dce02d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c027fc700 1 -- 172.21.15.5:0/2348618710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00e070 con 0x7f6c04161f10 2023-10-16T13:48:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c027fc700 1 -- 172.21.15.5:0/2348618710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc00b9c0 con 0x7f6c04161f10 2023-10-16T13:48:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.200+0000 7f6c027fc700 1 -- 172.21.15.5:0/2348618710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00bd70 con 0x7f6c04161f10 2023-10-16T13:48:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/2348618710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c04161f10 msgr2=0x7f6c040d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/2348618710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c04161f10 0x7f6c040d2440 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6c040b63c0 tx=0x7f6bfc00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/2348618710 shutdown_connections 2023-10-16T13:48:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/2348618710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c04161f10 0x7f6c040d2440 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/2348618710 >> v2:172.21.15.112:3300/0 conn(0x7f6c0415d9e0 0x7f6c0415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/2348618710 >> 172.21.15.5:0/2348618710 conn(0x7f6c0409cb40 msgr2=0x7f6c040d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/2348618710 shutdown_connections 2023-10-16T13:48:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.201+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/2348618710 wait complete. 2023-10-16T13:48:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.202+0000 7f6c0a1e1700 1 Processor -- start 2023-10-16T13:48:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.202+0000 7f6c0a1e1700 1 -- start start 2023-10-16T13:48:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c0a1e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 0x7f6c0415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c0a1e1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c0415d9e0 0x7f6c040b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c0a1e1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04161f10 0x7f6c040ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c0a1e1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040b8a20 con 0x7f6c040d1fc0 2023-10-16T13:48:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c0a1e1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040cd650 con 0x7f6c04161f10 2023-10-16T13:48:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c0a1e1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040b83d0 con 0x7f6c0415d9e0 2023-10-16T13:48:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 0x7f6c0415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 0x7f6c0415ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49050/0 (socket says 172.21.15.5:49050) 2023-10-16T13:48:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 -- 172.21.15.5:0/3899867550 learned_addr learned my addr 172.21.15.5:0/3899867550 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c02ffd700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c0415d9e0 0x7f6c040b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c03fff700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04161f10 0x7f6c040ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 -- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c0415d9e0 msgr2=0x7f6c040b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c0415d9e0 0x7f6c040b8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 -- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04161f10 msgr2=0x7f6c040ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04161f10 0x7f6c040ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 -- 172.21.15.5:0/3899867550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc009b30 con 0x7f6c040d1fc0 2023-10-16T13:48:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.203+0000 7f6c037fe700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 0x7f6c0415ad50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e810 tx=0x7f6bec00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.204+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec004230 con 0x7f6c040d1fc0 2023-10-16T13:48:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.204+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec004390 con 0x7f6c040d1fc0 2023-10-16T13:48:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.204+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0036a0 con 0x7f6c040d1fc0 2023-10-16T13:48:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.204+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c040b86b0 con 0x7f6c040d1fc0 2023-10-16T13:48:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.204+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c040b68b0 con 0x7f6c040d1fc0 2023-10-16T13:48:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.205+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04067d20 con 0x7f6c040d1fc0 2023-10-16T13:48:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.205+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6bec003800 con 0x7f6c040d1fc0 2023-10-16T13:48:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.205+0000 7f6bfbfff700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6be406b2f0 0x7f6be406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.206+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bec0898a0 con 0x7f6c040d1fc0 2023-10-16T13:48:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.206+0000 7f6c02ffd700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6be406b2f0 0x7f6be406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.206+0000 7f6c02ffd700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6be406b2f0 0x7f6be406d7b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c0406d770 tx=0x7f6bf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.210+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bec0542f0 con 0x7f6c040d1fc0 2023-10-16T13:48:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.427+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c040b8840 con 0x7f6c040d1fc0 2023-10-16T13:48:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.427+0000 7f6bfbfff700 1 -- 172.21.15.5:0/3899867550 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6bec0094c0 con 0x7f6c040d1fc0 2023-10-16T13:48:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6be406b2f0 msgr2=0x7f6be406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6be406b2f0 0x7f6be406d7b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c0406d770 tx=0x7f6bf4009040 comp rx=0 tx=0).stop 2023-10-16T13:48:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 msgr2=0x7f6c0415ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 0x7f6c0415ad50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e810 tx=0x7f6bec00ebd0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 shutdown_connections 2023-10-16T13:48:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04161f10 0x7f6c040ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c040d1fc0 0x7f6c0415ad50 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6be406b2f0 0x7f6be406d7b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 --2- 172.21.15.5:0/3899867550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c0415d9e0 0x7f6c040b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 >> 172.21.15.5:0/3899867550 conn(0x7f6c0409cb40 msgr2=0x7f6c040cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 shutdown_connections 2023-10-16T13:48:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.429+0000 7f6c0a1e1700 1 -- 172.21.15.5:0/3899867550 wait complete. 2023-10-16T13:48:34.435 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:48:34.444 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:48:34.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:34.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:34.491 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:48:34.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:34.492 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:48:34.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:34.511 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:34.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:48:34.529 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:34.530 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:34.569 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:48:34.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:34.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.690+0000 7f6d188a7700 1 Processor -- start 2023-10-16T13:48:34.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.690+0000 7f6d188a7700 1 -- start start 2023-10-16T13:48:34.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.691+0000 7f6d188a7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d141600e0 0x7f6d140af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.691+0000 7f6d188a7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d140afc60 0x7f6d1406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.691+0000 7f6d188a7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d140cbb10 con 0x7f6d1415b8d0 2023-10-16T13:48:34.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.691+0000 7f6d188a7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140b00f0 con 0x7f6d140afc60 2023-10-16T13:48:34.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.691+0000 7f6d188a7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140cb830 con 0x7f6d141600e0 2023-10-16T13:48:34.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d140afc60 0x7f6d1406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d140afc60 0x7f6d1406f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49060/0 (socket says 172.21.15.5:49060) 2023-10-16T13:48:34.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 -- 172.21.15.5:0/112476271 learned_addr learned my addr 172.21.15.5:0/112476271 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:34.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d11d9b700 1 --2- 172.21.15.5:0/112476271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d141600e0 0x7f6d140af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 -- 172.21.15.5:0/112476271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d141600e0 msgr2=0x7f6d140af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 --2- 172.21.15.5:0/112476271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d141600e0 0x7f6d140af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 -- 172.21.15.5:0/112476271 >> v1:172.21.15.112:6789/0 conn(0x7f6d1415b8d0 legacy=0x7f6d140cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 -- 172.21.15.5:0/112476271 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1415f600 con 0x7f6d140afc60 2023-10-16T13:48:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d12d9d700 1 --2- 172.21.15.5:0/112476271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d140afc60 0x7f6d1406f550 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009e50 tx=0x7f6d0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5f4723eaf5d063 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d1159a700 1 -- 172.21.15.5:0/112476271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00e070 con 0x7f6d140afc60 2023-10-16T13:48:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d1159a700 1 -- 172.21.15.5:0/112476271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c00b910 con 0x7f6d140afc60 2023-10-16T13:48:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.692+0000 7f6d1159a700 1 -- 172.21.15.5:0/112476271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00bcc0 con 0x7f6d140afc60 2023-10-16T13:48:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 -- 172.21.15.5:0/112476271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d140afc60 msgr2=0x7f6d1406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 --2- 172.21.15.5:0/112476271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d140afc60 0x7f6d1406f550 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009e50 tx=0x7f6d0c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 -- 172.21.15.5:0/112476271 shutdown_connections 2023-10-16T13:48:34.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 --2- 172.21.15.5:0/112476271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d140afc60 0x7f6d1406f550 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 --2- 172.21.15.5:0/112476271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d141600e0 0x7f6d140af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 -- 172.21.15.5:0/112476271 >> 172.21.15.5:0/112476271 conn(0x7f6d140cd270 msgr2=0x7f6d140cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:34.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 -- 172.21.15.5:0/112476271 shutdown_connections 2023-10-16T13:48:34.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.693+0000 7f6d188a7700 1 -- 172.21.15.5:0/112476271 wait complete. 2023-10-16T13:48:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.694+0000 7f6d188a7700 1 Processor -- start 2023-10-16T13:48:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.694+0000 7f6d188a7700 1 -- start start 2023-10-16T13:48:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d188a7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140afc60 0x7f6d140c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d188a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 0x7f6d1415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d188a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141600e0 0x7f6d1415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d188a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1415bf00 con 0x7f6d1415b8d0 2023-10-16T13:48:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d188a7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140c5950 con 0x7f6d141600e0 2023-10-16T13:48:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d188a7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140c5c30 con 0x7f6d140afc60 2023-10-16T13:48:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 0x7f6d1415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 0x7f6d1415dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49064/0 (socket says 172.21.15.5:49064) 2023-10-16T13:48:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 -- 172.21.15.5:0/1538352411 learned_addr learned my addr 172.21.15.5:0/1538352411 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d12d9d700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141600e0 0x7f6d1415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d1259c700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140afc60 0x7f6d140c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 -- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140afc60 msgr2=0x7f6d140c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140afc60 0x7f6d140c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 -- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141600e0 msgr2=0x7f6d1415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141600e0 0x7f6d1415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d11d9b700 1 -- 172.21.15.5:0/1538352411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c009b30 con 0x7f6d1415b8d0 2023-10-16T13:48:34.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.695+0000 7f6d1259c700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140afc60 0x7f6d140c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:34.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.696+0000 7f6d11d9b700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 0x7f6d1415dda0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00e980 tx=0x7f6cfc00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:34.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.696+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc009710 con 0x7f6d1415b8d0 2023-10-16T13:48:34.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.696+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc00eed0 con 0x7f6d1415b8d0 2023-10-16T13:48:34.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.696+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d140c5f10 con 0x7f6d1415b8d0 2023-10-16T13:48:34.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.696+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00ca90 con 0x7f6d1415b8d0 2023-10-16T13:48:34.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.696+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d140c64d0 con 0x7f6d1415b8d0 2023-10-16T13:48:34.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.697+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d140c66f0 con 0x7f6d1415b8d0 2023-10-16T13:48:34.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.698+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6cfc00cbf0 con 0x7f6d1415b8d0 2023-10-16T13:48:34.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.698+0000 7f6d0affd700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cf406b320 0x7f6cf406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:34.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.698+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cfc089cb0 con 0x7f6d1415b8d0 2023-10-16T13:48:34.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.698+0000 7f6d1259c700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cf406b320 0x7f6cf406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:34.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.699+0000 7f6d1259c700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cf406b320 0x7f6cf406d7e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6d04000fb0 tx=0x7f6d04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:34.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.703+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cfc054810 con 0x7f6d1415b8d0 2023-10-16T13:48:34.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.946+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d14067d20 con 0x7f6d1415b8d0 2023-10-16T13:48:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.947+0000 7f6d0affd700 1 -- 172.21.15.5:0/1538352411 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f6cfc021090 con 0x7f6d1415b8d0 2023-10-16T13:48:34.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:34.950 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:19.692644+0000","modified":"2023-10-16T13:48:22.708850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2462371397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2462371397},{"type":"v1","addr":"172.21.15.5:6835","nonce":2462371397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-16T13:48:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cf406b320 msgr2=0x7f6cf406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cf406b320 0x7f6cf406d7e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6d04000fb0 tx=0x7f6d04009040 comp rx=0 tx=0).stop 2023-10-16T13:48:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 msgr2=0x7f6d1415dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:34.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 0x7f6d1415dda0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00e980 tx=0x7f6cfc00ec90 comp rx=0 tx=0).stop 2023-10-16T13:48:34.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 shutdown_connections 2023-10-16T13:48:34.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141600e0 0x7f6d1415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6cf406b320 0x7f6cf406d7e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140afc60 0x7f6d140c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 --2- 172.21.15.5:0/1538352411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1415b8d0 0x7f6d1415dda0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:34.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 >> 172.21.15.5:0/1538352411 conn(0x7f6d140cd270 msgr2=0x7f6d140b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:34.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 shutdown_connections 2023-10-16T13:48:34.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:34.949+0000 7f6d188a7700 1 -- 172.21.15.5:0/1538352411 wait complete. 2023-10-16T13:48:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 71 2023-10-16T13:48:34.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:35.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.088+0000 7f16642a1700 1 Processor -- start 2023-10-16T13:48:35.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.088+0000 7f16642a1700 1 -- start start 2023-10-16T13:48:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f16642a1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f165c15ab10 0x7f165c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f16642a1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f165c0b1f50 0x7f165c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f16642a1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c15e7a0 con 0x7f165c0b2400 2023-10-16T13:48:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f16642a1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c15f730 con 0x7f165c0b1f50 2023-10-16T13:48:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f16642a1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c0b29a0 con 0x7f165c15ab10 2023-10-16T13:48:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f165c0b1f50 0x7f165c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f165c0b1f50 0x7f165c0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49072/0 (socket says 172.21.15.5:49072) 2023-10-16T13:48:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 -- 172.21.15.5:0/3780912633 learned_addr learned my addr 172.21.15.5:0/3780912633 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166203d700 1 --2- 172.21.15.5:0/3780912633 >> v2:172.21.15.112:3300/0 conn(0x7f165c15ab10 0x7f165c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 -- 172.21.15.5:0/3780912633 >> v2:172.21.15.112:3300/0 conn(0x7f165c15ab10 msgr2=0x7f165c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 --2- 172.21.15.5:0/3780912633 >> v2:172.21.15.112:3300/0 conn(0x7f165c15ab10 0x7f165c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 -- 172.21.15.5:0/3780912633 >> v1:172.21.15.112:6789/0 conn(0x7f165c0b2400 legacy=0x7f165c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.089+0000 7f166183c700 1 -- 172.21.15.5:0/3780912633 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0b2c80 con 0x7f165c0b1f50 2023-10-16T13:48:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f166183c700 1 --2- 172.21.15.5:0/3780912633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c0b1f50 0x7f165c0cf720 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f165c0d0430 tx=0x7f1658009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2d16cde3b4c085 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f166103b700 1 -- 172.21.15.5:0/3780912633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658005e30 con 0x7f165c0b1f50 2023-10-16T13:48:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f166103b700 1 -- 172.21.15.5:0/3780912633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1658004030 con 0x7f165c0b1f50 2023-10-16T13:48:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f166103b700 1 -- 172.21.15.5:0/3780912633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16580043e0 con 0x7f165c0b1f50 2023-10-16T13:48:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 -- 172.21.15.5:0/3780912633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c0b1f50 msgr2=0x7f165c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 --2- 172.21.15.5:0/3780912633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c0b1f50 0x7f165c0cf720 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f165c0d0430 tx=0x7f1658009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 -- 172.21.15.5:0/3780912633 shutdown_connections 2023-10-16T13:48:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 --2- 172.21.15.5:0/3780912633 >> v2:172.21.15.112:3300/0 conn(0x7f165c15ab10 0x7f165c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 --2- 172.21.15.5:0/3780912633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c0b1f50 0x7f165c0cf720 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 -- 172.21.15.5:0/3780912633 >> 172.21.15.5:0/3780912633 conn(0x7f165c06dae0 msgr2=0x7f165c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 -- 172.21.15.5:0/3780912633 shutdown_connections 2023-10-16T13:48:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.090+0000 7f16642a1700 1 -- 172.21.15.5:0/3780912633 wait complete. 2023-10-16T13:48:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.092+0000 7f16642a1700 1 Processor -- start 2023-10-16T13:48:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.092+0000 7f16642a1700 1 -- start start 2023-10-16T13:48:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f16642a1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f165c0b1f50 0x7f165c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f16642a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b2400 0x7f165c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f16642a1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 0x7f165c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f16642a1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0ca3e0 con 0x7f165c15ab10 2023-10-16T13:48:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f16642a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c1572a0 con 0x7f165c0b2400 2023-10-16T13:48:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f16642a1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0c9760 con 0x7f165c0b1f50 2023-10-16T13:48:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 0x7f165c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 0x7f165c0cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49080/0 (socket says 172.21.15.5:49080) 2023-10-16T13:48:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 -- 172.21.15.5:0/4160916816 learned_addr learned my addr 172.21.15.5:0/4160916816 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166183c700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b2400 0x7f165c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 -- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f165c0b1f50 msgr2=0x7f165c15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166203d700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f165c0b1f50 0x7f165c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f165c0b1f50 0x7f165c15c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 -- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b2400 msgr2=0x7f165c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b2400 0x7f165c0cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166283e700 1 -- 172.21.15.5:0/4160916816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658009500 con 0x7f165c15ab10 2023-10-16T13:48:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166183c700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b2400 0x7f165c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.093+0000 7f166203d700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f165c0b1f50 0x7f165c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.094+0000 7f166283e700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 0x7f165c0cc580 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f165400cb50 tx=0x7f165400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.094+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654003c00 con 0x7f165c15ab10 2023-10-16T13:48:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.094+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1654003d60 con 0x7f165c15ab10 2023-10-16T13:48:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.094+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c0c9a40 con 0x7f165c15ab10 2023-10-16T13:48:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.094+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165400ab70 con 0x7f165c15ab10 2023-10-16T13:48:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.094+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c0ca000 con 0x7f165c15ab10 2023-10-16T13:48:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.095+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c067d20 con 0x7f165c15ab10 2023-10-16T13:48:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.095+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f165400acd0 con 0x7f165c15ab10 2023-10-16T13:48:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.095+0000 7f1652ffd700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f164006b2f0 0x7f164006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.096+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1654089e80 con 0x7f165c15ab10 2023-10-16T13:48:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.096+0000 7f166203d700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f164006b2f0 0x7f164006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.096+0000 7f166203d700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f164006b2f0 0x7f164006d7b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f164c009b60 tx=0x7f164c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.100+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16540548d0 con 0x7f165c15ab10 2023-10-16T13:48:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.306+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f165c0afc10 con 0x7f165c15ab10 2023-10-16T13:48:35.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.307+0000 7f1652ffd700 1 -- 172.21.15.5:0/4160916816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16444 (secure 0 0 0) 0x7f1654057ef0 con 0x7f165c15ab10 2023-10-16T13:48:35.310 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:35.310 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:21.283240+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:35.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f164006b2f0 msgr2=0x7f164006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f164006b2f0 0x7f164006d7b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f164c009b60 tx=0x7f164c008040 comp rx=0 tx=0).stop 2023-10-16T13:48:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 msgr2=0x7f165c0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 0x7f165c0cc580 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f165400cb50 tx=0x7f165400cf10 comp rx=0 tx=0).stop 2023-10-16T13:48:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 shutdown_connections 2023-10-16T13:48:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165c15ab10 0x7f165c0cc580 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f164006b2f0 0x7f164006d7b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f165c0b1f50 0x7f165c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 --2- 172.21.15.5:0/4160916816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b2400 0x7f165c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 >> 172.21.15.5:0/4160916816 conn(0x7f165c06dae0 msgr2=0x7f165c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 shutdown_connections 2023-10-16T13:48:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.309+0000 7f16642a1700 1 -- 172.21.15.5:0/4160916816 wait complete. 2023-10-16T13:48:35.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:48:18.181024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:48:18.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:35.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.451+0000 7f2f9cda2700 1 Processor -- start 2023-10-16T13:48:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.451+0000 7f2f9cda2700 1 -- start start 2023-10-16T13:48:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9cda2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f980cd950 0x7f2f9815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9cda2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f9815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9cda2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980cf260 con 0x7f2f9806a840 2023-10-16T13:48:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9cda2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f981619a0 con 0x7f2f980cd950 2023-10-16T13:48:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9cda2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980b2d60 con 0x7f2f980cede0 2023-10-16T13:48:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f96d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f9806a840 0x7f2f98161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59092/0 (socket says 172.21.15.5:59092) 2023-10-16T13:48:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f96d9d700 1 -- 172.21.15.5:0/3342851747 learned_addr learned my addr 172.21.15.5:0/3342851747 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f95d9b700 1 --2- 172.21.15.5:0/3342851747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f9815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9659c700 1 --2- 172.21.15.5:0/3342851747 >> v2:172.21.15.112:3300/0 conn(0x7f2f980cd950 0x7f2f9815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9559a700 1 -- 172.21.15.5:0/3342851747 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952915126 0 0) 0x7f2f980cf260 con 0x7f2f9806a840 2023-10-16T13:48:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.452+0000 7f2f9559a700 1 -- 172.21.15.5:0/3342851747 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f800035b0 con 0x7f2f9806a840 2023-10-16T13:48:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f9559a700 1 -- 172.21.15.5:0/3342851747 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722965890 0 0) 0x7f2f800035b0 con 0x7f2f9806a840 2023-10-16T13:48:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f95d9b700 1 -- 172.21.15.5:0/3342851747 >> v2:172.21.15.112:3300/0 conn(0x7f2f980cd950 msgr2=0x7f2f9815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f95d9b700 1 --2- 172.21.15.5:0/3342851747 >> v2:172.21.15.112:3300/0 conn(0x7f2f980cd950 0x7f2f9815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f95d9b700 1 -- 172.21.15.5:0/3342851747 >> v1:172.21.15.5:6789/0 conn(0x7f2f9806a840 legacy=0x7f2f98161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f95d9b700 1 -- 172.21.15.5:0/3342851747 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980cdd30 con 0x7f2f980cede0 2023-10-16T13:48:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f9659c700 1 --2- 172.21.15.5:0/3342851747 >> v2:172.21.15.112:3300/0 conn(0x7f2f980cd950 0x7f2f9815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f95d9b700 1 --2- 172.21.15.5:0/3342851747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f9815f570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009820 tx=0x7f2f88009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef783219ba6af3f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f9559a700 1 -- 172.21.15.5:0/3342851747 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900019f0 con 0x7f2f980cede0 2023-10-16T13:48:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f9559a700 1 -- 172.21.15.5:0/3342851747 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88005c30 con 0x7f2f980cede0 2023-10-16T13:48:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.453+0000 7f2f9559a700 1 -- 172.21.15.5:0/3342851747 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88004030 con 0x7f2f980cede0 2023-10-16T13:48:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 -- 172.21.15.5:0/3342851747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 msgr2=0x7f2f9815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/3342851747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f9815f570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009820 tx=0x7f2f88009b30 comp rx=0 tx=0).stop 2023-10-16T13:48:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 -- 172.21.15.5:0/3342851747 shutdown_connections 2023-10-16T13:48:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/3342851747 >> v2:172.21.15.112:3300/0 conn(0x7f2f980cd950 0x7f2f9815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/3342851747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f9815f570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 -- 172.21.15.5:0/3342851747 >> 172.21.15.5:0/3342851747 conn(0x7f2f9806dae0 msgr2=0x7f2f9806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 -- 172.21.15.5:0/3342851747 shutdown_connections 2023-10-16T13:48:35.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.454+0000 7f2f9cda2700 1 -- 172.21.15.5:0/3342851747 wait complete. 2023-10-16T13:48:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.455+0000 7f2f9cda2700 1 Processor -- start 2023-10-16T13:48:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.455+0000 7f2f9cda2700 1 -- start start 2023-10-16T13:48:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9cda2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f9806a840 0x7f2f980c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9cda2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 0x7f2f980cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9cda2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f980cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9cda2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c6ed0 con 0x7f2f980cd950 2023-10-16T13:48:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9cda2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f981f7700 con 0x7f2f9806a840 2023-10-16T13:48:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9cda2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c63a0 con 0x7f2f980cede0 2023-10-16T13:48:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 0x7f2f980cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 0x7f2f980cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49094/0 (socket says 172.21.15.5:49094) 2023-10-16T13:48:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 -- 172.21.15.5:0/1736310905 learned_addr learned my addr 172.21.15.5:0/1736310905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f96d9d700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f980cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f9659c700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f9806a840 0x7f2f980c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 -- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 msgr2=0x7f2f980cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f980cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 -- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f9806a840 msgr2=0x7f2f980c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f9806a840 0x7f2f980c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.456+0000 7f2f95d9b700 1 -- 172.21.15.5:0/1736310905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0094a0 con 0x7f2f980cd950 2023-10-16T13:48:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.457+0000 7f2f95d9b700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 0x7f2f980cbff0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f2f88000c00 tx=0x7f2f88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.457+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88003bb0 con 0x7f2f980cd950 2023-10-16T13:48:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.457+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88009430 con 0x7f2f980cd950 2023-10-16T13:48:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.457+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88003d10 con 0x7f2f980cd950 2023-10-16T13:48:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.457+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8801d670 con 0x7f2f980cd950 2023-10-16T13:48:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.457+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f981f70b0 con 0x7f2f980cd950 2023-10-16T13:48:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.458+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f981f6f10 con 0x7f2f980cd950 2023-10-16T13:48:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.458+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2f8801d7d0 con 0x7f2f980cd950 2023-10-16T13:48:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.458+0000 7f2f86ffd700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f7806b2f0 0x7f2f7806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.459+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f8808b100 con 0x7f2f980cd950 2023-10-16T13:48:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.459+0000 7f2f9659c700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f7806b2f0 0x7f2f7806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.459+0000 7f2f9659c700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f7806b2f0 0x7f2f7806d7b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009c20 tx=0x7f2f8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.463+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f981f6f10 con 0x7f2f980cd950 2023-10-16T13:48:35.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.662+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f981f6f10 con 0x7f2f980cd950 2023-10-16T13:48:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.663+0000 7f2f86ffd700 1 -- 172.21.15.5:0/1736310905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f981f6f10 con 0x7f2f980cd950 2023-10-16T13:48:35.666 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f7806b2f0 msgr2=0x7f2f7806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f7806b2f0 0x7f2f7806d7b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009c20 tx=0x7f2f8c008040 comp rx=0 tx=0).stop 2023-10-16T13:48:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 msgr2=0x7f2f980cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 0x7f2f980cbff0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f2f88000c00 tx=0x7f2f88004750 comp rx=0 tx=0).stop 2023-10-16T13:48:35.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 shutdown_connections 2023-10-16T13:48:35.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2f7806b2f0 0x7f2f7806d7b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f980cede0 0x7f2f980cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f9806a840 0x7f2f980c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 --2- 172.21.15.5:0/1736310905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f980cd950 0x7f2f980cbff0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 >> 172.21.15.5:0/1736310905 conn(0x7f2f9806dae0 msgr2=0x7f2f98072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 shutdown_connections 2023-10-16T13:48:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.665+0000 7f2f9cda2700 1 -- 172.21.15.5:0/1736310905 wait complete. 2023-10-16T13:48:35.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:48:35.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.805+0000 7f7e7f1ae700 1 Processor -- start 2023-10-16T13:48:35.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.806+0000 7f7e7f1ae700 1 -- start start 2023-10-16T13:48:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.806+0000 7f7e7f1ae700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e780ce6e0 0x7f7e780cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.806+0000 7f7e7f1ae700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780d23e0 con 0x7f7e7815b740 2023-10-16T13:48:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.806+0000 7f7e7f1ae700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780cf190 con 0x7f7e780d0c70 2023-10-16T13:48:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.806+0000 7f7e7f1ae700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7815bb20 con 0x7f7e780ce6e0 2023-10-16T13:48:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e780ce6e0 0x7f7e780cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e780ce6e0 0x7f7e780cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49102/0 (socket says 172.21.15.5:49102) 2023-10-16T13:48:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 -- 172.21.15.5:0/830158660 learned_addr learned my addr 172.21.15.5:0/830158660 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 -- 172.21.15.5:0/830158660 >> v1:172.21.15.112:6789/0 conn(0x7f7e780d0c70 legacy=0x7f7e780cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 -- 172.21.15.5:0/830158660 >> v1:172.21.15.5:6789/0 conn(0x7f7e7815b740 legacy=0x7f7e780d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 -- 172.21.15.5:0/830158660 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780cbd40 con 0x7f7e780ce6e0 2023-10-16T13:48:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e777fe700 1 -- 172.21.15.5:0/830158660 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690766037 0 0) 0x7f7e6c001110 con 0x7f7e7815b740 2023-10-16T13:48:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e7d74b700 1 --2- 172.21.15.5:0/830158660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e780cf690 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009e50 tx=0x7f7e7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502d4b2c5a90d934 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e777fe700 1 -- 172.21.15.5:0/830158660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7000e070 con 0x7f7e780ce6e0 2023-10-16T13:48:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e777fe700 1 -- 172.21.15.5:0/830158660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7000b9c0 con 0x7f7e780ce6e0 2023-10-16T13:48:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.807+0000 7f7e777fe700 1 -- 172.21.15.5:0/830158660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7000bd70 con 0x7f7e780ce6e0 2023-10-16T13:48:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/830158660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 msgr2=0x7f7e780cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/830158660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e780cf690 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009e50 tx=0x7f7e7000b330 comp rx=0 tx=0).stop 2023-10-16T13:48:35.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/830158660 shutdown_connections 2023-10-16T13:48:35.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/830158660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e780cf690 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/830158660 >> 172.21.15.5:0/830158660 conn(0x7f7e780665a0 msgr2=0x7f7e78066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:35.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/830158660 shutdown_connections 2023-10-16T13:48:35.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.808+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/830158660 wait complete. 2023-10-16T13:48:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.809+0000 7f7e7f1ae700 1 Processor -- start 2023-10-16T13:48:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.809+0000 7f7e7f1ae700 1 -- start start 2023-10-16T13:48:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7f1ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e78155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7f1ae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e780d0c70 0x7f7e780b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7f1ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7815b740 0x7f7e780c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7f1ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b5530 con 0x7f7e780ce6e0 2023-10-16T13:48:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7f1ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b4920 con 0x7f7e7815b740 2023-10-16T13:48:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7f1ae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b4c00 con 0x7f7e780d0c70 2023-10-16T13:48:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e78155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e78155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49104/0 (socket says 172.21.15.5:49104) 2023-10-16T13:48:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 -- 172.21.15.5:0/3211521166 learned_addr learned my addr 172.21.15.5:0/3211521166 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7d74b700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7815b740 0x7f7e780c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 -- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e780d0c70 msgr2=0x7f7e780b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e780d0c70 0x7f7e780b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 -- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7815b740 msgr2=0x7f7e780c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7815b740 0x7f7e780c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 -- 172.21.15.5:0/3211521166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70009b30 con 0x7f7e780ce6e0 2023-10-16T13:48:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.810+0000 7f7e7cf4a700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e78155ec0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c780 tx=0x7f7e6c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.811+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0054e0 con 0x7f7e780ce6e0 2023-10-16T13:48:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.811+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c003680 con 0x7f7e780ce6e0 2023-10-16T13:48:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.811+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c003a30 con 0x7f7e780ce6e0 2023-10-16T13:48:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.811+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e780b4ee0 con 0x7f7e780ce6e0 2023-10-16T13:48:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.811+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e78156400 con 0x7f7e780ce6e0 2023-10-16T13:48:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.812+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e78067d20 con 0x7f7e780ce6e0 2023-10-16T13:48:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.812+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f7e6c003b90 con 0x7f7e780ce6e0 2023-10-16T13:48:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.813+0000 7f7e757fa700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e5c06b2f0 0x7f7e5c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.813+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e6c089070 con 0x7f7e780ce6e0 2023-10-16T13:48:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.813+0000 7f7e77fff700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e5c06b2f0 0x7f7e5c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.813+0000 7f7e77fff700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e5c06b2f0 0x7f7e5c06d7b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7e7815ef00 tx=0x7f7e640079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:35.817+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e6c0bbca0 con 0x7f7e780ce6e0 2023-10-16T13:48:36.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.017+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e780d23e0 con 0x7f7e780ce6e0 2023-10-16T13:48:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.018+0000 7f7e757fa700 1 -- 172.21.15.5:0/3211521166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e780d23e0 con 0x7f7e780ce6e0 2023-10-16T13:48:36.021 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:48:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.019+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e5c06b2f0 msgr2=0x7f7e5c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.019+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e5c06b2f0 0x7f7e5c06d7b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7e7815ef00 tx=0x7f7e640079e0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.019+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 msgr2=0x7f7e78155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.019+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e78155ec0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c780 tx=0x7f7e6c00cb40 comp rx=0 tx=0).stop 2023-10-16T13:48:36.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 shutdown_connections 2023-10-16T13:48:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7815b740 0x7f7e780c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e780ce6e0 0x7f7e78155ec0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7e5c06b2f0 0x7f7e5c06d7b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 --2- 172.21.15.5:0/3211521166 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e780d0c70 0x7f7e780b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 >> 172.21.15.5:0/3211521166 conn(0x7f7e780665a0 msgr2=0x7f7e7815f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:36.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 shutdown_connections 2023-10-16T13:48:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.020+0000 7f7e7f1ae700 1 -- 172.21.15.5:0/3211521166 wait complete. 2023-10-16T13:48:36.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:48:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 Processor -- start 2023-10-16T13:48:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 -- start start 2023-10-16T13:48:36.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20dc15ab10 0x7f20dc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20dc0cfe30 0x7f20dc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc15e7a0 con 0x7f20dc0b1f50 2023-10-16T13:48:36.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc15f730 con 0x7f20dc0cfe30 2023-10-16T13:48:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.160+0000 7f20e204f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc0b29a0 con 0x7f20dc15ab10 2023-10-16T13:48:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20dc0cfe30 0x7f20dc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20daffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20dc0b1f50 0x7f20dc0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59116/0 (socket says 172.21.15.5:59116) 2023-10-16T13:48:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20daffd700 1 -- 172.21.15.5:0/598927641 learned_addr learned my addr 172.21.15.5:0/598927641 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 --2- 172.21.15.5:0/598927641 >> v2:172.21.15.5:3300/0 conn(0x7f20dc0cfe30 0x7f20dc0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49116/0 (socket says 172.21.15.5:49116) 2023-10-16T13:48:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20db7fe700 1 --2- 172.21.15.5:0/598927641 >> v2:172.21.15.112:3300/0 conn(0x7f20dc15ab10 0x7f20dc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 -- 172.21.15.5:0/598927641 >> v2:172.21.15.112:3300/0 conn(0x7f20dc15ab10 msgr2=0x7f20dc15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 --2- 172.21.15.5:0/598927641 >> v2:172.21.15.112:3300/0 conn(0x7f20dc15ab10 0x7f20dc15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 -- 172.21.15.5:0/598927641 >> v1:172.21.15.5:6789/0 conn(0x7f20dc0b1f50 legacy=0x7f20dc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 -- 172.21.15.5:0/598927641 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0b2c80 con 0x7f20dc0cfe30 2023-10-16T13:48:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20da7fc700 1 -- 172.21.15.5:0/598927641 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248645081 0 0) 0x7f20dc15e7a0 con 0x7f20dc0b1f50 2023-10-16T13:48:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20dbfff700 1 --2- 172.21.15.5:0/598927641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0cfe30 0x7f20dc0cbf40 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0d0430 tx=0x7f20d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c61975684ddae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20da7fc700 1 -- 172.21.15.5:0/598927641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400e070 con 0x7f20dc0cfe30 2023-10-16T13:48:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20da7fc700 1 -- 172.21.15.5:0/598927641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d400bbd0 con 0x7f20dc0cfe30 2023-10-16T13:48:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.161+0000 7f20da7fc700 1 -- 172.21.15.5:0/598927641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4012430 con 0x7f20dc0cfe30 2023-10-16T13:48:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 -- 172.21.15.5:0/598927641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0cfe30 msgr2=0x7f20dc0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 --2- 172.21.15.5:0/598927641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0cfe30 0x7f20dc0cbf40 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0d0430 tx=0x7f20d400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 -- 172.21.15.5:0/598927641 shutdown_connections 2023-10-16T13:48:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 --2- 172.21.15.5:0/598927641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0cfe30 0x7f20dc0cbf40 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 --2- 172.21.15.5:0/598927641 >> v2:172.21.15.112:3300/0 conn(0x7f20dc15ab10 0x7f20dc15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 -- 172.21.15.5:0/598927641 >> 172.21.15.5:0/598927641 conn(0x7f20dc06dae0 msgr2=0x7f20dc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 -- 172.21.15.5:0/598927641 shutdown_connections 2023-10-16T13:48:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.162+0000 7f20e204f700 1 -- 172.21.15.5:0/598927641 wait complete. 2023-10-16T13:48:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.163+0000 7f20e204f700 1 Processor -- start 2023-10-16T13:48:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.163+0000 7f20e204f700 1 -- start start 2023-10-16T13:48:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20e204f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 0x7f20dc0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20e204f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc0cfe30 0x7f20dc14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20e204f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc15ab10 0x7f20dc0c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20e204f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc1f4a10 con 0x7f20dc0b1f50 2023-10-16T13:48:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20e204f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0c71c0 con 0x7f20dc0cfe30 2023-10-16T13:48:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20e204f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc1f4c60 con 0x7f20dc15ab10 2023-10-16T13:48:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 0x7f20dc0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 0x7f20dc0c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49118/0 (socket says 172.21.15.5:49118) 2023-10-16T13:48:36.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 -- 172.21.15.5:0/3373356835 learned_addr learned my addr 172.21.15.5:0/3373356835 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:36.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20daffd700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc0cfe30 0x7f20dc14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20dbfff700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc15ab10 0x7f20dc0c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 -- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc15ab10 msgr2=0x7f20dc0c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc15ab10 0x7f20dc0c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 -- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc0cfe30 msgr2=0x7f20dc14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc0cfe30 0x7f20dc14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20db7fe700 1 -- 172.21.15.5:0/3373356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4009a70 con 0x7f20dc0b1f50 2023-10-16T13:48:36.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20daffd700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc0cfe30 0x7f20dc14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.164+0000 7f20dbfff700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc15ab10 0x7f20dc0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.165+0000 7f20db7fe700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 0x7f20dc0c6bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f20d000c7f0 tx=0x7f20d000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.165+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0011800 con 0x7f20dc0b1f50 2023-10-16T13:48:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.165+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0011960 con 0x7f20dc0b1f50 2023-10-16T13:48:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.165+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0011cf0 con 0x7f20dc0b1f50 2023-10-16T13:48:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.165+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc1f4f40 con 0x7f20dc0b1f50 2023-10-16T13:48:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.165+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc0c55f0 con 0x7f20dc0b1f50 2023-10-16T13:48:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.166+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc067d20 con 0x7f20dc0b1f50 2023-10-16T13:48:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.166+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f20d0018360 con 0x7f20dc0b1f50 2023-10-16T13:48:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.167+0000 7f20c3fff700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20c806b2f0 0x7f20c806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.167+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20d0089e20 con 0x7f20dc0b1f50 2023-10-16T13:48:36.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.167+0000 7f20daffd700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20c806b2f0 0x7f20c806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.167+0000 7f20daffd700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20c806b2f0 0x7f20c806d7b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0ca630 tx=0x7f20cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.172+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20d00547f0 con 0x7f20dc0b1f50 2023-10-16T13:48:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.376+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20dc0afc10 con 0x7f20dc0b1f50 2023-10-16T13:48:36.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.376+0000 7f20c3fff700 1 -- 172.21.15.5:0/3373356835 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20d001f020 con 0x7f20dc0b1f50 2023-10-16T13:48:36.379 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:48:36.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20c806b2f0 msgr2=0x7f20c806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20c806b2f0 0x7f20c806d7b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0ca630 tx=0x7f20cc009040 comp rx=0 tx=0).stop 2023-10-16T13:48:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 msgr2=0x7f20dc0c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 0x7f20dc0c6bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f20d000c7f0 tx=0x7f20d000cbb0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 shutdown_connections 2023-10-16T13:48:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f20c806b2f0 0x7f20c806d7b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20dc15ab10 0x7f20dc0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20dc0b1f50 0x7f20dc0c6bc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 --2- 172.21.15.5:0/3373356835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20dc0cfe30 0x7f20dc14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 >> 172.21.15.5:0/3373356835 conn(0x7f20dc06dae0 msgr2=0x7f20dc159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 shutdown_connections 2023-10-16T13:48:36.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.378+0000 7f20e204f700 1 -- 172.21.15.5:0/3373356835 wait complete. 2023-10-16T13:48:36.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.516+0000 7fb4fb978700 1 Processor -- start 2023-10-16T13:48:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4fb978700 1 -- start start 2023-10-16T13:48:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4fb978700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f415ab10 0x7fb4f415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4fb978700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4f40cfe30 0x7fb4f40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4fb978700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f415e7a0 con 0x7fb4f40b1f50 2023-10-16T13:48:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4fb978700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f415f730 con 0x7fb4f40cfe30 2023-10-16T13:48:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4fb978700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b29a0 con 0x7fb4f415ab10 2023-10-16T13:48:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.517+0000 7fb4f9f15700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4f40cfe30 0x7fb4f40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4f40cfe30 0x7fb4f40cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49130/0 (socket says 172.21.15.5:49130) 2023-10-16T13:48:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3458706961 learned_addr learned my addr 172.21.15.5:0/3458706961 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9714700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f415ab10 0x7fb4f415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3458706961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f415ab10 msgr2=0x7fb4f415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f415ab10 0x7fb4f415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3458706961 >> v1:172.21.15.112:6789/0 conn(0x7fb4f40b1f50 legacy=0x7fb4f40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3458706961 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40b2c80 con 0x7fb4f40cfe30 2023-10-16T13:48:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9714700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f415ab10 0x7fb4f415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4f9f15700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f40cfe30 0x7fb4f40cbf40 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009e50 tx=0x7fb4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2b8a550a639518 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4e7fff700 1 -- 172.21.15.5:0/3458706961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00e070 con 0x7fb4f40cfe30 2023-10-16T13:48:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4e7fff700 1 -- 172.21.15.5:0/3458706961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec00b9c0 con 0x7fb4f40cfe30 2023-10-16T13:48:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.518+0000 7fb4e7fff700 1 -- 172.21.15.5:0/3458706961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00bd70 con 0x7fb4f40cfe30 2023-10-16T13:48:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 -- 172.21.15.5:0/3458706961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f40cfe30 msgr2=0x7fb4f40cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f40cfe30 0x7fb4f40cbf40 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009e50 tx=0x7fb4ec00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 -- 172.21.15.5:0/3458706961 shutdown_connections 2023-10-16T13:48:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f40cfe30 0x7fb4f40cbf40 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3458706961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f415ab10 0x7fb4f415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 -- 172.21.15.5:0/3458706961 >> 172.21.15.5:0/3458706961 conn(0x7fb4f406dae0 msgr2=0x7fb4f406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 -- 172.21.15.5:0/3458706961 shutdown_connections 2023-10-16T13:48:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.519+0000 7fb4fb978700 1 -- 172.21.15.5:0/3458706961 wait complete. 2023-10-16T13:48:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.520+0000 7fb4fb978700 1 Processor -- start 2023-10-16T13:48:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.520+0000 7fb4fb978700 1 -- start start 2023-10-16T13:48:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4fb978700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4f40b1f50 0x7fb4f4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4fb978700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f40cfe30 0x7fb4f415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4fb978700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 0x7fb4f415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4fb978700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4156430 con 0x7fb4f415ab10 2023-10-16T13:48:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4fb978700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415b430 con 0x7fb4f40b1f50 2023-10-16T13:48:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4fb978700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415b6d0 con 0x7fb4f40cfe30 2023-10-16T13:48:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 0x7fb4f415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 0x7fb4f415c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49136/0 (socket says 172.21.15.5:49136) 2023-10-16T13:48:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3387323372 learned_addr learned my addr 172.21.15.5:0/3387323372 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f8f13700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f40cfe30 0x7fb4f415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9714700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4f40b1f50 0x7fb4f4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f40cfe30 msgr2=0x7fb4f415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f40cfe30 0x7fb4f415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4f40b1f50 msgr2=0x7fb4f4155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4f40b1f50 0x7fb4f4155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 -- 172.21.15.5:0/3387323372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec009b30 con 0x7fb4f415ab10 2023-10-16T13:48:36.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.521+0000 7fb4f9f15700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 0x7fb4f415c780 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec012000 tx=0x7fb4ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.522+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0092e0 con 0x7fb4f415ab10 2023-10-16T13:48:36.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.522+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec004960 con 0x7fb4f415ab10 2023-10-16T13:48:36.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.522+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f415b9b0 con 0x7fb4f415ab10 2023-10-16T13:48:36.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.522+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec01c680 con 0x7fb4f415ab10 2023-10-16T13:48:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.522+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40c7640 con 0x7fb4f415ab10 2023-10-16T13:48:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.523+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f40c7860 con 0x7fb4f415ab10 2023-10-16T13:48:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.523+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fb4ec01c7e0 con 0x7fb4f415ab10 2023-10-16T13:48:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.524+0000 7fb4e5ffb700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b2f0 0x7fb4d806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.524+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4ec08bbb0 con 0x7fb4f415ab10 2023-10-16T13:48:36.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.524+0000 7fb4f9714700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b2f0 0x7fb4d806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.524+0000 7fb4f9714700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b2f0 0x7fb4d806d7b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0006fd0 tx=0x7fb4f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.528+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4ec056600 con 0x7fb4f415ab10 2023-10-16T13:48:36.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.775+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f4067d20 con 0x7fb4f415ab10 2023-10-16T13:48:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.775+0000 7fb4e5ffb700 1 -- 172.21.15.5:0/3387323372 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4915 (secure 0 0 0) 0x7fb4ec059c20 con 0x7fb4f415ab10 2023-10-16T13:48:36.778 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:36.779 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:19.692644+0000","modified":"2023-10-16T13:48:22.708850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2462371397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2462371397},{"type":"v1","addr":"172.21.15.5:6835","nonce":2462371397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-16T13:48:36.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b2f0 msgr2=0x7fb4d806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b2f0 0x7fb4d806d7b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0006fd0 tx=0x7fb4f0008040 comp rx=0 tx=0).stop 2023-10-16T13:48:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 msgr2=0x7fb4f415c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 0x7fb4f415c780 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec012000 tx=0x7fb4ec004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 shutdown_connections 2023-10-16T13:48:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415ab10 0x7fb4f415c780 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4f40b1f50 0x7fb4f4155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb4d806b2f0 0x7fb4d806d7b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 --2- 172.21.15.5:0/3387323372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4f40cfe30 0x7fb4f415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 >> 172.21.15.5:0/3387323372 conn(0x7fb4f406dae0 msgr2=0x7fb4f4159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 shutdown_connections 2023-10-16T13:48:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.777+0000 7fb4fb978700 1 -- 172.21.15.5:0/3387323372 wait complete. 2023-10-16T13:48:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 71 2023-10-16T13:48:36.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:36.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.914+0000 7fdfe1a29700 1 Processor -- start 2023-10-16T13:48:36.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.914+0000 7fdfe1a29700 1 -- start start 2023-10-16T13:48:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.915+0000 7fdfe1a29700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfdc15dbc0 0x7fdfdc15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.915+0000 7fdfe1a29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.915+0000 7fdfe1a29700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc15e4e0 con 0x7fdfdc0b7050 2023-10-16T13:48:36.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.915+0000 7fdfe1a29700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b7560 con 0x7fdfdc15dbc0 2023-10-16T13:48:36.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.915+0000 7fdfe1a29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b7840 con 0x7fdfdc0d3fc0 2023-10-16T13:48:36.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfdc15dbc0 0x7fdfdc15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdb7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdfdc0b7050 0x7fdfdc0d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59148/0 (socket says 172.21.15.5:59148) 2023-10-16T13:48:36.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdb7fe700 1 -- 172.21.15.5:0/2908291365 learned_addr learned my addr 172.21.15.5:0/2908291365 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:36.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfda7fc700 1 --2- 172.21.15.5:0/2908291365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdaffd700 1 -- 172.21.15.5:0/2908291365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 msgr2=0x7fdfdc0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:36.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdaffd700 1 --2- 172.21.15.5:0/2908291365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdaffd700 1 -- 172.21.15.5:0/2908291365 >> v1:172.21.15.5:6789/0 conn(0x7fdfdc0b7050 legacy=0x7fdfdc0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdaffd700 1 -- 172.21.15.5:0/2908291365 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0b7b20 con 0x7fdfdc15dbc0 2023-10-16T13:48:36.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfd9ffb700 1 -- 172.21.15.5:0/2908291365 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398729573 0 0) 0x7fdfdc15e4e0 con 0x7fdfdc0b7050 2023-10-16T13:48:36.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfdaffd700 1 --2- 172.21.15.5:0/2908291365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15dfa0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009820 tx=0x7fdfc4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7daef918de47485 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfd9ffb700 1 -- 172.21.15.5:0/2908291365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4005e30 con 0x7fdfdc15dbc0 2023-10-16T13:48:36.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfd9ffb700 1 -- 172.21.15.5:0/2908291365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc4006030 con 0x7fdfdc15dbc0 2023-10-16T13:48:36.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.916+0000 7fdfd9ffb700 1 -- 172.21.15.5:0/2908291365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40063c0 con 0x7fdfdc15dbc0 2023-10-16T13:48:36.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 -- 172.21.15.5:0/2908291365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc15dbc0 msgr2=0x7fdfdc15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/2908291365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15dfa0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009820 tx=0x7fdfc4009b30 comp rx=0 tx=0).stop 2023-10-16T13:48:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 -- 172.21.15.5:0/2908291365 shutdown_connections 2023-10-16T13:48:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/2908291365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15dfa0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/2908291365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 -- 172.21.15.5:0/2908291365 >> 172.21.15.5:0/2908291365 conn(0x7fdfdc09cb40 msgr2=0x7fdfdc0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 -- 172.21.15.5:0/2908291365 shutdown_connections 2023-10-16T13:48:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.917+0000 7fdfe1a29700 1 -- 172.21.15.5:0/2908291365 wait complete. 2023-10-16T13:48:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.918+0000 7fdfe1a29700 1 Processor -- start 2023-10-16T13:48:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.919+0000 7fdfe1a29700 1 -- start start 2023-10-16T13:48:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.919+0000 7fdfe1a29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 0x7fdfdc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.919+0000 7fdfe1a29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc1f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfe1a29700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfe1a29700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1f77c0 con 0x7fdfdc0b7050 2023-10-16T13:48:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfe1a29700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0ca100 con 0x7fdfdc15dbc0 2023-10-16T13:48:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfe1a29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc14c7c0 con 0x7fdfdc0d3fc0 2023-10-16T13:48:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 0x7fdfdc0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 0x7fdfdc0c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49146/0 (socket says 172.21.15.5:49146) 2023-10-16T13:48:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 -- 172.21.15.5:0/1703049703 learned_addr learned my addr 172.21.15.5:0/1703049703 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfda7fc700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc1f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 -- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 msgr2=0x7fdfdc1f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc1f7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdb7fe700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 -- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfdc15dbc0 msgr2=0x7fdfdc15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 -- 172.21.15.5:0/1703049703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009430 con 0x7fdfdc0b7050 2023-10-16T13:48:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfdaffd700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 0x7fdfdc0c9a40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009b70 tx=0x7fdfc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4004250 con 0x7fdfdc0b7050 2023-10-16T13:48:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc40043b0 con 0x7fdfdc0b7050 2023-10-16T13:48:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc14ca60 con 0x7fdfdc0b7050 2023-10-16T13:48:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4006940 con 0x7fdfdc0b7050 2023-10-16T13:48:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.920+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc14d020 con 0x7fdfdc0b7050 2023-10-16T13:48:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.921+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc04ebb0 con 0x7fdfdc0b7050 2023-10-16T13:48:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.922+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fdfc4022070 con 0x7fdfdc0b7050 2023-10-16T13:48:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.922+0000 7fdfd3fff700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdfbc06b2f0 0x7fdfbc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.922+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfc408b410 con 0x7fdfdc0b7050 2023-10-16T13:48:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.923+0000 7fdfda7fc700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdfbc06b2f0 0x7fdfbc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.923+0000 7fdfda7fc700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdfbc06b2f0 0x7fdfbc06d7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc14f1f0 tx=0x7fdfcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:36.927+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdfc4056080 con 0x7fdfdc0b7050 2023-10-16T13:48:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.127+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfdc0b5d10 con 0x7fdfdc0b7050 2023-10-16T13:48:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.128+0000 7fdfd3fff700 1 -- 172.21.15.5:0/1703049703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16444 (secure 0 0 0) 0x7fdfc40596a0 con 0x7fdfdc0b7050 2023-10-16T13:48:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:37.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:21.283240+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdfbc06b2f0 msgr2=0x7fdfbc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdfbc06b2f0 0x7fdfbc06d7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc14f1f0 tx=0x7fdfcc008040 comp rx=0 tx=0).stop 2023-10-16T13:48:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 msgr2=0x7fdfdc0c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 0x7fdfdc0c9a40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009b70 tx=0x7fdfc4004750 comp rx=0 tx=0).stop 2023-10-16T13:48:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 shutdown_connections 2023-10-16T13:48:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfdc15dbc0 0x7fdfdc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfdc0b7050 0x7fdfdc0c9a40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdfbc06b2f0 0x7fdfbc06d7b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 --2- 172.21.15.5:0/1703049703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfdc0d3fc0 0x7fdfdc1f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.130+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 >> 172.21.15.5:0/1703049703 conn(0x7fdfdc09cb40 msgr2=0x7fdfdc15ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.131+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 shutdown_connections 2023-10-16T13:48:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.131+0000 7fdfe1a29700 1 -- 172.21.15.5:0/1703049703 wait complete. 2023-10-16T13:48:37.146 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:48:37.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.268+0000 7faaeb840700 1 Processor -- start 2023-10-16T13:48:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.268+0000 7faaeb840700 1 -- start start 2023-10-16T13:48:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faaeb840700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faae415ab10 0x7faae415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faaeb840700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faae40cfe30 0x7faae40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faaeb840700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae415e7a0 con 0x7faae40b1f50 2023-10-16T13:48:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faaeb840700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae415f730 con 0x7faae415ab10 2023-10-16T13:48:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faaeb840700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae40b29a0 con 0x7faae40cfe30 2023-10-16T13:48:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae95dc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faae415ab10 0x7faae415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae8ddb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faae40b1f50 0x7faae40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59158/0 (socket says 172.21.15.5:59158) 2023-10-16T13:48:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae8ddb700 1 -- 172.21.15.5:0/3146994151 learned_addr learned my addr 172.21.15.5:0/3146994151 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae9ddd700 1 --2- 172.21.15.5:0/3146994151 >> v2:172.21.15.112:3300/0 conn(0x7faae40cfe30 0x7faae40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae95dc700 1 -- 172.21.15.5:0/3146994151 >> v2:172.21.15.112:3300/0 conn(0x7faae40cfe30 msgr2=0x7faae40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae95dc700 1 --2- 172.21.15.5:0/3146994151 >> v2:172.21.15.112:3300/0 conn(0x7faae40cfe30 0x7faae40cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae95dc700 1 -- 172.21.15.5:0/3146994151 >> v1:172.21.15.5:6789/0 conn(0x7faae40b1f50 legacy=0x7faae40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae95dc700 1 -- 172.21.15.5:0/3146994151 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40b2c80 con 0x7faae415ab10 2023-10-16T13:48:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faadbfff700 1 -- 172.21.15.5:0/3146994151 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574525369 0 0) 0x7faae415e7a0 con 0x7faae40b1f50 2023-10-16T13:48:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.269+0000 7faae95dc700 1 --2- 172.21.15.5:0/3146994151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae415ab10 0x7faae415f1f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7faae40d03e0 tx=0x7faae000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0645f7459e9fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faadbfff700 1 -- 172.21.15.5:0/3146994151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000dc70 con 0x7faae415ab10 2023-10-16T13:48:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faadbfff700 1 -- 172.21.15.5:0/3146994151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae000ddd0 con 0x7faae415ab10 2023-10-16T13:48:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faadbfff700 1 -- 172.21.15.5:0/3146994151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0010690 con 0x7faae415ab10 2023-10-16T13:48:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 -- 172.21.15.5:0/3146994151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae415ab10 msgr2=0x7faae415f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 --2- 172.21.15.5:0/3146994151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae415ab10 0x7faae415f1f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7faae40d03e0 tx=0x7faae000bdc0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 -- 172.21.15.5:0/3146994151 shutdown_connections 2023-10-16T13:48:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 --2- 172.21.15.5:0/3146994151 >> v2:172.21.15.112:3300/0 conn(0x7faae40cfe30 0x7faae40cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 --2- 172.21.15.5:0/3146994151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae415ab10 0x7faae415f1f0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 -- 172.21.15.5:0/3146994151 >> 172.21.15.5:0/3146994151 conn(0x7faae406dae0 msgr2=0x7faae406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 -- 172.21.15.5:0/3146994151 shutdown_connections 2023-10-16T13:48:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.270+0000 7faaeb840700 1 -- 172.21.15.5:0/3146994151 wait complete. 2023-10-16T13:48:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.271+0000 7faaeb840700 1 Processor -- start 2023-10-16T13:48:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 -- start start 2023-10-16T13:48:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 0x7faae41eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faae40cfe30 0x7faae40b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae415ab10 0x7faae40b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae415dbd0 con 0x7faae40b1f50 2023-10-16T13:48:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae415cf50 con 0x7faae415ab10 2023-10-16T13:48:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faaeb840700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae415d230 con 0x7faae40cfe30 2023-10-16T13:48:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faae95dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 0x7faae41eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faae95dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 0x7faae41eed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49158/0 (socket says 172.21.15.5:49158) 2023-10-16T13:48:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.272+0000 7faae95dc700 1 -- 172.21.15.5:0/837129411 learned_addr learned my addr 172.21.15.5:0/837129411 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faae95dc700 1 -- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faae40cfe30 msgr2=0x7faae40b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faae95dc700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faae40cfe30 0x7faae40b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faae95dc700 1 -- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae415ab10 msgr2=0x7faae40b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faae95dc700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae415ab10 0x7faae40b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faae95dc700 1 -- 172.21.15.5:0/837129411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae000b740 con 0x7faae40b1f50 2023-10-16T13:48:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faae95dc700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 0x7faae41eed50 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c00 tx=0x7faae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae001d070 con 0x7faae40b1f50 2023-10-16T13:48:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae0003a60 con 0x7faae40b1f50 2023-10-16T13:48:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae415d510 con 0x7faae40b1f50 2023-10-16T13:48:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0003e10 con 0x7faae40b1f50 2023-10-16T13:48:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.273+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae41ef290 con 0x7faae40b1f50 2023-10-16T13:48:37.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.274+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae40cdeb0 con 0x7faae40b1f50 2023-10-16T13:48:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.274+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7faae0019400 con 0x7faae40b1f50 2023-10-16T13:48:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.275+0000 7faad9ffb700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faac806b2f0 0x7faac806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.275+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faae008b240 con 0x7faae40b1f50 2023-10-16T13:48:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.275+0000 7faae8ddb700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faac806b2f0 0x7faac806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.276+0000 7faae8ddb700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faac806b2f0 0x7faac806d7b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faad4007fd0 tx=0x7faad40079a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.280+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faae0055c00 con 0x7faae40b1f50 2023-10-16T13:48:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.524+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faae40b6140 con 0x7faae40b1f50 2023-10-16T13:48:37.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.525+0000 7faad9ffb700 1 -- 172.21.15.5:0/837129411 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4915 (secure 0 0 0) 0x7faae40b6140 con 0x7faae40b1f50 2023-10-16T13:48:37.528 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:37.528 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:19.692644+0000","modified":"2023-10-16T13:48:22.708850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2462371397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2462371397},{"type":"v1","addr":"172.21.15.5:6835","nonce":2462371397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-16T13:48:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faac806b2f0 msgr2=0x7faac806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faac806b2f0 0x7faac806d7b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faad4007fd0 tx=0x7faad40079a0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 msgr2=0x7faae41eed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 0x7faae41eed50 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c00 tx=0x7faae0004750 comp rx=0 tx=0).stop 2023-10-16T13:48:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 shutdown_connections 2023-10-16T13:48:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae415ab10 0x7faae40b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae40b1f50 0x7faae41eed50 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faac806b2f0 0x7faac806d7b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 --2- 172.21.15.5:0/837129411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faae40cfe30 0x7faae40b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 >> 172.21.15.5:0/837129411 conn(0x7faae406dae0 msgr2=0x7faae406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 shutdown_connections 2023-10-16T13:48:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.527+0000 7faaeb840700 1 -- 172.21.15.5:0/837129411 wait complete. 2023-10-16T13:48:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 71 2023-10-16T13:48:37.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.663+0000 7f3494c71700 1 Processor -- start 2023-10-16T13:48:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.663+0000 7f3494c71700 1 -- start start 2023-10-16T13:48:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.664+0000 7f3494c71700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34900cda40 0x7f34900caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.664+0000 7f3494c71700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900cee20 con 0x7f349015d840 2023-10-16T13:48:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.664+0000 7f3494c71700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900b2ce0 con 0x7f3490162070 2023-10-16T13:48:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.664+0000 7f3494c71700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900ceb40 con 0x7f34900cda40 2023-10-16T13:48:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.664+0000 7f348e59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f349015d840 0x7f34900cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59170/0 (socket says 172.21.15.5:59170) 2023-10-16T13:48:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.664+0000 7f348e59c700 1 -- 172.21.15.5:0/3695482409 learned_addr learned my addr 172.21.15.5:0/3695482409 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348ed9d700 1 --2- 172.21.15.5:0/3695482409 >> v2:172.21.15.112:3300/0 conn(0x7f34900cda40 0x7f34900caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052164197 0 0) 0x7f34900cee20 con 0x7f349015d840 2023-10-16T13:48:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34780035b0 con 0x7f349015d840 2023-10-16T13:48:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3804735329 0 0) 0x7f34780035b0 con 0x7f349015d840 2023-10-16T13:48:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 >> v2:172.21.15.112:3300/0 conn(0x7f34900cda40 msgr2=0x7f34900caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 --2- 172.21.15.5:0/3695482409 >> v2:172.21.15.112:3300/0 conn(0x7f34900cda40 0x7f34900caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 >> v1:172.21.15.112:6789/0 conn(0x7f3490162070 legacy=0x7f34900cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490161590 con 0x7f349015d840 2023-10-16T13:48:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f3484001670 con 0x7f349015d840 2023-10-16T13:48:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 >> v1:172.21.15.5:6789/0 conn(0x7f349015d840 legacy=0x7f34900cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f3478003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3478004850 0x7f3478004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3478005210 0x7f347800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ceb40 con 0x7f3478003a00 2023-10-16T13:48:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347800c0b0 con 0x7f3478005210 2023-10-16T13:48:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347800c270 con 0x7f3478004850 2023-10-16T13:48:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348e59c700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f3478003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348ed9d700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3478005210 0x7f347800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348dd9b700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3478004850 0x7f3478004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348e59c700 1 -- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3478004850 msgr2=0x7f3478004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348e59c700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3478004850 0x7f3478004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348e59c700 1 -- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3478005210 msgr2=0x7f347800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348e59c700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3478005210 0x7f347800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348e59c700 1 -- 172.21.15.5:0/3695482409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780035b0 con 0x7f3478003a00 2023-10-16T13:48:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348ed9d700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3478005210 0x7f347800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.665+0000 7f348ed9d700 1 -- 172.21.15.5:0/3695482409 reap_dead start 2023-10-16T13:48:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f348e59c700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f3478003e20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f348400c240 tx=0x7f3478005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e752862c188b683 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484007c10 con 0x7f3478003a00 2023-10-16T13:48:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400cde0 con 0x7f3478003a00 2023-10-16T13:48:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f348d59a700 1 -- 172.21.15.5:0/3695482409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484005ba0 con 0x7f3478003a00 2023-10-16T13:48:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 -- 172.21.15.5:0/3695482409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 msgr2=0x7f3478003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f3478003e20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f348400c240 tx=0x7f3478005880 comp rx=0 tx=0).stop 2023-10-16T13:48:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 -- 172.21.15.5:0/3695482409 shutdown_connections 2023-10-16T13:48:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 --2- 172.21.15.5:0/3695482409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f3478003e20 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 -- 172.21.15.5:0/3695482409 >> 172.21.15.5:0/3695482409 conn(0x7f349006bd70 msgr2=0x7f349006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 -- 172.21.15.5:0/3695482409 shutdown_connections 2023-10-16T13:48:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.666+0000 7f3494c71700 1 -- 172.21.15.5:0/3695482409 wait complete. 2023-10-16T13:48:37.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.668+0000 7f3494c71700 1 Processor -- start 2023-10-16T13:48:37.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.668+0000 7f3494c71700 1 -- start start 2023-10-16T13:48:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f34900b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34900af030 0x7f3490147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34900af4b0 0x7f3490147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490156900 con 0x7f3478003a00 2023-10-16T13:48:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900b35f0 con 0x7f34900af030 2023-10-16T13:48:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900b5930 con 0x7f34900af4b0 2023-10-16T13:48:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f34900b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f34900b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49178/0 (socket says 172.21.15.5:49178) 2023-10-16T13:48:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 -- 172.21.15.5:0/1332568720 learned_addr learned my addr 172.21.15.5:0/1332568720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348dd9b700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34900af030 0x7f3490147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348ed9d700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34900af4b0 0x7f3490147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 -- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34900af4b0 msgr2=0x7f3490147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34900af4b0 0x7f3490147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 -- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34900af030 msgr2=0x7f3490147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34900af030 0x7f3490147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 -- 172.21.15.5:0/1332568720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900b5c10 con 0x7f3478003a00 2023-10-16T13:48:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348dd9b700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34900af030 0x7f3490147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f348e59c700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f34900b30b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f347800c080 tx=0x7f3484001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484001640 con 0x7f3478003a00 2023-10-16T13:48:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840070d0 con 0x7f3478003a00 2023-10-16T13:48:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3490156900 con 0x7f3478003a00 2023-10-16T13:48:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.669+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840074a0 con 0x7f3478003a00 2023-10-16T13:48:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.670+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900b5ef0 con 0x7f3478003a00 2023-10-16T13:48:37.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.671+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3490156be0 con 0x7f3478003a00 2023-10-16T13:48:37.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.671+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f3484007600 con 0x7f3478003a00 2023-10-16T13:48:37.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.671+0000 7f347effd700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f347006b2f0 0x7f347006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:37.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.671+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348408b0f0 con 0x7f3478003a00 2023-10-16T13:48:37.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.672+0000 7f348dd9b700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f347006b2f0 0x7f347006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:37.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.672+0000 7f348dd9b700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f347006b2f0 0x7f347006d7b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f349014b630 tx=0x7f3480009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.676+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3484055b90 con 0x7f3478003a00 2023-10-16T13:48:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.920+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3490067d20 con 0x7f3478003a00 2023-10-16T13:48:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.920+0000 7f347effd700 1 -- 172.21.15.5:0/1332568720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f3484007d70 con 0x7f3478003a00 2023-10-16T13:48:37.923 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:37.924 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:19.692644+0000","modified":"2023-10-16T13:48:22.708850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2462371397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2462371397},{"type":"v1","addr":"172.21.15.5:6835","nonce":2462371397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-16T13:48:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f347006b2f0 msgr2=0x7f347006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f347006b2f0 0x7f347006d7b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f349014b630 tx=0x7f3480009040 comp rx=0 tx=0).stop 2023-10-16T13:48:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 msgr2=0x7f34900b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f34900b30b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f347800c080 tx=0x7f3484001a00 comp rx=0 tx=0).stop 2023-10-16T13:48:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 shutdown_connections 2023-10-16T13:48:37.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f347006b2f0 0x7f347006d7b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34900af4b0 0x7f3490147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3478003a00 0x7f34900b30b0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 --2- 172.21.15.5:0/1332568720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34900af030 0x7f3490147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:37.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 >> 172.21.15.5:0/1332568720 conn(0x7f349006bd70 msgr2=0x7f349015b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:37.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.922+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 shutdown_connections 2023-10-16T13:48:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:37.923+0000 7f3494c71700 1 -- 172.21.15.5:0/1332568720 wait complete. 2023-10-16T13:48:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 71 2023-10-16T13:48:37.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 Processor -- start 2023-10-16T13:48:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 -- start start 2023-10-16T13:48:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 0x7f714015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71400d3fc0 0x7f71400d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714015e4e0 con 0x7f71400b7050 2023-10-16T13:48:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400b7560 con 0x7f71400d3fc0 2023-10-16T13:48:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.060+0000 7f71454ae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400b7840 con 0x7f714015dbc0 2023-10-16T13:48:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 0x7f714015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713e7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71400d3fc0 0x7f71400d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713f7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f71400b7050 0x7f71400d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50170/0 (socket says 172.21.15.5:50170) 2023-10-16T13:48:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 0x7f714015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:47090/0 (socket says 172.21.15.5:47090) 2023-10-16T13:48:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713e7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71400d3fc0 0x7f71400d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:45082/0 (socket says 172.21.15.5:45082) 2023-10-16T13:48:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713f7fe700 1 -- 172.21.15.5:0/3589050690 learned_addr learned my addr 172.21.15.5:0/3589050690 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 -- 172.21.15.5:0/3589050690 >> v2:172.21.15.112:3300/0 conn(0x7f71400d3fc0 msgr2=0x7f71400d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 --2- 172.21.15.5:0/3589050690 >> v2:172.21.15.112:3300/0 conn(0x7f71400d3fc0 0x7f71400d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 -- 172.21.15.5:0/3589050690 >> v1:172.21.15.112:6789/0 conn(0x7f71400b7050 legacy=0x7f71400d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 -- 172.21.15.5:0/3589050690 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400b7b20 con 0x7f714015dbc0 2023-10-16T13:48:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713effd700 1 --2- 172.21.15.5:0/3589050690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 0x7f714015dfa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7130009820 tx=0x7f7130009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8ad016c49c06e05 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713dffb700 1 -- 172.21.15.5:0/3589050690 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130005e30 con 0x7f714015dbc0 2023-10-16T13:48:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713dffb700 1 -- 172.21.15.5:0/3589050690 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130006030 con 0x7f714015dbc0 2023-10-16T13:48:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.061+0000 7f713dffb700 1 -- 172.21.15.5:0/3589050690 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300063c0 con 0x7f714015dbc0 2023-10-16T13:48:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 -- 172.21.15.5:0/3589050690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 msgr2=0x7f714015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 --2- 172.21.15.5:0/3589050690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 0x7f714015dfa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7130009820 tx=0x7f7130009b30 comp rx=0 tx=0).stop 2023-10-16T13:48:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 -- 172.21.15.5:0/3589050690 shutdown_connections 2023-10-16T13:48:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 --2- 172.21.15.5:0/3589050690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f714015dbc0 0x7f714015dfa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 --2- 172.21.15.5:0/3589050690 >> v2:172.21.15.112:3300/0 conn(0x7f71400d3fc0 0x7f71400d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 -- 172.21.15.5:0/3589050690 >> 172.21.15.5:0/3589050690 conn(0x7f714009cb40 msgr2=0x7f71400d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 -- 172.21.15.5:0/3589050690 shutdown_connections 2023-10-16T13:48:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.062+0000 7f71454ae700 1 -- 172.21.15.5:0/3589050690 wait complete. 2023-10-16T13:48:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.063+0000 7f71454ae700 1 Processor -- start 2023-10-16T13:48:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 -- start start 2023-10-16T13:48:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71400b7050 0x7f714015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71400d3fc0 0x7f714015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 0x7f714006c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714015c310 con 0x7f714015dbc0 2023-10-16T13:48:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714015b690 con 0x7f71400b7050 2023-10-16T13:48:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f71454ae700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714015b970 con 0x7f71400d3fc0 2023-10-16T13:48:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f713f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 0x7f714006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f713f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 0x7f714006c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49196/0 (socket says 172.21.15.5:49196) 2023-10-16T13:48:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.064+0000 7f713f7fe700 1 -- 172.21.15.5:0/1462237369 learned_addr learned my addr 172.21.15.5:0/1462237369 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713effd700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71400b7050 0x7f714015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713e7fc700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71400d3fc0 0x7f714015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713f7fe700 1 -- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71400d3fc0 msgr2=0x7f714015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713f7fe700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71400d3fc0 0x7f714015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713f7fe700 1 -- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71400b7050 msgr2=0x7f714015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713f7fe700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71400b7050 0x7f714015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713f7fe700 1 -- 172.21.15.5:0/1462237369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130009430 con 0x7f714015dbc0 2023-10-16T13:48:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f713f7fe700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 0x7f714006c490 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f713800caf0 tx=0x7f713800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800a9e0 con 0x7f714015dbc0 2023-10-16T13:48:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713800ab40 con 0x7f714015dbc0 2023-10-16T13:48:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714015bc50 con 0x7f714015dbc0 2023-10-16T13:48:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138012400 con 0x7f714015dbc0 2023-10-16T13:48:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.065+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714015c730 con 0x7f714015dbc0 2023-10-16T13:48:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.066+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714015be40 con 0x7f714015dbc0 2023-10-16T13:48:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.067+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f713801b3b0 con 0x7f714015dbc0 2023-10-16T13:48:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.067+0000 7f71377fe700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f712006b2f0 0x7f712006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.067+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7138089830 con 0x7f714015dbc0 2023-10-16T13:48:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.067+0000 7f713effd700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f712006b2f0 0x7f712006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.068+0000 7f713effd700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f712006b2f0 0x7f712006d7b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7130000c00 tx=0x7f7130008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.072+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7138054330 con 0x7f714015dbc0 2023-10-16T13:48:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.272+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f714015c040 con 0x7f714015dbc0 2023-10-16T13:48:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.274+0000 7f71377fe700 1 -- 172.21.15.5:0/1462237369 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16444 (secure 0 0 0) 0x7f7138057950 con 0x7f714015dbc0 2023-10-16T13:48:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:38.277 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:21.283240+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:18.181024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:18.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f712006b2f0 msgr2=0x7f712006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f712006b2f0 0x7f712006d7b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7130000c00 tx=0x7f7130008070 comp rx=0 tx=0).stop 2023-10-16T13:48:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 msgr2=0x7f714006c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 0x7f714006c490 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f713800caf0 tx=0x7f713800ce00 comp rx=0 tx=0).stop 2023-10-16T13:48:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 shutdown_connections 2023-10-16T13:48:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714015dbc0 0x7f714006c490 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71400b7050 0x7f714015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f712006b2f0 0x7f712006d7b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 --2- 172.21.15.5:0/1462237369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71400d3fc0 0x7f714015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 >> 172.21.15.5:0/1462237369 conn(0x7f714009cb40 msgr2=0x7f71400b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 shutdown_connections 2023-10-16T13:48:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.276+0000 7f71454ae700 1 -- 172.21.15.5:0/1462237369 wait complete. 2023-10-16T13:48:38.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:48:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.414+0000 7f63261da700 1 Processor -- start 2023-10-16T13:48:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f63261da700 1 -- start start 2023-10-16T13:48:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f63261da700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 0x7f63200b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f63261da700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632006cb70 con 0x7f63200cfc00 2023-10-16T13:48:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f63261da700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632006ce50 con 0x7f632015e0c0 2023-10-16T13:48:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f63261da700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200cbc40 con 0x7f632015dce0 2023-10-16T13:48:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f631ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63200cfc00 0x7f63200cc090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59206/0 (socket says 172.21.15.5:59206) 2023-10-16T13:48:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.415+0000 7f631ffff700 1 -- 172.21.15.5:0/672800189 learned_addr learned my addr 172.21.15.5:0/672800189 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631f7fe700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 0x7f63200b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266739822 0 0) 0x7f632006cb70 con 0x7f63200cfc00 2023-10-16T13:48:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63080035b0 con 0x7f63200cfc00 2023-10-16T13:48:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4158625612 0 0) 0x7f63080035b0 con 0x7f63200cfc00 2023-10-16T13:48:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 msgr2=0x7f63200b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 0x7f63200b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 >> v1:172.21.15.112:6789/0 conn(0x7f632015e0c0 legacy=0x7f63200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632006d130 con 0x7f63200cfc00 2023-10-16T13:48:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f63180019f0 con 0x7f63200cfc00 2023-10-16T13:48:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 >> v1:172.21.15.5:6789/0 conn(0x7f63200cfc00 legacy=0x7f63200cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6308003a30 0x7f6308003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 0x7f6308004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6308004d90 0x7f6308005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200cbc40 con 0x7f6308004d90 2023-10-16T13:48:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630800baf0 con 0x7f6308003a30 2023-10-16T13:48:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630800bcb0 con 0x7f632015dce0 2023-10-16T13:48:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631ffff700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6308004d90 0x7f6308005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631f7fe700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6308003a30 0x7f6308003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.416+0000 7f631effd700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 0x7f6308004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 -- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 msgr2=0x7f6308004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015dce0 0x7f6308004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 -- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6308003a30 msgr2=0x7f6308003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6308003a30 0x7f6308003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 -- 172.21.15.5:0/672800189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080035b0 con 0x7f6308004d90 2023-10-16T13:48:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6308004d90 0x7f6308005210 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f631800a810 tx=0x7f6308005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aabf503b41742c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800a250 con 0x7f6308004d90 2023-10-16T13:48:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318012620 con 0x7f6308004d90 2023-10-16T13:48:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631e7fc700 1 -- 172.21.15.5:0/672800189 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180129d0 con 0x7f6308004d90 2023-10-16T13:48:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f63261da700 1 -- 172.21.15.5:0/672800189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6308004d90 msgr2=0x7f6308005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f63261da700 1 --2- 172.21.15.5:0/672800189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6308004d90 0x7f6308005210 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f631800a810 tx=0x7f6308005880 comp rx=0 tx=0).stop 2023-10-16T13:48:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f631ffff700 1 -- 172.21.15.5:0/672800189 reap_dead start 2023-10-16T13:48:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f63261da700 1 -- 172.21.15.5:0/672800189 shutdown_connections 2023-10-16T13:48:38.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.417+0000 7f63261da700 1 -- 172.21.15.5:0/672800189 >> 172.21.15.5:0/672800189 conn(0x7f63200d15f0 msgr2=0x7f63200d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:38.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.418+0000 7f63261da700 1 -- 172.21.15.5:0/672800189 shutdown_connections 2023-10-16T13:48:38.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.418+0000 7f63261da700 1 -- 172.21.15.5:0/672800189 wait complete. 2023-10-16T13:48:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.419+0000 7f63261da700 1 Processor -- start 2023-10-16T13:48:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.419+0000 7f63261da700 1 -- start start 2023-10-16T13:48:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015a4a0 0x7f63200c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63200c70e0 0x7f63201e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 0x7f63200c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63201e81d0 con 0x7f63201e7d20 2023-10-16T13:48:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632009f2a0 con 0x7f63200c70e0 2023-10-16T13:48:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632015a880 con 0x7f632015a4a0 2023-10-16T13:48:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 0x7f63200c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 0x7f63200c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49214/0 (socket says 172.21.15.5:49214) 2023-10-16T13:48:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 -- 172.21.15.5:0/1630702591 learned_addr learned my addr 172.21.15.5:0/1630702591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631f7fe700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015a4a0 0x7f63200c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631effd700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63200c70e0 0x7f63201e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 -- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015a4a0 msgr2=0x7f63200c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015a4a0 0x7f63200c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 -- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63200c70e0 msgr2=0x7f63201e77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63200c70e0 0x7f63201e77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 -- 172.21.15.5:0/1630702591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200c9490 con 0x7f63201e7d20 2023-10-16T13:48:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f631ffff700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 0x7f63200c5050 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6318012000 tx=0x7f6318001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800a250 con 0x7f63201e7d20 2023-10-16T13:48:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631801e630 con 0x7f63201e7d20 2023-10-16T13:48:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63200c9770 con 0x7f63201e7d20 2023-10-16T13:48:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.420+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631801e9e0 con 0x7f63201e7d20 2023-10-16T13:48:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.421+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63200c9d30 con 0x7f63201e7d20 2023-10-16T13:48:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.421+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320067d20 con 0x7f63201e7d20 2023-10-16T13:48:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.422+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f631801eb40 con 0x7f63201e7d20 2023-10-16T13:48:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.422+0000 7f6307fff700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f630c06b2f0 0x7f630c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.422+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f631808bb90 con 0x7f63201e7d20 2023-10-16T13:48:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.423+0000 7f631f7fe700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f630c06b2f0 0x7f630c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.423+0000 7f631f7fe700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f630c06b2f0 0x7f630c06d7b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6310009ba0 tx=0x7f6310008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.427+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63180566f0 con 0x7f63201e7d20 2023-10-16T13:48:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.672+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6320160630 con 0x7f63201e7d20 2023-10-16T13:48:38.675 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:48:38.673+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:48:38.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.674+0000 7f6307fff700 1 -- 172.21.15.5:0/1630702591 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6318059d10 con 0x7f63201e7d20 2023-10-16T13:48:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f630c06b2f0 msgr2=0x7f630c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f630c06b2f0 0x7f630c06d7b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6310009ba0 tx=0x7f6310008040 comp rx=0 tx=0).stop 2023-10-16T13:48:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 msgr2=0x7f63200c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 0x7f63200c5050 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6318012000 tx=0x7f6318001cb0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 shutdown_connections 2023-10-16T13:48:38.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63201e7d20 0x7f63200c5050 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f630c06b2f0 0x7f630c06d7b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632015a4a0 0x7f63200c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 --2- 172.21.15.5:0/1630702591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63200c70e0 0x7f63201e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.677+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 >> 172.21.15.5:0/1630702591 conn(0x7f63200d15f0 msgr2=0x7f632015eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.678+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 shutdown_connections 2023-10-16T13:48:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.678+0000 7f63261da700 1 -- 172.21.15.5:0/1630702591 wait complete. 2023-10-16T13:48:38.683 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:48:38.683 INFO:tasks.ceph.mds.a.smithi005.stderr: -3486> 2023-10-16T13:48:22.260+0000 7faf88cce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:48:38.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:48:38.711 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:48:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.819+0000 7efc04bc3700 1 Processor -- start 2023-10-16T13:48:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.819+0000 7efc04bc3700 1 -- start start 2023-10-16T13:48:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efc04bc3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc000b54f0 0x7efc0015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efc04bc3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b5c70 con 0x7efc0006e750 2023-10-16T13:48:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efc04bc3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b5990 con 0x7efc0006eb30 2023-10-16T13:48:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efc04bc3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0015b2b0 con 0x7efc000b54f0 2023-10-16T13:48:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfe59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc0006e750 0x7efc000ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59234/0 (socket says 172.21.15.5:59234) 2023-10-16T13:48:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfe59c700 1 -- 172.21.15.5:0/1379265895 learned_addr learned my addr 172.21.15.5:0/1379265895 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:38.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfed9d700 1 --2- 172.21.15.5:0/1379265895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc000b54f0 0x7efc0015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189106261 0 0) 0x7efc000b5c70 con 0x7efc0006e750 2023-10-16T13:48:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe80035b0 con 0x7efc0006e750 2023-10-16T13:48:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897624286 0 0) 0x7efc000b5990 con 0x7efc0006eb30 2023-10-16T13:48:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc000b5c70 con 0x7efc0006eb30 2023-10-16T13:48:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfed9d700 1 -- 172.21.15.5:0/1379265895 >> v1:172.21.15.112:6789/0 conn(0x7efc0006eb30 legacy=0x7efc0015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032099016 0 0) 0x7efbe80035b0 con 0x7efc0006e750 2023-10-16T13:48:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfed9d700 1 -- 172.21.15.5:0/1379265895 >> v1:172.21.15.5:6789/0 conn(0x7efc0006e750 legacy=0x7efc000ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfed9d700 1 -- 172.21.15.5:0/1379265895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0015b590 con 0x7efc000b54f0 2023-10-16T13:48:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.820+0000 7efbfed9d700 1 --2- 172.21.15.5:0/1379265895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc000b54f0 0x7efc0015ee10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009df0 tx=0x7efbf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72cfc99c843d1ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800e070 con 0x7efc000b54f0 2023-10-16T13:48:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf8003a20 con 0x7efc000b54f0 2023-10-16T13:48:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efbfd59a700 1 -- 172.21.15.5:0/1379265895 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0001670 con 0x7efc000b54f0 2023-10-16T13:48:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 -- 172.21.15.5:0/1379265895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc000b54f0 msgr2=0x7efc0015ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1379265895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc000b54f0 0x7efc0015ee10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009df0 tx=0x7efbf800b330 comp rx=0 tx=0).stop 2023-10-16T13:48:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 -- 172.21.15.5:0/1379265895 shutdown_connections 2023-10-16T13:48:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1379265895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc000b54f0 0x7efc0015ee10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 -- 172.21.15.5:0/1379265895 >> 172.21.15.5:0/1379265895 conn(0x7efc000cc6f0 msgr2=0x7efc000ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 -- 172.21.15.5:0/1379265895 shutdown_connections 2023-10-16T13:48:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.821+0000 7efc04bc3700 1 -- 172.21.15.5:0/1379265895 wait complete. 2023-10-16T13:48:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 Processor -- start 2023-10-16T13:48:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 -- start start 2023-10-16T13:48:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 0x7efc000c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc0006eb30 0x7efc00155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc000b54f0 0x7efc000af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c4b80 con 0x7efc0006e750 2023-10-16T13:48:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c35a0 con 0x7efc000b54f0 2023-10-16T13:48:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efc04bc3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c3880 con 0x7efc0006eb30 2023-10-16T13:48:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efbfe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 0x7efc000c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efbfe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 0x7efc000c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49236/0 (socket says 172.21.15.5:49236) 2023-10-16T13:48:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.823+0000 7efbfe59c700 1 -- 172.21.15.5:0/1492197524 learned_addr learned my addr 172.21.15.5:0/1492197524 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfed9d700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc000b54f0 0x7efc000af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfdd9b700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc0006eb30 0x7efc00155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfe59c700 1 -- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc0006eb30 msgr2=0x7efc00155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfe59c700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc0006eb30 0x7efc00155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfe59c700 1 -- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc000b54f0 msgr2=0x7efc000af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfe59c700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc000b54f0 0x7efc000af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfe59c700 1 -- 172.21.15.5:0/1492197524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009a70 con 0x7efc0006e750 2023-10-16T13:48:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfdd9b700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc0006eb30 0x7efc00155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbfe59c700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 0x7efc000c4640 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efbf000c6d0 tx=0x7efbf000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0004c80 con 0x7efc0006e750 2023-10-16T13:48:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf0004e00 con 0x7efc0006e750 2023-10-16T13:48:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc000c3b60 con 0x7efc0006e750 2023-10-16T13:48:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0007310 con 0x7efc0006e750 2023-10-16T13:48:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.824+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc000c4120 con 0x7efc0006e750 2023-10-16T13:48:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.825+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc000c4340 con 0x7efc0006e750 2023-10-16T13:48:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.826+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7efbf0007470 con 0x7efc0006e750 2023-10-16T13:48:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.826+0000 7efbeeffd700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efbe006b320 0x7efbe006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.826+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efbf0089ac0 con 0x7efc0006e750 2023-10-16T13:48:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.826+0000 7efbfdd9b700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efbe006b320 0x7efbe006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.827+0000 7efbfdd9b700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efbe006b320 0x7efbe006d7e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efc001575a0 tx=0x7efbf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:38.831+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efbf0054640 con 0x7efc0006e750 2023-10-16T13:48:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.079+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc00067d20 con 0x7efc0006e750 2023-10-16T13:48:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.676+0000 7efbeeffd700 1 -- 172.21.15.5:0/1492197524 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7efbf0057c60 con 0x7efc0006e750 2023-10-16T13:48:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.679+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efbe006b320 msgr2=0x7efbe006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.679+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efbe006b320 0x7efbe006d7e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efc001575a0 tx=0x7efbf4009040 comp rx=0 tx=0).stop 2023-10-16T13:48:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.679+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 msgr2=0x7efc000c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.679+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 0x7efc000c4640 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efbf000c6d0 tx=0x7efbf000c9e0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 shutdown_connections 2023-10-16T13:48:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc000b54f0 0x7efc000af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0006e750 0x7efc000c4640 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efbe006b320 0x7efbe006d7e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 --2- 172.21.15.5:0/1492197524 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc0006eb30 0x7efc00155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 >> 172.21.15.5:0/1492197524 conn(0x7efc000cc6f0 msgr2=0x7efc000ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 shutdown_connections 2023-10-16T13:48:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.680+0000 7efc04bc3700 1 -- 172.21.15.5:0/1492197524 wait complete. 2023-10-16T13:48:39.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:48:39.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.870+0000 7f3aae9e1700 1 Processor -- start 2023-10-16T13:48:39.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.870+0000 7f3aae9e1700 1 -- start start 2023-10-16T13:48:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aae9e1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3aa80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aae9e1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80b2e40 con 0x7f3aa8151680 2023-10-16T13:48:39.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aae9e1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa815e7c0 con 0x7f3aa806da30 2023-10-16T13:48:39.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aae9e1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80b2880 con 0x7f3aa80727e0 2023-10-16T13:48:39.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3aa8151680 0x7f3aa815ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59250/0 (socket says 172.21.15.5:59250) 2023-10-16T13:48:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa7fff700 1 -- 172.21.15.5:0/2970434839 learned_addr learned my addr 172.21.15.5:0/2970434839 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3aa80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731619006 0 0) 0x7f3a98001110 con 0x7f3aa8151680 2023-10-16T13:48:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a940035b0 con 0x7f3aa8151680 2023-10-16T13:48:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537907474 0 0) 0x7f3aa815e7c0 con 0x7f3aa806da30 2023-10-16T13:48:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.871+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a98001110 con 0x7f3aa806da30 2023-10-16T13:48:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539038457 0 0) 0x7f3a940035b0 con 0x7f3aa8151680 2023-10-16T13:48:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 msgr2=0x7f3aa80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3aa80b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 >> v1:172.21.15.112:6789/0 conn(0x7f3aa806da30 legacy=0x7f3aa815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80b2b60 con 0x7f3aa8151680 2023-10-16T13:48:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f3a98001800 con 0x7f3aa8151680 2023-10-16T13:48:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3aa80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 >> v1:172.21.15.5:6789/0 conn(0x7f3aa8151680 legacy=0x7f3aa815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a94003bc0 0x7f3a94003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a94004850 0x7f3a94004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3a94005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80b2880 con 0x7f3a94004850 2023-10-16T13:48:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9400dc50 con 0x7f3a94003bc0 2023-10-16T13:48:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9400de10 con 0x7f3aa80727e0 2023-10-16T13:48:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a94004850 0x7f3a94004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa7fff700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a94003bc0 0x7f3a94003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aacf7e700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3a94005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 -- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 msgr2=0x7f3a94005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3a94005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 -- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a94003bc0 msgr2=0x7f3a94003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a94003bc0 0x7f3a94003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 -- 172.21.15.5:0/2970434839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900094a0 con 0x7f3a94004850 2023-10-16T13:48:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aacf7e700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3aa80727e0 0x7f3a94005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a94004850 0x7f3a94004cd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009d00 tx=0x7f3a94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eadc854ebc01ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90009e50 con 0x7f3a94004850 2023-10-16T13:48:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000e9a0 con 0x7f3a94004850 2023-10-16T13:48:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.872+0000 7f3aa6ffd700 1 -- 172.21.15.5:0/2970434839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000ed30 con 0x7f3a94004850 2023-10-16T13:48:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2970434839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a94004850 msgr2=0x7f3a94004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2970434839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a94004850 0x7f3a94004cd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009d00 tx=0x7f3a94005880 comp rx=0 tx=0).stop 2023-10-16T13:48:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aacf7e700 1 -- 172.21.15.5:0/2970434839 reap_dead start 2023-10-16T13:48:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2970434839 shutdown_connections 2023-10-16T13:48:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2970434839 >> 172.21.15.5:0/2970434839 conn(0x7f3aa806bd70 msgr2=0x7f3aa806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:39.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2970434839 shutdown_connections 2023-10-16T13:48:39.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.873+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2970434839 wait complete. 2023-10-16T13:48:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.874+0000 7f3aae9e1700 1 Processor -- start 2023-10-16T13:48:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 -- start start 2023-10-16T13:48:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a94004850 0x7f3aa8144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aa80afcc0 0x7f3aa80b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 0x7f3aa80c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c63a0 con 0x7f3aa80c59e0 2023-10-16T13:48:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8146510 con 0x7f3aa80afcc0 2023-10-16T13:48:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aae9e1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8145900 con 0x7f3a94004850 2023-10-16T13:48:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aacf7e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 0x7f3aa80c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aacf7e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 0x7f3aa80c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49262/0 (socket says 172.21.15.5:49262) 2023-10-16T13:48:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.875+0000 7f3aacf7e700 1 -- 172.21.15.5:0/2824221653 learned_addr learned my addr 172.21.15.5:0/2824221653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aa7fff700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a94004850 0x7f3aa8144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aa80afcc0 0x7f3aa80b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aacf7e700 1 -- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a94004850 msgr2=0x7f3aa8144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aacf7e700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a94004850 0x7f3aa8144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aacf7e700 1 -- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aa80afcc0 msgr2=0x7f3aa80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aacf7e700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aa80afcc0 0x7f3aa80b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aacf7e700 1 -- 172.21.15.5:0/2824221653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa8145390 con 0x7f3aa80c59e0 2023-10-16T13:48:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aa77fe700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aa80afcc0 0x7f3aa80b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aacf7e700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 0x7f3aa80c5e60 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0001a50 tx=0x7f3aa000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0003c10 con 0x7f3aa80c59e0 2023-10-16T13:48:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0003d90 con 0x7f3aa80c59e0 2023-10-16T13:48:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa814a5c0 con 0x7f3aa80c59e0 2023-10-16T13:48:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0005310 con 0x7f3aa80c59e0 2023-10-16T13:48:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.876+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa8146a40 con 0x7f3aa80c59e0 2023-10-16T13:48:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.877+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa8072e10 con 0x7f3aa80c59e0 2023-10-16T13:48:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.878+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f3aa0005470 con 0x7f3aa80c59e0 2023-10-16T13:48:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.878+0000 7f3aa4ff9700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a8806b2f0 0x7f3a8806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.878+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3aa0089e80 con 0x7f3aa80c59e0 2023-10-16T13:48:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.878+0000 7f3aa7fff700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a8806b2f0 0x7f3a8806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.879+0000 7f3aa7fff700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a8806b2f0 0x7f3a8806d7b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3a98000c00 tx=0x7f3a98007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:39.883+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3aa00548f0 con 0x7f3aa80c59e0 2023-10-16T13:48:40.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.084+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3aa8067d20 con 0x7f3aa80c59e0 2023-10-16T13:48:40.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.677+0000 7f3aa4ff9700 1 -- 172.21.15.5:0/2824221653 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3aa0001ca0 con 0x7f3aa80c59e0 2023-10-16T13:48:40.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a8806b2f0 msgr2=0x7f3a8806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a8806b2f0 0x7f3a8806d7b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3a98000c00 tx=0x7f3a98007a80 comp rx=0 tx=0).stop 2023-10-16T13:48:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 msgr2=0x7f3aa80c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 0x7f3aa80c5e60 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0001a50 tx=0x7f3aa000ee90 comp rx=0 tx=0).stop 2023-10-16T13:48:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 shutdown_connections 2023-10-16T13:48:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80c59e0 0x7f3aa80c5e60 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3a8806b2f0 0x7f3a8806d7b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a94004850 0x7f3aa8144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 --2- 172.21.15.5:0/2824221653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aa80afcc0 0x7f3aa80b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 >> 172.21.15.5:0/2824221653 conn(0x7f3aa806bd70 msgr2=0x7f3aa814f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 shutdown_connections 2023-10-16T13:48:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.681+0000 7f3aae9e1700 1 -- 172.21.15.5:0/2824221653 wait complete. 2023-10-16T13:48:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:48:40.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:48:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.828+0000 7f0f29acd700 1 Processor -- start 2023-10-16T13:48:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.828+0000 7f0f29acd700 1 -- start start 2023-10-16T13:48:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f29acd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2415f250 0x7f0f2415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f29acd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2415cc30 con 0x7f0f2406d320 2023-10-16T13:48:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f29acd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f24071c60 con 0x7f0f2415c7b0 2023-10-16T13:48:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f29acd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24071f40 con 0x7f0f2415f250 2023-10-16T13:48:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f237fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f2406d320 0x7f0f2406d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59270/0 (socket says 172.21.15.5:59270) 2023-10-16T13:48:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f237fe700 1 -- 172.21.15.5:0/4050213950 learned_addr learned my addr 172.21.15.5:0/4050213950 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f23fff700 1 --2- 172.21.15.5:0/4050213950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2415f250 0x7f0f2415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858914574 0 0) 0x7f0f14001110 con 0x7f0f2406d320 2023-10-16T13:48:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f100035b0 con 0x7f0f2406d320 2023-10-16T13:48:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118459624 0 0) 0x7f0f24071c60 con 0x7f0f2415c7b0 2023-10-16T13:48:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f14001110 con 0x7f0f2415c7b0 2023-10-16T13:48:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f23fff700 1 -- 172.21.15.5:0/4050213950 >> v1:172.21.15.112:6789/0 conn(0x7f0f2415c7b0 legacy=0x7f0f24071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677323337 0 0) 0x7f0f100035b0 con 0x7f0f2406d320 2023-10-16T13:48:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f23fff700 1 -- 172.21.15.5:0/4050213950 >> v1:172.21.15.5:6789/0 conn(0x7f0f2406d320 legacy=0x7f0f2406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.829+0000 7f0f23fff700 1 -- 172.21.15.5:0/4050213950 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2415bfb0 con 0x7f0f2415f250 2023-10-16T13:48:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f23fff700 1 --2- 172.21.15.5:0/4050213950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2415f250 0x7f0f2415f6e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009dc0 tx=0x7f0f1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc12e0fc26995ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00e070 con 0x7f0f2415f250 2023-10-16T13:48:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c003a20 con 0x7f0f2415f250 2023-10-16T13:48:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f227fc700 1 -- 172.21.15.5:0/4050213950 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14001800 con 0x7f0f2415f250 2023-10-16T13:48:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 -- 172.21.15.5:0/4050213950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2415f250 msgr2=0x7f0f2415f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 --2- 172.21.15.5:0/4050213950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2415f250 0x7f0f2415f6e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009dc0 tx=0x7f0f1c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 -- 172.21.15.5:0/4050213950 shutdown_connections 2023-10-16T13:48:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 --2- 172.21.15.5:0/4050213950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2415f250 0x7f0f2415f6e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 -- 172.21.15.5:0/4050213950 >> 172.21.15.5:0/4050213950 conn(0x7f0f240cfc10 msgr2=0x7f0f240d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 -- 172.21.15.5:0/4050213950 shutdown_connections 2023-10-16T13:48:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.830+0000 7f0f29acd700 1 -- 172.21.15.5:0/4050213950 wait complete. 2023-10-16T13:48:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.832+0000 7f0f29acd700 1 Processor -- start 2023-10-16T13:48:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.832+0000 7f0f29acd700 1 -- start start 2023-10-16T13:48:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f29acd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2406d320 0x7f0f24154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f29acd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f2415c7b0 0x7f0f241f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f29acd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 0x7f0f2415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f29acd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24154fc0 con 0x7f0f2415f250 2023-10-16T13:48:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f29acd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240c5ed0 con 0x7f0f2415c7b0 2023-10-16T13:48:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f29acd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241f5350 con 0x7f0f2406d320 2023-10-16T13:48:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f23fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 0x7f0f2415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f23fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 0x7f0f2415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49276/0 (socket says 172.21.15.5:49276) 2023-10-16T13:48:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f23fff700 1 -- 172.21.15.5:0/3443974546 learned_addr learned my addr 172.21.15.5:0/3443974546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f237fe700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2406d320 0x7f0f24154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.833+0000 7f0f22ffd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f2415c7b0 0x7f0f241f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f23fff700 1 -- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2406d320 msgr2=0x7f0f24154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f23fff700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2406d320 0x7f0f24154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f23fff700 1 -- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f2415c7b0 msgr2=0x7f0f241f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f23fff700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f2415c7b0 0x7f0f241f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f23fff700 1 -- 172.21.15.5:0/3443974546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c009a70 con 0x7f0f2415f250 2023-10-16T13:48:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f23fff700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 0x7f0f2415d5a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00b370 tx=0x7f0f1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0044c0 con 0x7f0f2415f250 2023-10-16T13:48:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c004620 con 0x7f0f2415f250 2023-10-16T13:48:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f241f4590 con 0x7f0f2415f250 2023-10-16T13:48:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c01d470 con 0x7f0f2415f250 2023-10-16T13:48:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.834+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f241f4b50 con 0x7f0f2415f250 2023-10-16T13:48:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.835+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f24072550 con 0x7f0f2415f250 2023-10-16T13:48:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.836+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f0f1c01d5d0 con 0x7f0f2415f250 2023-10-16T13:48:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.836+0000 7f0f1bfff700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f0406b2f0 0x7f0f0406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:40.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.836+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0f1c08b8e0 con 0x7f0f2415f250 2023-10-16T13:48:40.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.836+0000 7f0f237fe700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f0406b2f0 0x7f0f0406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:40.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.837+0000 7f0f237fe700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f0406b2f0 0x7f0f0406d7b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0f14001370 tx=0x7f0f14007ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:40.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:40.841+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f1c056490 con 0x7f0f2415f250 2023-10-16T13:48:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.045+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f24067d20 con 0x7f0f2415f250 2023-10-16T13:48:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.683+0000 7f0f1bfff700 1 -- 172.21.15.5:0/3443974546 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0f1c059ab0 con 0x7f0f2415f250 2023-10-16T13:48:41.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f0406b2f0 msgr2=0x7f0f0406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f0406b2f0 0x7f0f0406d7b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0f14001370 tx=0x7f0f14007ba0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 msgr2=0x7f0f2415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 0x7f0f2415d5a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00b370 tx=0x7f0f1c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 shutdown_connections 2023-10-16T13:48:41.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2415f250 0x7f0f2415d5a0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0f0406b2f0 0x7f0f0406d7b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f2406d320 0x7f0f24154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 --2- 172.21.15.5:0/3443974546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f2415c7b0 0x7f0f241f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.685+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 >> 172.21.15.5:0/3443974546 conn(0x7f0f240cfc10 msgr2=0x7f0f2406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.686+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 shutdown_connections 2023-10-16T13:48:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.686+0000 7f0f29acd700 1 -- 172.21.15.5:0/3443974546 wait complete. 2023-10-16T13:48:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:48:41.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:48:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.836+0000 7f5072f08700 1 Processor -- start 2023-10-16T13:48:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.836+0000 7f5072f08700 1 -- start start 2023-10-16T13:48:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f5072f08700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f506c0b28b0 0x7f506c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f5072f08700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0b3530 con 0x7f506c15f130 2023-10-16T13:48:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f5072f08700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0cd180 con 0x7f506c06af50 2023-10-16T13:48:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f5072f08700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0cde00 con 0x7f506c0b28b0 2023-10-16T13:48:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f50714a5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f506c0b28b0 0x7f506c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f5070ca4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f506c15f130 0x7f506c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59284/0 (socket says 172.21.15.5:59284) 2023-10-16T13:48:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f5070ca4700 1 -- 172.21.15.5:0/1118641059 learned_addr learned my addr 172.21.15.5:0/1118641059 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f50714a5700 1 -- 172.21.15.5:0/1118641059 >> v1:172.21.15.112:6789/0 conn(0x7f506c06af50 legacy=0x7f506c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f50714a5700 1 -- 172.21.15.5:0/1118641059 >> v1:172.21.15.5:6789/0 conn(0x7f506c15f130 legacy=0x7f506c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f506b7fe700 1 -- 172.21.15.5:0/1118641059 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900035314 0 0) 0x7f506c0b3530 con 0x7f506c15f130 2023-10-16T13:48:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f50714a5700 1 -- 172.21.15.5:0/1118641059 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c0cd460 con 0x7f506c0b28b0 2023-10-16T13:48:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f50714a5700 1 --2- 172.21.15.5:0/1118641059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c0b28b0 0x7f506c0cede0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5064009d90 tx=0x7f506400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0b00c672942a45 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f506b7fe700 1 -- 172.21.15.5:0/1118641059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400e070 con 0x7f506c0b28b0 2023-10-16T13:48:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f506b7fe700 1 -- 172.21.15.5:0/1118641059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400bbd0 con 0x7f506c0b28b0 2023-10-16T13:48:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.837+0000 7f506b7fe700 1 -- 172.21.15.5:0/1118641059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064012430 con 0x7f506c0b28b0 2023-10-16T13:48:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 -- 172.21.15.5:0/1118641059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c0b28b0 msgr2=0x7f506c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 --2- 172.21.15.5:0/1118641059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c0b28b0 0x7f506c0cede0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5064009d90 tx=0x7f506400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 -- 172.21.15.5:0/1118641059 shutdown_connections 2023-10-16T13:48:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 --2- 172.21.15.5:0/1118641059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c0b28b0 0x7f506c0cede0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 -- 172.21.15.5:0/1118641059 >> 172.21.15.5:0/1118641059 conn(0x7f506c06dae0 msgr2=0x7f506c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 -- 172.21.15.5:0/1118641059 shutdown_connections 2023-10-16T13:48:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.838+0000 7f5072f08700 1 -- 172.21.15.5:0/1118641059 wait complete. 2023-10-16T13:48:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.839+0000 7f5072f08700 1 Processor -- start 2023-10-16T13:48:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.839+0000 7f5072f08700 1 -- start start 2023-10-16T13:48:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5072f08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 0x7f506c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5072f08700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f506c0b28b0 0x7f506c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5072f08700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506c15f130 0x7f506c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5072f08700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c15bab0 con 0x7f506c06af50 2023-10-16T13:48:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5072f08700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c15bd90 con 0x7f506c15f130 2023-10-16T13:48:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5072f08700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c15c070 con 0x7f506c0b28b0 2023-10-16T13:48:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5070ca4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 0x7f506c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5070ca4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 0x7f506c15b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49286/0 (socket says 172.21.15.5:49286) 2023-10-16T13:48:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f5070ca4700 1 -- 172.21.15.5:0/108840604 learned_addr learned my addr 172.21.15.5:0/108840604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f506bfff700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f506c0b28b0 0x7f506c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.840+0000 7f50714a5700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506c15f130 0x7f506c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5070ca4700 1 -- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f506c0b28b0 msgr2=0x7f506c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5070ca4700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f506c0b28b0 0x7f506c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5070ca4700 1 -- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506c15f130 msgr2=0x7f506c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5070ca4700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506c15f130 0x7f506c157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5070ca4700 1 -- 172.21.15.5:0/108840604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009a70 con 0x7f506c06af50 2023-10-16T13:48:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f50714a5700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506c15f130 0x7f506c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5070ca4700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 0x7f506c15b4d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f506000c520 tx=0x7f506000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060004c80 con 0x7f506c06af50 2023-10-16T13:48:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060004de0 con 0x7f506c06af50 2023-10-16T13:48:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c15c350 con 0x7f506c06af50 2023-10-16T13:48:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060007310 con 0x7f506c06af50 2023-10-16T13:48:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.841+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c158270 con 0x7f506c06af50 2023-10-16T13:48:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.842+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c067d20 con 0x7f506c06af50 2023-10-16T13:48:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.842+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5060007470 con 0x7f506c06af50 2023-10-16T13:48:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.843+0000 7f50697fa700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f505006b2f0 0x7f505006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.843+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5060089590 con 0x7f506c06af50 2023-10-16T13:48:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.843+0000 7f506bfff700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f505006b2f0 0x7f505006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.844+0000 7f506bfff700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f505006b2f0 0x7f505006d7b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f506c0c9900 tx=0x7f5058009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:41.848+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50600543f0 con 0x7f506c06af50 2023-10-16T13:48:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.059+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f506c0ca890 con 0x7f506c06af50 2023-10-16T13:48:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.062+0000 7f50697fa700 1 -- 172.21.15.5:0/108840604 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5060057a10 con 0x7f506c06af50 2023-10-16T13:48:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f505006b2f0 msgr2=0x7f505006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f505006b2f0 0x7f505006d7b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f506c0c9900 tx=0x7f5058009040 comp rx=0 tx=0).stop 2023-10-16T13:48:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 msgr2=0x7f506c15b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 0x7f506c15b4d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f506000c520 tx=0x7f506000c830 comp rx=0 tx=0).stop 2023-10-16T13:48:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 shutdown_connections 2023-10-16T13:48:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506c15f130 0x7f506c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506c06af50 0x7f506c15b4d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f505006b2f0 0x7f505006d7b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 --2- 172.21.15.5:0/108840604 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f506c0b28b0 0x7f506c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 >> 172.21.15.5:0/108840604 conn(0x7f506c06dae0 msgr2=0x7f506c0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 shutdown_connections 2023-10-16T13:48:42.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.064+0000 7f5072f08700 1 -- 172.21.15.5:0/108840604 wait complete. 2023-10-16T13:48:42.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-16T13:48:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.201+0000 7f3057fdc700 1 Processor -- start 2023-10-16T13:48:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.202+0000 7f3057fdc700 1 -- start start 2023-10-16T13:48:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.202+0000 7f3057fdc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30500d0c70 0x7f30500cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3057fdc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500d23e0 con 0x7f30500c5110 2023-10-16T13:48:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3057fdc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500cf190 con 0x7f305015b740 2023-10-16T13:48:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3057fdc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305015bb20 con 0x7f30500d0c70 2023-10-16T13:48:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3056579700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f30500c5110 0x7f30500cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59302/0 (socket says 172.21.15.5:59302) 2023-10-16T13:48:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3056579700 1 -- 172.21.15.5:0/1125094322 learned_addr learned my addr 172.21.15.5:0/1125094322 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3055577700 1 --2- 172.21.15.5:0/1125094322 >> v2:172.21.15.112:3300/0 conn(0x7f30500d0c70 0x7f30500cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433766844 0 0) 0x7f3048001490 con 0x7f30500c5110 2023-10-16T13:48:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c0035b0 con 0x7f30500c5110 2023-10-16T13:48:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397161987 0 0) 0x7f303c0035b0 con 0x7f30500c5110 2023-10-16T13:48:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 >> v2:172.21.15.112:3300/0 conn(0x7f30500d0c70 msgr2=0x7f30500cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 --2- 172.21.15.5:0/1125094322 >> v2:172.21.15.112:3300/0 conn(0x7f30500d0c70 0x7f30500cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 >> v1:172.21.15.112:6789/0 conn(0x7f305015b740 legacy=0x7f30500d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500cbd40 con 0x7f30500c5110 2023-10-16T13:48:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f3048001b80 con 0x7f30500c5110 2023-10-16T13:48:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 >> v1:172.21.15.5:6789/0 conn(0x7f30500c5110 legacy=0x7f30500cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c003a00 0x7f303c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f303c004850 0x7f303c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303c005330 0x7f303c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305015bb20 con 0x7f303c005330 2023-10-16T13:48:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c00c200 con 0x7f303c003a00 2023-10-16T13:48:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c00c3c0 con 0x7f303c004850 2023-10-16T13:48:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.203+0000 7f3056579700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303c005330 0x7f303c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3055d78700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c003a00 0x7f303c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3055577700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f303c004850 0x7f303c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 -- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f303c004850 msgr2=0x7f303c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f303c004850 0x7f303c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 -- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c003a00 msgr2=0x7f303c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c003a00 0x7f303c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 -- 172.21.15.5:0/1125094322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0035b0 con 0x7f303c005330 2023-10-16T13:48:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 -- 172.21.15.5:0/1125094322 reap_dead start 2023-10-16T13:48:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3056579700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303c005330 0x7f303c00ba10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f304800a800 tx=0x7f303c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b7ceec4a07f191 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800a490 con 0x7f303c005330 2023-10-16T13:48:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048012620 con 0x7f303c005330 2023-10-16T13:48:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.204+0000 7f3054d76700 1 -- 172.21.15.5:0/1125094322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480129d0 con 0x7f303c005330 2023-10-16T13:48:42.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 -- 172.21.15.5:0/1125094322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303c005330 msgr2=0x7f303c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303c005330 0x7f303c00ba10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f304800a800 tx=0x7f303c005880 comp rx=0 tx=0).stop 2023-10-16T13:48:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 -- 172.21.15.5:0/1125094322 shutdown_connections 2023-10-16T13:48:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 --2- 172.21.15.5:0/1125094322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303c005330 0x7f303c00ba10 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 -- 172.21.15.5:0/1125094322 >> 172.21.15.5:0/1125094322 conn(0x7f30500665a0 msgr2=0x7f3050066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 -- 172.21.15.5:0/1125094322 shutdown_connections 2023-10-16T13:48:42.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.205+0000 7f3057fdc700 1 -- 172.21.15.5:0/1125094322 wait complete. 2023-10-16T13:48:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.206+0000 7f3057fdc700 1 Processor -- start 2023-10-16T13:48:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.206+0000 7f3057fdc700 1 -- start start 2023-10-16T13:48:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3057fdc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c005330 0x7f30501538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3057fdc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 0x7f30500b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3057fdc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30500b5c50 0x7f30500b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3057fdc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500b60d0 con 0x7f305014f5f0 2023-10-16T13:48:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3057fdc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500c8d40 con 0x7f303c005330 2023-10-16T13:48:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3057fdc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30501f0c30 con 0x7f30500b5c50 2023-10-16T13:48:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 0x7f30500b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 0x7f30500b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49308/0 (socket says 172.21.15.5:49308) 2023-10-16T13:48:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 -- 172.21.15.5:0/2975070605 learned_addr learned my addr 172.21.15.5:0/2975070605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055d78700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c005330 0x7f30501538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3056579700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30500b5c50 0x7f30500b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 -- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30500b5c50 msgr2=0x7f30500b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30500b5c50 0x7f30500b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 -- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c005330 msgr2=0x7f30501538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c005330 0x7f30501538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 -- 172.21.15.5:0/2975070605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500c8730 con 0x7f305014f5f0 2023-10-16T13:48:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.207+0000 7f3055577700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 0x7f30500b5710 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f30400119a0 tx=0x7f3040011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.208+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000f780 con 0x7f305014f5f0 2023-10-16T13:48:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.208+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000f8e0 con 0x7f305014f5f0 2023-10-16T13:48:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.208+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500b5060 con 0x7f305014f5f0 2023-10-16T13:48:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.208+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000fc70 con 0x7f305014f5f0 2023-10-16T13:48:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.208+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500b5340 con 0x7f305014f5f0 2023-10-16T13:48:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.209+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30500c8ef0 con 0x7f305014f5f0 2023-10-16T13:48:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.209+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f3040014440 con 0x7f305014f5f0 2023-10-16T13:48:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.209+0000 7f30467fc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f303406b2f0 0x7f303406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.210+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f304008a060 con 0x7f305014f5f0 2023-10-16T13:48:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.210+0000 7f3055d78700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f303406b2f0 0x7f303406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.210+0000 7f3055d78700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f303406b2f0 0x7f303406d7b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f304c007fd0 tx=0x7f304c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.214+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30400bcca0 con 0x7f305014f5f0 2023-10-16T13:48:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.497+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f30500d00b0 con 0x7f305014f5f0 2023-10-16T13:48:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.684+0000 7f30467fc700 1 -- 172.21.15.5:0/2975070605 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v449) v1 ==== 156+0+0 (secure 0 0 0) 0x7f30500c8ef0 con 0x7f305014f5f0 2023-10-16T13:48:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f303406b2f0 msgr2=0x7f303406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f303406b2f0 0x7f303406d7b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f304c007fd0 tx=0x7f304c009040 comp rx=0 tx=0).stop 2023-10-16T13:48:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 msgr2=0x7f30500b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 0x7f30500b5710 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f30400119a0 tx=0x7f3040011cb0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 shutdown_connections 2023-10-16T13:48:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f303406b2f0 0x7f303406d7b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30500b5c50 0x7f30500b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f303c005330 0x7f30501538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 --2- 172.21.15.5:0/2975070605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305014f5f0 0x7f30500b5710 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 >> 172.21.15.5:0/2975070605 conn(0x7f30500665a0 msgr2=0x7f30500c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 shutdown_connections 2023-10-16T13:48:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.687+0000 7f3057fdc700 1 -- 172.21.15.5:0/2975070605 wait complete. 2023-10-16T13:48:42.702 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command without subvolume group ... ok 2023-10-16T13:48:42.703 INFO:tasks.cephfs_test_runner:Starting test: test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) That the existing and the newly created volumes can be listed and 2023-10-16T13:48:42.703 INFO:tasks.cephfs_test_runner:test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:48:42.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:42.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.827+0000 7fae109e5700 1 Processor -- start 2023-10-16T13:48:42.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.827+0000 7fae109e5700 1 -- start start 2023-10-16T13:48:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae109e5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae0c15f1f0 0x7fae0c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae109e5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae0c0cfc60 0x7fae0c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae109e5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c15e7a0 con 0x7fae0c15ab10 2023-10-16T13:48:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae109e5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c0d0090 con 0x7fae0c0cfc60 2023-10-16T13:48:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae109e5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c0b29a0 con 0x7fae0c15f1f0 2023-10-16T13:48:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae0c0cfc60 0x7fae0c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae0c0cfc60 0x7fae0c0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49318/0 (socket says 172.21.15.5:49318) 2023-10-16T13:48:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 -- 172.21.15.5:0/1269228969 learned_addr learned my addr 172.21.15.5:0/1269228969 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae09d9b700 1 --2- 172.21.15.5:0/1269228969 >> v2:172.21.15.112:3300/0 conn(0x7fae0c15f1f0 0x7fae0c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 -- 172.21.15.5:0/1269228969 >> v2:172.21.15.112:3300/0 conn(0x7fae0c15f1f0 msgr2=0x7fae0c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 --2- 172.21.15.5:0/1269228969 >> v2:172.21.15.112:3300/0 conn(0x7fae0c15f1f0 0x7fae0c0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 -- 172.21.15.5:0/1269228969 >> v1:172.21.15.112:6789/0 conn(0x7fae0c15ab10 legacy=0x7fae0c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae0ad9d700 1 -- 172.21.15.5:0/1269228969 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0b2c80 con 0x7fae0c0cfc60 2023-10-16T13:48:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.828+0000 7fae09d9b700 1 --2- 172.21.15.5:0/1269228969 >> v2:172.21.15.112:3300/0 conn(0x7fae0c15f1f0 0x7fae0c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae0ad9d700 1 --2- 172.21.15.5:0/1269228969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0cbf40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06d470 tx=0x7fae0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0441a66cd3518c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae0959a700 1 -- 172.21.15.5:0/1269228969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400e070 con 0x7fae0c0cfc60 2023-10-16T13:48:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae0959a700 1 -- 172.21.15.5:0/1269228969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04003a20 con 0x7fae0c0cfc60 2023-10-16T13:48:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae0959a700 1 -- 172.21.15.5:0/1269228969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04003dd0 con 0x7fae0c0cfc60 2023-10-16T13:48:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 -- 172.21.15.5:0/1269228969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 msgr2=0x7fae0c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 --2- 172.21.15.5:0/1269228969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0cbf40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06d470 tx=0x7fae0400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 -- 172.21.15.5:0/1269228969 shutdown_connections 2023-10-16T13:48:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 --2- 172.21.15.5:0/1269228969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0cbf40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 --2- 172.21.15.5:0/1269228969 >> v2:172.21.15.112:3300/0 conn(0x7fae0c15f1f0 0x7fae0c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 -- 172.21.15.5:0/1269228969 >> 172.21.15.5:0/1269228969 conn(0x7fae0c06dae0 msgr2=0x7fae0c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 -- 172.21.15.5:0/1269228969 shutdown_connections 2023-10-16T13:48:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.829+0000 7fae109e5700 1 -- 172.21.15.5:0/1269228969 wait complete. 2023-10-16T13:48:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.831+0000 7fae109e5700 1 Processor -- start 2023-10-16T13:48:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.831+0000 7fae109e5700 1 -- start start 2023-10-16T13:48:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.831+0000 7fae109e5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15ab10 0x7fae0c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15f1f0 0x7fae0c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0c6ef0 con 0x7fae0c0cfc60 2023-10-16T13:48:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c159fb0 con 0x7fae0c15f1f0 2023-10-16T13:48:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c14e2c0 con 0x7fae0c15ab10 2023-10-16T13:48:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49320/0 (socket says 172.21.15.5:49320) 2023-10-16T13:48:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 -- 172.21.15.5:0/3852133806 learned_addr learned my addr 172.21.15.5:0/3852133806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0ad9d700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15f1f0 0x7fae0c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae09d9b700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15ab10 0x7fae0c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 -- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15ab10 msgr2=0x7fae0c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15ab10 0x7fae0c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 -- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15f1f0 msgr2=0x7fae0c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15f1f0 0x7fae0c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 -- 172.21.15.5:0/3852133806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04009b30 con 0x7fae0c0cfc60 2023-10-16T13:48:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae0a59c700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0c4270 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b4d0 tx=0x7fadfc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00bea0 con 0x7fae0c0cfc60 2023-10-16T13:48:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc011830 con 0x7fae0c0cfc60 2023-10-16T13:48:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c152310 con 0x7fae0c0cfc60 2023-10-16T13:48:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011be0 con 0x7fae0c0cfc60 2023-10-16T13:48:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.832+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c14e510 con 0x7fae0c0cfc60 2023-10-16T13:48:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.833+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c074460 con 0x7fae0c0cfc60 2023-10-16T13:48:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.834+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fadfc011d40 con 0x7fae0c0cfc60 2023-10-16T13:48:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.834+0000 7fadfaffd700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadec06b2f0 0x7fadec06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.834+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fadfc089520 con 0x7fae0c0cfc60 2023-10-16T13:48:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.834+0000 7fae09d9b700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadec06b2f0 0x7fadec06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.835+0000 7fae09d9b700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadec06b2f0 0x7fadec06d7b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0b3d50 tx=0x7fae00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:42.839+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae0c074460 con 0x7fae0c0cfc60 2023-10-16T13:48:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.040+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae0c074460 con 0x7fae0c0cfc60 2023-10-16T13:48:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.041+0000 7fadfaffd700 1 -- 172.21.15.5:0/3852133806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+12914 (secure 0 0 0) 0x7fae0c074460 con 0x7fae0c0cfc60 2023-10-16T13:48:43.044 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:43.044 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":101,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:41.678977+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/2462371397":"2023-10-17T13:48:38.673841+0000","172.21.15.5:6833/2462371397":"2023-10-17T13:48:38.673841+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadec06b2f0 msgr2=0x7fadec06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadec06b2f0 0x7fadec06d7b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0b3d50 tx=0x7fae00008040 comp rx=0 tx=0).stop 2023-10-16T13:48:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 msgr2=0x7fae0c0c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0c4270 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b4d0 tx=0x7fadfc00b7e0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 shutdown_connections 2023-10-16T13:48:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c15f1f0 0x7fae0c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae0c0cfc60 0x7fae0c0c4270 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadec06b2f0 0x7fadec06d7b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 --2- 172.21.15.5:0/3852133806 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae0c15ab10 0x7fae0c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 >> 172.21.15.5:0/3852133806 conn(0x7fae0c06dae0 msgr2=0x7fae0c151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 shutdown_connections 2023-10-16T13:48:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.043+0000 7fae109e5700 1 -- 172.21.15.5:0/3852133806 wait complete. 2023-10-16T13:48:43.059 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:43.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.184+0000 7f0175f29700 1 Processor -- start 2023-10-16T13:48:43.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 -- start start 2023-10-16T13:48:43.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f017015eab0 0x7f01700cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01700cf6d0 0x7f01700d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01700d1bc0 0x7f0170161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01700cfb50 con 0x7f01700cf6d0 2023-10-16T13:48:43.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017015ee90 con 0x7f01700d1bc0 2023-10-16T13:48:43.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.185+0000 7f0175f29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0170158370 con 0x7f017015eab0 2023-10-16T13:48:43.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01700cf6d0 0x7f01700d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01700cf6d0 0x7f01700d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49328/0 (socket says 172.21.15.5:49328) 2023-10-16T13:48:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 -- 172.21.15.5:0/872663724 learned_addr learned my addr 172.21.15.5:0/872663724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016f7fe700 1 --2- 172.21.15.5:0/872663724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f017015eab0 0x7f01700cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016ffff700 1 --2- 172.21.15.5:0/872663724 >> v2:172.21.15.112:3300/0 conn(0x7f01700d1bc0 0x7f0170161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 -- 172.21.15.5:0/872663724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f017015eab0 msgr2=0x7f01700cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 --2- 172.21.15.5:0/872663724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f017015eab0 0x7f01700cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 -- 172.21.15.5:0/872663724 >> v2:172.21.15.112:3300/0 conn(0x7f01700d1bc0 msgr2=0x7f0170161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 --2- 172.21.15.5:0/872663724 >> v2:172.21.15.112:3300/0 conn(0x7f01700d1bc0 0x7f0170161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 -- 172.21.15.5:0/872663724 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700d23b0 con 0x7f01700cf6d0 2023-10-16T13:48:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016effd700 1 --2- 172.21.15.5:0/872663724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01700cf6d0 0x7f01700d1680 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f01700cd190 tx=0x7f0158009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f5dd842b6ddf70 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016e7fc700 1 -- 172.21.15.5:0/872663724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158011830 con 0x7f01700cf6d0 2023-10-16T13:48:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016e7fc700 1 -- 172.21.15.5:0/872663724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158011990 con 0x7f01700cf6d0 2023-10-16T13:48:43.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.186+0000 7f016e7fc700 1 -- 172.21.15.5:0/872663724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158011d20 con 0x7f01700cf6d0 2023-10-16T13:48:43.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 -- 172.21.15.5:0/872663724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01700cf6d0 msgr2=0x7f01700d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 --2- 172.21.15.5:0/872663724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01700cf6d0 0x7f01700d1680 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f01700cd190 tx=0x7f0158009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 -- 172.21.15.5:0/872663724 shutdown_connections 2023-10-16T13:48:43.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 --2- 172.21.15.5:0/872663724 >> v2:172.21.15.112:3300/0 conn(0x7f01700d1bc0 0x7f0170161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 --2- 172.21.15.5:0/872663724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f017015eab0 0x7f01700cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 --2- 172.21.15.5:0/872663724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01700cf6d0 0x7f01700d1680 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 -- 172.21.15.5:0/872663724 >> 172.21.15.5:0/872663724 conn(0x7f01700665a0 msgr2=0x7f0170066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:43.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 -- 172.21.15.5:0/872663724 shutdown_connections 2023-10-16T13:48:43.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.187+0000 7f0175f29700 1 -- 172.21.15.5:0/872663724 wait complete. 2023-10-16T13:48:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.188+0000 7f0175f29700 1 Processor -- start 2023-10-16T13:48:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.188+0000 7f0175f29700 1 -- start start 2023-10-16T13:48:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f0175f29700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01700cf6d0 0x7f01700c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f0175f29700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01700d1bc0 0x7f0170150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f0175f29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 0x7f0170151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f0175f29700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700b6ac0 con 0x7f017015eab0 2023-10-16T13:48:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f0175f29700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01701510b0 con 0x7f01700cf6d0 2023-10-16T13:48:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f0175f29700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700ca1b0 con 0x7f01700d1bc0 2023-10-16T13:48:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 0x7f0170151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 0x7f0170151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49336/0 (socket says 172.21.15.5:49336) 2023-10-16T13:48:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 -- 172.21.15.5:0/931550833 learned_addr learned my addr 172.21.15.5:0/931550833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016f7fe700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01700cf6d0 0x7f01700c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016effd700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01700d1bc0 0x7f0170150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 -- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01700d1bc0 msgr2=0x7f0170150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01700d1bc0 0x7f0170150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 -- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01700cf6d0 msgr2=0x7f01700c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01700cf6d0 0x7f01700c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.189+0000 7f016ffff700 1 -- 172.21.15.5:0/931550833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009550 con 0x7f017015eab0 2023-10-16T13:48:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.190+0000 7f016ffff700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 0x7f0170151270 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f016800ef00 tx=0x7f016800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.190+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168010040 con 0x7f017015eab0 2023-10-16T13:48:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.190+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800b990 con 0x7f017015eab0 2023-10-16T13:48:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.190+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01700c9880 con 0x7f017015eab0 2023-10-16T13:48:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.190+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800bd40 con 0x7f017015eab0 2023-10-16T13:48:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.190+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01700c9e40 con 0x7f017015eab0 2023-10-16T13:48:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.191+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0170067d20 con 0x7f017015eab0 2023-10-16T13:48:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.191+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f016801d400 con 0x7f017015eab0 2023-10-16T13:48:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.191+0000 7f0167fff700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f015006b2f0 0x7f015006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.192+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f016808a110 con 0x7f017015eab0 2023-10-16T13:48:43.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.192+0000 7f016f7fe700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f015006b2f0 0x7f015006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.192+0000 7f016f7fe700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f015006b2f0 0x7f015006d7b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0160009be0 tx=0x7f0160009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:43.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.196+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0168054df0 con 0x7f017015eab0 2023-10-16T13:48:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.397+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01700ca2f0 con 0x7f017015eab0 2023-10-16T13:48:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.397+0000 7f0167fff700 1 -- 172.21.15.5:0/931550833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01680180a0 con 0x7f017015eab0 2023-10-16T13:48:43.401 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f015006b2f0 msgr2=0x7f015006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f015006b2f0 0x7f015006d7b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0160009be0 tx=0x7f0160009210 comp rx=0 tx=0).stop 2023-10-16T13:48:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 msgr2=0x7f0170151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 0x7f0170151270 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f016800ef00 tx=0x7f016800ef30 comp rx=0 tx=0).stop 2023-10-16T13:48:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 shutdown_connections 2023-10-16T13:48:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f017015eab0 0x7f0170151270 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01700cf6d0 0x7f01700c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f015006b2f0 0x7f015006d7b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 --2- 172.21.15.5:0/931550833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01700d1bc0 0x7f0170150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.399+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 >> 172.21.15.5:0/931550833 conn(0x7f01700665a0 msgr2=0x7f01700b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.400+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 shutdown_connections 2023-10-16T13:48:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.400+0000 7f0175f29700 1 -- 172.21.15.5:0/931550833 wait complete. 2023-10-16T13:48:43.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-16T13:48:43.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.537+0000 7ff2d81e9700 1 Processor -- start 2023-10-16T13:48:43.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.537+0000 7ff2d81e9700 1 -- start start 2023-10-16T13:48:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d81e9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2d00d1d90 0x7ff2d01688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d81e9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d00ccc20 con 0x7ff2d015eab0 2023-10-16T13:48:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d81e9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d015ee90 con 0x7ff2d00cf8a0 2023-10-16T13:48:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d81e9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d0158370 con 0x7ff2d00d1d90 2023-10-16T13:48:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d5f85700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2d015eab0 0x7ff2d00cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59344/0 (socket says 172.21.15.5:59344) 2023-10-16T13:48:43.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d5f85700 1 -- 172.21.15.5:0/560777288 learned_addr learned my addr 172.21.15.5:0/560777288 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:43.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d6786700 1 --2- 172.21.15.5:0/560777288 >> v2:172.21.15.112:3300/0 conn(0x7ff2d00d1d90 0x7ff2d01688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d4f83700 1 -- 172.21.15.5:0/560777288 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508822874 0 0) 0x7ff2d00ccc20 con 0x7ff2d015eab0 2023-10-16T13:48:43.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.538+0000 7ff2d4f83700 1 -- 172.21.15.5:0/560777288 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2bc0035b0 con 0x7ff2d015eab0 2023-10-16T13:48:43.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d6786700 1 -- 172.21.15.5:0/560777288 >> v1:172.21.15.112:6789/0 conn(0x7ff2d00cf8a0 legacy=0x7ff2d00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d6786700 1 -- 172.21.15.5:0/560777288 >> v1:172.21.15.5:6789/0 conn(0x7ff2d015eab0 legacy=0x7ff2d00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d6786700 1 -- 172.21.15.5:0/560777288 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00d23b0 con 0x7ff2d00d1d90 2023-10-16T13:48:43.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d6786700 1 --2- 172.21.15.5:0/560777288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00d1d90 0x7ff2d01688a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00d25a0 tx=0x7ff2c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2e2bb3bdb5cea17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:43.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d4f83700 1 -- 172.21.15.5:0/560777288 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8016070 con 0x7ff2d00d1d90 2023-10-16T13:48:43.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d4f83700 1 -- 172.21.15.5:0/560777288 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800bb20 con 0x7ff2d00d1d90 2023-10-16T13:48:43.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d4f83700 1 -- 172.21.15.5:0/560777288 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800e070 con 0x7ff2d00d1d90 2023-10-16T13:48:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d81e9700 1 -- 172.21.15.5:0/560777288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00d1d90 msgr2=0x7ff2d01688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/560777288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00d1d90 0x7ff2d01688a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00d25a0 tx=0x7ff2c800b330 comp rx=0 tx=0).stop 2023-10-16T13:48:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d81e9700 1 -- 172.21.15.5:0/560777288 shutdown_connections 2023-10-16T13:48:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/560777288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00d1d90 0x7ff2d01688a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.539+0000 7ff2d81e9700 1 -- 172.21.15.5:0/560777288 >> 172.21.15.5:0/560777288 conn(0x7ff2d00665a0 msgr2=0x7ff2d0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.540+0000 7ff2d81e9700 1 -- 172.21.15.5:0/560777288 shutdown_connections 2023-10-16T13:48:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.540+0000 7ff2d81e9700 1 -- 172.21.15.5:0/560777288 wait complete. 2023-10-16T13:48:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.541+0000 7ff2d81e9700 1 Processor -- start 2023-10-16T13:48:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.541+0000 7ff2d81e9700 1 -- start start 2023-10-16T13:48:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d81e9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00cf8a0 0x7ff2d0160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d81e9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2d00d1d90 0x7ff2d00b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d81e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 0x7ff2d00c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d81e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f7250 con 0x7ff2d015eab0 2023-10-16T13:48:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d81e9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f66d0 con 0x7ff2d00cf8a0 2023-10-16T13:48:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d81e9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f69b0 con 0x7ff2d00d1d90 2023-10-16T13:48:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d6786700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 0x7ff2d00c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d6786700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 0x7ff2d00c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49350/0 (socket says 172.21.15.5:49350) 2023-10-16T13:48:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d6786700 1 -- 172.21.15.5:0/2144221969 learned_addr learned my addr 172.21.15.5:0/2144221969 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d5f85700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00cf8a0 0x7ff2d0160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.542+0000 7ff2d5784700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2d00d1d90 0x7ff2d00b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d6786700 1 -- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2d00d1d90 msgr2=0x7ff2d00b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d6786700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2d00d1d90 0x7ff2d00b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d6786700 1 -- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00cf8a0 msgr2=0x7ff2d0160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d6786700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00cf8a0 0x7ff2d0160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d6786700 1 -- 172.21.15.5:0/2144221969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009a70 con 0x7ff2d015eab0 2023-10-16T13:48:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d5f85700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00cf8a0 0x7ff2d0160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d6786700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 0x7ff2d00c7220 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800b370 tx=0x7ff2c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8016040 con 0x7ff2d015eab0 2023-10-16T13:48:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c80098f0 con 0x7ff2d015eab0 2023-10-16T13:48:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d01f6c90 con 0x7ff2d015eab0 2023-10-16T13:48:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c801b680 con 0x7ff2d015eab0 2023-10-16T13:48:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.543+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d01f6360 con 0x7ff2d015eab0 2023-10-16T13:48:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.544+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d015f0e0 con 0x7ff2d015eab0 2023-10-16T13:48:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.544+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7ff2c801b7e0 con 0x7ff2d015eab0 2023-10-16T13:48:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.545+0000 7ff2c27fc700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff2b406b2f0 0x7ff2b406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.545+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2c808b1f0 con 0x7ff2d015eab0 2023-10-16T13:48:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.545+0000 7ff2d5f85700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff2b406b2f0 0x7ff2b406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.546+0000 7ff2d5f85700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff2b406b2f0 0x7ff2b406d7b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0011e0 tx=0x7ff2cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.550+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2d015f0e0 con 0x7ff2d015eab0 2023-10-16T13:48:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:43.834+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7ff2d015f0e0 con 0x7ff2d015eab0 2023-10-16T13:48:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.690+0000 7ff2c27fc700 1 -- 172.21.15.5:0/2144221969 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v451) v1 ==== 134+0+0 (secure 0 0 0) 0x7ff2d015f0e0 con 0x7ff2d015eab0 2023-10-16T13:48:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff2b406b2f0 msgr2=0x7ff2b406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff2b406b2f0 0x7ff2b406d7b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0011e0 tx=0x7ff2cc009040 comp rx=0 tx=0).stop 2023-10-16T13:48:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 msgr2=0x7ff2d00c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 0x7ff2d00c7220 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800b370 tx=0x7ff2c8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 shutdown_connections 2023-10-16T13:48:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d015eab0 0x7ff2d00c7220 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2d00cf8a0 0x7ff2d0160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.693+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff2b406b2f0 0x7ff2b406d7b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.694+0000 7ff2d81e9700 1 --2- 172.21.15.5:0/2144221969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2d00d1d90 0x7ff2d00b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.694+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 >> 172.21.15.5:0/2144221969 conn(0x7ff2d00665a0 msgr2=0x7ff2d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.694+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 shutdown_connections 2023-10-16T13:48:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.694+0000 7ff2d81e9700 1 -- 172.21.15.5:0/2144221969 wait complete. 2023-10-16T13:48:44.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:48:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.843+0000 7fc7dddba700 1 Processor -- start 2023-10-16T13:48:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.843+0000 7fc7dddba700 1 -- start start 2023-10-16T13:48:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.844+0000 7fc7dddba700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.844+0000 7fc7dddba700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7d80cfc60 0x7fc7d80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.844+0000 7fc7dddba700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d815e7a0 con 0x7fc7d815ab10 2023-10-16T13:48:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.844+0000 7fc7dddba700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d80d00d0 con 0x7fc7d80cfc60 2023-10-16T13:48:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.844+0000 7fc7dddba700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80b29a0 con 0x7fc7d815f1f0 2023-10-16T13:48:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7d80cfc60 0x7fc7d80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d80cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:47260/0 (socket says 172.21.15.5:47260) 2023-10-16T13:48:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d77fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc7d815ab10 0x7fc7d80b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50334/0 (socket says 172.21.15.5:50334) 2023-10-16T13:48:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/1808879518 learned_addr learned my addr 172.21.15.5:0/1808879518 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7d80cfc60 0x7fc7d80cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2023-10-16T13:48:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/1808879518 >> v2:172.21.15.112:3300/0 conn(0x7fc7d80cfc60 msgr2=0x7fc7d80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 --2- 172.21.15.5:0/1808879518 >> v2:172.21.15.112:3300/0 conn(0x7fc7d80cfc60 0x7fc7d80cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/1808879518 >> v1:172.21.15.112:6789/0 conn(0x7fc7d815ab10 legacy=0x7fc7d80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:44.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/1808879518 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d80b2c80 con 0x7fc7d815f1f0 2023-10-16T13:48:44.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d6ffd700 1 --2- 172.21.15.5:0/1808879518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d80cf720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc006fd0 tx=0x7fc7cc00be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef89489c7ddada94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:44.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d67fc700 1 -- 172.21.15.5:0/1808879518 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc005e30 con 0x7fc7d815f1f0 2023-10-16T13:48:44.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d67fc700 1 -- 172.21.15.5:0/1808879518 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc004030 con 0x7fc7d815f1f0 2023-10-16T13:48:44.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.845+0000 7fc7d67fc700 1 -- 172.21.15.5:0/1808879518 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0043e0 con 0x7fc7d815f1f0 2023-10-16T13:48:44.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 -- 172.21.15.5:0/1808879518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 msgr2=0x7fc7d80cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:44.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 --2- 172.21.15.5:0/1808879518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d80cf720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc006fd0 tx=0x7fc7cc00be70 comp rx=0 tx=0).stop 2023-10-16T13:48:44.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 -- 172.21.15.5:0/1808879518 shutdown_connections 2023-10-16T13:48:44.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 --2- 172.21.15.5:0/1808879518 >> v2:172.21.15.112:3300/0 conn(0x7fc7d80cfc60 0x7fc7d80cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 --2- 172.21.15.5:0/1808879518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d80cf720 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 -- 172.21.15.5:0/1808879518 >> 172.21.15.5:0/1808879518 conn(0x7fc7d806dae0 msgr2=0x7fc7d806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 -- 172.21.15.5:0/1808879518 shutdown_connections 2023-10-16T13:48:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.846+0000 7fc7dddba700 1 -- 172.21.15.5:0/1808879518 wait complete. 2023-10-16T13:48:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.847+0000 7fc7dddba700 1 Processor -- start 2023-10-16T13:48:44.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.847+0000 7fc7dddba700 1 -- start start 2023-10-16T13:48:44.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7dddba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d80cfc60 0x7fc7d80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:44.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7dddba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 0x7fc7d81efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:44.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7dddba700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d81488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:44.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7dddba700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80c8800 con 0x7fc7d815ab10 2023-10-16T13:48:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7dddba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81f0270 con 0x7fc7d80cfc60 2023-10-16T13:48:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7dddba700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80c8c20 con 0x7fc7d815f1f0 2023-10-16T13:48:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7d6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 0x7fc7d81efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7d6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 0x7fc7d81efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49362/0 (socket says 172.21.15.5:49362) 2023-10-16T13:48:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/3123156736 learned_addr learned my addr 172.21.15.5:0/3123156736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:44.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7d7fff700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d81488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:44.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7d77fe700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d80cfc60 0x7fc7d80c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:44.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.848+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 msgr2=0x7fc7d81488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:44.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7d6ffd700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d81488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d80cfc60 msgr2=0x7fc7d80c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7d6ffd700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d80cfc60 0x7fc7d80c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7d6ffd700 1 -- 172.21.15.5:0/3123156736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc00b7a0 con 0x7fc7d815ab10 2023-10-16T13:48:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7d6ffd700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 0x7fc7d81efd30 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00beb0 tx=0x7fc7cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc003ab0 con 0x7fc7d815ab10 2023-10-16T13:48:44.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc003c10 con 0x7fc7d815ab10 2023-10-16T13:48:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d80c7b80 con 0x7fc7d815ab10 2023-10-16T13:48:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc010470 con 0x7fc7d815ab10 2023-10-16T13:48:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.849+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d80c8140 con 0x7fc7d815ab10 2023-10-16T13:48:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.850+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d80c8940 con 0x7fc7d815ab10 2023-10-16T13:48:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.850+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fc7cc024400 con 0x7fc7d815ab10 2023-10-16T13:48:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.851+0000 7fc7bffff700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7c406b2f0 0x7fc7c406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:44.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.851+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc7cc08d660 con 0x7fc7d815ab10 2023-10-16T13:48:44.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.851+0000 7fc7d77fe700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7c406b2f0 0x7fc7c406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:44.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.851+0000 7fc7d77fe700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7c406b2f0 0x7fc7c406d7b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80cd940 tx=0x7fc7c8007f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:44.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:44.855+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7d80c8940 con 0x7fc7d815ab10 2023-10-16T13:48:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.055+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7d80c8940 con 0x7fc7d815ab10 2023-10-16T13:48:45.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.058+0000 7fc7bffff700 1 -- 172.21.15.5:0/3123156736 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7d80c8940 con 0x7fc7d815ab10 2023-10-16T13:48:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7c406b2f0 msgr2=0x7fc7c406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7c406b2f0 0x7fc7c406d7b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80cd940 tx=0x7fc7c8007f10 comp rx=0 tx=0).stop 2023-10-16T13:48:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 msgr2=0x7fc7d81efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 0x7fc7d81efd30 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00beb0 tx=0x7fc7cc004750 comp rx=0 tx=0).stop 2023-10-16T13:48:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 shutdown_connections 2023-10-16T13:48:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc7c406b2f0 0x7fc7c406d7b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7d815f1f0 0x7fc7d81488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d80cfc60 0x7fc7d80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 --2- 172.21.15.5:0/3123156736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d815ab10 0x7fc7d81efd30 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 >> 172.21.15.5:0/3123156736 conn(0x7fc7d806dae0 msgr2=0x7fc7d8158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 shutdown_connections 2023-10-16T13:48:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.060+0000 7fc7dddba700 1 -- 172.21.15.5:0/3123156736 wait complete. 2023-10-16T13:48:45.075 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:48:45.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:45.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:48:45.161 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:48:45.161 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:45.162 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:45.180 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:48:45.180 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:45.180 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:45.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:48:45.201 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:45.201 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:45.237 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:48:45.237 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:48:45.238 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:45.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:48:45.262 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:48:45.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:45.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.398+0000 7f7d10858700 1 Processor -- start 2023-10-16T13:48:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.399+0000 7f7d10858700 1 -- start start 2023-10-16T13:48:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.399+0000 7f7d10858700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c15b740 0x7f7d0c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.399+0000 7f7d10858700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d0c0ce6e0 0x7f7d0c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.399+0000 7f7d10858700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0cf190 con 0x7f7d0c0d0c70 2023-10-16T13:48:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.399+0000 7f7d10858700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c15bb20 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.399+0000 7f7d10858700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0cbd40 con 0x7f7d0c15b740 2023-10-16T13:48:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d0c0ce6e0 0x7f7d0c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d0c0ce6e0 0x7f7d0c0cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49372/0 (socket says 172.21.15.5:49372) 2023-10-16T13:48:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 -- 172.21.15.5:0/1585247435 learned_addr learned my addr 172.21.15.5:0/1585247435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0a59c700 1 --2- 172.21.15.5:0/1585247435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c15b740 0x7f7d0c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 -- 172.21.15.5:0/1585247435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c15b740 msgr2=0x7f7d0c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:45.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 --2- 172.21.15.5:0/1585247435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c15b740 0x7f7d0c0d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 -- 172.21.15.5:0/1585247435 >> v1:172.21.15.112:6789/0 conn(0x7f7d0c0d0c70 legacy=0x7f7d0c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 -- 172.21.15.5:0/1585247435 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0cc020 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0ad9d700 1 --2- 172.21.15.5:0/1585247435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c0cf690 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009e50 tx=0x7f7d0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54423b76bf94726d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:45.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0959a700 1 -- 172.21.15.5:0/1585247435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400e070 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0959a700 1 -- 172.21.15.5:0/1585247435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400b9c0 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.400+0000 7f7d0959a700 1 -- 172.21.15.5:0/1585247435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400bd70 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 -- 172.21.15.5:0/1585247435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 msgr2=0x7f7d0c0cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 --2- 172.21.15.5:0/1585247435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c0cf690 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009e50 tx=0x7f7d0400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 -- 172.21.15.5:0/1585247435 shutdown_connections 2023-10-16T13:48:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 --2- 172.21.15.5:0/1585247435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c0cf690 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 --2- 172.21.15.5:0/1585247435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c15b740 0x7f7d0c0d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 -- 172.21.15.5:0/1585247435 >> 172.21.15.5:0/1585247435 conn(0x7f7d0c0665a0 msgr2=0x7f7d0c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:45.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 -- 172.21.15.5:0/1585247435 shutdown_connections 2023-10-16T13:48:45.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.401+0000 7f7d10858700 1 -- 172.21.15.5:0/1585247435 wait complete. 2023-10-16T13:48:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.402+0000 7f7d10858700 1 Processor -- start 2023-10-16T13:48:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.402+0000 7f7d10858700 1 -- start start 2023-10-16T13:48:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d10858700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c1f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d10858700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c0d0c70 0x7f7d0c1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d10858700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d0c15b740 0x7f7d0c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d10858700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c97b0 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d10858700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c159380 con 0x7f7d0c15b740 2023-10-16T13:48:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d10858700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1f3f60 con 0x7f7d0c0d0c70 2023-10-16T13:48:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c1f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c1f0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49374/0 (socket says 172.21.15.5:49374) 2023-10-16T13:48:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 -- 172.21.15.5:0/651869712 learned_addr learned my addr 172.21.15.5:0/651869712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d09d9b700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c0d0c70 0x7f7d0c1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0ad9d700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d0c15b740 0x7f7d0c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 -- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c0d0c70 msgr2=0x7f7d0c1f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c0d0c70 0x7f7d0c1f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 -- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d0c15b740 msgr2=0x7f7d0c0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d0c15b740 0x7f7d0c0c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d0a59c700 1 -- 172.21.15.5:0/651869712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04009b30 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.403+0000 7f7d09d9b700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c0d0c70 0x7f7d0c1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.404+0000 7f7d0a59c700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c1f0640 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00d800 tx=0x7f7cfc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.404+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0125f0 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.404+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc012750 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.404+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c15eda0 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.404+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc012b00 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.404+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c0c8e10 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.405+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c067d20 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.405+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f7cfc012c60 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.406+0000 7f7d02ffd700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7cec06b2f0 0x7f7cec06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.406+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7cfc089e00 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.406+0000 7f7d09d9b700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7cec06b2f0 0x7f7cec06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.407+0000 7f7d09d9b700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7cec06b2f0 0x7f7cec06d7b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0cffb0 tx=0x7f7cf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.411+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7cfc054bd0 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.657+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d0c0c6070 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.657+0000 7f7d02ffd700 1 -- 172.21.15.5:0/651869712 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f7cfc0581f0 con 0x7f7d0c0ce6e0 2023-10-16T13:48:45.661 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2048914737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2048914737},{"type":"v1","addr":"172.21.15.112:6837","nonce":2048914737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3804435435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3804435435},{"type":"v1","addr":"172.21.15.112:6835","nonce":3804435435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3326672377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3326672377},{"type":"v1","addr":"172.21.15.5:6834","nonce":3326672377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1858800518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1858800518},{"type":"v1","addr":"172.21.15.5:6835","nonce":1858800518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[]} 2023-10-16T13:48:45.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7cec06b2f0 msgr2=0x7f7cec06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7cec06b2f0 0x7f7cec06d7b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0cffb0 tx=0x7f7cf4009040 comp rx=0 tx=0).stop 2023-10-16T13:48:45.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 msgr2=0x7f7d0c1f0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c1f0640 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00d800 tx=0x7f7cfc00dbc0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 shutdown_connections 2023-10-16T13:48:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d0c15b740 0x7f7d0c0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d0c0ce6e0 0x7f7d0c1f0640 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7cec06b2f0 0x7f7cec06d7b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 --2- 172.21.15.5:0/651869712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d0c0d0c70 0x7f7d0c1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 >> 172.21.15.5:0/651869712 conn(0x7f7d0c0665a0 msgr2=0x7f7d0c0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 shutdown_connections 2023-10-16T13:48:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.660+0000 7f7d10858700 1 -- 172.21.15.5:0/651869712 wait complete. 2023-10-16T13:48:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-10-16T13:48:45.675 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:48:45.675 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:48:45.676 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:48:45.676 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:45.676 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:48:45.676 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:48:45.677 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:48:45.677 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:45.677 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:48:45.677 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:48:45.678 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:48:45.678 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:45.678 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:48:45.678 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:48:45.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:48:45.679 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:48:45.686 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:48:45.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:48:45.687 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:48:45.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:48:45.689 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:48:45.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:48:45.690 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:48:45.690 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:48:45.729 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:48:45.729 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:45.730 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:48:45.730 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:45.733 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:48:45.733 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:45.733 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:48:45.734 DEBUG:teuthology.parallel:result is None 2023-10-16T13:48:45.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:48:45.810 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:48:45.811 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:48:45.820 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:48:45.821 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:48:45.821 INFO:tasks.ceph.mds.b.smithi112.stderr:2023-10-16T13:48:45.818+0000 7f9ca267a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-16T13:48:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.865+0000 7fd253860700 1 Processor -- start 2023-10-16T13:48:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.865+0000 7fd253860700 1 -- start start 2023-10-16T13:48:45.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd253860700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd24c15d9e0 0x7fd24c15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd253860700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd24c161f10 0x7fd24c0d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd253860700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0ce350 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd253860700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c0b5140 con 0x7fd24c15d9e0 2023-10-16T13:48:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd253860700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c162630 con 0x7fd24c161f10 2023-10-16T13:48:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd2515fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd24c15d9e0 0x7fd24c15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd250dfb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd24c0d1fc0 0x7fd24c161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59412/0 (socket says 172.21.15.5:59412) 2023-10-16T13:48:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd2515fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd24c15d9e0 0x7fd24c15ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49408/0 (socket says 172.21.15.5:49408) 2023-10-16T13:48:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd250dfb700 1 -- 172.21.15.5:0/3149039157 learned_addr learned my addr 172.21.15.5:0/3149039157 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd251dfd700 1 --2- 172.21.15.5:0/3149039157 >> v2:172.21.15.112:3300/0 conn(0x7fd24c161f10 0x7fd24c0d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd2515fc700 1 -- 172.21.15.5:0/3149039157 >> v2:172.21.15.112:3300/0 conn(0x7fd24c161f10 msgr2=0x7fd24c0d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd2515fc700 1 --2- 172.21.15.5:0/3149039157 >> v2:172.21.15.112:3300/0 conn(0x7fd24c161f10 0x7fd24c0d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd2515fc700 1 -- 172.21.15.5:0/3149039157 >> v1:172.21.15.5:6789/0 conn(0x7fd24c0d1fc0 legacy=0x7fd24c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd243fff700 1 -- 172.21.15.5:0/3149039157 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545503844 0 0) 0x7fd24c0ce350 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.866+0000 7fd2515fc700 1 -- 172.21.15.5:0/3149039157 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0ce5f0 con 0x7fd24c15d9e0 2023-10-16T13:48:45.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd2515fc700 1 --2- 172.21.15.5:0/3149039157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c15d9e0 0x7fd24c15ddc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0d1300 tx=0x7fd248009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb93e25e85992c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd243fff700 1 -- 172.21.15.5:0/3149039157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248011830 con 0x7fd24c15d9e0 2023-10-16T13:48:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd243fff700 1 -- 172.21.15.5:0/3149039157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248011990 con 0x7fd24c15d9e0 2023-10-16T13:48:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd243fff700 1 -- 172.21.15.5:0/3149039157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248011d20 con 0x7fd24c15d9e0 2023-10-16T13:48:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 -- 172.21.15.5:0/3149039157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c15d9e0 msgr2=0x7fd24c15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 --2- 172.21.15.5:0/3149039157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c15d9e0 0x7fd24c15ddc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0d1300 tx=0x7fd248009b20 comp rx=0 tx=0).stop 2023-10-16T13:48:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 -- 172.21.15.5:0/3149039157 shutdown_connections 2023-10-16T13:48:45.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 --2- 172.21.15.5:0/3149039157 >> v2:172.21.15.112:3300/0 conn(0x7fd24c161f10 0x7fd24c0d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 --2- 172.21.15.5:0/3149039157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c15d9e0 0x7fd24c15ddc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 -- 172.21.15.5:0/3149039157 >> 172.21.15.5:0/3149039157 conn(0x7fd24c09cb40 msgr2=0x7fd24c0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 -- 172.21.15.5:0/3149039157 shutdown_connections 2023-10-16T13:48:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.867+0000 7fd253860700 1 -- 172.21.15.5:0/3149039157 wait complete. 2023-10-16T13:48:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 Processor -- start 2023-10-16T13:48:45.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 -- start start 2023-10-16T13:48:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 0x7fd24c160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd24c15d9e0 0x7fd24c0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd24c161f10 0x7fd24c0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c9c20 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c8d40 con 0x7fd24c15d9e0 2023-10-16T13:48:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.869+0000 7fd253860700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c9010 con 0x7fd24c161f10 2023-10-16T13:48:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 0x7fd24c160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 0x7fd24c160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49414/0 (socket says 172.21.15.5:49414) 2023-10-16T13:48:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 -- 172.21.15.5:0/3736784050 learned_addr learned my addr 172.21.15.5:0/3736784050 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd250dfb700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd24c15d9e0 0x7fd24c0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd251dfd700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd24c161f10 0x7fd24c0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 -- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd24c161f10 msgr2=0x7fd24c0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd24c161f10 0x7fd24c0c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 -- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd24c15d9e0 msgr2=0x7fd24c0c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd24c15d9e0 0x7fd24c0c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:45.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 -- 172.21.15.5:0/3736784050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480094a0 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd2515fc700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 0x7fd24c160530 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd2480090b0 tx=0x7fd248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480036a0 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24801f070 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0c92f0 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248003a60 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.870+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0c98b0 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.871+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c067d20 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.872+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fd248003bc0 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.872+0000 7fd241ffb700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd23006b2f0 0x7fd23006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.873+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd248021070 con 0x7fd24c0d1fc0 2023-10-16T13:48:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.873+0000 7fd250dfb700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd23006b2f0 0x7fd23006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.873+0000 7fd250dfb700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd23006b2f0 0x7fd23006d7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0c6c60 tx=0x7fd23c007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:45.877+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd248055fc0 con 0x7fd24c0d1fc0 2023-10-16T13:48:46.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:46.095+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd24c08d8d0 con 0x7fd24c0d1fc0 2023-10-16T13:48:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.078+0000 7fd241ffb700 1 -- 172.21.15.5:0/3736784050 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v106) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd248015020 con 0x7fd24c0d1fc0 2023-10-16T13:48:47.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd23006b2f0 msgr2=0x7fd23006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd23006b2f0 0x7fd23006d7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0c6c60 tx=0x7fd23c007de0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 msgr2=0x7fd24c160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 0x7fd24c160530 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd2480090b0 tx=0x7fd248004750 comp rx=0 tx=0).stop 2023-10-16T13:48:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 shutdown_connections 2023-10-16T13:48:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd23006b2f0 0x7fd23006d7b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd24c161f10 0x7fd24c0c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24c0d1fc0 0x7fd24c160530 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 --2- 172.21.15.5:0/3736784050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd24c15d9e0 0x7fd24c0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 >> 172.21.15.5:0/3736784050 conn(0x7fd24c09cb40 msgr2=0x7fd24c0d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 shutdown_connections 2023-10-16T13:48:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.081+0000 7fd253860700 1 -- 172.21.15.5:0/3736784050 wait complete. 2023-10-16T13:48:47.087 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:48:47.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:48:47.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.227+0000 7f3e5ba04700 1 Processor -- start 2023-10-16T13:48:47.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.228+0000 7f3e5ba04700 1 -- start start 2023-10-16T13:48:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.228+0000 7f3e5ba04700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e5415eab0 0x7f3e540cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.228+0000 7f3e5ba04700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e540cf6d0 0x7f3e540d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.228+0000 7f3e5ba04700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e540ccc20 con 0x7f3e540d1bc0 2023-10-16T13:48:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e5ba04700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e540cfb60 con 0x7f3e5415eab0 2023-10-16T13:48:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e5ba04700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5415ee90 con 0x7f3e540cf6d0 2023-10-16T13:48:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e5415eab0 0x7f3e540cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e5415eab0 0x7f3e540cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49426/0 (socket says 172.21.15.5:49426) 2023-10-16T13:48:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 -- 172.21.15.5:0/1871146160 learned_addr learned my addr 172.21.15.5:0/1871146160 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e58f9f700 1 --2- 172.21.15.5:0/1871146160 >> v2:172.21.15.112:3300/0 conn(0x7f3e540cf6d0 0x7f3e540d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 -- 172.21.15.5:0/1871146160 >> v2:172.21.15.112:3300/0 conn(0x7f3e540cf6d0 msgr2=0x7f3e540d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 --2- 172.21.15.5:0/1871146160 >> v2:172.21.15.112:3300/0 conn(0x7f3e540cf6d0 0x7f3e540d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 -- 172.21.15.5:0/1871146160 >> v1:172.21.15.112:6789/0 conn(0x7f3e540d1bc0 legacy=0x7f3e54161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 -- 172.21.15.5:0/1871146160 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54158370 con 0x7f3e5415eab0 2023-10-16T13:48:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e597a0700 1 --2- 172.21.15.5:0/1871146160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e5415eab0 0x7f3e540cf190 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f3e5406da90 tx=0x7f3e48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418e92a3e841579a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e47fff700 1 -- 172.21.15.5:0/1871146160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011830 con 0x7f3e5415eab0 2023-10-16T13:48:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e47fff700 1 -- 172.21.15.5:0/1871146160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48011990 con 0x7f3e5415eab0 2023-10-16T13:48:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.229+0000 7f3e47fff700 1 -- 172.21.15.5:0/1871146160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011d20 con 0x7f3e5415eab0 2023-10-16T13:48:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1871146160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e5415eab0 msgr2=0x7f3e540cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1871146160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e5415eab0 0x7f3e540cf190 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f3e5406da90 tx=0x7f3e48009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1871146160 shutdown_connections 2023-10-16T13:48:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1871146160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e5415eab0 0x7f3e540cf190 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1871146160 >> v2:172.21.15.112:3300/0 conn(0x7f3e540cf6d0 0x7f3e540d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1871146160 >> 172.21.15.5:0/1871146160 conn(0x7f3e540665a0 msgr2=0x7f3e54066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1871146160 shutdown_connections 2023-10-16T13:48:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.230+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1871146160 wait complete. 2023-10-16T13:48:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.232+0000 7f3e5ba04700 1 Processor -- start 2023-10-16T13:48:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.232+0000 7f3e5ba04700 1 -- start start 2023-10-16T13:48:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e5ba04700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e540cf6d0 0x7f3e54160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e5ba04700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 0x7f3e54155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e5ba04700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e5415eab0 0x7f3e540b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e5ba04700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540cb770 con 0x7f3e540d1bc0 2023-10-16T13:48:47.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e5ba04700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e54155fe0 con 0x7f3e540cf6d0 2023-10-16T13:48:47.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e5ba04700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540cb490 con 0x7f3e5415eab0 2023-10-16T13:48:47.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 0x7f3e54155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 0x7f3e54155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49434/0 (socket says 172.21.15.5:49434) 2023-10-16T13:48:47.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 -- 172.21.15.5:0/1121683730 learned_addr learned my addr 172.21.15.5:0/1121683730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e597a0700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e540cf6d0 0x7f3e54160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e59fa1700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e5415eab0 0x7f3e540b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 -- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e5415eab0 msgr2=0x7f3e540b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e5415eab0 0x7f3e540b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 -- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e540cf6d0 msgr2=0x7f3e54160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e540cf6d0 0x7f3e54160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 -- 172.21.15.5:0/1121683730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e48009550 con 0x7f3e540d1bc0 2023-10-16T13:48:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e59fa1700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e5415eab0 0x7f3e540b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e58f9f700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 0x7f3e54155aa0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e9b0 tx=0x7f3e5000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50009710 con 0x7f3e540d1bc0 2023-10-16T13:48:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.233+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000c850 con 0x7f3e540d1bc0 2023-10-16T13:48:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.234+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e54160200 con 0x7f3e540d1bc0 2023-10-16T13:48:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.234+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000cbc0 con 0x7f3e540d1bc0 2023-10-16T13:48:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.234+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541607c0 con 0x7f3e540d1bc0 2023-10-16T13:48:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.235+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e54160b30 con 0x7f3e540d1bc0 2023-10-16T13:48:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.235+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f3e5000cd20 con 0x7f3e540d1bc0 2023-10-16T13:48:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.235+0000 7f3e45ffb700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3e3806b2f0 0x7f3e3806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.236+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e50089a30 con 0x7f3e540d1bc0 2023-10-16T13:48:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.236+0000 7f3e597a0700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3e3806b2f0 0x7f3e3806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.236+0000 7f3e597a0700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3e3806b2f0 0x7f3e3806d7b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3e48014040 tx=0x7f3e48008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.241+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e500548a0 con 0x7f3e540d1bc0 2023-10-16T13:48:47.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.522+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3e54067d20 con 0x7f3e540d1bc0 2023-10-16T13:48:47.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.523+0000 7f3e45ffb700 1 -- 172.21.15.5:0/1121683730 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3e50021090 con 0x7f3e540d1bc0 2023-10-16T13:48:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:47.526 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:48:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:48:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:48:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:48:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:48:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:48:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:48:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:48:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:48:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:48:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:48:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:48:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:48:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:48:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:48:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:48:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:48:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:48:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:48:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:48:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:48:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:48:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:48:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:48:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:48:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:48:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:48:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:48:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:48:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:48:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:48:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:48:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:48:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:48:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:48:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:48:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:48:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:48:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:48:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:48:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:48:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:48:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:48:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:48:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:48:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:48:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:48:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:48:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:48:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:48:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:48:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:48:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:48:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:48:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:48:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:48:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:48:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:48:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:48:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:48:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:48:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:48:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:48:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:48:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:48:47.560 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:48:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3e3806b2f0 msgr2=0x7f3e3806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3e3806b2f0 0x7f3e3806d7b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3e48014040 tx=0x7f3e48008030 comp rx=0 tx=0).stop 2023-10-16T13:48:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 msgr2=0x7f3e54155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 0x7f3e54155aa0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e9b0 tx=0x7f3e5000ecc0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 shutdown_connections 2023-10-16T13:48:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3e3806b2f0 0x7f3e3806d7b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e5415eab0 0x7f3e540b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e540cf6d0 0x7f3e54160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 --2- 172.21.15.5:0/1121683730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e540d1bc0 0x7f3e54155aa0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 >> 172.21.15.5:0/1121683730 conn(0x7f3e540665a0 msgr2=0x7f3e540b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 shutdown_connections 2023-10-16T13:48:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.525+0000 7f3e5ba04700 1 -- 172.21.15.5:0/1121683730 wait complete. 2023-10-16T13:48:47.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.687+0000 7f6249c32700 1 Processor -- start 2023-10-16T13:48:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.687+0000 7f6249c32700 1 -- start start 2023-10-16T13:48:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6249c32700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f624415eab0 0x7f62440cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6249c32700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62440cf6d0 0x7f62440d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6249c32700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62440d1bc0 0x7f6244161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6249c32700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440cfb30 con 0x7f62440d1bc0 2023-10-16T13:48:47.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6249c32700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624415ee90 con 0x7f624415eab0 2023-10-16T13:48:47.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6249c32700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6244158370 con 0x7f62440cf6d0 2023-10-16T13:48:47.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6243fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62440d1bc0 0x7f6244161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6243fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62440d1bc0 0x7f6244161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49444/0 (socket says 172.21.15.5:49444) 2023-10-16T13:48:47.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6243fff700 1 -- 172.21.15.5:0/698401026 learned_addr learned my addr 172.21.15.5:0/698401026 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:47.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f62437fe700 1 --2- 172.21.15.5:0/698401026 >> v2:172.21.15.112:3300/0 conn(0x7f624415eab0 0x7f62440cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.688+0000 7f6242ffd700 1 --2- 172.21.15.5:0/698401026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62440cf6d0 0x7f62440d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6243fff700 1 -- 172.21.15.5:0/698401026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62440cf6d0 msgr2=0x7f62440d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6243fff700 1 --2- 172.21.15.5:0/698401026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62440cf6d0 0x7f62440d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6243fff700 1 -- 172.21.15.5:0/698401026 >> v2:172.21.15.112:3300/0 conn(0x7f624415eab0 msgr2=0x7f62440cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6243fff700 1 --2- 172.21.15.5:0/698401026 >> v2:172.21.15.112:3300/0 conn(0x7f624415eab0 0x7f62440cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6243fff700 1 -- 172.21.15.5:0/698401026 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440d23b0 con 0x7f62440d1bc0 2023-10-16T13:48:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6243fff700 1 --2- 172.21.15.5:0/698401026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f6244161510 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6244067550 tx=0x7f623c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad2b67cd44d83f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f62427fc700 1 -- 172.21.15.5:0/698401026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00e070 con 0x7f62440d1bc0 2023-10-16T13:48:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f62427fc700 1 -- 172.21.15.5:0/698401026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00b910 con 0x7f62440d1bc0 2023-10-16T13:48:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f62427fc700 1 -- 172.21.15.5:0/698401026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00bcc0 con 0x7f62440d1bc0 2023-10-16T13:48:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 -- 172.21.15.5:0/698401026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 msgr2=0x7f6244161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 --2- 172.21.15.5:0/698401026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f6244161510 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6244067550 tx=0x7f623c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:47.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 -- 172.21.15.5:0/698401026 shutdown_connections 2023-10-16T13:48:47.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 --2- 172.21.15.5:0/698401026 >> v2:172.21.15.112:3300/0 conn(0x7f624415eab0 0x7f62440cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 --2- 172.21.15.5:0/698401026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f6244161510 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 --2- 172.21.15.5:0/698401026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62440cf6d0 0x7f62440d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.689+0000 7f6249c32700 1 -- 172.21.15.5:0/698401026 >> 172.21.15.5:0/698401026 conn(0x7f62440665a0 msgr2=0x7f6244066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:47.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.690+0000 7f6249c32700 1 -- 172.21.15.5:0/698401026 shutdown_connections 2023-10-16T13:48:47.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.690+0000 7f6249c32700 1 -- 172.21.15.5:0/698401026 wait complete. 2023-10-16T13:48:47.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.691+0000 7f6249c32700 1 Processor -- start 2023-10-16T13:48:47.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.691+0000 7f6249c32700 1 -- start start 2023-10-16T13:48:47.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6249c32700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62440cf6d0 0x7f62441600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6249c32700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f62440c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6249c32700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f624415eab0 0x7f62440c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6249c32700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440ca400 con 0x7f62440d1bc0 2023-10-16T13:48:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6249c32700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6244160620 con 0x7f62440cf6d0 2023-10-16T13:48:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6249c32700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62441f3f00 con 0x7f624415eab0 2023-10-16T13:48:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f62440c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f62440c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49448/0 (socket says 172.21.15.5:49448) 2023-10-16T13:48:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 -- 172.21.15.5:0/1537638151 learned_addr learned my addr 172.21.15.5:0/1537638151 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:47.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f62437fe700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62440cf6d0 0x7f62441600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6243fff700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f624415eab0 0x7f62440c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 -- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f624415eab0 msgr2=0x7f62440c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f624415eab0 0x7f62440c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 -- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62440cf6d0 msgr2=0x7f62441600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62440cf6d0 0x7f62441600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 -- 172.21.15.5:0/1537638151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c009b30 con 0x7f62440d1bc0 2023-10-16T13:48:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f62437fe700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62440cf6d0 0x7f62441600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.692+0000 7f6242ffd700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f62440c5f90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f622c00e8a0 tx=0x7f622c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.693+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00ee40 con 0x7f62440d1bc0 2023-10-16T13:48:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.693+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c00c850 con 0x7f62440d1bc0 2023-10-16T13:48:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.693+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62440c9a60 con 0x7f62440d1bc0 2023-10-16T13:48:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.693+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00cc00 con 0x7f62440d1bc0 2023-10-16T13:48:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.693+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62440c9df0 con 0x7f62440d1bc0 2023-10-16T13:48:47.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.693+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6244067d20 con 0x7f62440d1bc0 2023-10-16T13:48:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.694+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f622c00cd60 con 0x7f62440d1bc0 2023-10-16T13:48:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.695+0000 7f623bfff700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f622406b2f0 0x7f622406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.695+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f622c089820 con 0x7f62440d1bc0 2023-10-16T13:48:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.695+0000 7f62437fe700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f622406b2f0 0x7f622406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.695+0000 7f62437fe700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f622406b2f0 0x7f622406d7b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6234009c30 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:47.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.699+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f622c0546d0 con 0x7f62440d1bc0 2023-10-16T13:48:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.904+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f624415d590 con 0x7f62440d1bc0 2023-10-16T13:48:47.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.905+0000 7f623bfff700 1 -- 172.21.15.5:0/1537638151 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+12787 (secure 0 0 0) 0x7f622c057cf0 con 0x7f62440d1bc0 2023-10-16T13:48:47.907 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:47.908 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":106,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:47.077333+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f622406b2f0 msgr2=0x7f622406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f622406b2f0 0x7f622406d7b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6234009c30 tx=0x7f6234008040 comp rx=0 tx=0).stop 2023-10-16T13:48:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 msgr2=0x7f62440c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f62440c5f90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f622c00e8a0 tx=0x7f622c00ec60 comp rx=0 tx=0).stop 2023-10-16T13:48:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 shutdown_connections 2023-10-16T13:48:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f622406b2f0 0x7f622406d7b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f624415eab0 0x7f62440c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62440cf6d0 0x7f62441600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 --2- 172.21.15.5:0/1537638151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d1bc0 0x7f62440c5f90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 >> 172.21.15.5:0/1537638151 conn(0x7f62440665a0 msgr2=0x7f62440b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 shutdown_connections 2023-10-16T13:48:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:47.907+0000 7f6249c32700 1 -- 172.21.15.5:0/1537638151 wait complete. 2023-10-16T13:48:47.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:48:47.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:48:48.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.047+0000 7f88b7df2700 1 Processor -- start 2023-10-16T13:48:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.048+0000 7f88b7df2700 1 -- start start 2023-10-16T13:48:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.048+0000 7f88b7df2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88b015b740 0x7f88b00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.048+0000 7f88b7df2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00d0c70 0x7f88b00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.048+0000 7f88b7df2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b00cf190 con 0x7f88b00c5110 2023-10-16T13:48:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.048+0000 7f88b7df2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b015bb20 con 0x7f88b015b740 2023-10-16T13:48:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.048+0000 7f88b7df2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00cbd40 con 0x7f88b00d0c70 2023-10-16T13:48:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b5b8e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88b015b740 0x7f88b00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b638f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88b00c5110 0x7f88b00cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59462/0 (socket says 172.21.15.5:59462) 2023-10-16T13:48:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b638f700 1 -- 172.21.15.5:0/3670294685 learned_addr learned my addr 172.21.15.5:0/3670294685 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b538d700 1 --2- 172.21.15.5:0/3670294685 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00d0c70 0x7f88b00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b5b8e700 1 -- 172.21.15.5:0/3670294685 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00d0c70 msgr2=0x7f88b00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b5b8e700 1 --2- 172.21.15.5:0/3670294685 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00d0c70 0x7f88b00cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b5b8e700 1 -- 172.21.15.5:0/3670294685 >> v1:172.21.15.5:6789/0 conn(0x7f88b00c5110 legacy=0x7f88b00cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b4b8c700 1 -- 172.21.15.5:0/3670294685 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469168419 0 0) 0x7f88b00cf190 con 0x7f88b00c5110 2023-10-16T13:48:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b5b8e700 1 -- 172.21.15.5:0/3670294685 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00cc020 con 0x7f88b015b740 2023-10-16T13:48:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b5b8e700 1 --2- 172.21.15.5:0/3670294685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b00d1cd0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009840 tx=0x7f88ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c58ef6b543aeef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b4b8c700 1 -- 172.21.15.5:0/3670294685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011830 con 0x7f88b015b740 2023-10-16T13:48:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b4b8c700 1 -- 172.21.15.5:0/3670294685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac011990 con 0x7f88b015b740 2023-10-16T13:48:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.049+0000 7f88b4b8c700 1 -- 172.21.15.5:0/3670294685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011d20 con 0x7f88b015b740 2023-10-16T13:48:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 -- 172.21.15.5:0/3670294685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 msgr2=0x7f88b00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 --2- 172.21.15.5:0/3670294685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b00d1cd0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009840 tx=0x7f88ac009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 -- 172.21.15.5:0/3670294685 shutdown_connections 2023-10-16T13:48:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 --2- 172.21.15.5:0/3670294685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b00d1cd0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 --2- 172.21.15.5:0/3670294685 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00d0c70 0x7f88b00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 -- 172.21.15.5:0/3670294685 >> 172.21.15.5:0/3670294685 conn(0x7f88b00665a0 msgr2=0x7f88b0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 -- 172.21.15.5:0/3670294685 shutdown_connections 2023-10-16T13:48:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.050+0000 7f88b7df2700 1 -- 172.21.15.5:0/3670294685 wait complete. 2023-10-16T13:48:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.051+0000 7f88b7df2700 1 Processor -- start 2023-10-16T13:48:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.051+0000 7f88b7df2700 1 -- start start 2023-10-16T13:48:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b7df2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00c5110 0x7f88b015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b7df2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00d0c70 0x7f88b006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b7df2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b01f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b7df2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0157360 con 0x7f88b015b740 2023-10-16T13:48:48.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b7df2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00b42d0 con 0x7f88b00d0c70 2023-10-16T13:48:48.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b7df2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01f3370 con 0x7f88b00c5110 2023-10-16T13:48:48.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b01f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b01f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49464/0 (socket says 172.21.15.5:49464) 2023-10-16T13:48:48.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 -- 172.21.15.5:0/1596282623 learned_addr learned my addr 172.21.15.5:0/1596282623 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:48.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b5b8e700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00c5110 0x7f88b015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b538d700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00d0c70 0x7f88b006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 -- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00c5110 msgr2=0x7f88b015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00c5110 0x7f88b015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 -- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00d0c70 msgr2=0x7f88b006d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00d0c70 0x7f88b006d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 -- 172.21.15.5:0/1596282623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0094a0 con 0x7f88b015b740 2023-10-16T13:48:48.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b538d700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00d0c70 0x7f88b006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:48.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.052+0000 7f88b638f700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b01f29f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f88a800cc70 tx=0x7f88a800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.053+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800ab50 con 0x7f88b015b740 2023-10-16T13:48:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.053+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800acd0 con 0x7f88b015b740 2023-10-16T13:48:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.053+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8007310 con 0x7f88b015b740 2023-10-16T13:48:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.053+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b01f3650 con 0x7f88b015b740 2023-10-16T13:48:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.053+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b01f3c10 con 0x7f88b015b740 2023-10-16T13:48:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.054+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b01f3e30 con 0x7f88b015b740 2023-10-16T13:48:48.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.054+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f88a8007470 con 0x7f88b015b740 2023-10-16T13:48:48.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.055+0000 7f88a27fc700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889406b2f0 0x7f889406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.055+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f88a8089480 con 0x7f88b015b740 2023-10-16T13:48:48.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.055+0000 7f88b5b8e700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889406b2f0 0x7f889406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.055+0000 7f88b5b8e700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889406b2f0 0x7f889406d7b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0090b0 tx=0x7f88ac01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.059+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88a80542a0 con 0x7f88b015b740 2023-10-16T13:48:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.259+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88b0067d20 con 0x7f88b015b740 2023-10-16T13:48:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.259+0000 7f88a27fc700 1 -- 172.21.15.5:0/1596282623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88a8018020 con 0x7f88b015b740 2023-10-16T13:48:48.263 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:48:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889406b2f0 msgr2=0x7f889406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889406b2f0 0x7f889406d7b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0090b0 tx=0x7f88ac01c040 comp rx=0 tx=0).stop 2023-10-16T13:48:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 msgr2=0x7f88b01f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b01f29f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f88a800cc70 tx=0x7f88a800cf80 comp rx=0 tx=0).stop 2023-10-16T13:48:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 shutdown_connections 2023-10-16T13:48:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88b015b740 0x7f88b01f29f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f889406b2f0 0x7f889406d7b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f88b00c5110 0x7f88b015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 --2- 172.21.15.5:0/1596282623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88b00d0c70 0x7f88b006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 >> 172.21.15.5:0/1596282623 conn(0x7f88b00665a0 msgr2=0x7f88b0159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 shutdown_connections 2023-10-16T13:48:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.261+0000 7f88b7df2700 1 -- 172.21.15.5:0/1596282623 wait complete. 2023-10-16T13:48:48.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:48:48.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.398+0000 7f9826205700 1 Processor -- start 2023-10-16T13:48:48.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.398+0000 7f9826205700 1 -- start start 2023-10-16T13:48:48.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f9826205700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f9826205700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98200d08a0 0x7f98200ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f9826205700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200b6610 con 0x7f9820161210 2023-10-16T13:48:48.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f9826205700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200d1da0 con 0x7f98200d08a0 2023-10-16T13:48:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f9826205700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200d2080 con 0x7f9820160e30 2023-10-16T13:48:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f981ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98200d08a0 0x7f98200ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f981ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98200d08a0 0x7f98200ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49470/0 (socket says 172.21.15.5:49470) 2023-10-16T13:48:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.399+0000 7f981ffff700 1 -- 172.21.15.5:0/3066430123 learned_addr learned my addr 172.21.15.5:0/3066430123 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981f7fe700 1 --2- 172.21.15.5:0/3066430123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981ffff700 1 -- 172.21.15.5:0/3066430123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 msgr2=0x7f98200d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:48.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981ffff700 1 --2- 172.21.15.5:0/3066430123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981ffff700 1 -- 172.21.15.5:0/3066430123 >> v1:172.21.15.112:6789/0 conn(0x7f9820161210 legacy=0x7f98200d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981ffff700 1 -- 172.21.15.5:0/3066430123 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200d2360 con 0x7f98200d08a0 2023-10-16T13:48:48.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981ffff700 1 --2- 172.21.15.5:0/3066430123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f98200ce3d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f9818009e50 tx=0x7f981800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b734697ac72f038 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981e7fc700 1 -- 172.21.15.5:0/3066430123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800e070 con 0x7f98200d08a0 2023-10-16T13:48:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981e7fc700 1 -- 172.21.15.5:0/3066430123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800b910 con 0x7f98200d08a0 2023-10-16T13:48:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.400+0000 7f981e7fc700 1 -- 172.21.15.5:0/3066430123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800bcc0 con 0x7f98200d08a0 2023-10-16T13:48:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 -- 172.21.15.5:0/3066430123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 msgr2=0x7f98200ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 --2- 172.21.15.5:0/3066430123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f98200ce3d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f9818009e50 tx=0x7f981800b330 comp rx=0 tx=0).stop 2023-10-16T13:48:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 -- 172.21.15.5:0/3066430123 shutdown_connections 2023-10-16T13:48:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 --2- 172.21.15.5:0/3066430123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f98200ce3d0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 --2- 172.21.15.5:0/3066430123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 -- 172.21.15.5:0/3066430123 >> 172.21.15.5:0/3066430123 conn(0x7f982009cb40 msgr2=0x7f98200d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 -- 172.21.15.5:0/3066430123 shutdown_connections 2023-10-16T13:48:48.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.401+0000 7f9826205700 1 -- 172.21.15.5:0/3066430123 wait complete. 2023-10-16T13:48:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.402+0000 7f9826205700 1 Processor -- start 2023-10-16T13:48:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.402+0000 7f9826205700 1 -- start start 2023-10-16T13:48:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9826205700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f982014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9826205700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9826205700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161210 0x7f98200cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9826205700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982015b430 con 0x7f98200d08a0 2023-10-16T13:48:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9826205700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200c8c70 con 0x7f9820161210 2023-10-16T13:48:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9826205700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200cc1c0 con 0x7f9820160e30 2023-10-16T13:48:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f982014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f982014e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49474/0 (socket says 172.21.15.5:49474) 2023-10-16T13:48:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 -- 172.21.15.5:0/2122326346 learned_addr learned my addr 172.21.15.5:0/2122326346 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:48.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981effd700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981ffff700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161210 0x7f98200cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 -- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 msgr2=0x7f98200ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 -- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161210 msgr2=0x7f98200cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161210 0x7f98200cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 -- 172.21.15.5:0/2122326346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818009b30 con 0x7f98200d08a0 2023-10-16T13:48:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981ffff700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161210 0x7f98200cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f981f7fe700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f982014e530 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f980800e990 tx=0x7f980800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.403+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080096f0 con 0x7f98200d08a0 2023-10-16T13:48:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.404+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800c850 con 0x7f98200d08a0 2023-10-16T13:48:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.404+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800eee0 con 0x7f98200d08a0 2023-10-16T13:48:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.404+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98200cc4a0 con 0x7f98200d08a0 2023-10-16T13:48:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.404+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98200cca60 con 0x7f98200d08a0 2023-10-16T13:48:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.404+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98200ccdd0 con 0x7f98200d08a0 2023-10-16T13:48:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.405+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f980800cbc0 con 0x7f98200d08a0 2023-10-16T13:48:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.405+0000 7f9817fff700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f980006b2f0 0x7f980006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.405+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9808089da0 con 0x7f98200d08a0 2023-10-16T13:48:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.406+0000 7f981effd700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f980006b2f0 0x7f980006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.406+0000 7f981effd700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f980006b2f0 0x7f980006d7b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9820151700 tx=0x7f9810009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.410+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9808054c10 con 0x7f98200d08a0 2023-10-16T13:48:48.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.613+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9820067d20 con 0x7f98200d08a0 2023-10-16T13:48:48.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.614+0000 7f9817fff700 1 -- 172.21.15.5:0/2122326346 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9808021090 con 0x7f98200d08a0 2023-10-16T13:48:48.617 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:48.617 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:48:48.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:48:48.618 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:48:48.618 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:48:48.618 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:48:48.618 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:48:48.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f980006b2f0 msgr2=0x7f980006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f980006b2f0 0x7f980006d7b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9820151700 tx=0x7f9810009040 comp rx=0 tx=0).stop 2023-10-16T13:48:48.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 msgr2=0x7f982014e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f982014e530 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f980800e990 tx=0x7f980800eca0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 shutdown_connections 2023-10-16T13:48:48.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161210 0x7f98200cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200d08a0 0x7f982014e530 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f980006b2f0 0x7f980006d7b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 --2- 172.21.15.5:0/2122326346 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9820160e30 0x7f98200ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 >> 172.21.15.5:0/2122326346 conn(0x7f982009cb40 msgr2=0x7f9820160080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 shutdown_connections 2023-10-16T13:48:48.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.616+0000 7f9826205700 1 -- 172.21.15.5:0/2122326346 wait complete. 2023-10-16T13:48:48.631 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:48:48.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:48:48.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.758+0000 7f4bd193f700 1 Processor -- start 2023-10-16T13:48:48.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.758+0000 7f4bd193f700 1 -- start start 2023-10-16T13:48:48.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bd193f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bcc15da20 0x7f4bcc0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bd193f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc0cc940 con 0x7f4bcc0cffe0 2023-10-16T13:48:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bd193f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc0ccc00 con 0x7f4bcc15de00 2023-10-16T13:48:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bd193f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cd5a0 con 0x7f4bcc15da20 2023-10-16T13:48:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bcaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bcc15da20 0x7f4bcc0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bcb7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bcc0cffe0 0x7f4bcc06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59486/0 (socket says 172.21.15.5:59486) 2023-10-16T13:48:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bcaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bcc15da20 0x7f4bcc0cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49482/0 (socket says 172.21.15.5:49482) 2023-10-16T13:48:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bcb7fe700 1 -- 172.21.15.5:0/1816717874 learned_addr learned my addr 172.21.15.5:0/1816717874 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bcaffd700 1 -- 172.21.15.5:0/1816717874 >> v1:172.21.15.112:6789/0 conn(0x7f4bcc15de00 legacy=0x7f4bcc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bcaffd700 1 -- 172.21.15.5:0/1816717874 >> v1:172.21.15.5:6789/0 conn(0x7f4bcc0cffe0 legacy=0x7f4bcc06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.759+0000 7f4bc9ffb700 1 -- 172.21.15.5:0/1816717874 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185030334 0 0) 0x7f4bcc0cc940 con 0x7f4bcc0cffe0 2023-10-16T13:48:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bcaffd700 1 -- 172.21.15.5:0/1816717874 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0ccee0 con 0x7f4bcc15da20 2023-10-16T13:48:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bcaffd700 1 --2- 172.21.15.5:0/1816717874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15da20 0x7f4bcc0cd9c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009840 tx=0x7f4bc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b412737e7e71e3f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bc9ffb700 1 -- 172.21.15.5:0/1816717874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011830 con 0x7f4bcc15da20 2023-10-16T13:48:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bc9ffb700 1 -- 172.21.15.5:0/1816717874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0011990 con 0x7f4bcc15da20 2023-10-16T13:48:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bc9ffb700 1 -- 172.21.15.5:0/1816717874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011d20 con 0x7f4bcc15da20 2023-10-16T13:48:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 -- 172.21.15.5:0/1816717874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15da20 msgr2=0x7f4bcc0cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 --2- 172.21.15.5:0/1816717874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15da20 0x7f4bcc0cd9c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009840 tx=0x7f4bc0009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 -- 172.21.15.5:0/1816717874 shutdown_connections 2023-10-16T13:48:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 --2- 172.21.15.5:0/1816717874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15da20 0x7f4bcc0cd9c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 -- 172.21.15.5:0/1816717874 >> 172.21.15.5:0/1816717874 conn(0x7f4bcc099a30 msgr2=0x7f4bcc0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 -- 172.21.15.5:0/1816717874 shutdown_connections 2023-10-16T13:48:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.760+0000 7f4bd193f700 1 -- 172.21.15.5:0/1816717874 wait complete. 2023-10-16T13:48:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 Processor -- start 2023-10-16T13:48:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 -- start start 2023-10-16T13:48:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc0cffe0 0x7f4bcc154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bcc15da20 0x7f4bcc0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 0x7f4bcc161720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1f30e0 con 0x7f4bcc15de00 2023-10-16T13:48:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0c6d80 con 0x7f4bcc0cffe0 2023-10-16T13:48:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.762+0000 7f4bd193f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc15e600 con 0x7f4bcc15da20 2023-10-16T13:48:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 0x7f4bcc161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 0x7f4bcc161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49490/0 (socket says 172.21.15.5:49490) 2023-10-16T13:48:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 -- 172.21.15.5:0/2169033946 learned_addr learned my addr 172.21.15.5:0/2169033946 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcaffd700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc0cffe0 0x7f4bcc154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bca7fc700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bcc15da20 0x7f4bcc0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 -- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bcc15da20 msgr2=0x7f4bcc0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bcc15da20 0x7f4bcc0c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 -- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc0cffe0 msgr2=0x7f4bcc154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc0cffe0 0x7f4bcc154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 -- 172.21.15.5:0/2169033946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00094a0 con 0x7f4bcc15de00 2023-10-16T13:48:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bcb7fe700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 0x7f4bcc161720 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400cba0 tx=0x7f4bc400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400aaa0 con 0x7f4bcc15de00 2023-10-16T13:48:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc400ac00 con 0x7f4bcc15de00 2023-10-16T13:48:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc15e8e0 con 0x7f4bcc15de00 2023-10-16T13:48:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40070d0 con 0x7f4bcc15de00 2023-10-16T13:48:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.763+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc15eea0 con 0x7f4bcc15de00 2023-10-16T13:48:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.764+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc04ebb0 con 0x7f4bcc15de00 2023-10-16T13:48:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.765+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f4bc4007230 con 0x7f4bcc15de00 2023-10-16T13:48:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.765+0000 7f4bb3fff700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bb806b2f0 0x7f4bb806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.765+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4bc4089710 con 0x7f4bcc15de00 2023-10-16T13:48:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.766+0000 7f4bcaffd700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bb806b2f0 0x7f4bb806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.766+0000 7f4bcaffd700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bb806b2f0 0x7f4bb806d7b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00090b0 tx=0x7f4bc0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.770+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bc40544f0 con 0x7f4bcc15de00 2023-10-16T13:48:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:48.971+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4bcc06d710 con 0x7f4bcc15de00 2023-10-16T13:48:49.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.708+0000 7f4bb3fff700 1 -- 172.21.15.5:0/2169033946 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4bc40180b0 con 0x7f4bcc15de00 2023-10-16T13:48:49.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.711+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bb806b2f0 msgr2=0x7f4bb806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:49.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.711+0000 7f4bd193f700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bb806b2f0 0x7f4bb806d7b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00090b0 tx=0x7f4bc0008030 comp rx=0 tx=0).stop 2023-10-16T13:48:49.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.711+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 msgr2=0x7f4bcc161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.711+0000 7f4bd193f700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 0x7f4bcc161720 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400cba0 tx=0x7f4bc400ceb0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 shutdown_connections 2023-10-16T13:48:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bcc15de00 0x7f4bcc161720 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc0cffe0 0x7f4bcc154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4bb806b2f0 0x7f4bb806d7b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 --2- 172.21.15.5:0/2169033946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bcc15da20 0x7f4bcc0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 >> 172.21.15.5:0/2169033946 conn(0x7f4bcc099a30 msgr2=0x7f4bcc0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 shutdown_connections 2023-10-16T13:48:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.712+0000 7f4bd193f700 1 -- 172.21.15.5:0/2169033946 wait complete. 2023-10-16T13:48:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:48:49.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:48:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.869+0000 7f1b33dab700 1 Processor -- start 2023-10-16T13:48:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.869+0000 7f1b33dab700 1 -- start start 2023-10-16T13:48:49.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b33dab700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1b2c06d390 0x7f1b2c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b33dab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b33dab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b2c0ce550 0x7f1b2c06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b33dab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0721e0 con 0x7f1b2c0ce550 2023-10-16T13:48:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b33dab700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c06dcb0 con 0x7f1b2c06d390 2023-10-16T13:48:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b33dab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0715d0 con 0x7f1b2c06ba60 2023-10-16T13:48:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b32348700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b2c0ce550 0x7f1b2c06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b32348700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b2c0ce550 0x7f1b2c06ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49498/0 (socket says 172.21.15.5:49498) 2023-10-16T13:48:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.870+0000 7f1b32348700 1 -- 172.21.15.5:0/1849246600 learned_addr learned my addr 172.21.15.5:0/1849246600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b31b47700 1 --2- 172.21.15.5:0/1849246600 >> v2:172.21.15.112:3300/0 conn(0x7f1b2c06d390 0x7f1b2c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b31346700 1 --2- 172.21.15.5:0/1849246600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b32348700 1 -- 172.21.15.5:0/1849246600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 msgr2=0x7f1b2c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b32348700 1 --2- 172.21.15.5:0/1849246600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b32348700 1 -- 172.21.15.5:0/1849246600 >> v2:172.21.15.112:3300/0 conn(0x7f1b2c06d390 msgr2=0x7f1b2c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b32348700 1 --2- 172.21.15.5:0/1849246600 >> v2:172.21.15.112:3300/0 conn(0x7f1b2c06d390 0x7f1b2c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b32348700 1 -- 172.21.15.5:0/1849246600 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0718b0 con 0x7f1b2c0ce550 2023-10-16T13:48:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b32348700 1 --2- 172.21.15.5:0/1849246600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c06ad80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b2860 tx=0x7f1b2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb5f8dfcaf6aafb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b30b45700 1 -- 172.21.15.5:0/1849246600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400e070 con 0x7f1b2c0ce550 2023-10-16T13:48:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b30b45700 1 -- 172.21.15.5:0/1849246600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400b9c0 con 0x7f1b2c0ce550 2023-10-16T13:48:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.871+0000 7f1b30b45700 1 -- 172.21.15.5:0/1849246600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400bd70 con 0x7f1b2c0ce550 2023-10-16T13:48:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 -- 172.21.15.5:0/1849246600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c0ce550 msgr2=0x7f1b2c06ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1849246600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c06ad80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b2860 tx=0x7f1b2400b330 comp rx=0 tx=0).stop 2023-10-16T13:48:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 -- 172.21.15.5:0/1849246600 shutdown_connections 2023-10-16T13:48:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1849246600 >> v2:172.21.15.112:3300/0 conn(0x7f1b2c06d390 0x7f1b2c06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1849246600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c06ad80 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1849246600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 -- 172.21.15.5:0/1849246600 >> 172.21.15.5:0/1849246600 conn(0x7f1b2c0cfc40 msgr2=0x7f1b2c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 -- 172.21.15.5:0/1849246600 shutdown_connections 2023-10-16T13:48:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.872+0000 7f1b33dab700 1 -- 172.21.15.5:0/1849246600 wait complete. 2023-10-16T13:48:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.873+0000 7f1b33dab700 1 Processor -- start 2023-10-16T13:48:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.873+0000 7f1b33dab700 1 -- start start 2023-10-16T13:48:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b33dab700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b33dab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 0x7f1b2c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b33dab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b33dab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c15ce50 con 0x7f1b2c06d390 2023-10-16T13:48:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b33dab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c15d0a0 con 0x7f1b2c0ce550 2023-10-16T13:48:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b33dab700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c15d380 con 0x7f1b2c06ba60 2023-10-16T13:48:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b31346700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 0x7f1b2c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b31346700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 0x7f1b2c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49502/0 (socket says 172.21.15.5:49502) 2023-10-16T13:48:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.874+0000 7f1b31346700 1 -- 172.21.15.5:0/1025289871 learned_addr learned my addr 172.21.15.5:0/1025289871 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31b47700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b32348700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31346700 1 -- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 msgr2=0x7f1b2c0c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31346700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c0c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31346700 1 -- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b2c0ce550 msgr2=0x7f1b2c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31346700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c0a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31346700 1 -- 172.21.15.5:0/1025289871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009b30 con 0x7f1b2c06d390 2023-10-16T13:48:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b31346700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 0x7f1b2c0c9650 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800d800 tx=0x7f1b2800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280125f0 con 0x7f1b2c06d390 2023-10-16T13:48:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28012750 con 0x7f1b2c06d390 2023-10-16T13:48:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c15d660 con 0x7f1b2c06d390 2023-10-16T13:48:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28012ae0 con 0x7f1b2c06d390 2023-10-16T13:48:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.875+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c15dc20 con 0x7f1b2c06d390 2023-10-16T13:48:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.876+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c15df90 con 0x7f1b2c06d390 2023-10-16T13:48:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.877+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f1b28012c40 con 0x7f1b2c06d390 2023-10-16T13:48:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.877+0000 7f1b227fc700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1b1006b2f0 0x7f1b1006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.877+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1b28089b60 con 0x7f1b2c06d390 2023-10-16T13:48:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.877+0000 7f1b31b47700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1b1006b2f0 0x7f1b1006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.878+0000 7f1b31b47700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1b1006b2f0 0x7f1b1006d7b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c006b20 tx=0x7f1b1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:49.882+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b280548c0 con 0x7f1b2c06d390 2023-10-16T13:48:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.083+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1b2c067d20 con 0x7f1b2c06d390 2023-10-16T13:48:50.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.710+0000 7f1b227fc700 1 -- 172.21.15.5:0/1025289871 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1b28057ee0 con 0x7f1b2c06d390 2023-10-16T13:48:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.714+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1b1006b2f0 msgr2=0x7f1b1006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.714+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1b1006b2f0 0x7f1b1006d7b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c006b20 tx=0x7f1b1c008040 comp rx=0 tx=0).stop 2023-10-16T13:48:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.714+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 msgr2=0x7f1b2c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.714+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 0x7f1b2c0c9650 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800d800 tx=0x7f1b2800db10 comp rx=0 tx=0).stop 2023-10-16T13:48:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.715+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 shutdown_connections 2023-10-16T13:48:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.715+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b2c0ce550 0x7f1b2c0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.715+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1b1006b2f0 0x7f1b1006d7b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.715+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b2c06ba60 0x7f1b2c0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.715+0000 7f1b33dab700 1 --2- 172.21.15.5:0/1025289871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b2c06d390 0x7f1b2c0c9650 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.715+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 >> 172.21.15.5:0/1025289871 conn(0x7f1b2c0cfc40 msgr2=0x7f1b2c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.716+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 shutdown_connections 2023-10-16T13:48:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.716+0000 7f1b33dab700 1 -- 172.21.15.5:0/1025289871 wait complete. 2023-10-16T13:48:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:48:50.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:48:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.872+0000 7fb2325ed700 1 Processor -- start 2023-10-16T13:48:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.872+0000 7fb2325ed700 1 -- start start 2023-10-16T13:48:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb2325ed700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb22c0cd950 0x7fb22c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb2325ed700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb2325ed700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb22c06a840 0x7fb22c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb2325ed700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c1619a0 con 0x7fb22c0cd950 2023-10-16T13:48:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb2325ed700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c06b1f0 con 0x7fb22c06a840 2023-10-16T13:48:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb2325ed700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0cf260 con 0x7fb22c0cede0 2023-10-16T13:48:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb22bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb22c0cd950 0x7fb22c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb22bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb22c0cd950 0x7fb22c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49508/0 (socket says 172.21.15.5:49508) 2023-10-16T13:48:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.873+0000 7fb22bfff700 1 -- 172.21.15.5:0/211199344 learned_addr learned my addr 172.21.15.5:0/211199344 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb230b8a700 1 --2- 172.21.15.5:0/211199344 >> v2:172.21.15.112:3300/0 conn(0x7fb22c06a840 0x7fb22c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22b7fe700 1 --2- 172.21.15.5:0/211199344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22bfff700 1 -- 172.21.15.5:0/211199344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 msgr2=0x7fb22c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22bfff700 1 --2- 172.21.15.5:0/211199344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22bfff700 1 -- 172.21.15.5:0/211199344 >> v2:172.21.15.112:3300/0 conn(0x7fb22c06a840 msgr2=0x7fb22c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22bfff700 1 --2- 172.21.15.5:0/211199344 >> v2:172.21.15.112:3300/0 conn(0x7fb22c06a840 0x7fb22c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22bfff700 1 -- 172.21.15.5:0/211199344 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0b2d60 con 0x7fb22c0cd950 2023-10-16T13:48:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb230b8a700 1 --2- 172.21.15.5:0/211199344 >> v2:172.21.15.112:3300/0 conn(0x7fb22c06a840 0x7fb22c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22bfff700 1 --2- 172.21.15.5:0/211199344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c0cd950 0x7fb22c15e2f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb22c06ebc0 tx=0x7fb220009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b725e5dd56017d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22affd700 1 -- 172.21.15.5:0/211199344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22000b870 con 0x7fb22c0cd950 2023-10-16T13:48:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22affd700 1 -- 172.21.15.5:0/211199344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22000b9d0 con 0x7fb22c0cd950 2023-10-16T13:48:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.874+0000 7fb22affd700 1 -- 172.21.15.5:0/211199344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22000bd60 con 0x7fb22c0cd950 2023-10-16T13:48:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 -- 172.21.15.5:0/211199344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c0cd950 msgr2=0x7fb22c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 --2- 172.21.15.5:0/211199344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c0cd950 0x7fb22c15e2f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb22c06ebc0 tx=0x7fb220009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 -- 172.21.15.5:0/211199344 shutdown_connections 2023-10-16T13:48:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 --2- 172.21.15.5:0/211199344 >> v2:172.21.15.112:3300/0 conn(0x7fb22c06a840 0x7fb22c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 --2- 172.21.15.5:0/211199344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c0cd950 0x7fb22c15e2f0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 --2- 172.21.15.5:0/211199344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 -- 172.21.15.5:0/211199344 >> 172.21.15.5:0/211199344 conn(0x7fb22c06dae0 msgr2=0x7fb22c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 -- 172.21.15.5:0/211199344 shutdown_connections 2023-10-16T13:48:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.875+0000 7fb2325ed700 1 -- 172.21.15.5:0/211199344 wait complete. 2023-10-16T13:48:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.876+0000 7fb2325ed700 1 Processor -- start 2023-10-16T13:48:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.876+0000 7fb2325ed700 1 -- start start 2023-10-16T13:48:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb2325ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 0x7fb22c15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb2325ed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22c0cd950 0x7fb22c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb2325ed700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb2325ed700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c15c4b0 con 0x7fb22c06a840 2023-10-16T13:48:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb2325ed700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c5150 con 0x7fb22c0cd950 2023-10-16T13:48:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb2325ed700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c4aa0 con 0x7fb22c0cede0 2023-10-16T13:48:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 0x7fb22c15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 0x7fb22c15bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49514/0 (socket says 172.21.15.5:49514) 2023-10-16T13:48:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 -- 172.21.15.5:0/911835757 learned_addr learned my addr 172.21.15.5:0/911835757 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22b7fe700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22c0cd950 0x7fb22c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb230b8a700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 -- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 msgr2=0x7fb22c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 -- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22c0cd950 msgr2=0x7fb22c0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22c0cd950 0x7fb22c0c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22bfff700 1 -- 172.21.15.5:0/911835757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb220009550 con 0x7fb22c06a840 2023-10-16T13:48:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.877+0000 7fb22b7fe700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22c0cd950 0x7fb22c0c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.878+0000 7fb22bfff700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 0x7fb22c15bf70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb220000c00 tx=0x7fb220004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.878+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220004540 con 0x7fb22c06a840 2023-10-16T13:48:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.878+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2200036a0 con 0x7fb22c06a840 2023-10-16T13:48:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.878+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c0c4d80 con 0x7fb22c06a840 2023-10-16T13:48:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.878+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220003a50 con 0x7fb22c06a840 2023-10-16T13:48:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.878+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c0c5640 con 0x7fb22c06a840 2023-10-16T13:48:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.879+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c067d20 con 0x7fb22c06a840 2023-10-16T13:48:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.879+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fb220021070 con 0x7fb22c06a840 2023-10-16T13:48:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.880+0000 7fb228ff9700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb21806b2f0 0x7fb21806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.880+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb22008b7b0 con 0x7fb22c06a840 2023-10-16T13:48:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.880+0000 7fb22b7fe700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb21806b2f0 0x7fb21806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.881+0000 7fb22b7fe700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb21806b2f0 0x7fb21806d7b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb22c160400 tx=0x7fb21c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:50.884+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb220056580 con 0x7fb22c06a840 2023-10-16T13:48:51.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.127+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb22c0c4f10 con 0x7fb22c06a840 2023-10-16T13:48:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.740+0000 7fb228ff9700 1 -- 172.21.15.5:0/911835757 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v75) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb220015020 con 0x7fb22c06a840 2023-10-16T13:48:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb21806b2f0 msgr2=0x7fb21806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb21806b2f0 0x7fb21806d7b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb22c160400 tx=0x7fb21c008040 comp rx=0 tx=0).stop 2023-10-16T13:48:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 msgr2=0x7fb22c15bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 0x7fb22c15bf70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb220000c00 tx=0x7fb220004750 comp rx=0 tx=0).stop 2023-10-16T13:48:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 shutdown_connections 2023-10-16T13:48:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb21806b2f0 0x7fb21806d7b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb22c0cede0 0x7fb22c06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22c06a840 0x7fb22c15bf70 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 --2- 172.21.15.5:0/911835757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb22c0cd950 0x7fb22c0c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 >> 172.21.15.5:0/911835757 conn(0x7fb22c06dae0 msgr2=0x7fb22c15cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 shutdown_connections 2023-10-16T13:48:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.744+0000 7fb2325ed700 1 -- 172.21.15.5:0/911835757 wait complete. 2023-10-16T13:48:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 18 and data pool 19 2023-10-16T13:48:51.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:51.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.896+0000 7f80c5ddc700 1 Processor -- start 2023-10-16T13:48:51.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.896+0000 7f80c5ddc700 1 -- start start 2023-10-16T13:48:51.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80c5ddc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f80c015eab0 0x7f80c00cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80c5ddc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 0x7f80c00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80c5ddc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00cfb30 con 0x7f80c00d1bc0 2023-10-16T13:48:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80c5ddc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00ccc20 con 0x7f80c015eab0 2023-10-16T13:48:51.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80c5ddc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c015ee90 con 0x7f80c00cf6d0 2023-10-16T13:48:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80bffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80c00d1bc0 0x7f80c0161510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59546/0 (socket says 172.21.15.5:59546) 2023-10-16T13:48:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80bffff700 1 -- 172.21.15.5:0/350041444 learned_addr learned my addr 172.21.15.5:0/350041444 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80bf7fe700 1 --2- 172.21.15.5:0/350041444 >> v2:172.21.15.112:3300/0 conn(0x7f80c015eab0 0x7f80c00cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80beffd700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 0x7f80c00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986117524 0 0) 0x7f80c00cfb30 con 0x7f80c00d1bc0 2023-10-16T13:48:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a80035b0 con 0x7f80c00d1bc0 2023-10-16T13:48:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346052010 0 0) 0x7f80a80035b0 con 0x7f80c00d1bc0 2023-10-16T13:48:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 msgr2=0x7f80c00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 0x7f80c00d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 >> v2:172.21.15.112:3300/0 conn(0x7f80c015eab0 msgr2=0x7f80c00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 --2- 172.21.15.5:0/350041444 >> v2:172.21.15.112:3300/0 conn(0x7f80c015eab0 0x7f80c00cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0158370 con 0x7f80c00d1bc0 2023-10-16T13:48:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.897+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f80b80019f0 con 0x7f80c00d1bc0 2023-10-16T13:48:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 >> v1:172.21.15.5:6789/0 conn(0x7f80c00d1bc0 legacy=0x7f80c0161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a8003a00 0x7f80a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 0x7f80a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a8004d90 0x7f80a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00ccc20 con 0x7f80a8004d90 2023-10-16T13:48:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c015ee90 con 0x7f80a8003a00 2023-10-16T13:48:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a800ba10 con 0x7f80c00cf6d0 2023-10-16T13:48:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a8004d90 0x7f80a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bf7fe700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a8003a00 0x7f80a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80beffd700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 0x7f80a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 -- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 msgr2=0x7f80a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00cf6d0 0x7f80a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 -- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a8003a00 msgr2=0x7f80a8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80a8003a00 0x7f80a8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 -- 172.21.15.5:0/350041444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80035b0 con 0x7f80a8004d90 2023-10-16T13:48:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80bffff700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a8004d90 0x7f80a8005210 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f80b800a850 tx=0x7f80a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb154169f4f825 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8012600 con 0x7f80a8004d90 2023-10-16T13:48:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8012760 con 0x7f80a8004d90 2023-10-16T13:48:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.898+0000 7f80be7fc700 1 -- 172.21.15.5:0/350041444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8012af0 con 0x7f80a8004d90 2023-10-16T13:48:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80c5ddc700 1 -- 172.21.15.5:0/350041444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a8004d90 msgr2=0x7f80a8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/350041444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a8004d90 0x7f80a8005210 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f80b800a850 tx=0x7f80a8005880 comp rx=0 tx=0).stop 2023-10-16T13:48:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80bffff700 1 -- 172.21.15.5:0/350041444 reap_dead start 2023-10-16T13:48:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80c5ddc700 1 -- 172.21.15.5:0/350041444 shutdown_connections 2023-10-16T13:48:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80c5ddc700 1 -- 172.21.15.5:0/350041444 >> 172.21.15.5:0/350041444 conn(0x7f80c00665a0 msgr2=0x7f80c0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80c5ddc700 1 -- 172.21.15.5:0/350041444 shutdown_connections 2023-10-16T13:48:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.899+0000 7f80c5ddc700 1 -- 172.21.15.5:0/350041444 wait complete. 2023-10-16T13:48:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.900+0000 7f80c5ddc700 1 Processor -- start 2023-10-16T13:48:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 -- start start 2023-10-16T13:48:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 0x7f80c0156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80c00cb660 0x7f80c01574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00ad8f0 0x7f80c00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00af090 con 0x7f80c00ad510 2023-10-16T13:48:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0157ec0 con 0x7f80c00cb660 2023-10-16T13:48:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80c5ddc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00cc6a0 con 0x7f80c00ad8f0 2023-10-16T13:48:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 0x7f80c0156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 0x7f80c0156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49550/0 (socket says 172.21.15.5:49550) 2023-10-16T13:48:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.901+0000 7f80bf7fe700 1 -- 172.21.15.5:0/638249475 learned_addr learned my addr 172.21.15.5:0/638249475 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80beffd700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80c00cb660 0x7f80c01574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bffff700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00ad8f0 0x7f80c00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bf7fe700 1 -- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00ad8f0 msgr2=0x7f80c00c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bf7fe700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00ad8f0 0x7f80c00c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bf7fe700 1 -- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80c00cb660 msgr2=0x7f80c01574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bf7fe700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80c00cb660 0x7f80c01574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bf7fe700 1 -- 172.21.15.5:0/638249475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00cbb20 con 0x7f80c00ad510 2023-10-16T13:48:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80bf7fe700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 0x7f80c0156fb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f80b0011aa0 tx=0x7f80b0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011ed0 con 0x7f80c00ad510 2023-10-16T13:48:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000f940 con 0x7f80c00ad510 2023-10-16T13:48:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c00cbe00 con 0x7f80c00ad510 2023-10-16T13:48:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000fd10 con 0x7f80c00ad510 2023-10-16T13:48:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.902+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c00cc3c0 con 0x7f80c00ad510 2023-10-16T13:48:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.903+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c00c8850 con 0x7f80c00ad510 2023-10-16T13:48:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.904+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f80b0014440 con 0x7f80c00ad510 2023-10-16T13:48:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.904+0000 7f80a7fff700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80ac06b2f0 0x7f80ac06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.904+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80b008a300 con 0x7f80c00ad510 2023-10-16T13:48:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.904+0000 7f80beffd700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80ac06b2f0 0x7f80ac06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.905+0000 7f80beffd700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80ac06b2f0 0x7f80ac06d7b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009c60 tx=0x7f80b4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:51.909+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80b0054f20 con 0x7f80c00ad510 2023-10-16T13:48:52.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.111+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c0074040 con 0x7f80c00ad510 2023-10-16T13:48:52.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.113+0000 7f80a7fff700 1 -- 172.21.15.5:0/638249475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16520 (secure 0 0 0) 0x7f80b0058540 con 0x7f80c00ad510 2023-10-16T13:48:52.116 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:52.116 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":109,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:51.129172+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80ac06b2f0 msgr2=0x7f80ac06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80ac06b2f0 0x7f80ac06d7b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009c60 tx=0x7f80b4009210 comp rx=0 tx=0).stop 2023-10-16T13:48:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 msgr2=0x7f80c0156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 0x7f80c0156fb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f80b0011aa0 tx=0x7f80b0011db0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 shutdown_connections 2023-10-16T13:48:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80ac06b2f0 0x7f80ac06d7b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80c00ad8f0 0x7f80c00c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80c00ad510 0x7f80c0156fb0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 --2- 172.21.15.5:0/638249475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80c00cb660 0x7f80c01574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 >> 172.21.15.5:0/638249475 conn(0x7f80c00665a0 msgr2=0x7f80c00b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 shutdown_connections 2023-10-16T13:48:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.115+0000 7f80c5ddc700 1 -- 172.21.15.5:0/638249475 wait complete. 2023-10-16T13:48:52.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.252+0000 7f8669643700 1 Processor -- start 2023-10-16T13:48:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.253+0000 7f8669643700 1 -- start start 2023-10-16T13:48:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.253+0000 7f8669643700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f866415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.253+0000 7f8669643700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86640b7050 0x7f86640d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.253+0000 7f8669643700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866415e4e0 con 0x7f866415dbc0 2023-10-16T13:48:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.253+0000 7f8669643700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640b7560 con 0x7f86640b7050 2023-10-16T13:48:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.253+0000 7f8669643700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640b7840 con 0x7f86640d3fc0 2023-10-16T13:48:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86640b7050 0x7f86640d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86640b7050 0x7f86640d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49562/0 (socket says 172.21.15.5:49562) 2023-10-16T13:48:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 -- 172.21.15.5:0/1823823981 learned_addr learned my addr 172.21.15.5:0/1823823981 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86627fc700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f866415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 -- 172.21.15.5:0/1823823981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 msgr2=0x7f866415dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f866415dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 -- 172.21.15.5:0/1823823981 >> v1:172.21.15.112:6789/0 conn(0x7f866415dbc0 legacy=0x7f86640d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 -- 172.21.15.5:0/1823823981 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640b7b20 con 0x7f86640b7050 2023-10-16T13:48:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86627fc700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f866415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f86637fe700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86640b7050 0x7f86640d21d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f865c009e50 tx=0x7f865c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9f0ca17d74227f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f8661ffb700 1 -- 172.21.15.5:0/1823823981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00e070 con 0x7f86640b7050 2023-10-16T13:48:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f8661ffb700 1 -- 172.21.15.5:0/1823823981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00b9c0 con 0x7f86640b7050 2023-10-16T13:48:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.254+0000 7f8661ffb700 1 -- 172.21.15.5:0/1823823981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00bd70 con 0x7f86640b7050 2023-10-16T13:48:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 -- 172.21.15.5:0/1823823981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86640b7050 msgr2=0x7f86640d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86640b7050 0x7f86640d21d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f865c009e50 tx=0x7f865c00b330 comp rx=0 tx=0).stop 2023-10-16T13:48:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 -- 172.21.15.5:0/1823823981 shutdown_connections 2023-10-16T13:48:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86640b7050 0x7f86640d21d0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 --2- 172.21.15.5:0/1823823981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f866415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 -- 172.21.15.5:0/1823823981 >> 172.21.15.5:0/1823823981 conn(0x7f866409cb40 msgr2=0x7f86640d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 -- 172.21.15.5:0/1823823981 shutdown_connections 2023-10-16T13:48:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.255+0000 7f8669643700 1 -- 172.21.15.5:0/1823823981 wait complete. 2023-10-16T13:48:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.256+0000 7f8669643700 1 Processor -- start 2023-10-16T13:48:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.256+0000 7f8669643700 1 -- start start 2023-10-16T13:48:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8669643700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86640b7050 0x7f86640c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8669643700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f8664159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8669643700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 0x7f86640ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8669643700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866415c850 con 0x7f866415dbc0 2023-10-16T13:48:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8669643700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866415b930 con 0x7f86640b7050 2023-10-16T13:48:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8669643700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866415bbd0 con 0x7f86640d3fc0 2023-10-16T13:48:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 0x7f86640ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 0x7f86640ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49568/0 (socket says 172.21.15.5:49568) 2023-10-16T13:48:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 -- 172.21.15.5:0/551691182 learned_addr learned my addr 172.21.15.5:0/551691182 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f8662ffd700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86640b7050 0x7f86640c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86627fc700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f8664159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 -- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 msgr2=0x7f8664159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f8664159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 -- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86640b7050 msgr2=0x7f86640c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86640b7050 0x7f86640c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86637fe700 1 -- 172.21.15.5:0/551691182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009b30 con 0x7f866415dbc0 2023-10-16T13:48:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.257+0000 7f86627fc700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f8664159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.258+0000 7f86637fe700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 0x7f86640ce5d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f865c012000 tx=0x7f865c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.258+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0048b0 con 0x7f866415dbc0 2023-10-16T13:48:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.258+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0099b0 con 0x7f866415dbc0 2023-10-16T13:48:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.258+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866415beb0 con 0x7f866415dbc0 2023-10-16T13:48:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.258+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c01c680 con 0x7f866415dbc0 2023-10-16T13:48:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.258+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866415c470 con 0x7f866415dbc0 2023-10-16T13:48:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.259+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866415c990 con 0x7f866415dbc0 2023-10-16T13:48:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.259+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f865c01c7e0 con 0x7f866415dbc0 2023-10-16T13:48:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.260+0000 7f865b7fe700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f864406b2f0 0x7f864406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.260+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f865c08ba60 con 0x7f866415dbc0 2023-10-16T13:48:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.260+0000 7f8662ffd700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f864406b2f0 0x7f864406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.260+0000 7f8662ffd700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f864406b2f0 0x7f864406d7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8654000fb0 tx=0x7f8654009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.264+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f866415c990 con 0x7f866415dbc0 2023-10-16T13:48:52.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.465+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f866415c990 con 0x7f866415dbc0 2023-10-16T13:48:52.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.466+0000 7f865b7fe700 1 -- 172.21.15.5:0/551691182 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16520 (secure 0 0 0) 0x7f866415c990 con 0x7f866415dbc0 2023-10-16T13:48:52.469 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:52.469 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":109,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:51.129172+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f864406b2f0 msgr2=0x7f864406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f864406b2f0 0x7f864406d7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8654000fb0 tx=0x7f8654009040 comp rx=0 tx=0).stop 2023-10-16T13:48:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 msgr2=0x7f86640ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 0x7f86640ce5d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f865c012000 tx=0x7f865c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 shutdown_connections 2023-10-16T13:48:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866415dbc0 0x7f86640ce5d0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86640b7050 0x7f86640c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f864406b2f0 0x7f864406d7b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 --2- 172.21.15.5:0/551691182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86640d3fc0 0x7f8664159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 >> 172.21.15.5:0/551691182 conn(0x7f866409cb40 msgr2=0x7f86640cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 shutdown_connections 2023-10-16T13:48:52.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.468+0000 7f8669643700 1 -- 172.21.15.5:0/551691182 wait complete. 2023-10-16T13:48:52.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:48:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.608+0000 7f56128b1700 1 Processor -- start 2023-10-16T13:48:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.609+0000 7f56128b1700 1 -- start start 2023-10-16T13:48:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.609+0000 7f56128b1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f560c15b740 0x7f560c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.609+0000 7f56128b1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0cf190 con 0x7f560c0d0c70 2023-10-16T13:48:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.609+0000 7f56128b1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0cbd40 con 0x7f560c0ce6e0 2023-10-16T13:48:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.609+0000 7f56128b1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c15bb20 con 0x7f560c15b740 2023-10-16T13:48:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f560c0d0c70 0x7f560c0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59576/0 (socket says 172.21.15.5:59576) 2023-10-16T13:48:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560b7fe700 1 -- 172.21.15.5:0/1355033859 learned_addr learned my addr 172.21.15.5:0/1355033859 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560bfff700 1 --2- 172.21.15.5:0/1355033859 >> v2:172.21.15.112:3300/0 conn(0x7f560c15b740 0x7f560c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136212634 0 0) 0x7f560c0cf190 con 0x7f560c0d0c70 2023-10-16T13:48:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f40035b0 con 0x7f560c0d0c70 2023-10-16T13:48:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231720402 0 0) 0x7f55f40035b0 con 0x7f560c0d0c70 2023-10-16T13:48:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 >> v2:172.21.15.112:3300/0 conn(0x7f560c15b740 msgr2=0x7f560c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 --2- 172.21.15.5:0/1355033859 >> v2:172.21.15.112:3300/0 conn(0x7f560c15b740 0x7f560c0d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 >> v1:172.21.15.112:6789/0 conn(0x7f560c0ce6e0 legacy=0x7f560c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0cc020 con 0x7f560c0d0c70 2023-10-16T13:48:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5600001670 con 0x7f560c0d0c70 2023-10-16T13:48:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 >> v1:172.21.15.5:6789/0 conn(0x7f560c0d0c70 legacy=0x7f560c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f4003a00 0x7f55f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f55f40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f4005170 0x7f55f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c15bb20 con 0x7f55f4004400 2023-10-16T13:48:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f400c0b0 con 0x7f55f4003a00 2023-10-16T13:48:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f400c270 con 0x7f55f4005170 2023-10-16T13:48:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f55f40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.610+0000 7f560bfff700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f4003a00 0x7f55f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f5610e4e700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f4005170 0x7f55f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560b7fe700 1 -- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f4005170 msgr2=0x7f55f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55f4005170 0x7f55f400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560b7fe700 1 -- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f4003a00 msgr2=0x7f55f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55f4003a00 0x7f55f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560b7fe700 1 -- 172.21.15.5:0/1355033859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40035b0 con 0x7f55f4004400 2023-10-16T13:48:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f5610e4e700 1 -- 172.21.15.5:0/1355033859 reap_dead start 2023-10-16T13:48:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f55f40048d0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f560000c240 tx=0x7f55f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b05c4df236b5f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000cd40 con 0x7f55f4004400 2023-10-16T13:48:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600005960 con 0x7f55f4004400 2023-10-16T13:48:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f560affd700 1 -- 172.21.15.5:0/1355033859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000cea0 con 0x7f55f4004400 2023-10-16T13:48:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f56128b1700 1 -- 172.21.15.5:0/1355033859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 msgr2=0x7f55f40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f56128b1700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f55f40048d0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f560000c240 tx=0x7f55f4005880 comp rx=0 tx=0).stop 2023-10-16T13:48:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.611+0000 7f56128b1700 1 -- 172.21.15.5:0/1355033859 shutdown_connections 2023-10-16T13:48:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.612+0000 7f56128b1700 1 --2- 172.21.15.5:0/1355033859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f55f40048d0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.612+0000 7f56128b1700 1 -- 172.21.15.5:0/1355033859 >> 172.21.15.5:0/1355033859 conn(0x7f560c0665a0 msgr2=0x7f560c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.612+0000 7f56128b1700 1 -- 172.21.15.5:0/1355033859 shutdown_connections 2023-10-16T13:48:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.612+0000 7f56128b1700 1 -- 172.21.15.5:0/1355033859 wait complete. 2023-10-16T13:48:52.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.613+0000 7f56128b1700 1 Processor -- start 2023-10-16T13:48:52.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.613+0000 7f56128b1700 1 -- start start 2023-10-16T13:48:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f56128b1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f560c0b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f56128b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f560c0b4e80 0x7f560c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f56128b1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f560c0aee70 0x7f560c0c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f56128b1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0b49f0 con 0x7f55f4004400 2023-10-16T13:48:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f56128b1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0b6df0 con 0x7f560c0b4e80 2023-10-16T13:48:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f56128b1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0b5300 con 0x7f560c0aee70 2023-10-16T13:48:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f560c0b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f560c0b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49584/0 (socket says 172.21.15.5:49584) 2023-10-16T13:48:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 -- 172.21.15.5:0/1748967220 learned_addr learned my addr 172.21.15.5:0/1748967220 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f560c0b4e80 0x7f560c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 -- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f560c0aee70 msgr2=0x7f560c0c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f5610e4e700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f560c0aee70 0x7f560c0c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f560c0aee70 0x7f560c0c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 -- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f560c0b4e80 msgr2=0x7f560c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f560c0b4e80 0x7f560c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 -- 172.21.15.5:0/1748967220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0ca630 con 0x7f55f4004400 2023-10-16T13:48:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f560c0b4e80 0x7f560c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.614+0000 7f560bfff700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f560c0b6750 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0119d0 tx=0x7f55fc011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.615+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc009630 con 0x7f55f4004400 2023-10-16T13:48:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.615+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc004240 con 0x7f55f4004400 2023-10-16T13:48:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.615+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c0b40c0 con 0x7f55f4004400 2023-10-16T13:48:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.615+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00f730 con 0x7f55f4004400 2023-10-16T13:48:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.615+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c0b4680 con 0x7f55f4004400 2023-10-16T13:48:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.615+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c067d20 con 0x7f55f4004400 2023-10-16T13:48:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.616+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f55fc00f890 con 0x7f55f4004400 2023-10-16T13:48:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.617+0000 7f5608ff9700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55f806b2f0 0x7f55f806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.617+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55fc08a310 con 0x7f55f4004400 2023-10-16T13:48:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.617+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55f806b2f0 0x7f55f806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:52.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.617+0000 7f560b7fe700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55f806b2f0 0x7f55f806d7b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f560c1582b0 tx=0x7f560000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.622+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55fc054de0 con 0x7f55f4004400 2023-10-16T13:48:52.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:52.873+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f560c0b4cd0 con 0x7f55f4004400 2023-10-16T13:48:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.754+0000 7f5608ff9700 1 -- 172.21.15.5:0/1748967220 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) v1 ==== 118+0+0 (secure 0 0 0) 0x7f55fc058400 con 0x7f55f4004400 2023-10-16T13:48:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.757+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55f806b2f0 msgr2=0x7f55f806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.757+0000 7f56128b1700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55f806b2f0 0x7f55f806d7b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f560c1582b0 tx=0x7f560000a000 comp rx=0 tx=0).stop 2023-10-16T13:48:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.757+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 msgr2=0x7f560c0b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.757+0000 7f56128b1700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f560c0b6750 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0119d0 tx=0x7f55fc011d90 comp rx=0 tx=0).stop 2023-10-16T13:48:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 shutdown_connections 2023-10-16T13:48:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f55f806b2f0 0x7f55f806d7b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f560c0aee70 0x7f560c0c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4004400 0x7f560c0b6750 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 --2- 172.21.15.5:0/1748967220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f560c0b4e80 0x7f560c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 >> 172.21.15.5:0/1748967220 conn(0x7f560c0665a0 msgr2=0x7f560c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 shutdown_connections 2023-10-16T13:48:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.758+0000 7f56128b1700 1 -- 172.21.15.5:0/1748967220 wait complete. 2023-10-16T13:48:53.777 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:48:53.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:48:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.910+0000 7f36e85ef700 1 Processor -- start 2023-10-16T13:48:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.910+0000 7f36e85ef700 1 -- start start 2023-10-16T13:48:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e85ef700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f36e015ab10 0x7f36e015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e85ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e00b1f50 0x7f36e00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e85ef700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36e00b23d0 0x7f36e00cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e85ef700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e015e7a0 con 0x7f36e00b23d0 2023-10-16T13:48:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e85ef700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e015f730 con 0x7f36e015ab10 2023-10-16T13:48:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e85ef700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e00b29a0 con 0x7f36e00b1f50 2023-10-16T13:48:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36e00b23d0 0x7f36e00cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36e00b23d0 0x7f36e00cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49596/0 (socket says 172.21.15.5:49596) 2023-10-16T13:48:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 -- 172.21.15.5:0/1184541278 learned_addr learned my addr 172.21.15.5:0/1184541278 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e5b8a700 1 --2- 172.21.15.5:0/1184541278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e00b1f50 0x7f36e00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e638b700 1 --2- 172.21.15.5:0/1184541278 >> v2:172.21.15.112:3300/0 conn(0x7f36e015ab10 0x7f36e015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 -- 172.21.15.5:0/1184541278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e00b1f50 msgr2=0x7f36e00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 --2- 172.21.15.5:0/1184541278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e00b1f50 0x7f36e00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 -- 172.21.15.5:0/1184541278 >> v2:172.21.15.112:3300/0 conn(0x7f36e015ab10 msgr2=0x7f36e015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 --2- 172.21.15.5:0/1184541278 >> v2:172.21.15.112:3300/0 conn(0x7f36e015ab10 0x7f36e015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 -- 172.21.15.5:0/1184541278 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00b2c80 con 0x7f36e00b23d0 2023-10-16T13:48:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.911+0000 7f36e6b8c700 1 --2- 172.21.15.5:0/1184541278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b23d0 0x7f36e00cfc60 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f36e00d0430 tx=0x7f36d800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767268ad48a4cc65 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e5389700 1 -- 172.21.15.5:0/1184541278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8010070 con 0x7f36e00b23d0 2023-10-16T13:48:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e5389700 1 -- 172.21.15.5:0/1184541278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d800dce0 con 0x7f36e00b23d0 2023-10-16T13:48:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e5389700 1 -- 172.21.15.5:0/1184541278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800b310 con 0x7f36e00b23d0 2023-10-16T13:48:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 -- 172.21.15.5:0/1184541278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b23d0 msgr2=0x7f36e00cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1184541278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b23d0 0x7f36e00cfc60 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f36e00d0430 tx=0x7f36d800d430 comp rx=0 tx=0).stop 2023-10-16T13:48:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 -- 172.21.15.5:0/1184541278 shutdown_connections 2023-10-16T13:48:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1184541278 >> v2:172.21.15.112:3300/0 conn(0x7f36e015ab10 0x7f36e015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1184541278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b23d0 0x7f36e00cfc60 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1184541278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e00b1f50 0x7f36e00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 -- 172.21.15.5:0/1184541278 >> 172.21.15.5:0/1184541278 conn(0x7f36e006dae0 msgr2=0x7f36e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 -- 172.21.15.5:0/1184541278 shutdown_connections 2023-10-16T13:48:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.912+0000 7f36e85ef700 1 -- 172.21.15.5:0/1184541278 wait complete. 2023-10-16T13:48:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.914+0000 7f36e85ef700 1 Processor -- start 2023-10-16T13:48:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.914+0000 7f36e85ef700 1 -- start start 2023-10-16T13:48:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e85ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 0x7f36e0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e85ef700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e00b23d0 0x7f36e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e85ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e015ab10 0x7f36e0155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e85ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0155700 con 0x7f36e00b1f50 2023-10-16T13:48:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e85ef700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e006b120 con 0x7f36e00b23d0 2023-10-16T13:48:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e85ef700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e006b400 con 0x7f36e015ab10 2023-10-16T13:48:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 0x7f36e0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 0x7f36e0151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49598/0 (socket says 172.21.15.5:49598) 2023-10-16T13:48:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 -- 172.21.15.5:0/1513649303 learned_addr learned my addr 172.21.15.5:0/1513649303 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e5b8a700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e00b23d0 0x7f36e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e6b8c700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e015ab10 0x7f36e0155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 -- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e015ab10 msgr2=0x7f36e0155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e015ab10 0x7f36e0155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 -- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e00b23d0 msgr2=0x7f36e006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e00b23d0 0x7f36e006a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 -- 172.21.15.5:0/1513649303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d800bd40 con 0x7f36e00b1f50 2023-10-16T13:48:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e6b8c700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e015ab10 0x7f36e0155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.915+0000 7f36e638b700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 0x7f36e0151e60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00e9b0 tx=0x7f36dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.916+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc009710 con 0x7f36e00b1f50 2023-10-16T13:48:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.916+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00c850 con 0x7f36e00b1f50 2023-10-16T13:48:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.916+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e006b6e0 con 0x7f36e00b1f50 2023-10-16T13:48:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.916+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00cbc0 con 0x7f36e00b1f50 2023-10-16T13:48:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.916+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e01523a0 con 0x7f36e00b1f50 2023-10-16T13:48:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.916+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e0155970 con 0x7f36e00b1f50 2023-10-16T13:48:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.917+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f36dc00cd20 con 0x7f36e00b1f50 2023-10-16T13:48:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.918+0000 7f36d6ffd700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f36c406b2f0 0x7f36c406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.918+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36dc089d90 con 0x7f36e00b1f50 2023-10-16T13:48:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.918+0000 7f36e5b8a700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f36c406b2f0 0x7f36c406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.918+0000 7f36e5b8a700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f36c406b2f0 0x7f36c406d7b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f36e01544f0 tx=0x7f36d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:53.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:53.922+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36dc0548f0 con 0x7f36e00b1f50 2023-10-16T13:48:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.172+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f36e0067d20 con 0x7f36e00b1f50 2023-10-16T13:48:54.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.762+0000 7f36d6ffd700 1 -- 172.21.15.5:0/1513649303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v79) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36dc0210c0 con 0x7f36e00b1f50 2023-10-16T13:48:54.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f36c406b2f0 msgr2=0x7f36c406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:54.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f36c406b2f0 0x7f36c406d7b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f36e01544f0 tx=0x7f36d0008040 comp rx=0 tx=0).stop 2023-10-16T13:48:54.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 msgr2=0x7f36e0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 0x7f36e0151e60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00e9b0 tx=0x7f36dc00ed70 comp rx=0 tx=0).stop 2023-10-16T13:48:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 shutdown_connections 2023-10-16T13:48:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f36c406b2f0 0x7f36c406d7b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36e015ab10 0x7f36e0155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e00b1f50 0x7f36e0151e60 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 --2- 172.21.15.5:0/1513649303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e00b23d0 0x7f36e006a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 >> 172.21.15.5:0/1513649303 conn(0x7f36e006dae0 msgr2=0x7f36e00c3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:54.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 shutdown_connections 2023-10-16T13:48:54.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.765+0000 7f36e85ef700 1 -- 172.21.15.5:0/1513649303 wait complete. 2023-10-16T13:48:54.783 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:48:54.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.912+0000 7fa387786700 1 Processor -- start 2023-10-16T13:48:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.912+0000 7fa387786700 1 -- start start 2023-10-16T13:48:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa387786700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa38006b950 0x7fa380066750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa387786700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3800ce930 0x7fa38015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa387786700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa380066d30 con 0x7fa38006bd30 2023-10-16T13:48:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa387786700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800ce510 con 0x7fa38006b950 2023-10-16T13:48:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa387786700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015f2a0 con 0x7fa3800ce930 2023-10-16T13:48:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa385522700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa38006b950 0x7fa380066750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa384d21700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3800ce930 0x7fa38015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa385d23700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa38006bd30 0x7fa38006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50590/0 (socket says 172.21.15.5:50590) 2023-10-16T13:48:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.913+0000 7fa385d23700 1 -- 172.21.15.5:0/2217659915 learned_addr learned my addr 172.21.15.5:0/2217659915 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa377fff700 1 -- 172.21.15.5:0/2217659915 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505690330 0 0) 0x7fa380066d30 con 0x7fa38006bd30 2023-10-16T13:48:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa377fff700 1 -- 172.21.15.5:0/2217659915 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa36c0035b0 con 0x7fa38006bd30 2023-10-16T13:48:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa385522700 1 -- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3800ce930 msgr2=0x7fa38015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa385522700 1 --2- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3800ce930 0x7fa38015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa385522700 1 -- 172.21.15.5:0/2217659915 >> v1:172.21.15.112:6789/0 conn(0x7fa38006bd30 legacy=0x7fa38006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa385522700 1 -- 172.21.15.5:0/2217659915 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800cdb70 con 0x7fa38006b950 2023-10-16T13:48:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa384d21700 1 --2- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3800ce930 0x7fa38015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa385522700 1 --2- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006b950 0x7fa380066750 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa37000bae0 tx=0x7fa37000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45af42c9d3d7b8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa377fff700 1 -- 172.21.15.5:0/2217659915 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000dc70 con 0x7fa38006b950 2023-10-16T13:48:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa377fff700 1 -- 172.21.15.5:0/2217659915 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000ddd0 con 0x7fa38006b950 2023-10-16T13:48:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.914+0000 7fa377fff700 1 -- 172.21.15.5:0/2217659915 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370010690 con 0x7fa38006b950 2023-10-16T13:48:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 -- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006b950 msgr2=0x7fa380066750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 --2- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006b950 0x7fa380066750 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa37000bae0 tx=0x7fa37000bdf0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 -- 172.21.15.5:0/2217659915 shutdown_connections 2023-10-16T13:48:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 --2- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006b950 0x7fa380066750 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 --2- 172.21.15.5:0/2217659915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3800ce930 0x7fa38015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 -- 172.21.15.5:0/2217659915 >> 172.21.15.5:0/2217659915 conn(0x7fa3800b19f0 msgr2=0x7fa3800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 -- 172.21.15.5:0/2217659915 shutdown_connections 2023-10-16T13:48:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.915+0000 7fa387786700 1 -- 172.21.15.5:0/2217659915 wait complete. 2023-10-16T13:48:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.916+0000 7fa387786700 1 Processor -- start 2023-10-16T13:48:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.916+0000 7fa387786700 1 -- start start 2023-10-16T13:48:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa387786700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa38006b950 0x7fa3800c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa387786700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006bd30 0x7fa38014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa387786700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 0x7fa3800a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa387786700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38014f1c0 con 0x7fa3800ce930 2023-10-16T13:48:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa387786700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800a0870 con 0x7fa38006bd30 2023-10-16T13:48:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa387786700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801f3490 con 0x7fa38006b950 2023-10-16T13:48:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385d23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 0x7fa3800a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385d23700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 0x7fa3800a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49616/0 (socket says 172.21.15.5:49616) 2023-10-16T13:48:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa384d21700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006bd30 0x7fa38014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385d23700 1 -- 172.21.15.5:0/2177785702 learned_addr learned my addr 172.21.15.5:0/2177785702 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385522700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa38006b950 0x7fa3800c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385d23700 1 -- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa38006b950 msgr2=0x7fa3800c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385d23700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa38006b950 0x7fa3800c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.917+0000 7fa385d23700 1 -- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006bd30 msgr2=0x7fa38014ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa385d23700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006bd30 0x7fa38014ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa385d23700 1 -- 172.21.15.5:0/2177785702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0094a0 con 0x7fa3800ce930 2023-10-16T13:48:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa384d21700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006bd30 0x7fa38014ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa385d23700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 0x7fa3800a0330 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa37800cb40 tx=0x7fa37800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800a9e0 con 0x7fa3800ce930 2023-10-16T13:48:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800ab40 con 0x7fa3800ce930 2023-10-16T13:48:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378012400 con 0x7fa3800ce930 2023-10-16T13:48:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37000b740 con 0x7fa3800ce930 2023-10-16T13:48:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.918+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3800c9870 con 0x7fa3800ce930 2023-10-16T13:48:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.919+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380067d20 con 0x7fa3800ce930 2023-10-16T13:48:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.920+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fa37801b3b0 con 0x7fa3800ce930 2023-10-16T13:48:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.920+0000 7fa375ffb700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa36406b2f0 0x7fa36406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.920+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3780897c0 con 0x7fa3800ce930 2023-10-16T13:48:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.920+0000 7fa385522700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa36406b2f0 0x7fa36406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.921+0000 7fa385522700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa36406b2f0 0x7fa36406d7b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa37000be30 tx=0x7fa37001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:54.925+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3780543d0 con 0x7fa3800ce930 2023-10-16T13:48:55.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.167+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3800af820 con 0x7fa3800ce930 2023-10-16T13:48:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.168+0000 7fa375ffb700 1 -- 172.21.15.5:0/2177785702 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fa3780579f0 con 0x7fa3800ce930 2023-10-16T13:48:55.171 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:55.171 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2690348630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2690348630},{"type":"v1","addr":"172.21.15.112:6837","nonce":2690348630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3556823542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3556823542},{"type":"v1","addr":"172.21.15.112:6836","nonce":3556823542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:51.129490+0000","modified":"2023-10-16T13:48:54.173911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7713":{"gid":7713,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/618714180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":618714180},{"type":"v1","addr":"172.21.15.5:6835","nonce":618714180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-16T13:48:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa36406b2f0 msgr2=0x7fa36406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa36406b2f0 0x7fa36406d7b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa37000be30 tx=0x7fa37001c040 comp rx=0 tx=0).stop 2023-10-16T13:48:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 msgr2=0x7fa3800a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 0x7fa3800a0330 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa37800cb40 tx=0x7fa37800ce50 comp rx=0 tx=0).stop 2023-10-16T13:48:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 shutdown_connections 2023-10-16T13:48:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3800ce930 0x7fa3800a0330 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa36406b2f0 0x7fa36406d7b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa38006b950 0x7fa3800c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 --2- 172.21.15.5:0/2177785702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa38006bd30 0x7fa38014ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 >> 172.21.15.5:0/2177785702 conn(0x7fa3800b19f0 msgr2=0x7fa3800ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:55.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 shutdown_connections 2023-10-16T13:48:55.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.170+0000 7fa387786700 1 -- 172.21.15.5:0/2177785702 wait complete. 2023-10-16T13:48:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 79 2023-10-16T13:48:55.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:48:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.308+0000 7f4828916700 1 Processor -- start 2023-10-16T13:48:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.308+0000 7f4828916700 1 -- start start 2023-10-16T13:48:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4828916700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482415ab10 0x7f482415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4828916700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48240cfe30 0x7f48240cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4828916700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482415e7a0 con 0x7f48240b1f50 2023-10-16T13:48:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4828916700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482415f730 con 0x7f48240cfe30 2023-10-16T13:48:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4828916700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240b29a0 con 0x7f482415ab10 2023-10-16T13:48:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48240cfe30 0x7f48240cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48240cfe30 0x7f48240cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49624/0 (socket says 172.21.15.5:49624) 2023-10-16T13:48:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 -- 172.21.15.5:0/1733258209 learned_addr learned my addr 172.21.15.5:0/1733258209 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f482259c700 1 --2- 172.21.15.5:0/1733258209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482415ab10 0x7f482415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 -- 172.21.15.5:0/1733258209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482415ab10 msgr2=0x7f482415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 --2- 172.21.15.5:0/1733258209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482415ab10 0x7f482415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 -- 172.21.15.5:0/1733258209 >> v1:172.21.15.112:6789/0 conn(0x7f48240b1f50 legacy=0x7f48240cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.309+0000 7f4822d9d700 1 -- 172.21.15.5:0/1733258209 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48240b2c80 con 0x7f48240cfe30 2023-10-16T13:48:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4822d9d700 1 --2- 172.21.15.5:0/1733258209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240cfe30 0x7f48240cbf40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f481c00d150 tx=0x7f481c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b230269e2b49d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f482159a700 1 -- 172.21.15.5:0/1733258209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c010070 con 0x7f48240cfe30 2023-10-16T13:48:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f482159a700 1 -- 172.21.15.5:0/1733258209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c00ddc0 con 0x7f48240cfe30 2023-10-16T13:48:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f482159a700 1 -- 172.21.15.5:0/1733258209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00b310 con 0x7f48240cfe30 2023-10-16T13:48:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 -- 172.21.15.5:0/1733258209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240cfe30 msgr2=0x7f48240cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 --2- 172.21.15.5:0/1733258209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240cfe30 0x7f48240cbf40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f481c00d150 tx=0x7f481c00d460 comp rx=0 tx=0).stop 2023-10-16T13:48:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 -- 172.21.15.5:0/1733258209 shutdown_connections 2023-10-16T13:48:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 --2- 172.21.15.5:0/1733258209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240cfe30 0x7f48240cbf40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 --2- 172.21.15.5:0/1733258209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482415ab10 0x7f482415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 -- 172.21.15.5:0/1733258209 >> 172.21.15.5:0/1733258209 conn(0x7f482406dae0 msgr2=0x7f482406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 -- 172.21.15.5:0/1733258209 shutdown_connections 2023-10-16T13:48:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.310+0000 7f4828916700 1 -- 172.21.15.5:0/1733258209 wait complete. 2023-10-16T13:48:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 Processor -- start 2023-10-16T13:48:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 -- start start 2023-10-16T13:48:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48240b1f50 0x7f4824156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48240cfe30 0x7f48240acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 0x7f48241f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241f7be0 con 0x7f482415ab10 2023-10-16T13:48:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48240adb90 con 0x7f48240b1f50 2023-10-16T13:48:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.312+0000 7f4828916700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482415c0a0 con 0x7f48240cfe30 2023-10-16T13:48:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 0x7f48241f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 0x7f48241f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49628/0 (socket says 172.21.15.5:49628) 2023-10-16T13:48:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 -- 172.21.15.5:0/363770821 learned_addr learned my addr 172.21.15.5:0/363770821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4821d9b700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48240cfe30 0x7f48240acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f482259c700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48240b1f50 0x7f4824156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 -- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48240cfe30 msgr2=0x7f48240acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48240cfe30 0x7f48240acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 -- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48240b1f50 msgr2=0x7f4824156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48240b1f50 0x7f4824156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 -- 172.21.15.5:0/363770821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c00bd40 con 0x7f482415ab10 2023-10-16T13:48:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4822d9d700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 0x7f48241f76a0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f482406d4f0 tx=0x7f481c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c009a10 con 0x7f482415ab10 2023-10-16T13:48:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c009b70 con 0x7f482415ab10 2023-10-16T13:48:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482415c660 con 0x7f482415ab10 2023-10-16T13:48:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00bbc0 con 0x7f482415ab10 2023-10-16T13:48:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.313+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48240ad8b0 con 0x7f482415ab10 2023-10-16T13:48:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.314+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482415c7f0 con 0x7f482415ab10 2023-10-16T13:48:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.315+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f481c004040 con 0x7f482415ab10 2023-10-16T13:48:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.315+0000 7f4812ffd700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f480406b2f0 0x7f480406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.315+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f481c08b7c0 con 0x7f482415ab10 2023-10-16T13:48:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.315+0000 7f482259c700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f480406b2f0 0x7f480406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.316+0000 7f482259c700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f480406b2f0 0x7f480406d7b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4818006b20 tx=0x7f4818008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.320+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f481c056210 con 0x7f482415ab10 2023-10-16T13:48:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.520+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4824067d20 con 0x7f482415ab10 2023-10-16T13:48:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.522+0000 7f4812ffd700 1 -- 172.21.15.5:0/363770821 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f481c059830 con 0x7f482415ab10 2023-10-16T13:48:55.525 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:55.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":110,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:48:52.711493+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:48:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f480406b2f0 msgr2=0x7f480406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f480406b2f0 0x7f480406d7b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4818006b20 tx=0x7f4818008040 comp rx=0 tx=0).stop 2023-10-16T13:48:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 msgr2=0x7f48241f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 0x7f48241f76a0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f482406d4f0 tx=0x7f481c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 shutdown_connections 2023-10-16T13:48:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415ab10 0x7f48241f76a0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48240b1f50 0x7f4824156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f480406b2f0 0x7f480406d7b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 --2- 172.21.15.5:0/363770821 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48240cfe30 0x7f48240acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 >> 172.21.15.5:0/363770821 conn(0x7f482406dae0 msgr2=0x7f4824157420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 shutdown_connections 2023-10-16T13:48:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.524+0000 7f4828916700 1 -- 172.21.15.5:0/363770821 wait complete. 2023-10-16T13:48:55.539 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:48:55.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:48:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.663+0000 7f49ad946700 1 Processor -- start 2023-10-16T13:48:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.663+0000 7f49ad946700 1 -- start start 2023-10-16T13:48:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49ad946700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49a815f130 0x7f49a80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49ad946700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a80b28b0 0x7f49a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49ad946700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80b3530 con 0x7f49a806ad80 2023-10-16T13:48:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49ad946700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80cde00 con 0x7f49a815f130 2023-10-16T13:48:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49ad946700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a806b1b0 con 0x7f49a80b28b0 2023-10-16T13:48:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49a815f130 0x7f49a80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49a77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49a806ad80 0x7f49a8071af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59640/0 (socket says 172.21.15.5:59640) 2023-10-16T13:48:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49a77fe700 1 -- 172.21.15.5:0/2785164519 learned_addr learned my addr 172.21.15.5:0/2785164519 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49a6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49a815f130 0x7f49a80cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49632/0 (socket says 172.21.15.5:49632) 2023-10-16T13:48:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.664+0000 7f49a67fc700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a80b28b0 0x7f49a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a6ffd700 1 -- 172.21.15.5:0/2785164519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a80b28b0 msgr2=0x7f49a806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:55.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a6ffd700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a80b28b0 0x7f49a806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a6ffd700 1 -- 172.21.15.5:0/2785164519 >> v1:172.21.15.5:6789/0 conn(0x7f49a806ad80 legacy=0x7f49a8071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a6ffd700 1 -- 172.21.15.5:0/2785164519 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80cd180 con 0x7f49a815f130 2023-10-16T13:48:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a67fc700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a80b28b0 0x7f49a806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a6ffd700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a815f130 0x7f49a80cede0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f499c009840 tx=0x7f499c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd580a43e8b726c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a5ffb700 1 -- 172.21.15.5:0/2785164519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011830 con 0x7f49a815f130 2023-10-16T13:48:55.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a5ffb700 1 -- 172.21.15.5:0/2785164519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011990 con 0x7f49a815f130 2023-10-16T13:48:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49a5ffb700 1 -- 172.21.15.5:0/2785164519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011d20 con 0x7f49a815f130 2023-10-16T13:48:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49ad946700 1 -- 172.21.15.5:0/2785164519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a815f130 msgr2=0x7f49a80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49ad946700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a815f130 0x7f49a80cede0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f499c009840 tx=0x7f499c009b50 comp rx=0 tx=0).stop 2023-10-16T13:48:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49ad946700 1 -- 172.21.15.5:0/2785164519 shutdown_connections 2023-10-16T13:48:55.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49ad946700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a815f130 0x7f49a80cede0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49ad946700 1 --2- 172.21.15.5:0/2785164519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a80b28b0 0x7f49a806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.665+0000 7f49ad946700 1 -- 172.21.15.5:0/2785164519 >> 172.21.15.5:0/2785164519 conn(0x7f49a806dae0 msgr2=0x7f49a806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.666+0000 7f49ad946700 1 -- 172.21.15.5:0/2785164519 shutdown_connections 2023-10-16T13:48:55.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.666+0000 7f49ad946700 1 -- 172.21.15.5:0/2785164519 wait complete. 2023-10-16T13:48:55.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.667+0000 7f49ad946700 1 Processor -- start 2023-10-16T13:48:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.667+0000 7f49ad946700 1 -- start start 2023-10-16T13:48:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 0x7f49a80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b28b0 0x7f49a80c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a815f130 0x7f49a81f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a815a8e0 con 0x7f49a806ad80 2023-10-16T13:48:55.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a815b700 con 0x7f49a80b28b0 2023-10-16T13:48:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80ca8d0 con 0x7f49a815f130 2023-10-16T13:48:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 0x7f49a80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 0x7f49a80ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49638/0 (socket says 172.21.15.5:49638) 2023-10-16T13:48:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 -- 172.21.15.5:0/882808863 learned_addr learned my addr 172.21.15.5:0/882808863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a77fe700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a815f130 0x7f49a81f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 -- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a815f130 msgr2=0x7f49a81f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a815f130 0x7f49a81f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 -- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b28b0 msgr2=0x7f49a80c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a67fc700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b28b0 0x7f49a80c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b28b0 0x7f49a80c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 -- 172.21.15.5:0/882808863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0094a0 con 0x7f49a806ad80 2023-10-16T13:48:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49a6ffd700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 0x7f49a80ca390 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f499c0090b0 tx=0x7f499c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0038a0 con 0x7f49a806ad80 2023-10-16T13:48:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c01f070 con 0x7f49a806ad80 2023-10-16T13:48:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a815aaf0 con 0x7f49a806ad80 2023-10-16T13:48:55.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c003c60 con 0x7f49a806ad80 2023-10-16T13:48:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.668+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a815b0b0 con 0x7f49a806ad80 2023-10-16T13:48:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.669+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a8067d20 con 0x7f49a806ad80 2023-10-16T13:48:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.670+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f499c01a430 con 0x7f49a806ad80 2023-10-16T13:48:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.670+0000 7f498ffff700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f499406b2f0 0x7f499406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.670+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f499c021070 con 0x7f49a806ad80 2023-10-16T13:48:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.670+0000 7f49a67fc700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f499406b2f0 0x7f499406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.671+0000 7f49a67fc700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f499406b2f0 0x7f499406d7b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f49a80c9bc0 tx=0x7f4998008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.675+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f499c0562e0 con 0x7f49a806ad80 2023-10-16T13:48:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.875+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49a80cd740 con 0x7f499406b2f0 2023-10-16T13:48:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.883+0000 7f498ffff700 1 -- 172.21.15.5:0/882808863 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290001 (secure 0 0 0) 0x7f499800c040 con 0x7f499406b2f0 2023-10-16T13:48:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f499406b2f0 msgr2=0x7f499406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f499406b2f0 0x7f499406d7b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f49a80c9bc0 tx=0x7f4998008040 comp rx=0 tx=0).stop 2023-10-16T13:48:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 msgr2=0x7f49a80ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 0x7f49a80ca390 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f499c0090b0 tx=0x7f499c004750 comp rx=0 tx=0).stop 2023-10-16T13:48:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 shutdown_connections 2023-10-16T13:48:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f499406b2f0 0x7f499406d7b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a815f130 0x7f49a81f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a806ad80 0x7f49a80ca390 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 --2- 172.21.15.5:0/882808863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b28b0 0x7f49a80c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 >> 172.21.15.5:0/882808863 conn(0x7f49a806dae0 msgr2=0x7f49a80b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 shutdown_connections 2023-10-16T13:48:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:55.887+0000 7f49ad946700 1 -- 172.21.15.5:0/882808863 wait complete. 2023-10-16T13:48:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:48:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2023-10-16T13:48:55.617285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261388,"kb_used_data":11932,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713332,"statfs":{"total":773094113280,"available":772826451968,"internally_reserved":0,"allocated":12218368,"data_stored":5955594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.906984"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002341+0000","last_change":"2023-10-16T13:48:51.726183+0000","last_active":"2023-10-16T13:48:53.002341+0000","last_peered":"2023-10-16T13:48:53.002341+0000","last_clean":"2023-10-16T13:48:53.002341+0000","last_became_active":"2023-10-16T13:48:51.725308+0000","last_became_peered":"2023-10-16T13:48:51.725308+0000","last_unstale":"2023-10-16T13:48:53.002341+0000","last_undegraded":"2023-10-16T13:48:53.002341+0000","last_fullsized":"2023-10-16T13:48:53.002341+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.893297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002603+0000","last_change":"2023-10-16T13:48:51.727405+0000","last_active":"2023-10-16T13:48:53.002603+0000","last_peered":"2023-10-16T13:48:53.002603+0000","last_clean":"2023-10-16T13:48:53.002603+0000","last_became_active":"2023-10-16T13:48:51.726535+0000","last_became_peered":"2023-10-16T13:48:51.726535+0000","last_unstale":"2023-10-16T13:48:53.002603+0000","last_undegraded":"2023-10-16T13:48:53.002603+0000","last_fullsized":"2023-10-16T13:48:53.002603+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:31.659462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717586+0000","last_change":"2023-10-16T13:48:51.736917+0000","last_active":"2023-10-16T13:48:52.717586+0000","last_peered":"2023-10-16T13:48:52.717586+0000","last_clean":"2023-10-16T13:48:52.717586+0000","last_became_active":"2023-10-16T13:48:51.736687+0000","last_became_peered":"2023-10-16T13:48:51.736687+0000","last_unstale":"2023-10-16T13:48:52.717586+0000","last_undegraded":"2023-10-16T13:48:52.717586+0000","last_fullsized":"2023-10-16T13:48:52.717586+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:58.967594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002404+0000","last_change":"2023-10-16T13:48:51.728119+0000","last_active":"2023-10-16T13:48:53.002404+0000","last_peered":"2023-10-16T13:48:53.002404+0000","last_clean":"2023-10-16T13:48:53.002404+0000","last_became_active":"2023-10-16T13:48:51.727784+0000","last_became_peered":"2023-10-16T13:48:51.727784+0000","last_unstale":"2023-10-16T13:48:53.002404+0000","last_undegraded":"2023-10-16T13:48:53.002404+0000","last_fullsized":"2023-10-16T13:48:53.002404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:29:39.328695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002109+0000","last_change":"2023-10-16T13:48:51.727478+0000","last_active":"2023-10-16T13:48:53.002109+0000","last_peered":"2023-10-16T13:48:53.002109+0000","last_clean":"2023-10-16T13:48:53.002109+0000","last_became_active":"2023-10-16T13:48:51.727077+0000","last_became_peered":"2023-10-16T13:48:51.727077+0000","last_unstale":"2023-10-16T13:48:53.002109+0000","last_undegraded":"2023-10-16T13:48:53.002109+0000","last_fullsized":"2023-10-16T13:48:53.002109+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:29.748225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716203+0000","last_change":"2023-10-16T13:48:51.726436+0000","last_active":"2023-10-16T13:48:52.716203+0000","last_peered":"2023-10-16T13:48:52.716203+0000","last_clean":"2023-10-16T13:48:52.716203+0000","last_became_active":"2023-10-16T13:48:51.726047+0000","last_became_peered":"2023-10-16T13:48:51.726047+0000","last_unstale":"2023-10-16T13:48:52.716203+0000","last_undegraded":"2023-10-16T13:48:52.716203+0000","last_fullsized":"2023-10-16T13:48:52.716203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:43:50.438194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716595+0000","last_change":"2023-10-16T13:48:51.733064+0000","last_active":"2023-10-16T13:48:52.716595+0000","last_peered":"2023-10-16T13:48:52.716595+0000","last_clean":"2023-10-16T13:48:52.716595+0000","last_became_active":"2023-10-16T13:48:51.732793+0000","last_became_peered":"2023-10-16T13:48:51.732793+0000","last_unstale":"2023-10-16T13:48:52.716595+0000","last_undegraded":"2023-10-16T13:48:52.716595+0000","last_fullsized":"2023-10-16T13:48:52.716595+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:14:16.872024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715817+0000","last_change":"2023-10-16T13:48:51.732955+0000","last_active":"2023-10-16T13:48:52.715817+0000","last_peered":"2023-10-16T13:48:52.715817+0000","last_clean":"2023-10-16T13:48:52.715817+0000","last_became_active":"2023-10-16T13:48:51.732541+0000","last_became_peered":"2023-10-16T13:48:51.732541+0000","last_unstale":"2023-10-16T13:48:52.715817+0000","last_undegraded":"2023-10-16T13:48:52.715817+0000","last_fullsized":"2023-10-16T13:48:52.715817+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:56.932597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717696+0000","last_change":"2023-10-16T13:48:51.731294+0000","last_active":"2023-10-16T13:48:52.717696+0000","last_peered":"2023-10-16T13:48:52.717696+0000","last_clean":"2023-10-16T13:48:52.717696+0000","last_became_active":"2023-10-16T13:48:51.731014+0000","last_became_peered":"2023-10-16T13:48:51.731014+0000","last_unstale":"2023-10-16T13:48:52.717696+0000","last_undegraded":"2023-10-16T13:48:52.717696+0000","last_fullsized":"2023-10-16T13:48:52.717696+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:38.955755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002738+0000","last_change":"2023-10-16T13:48:51.727656+0000","last_active":"2023-10-16T13:48:53.002738+0000","last_peered":"2023-10-16T13:48:53.002738+0000","last_clean":"2023-10-16T13:48:53.002738+0000","last_became_active":"2023-10-16T13:48:51.727171+0000","last_became_peered":"2023-10-16T13:48:51.727171+0000","last_unstale":"2023-10-16T13:48:53.002738+0000","last_undegraded":"2023-10-16T13:48:53.002738+0000","last_fullsized":"2023-10-16T13:48:53.002738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:08.653951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002876+0000","last_change":"2023-10-16T13:48:51.737117+0000","last_active":"2023-10-16T13:48:53.002876+0000","last_peered":"2023-10-16T13:48:53.002876+0000","last_clean":"2023-10-16T13:48:53.002876+0000","last_became_active":"2023-10-16T13:48:51.736578+0000","last_became_peered":"2023-10-16T13:48:51.736578+0000","last_unstale":"2023-10-16T13:48:53.002876+0000","last_undegraded":"2023-10-16T13:48:53.002876+0000","last_fullsized":"2023-10-16T13:48:53.002876+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:31.385782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715710+0000","last_change":"2023-10-16T13:48:51.726500+0000","last_active":"2023-10-16T13:48:52.715710+0000","last_peered":"2023-10-16T13:48:52.715710+0000","last_clean":"2023-10-16T13:48:52.715710+0000","last_became_active":"2023-10-16T13:48:51.726239+0000","last_became_peered":"2023-10-16T13:48:51.726239+0000","last_unstale":"2023-10-16T13:48:52.715710+0000","last_undegraded":"2023-10-16T13:48:52.715710+0000","last_fullsized":"2023-10-16T13:48:52.715710+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:14:01.580036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003276+0000","last_change":"2023-10-16T13:48:51.726769+0000","last_active":"2023-10-16T13:48:53.003276+0000","last_peered":"2023-10-16T13:48:53.003276+0000","last_clean":"2023-10-16T13:48:53.003276+0000","last_became_active":"2023-10-16T13:48:51.726412+0000","last_became_peered":"2023-10-16T13:48:51.726412+0000","last_unstale":"2023-10-16T13:48:53.003276+0000","last_undegraded":"2023-10-16T13:48:53.003276+0000","last_fullsized":"2023-10-16T13:48:53.003276+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:50.926632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002695+0000","last_change":"2023-10-16T13:48:51.724589+0000","last_active":"2023-10-16T13:48:53.002695+0000","last_peered":"2023-10-16T13:48:53.002695+0000","last_clean":"2023-10-16T13:48:53.002695+0000","last_became_active":"2023-10-16T13:48:51.724262+0000","last_became_peered":"2023-10-16T13:48:51.724262+0000","last_unstale":"2023-10-16T13:48:53.002695+0000","last_undegraded":"2023-10-16T13:48:53.002695+0000","last_fullsized":"2023-10-16T13:48:53.002695+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:49:37.664530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003012+0000","last_change":"2023-10-16T13:48:51.733820+0000","last_active":"2023-10-16T13:48:53.003012+0000","last_peered":"2023-10-16T13:48:53.003012+0000","last_clean":"2023-10-16T13:48:53.003012+0000","last_became_active":"2023-10-16T13:48:51.733542+0000","last_became_peered":"2023-10-16T13:48:51.733542+0000","last_unstale":"2023-10-16T13:48:53.003012+0000","last_undegraded":"2023-10-16T13:48:53.003012+0000","last_fullsized":"2023-10-16T13:48:53.003012+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:34.543509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002088+0000","last_change":"2023-10-16T13:48:51.726754+0000","last_active":"2023-10-16T13:48:53.002088+0000","last_peered":"2023-10-16T13:48:53.002088+0000","last_clean":"2023-10-16T13:48:53.002088+0000","last_became_active":"2023-10-16T13:48:51.725174+0000","last_became_peered":"2023-10-16T13:48:51.725174+0000","last_unstale":"2023-10-16T13:48:53.002088+0000","last_undegraded":"2023-10-16T13:48:53.002088+0000","last_fullsized":"2023-10-16T13:48:53.002088+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:00:03.738122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716849+0000","last_change":"2023-10-16T13:48:51.735544+0000","last_active":"2023-10-16T13:48:52.716849+0000","last_peered":"2023-10-16T13:48:52.716849+0000","last_clean":"2023-10-16T13:48:52.716849+0000","last_became_active":"2023-10-16T13:48:51.735259+0000","last_became_peered":"2023-10-16T13:48:51.735259+0000","last_unstale":"2023-10-16T13:48:52.716849+0000","last_undegraded":"2023-10-16T13:48:52.716849+0000","last_fullsized":"2023-10-16T13:48:52.716849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:28.685961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002748+0000","last_change":"2023-10-16T13:48:51.728631+0000","last_active":"2023-10-16T13:48:53.002748+0000","last_peered":"2023-10-16T13:48:53.002748+0000","last_clean":"2023-10-16T13:48:53.002748+0000","last_became_active":"2023-10-16T13:48:51.728155+0000","last_became_peered":"2023-10-16T13:48:51.728155+0000","last_unstale":"2023-10-16T13:48:53.002748+0000","last_undegraded":"2023-10-16T13:48:53.002748+0000","last_fullsized":"2023-10-16T13:48:53.002748+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:29.748225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003168+0000","last_change":"2023-10-16T13:48:51.737134+0000","last_active":"2023-10-16T13:48:53.003168+0000","last_peered":"2023-10-16T13:48:53.003168+0000","last_clean":"2023-10-16T13:48:53.003168+0000","last_became_active":"2023-10-16T13:48:51.736310+0000","last_became_peered":"2023-10-16T13:48:51.736310+0000","last_unstale":"2023-10-16T13:48:53.003168+0000","last_undegraded":"2023-10-16T13:48:53.003168+0000","last_fullsized":"2023-10-16T13:48:53.003168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.228947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002687+0000","last_change":"2023-10-16T13:48:51.724449+0000","last_active":"2023-10-16T13:48:53.002687+0000","last_peered":"2023-10-16T13:48:53.002687+0000","last_clean":"2023-10-16T13:48:53.002687+0000","last_became_active":"2023-10-16T13:48:51.724154+0000","last_became_peered":"2023-10-16T13:48:51.724154+0000","last_unstale":"2023-10-16T13:48:53.002687+0000","last_undegraded":"2023-10-16T13:48:53.002687+0000","last_fullsized":"2023-10-16T13:48:53.002687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.228947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002323+0000","last_change":"2023-10-16T13:48:51.727826+0000","last_active":"2023-10-16T13:48:53.002323+0000","last_peered":"2023-10-16T13:48:53.002323+0000","last_clean":"2023-10-16T13:48:53.002323+0000","last_became_active":"2023-10-16T13:48:51.727507+0000","last_became_peered":"2023-10-16T13:48:51.727507+0000","last_unstale":"2023-10-16T13:48:53.002323+0000","last_undegraded":"2023-10-16T13:48:53.002323+0000","last_fullsized":"2023-10-16T13:48:53.002323+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:23.339409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002130+0000","last_change":"2023-10-16T13:48:51.735270+0000","last_active":"2023-10-16T13:48:53.002130+0000","last_peered":"2023-10-16T13:48:53.002130+0000","last_clean":"2023-10-16T13:48:53.002130+0000","last_became_active":"2023-10-16T13:48:51.734787+0000","last_became_peered":"2023-10-16T13:48:51.734787+0000","last_unstale":"2023-10-16T13:48:53.002130+0000","last_undegraded":"2023-10-16T13:48:53.002130+0000","last_fullsized":"2023-10-16T13:48:53.002130+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:00:03.738122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716129+0000","last_change":"2023-10-16T13:48:51.730391+0000","last_active":"2023-10-16T13:48:52.716129+0000","last_peered":"2023-10-16T13:48:52.716129+0000","last_clean":"2023-10-16T13:48:52.716129+0000","last_became_active":"2023-10-16T13:48:51.730065+0000","last_became_peered":"2023-10-16T13:48:51.730065+0000","last_unstale":"2023-10-16T13:48:52.716129+0000","last_undegraded":"2023-10-16T13:48:52.716129+0000","last_fullsized":"2023-10-16T13:48:52.716129+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:48.730517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003163+0000","last_change":"2023-10-16T13:48:51.736513+0000","last_active":"2023-10-16T13:48:53.003163+0000","last_peered":"2023-10-16T13:48:53.003163+0000","last_clean":"2023-10-16T13:48:53.003163+0000","last_became_active":"2023-10-16T13:48:51.736089+0000","last_became_peered":"2023-10-16T13:48:51.736089+0000","last_unstale":"2023-10-16T13:48:53.003163+0000","last_undegraded":"2023-10-16T13:48:53.003163+0000","last_fullsized":"2023-10-16T13:48:53.003163+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:11:27.204983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003391+0000","last_change":"2023-10-16T13:48:51.726731+0000","last_active":"2023-10-16T13:48:53.003391+0000","last_peered":"2023-10-16T13:48:53.003391+0000","last_clean":"2023-10-16T13:48:53.003391+0000","last_became_active":"2023-10-16T13:48:51.726052+0000","last_became_peered":"2023-10-16T13:48:51.726052+0000","last_unstale":"2023-10-16T13:48:53.003391+0000","last_undegraded":"2023-10-16T13:48:53.003391+0000","last_fullsized":"2023-10-16T13:48:53.003391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:25:36.882801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002883+0000","last_change":"2023-10-16T13:48:51.727038+0000","last_active":"2023-10-16T13:48:53.002883+0000","last_peered":"2023-10-16T13:48:53.002883+0000","last_clean":"2023-10-16T13:48:53.002883+0000","last_became_active":"2023-10-16T13:48:51.725120+0000","last_became_peered":"2023-10-16T13:48:51.725120+0000","last_unstale":"2023-10-16T13:48:53.002883+0000","last_undegraded":"2023-10-16T13:48:53.002883+0000","last_fullsized":"2023-10-16T13:48:53.002883+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:23.339409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003063+0000","last_change":"2023-10-16T13:48:51.727534+0000","last_active":"2023-10-16T13:48:53.003063+0000","last_peered":"2023-10-16T13:48:53.003063+0000","last_clean":"2023-10-16T13:48:53.003063+0000","last_became_active":"2023-10-16T13:48:51.725669+0000","last_became_peered":"2023-10-16T13:48:51.725669+0000","last_unstale":"2023-10-16T13:48:53.003063+0000","last_undegraded":"2023-10-16T13:48:53.003063+0000","last_fullsized":"2023-10-16T13:48:53.003063+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:33:24.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716392+0000","last_change":"2023-10-16T13:48:51.729263+0000","last_active":"2023-10-16T13:48:52.716392+0000","last_peered":"2023-10-16T13:48:52.716392+0000","last_clean":"2023-10-16T13:48:52.716392+0000","last_became_active":"2023-10-16T13:48:51.728896+0000","last_became_peered":"2023-10-16T13:48:51.728896+0000","last_unstale":"2023-10-16T13:48:52.716392+0000","last_undegraded":"2023-10-16T13:48:52.716392+0000","last_fullsized":"2023-10-16T13:48:52.716392+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:07.742873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003404+0000","last_change":"2023-10-16T13:48:51.727119+0000","last_active":"2023-10-16T13:48:53.003404+0000","last_peered":"2023-10-16T13:48:53.003404+0000","last_clean":"2023-10-16T13:48:53.003404+0000","last_became_active":"2023-10-16T13:48:51.726824+0000","last_became_peered":"2023-10-16T13:48:51.726824+0000","last_unstale":"2023-10-16T13:48:53.003404+0000","last_undegraded":"2023-10-16T13:48:53.003404+0000","last_fullsized":"2023-10-16T13:48:53.003404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:18.937888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002275+0000","last_change":"2023-10-16T13:48:51.730217+0000","last_active":"2023-10-16T13:48:53.002275+0000","last_peered":"2023-10-16T13:48:53.002275+0000","last_clean":"2023-10-16T13:48:53.002275+0000","last_became_active":"2023-10-16T13:48:51.729102+0000","last_became_peered":"2023-10-16T13:48:51.729102+0000","last_unstale":"2023-10-16T13:48:53.002275+0000","last_undegraded":"2023-10-16T13:48:53.002275+0000","last_fullsized":"2023-10-16T13:48:53.002275+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:36.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002416+0000","last_change":"2023-10-16T13:48:51.731686+0000","last_active":"2023-10-16T13:48:53.002416+0000","last_peered":"2023-10-16T13:48:53.002416+0000","last_clean":"2023-10-16T13:48:53.002416+0000","last_became_active":"2023-10-16T13:48:51.731314+0000","last_became_peered":"2023-10-16T13:48:51.731314+0000","last_unstale":"2023-10-16T13:48:53.002416+0000","last_undegraded":"2023-10-16T13:48:53.002416+0000","last_fullsized":"2023-10-16T13:48:53.002416+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:36:25.915352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716097+0000","last_change":"2023-10-16T13:48:51.729423+0000","last_active":"2023-10-16T13:48:52.716097+0000","last_peered":"2023-10-16T13:48:52.716097+0000","last_clean":"2023-10-16T13:48:52.716097+0000","last_became_active":"2023-10-16T13:48:51.728875+0000","last_became_peered":"2023-10-16T13:48:51.728875+0000","last_unstale":"2023-10-16T13:48:52.716097+0000","last_undegraded":"2023-10-16T13:48:52.716097+0000","last_fullsized":"2023-10-16T13:48:52.716097+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:59.838188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002992+0000","last_change":"2023-10-16T13:48:51.723731+0000","last_active":"2023-10-16T13:48:53.002992+0000","last_peered":"2023-10-16T13:48:53.002992+0000","last_clean":"2023-10-16T13:48:53.002992+0000","last_became_active":"2023-10-16T13:48:51.723330+0000","last_became_peered":"2023-10-16T13:48:51.723330+0000","last_unstale":"2023-10-16T13:48:53.002992+0000","last_undegraded":"2023-10-16T13:48:53.002992+0000","last_fullsized":"2023-10-16T13:48:53.002992+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.698650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"109'4","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002272+0000","last_change":"2023-10-16T13:48:50.737701+0000","last_active":"2023-10-16T13:48:53.002272+0000","last_peered":"2023-10-16T13:48:53.002272+0000","last_clean":"2023-10-16T13:48:53.002272+0000","last_became_active":"2023-10-16T13:48:50.737422+0000","last_became_peered":"2023-10-16T13:48:50.737422+0000","last_unstale":"2023-10-16T13:48:53.002272+0000","last_undegraded":"2023-10-16T13:48:53.002272+0000","last_fullsized":"2023-10-16T13:48:53.002272+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:51.529725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717699+0000","last_change":"2023-10-16T13:48:51.728282+0000","last_active":"2023-10-16T13:48:52.717699+0000","last_peered":"2023-10-16T13:48:52.717699+0000","last_clean":"2023-10-16T13:48:52.717699+0000","last_became_active":"2023-10-16T13:48:51.727955+0000","last_became_peered":"2023-10-16T13:48:51.727955+0000","last_unstale":"2023-10-16T13:48:52.717699+0000","last_undegraded":"2023-10-16T13:48:52.717699+0000","last_fullsized":"2023-10-16T13:48:52.717699+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:59.138291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716250+0000","last_change":"2023-10-16T13:48:50.728678+0000","last_active":"2023-10-16T13:48:52.716250+0000","last_peered":"2023-10-16T13:48:52.716250+0000","last_clean":"2023-10-16T13:48:52.716250+0000","last_became_active":"2023-10-16T13:48:50.728371+0000","last_became_peered":"2023-10-16T13:48:50.728371+0000","last_unstale":"2023-10-16T13:48:52.716250+0000","last_undegraded":"2023-10-16T13:48:52.716250+0000","last_fullsized":"2023-10-16T13:48:52.716250+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:03:24.040668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002324+0000","last_change":"2023-10-16T13:48:51.730191+0000","last_active":"2023-10-16T13:48:53.002324+0000","last_peered":"2023-10-16T13:48:53.002324+0000","last_clean":"2023-10-16T13:48:53.002324+0000","last_became_active":"2023-10-16T13:48:51.729923+0000","last_became_peered":"2023-10-16T13:48:51.729923+0000","last_unstale":"2023-10-16T13:48:53.002324+0000","last_undegraded":"2023-10-16T13:48:53.002324+0000","last_fullsized":"2023-10-16T13:48:53.002324+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:50.007623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002976+0000","last_change":"2023-10-16T13:48:50.735881+0000","last_active":"2023-10-16T13:48:53.002976+0000","last_peered":"2023-10-16T13:48:53.002976+0000","last_clean":"2023-10-16T13:48:53.002976+0000","last_became_active":"2023-10-16T13:48:50.735532+0000","last_became_peered":"2023-10-16T13:48:50.735532+0000","last_unstale":"2023-10-16T13:48:53.002976+0000","last_undegraded":"2023-10-16T13:48:53.002976+0000","last_fullsized":"2023-10-16T13:48:53.002976+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:02.580945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002407+0000","last_change":"2023-10-16T13:48:51.728119+0000","last_active":"2023-10-16T13:48:53.002407+0000","last_peered":"2023-10-16T13:48:53.002407+0000","last_clean":"2023-10-16T13:48:53.002407+0000","last_became_active":"2023-10-16T13:48:51.727123+0000","last_became_peered":"2023-10-16T13:48:51.727123+0000","last_unstale":"2023-10-16T13:48:53.002407+0000","last_undegraded":"2023-10-16T13:48:53.002407+0000","last_fullsized":"2023-10-16T13:48:53.002407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:36.963095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003294+0000","last_change":"2023-10-16T13:48:50.732491+0000","last_active":"2023-10-16T13:48:53.003294+0000","last_peered":"2023-10-16T13:48:53.003294+0000","last_clean":"2023-10-16T13:48:53.003294+0000","last_became_active":"2023-10-16T13:48:50.732186+0000","last_became_peered":"2023-10-16T13:48:50.732186+0000","last_unstale":"2023-10-16T13:48:53.003294+0000","last_undegraded":"2023-10-16T13:48:53.003294+0000","last_fullsized":"2023-10-16T13:48:53.003294+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:13.321762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002522+0000","last_change":"2023-10-16T13:48:51.726396+0000","last_active":"2023-10-16T13:48:53.002522+0000","last_peered":"2023-10-16T13:48:53.002522+0000","last_clean":"2023-10-16T13:48:53.002522+0000","last_became_active":"2023-10-16T13:48:51.725962+0000","last_became_peered":"2023-10-16T13:48:51.725962+0000","last_unstale":"2023-10-16T13:48:53.002522+0000","last_undegraded":"2023-10-16T13:48:53.002522+0000","last_fullsized":"2023-10-16T13:48:53.002522+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:11:27.204983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003094+0000","last_change":"2023-10-16T13:48:50.738698+0000","last_active":"2023-10-16T13:48:53.003094+0000","last_peered":"2023-10-16T13:48:53.003094+0000","last_clean":"2023-10-16T13:48:53.003094+0000","last_became_active":"2023-10-16T13:48:50.738470+0000","last_became_peered":"2023-10-16T13:48:50.738470+0000","last_unstale":"2023-10-16T13:48:53.003094+0000","last_undegraded":"2023-10-16T13:48:53.003094+0000","last_fullsized":"2023-10-16T13:48:53.003094+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:27.832481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715879+0000","last_change":"2023-10-16T13:48:51.738057+0000","last_active":"2023-10-16T13:48:52.715879+0000","last_peered":"2023-10-16T13:48:52.715879+0000","last_clean":"2023-10-16T13:48:52.715879+0000","last_became_active":"2023-10-16T13:48:51.737712+0000","last_became_peered":"2023-10-16T13:48:51.737712+0000","last_unstale":"2023-10-16T13:48:52.715879+0000","last_undegraded":"2023-10-16T13:48:52.715879+0000","last_fullsized":"2023-10-16T13:48:52.715879+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:52.535382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002618+0000","last_change":"2023-10-16T13:48:50.735579+0000","last_active":"2023-10-16T13:48:53.002618+0000","last_peered":"2023-10-16T13:48:53.002618+0000","last_clean":"2023-10-16T13:48:53.002618+0000","last_became_active":"2023-10-16T13:48:50.735273+0000","last_became_peered":"2023-10-16T13:48:50.735273+0000","last_unstale":"2023-10-16T13:48:53.002618+0000","last_undegraded":"2023-10-16T13:48:53.002618+0000","last_fullsized":"2023-10-16T13:48:53.002618+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:14:15.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715970+0000","last_change":"2023-10-16T13:48:51.732885+0000","last_active":"2023-10-16T13:48:52.715970+0000","last_peered":"2023-10-16T13:48:52.715970+0000","last_clean":"2023-10-16T13:48:52.715970+0000","last_became_active":"2023-10-16T13:48:51.732149+0000","last_became_peered":"2023-10-16T13:48:51.732149+0000","last_unstale":"2023-10-16T13:48:52.715970+0000","last_undegraded":"2023-10-16T13:48:52.715970+0000","last_fullsized":"2023-10-16T13:48:52.715970+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:47.543306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716731+0000","last_change":"2023-10-16T13:48:50.728879+0000","last_active":"2023-10-16T13:48:52.716731+0000","last_peered":"2023-10-16T13:48:52.716731+0000","last_clean":"2023-10-16T13:48:52.716731+0000","last_became_active":"2023-10-16T13:48:50.728569+0000","last_became_peered":"2023-10-16T13:48:50.728569+0000","last_unstale":"2023-10-16T13:48:52.716731+0000","last_undegraded":"2023-10-16T13:48:52.716731+0000","last_fullsized":"2023-10-16T13:48:52.716731+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:10.214411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002457+0000","last_change":"2023-10-16T13:48:51.724543+0000","last_active":"2023-10-16T13:48:53.002457+0000","last_peered":"2023-10-16T13:48:53.002457+0000","last_clean":"2023-10-16T13:48:53.002457+0000","last_became_active":"2023-10-16T13:48:51.724185+0000","last_became_peered":"2023-10-16T13:48:51.724185+0000","last_unstale":"2023-10-16T13:48:53.002457+0000","last_undegraded":"2023-10-16T13:48:53.002457+0000","last_fullsized":"2023-10-16T13:48:53.002457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:13.511678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002644+0000","last_change":"2023-10-16T13:48:50.732852+0000","last_active":"2023-10-16T13:48:53.002644+0000","last_peered":"2023-10-16T13:48:53.002644+0000","last_clean":"2023-10-16T13:48:53.002644+0000","last_became_active":"2023-10-16T13:48:50.731897+0000","last_became_peered":"2023-10-16T13:48:50.731897+0000","last_unstale":"2023-10-16T13:48:53.002644+0000","last_undegraded":"2023-10-16T13:48:53.002644+0000","last_fullsized":"2023-10-16T13:48:53.002644+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:12:21.018306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002596+0000","last_change":"2023-10-16T13:48:51.738088+0000","last_active":"2023-10-16T13:48:53.002596+0000","last_peered":"2023-10-16T13:48:53.002596+0000","last_clean":"2023-10-16T13:48:53.002596+0000","last_became_active":"2023-10-16T13:48:51.737725+0000","last_became_peered":"2023-10-16T13:48:51.737725+0000","last_unstale":"2023-10-16T13:48:53.002596+0000","last_undegraded":"2023-10-16T13:48:53.002596+0000","last_fullsized":"2023-10-16T13:48:53.002596+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:59:33.297020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717284+0000","last_change":"2023-10-16T13:48:50.727969+0000","last_active":"2023-10-16T13:48:52.717284+0000","last_peered":"2023-10-16T13:48:52.717284+0000","last_clean":"2023-10-16T13:48:52.717284+0000","last_became_active":"2023-10-16T13:48:50.727532+0000","last_became_peered":"2023-10-16T13:48:50.727532+0000","last_unstale":"2023-10-16T13:48:52.717284+0000","last_undegraded":"2023-10-16T13:48:52.717284+0000","last_fullsized":"2023-10-16T13:48:52.717284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:46.537650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717101+0000","last_change":"2023-10-16T13:48:51.724315+0000","last_active":"2023-10-16T13:48:52.717101+0000","last_peered":"2023-10-16T13:48:52.717101+0000","last_clean":"2023-10-16T13:48:52.717101+0000","last_became_active":"2023-10-16T13:48:51.724024+0000","last_became_peered":"2023-10-16T13:48:51.724024+0000","last_unstale":"2023-10-16T13:48:52.717101+0000","last_undegraded":"2023-10-16T13:48:52.717101+0000","last_fullsized":"2023-10-16T13:48:52.717101+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:28.838137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002974+0000","last_change":"2023-10-16T13:48:50.729440+0000","last_active":"2023-10-16T13:48:53.002974+0000","last_peered":"2023-10-16T13:48:53.002974+0000","last_clean":"2023-10-16T13:48:53.002974+0000","last_became_active":"2023-10-16T13:48:50.729183+0000","last_became_peered":"2023-10-16T13:48:50.729183+0000","last_unstale":"2023-10-16T13:48:53.002974+0000","last_undegraded":"2023-10-16T13:48:53.002974+0000","last_fullsized":"2023-10-16T13:48:53.002974+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:02.580945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002370+0000","last_change":"2023-10-16T13:48:51.728909+0000","last_active":"2023-10-16T13:48:53.002370+0000","last_peered":"2023-10-16T13:48:53.002370+0000","last_clean":"2023-10-16T13:48:53.002370+0000","last_became_active":"2023-10-16T13:48:51.728651+0000","last_became_peered":"2023-10-16T13:48:51.728651+0000","last_unstale":"2023-10-16T13:48:53.002370+0000","last_undegraded":"2023-10-16T13:48:53.002370+0000","last_fullsized":"2023-10-16T13:48:53.002370+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.698650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"109'3","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716781+0000","last_change":"2023-10-16T13:48:50.735980+0000","last_active":"2023-10-16T13:48:52.716781+0000","last_peered":"2023-10-16T13:48:52.716781+0000","last_clean":"2023-10-16T13:48:52.716781+0000","last_became_active":"2023-10-16T13:48:50.735596+0000","last_became_peered":"2023-10-16T13:48:50.735596+0000","last_unstale":"2023-10-16T13:48:52.716781+0000","last_undegraded":"2023-10-16T13:48:52.716781+0000","last_fullsized":"2023-10-16T13:48:52.716781+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:44.227923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002411+0000","last_change":"2023-10-16T13:48:51.731745+0000","last_active":"2023-10-16T13:48:53.002411+0000","last_peered":"2023-10-16T13:48:53.002411+0000","last_clean":"2023-10-16T13:48:53.002411+0000","last_became_active":"2023-10-16T13:48:51.731500+0000","last_became_peered":"2023-10-16T13:48:51.731500+0000","last_unstale":"2023-10-16T13:48:53.002411+0000","last_undegraded":"2023-10-16T13:48:53.002411+0000","last_fullsized":"2023-10-16T13:48:53.002411+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:41.284343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"109'6","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717371+0000","last_change":"2023-10-16T13:48:50.729317+0000","last_active":"2023-10-16T13:48:52.717371+0000","last_peered":"2023-10-16T13:48:52.717371+0000","last_clean":"2023-10-16T13:48:52.717371+0000","last_became_active":"2023-10-16T13:48:50.729041+0000","last_became_peered":"2023-10-16T13:48:50.729041+0000","last_unstale":"2023-10-16T13:48:52.717371+0000","last_undegraded":"2023-10-16T13:48:52.717371+0000","last_fullsized":"2023-10-16T13:48:52.717371+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:49:32.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003546+0000","last_change":"2023-10-16T13:48:51.735610+0000","last_active":"2023-10-16T13:48:53.003546+0000","last_peered":"2023-10-16T13:48:53.003546+0000","last_clean":"2023-10-16T13:48:53.003546+0000","last_became_active":"2023-10-16T13:48:51.735333+0000","last_became_peered":"2023-10-16T13:48:51.735333+0000","last_unstale":"2023-10-16T13:48:53.003546+0000","last_undegraded":"2023-10-16T13:48:53.003546+0000","last_fullsized":"2023-10-16T13:48:53.003546+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:09.230574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002353+0000","last_change":"2023-10-16T13:48:50.727152+0000","last_active":"2023-10-16T13:48:53.002353+0000","last_peered":"2023-10-16T13:48:53.002353+0000","last_clean":"2023-10-16T13:48:53.002353+0000","last_became_active":"2023-10-16T13:48:50.725133+0000","last_became_peered":"2023-10-16T13:48:50.725133+0000","last_unstale":"2023-10-16T13:48:53.002353+0000","last_undegraded":"2023-10-16T13:48:53.002353+0000","last_fullsized":"2023-10-16T13:48:53.002353+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:07:00.513657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002554+0000","last_change":"2023-10-16T13:48:51.732135+0000","last_active":"2023-10-16T13:48:53.002554+0000","last_peered":"2023-10-16T13:48:53.002554+0000","last_clean":"2023-10-16T13:48:53.002554+0000","last_became_active":"2023-10-16T13:48:51.731871+0000","last_became_peered":"2023-10-16T13:48:51.731871+0000","last_unstale":"2023-10-16T13:48:53.002554+0000","last_undegraded":"2023-10-16T13:48:53.002554+0000","last_fullsized":"2023-10-16T13:48:53.002554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:21:24.819500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002548+0000","last_change":"2023-10-16T13:48:50.732663+0000","last_active":"2023-10-16T13:48:53.002548+0000","last_peered":"2023-10-16T13:48:53.002548+0000","last_clean":"2023-10-16T13:48:53.002548+0000","last_became_active":"2023-10-16T13:48:50.732283+0000","last_became_peered":"2023-10-16T13:48:50.732283+0000","last_unstale":"2023-10-16T13:48:53.002548+0000","last_undegraded":"2023-10-16T13:48:53.002548+0000","last_fullsized":"2023-10-16T13:48:53.002548+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:53.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716263+0000","last_change":"2023-10-16T13:48:51.728809+0000","last_active":"2023-10-16T13:48:52.716263+0000","last_peered":"2023-10-16T13:48:52.716263+0000","last_clean":"2023-10-16T13:48:52.716263+0000","last_became_active":"2023-10-16T13:48:51.728411+0000","last_became_peered":"2023-10-16T13:48:51.728411+0000","last_unstale":"2023-10-16T13:48:52.716263+0000","last_undegraded":"2023-10-16T13:48:52.716263+0000","last_fullsized":"2023-10-16T13:48:52.716263+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:07.742873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"109'8","reported_seq":20,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716150+0000","last_change":"2023-10-16T13:48:50.737403+0000","last_active":"2023-10-16T13:48:52.716150+0000","last_peered":"2023-10-16T13:48:52.716150+0000","last_clean":"2023-10-16T13:48:52.716150+0000","last_became_active":"2023-10-16T13:48:50.737141+0000","last_became_peered":"2023-10-16T13:48:50.737141+0000","last_unstale":"2023-10-16T13:48:52.716150+0000","last_undegraded":"2023-10-16T13:48:52.716150+0000","last_fullsized":"2023-10-16T13:48:52.716150+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:10.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717658+0000","last_change":"2023-10-16T13:48:51.725281+0000","last_active":"2023-10-16T13:48:52.717658+0000","last_peered":"2023-10-16T13:48:52.717658+0000","last_clean":"2023-10-16T13:48:52.717658+0000","last_became_active":"2023-10-16T13:48:51.725010+0000","last_became_peered":"2023-10-16T13:48:51.725010+0000","last_unstale":"2023-10-16T13:48:52.717658+0000","last_undegraded":"2023-10-16T13:48:52.717658+0000","last_fullsized":"2023-10-16T13:48:52.717658+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:28.838137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717297+0000","last_change":"2023-10-16T13:48:50.729013+0000","last_active":"2023-10-16T13:48:52.717297+0000","last_peered":"2023-10-16T13:48:52.717297+0000","last_clean":"2023-10-16T13:48:52.717297+0000","last_became_active":"2023-10-16T13:48:50.728036+0000","last_became_peered":"2023-10-16T13:48:50.728036+0000","last_unstale":"2023-10-16T13:48:52.717297+0000","last_undegraded":"2023-10-16T13:48:52.717297+0000","last_fullsized":"2023-10-16T13:48:52.717297+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:47.724860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716952+0000","last_change":"2023-10-16T13:48:51.735409+0000","last_active":"2023-10-16T13:48:52.716952+0000","last_peered":"2023-10-16T13:48:52.716952+0000","last_clean":"2023-10-16T13:48:52.716952+0000","last_became_active":"2023-10-16T13:48:51.735123+0000","last_became_peered":"2023-10-16T13:48:51.735123+0000","last_unstale":"2023-10-16T13:48:52.716952+0000","last_undegraded":"2023-10-16T13:48:52.716952+0000","last_fullsized":"2023-10-16T13:48:52.716952+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:58.967594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002653+0000","last_change":"2023-10-16T13:48:50.727960+0000","last_active":"2023-10-16T13:48:53.002653+0000","last_peered":"2023-10-16T13:48:53.002653+0000","last_clean":"2023-10-16T13:48:53.002653+0000","last_became_active":"2023-10-16T13:48:50.727658+0000","last_became_peered":"2023-10-16T13:48:50.727658+0000","last_unstale":"2023-10-16T13:48:53.002653+0000","last_undegraded":"2023-10-16T13:48:53.002653+0000","last_fullsized":"2023-10-16T13:48:53.002653+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:57.691114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002827+0000","last_change":"2023-10-16T13:48:51.721878+0000","last_active":"2023-10-16T13:48:53.002827+0000","last_peered":"2023-10-16T13:48:53.002827+0000","last_clean":"2023-10-16T13:48:53.002827+0000","last_became_active":"2023-10-16T13:48:51.721552+0000","last_became_peered":"2023-10-16T13:48:51.721552+0000","last_unstale":"2023-10-16T13:48:53.002827+0000","last_undegraded":"2023-10-16T13:48:53.002827+0000","last_fullsized":"2023-10-16T13:48:53.002827+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:50.007623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716681+0000","last_change":"2023-10-16T13:48:50.737476+0000","last_active":"2023-10-16T13:48:52.716681+0000","last_peered":"2023-10-16T13:48:52.716681+0000","last_clean":"2023-10-16T13:48:52.716681+0000","last_became_active":"2023-10-16T13:48:50.737179+0000","last_became_peered":"2023-10-16T13:48:50.737179+0000","last_unstale":"2023-10-16T13:48:52.716681+0000","last_undegraded":"2023-10-16T13:48:52.716681+0000","last_fullsized":"2023-10-16T13:48:52.716681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:59:52.608972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003304+0000","last_change":"2023-10-16T13:48:51.726141+0000","last_active":"2023-10-16T13:48:53.003304+0000","last_peered":"2023-10-16T13:48:53.003304+0000","last_clean":"2023-10-16T13:48:53.003304+0000","last_became_active":"2023-10-16T13:48:51.725820+0000","last_became_peered":"2023-10-16T13:48:51.725820+0000","last_unstale":"2023-10-16T13:48:53.003304+0000","last_undegraded":"2023-10-16T13:48:53.003304+0000","last_fullsized":"2023-10-16T13:48:53.003304+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:37.882104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716482+0000","last_change":"2023-10-16T13:48:50.726298+0000","last_active":"2023-10-16T13:48:52.716482+0000","last_peered":"2023-10-16T13:48:52.716482+0000","last_clean":"2023-10-16T13:48:52.716482+0000","last_became_active":"2023-10-16T13:48:50.726019+0000","last_became_peered":"2023-10-16T13:48:50.726019+0000","last_unstale":"2023-10-16T13:48:52.716482+0000","last_undegraded":"2023-10-16T13:48:52.716482+0000","last_fullsized":"2023-10-16T13:48:52.716482+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:10.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002243+0000","last_change":"2023-10-16T13:48:51.728708+0000","last_active":"2023-10-16T13:48:53.002243+0000","last_peered":"2023-10-16T13:48:53.002243+0000","last_clean":"2023-10-16T13:48:53.002243+0000","last_became_active":"2023-10-16T13:48:51.725685+0000","last_became_peered":"2023-10-16T13:48:51.725685+0000","last_unstale":"2023-10-16T13:48:53.002243+0000","last_undegraded":"2023-10-16T13:48:53.002243+0000","last_fullsized":"2023-10-16T13:48:53.002243+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:32.462606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717231+0000","last_change":"2023-10-16T13:48:50.727544+0000","last_active":"2023-10-16T13:48:52.717231+0000","last_peered":"2023-10-16T13:48:52.717231+0000","last_clean":"2023-10-16T13:48:52.717231+0000","last_became_active":"2023-10-16T13:48:50.727285+0000","last_became_peered":"2023-10-16T13:48:50.727285+0000","last_unstale":"2023-10-16T13:48:52.717231+0000","last_undegraded":"2023-10-16T13:48:52.717231+0000","last_fullsized":"2023-10-16T13:48:52.717231+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:49:32.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716699+0000","last_change":"2023-10-16T13:48:51.732640+0000","last_active":"2023-10-16T13:48:52.716699+0000","last_peered":"2023-10-16T13:48:52.716699+0000","last_clean":"2023-10-16T13:48:52.716699+0000","last_became_active":"2023-10-16T13:48:51.732337+0000","last_became_peered":"2023-10-16T13:48:51.732337+0000","last_unstale":"2023-10-16T13:48:52.716699+0000","last_undegraded":"2023-10-16T13:48:52.716699+0000","last_fullsized":"2023-10-16T13:48:52.716699+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:58.696770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002704+0000","last_change":"2023-10-16T13:48:50.728615+0000","last_active":"2023-10-16T13:48:53.002704+0000","last_peered":"2023-10-16T13:48:53.002704+0000","last_clean":"2023-10-16T13:48:53.002704+0000","last_became_active":"2023-10-16T13:48:50.728337+0000","last_became_peered":"2023-10-16T13:48:50.728337+0000","last_unstale":"2023-10-16T13:48:53.002704+0000","last_undegraded":"2023-10-16T13:48:53.002704+0000","last_fullsized":"2023-10-16T13:48:53.002704+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:58.995229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002414+0000","last_change":"2023-10-16T13:48:51.736844+0000","last_active":"2023-10-16T13:48:53.002414+0000","last_peered":"2023-10-16T13:48:53.002414+0000","last_clean":"2023-10-16T13:48:53.002414+0000","last_became_active":"2023-10-16T13:48:51.736529+0000","last_became_peered":"2023-10-16T13:48:51.736529+0000","last_unstale":"2023-10-16T13:48:53.002414+0000","last_undegraded":"2023-10-16T13:48:53.002414+0000","last_fullsized":"2023-10-16T13:48:53.002414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:49.071480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002288+0000","last_change":"2023-10-16T13:48:50.731431+0000","last_active":"2023-10-16T13:48:53.002288+0000","last_peered":"2023-10-16T13:48:53.002288+0000","last_clean":"2023-10-16T13:48:53.002288+0000","last_became_active":"2023-10-16T13:48:50.731128+0000","last_became_peered":"2023-10-16T13:48:50.731128+0000","last_unstale":"2023-10-16T13:48:53.002288+0000","last_undegraded":"2023-10-16T13:48:53.002288+0000","last_fullsized":"2023-10-16T13:48:53.002288+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:04.113084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002046+0000","last_change":"2023-10-16T13:48:51.732395+0000","last_active":"2023-10-16T13:48:53.002046+0000","last_peered":"2023-10-16T13:48:53.002046+0000","last_clean":"2023-10-16T13:48:53.002046+0000","last_became_active":"2023-10-16T13:48:51.732132+0000","last_became_peered":"2023-10-16T13:48:51.732132+0000","last_unstale":"2023-10-16T13:48:53.002046+0000","last_undegraded":"2023-10-16T13:48:53.002046+0000","last_fullsized":"2023-10-16T13:48:53.002046+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:11:27.204983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.001968+0000","last_change":"2023-10-16T13:48:50.736222+0000","last_active":"2023-10-16T13:48:53.001968+0000","last_peered":"2023-10-16T13:48:53.001968+0000","last_clean":"2023-10-16T13:48:53.001968+0000","last_became_active":"2023-10-16T13:48:50.735958+0000","last_became_peered":"2023-10-16T13:48:50.735958+0000","last_unstale":"2023-10-16T13:48:53.001968+0000","last_undegraded":"2023-10-16T13:48:53.001968+0000","last_fullsized":"2023-10-16T13:48:53.001968+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:58.995229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716922+0000","last_change":"2023-10-16T13:48:51.725684+0000","last_active":"2023-10-16T13:48:52.716922+0000","last_peered":"2023-10-16T13:48:52.716922+0000","last_clean":"2023-10-16T13:48:52.716922+0000","last_became_active":"2023-10-16T13:48:51.725256+0000","last_became_peered":"2023-10-16T13:48:51.725256+0000","last_unstale":"2023-10-16T13:48:52.716922+0000","last_undegraded":"2023-10-16T13:48:52.716922+0000","last_fullsized":"2023-10-16T13:48:52.716922+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:05.118741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002794+0000","last_change":"2023-10-16T13:48:50.727980+0000","last_active":"2023-10-16T13:48:53.002794+0000","last_peered":"2023-10-16T13:48:53.002794+0000","last_clean":"2023-10-16T13:48:53.002794+0000","last_became_active":"2023-10-16T13:48:50.727704+0000","last_became_peered":"2023-10-16T13:48:50.727704+0000","last_unstale":"2023-10-16T13:48:53.002794+0000","last_undegraded":"2023-10-16T13:48:53.002794+0000","last_fullsized":"2023-10-16T13:48:53.002794+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:49.874078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002702+0000","last_change":"2023-10-16T13:48:51.733422+0000","last_active":"2023-10-16T13:48:53.002702+0000","last_peered":"2023-10-16T13:48:53.002702+0000","last_clean":"2023-10-16T13:48:53.002702+0000","last_became_active":"2023-10-16T13:48:51.733086+0000","last_became_peered":"2023-10-16T13:48:51.733086+0000","last_unstale":"2023-10-16T13:48:53.002702+0000","last_undegraded":"2023-10-16T13:48:53.002702+0000","last_fullsized":"2023-10-16T13:48:53.002702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:30:14.861869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002218+0000","last_change":"2023-10-16T13:48:50.730801+0000","last_active":"2023-10-16T13:48:53.002218+0000","last_peered":"2023-10-16T13:48:53.002218+0000","last_clean":"2023-10-16T13:48:53.002218+0000","last_became_active":"2023-10-16T13:48:50.730492+0000","last_became_peered":"2023-10-16T13:48:50.730492+0000","last_unstale":"2023-10-16T13:48:53.002218+0000","last_undegraded":"2023-10-16T13:48:53.002218+0000","last_fullsized":"2023-10-16T13:48:53.002218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:49.551205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003139+0000","last_change":"2023-10-16T13:48:51.727329+0000","last_active":"2023-10-16T13:48:53.003139+0000","last_peered":"2023-10-16T13:48:53.003139+0000","last_clean":"2023-10-16T13:48:53.003139+0000","last_became_active":"2023-10-16T13:48:51.725755+0000","last_became_peered":"2023-10-16T13:48:51.725755+0000","last_unstale":"2023-10-16T13:48:53.003139+0000","last_undegraded":"2023-10-16T13:48:53.003139+0000","last_fullsized":"2023-10-16T13:48:53.003139+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:27:05.925760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003397+0000","last_change":"2023-10-16T13:48:50.731398+0000","last_active":"2023-10-16T13:48:53.003397+0000","last_peered":"2023-10-16T13:48:53.003397+0000","last_clean":"2023-10-16T13:48:53.003397+0000","last_became_active":"2023-10-16T13:48:50.731060+0000","last_became_peered":"2023-10-16T13:48:50.731060+0000","last_unstale":"2023-10-16T13:48:53.003397+0000","last_undegraded":"2023-10-16T13:48:53.003397+0000","last_fullsized":"2023-10-16T13:48:53.003397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:02.296892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716461+0000","last_change":"2023-10-16T13:48:51.727063+0000","last_active":"2023-10-16T13:48:52.716461+0000","last_peered":"2023-10-16T13:48:52.716461+0000","last_clean":"2023-10-16T13:48:52.716461+0000","last_became_active":"2023-10-16T13:48:51.725978+0000","last_became_peered":"2023-10-16T13:48:51.725978+0000","last_unstale":"2023-10-16T13:48:52.716461+0000","last_undegraded":"2023-10-16T13:48:52.716461+0000","last_fullsized":"2023-10-16T13:48:52.716461+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:50.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002069+0000","last_change":"2023-10-16T13:48:50.733838+0000","last_active":"2023-10-16T13:48:53.002069+0000","last_peered":"2023-10-16T13:48:53.002069+0000","last_clean":"2023-10-16T13:48:53.002069+0000","last_became_active":"2023-10-16T13:48:50.733567+0000","last_became_peered":"2023-10-16T13:48:50.733567+0000","last_unstale":"2023-10-16T13:48:53.002069+0000","last_undegraded":"2023-10-16T13:48:53.002069+0000","last_fullsized":"2023-10-16T13:48:53.002069+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:14:15.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002175+0000","last_change":"2023-10-16T13:48:51.725901+0000","last_active":"2023-10-16T13:48:53.002175+0000","last_peered":"2023-10-16T13:48:53.002175+0000","last_clean":"2023-10-16T13:48:53.002175+0000","last_became_active":"2023-10-16T13:48:51.725643+0000","last_became_peered":"2023-10-16T13:48:51.725643+0000","last_unstale":"2023-10-16T13:48:53.002175+0000","last_undegraded":"2023-10-16T13:48:53.002175+0000","last_fullsized":"2023-10-16T13:48:53.002175+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.228947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003182+0000","last_change":"2023-10-16T13:48:50.729407+0000","last_active":"2023-10-16T13:48:53.003182+0000","last_peered":"2023-10-16T13:48:53.003182+0000","last_clean":"2023-10-16T13:48:53.003182+0000","last_became_active":"2023-10-16T13:48:50.729095+0000","last_became_peered":"2023-10-16T13:48:50.729095+0000","last_unstale":"2023-10-16T13:48:53.003182+0000","last_undegraded":"2023-10-16T13:48:53.003182+0000","last_fullsized":"2023-10-16T13:48:53.003182+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:06.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717194+0000","last_change":"2023-10-16T13:48:51.725886+0000","last_active":"2023-10-16T13:48:52.717194+0000","last_peered":"2023-10-16T13:48:52.717194+0000","last_clean":"2023-10-16T13:48:52.717194+0000","last_became_active":"2023-10-16T13:48:51.725526+0000","last_became_peered":"2023-10-16T13:48:51.725526+0000","last_unstale":"2023-10-16T13:48:52.717194+0000","last_undegraded":"2023-10-16T13:48:52.717194+0000","last_fullsized":"2023-10-16T13:48:52.717194+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:38.955755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002120+0000","last_change":"2023-10-16T13:48:50.731193+0000","last_active":"2023-10-16T13:48:53.002120+0000","last_peered":"2023-10-16T13:48:53.002120+0000","last_clean":"2023-10-16T13:48:53.002120+0000","last_became_active":"2023-10-16T13:48:50.730909+0000","last_became_peered":"2023-10-16T13:48:50.730909+0000","last_unstale":"2023-10-16T13:48:53.002120+0000","last_undegraded":"2023-10-16T13:48:53.002120+0000","last_fullsized":"2023-10-16T13:48:53.002120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:43:49.432538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002116+0000","last_change":"2023-10-16T13:48:51.726949+0000","last_active":"2023-10-16T13:48:53.002116+0000","last_peered":"2023-10-16T13:48:53.002116+0000","last_clean":"2023-10-16T13:48:53.002116+0000","last_became_active":"2023-10-16T13:48:51.726475+0000","last_became_peered":"2023-10-16T13:48:51.726475+0000","last_unstale":"2023-10-16T13:48:53.002116+0000","last_undegraded":"2023-10-16T13:48:53.002116+0000","last_fullsized":"2023-10-16T13:48:53.002116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:31.385782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002376+0000","last_change":"2023-10-16T13:48:50.728957+0000","last_active":"2023-10-16T13:48:53.002376+0000","last_peered":"2023-10-16T13:48:53.002376+0000","last_clean":"2023-10-16T13:48:53.002376+0000","last_became_active":"2023-10-16T13:48:50.728665+0000","last_became_peered":"2023-10-16T13:48:50.728665+0000","last_unstale":"2023-10-16T13:48:53.002376+0000","last_undegraded":"2023-10-16T13:48:53.002376+0000","last_fullsized":"2023-10-16T13:48:53.002376+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:01:17.786615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002316+0000","last_change":"2023-10-16T13:48:51.729491+0000","last_active":"2023-10-16T13:48:53.002316+0000","last_peered":"2023-10-16T13:48:53.002316+0000","last_clean":"2023-10-16T13:48:53.002316+0000","last_became_active":"2023-10-16T13:48:51.729214+0000","last_became_peered":"2023-10-16T13:48:51.729214+0000","last_unstale":"2023-10-16T13:48:53.002316+0000","last_undegraded":"2023-10-16T13:48:53.002316+0000","last_fullsized":"2023-10-16T13:48:53.002316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:36.199863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002060+0000","last_change":"2023-10-16T13:48:50.732196+0000","last_active":"2023-10-16T13:48:53.002060+0000","last_peered":"2023-10-16T13:48:53.002060+0000","last_clean":"2023-10-16T13:48:53.002060+0000","last_became_active":"2023-10-16T13:48:50.731897+0000","last_became_peered":"2023-10-16T13:48:50.731897+0000","last_unstale":"2023-10-16T13:48:53.002060+0000","last_undegraded":"2023-10-16T13:48:53.002060+0000","last_fullsized":"2023-10-16T13:48:53.002060+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:01:17.786615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002009+0000","last_change":"2023-10-16T13:48:51.733738+0000","last_active":"2023-10-16T13:48:53.002009+0000","last_peered":"2023-10-16T13:48:53.002009+0000","last_clean":"2023-10-16T13:48:53.002009+0000","last_became_active":"2023-10-16T13:48:51.733436+0000","last_became_peered":"2023-10-16T13:48:51.733436+0000","last_unstale":"2023-10-16T13:48:53.002009+0000","last_undegraded":"2023-10-16T13:48:53.002009+0000","last_fullsized":"2023-10-16T13:48:53.002009+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:31.385782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002370+0000","last_change":"2023-10-16T13:48:50.737691+0000","last_active":"2023-10-16T13:48:53.002370+0000","last_peered":"2023-10-16T13:48:53.002370+0000","last_clean":"2023-10-16T13:48:53.002370+0000","last_became_active":"2023-10-16T13:48:50.737337+0000","last_became_peered":"2023-10-16T13:48:50.737337+0000","last_unstale":"2023-10-16T13:48:53.002370+0000","last_undegraded":"2023-10-16T13:48:53.002370+0000","last_fullsized":"2023-10-16T13:48:53.002370+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:58.995229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-16T13:48:51.718129+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:48:51.718129+0000","last_peered":"2023-10-16T13:48:51.718129+0000","last_clean":"2023-10-16T13:48:51.718129+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:48:51.718129+0000","last_undegraded":"2023-10-16T13:48:51.718129+0000","last_fullsized":"2023-10-16T13:48:51.718129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1994752,"data_stored":1191490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.54400000000000004}]},{"osd":1,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.83099999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.622}]},{"osd":2,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.76400000000000001,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.73999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574980,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1388544,"data_stored":600484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.34200000000000003,"15min":0.23100000000000001},"max":{"1min":0.79500000000000004,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56100000000000005,"15min":0.53400000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.73499999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.86099999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57099999999999995,"15min":0.60599999999999998},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.77200000000000002,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.86699999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":1.768,"15min":1.768},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":1.157},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.81599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.80700000000000005,"5min":0.81899999999999995,"15min":10.964},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77100000000000002,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.89800000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.875,"15min":0.875},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.438}]},{"osd":5,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":1.343,"15min":1.343},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.59199999999999997},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.036},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.63300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1363968,"data_stored":592572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46500000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.372},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.47699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.32900000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.496,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.5,"5min":0.61699999999999999,"15min":0.752},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.88},"last":0.432},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.52100000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.905},"last":0.751},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.52000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":1.879},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.44700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.748,"5min":0.90400000000000003,"15min":1.925},"last":0.53000000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.624},"min":{"1min":0.53100000000000003,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.81100000000000005,"5min":0.872,"15min":1.085},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574980,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1181921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.35299999999999998},"min":{"1min":0.221,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.49299999999999999,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.309},{"interface":"front","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.214},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.379}]},{"osd":2,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.38800000000000001},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":3.8849999999999998},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.38200000000000001},"min":{"1min":0.28000000000000003,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.78800000000000003,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.60199999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":4.0650000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":4.0369999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.46000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.63},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.98299999999999998,"15min":4.2359999999999998},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":4.2119999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.877,"15min":4.2649999999999997},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":598469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.317,"15min":0.33400000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.99199999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.34599999999999997,"15min":0.36299999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.78700000000000003},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.221,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.67800000000000005},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.374,"15min":0.375},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.24399999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.629,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":0.621,"15min":1.153},"last":0.29899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.629},"min":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85099999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.504}]},{"osd":6,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.96999999999999997,"15min":1.379},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.98199999999999998,"15min":1.395},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.875,"15min":6.0499999999999998},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1372160,"data_stored":592732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.45400000000000001},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.629},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.378,"15min":0.40400000000000003},"min":{"1min":0.28599999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":2.181},"last":0.65000000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.40300000000000002,"15min":0.434},"min":{"1min":0.28599999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.34100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.60899999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.752}]},{"osd":5,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61299999999999999,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.73199999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.621,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.264,"5min":1.264,"15min":2.4039999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.371,"15min":0.371},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.76100000000000001},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64900000000000002,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":2.4430000000000001},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574981,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":598942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65500000000000003,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67500000000000004,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.76100000000000001,"15min":0.89900000000000002},"last":0.497}]},{"osd":2,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.751,"15min":0.85099999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.628}]},{"osd":3,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.749,"5min":0.77900000000000003,"15min":0.88},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76600000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.81200000000000006},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55800000000000005,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.81599999999999995,"5min":0.872,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"min":{"1min":0.45400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.62,"15min":0.65100000000000002},"min":{"1min":0.433,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82699999999999996,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1384448,"data_stored":598984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.34200000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.752,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.40699999999999997,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.34999999999999998},"max":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.80500000000000005},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":1.141},"last":0.502},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.36699999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77000000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.41799999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.437},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.41899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80300000000000005,"5min":0.87,"15min":0.87},"last":0.39000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:48:55.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:48:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.065+0000 7f7249b4a700 1 Processor -- start 2023-10-16T13:48:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.065+0000 7f7249b4a700 1 -- start start 2023-10-16T13:48:56.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7249b4a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72440b2880 0x7f724406c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7249b4a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440b2c60 0x7f72440cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7249b4a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72440d0d00 con 0x7f72440ce3a0 2023-10-16T13:48:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7249b4a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72440ce810 con 0x7f72440b2880 2023-10-16T13:48:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7249b4a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72440d2450 con 0x7f72440b2c60 2023-10-16T13:48:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72437fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72440b2880 0x7f724406c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7243fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72440ce3a0 0x7f72441617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59650/0 (socket says 172.21.15.5:59650) 2023-10-16T13:48:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f7243fff700 1 -- 172.21.15.5:0/3050005832 learned_addr learned my addr 172.21.15.5:0/3050005832 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72437fe700 1 -- 172.21.15.5:0/3050005832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440b2c60 msgr2=0x7f72440cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72437fe700 1 --2- 172.21.15.5:0/3050005832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440b2c60 0x7f72440cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72437fe700 1 -- 172.21.15.5:0/3050005832 >> v1:172.21.15.5:6789/0 conn(0x7f72440ce3a0 legacy=0x7f72441617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72437fe700 1 -- 172.21.15.5:0/3050005832 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440cfc60 con 0x7f72440b2880 2023-10-16T13:48:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72427fc700 1 -- 172.21.15.5:0/3050005832 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594122459 0 0) 0x7f72440d0d00 con 0x7f72440ce3a0 2023-10-16T13:48:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.066+0000 7f72437fe700 1 --2- 172.21.15.5:0/3050005832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2880 0x7f724406c660 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7238009820 tx=0x7f7238009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bce7b6752fafe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f72427fc700 1 -- 172.21.15.5:0/3050005832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238005e30 con 0x7f72440b2880 2023-10-16T13:48:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f72427fc700 1 -- 172.21.15.5:0/3050005832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7238006030 con 0x7f72440b2880 2023-10-16T13:48:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f72427fc700 1 -- 172.21.15.5:0/3050005832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380063e0 con 0x7f72440b2880 2023-10-16T13:48:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 -- 172.21.15.5:0/3050005832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2880 msgr2=0x7f724406c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 --2- 172.21.15.5:0/3050005832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2880 0x7f724406c660 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7238009820 tx=0x7f7238009b30 comp rx=0 tx=0).stop 2023-10-16T13:48:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 -- 172.21.15.5:0/3050005832 shutdown_connections 2023-10-16T13:48:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 --2- 172.21.15.5:0/3050005832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2880 0x7f724406c660 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 --2- 172.21.15.5:0/3050005832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440b2c60 0x7f72440cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 -- 172.21.15.5:0/3050005832 >> 172.21.15.5:0/3050005832 conn(0x7f72440d15e0 msgr2=0x7f72440d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 -- 172.21.15.5:0/3050005832 shutdown_connections 2023-10-16T13:48:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.067+0000 7f7249b4a700 1 -- 172.21.15.5:0/3050005832 wait complete. 2023-10-16T13:48:56.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.068+0000 7f7249b4a700 1 Processor -- start 2023-10-16T13:48:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 -- start start 2023-10-16T13:48:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72440b2880 0x7f724415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 0x7f724415d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440ce3a0 0x7f724415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724415b670 con 0x7f72440b2c60 2023-10-16T13:48:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724415c940 con 0x7f72440b2880 2023-10-16T13:48:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7249b4a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72440c53a0 con 0x7f72440ce3a0 2023-10-16T13:48:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7242ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 0x7f724415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7242ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 0x7f724415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49654/0 (socket says 172.21.15.5:49654) 2023-10-16T13:48:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.069+0000 7f7242ffd700 1 -- 172.21.15.5:0/157693681 learned_addr learned my addr 172.21.15.5:0/157693681 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7243fff700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440ce3a0 0x7f724415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f72437fe700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72440b2880 0x7f724415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7242ffd700 1 -- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440ce3a0 msgr2=0x7f724415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7242ffd700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440ce3a0 0x7f724415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7242ffd700 1 -- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72440b2880 msgr2=0x7f724415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7242ffd700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72440b2880 0x7f724415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7242ffd700 1 -- 172.21.15.5:0/157693681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238009430 con 0x7f72440b2c60 2023-10-16T13:48:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7242ffd700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 0x7f724415d490 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f723400b500 tx=0x7f723400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234011830 con 0x7f72440b2c60 2023-10-16T13:48:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72340119b0 con 0x7f72440b2c60 2023-10-16T13:48:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234011d60 con 0x7f72440b2c60 2023-10-16T13:48:56.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724415b8a0 con 0x7f72440b2c60 2023-10-16T13:48:56.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.070+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724415be60 con 0x7f72440b2c60 2023-10-16T13:48:56.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.071+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724404ebb0 con 0x7f72440b2c60 2023-10-16T13:48:56.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.072+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f723401a400 con 0x7f72440b2c60 2023-10-16T13:48:56.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.072+0000 7f722bfff700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f723006b2f0 0x7f723006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.072+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7234089df0 con 0x7f72440b2c60 2023-10-16T13:48:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.072+0000 7f72437fe700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f723006b2f0 0x7f723006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.073+0000 7f72437fe700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f723006b2f0 0x7f723006d7b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7238013040 tx=0x7f7238008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.077+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72340548c0 con 0x7f72440b2c60 2023-10-16T13:48:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.272+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72440d0220 con 0x7f723006b2f0 2023-10-16T13:48:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.280+0000 7f722bfff700 1 -- 172.21.15.5:0/157693681 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290001 (secure 0 0 0) 0x7f72380062e0 con 0x7f723006b2f0 2023-10-16T13:48:56.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.283+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f723006b2f0 msgr2=0x7f723006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.283+0000 7f7249b4a700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f723006b2f0 0x7f723006d7b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7238013040 tx=0x7f7238008070 comp rx=0 tx=0).stop 2023-10-16T13:48:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.283+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 msgr2=0x7f724415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.283+0000 7f7249b4a700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 0x7f724415d490 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f723400b500 tx=0x7f723400b8c0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 shutdown_connections 2023-10-16T13:48:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f723006b2f0 0x7f723006d7b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72440ce3a0 0x7f724415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72440b2880 0x7f724415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 --2- 172.21.15.5:0/157693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72440b2c60 0x7f724415d490 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 >> 172.21.15.5:0/157693681 conn(0x7f72440d15e0 msgr2=0x7f724406b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 shutdown_connections 2023-10-16T13:48:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.284+0000 7f7249b4a700 1 -- 172.21.15.5:0/157693681 wait complete. 2023-10-16T13:48:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:48:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2023-10-16T13:48:55.617285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261388,"kb_used_data":11932,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713332,"statfs":{"total":773094113280,"available":772826451968,"internally_reserved":0,"allocated":12218368,"data_stored":5955594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":255315512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.906984"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002341+0000","last_change":"2023-10-16T13:48:51.726183+0000","last_active":"2023-10-16T13:48:53.002341+0000","last_peered":"2023-10-16T13:48:53.002341+0000","last_clean":"2023-10-16T13:48:53.002341+0000","last_became_active":"2023-10-16T13:48:51.725308+0000","last_became_peered":"2023-10-16T13:48:51.725308+0000","last_unstale":"2023-10-16T13:48:53.002341+0000","last_undegraded":"2023-10-16T13:48:53.002341+0000","last_fullsized":"2023-10-16T13:48:53.002341+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.893297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002603+0000","last_change":"2023-10-16T13:48:51.727405+0000","last_active":"2023-10-16T13:48:53.002603+0000","last_peered":"2023-10-16T13:48:53.002603+0000","last_clean":"2023-10-16T13:48:53.002603+0000","last_became_active":"2023-10-16T13:48:51.726535+0000","last_became_peered":"2023-10-16T13:48:51.726535+0000","last_unstale":"2023-10-16T13:48:53.002603+0000","last_undegraded":"2023-10-16T13:48:53.002603+0000","last_fullsized":"2023-10-16T13:48:53.002603+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:42:31.659462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717586+0000","last_change":"2023-10-16T13:48:51.736917+0000","last_active":"2023-10-16T13:48:52.717586+0000","last_peered":"2023-10-16T13:48:52.717586+0000","last_clean":"2023-10-16T13:48:52.717586+0000","last_became_active":"2023-10-16T13:48:51.736687+0000","last_became_peered":"2023-10-16T13:48:51.736687+0000","last_unstale":"2023-10-16T13:48:52.717586+0000","last_undegraded":"2023-10-16T13:48:52.717586+0000","last_fullsized":"2023-10-16T13:48:52.717586+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:58.967594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002404+0000","last_change":"2023-10-16T13:48:51.728119+0000","last_active":"2023-10-16T13:48:53.002404+0000","last_peered":"2023-10-16T13:48:53.002404+0000","last_clean":"2023-10-16T13:48:53.002404+0000","last_became_active":"2023-10-16T13:48:51.727784+0000","last_became_peered":"2023-10-16T13:48:51.727784+0000","last_unstale":"2023-10-16T13:48:53.002404+0000","last_undegraded":"2023-10-16T13:48:53.002404+0000","last_fullsized":"2023-10-16T13:48:53.002404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:29:39.328695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002109+0000","last_change":"2023-10-16T13:48:51.727478+0000","last_active":"2023-10-16T13:48:53.002109+0000","last_peered":"2023-10-16T13:48:53.002109+0000","last_clean":"2023-10-16T13:48:53.002109+0000","last_became_active":"2023-10-16T13:48:51.727077+0000","last_became_peered":"2023-10-16T13:48:51.727077+0000","last_unstale":"2023-10-16T13:48:53.002109+0000","last_undegraded":"2023-10-16T13:48:53.002109+0000","last_fullsized":"2023-10-16T13:48:53.002109+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:29.748225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716203+0000","last_change":"2023-10-16T13:48:51.726436+0000","last_active":"2023-10-16T13:48:52.716203+0000","last_peered":"2023-10-16T13:48:52.716203+0000","last_clean":"2023-10-16T13:48:52.716203+0000","last_became_active":"2023-10-16T13:48:51.726047+0000","last_became_peered":"2023-10-16T13:48:51.726047+0000","last_unstale":"2023-10-16T13:48:52.716203+0000","last_undegraded":"2023-10-16T13:48:52.716203+0000","last_fullsized":"2023-10-16T13:48:52.716203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:43:50.438194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716595+0000","last_change":"2023-10-16T13:48:51.733064+0000","last_active":"2023-10-16T13:48:52.716595+0000","last_peered":"2023-10-16T13:48:52.716595+0000","last_clean":"2023-10-16T13:48:52.716595+0000","last_became_active":"2023-10-16T13:48:51.732793+0000","last_became_peered":"2023-10-16T13:48:51.732793+0000","last_unstale":"2023-10-16T13:48:52.716595+0000","last_undegraded":"2023-10-16T13:48:52.716595+0000","last_fullsized":"2023-10-16T13:48:52.716595+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:14:16.872024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715817+0000","last_change":"2023-10-16T13:48:51.732955+0000","last_active":"2023-10-16T13:48:52.715817+0000","last_peered":"2023-10-16T13:48:52.715817+0000","last_clean":"2023-10-16T13:48:52.715817+0000","last_became_active":"2023-10-16T13:48:51.732541+0000","last_became_peered":"2023-10-16T13:48:51.732541+0000","last_unstale":"2023-10-16T13:48:52.715817+0000","last_undegraded":"2023-10-16T13:48:52.715817+0000","last_fullsized":"2023-10-16T13:48:52.715817+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:56.932597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717696+0000","last_change":"2023-10-16T13:48:51.731294+0000","last_active":"2023-10-16T13:48:52.717696+0000","last_peered":"2023-10-16T13:48:52.717696+0000","last_clean":"2023-10-16T13:48:52.717696+0000","last_became_active":"2023-10-16T13:48:51.731014+0000","last_became_peered":"2023-10-16T13:48:51.731014+0000","last_unstale":"2023-10-16T13:48:52.717696+0000","last_undegraded":"2023-10-16T13:48:52.717696+0000","last_fullsized":"2023-10-16T13:48:52.717696+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:38.955755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002738+0000","last_change":"2023-10-16T13:48:51.727656+0000","last_active":"2023-10-16T13:48:53.002738+0000","last_peered":"2023-10-16T13:48:53.002738+0000","last_clean":"2023-10-16T13:48:53.002738+0000","last_became_active":"2023-10-16T13:48:51.727171+0000","last_became_peered":"2023-10-16T13:48:51.727171+0000","last_unstale":"2023-10-16T13:48:53.002738+0000","last_undegraded":"2023-10-16T13:48:53.002738+0000","last_fullsized":"2023-10-16T13:48:53.002738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:08.653951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002876+0000","last_change":"2023-10-16T13:48:51.737117+0000","last_active":"2023-10-16T13:48:53.002876+0000","last_peered":"2023-10-16T13:48:53.002876+0000","last_clean":"2023-10-16T13:48:53.002876+0000","last_became_active":"2023-10-16T13:48:51.736578+0000","last_became_peered":"2023-10-16T13:48:51.736578+0000","last_unstale":"2023-10-16T13:48:53.002876+0000","last_undegraded":"2023-10-16T13:48:53.002876+0000","last_fullsized":"2023-10-16T13:48:53.002876+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:31.385782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715710+0000","last_change":"2023-10-16T13:48:51.726500+0000","last_active":"2023-10-16T13:48:52.715710+0000","last_peered":"2023-10-16T13:48:52.715710+0000","last_clean":"2023-10-16T13:48:52.715710+0000","last_became_active":"2023-10-16T13:48:51.726239+0000","last_became_peered":"2023-10-16T13:48:51.726239+0000","last_unstale":"2023-10-16T13:48:52.715710+0000","last_undegraded":"2023-10-16T13:48:52.715710+0000","last_fullsized":"2023-10-16T13:48:52.715710+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:14:01.580036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003276+0000","last_change":"2023-10-16T13:48:51.726769+0000","last_active":"2023-10-16T13:48:53.003276+0000","last_peered":"2023-10-16T13:48:53.003276+0000","last_clean":"2023-10-16T13:48:53.003276+0000","last_became_active":"2023-10-16T13:48:51.726412+0000","last_became_peered":"2023-10-16T13:48:51.726412+0000","last_unstale":"2023-10-16T13:48:53.003276+0000","last_undegraded":"2023-10-16T13:48:53.003276+0000","last_fullsized":"2023-10-16T13:48:53.003276+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:38:50.926632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002695+0000","last_change":"2023-10-16T13:48:51.724589+0000","last_active":"2023-10-16T13:48:53.002695+0000","last_peered":"2023-10-16T13:48:53.002695+0000","last_clean":"2023-10-16T13:48:53.002695+0000","last_became_active":"2023-10-16T13:48:51.724262+0000","last_became_peered":"2023-10-16T13:48:51.724262+0000","last_unstale":"2023-10-16T13:48:53.002695+0000","last_undegraded":"2023-10-16T13:48:53.002695+0000","last_fullsized":"2023-10-16T13:48:53.002695+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:49:37.664530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003012+0000","last_change":"2023-10-16T13:48:51.733820+0000","last_active":"2023-10-16T13:48:53.003012+0000","last_peered":"2023-10-16T13:48:53.003012+0000","last_clean":"2023-10-16T13:48:53.003012+0000","last_became_active":"2023-10-16T13:48:51.733542+0000","last_became_peered":"2023-10-16T13:48:51.733542+0000","last_unstale":"2023-10-16T13:48:53.003012+0000","last_undegraded":"2023-10-16T13:48:53.003012+0000","last_fullsized":"2023-10-16T13:48:53.003012+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:34.543509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002088+0000","last_change":"2023-10-16T13:48:51.726754+0000","last_active":"2023-10-16T13:48:53.002088+0000","last_peered":"2023-10-16T13:48:53.002088+0000","last_clean":"2023-10-16T13:48:53.002088+0000","last_became_active":"2023-10-16T13:48:51.725174+0000","last_became_peered":"2023-10-16T13:48:51.725174+0000","last_unstale":"2023-10-16T13:48:53.002088+0000","last_undegraded":"2023-10-16T13:48:53.002088+0000","last_fullsized":"2023-10-16T13:48:53.002088+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:00:03.738122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716849+0000","last_change":"2023-10-16T13:48:51.735544+0000","last_active":"2023-10-16T13:48:52.716849+0000","last_peered":"2023-10-16T13:48:52.716849+0000","last_clean":"2023-10-16T13:48:52.716849+0000","last_became_active":"2023-10-16T13:48:51.735259+0000","last_became_peered":"2023-10-16T13:48:51.735259+0000","last_unstale":"2023-10-16T13:48:52.716849+0000","last_undegraded":"2023-10-16T13:48:52.716849+0000","last_fullsized":"2023-10-16T13:48:52.716849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:41:28.685961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002748+0000","last_change":"2023-10-16T13:48:51.728631+0000","last_active":"2023-10-16T13:48:53.002748+0000","last_peered":"2023-10-16T13:48:53.002748+0000","last_clean":"2023-10-16T13:48:53.002748+0000","last_became_active":"2023-10-16T13:48:51.728155+0000","last_became_peered":"2023-10-16T13:48:51.728155+0000","last_unstale":"2023-10-16T13:48:53.002748+0000","last_undegraded":"2023-10-16T13:48:53.002748+0000","last_fullsized":"2023-10-16T13:48:53.002748+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:29.748225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003168+0000","last_change":"2023-10-16T13:48:51.737134+0000","last_active":"2023-10-16T13:48:53.003168+0000","last_peered":"2023-10-16T13:48:53.003168+0000","last_clean":"2023-10-16T13:48:53.003168+0000","last_became_active":"2023-10-16T13:48:51.736310+0000","last_became_peered":"2023-10-16T13:48:51.736310+0000","last_unstale":"2023-10-16T13:48:53.003168+0000","last_undegraded":"2023-10-16T13:48:53.003168+0000","last_fullsized":"2023-10-16T13:48:53.003168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.228947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002687+0000","last_change":"2023-10-16T13:48:51.724449+0000","last_active":"2023-10-16T13:48:53.002687+0000","last_peered":"2023-10-16T13:48:53.002687+0000","last_clean":"2023-10-16T13:48:53.002687+0000","last_became_active":"2023-10-16T13:48:51.724154+0000","last_became_peered":"2023-10-16T13:48:51.724154+0000","last_unstale":"2023-10-16T13:48:53.002687+0000","last_undegraded":"2023-10-16T13:48:53.002687+0000","last_fullsized":"2023-10-16T13:48:53.002687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.228947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002323+0000","last_change":"2023-10-16T13:48:51.727826+0000","last_active":"2023-10-16T13:48:53.002323+0000","last_peered":"2023-10-16T13:48:53.002323+0000","last_clean":"2023-10-16T13:48:53.002323+0000","last_became_active":"2023-10-16T13:48:51.727507+0000","last_became_peered":"2023-10-16T13:48:51.727507+0000","last_unstale":"2023-10-16T13:48:53.002323+0000","last_undegraded":"2023-10-16T13:48:53.002323+0000","last_fullsized":"2023-10-16T13:48:53.002323+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:23.339409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002130+0000","last_change":"2023-10-16T13:48:51.735270+0000","last_active":"2023-10-16T13:48:53.002130+0000","last_peered":"2023-10-16T13:48:53.002130+0000","last_clean":"2023-10-16T13:48:53.002130+0000","last_became_active":"2023-10-16T13:48:51.734787+0000","last_became_peered":"2023-10-16T13:48:51.734787+0000","last_unstale":"2023-10-16T13:48:53.002130+0000","last_undegraded":"2023-10-16T13:48:53.002130+0000","last_fullsized":"2023-10-16T13:48:53.002130+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:00:03.738122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716129+0000","last_change":"2023-10-16T13:48:51.730391+0000","last_active":"2023-10-16T13:48:52.716129+0000","last_peered":"2023-10-16T13:48:52.716129+0000","last_clean":"2023-10-16T13:48:52.716129+0000","last_became_active":"2023-10-16T13:48:51.730065+0000","last_became_peered":"2023-10-16T13:48:51.730065+0000","last_unstale":"2023-10-16T13:48:52.716129+0000","last_undegraded":"2023-10-16T13:48:52.716129+0000","last_fullsized":"2023-10-16T13:48:52.716129+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:48.730517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003163+0000","last_change":"2023-10-16T13:48:51.736513+0000","last_active":"2023-10-16T13:48:53.003163+0000","last_peered":"2023-10-16T13:48:53.003163+0000","last_clean":"2023-10-16T13:48:53.003163+0000","last_became_active":"2023-10-16T13:48:51.736089+0000","last_became_peered":"2023-10-16T13:48:51.736089+0000","last_unstale":"2023-10-16T13:48:53.003163+0000","last_undegraded":"2023-10-16T13:48:53.003163+0000","last_fullsized":"2023-10-16T13:48:53.003163+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:11:27.204983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003391+0000","last_change":"2023-10-16T13:48:51.726731+0000","last_active":"2023-10-16T13:48:53.003391+0000","last_peered":"2023-10-16T13:48:53.003391+0000","last_clean":"2023-10-16T13:48:53.003391+0000","last_became_active":"2023-10-16T13:48:51.726052+0000","last_became_peered":"2023-10-16T13:48:51.726052+0000","last_unstale":"2023-10-16T13:48:53.003391+0000","last_undegraded":"2023-10-16T13:48:53.003391+0000","last_fullsized":"2023-10-16T13:48:53.003391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:25:36.882801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002883+0000","last_change":"2023-10-16T13:48:51.727038+0000","last_active":"2023-10-16T13:48:53.002883+0000","last_peered":"2023-10-16T13:48:53.002883+0000","last_clean":"2023-10-16T13:48:53.002883+0000","last_became_active":"2023-10-16T13:48:51.725120+0000","last_became_peered":"2023-10-16T13:48:51.725120+0000","last_unstale":"2023-10-16T13:48:53.002883+0000","last_undegraded":"2023-10-16T13:48:53.002883+0000","last_fullsized":"2023-10-16T13:48:53.002883+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:23.339409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003063+0000","last_change":"2023-10-16T13:48:51.727534+0000","last_active":"2023-10-16T13:48:53.003063+0000","last_peered":"2023-10-16T13:48:53.003063+0000","last_clean":"2023-10-16T13:48:53.003063+0000","last_became_active":"2023-10-16T13:48:51.725669+0000","last_became_peered":"2023-10-16T13:48:51.725669+0000","last_unstale":"2023-10-16T13:48:53.003063+0000","last_undegraded":"2023-10-16T13:48:53.003063+0000","last_fullsized":"2023-10-16T13:48:53.003063+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:33:24.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716392+0000","last_change":"2023-10-16T13:48:51.729263+0000","last_active":"2023-10-16T13:48:52.716392+0000","last_peered":"2023-10-16T13:48:52.716392+0000","last_clean":"2023-10-16T13:48:52.716392+0000","last_became_active":"2023-10-16T13:48:51.728896+0000","last_became_peered":"2023-10-16T13:48:51.728896+0000","last_unstale":"2023-10-16T13:48:52.716392+0000","last_undegraded":"2023-10-16T13:48:52.716392+0000","last_fullsized":"2023-10-16T13:48:52.716392+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:07.742873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003404+0000","last_change":"2023-10-16T13:48:51.727119+0000","last_active":"2023-10-16T13:48:53.003404+0000","last_peered":"2023-10-16T13:48:53.003404+0000","last_clean":"2023-10-16T13:48:53.003404+0000","last_became_active":"2023-10-16T13:48:51.726824+0000","last_became_peered":"2023-10-16T13:48:51.726824+0000","last_unstale":"2023-10-16T13:48:53.003404+0000","last_undegraded":"2023-10-16T13:48:53.003404+0000","last_fullsized":"2023-10-16T13:48:53.003404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:18.937888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002275+0000","last_change":"2023-10-16T13:48:51.730217+0000","last_active":"2023-10-16T13:48:53.002275+0000","last_peered":"2023-10-16T13:48:53.002275+0000","last_clean":"2023-10-16T13:48:53.002275+0000","last_became_active":"2023-10-16T13:48:51.729102+0000","last_became_peered":"2023-10-16T13:48:51.729102+0000","last_unstale":"2023-10-16T13:48:53.002275+0000","last_undegraded":"2023-10-16T13:48:53.002275+0000","last_fullsized":"2023-10-16T13:48:53.002275+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:11:36.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002416+0000","last_change":"2023-10-16T13:48:51.731686+0000","last_active":"2023-10-16T13:48:53.002416+0000","last_peered":"2023-10-16T13:48:53.002416+0000","last_clean":"2023-10-16T13:48:53.002416+0000","last_became_active":"2023-10-16T13:48:51.731314+0000","last_became_peered":"2023-10-16T13:48:51.731314+0000","last_unstale":"2023-10-16T13:48:53.002416+0000","last_undegraded":"2023-10-16T13:48:53.002416+0000","last_fullsized":"2023-10-16T13:48:53.002416+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:36:25.915352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716097+0000","last_change":"2023-10-16T13:48:51.729423+0000","last_active":"2023-10-16T13:48:52.716097+0000","last_peered":"2023-10-16T13:48:52.716097+0000","last_clean":"2023-10-16T13:48:52.716097+0000","last_became_active":"2023-10-16T13:48:51.728875+0000","last_became_peered":"2023-10-16T13:48:51.728875+0000","last_unstale":"2023-10-16T13:48:52.716097+0000","last_undegraded":"2023-10-16T13:48:52.716097+0000","last_fullsized":"2023-10-16T13:48:52.716097+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:59.838188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002992+0000","last_change":"2023-10-16T13:48:51.723731+0000","last_active":"2023-10-16T13:48:53.002992+0000","last_peered":"2023-10-16T13:48:53.002992+0000","last_clean":"2023-10-16T13:48:53.002992+0000","last_became_active":"2023-10-16T13:48:51.723330+0000","last_became_peered":"2023-10-16T13:48:51.723330+0000","last_unstale":"2023-10-16T13:48:53.002992+0000","last_undegraded":"2023-10-16T13:48:53.002992+0000","last_fullsized":"2023-10-16T13:48:53.002992+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.698650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"109'4","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002272+0000","last_change":"2023-10-16T13:48:50.737701+0000","last_active":"2023-10-16T13:48:53.002272+0000","last_peered":"2023-10-16T13:48:53.002272+0000","last_clean":"2023-10-16T13:48:53.002272+0000","last_became_active":"2023-10-16T13:48:50.737422+0000","last_became_peered":"2023-10-16T13:48:50.737422+0000","last_unstale":"2023-10-16T13:48:53.002272+0000","last_undegraded":"2023-10-16T13:48:53.002272+0000","last_fullsized":"2023-10-16T13:48:53.002272+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:51.529725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717699+0000","last_change":"2023-10-16T13:48:51.728282+0000","last_active":"2023-10-16T13:48:52.717699+0000","last_peered":"2023-10-16T13:48:52.717699+0000","last_clean":"2023-10-16T13:48:52.717699+0000","last_became_active":"2023-10-16T13:48:51.727955+0000","last_became_peered":"2023-10-16T13:48:51.727955+0000","last_unstale":"2023-10-16T13:48:52.717699+0000","last_undegraded":"2023-10-16T13:48:52.717699+0000","last_fullsized":"2023-10-16T13:48:52.717699+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:10:59.138291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716250+0000","last_change":"2023-10-16T13:48:50.728678+0000","last_active":"2023-10-16T13:48:52.716250+0000","last_peered":"2023-10-16T13:48:52.716250+0000","last_clean":"2023-10-16T13:48:52.716250+0000","last_became_active":"2023-10-16T13:48:50.728371+0000","last_became_peered":"2023-10-16T13:48:50.728371+0000","last_unstale":"2023-10-16T13:48:52.716250+0000","last_undegraded":"2023-10-16T13:48:52.716250+0000","last_fullsized":"2023-10-16T13:48:52.716250+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:03:24.040668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002324+0000","last_change":"2023-10-16T13:48:51.730191+0000","last_active":"2023-10-16T13:48:53.002324+0000","last_peered":"2023-10-16T13:48:53.002324+0000","last_clean":"2023-10-16T13:48:53.002324+0000","last_became_active":"2023-10-16T13:48:51.729923+0000","last_became_peered":"2023-10-16T13:48:51.729923+0000","last_unstale":"2023-10-16T13:48:53.002324+0000","last_undegraded":"2023-10-16T13:48:53.002324+0000","last_fullsized":"2023-10-16T13:48:53.002324+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:50.007623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002976+0000","last_change":"2023-10-16T13:48:50.735881+0000","last_active":"2023-10-16T13:48:53.002976+0000","last_peered":"2023-10-16T13:48:53.002976+0000","last_clean":"2023-10-16T13:48:53.002976+0000","last_became_active":"2023-10-16T13:48:50.735532+0000","last_became_peered":"2023-10-16T13:48:50.735532+0000","last_unstale":"2023-10-16T13:48:53.002976+0000","last_undegraded":"2023-10-16T13:48:53.002976+0000","last_fullsized":"2023-10-16T13:48:53.002976+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:02.580945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002407+0000","last_change":"2023-10-16T13:48:51.728119+0000","last_active":"2023-10-16T13:48:53.002407+0000","last_peered":"2023-10-16T13:48:53.002407+0000","last_clean":"2023-10-16T13:48:53.002407+0000","last_became_active":"2023-10-16T13:48:51.727123+0000","last_became_peered":"2023-10-16T13:48:51.727123+0000","last_unstale":"2023-10-16T13:48:53.002407+0000","last_undegraded":"2023-10-16T13:48:53.002407+0000","last_fullsized":"2023-10-16T13:48:53.002407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:36.963095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003294+0000","last_change":"2023-10-16T13:48:50.732491+0000","last_active":"2023-10-16T13:48:53.003294+0000","last_peered":"2023-10-16T13:48:53.003294+0000","last_clean":"2023-10-16T13:48:53.003294+0000","last_became_active":"2023-10-16T13:48:50.732186+0000","last_became_peered":"2023-10-16T13:48:50.732186+0000","last_unstale":"2023-10-16T13:48:53.003294+0000","last_undegraded":"2023-10-16T13:48:53.003294+0000","last_fullsized":"2023-10-16T13:48:53.003294+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:13.321762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002522+0000","last_change":"2023-10-16T13:48:51.726396+0000","last_active":"2023-10-16T13:48:53.002522+0000","last_peered":"2023-10-16T13:48:53.002522+0000","last_clean":"2023-10-16T13:48:53.002522+0000","last_became_active":"2023-10-16T13:48:51.725962+0000","last_became_peered":"2023-10-16T13:48:51.725962+0000","last_unstale":"2023-10-16T13:48:53.002522+0000","last_undegraded":"2023-10-16T13:48:53.002522+0000","last_fullsized":"2023-10-16T13:48:53.002522+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:11:27.204983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003094+0000","last_change":"2023-10-16T13:48:50.738698+0000","last_active":"2023-10-16T13:48:53.003094+0000","last_peered":"2023-10-16T13:48:53.003094+0000","last_clean":"2023-10-16T13:48:53.003094+0000","last_became_active":"2023-10-16T13:48:50.738470+0000","last_became_peered":"2023-10-16T13:48:50.738470+0000","last_unstale":"2023-10-16T13:48:53.003094+0000","last_undegraded":"2023-10-16T13:48:53.003094+0000","last_fullsized":"2023-10-16T13:48:53.003094+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:27.832481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715879+0000","last_change":"2023-10-16T13:48:51.738057+0000","last_active":"2023-10-16T13:48:52.715879+0000","last_peered":"2023-10-16T13:48:52.715879+0000","last_clean":"2023-10-16T13:48:52.715879+0000","last_became_active":"2023-10-16T13:48:51.737712+0000","last_became_peered":"2023-10-16T13:48:51.737712+0000","last_unstale":"2023-10-16T13:48:52.715879+0000","last_undegraded":"2023-10-16T13:48:52.715879+0000","last_fullsized":"2023-10-16T13:48:52.715879+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:52.535382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002618+0000","last_change":"2023-10-16T13:48:50.735579+0000","last_active":"2023-10-16T13:48:53.002618+0000","last_peered":"2023-10-16T13:48:53.002618+0000","last_clean":"2023-10-16T13:48:53.002618+0000","last_became_active":"2023-10-16T13:48:50.735273+0000","last_became_peered":"2023-10-16T13:48:50.735273+0000","last_unstale":"2023-10-16T13:48:53.002618+0000","last_undegraded":"2023-10-16T13:48:53.002618+0000","last_fullsized":"2023-10-16T13:48:53.002618+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:14:15.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.715970+0000","last_change":"2023-10-16T13:48:51.732885+0000","last_active":"2023-10-16T13:48:52.715970+0000","last_peered":"2023-10-16T13:48:52.715970+0000","last_clean":"2023-10-16T13:48:52.715970+0000","last_became_active":"2023-10-16T13:48:51.732149+0000","last_became_peered":"2023-10-16T13:48:51.732149+0000","last_unstale":"2023-10-16T13:48:52.715970+0000","last_undegraded":"2023-10-16T13:48:52.715970+0000","last_fullsized":"2023-10-16T13:48:52.715970+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:47.543306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716731+0000","last_change":"2023-10-16T13:48:50.728879+0000","last_active":"2023-10-16T13:48:52.716731+0000","last_peered":"2023-10-16T13:48:52.716731+0000","last_clean":"2023-10-16T13:48:52.716731+0000","last_became_active":"2023-10-16T13:48:50.728569+0000","last_became_peered":"2023-10-16T13:48:50.728569+0000","last_unstale":"2023-10-16T13:48:52.716731+0000","last_undegraded":"2023-10-16T13:48:52.716731+0000","last_fullsized":"2023-10-16T13:48:52.716731+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:10.214411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002457+0000","last_change":"2023-10-16T13:48:51.724543+0000","last_active":"2023-10-16T13:48:53.002457+0000","last_peered":"2023-10-16T13:48:53.002457+0000","last_clean":"2023-10-16T13:48:53.002457+0000","last_became_active":"2023-10-16T13:48:51.724185+0000","last_became_peered":"2023-10-16T13:48:51.724185+0000","last_unstale":"2023-10-16T13:48:53.002457+0000","last_undegraded":"2023-10-16T13:48:53.002457+0000","last_fullsized":"2023-10-16T13:48:53.002457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:13.511678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002644+0000","last_change":"2023-10-16T13:48:50.732852+0000","last_active":"2023-10-16T13:48:53.002644+0000","last_peered":"2023-10-16T13:48:53.002644+0000","last_clean":"2023-10-16T13:48:53.002644+0000","last_became_active":"2023-10-16T13:48:50.731897+0000","last_became_peered":"2023-10-16T13:48:50.731897+0000","last_unstale":"2023-10-16T13:48:53.002644+0000","last_undegraded":"2023-10-16T13:48:53.002644+0000","last_fullsized":"2023-10-16T13:48:53.002644+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:12:21.018306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002596+0000","last_change":"2023-10-16T13:48:51.738088+0000","last_active":"2023-10-16T13:48:53.002596+0000","last_peered":"2023-10-16T13:48:53.002596+0000","last_clean":"2023-10-16T13:48:53.002596+0000","last_became_active":"2023-10-16T13:48:51.737725+0000","last_became_peered":"2023-10-16T13:48:51.737725+0000","last_unstale":"2023-10-16T13:48:53.002596+0000","last_undegraded":"2023-10-16T13:48:53.002596+0000","last_fullsized":"2023-10-16T13:48:53.002596+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:59:33.297020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717284+0000","last_change":"2023-10-16T13:48:50.727969+0000","last_active":"2023-10-16T13:48:52.717284+0000","last_peered":"2023-10-16T13:48:52.717284+0000","last_clean":"2023-10-16T13:48:52.717284+0000","last_became_active":"2023-10-16T13:48:50.727532+0000","last_became_peered":"2023-10-16T13:48:50.727532+0000","last_unstale":"2023-10-16T13:48:52.717284+0000","last_undegraded":"2023-10-16T13:48:52.717284+0000","last_fullsized":"2023-10-16T13:48:52.717284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:51:46.537650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717101+0000","last_change":"2023-10-16T13:48:51.724315+0000","last_active":"2023-10-16T13:48:52.717101+0000","last_peered":"2023-10-16T13:48:52.717101+0000","last_clean":"2023-10-16T13:48:52.717101+0000","last_became_active":"2023-10-16T13:48:51.724024+0000","last_became_peered":"2023-10-16T13:48:51.724024+0000","last_unstale":"2023-10-16T13:48:52.717101+0000","last_undegraded":"2023-10-16T13:48:52.717101+0000","last_fullsized":"2023-10-16T13:48:52.717101+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:28.838137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002974+0000","last_change":"2023-10-16T13:48:50.729440+0000","last_active":"2023-10-16T13:48:53.002974+0000","last_peered":"2023-10-16T13:48:53.002974+0000","last_clean":"2023-10-16T13:48:53.002974+0000","last_became_active":"2023-10-16T13:48:50.729183+0000","last_became_peered":"2023-10-16T13:48:50.729183+0000","last_unstale":"2023-10-16T13:48:53.002974+0000","last_undegraded":"2023-10-16T13:48:53.002974+0000","last_fullsized":"2023-10-16T13:48:53.002974+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:55:02.580945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002370+0000","last_change":"2023-10-16T13:48:51.728909+0000","last_active":"2023-10-16T13:48:53.002370+0000","last_peered":"2023-10-16T13:48:53.002370+0000","last_clean":"2023-10-16T13:48:53.002370+0000","last_became_active":"2023-10-16T13:48:51.728651+0000","last_became_peered":"2023-10-16T13:48:51.728651+0000","last_unstale":"2023-10-16T13:48:53.002370+0000","last_undegraded":"2023-10-16T13:48:53.002370+0000","last_fullsized":"2023-10-16T13:48:53.002370+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.698650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"109'3","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716781+0000","last_change":"2023-10-16T13:48:50.735980+0000","last_active":"2023-10-16T13:48:52.716781+0000","last_peered":"2023-10-16T13:48:52.716781+0000","last_clean":"2023-10-16T13:48:52.716781+0000","last_became_active":"2023-10-16T13:48:50.735596+0000","last_became_peered":"2023-10-16T13:48:50.735596+0000","last_unstale":"2023-10-16T13:48:52.716781+0000","last_undegraded":"2023-10-16T13:48:52.716781+0000","last_fullsized":"2023-10-16T13:48:52.716781+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:23:44.227923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002411+0000","last_change":"2023-10-16T13:48:51.731745+0000","last_active":"2023-10-16T13:48:53.002411+0000","last_peered":"2023-10-16T13:48:53.002411+0000","last_clean":"2023-10-16T13:48:53.002411+0000","last_became_active":"2023-10-16T13:48:51.731500+0000","last_became_peered":"2023-10-16T13:48:51.731500+0000","last_unstale":"2023-10-16T13:48:53.002411+0000","last_undegraded":"2023-10-16T13:48:53.002411+0000","last_fullsized":"2023-10-16T13:48:53.002411+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:41.284343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"109'6","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717371+0000","last_change":"2023-10-16T13:48:50.729317+0000","last_active":"2023-10-16T13:48:52.717371+0000","last_peered":"2023-10-16T13:48:52.717371+0000","last_clean":"2023-10-16T13:48:52.717371+0000","last_became_active":"2023-10-16T13:48:50.729041+0000","last_became_peered":"2023-10-16T13:48:50.729041+0000","last_unstale":"2023-10-16T13:48:52.717371+0000","last_undegraded":"2023-10-16T13:48:52.717371+0000","last_fullsized":"2023-10-16T13:48:52.717371+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:49:32.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003546+0000","last_change":"2023-10-16T13:48:51.735610+0000","last_active":"2023-10-16T13:48:53.003546+0000","last_peered":"2023-10-16T13:48:53.003546+0000","last_clean":"2023-10-16T13:48:53.003546+0000","last_became_active":"2023-10-16T13:48:51.735333+0000","last_became_peered":"2023-10-16T13:48:51.735333+0000","last_unstale":"2023-10-16T13:48:53.003546+0000","last_undegraded":"2023-10-16T13:48:53.003546+0000","last_fullsized":"2023-10-16T13:48:53.003546+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:06:09.230574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002353+0000","last_change":"2023-10-16T13:48:50.727152+0000","last_active":"2023-10-16T13:48:53.002353+0000","last_peered":"2023-10-16T13:48:53.002353+0000","last_clean":"2023-10-16T13:48:53.002353+0000","last_became_active":"2023-10-16T13:48:50.725133+0000","last_became_peered":"2023-10-16T13:48:50.725133+0000","last_unstale":"2023-10-16T13:48:53.002353+0000","last_undegraded":"2023-10-16T13:48:53.002353+0000","last_fullsized":"2023-10-16T13:48:53.002353+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:07:00.513657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002554+0000","last_change":"2023-10-16T13:48:51.732135+0000","last_active":"2023-10-16T13:48:53.002554+0000","last_peered":"2023-10-16T13:48:53.002554+0000","last_clean":"2023-10-16T13:48:53.002554+0000","last_became_active":"2023-10-16T13:48:51.731871+0000","last_became_peered":"2023-10-16T13:48:51.731871+0000","last_unstale":"2023-10-16T13:48:53.002554+0000","last_undegraded":"2023-10-16T13:48:53.002554+0000","last_fullsized":"2023-10-16T13:48:53.002554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:21:24.819500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002548+0000","last_change":"2023-10-16T13:48:50.732663+0000","last_active":"2023-10-16T13:48:53.002548+0000","last_peered":"2023-10-16T13:48:53.002548+0000","last_clean":"2023-10-16T13:48:53.002548+0000","last_became_active":"2023-10-16T13:48:50.732283+0000","last_became_peered":"2023-10-16T13:48:50.732283+0000","last_unstale":"2023-10-16T13:48:53.002548+0000","last_undegraded":"2023-10-16T13:48:53.002548+0000","last_fullsized":"2023-10-16T13:48:53.002548+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:43:53.440638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716263+0000","last_change":"2023-10-16T13:48:51.728809+0000","last_active":"2023-10-16T13:48:52.716263+0000","last_peered":"2023-10-16T13:48:52.716263+0000","last_clean":"2023-10-16T13:48:52.716263+0000","last_became_active":"2023-10-16T13:48:51.728411+0000","last_became_peered":"2023-10-16T13:48:51.728411+0000","last_unstale":"2023-10-16T13:48:52.716263+0000","last_undegraded":"2023-10-16T13:48:52.716263+0000","last_fullsized":"2023-10-16T13:48:52.716263+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:07.742873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"109'8","reported_seq":20,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716150+0000","last_change":"2023-10-16T13:48:50.737403+0000","last_active":"2023-10-16T13:48:52.716150+0000","last_peered":"2023-10-16T13:48:52.716150+0000","last_clean":"2023-10-16T13:48:52.716150+0000","last_became_active":"2023-10-16T13:48:50.737141+0000","last_became_peered":"2023-10-16T13:48:50.737141+0000","last_unstale":"2023-10-16T13:48:52.716150+0000","last_undegraded":"2023-10-16T13:48:52.716150+0000","last_fullsized":"2023-10-16T13:48:52.716150+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:10.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717658+0000","last_change":"2023-10-16T13:48:51.725281+0000","last_active":"2023-10-16T13:48:52.717658+0000","last_peered":"2023-10-16T13:48:52.717658+0000","last_clean":"2023-10-16T13:48:52.717658+0000","last_became_active":"2023-10-16T13:48:51.725010+0000","last_became_peered":"2023-10-16T13:48:51.725010+0000","last_unstale":"2023-10-16T13:48:52.717658+0000","last_undegraded":"2023-10-16T13:48:52.717658+0000","last_fullsized":"2023-10-16T13:48:52.717658+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:28.838137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717297+0000","last_change":"2023-10-16T13:48:50.729013+0000","last_active":"2023-10-16T13:48:52.717297+0000","last_peered":"2023-10-16T13:48:52.717297+0000","last_clean":"2023-10-16T13:48:52.717297+0000","last_became_active":"2023-10-16T13:48:50.728036+0000","last_became_peered":"2023-10-16T13:48:50.728036+0000","last_unstale":"2023-10-16T13:48:52.717297+0000","last_undegraded":"2023-10-16T13:48:52.717297+0000","last_fullsized":"2023-10-16T13:48:52.717297+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:53:47.724860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716952+0000","last_change":"2023-10-16T13:48:51.735409+0000","last_active":"2023-10-16T13:48:52.716952+0000","last_peered":"2023-10-16T13:48:52.716952+0000","last_clean":"2023-10-16T13:48:52.716952+0000","last_became_active":"2023-10-16T13:48:51.735123+0000","last_became_peered":"2023-10-16T13:48:51.735123+0000","last_unstale":"2023-10-16T13:48:52.716952+0000","last_undegraded":"2023-10-16T13:48:52.716952+0000","last_fullsized":"2023-10-16T13:48:52.716952+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:58.967594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002653+0000","last_change":"2023-10-16T13:48:50.727960+0000","last_active":"2023-10-16T13:48:53.002653+0000","last_peered":"2023-10-16T13:48:53.002653+0000","last_clean":"2023-10-16T13:48:53.002653+0000","last_became_active":"2023-10-16T13:48:50.727658+0000","last_became_peered":"2023-10-16T13:48:50.727658+0000","last_unstale":"2023-10-16T13:48:53.002653+0000","last_undegraded":"2023-10-16T13:48:53.002653+0000","last_fullsized":"2023-10-16T13:48:53.002653+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:57.691114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002827+0000","last_change":"2023-10-16T13:48:51.721878+0000","last_active":"2023-10-16T13:48:53.002827+0000","last_peered":"2023-10-16T13:48:53.002827+0000","last_clean":"2023-10-16T13:48:53.002827+0000","last_became_active":"2023-10-16T13:48:51.721552+0000","last_became_peered":"2023-10-16T13:48:51.721552+0000","last_unstale":"2023-10-16T13:48:53.002827+0000","last_undegraded":"2023-10-16T13:48:53.002827+0000","last_fullsized":"2023-10-16T13:48:53.002827+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:50.007623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"109'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716681+0000","last_change":"2023-10-16T13:48:50.737476+0000","last_active":"2023-10-16T13:48:52.716681+0000","last_peered":"2023-10-16T13:48:52.716681+0000","last_clean":"2023-10-16T13:48:52.716681+0000","last_became_active":"2023-10-16T13:48:50.737179+0000","last_became_peered":"2023-10-16T13:48:50.737179+0000","last_unstale":"2023-10-16T13:48:52.716681+0000","last_undegraded":"2023-10-16T13:48:52.716681+0000","last_fullsized":"2023-10-16T13:48:52.716681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:59:52.608972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003304+0000","last_change":"2023-10-16T13:48:51.726141+0000","last_active":"2023-10-16T13:48:53.003304+0000","last_peered":"2023-10-16T13:48:53.003304+0000","last_clean":"2023-10-16T13:48:53.003304+0000","last_became_active":"2023-10-16T13:48:51.725820+0000","last_became_peered":"2023-10-16T13:48:51.725820+0000","last_unstale":"2023-10-16T13:48:53.003304+0000","last_undegraded":"2023-10-16T13:48:53.003304+0000","last_fullsized":"2023-10-16T13:48:53.003304+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:39:37.882104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716482+0000","last_change":"2023-10-16T13:48:50.726298+0000","last_active":"2023-10-16T13:48:52.716482+0000","last_peered":"2023-10-16T13:48:52.716482+0000","last_clean":"2023-10-16T13:48:52.716482+0000","last_became_active":"2023-10-16T13:48:50.726019+0000","last_became_peered":"2023-10-16T13:48:50.726019+0000","last_unstale":"2023-10-16T13:48:52.716482+0000","last_undegraded":"2023-10-16T13:48:52.716482+0000","last_fullsized":"2023-10-16T13:48:52.716482+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:10.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002243+0000","last_change":"2023-10-16T13:48:51.728708+0000","last_active":"2023-10-16T13:48:53.002243+0000","last_peered":"2023-10-16T13:48:53.002243+0000","last_clean":"2023-10-16T13:48:53.002243+0000","last_became_active":"2023-10-16T13:48:51.725685+0000","last_became_peered":"2023-10-16T13:48:51.725685+0000","last_unstale":"2023-10-16T13:48:53.002243+0000","last_undegraded":"2023-10-16T13:48:53.002243+0000","last_fullsized":"2023-10-16T13:48:53.002243+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:32.462606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717231+0000","last_change":"2023-10-16T13:48:50.727544+0000","last_active":"2023-10-16T13:48:52.717231+0000","last_peered":"2023-10-16T13:48:52.717231+0000","last_clean":"2023-10-16T13:48:52.717231+0000","last_became_active":"2023-10-16T13:48:50.727285+0000","last_became_peered":"2023-10-16T13:48:50.727285+0000","last_unstale":"2023-10-16T13:48:52.717231+0000","last_undegraded":"2023-10-16T13:48:52.717231+0000","last_fullsized":"2023-10-16T13:48:52.717231+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:49:32.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716699+0000","last_change":"2023-10-16T13:48:51.732640+0000","last_active":"2023-10-16T13:48:52.716699+0000","last_peered":"2023-10-16T13:48:52.716699+0000","last_clean":"2023-10-16T13:48:52.716699+0000","last_became_active":"2023-10-16T13:48:51.732337+0000","last_became_peered":"2023-10-16T13:48:51.732337+0000","last_unstale":"2023-10-16T13:48:52.716699+0000","last_undegraded":"2023-10-16T13:48:52.716699+0000","last_fullsized":"2023-10-16T13:48:52.716699+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:58.696770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002704+0000","last_change":"2023-10-16T13:48:50.728615+0000","last_active":"2023-10-16T13:48:53.002704+0000","last_peered":"2023-10-16T13:48:53.002704+0000","last_clean":"2023-10-16T13:48:53.002704+0000","last_became_active":"2023-10-16T13:48:50.728337+0000","last_became_peered":"2023-10-16T13:48:50.728337+0000","last_unstale":"2023-10-16T13:48:53.002704+0000","last_undegraded":"2023-10-16T13:48:53.002704+0000","last_fullsized":"2023-10-16T13:48:53.002704+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:58.995229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002414+0000","last_change":"2023-10-16T13:48:51.736844+0000","last_active":"2023-10-16T13:48:53.002414+0000","last_peered":"2023-10-16T13:48:53.002414+0000","last_clean":"2023-10-16T13:48:53.002414+0000","last_became_active":"2023-10-16T13:48:51.736529+0000","last_became_peered":"2023-10-16T13:48:51.736529+0000","last_unstale":"2023-10-16T13:48:53.002414+0000","last_undegraded":"2023-10-16T13:48:53.002414+0000","last_fullsized":"2023-10-16T13:48:53.002414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:49.071480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002288+0000","last_change":"2023-10-16T13:48:50.731431+0000","last_active":"2023-10-16T13:48:53.002288+0000","last_peered":"2023-10-16T13:48:53.002288+0000","last_clean":"2023-10-16T13:48:53.002288+0000","last_became_active":"2023-10-16T13:48:50.731128+0000","last_became_peered":"2023-10-16T13:48:50.731128+0000","last_unstale":"2023-10-16T13:48:53.002288+0000","last_undegraded":"2023-10-16T13:48:53.002288+0000","last_fullsized":"2023-10-16T13:48:53.002288+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:04.113084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002046+0000","last_change":"2023-10-16T13:48:51.732395+0000","last_active":"2023-10-16T13:48:53.002046+0000","last_peered":"2023-10-16T13:48:53.002046+0000","last_clean":"2023-10-16T13:48:53.002046+0000","last_became_active":"2023-10-16T13:48:51.732132+0000","last_became_peered":"2023-10-16T13:48:51.732132+0000","last_unstale":"2023-10-16T13:48:53.002046+0000","last_undegraded":"2023-10-16T13:48:53.002046+0000","last_fullsized":"2023-10-16T13:48:53.002046+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:11:27.204983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.001968+0000","last_change":"2023-10-16T13:48:50.736222+0000","last_active":"2023-10-16T13:48:53.001968+0000","last_peered":"2023-10-16T13:48:53.001968+0000","last_clean":"2023-10-16T13:48:53.001968+0000","last_became_active":"2023-10-16T13:48:50.735958+0000","last_became_peered":"2023-10-16T13:48:50.735958+0000","last_unstale":"2023-10-16T13:48:53.001968+0000","last_undegraded":"2023-10-16T13:48:53.001968+0000","last_fullsized":"2023-10-16T13:48:53.001968+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:58.995229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716922+0000","last_change":"2023-10-16T13:48:51.725684+0000","last_active":"2023-10-16T13:48:52.716922+0000","last_peered":"2023-10-16T13:48:52.716922+0000","last_clean":"2023-10-16T13:48:52.716922+0000","last_became_active":"2023-10-16T13:48:51.725256+0000","last_became_peered":"2023-10-16T13:48:51.725256+0000","last_unstale":"2023-10-16T13:48:52.716922+0000","last_undegraded":"2023-10-16T13:48:52.716922+0000","last_fullsized":"2023-10-16T13:48:52.716922+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:05.118741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002794+0000","last_change":"2023-10-16T13:48:50.727980+0000","last_active":"2023-10-16T13:48:53.002794+0000","last_peered":"2023-10-16T13:48:53.002794+0000","last_clean":"2023-10-16T13:48:53.002794+0000","last_became_active":"2023-10-16T13:48:50.727704+0000","last_became_peered":"2023-10-16T13:48:50.727704+0000","last_unstale":"2023-10-16T13:48:53.002794+0000","last_undegraded":"2023-10-16T13:48:53.002794+0000","last_fullsized":"2023-10-16T13:48:53.002794+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:49:49.874078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002702+0000","last_change":"2023-10-16T13:48:51.733422+0000","last_active":"2023-10-16T13:48:53.002702+0000","last_peered":"2023-10-16T13:48:53.002702+0000","last_clean":"2023-10-16T13:48:53.002702+0000","last_became_active":"2023-10-16T13:48:51.733086+0000","last_became_peered":"2023-10-16T13:48:51.733086+0000","last_unstale":"2023-10-16T13:48:53.002702+0000","last_undegraded":"2023-10-16T13:48:53.002702+0000","last_fullsized":"2023-10-16T13:48:53.002702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:30:14.861869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002218+0000","last_change":"2023-10-16T13:48:50.730801+0000","last_active":"2023-10-16T13:48:53.002218+0000","last_peered":"2023-10-16T13:48:53.002218+0000","last_clean":"2023-10-16T13:48:53.002218+0000","last_became_active":"2023-10-16T13:48:50.730492+0000","last_became_peered":"2023-10-16T13:48:50.730492+0000","last_unstale":"2023-10-16T13:48:53.002218+0000","last_undegraded":"2023-10-16T13:48:53.002218+0000","last_fullsized":"2023-10-16T13:48:53.002218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:49.551205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003139+0000","last_change":"2023-10-16T13:48:51.727329+0000","last_active":"2023-10-16T13:48:53.003139+0000","last_peered":"2023-10-16T13:48:53.003139+0000","last_clean":"2023-10-16T13:48:53.003139+0000","last_became_active":"2023-10-16T13:48:51.725755+0000","last_became_peered":"2023-10-16T13:48:51.725755+0000","last_unstale":"2023-10-16T13:48:53.003139+0000","last_undegraded":"2023-10-16T13:48:53.003139+0000","last_fullsized":"2023-10-16T13:48:53.003139+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:27:05.925760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003397+0000","last_change":"2023-10-16T13:48:50.731398+0000","last_active":"2023-10-16T13:48:53.003397+0000","last_peered":"2023-10-16T13:48:53.003397+0000","last_clean":"2023-10-16T13:48:53.003397+0000","last_became_active":"2023-10-16T13:48:50.731060+0000","last_became_peered":"2023-10-16T13:48:50.731060+0000","last_unstale":"2023-10-16T13:48:53.003397+0000","last_undegraded":"2023-10-16T13:48:53.003397+0000","last_fullsized":"2023-10-16T13:48:53.003397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:02.296892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.716461+0000","last_change":"2023-10-16T13:48:51.727063+0000","last_active":"2023-10-16T13:48:52.716461+0000","last_peered":"2023-10-16T13:48:52.716461+0000","last_clean":"2023-10-16T13:48:52.716461+0000","last_became_active":"2023-10-16T13:48:51.725978+0000","last_became_peered":"2023-10-16T13:48:51.725978+0000","last_unstale":"2023-10-16T13:48:52.716461+0000","last_undegraded":"2023-10-16T13:48:52.716461+0000","last_fullsized":"2023-10-16T13:48:52.716461+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:50.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002069+0000","last_change":"2023-10-16T13:48:50.733838+0000","last_active":"2023-10-16T13:48:53.002069+0000","last_peered":"2023-10-16T13:48:53.002069+0000","last_clean":"2023-10-16T13:48:53.002069+0000","last_became_active":"2023-10-16T13:48:50.733567+0000","last_became_peered":"2023-10-16T13:48:50.733567+0000","last_unstale":"2023-10-16T13:48:53.002069+0000","last_undegraded":"2023-10-16T13:48:53.002069+0000","last_fullsized":"2023-10-16T13:48:53.002069+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:14:15.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002175+0000","last_change":"2023-10-16T13:48:51.725901+0000","last_active":"2023-10-16T13:48:53.002175+0000","last_peered":"2023-10-16T13:48:53.002175+0000","last_clean":"2023-10-16T13:48:53.002175+0000","last_became_active":"2023-10-16T13:48:51.725643+0000","last_became_peered":"2023-10-16T13:48:51.725643+0000","last_unstale":"2023-10-16T13:48:53.002175+0000","last_undegraded":"2023-10-16T13:48:53.002175+0000","last_fullsized":"2023-10-16T13:48:53.002175+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:51:49.228947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.003182+0000","last_change":"2023-10-16T13:48:50.729407+0000","last_active":"2023-10-16T13:48:53.003182+0000","last_peered":"2023-10-16T13:48:53.003182+0000","last_clean":"2023-10-16T13:48:53.003182+0000","last_became_active":"2023-10-16T13:48:50.729095+0000","last_became_peered":"2023-10-16T13:48:50.729095+0000","last_unstale":"2023-10-16T13:48:53.003182+0000","last_undegraded":"2023-10-16T13:48:53.003182+0000","last_fullsized":"2023-10-16T13:48:53.003182+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:06.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:52.717194+0000","last_change":"2023-10-16T13:48:51.725886+0000","last_active":"2023-10-16T13:48:52.717194+0000","last_peered":"2023-10-16T13:48:52.717194+0000","last_clean":"2023-10-16T13:48:52.717194+0000","last_became_active":"2023-10-16T13:48:51.725526+0000","last_became_peered":"2023-10-16T13:48:51.725526+0000","last_unstale":"2023-10-16T13:48:52.717194+0000","last_undegraded":"2023-10-16T13:48:52.717194+0000","last_fullsized":"2023-10-16T13:48:52.717194+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:42:38.955755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002120+0000","last_change":"2023-10-16T13:48:50.731193+0000","last_active":"2023-10-16T13:48:53.002120+0000","last_peered":"2023-10-16T13:48:53.002120+0000","last_clean":"2023-10-16T13:48:53.002120+0000","last_became_active":"2023-10-16T13:48:50.730909+0000","last_became_peered":"2023-10-16T13:48:50.730909+0000","last_unstale":"2023-10-16T13:48:53.002120+0000","last_undegraded":"2023-10-16T13:48:53.002120+0000","last_fullsized":"2023-10-16T13:48:53.002120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:43:49.432538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002116+0000","last_change":"2023-10-16T13:48:51.726949+0000","last_active":"2023-10-16T13:48:53.002116+0000","last_peered":"2023-10-16T13:48:53.002116+0000","last_clean":"2023-10-16T13:48:53.002116+0000","last_became_active":"2023-10-16T13:48:51.726475+0000","last_became_peered":"2023-10-16T13:48:51.726475+0000","last_unstale":"2023-10-16T13:48:53.002116+0000","last_undegraded":"2023-10-16T13:48:53.002116+0000","last_fullsized":"2023-10-16T13:48:53.002116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:31.385782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002376+0000","last_change":"2023-10-16T13:48:50.728957+0000","last_active":"2023-10-16T13:48:53.002376+0000","last_peered":"2023-10-16T13:48:53.002376+0000","last_clean":"2023-10-16T13:48:53.002376+0000","last_became_active":"2023-10-16T13:48:50.728665+0000","last_became_peered":"2023-10-16T13:48:50.728665+0000","last_unstale":"2023-10-16T13:48:53.002376+0000","last_undegraded":"2023-10-16T13:48:53.002376+0000","last_fullsized":"2023-10-16T13:48:53.002376+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:01:17.786615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002316+0000","last_change":"2023-10-16T13:48:51.729491+0000","last_active":"2023-10-16T13:48:53.002316+0000","last_peered":"2023-10-16T13:48:53.002316+0000","last_clean":"2023-10-16T13:48:53.002316+0000","last_became_active":"2023-10-16T13:48:51.729214+0000","last_became_peered":"2023-10-16T13:48:51.729214+0000","last_unstale":"2023-10-16T13:48:53.002316+0000","last_undegraded":"2023-10-16T13:48:53.002316+0000","last_fullsized":"2023-10-16T13:48:53.002316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:40:36.199863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002060+0000","last_change":"2023-10-16T13:48:50.732196+0000","last_active":"2023-10-16T13:48:53.002060+0000","last_peered":"2023-10-16T13:48:53.002060+0000","last_clean":"2023-10-16T13:48:53.002060+0000","last_became_active":"2023-10-16T13:48:50.731897+0000","last_became_peered":"2023-10-16T13:48:50.731897+0000","last_unstale":"2023-10-16T13:48:53.002060+0000","last_undegraded":"2023-10-16T13:48:53.002060+0000","last_fullsized":"2023-10-16T13:48:53.002060+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:01:17.786615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002009+0000","last_change":"2023-10-16T13:48:51.733738+0000","last_active":"2023-10-16T13:48:53.002009+0000","last_peered":"2023-10-16T13:48:53.002009+0000","last_clean":"2023-10-16T13:48:53.002009+0000","last_became_active":"2023-10-16T13:48:51.733436+0000","last_became_peered":"2023-10-16T13:48:51.733436+0000","last_unstale":"2023-10-16T13:48:53.002009+0000","last_undegraded":"2023-10-16T13:48:53.002009+0000","last_fullsized":"2023-10-16T13:48:53.002009+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:50.709038+0000","last_clean_scrub_stamp":"2023-10-16T13:48:50.709038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:31.385782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"109'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-16T13:48:53.002370+0000","last_change":"2023-10-16T13:48:50.737691+0000","last_active":"2023-10-16T13:48:53.002370+0000","last_peered":"2023-10-16T13:48:53.002370+0000","last_clean":"2023-10-16T13:48:53.002370+0000","last_became_active":"2023-10-16T13:48:50.737337+0000","last_became_peered":"2023-10-16T13:48:50.737337+0000","last_unstale":"2023-10-16T13:48:53.002370+0000","last_undegraded":"2023-10-16T13:48:53.002370+0000","last_fullsized":"2023-10-16T13:48:53.002370+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:48:49.703381+0000","last_clean_scrub_stamp":"2023-10-16T13:48:49.703381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:58.995229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-16T13:48:51.718129+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:48:51.718129+0000","last_peered":"2023-10-16T13:48:51.718129+0000","last_clean":"2023-10-16T13:48:51.718129+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:48:51.718129+0000","last_undegraded":"2023-10-16T13:48:51.718129+0000","last_fullsized":"2023-10-16T13:48:51.718129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1994752,"data_stored":1191490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.54400000000000004}]},{"osd":1,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.83099999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.622}]},{"osd":2,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.76400000000000001,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.73999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574980,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1388544,"data_stored":600484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.34200000000000003,"15min":0.23100000000000001},"max":{"1min":0.79500000000000004,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56100000000000005,"15min":0.53400000000000003},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.73499999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.86099999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57099999999999995,"15min":0.60599999999999998},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.77200000000000002,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.86699999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.34999999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.81599999999999995,"5min":1.768,"15min":1.768},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.755,"5min":0.79200000000000004,"15min":1.157},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.81599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.80700000000000005,"5min":0.81899999999999995,"15min":10.964},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77100000000000002,"5min":0.82199999999999995,"15min":0.95599999999999996},"last":0.89800000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.73599999999999999,"5min":0.875,"15min":0.875},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53900000000000003,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.438}]},{"osd":5,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":1.343,"15min":1.343},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.59199999999999997},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.036},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.63300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1363968,"data_stored":592572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46500000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.372},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.47699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.32900000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.496,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.5,"5min":0.61699999999999999,"15min":0.752},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.88},"last":0.432},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.52100000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.905},"last":0.751},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.52000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":1.879},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.44700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.748,"5min":0.90400000000000003,"15min":1.925},"last":0.53000000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.624},"min":{"1min":0.53100000000000003,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.81100000000000005,"5min":0.872,"15min":1.085},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574980,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1181921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.35299999999999998},"min":{"1min":0.221,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.49299999999999999,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.309},{"interface":"front","average":{"1min":0.38,"5min":0.35399999999999998,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.221,"15min":0.214},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.379}]},{"osd":2,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.38800000000000001},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":3.8849999999999998},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.38200000000000001},"min":{"1min":0.28000000000000003,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.379,"15min":0.30499999999999999},"max":{"1min":0.78800000000000003,"5min":0.92300000000000004,"15min":4.0190000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.60199999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":4.0650000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.95399999999999996,"15min":4.0369999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":4.1859999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.46000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.92000000000000004,"15min":4.3049999999999997},"last":0.63},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.98299999999999998,"15min":4.2359999999999998},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63200000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":4.2119999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.877,"15min":4.2649999999999997},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":598469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.317,"15min":0.33400000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.99199999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.34599999999999997,"15min":0.36299999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.78700000000000003},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.221,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.67800000000000005},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.374,"15min":0.375},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.24399999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.629,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":0.621,"15min":1.153},"last":0.29899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.629},"min":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85099999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.504}]},{"osd":6,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.96999999999999997,"15min":1.379},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.98199999999999998,"15min":1.395},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.875,"15min":6.0499999999999998},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1372160,"data_stored":592732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.45400000000000001},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.629},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.378,"15min":0.40400000000000003},"min":{"1min":0.28599999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":2.181},"last":0.65000000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.40300000000000002,"15min":0.434},"min":{"1min":0.28599999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.34100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.60899999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.752}]},{"osd":5,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61299999999999999,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.73199999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.621,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.264,"5min":1.264,"15min":2.4039999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.371,"15min":0.371},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.76100000000000001},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64900000000000002,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":2.4430000000000001},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574981,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":598942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.85299999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65500000000000003,"5min":0.73799999999999999,"15min":0.82099999999999995},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67500000000000004,"5min":0.81499999999999995,"15min":0.83199999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.76100000000000001,"15min":0.89900000000000002},"last":0.497}]},{"osd":2,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.751,"15min":0.85099999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.95099999999999996},"last":0.628}]},{"osd":3,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.81799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.749,"5min":0.77900000000000003,"15min":0.88},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.35299999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76600000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.81200000000000006},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55800000000000005,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.81599999999999995,"5min":0.872,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58399999999999996,"15min":0.60899999999999999},"min":{"1min":0.45400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.62,"15min":0.65100000000000002},"min":{"1min":0.433,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82699999999999996,"5min":0.83999999999999997,"15min":0.91600000000000004},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1384448,"data_stored":598984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.34200000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.752,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.40699999999999997,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.79900000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.35599999999999998,"15min":0.34999999999999998},"max":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.80500000000000005},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":1.141},"last":0.502},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.36699999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77000000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.41799999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.437},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.41899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80300000000000005,"5min":0.87,"15min":0.87},"last":0.39000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:48:56.304 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:48:56.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:48:56.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.469+0000 7fce359c3700 1 Processor -- start 2023-10-16T13:48:56.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.469+0000 7fce359c3700 1 -- start start 2023-10-16T13:48:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce359c3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce300d0820 0x7fce30168b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce359c3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300cf8c0 con 0x7fce3015dc90 2023-10-16T13:48:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce359c3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300cecb0 con 0x7fce300ce6b0 2023-10-16T13:48:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce359c3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce300cef90 con 0x7fce300d0820 2023-10-16T13:48:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce300d0820 0x7fce30168b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fce3015dc90 0x7fce300d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59664/0 (socket says 172.21.15.5:59664) 2023-10-16T13:48:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2effd700 1 -- 172.21.15.5:0/3076713434 learned_addr learned my addr 172.21.15.5:0/3076713434 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce300d0820 0x7fce30168b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49664/0 (socket says 172.21.15.5:49664) 2023-10-16T13:48:56.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2f7fe700 1 -- 172.21.15.5:0/3076713434 >> v1:172.21.15.112:6789/0 conn(0x7fce300ce6b0 legacy=0x7fce300d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:56.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2f7fe700 1 -- 172.21.15.5:0/3076713434 >> v1:172.21.15.5:6789/0 conn(0x7fce3015dc90 legacy=0x7fce300d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2f7fe700 1 -- 172.21.15.5:0/3076713434 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce300cf270 con 0x7fce300d0820 2023-10-16T13:48:56.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.470+0000 7fce2dffb700 1 -- 172.21.15.5:0/3076713434 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849745424 0 0) 0x7fce300cf8c0 con 0x7fce3015dc90 2023-10-16T13:48:56.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce2f7fe700 1 --2- 172.21.15.5:0/3076713434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300d0820 0x7fce30168b40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fce28009d90 tx=0x7fce2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a7a818657e8820 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce2dffb700 1 -- 172.21.15.5:0/3076713434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800e070 con 0x7fce300d0820 2023-10-16T13:48:56.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce2dffb700 1 -- 172.21.15.5:0/3076713434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800bb90 con 0x7fce300d0820 2023-10-16T13:48:56.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce2dffb700 1 -- 172.21.15.5:0/3076713434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28003a20 con 0x7fce300d0820 2023-10-16T13:48:56.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 -- 172.21.15.5:0/3076713434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300d0820 msgr2=0x7fce30168b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 --2- 172.21.15.5:0/3076713434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300d0820 0x7fce30168b40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fce28009d90 tx=0x7fce2800b330 comp rx=0 tx=0).stop 2023-10-16T13:48:56.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 -- 172.21.15.5:0/3076713434 shutdown_connections 2023-10-16T13:48:56.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 --2- 172.21.15.5:0/3076713434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300d0820 0x7fce30168b40 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 -- 172.21.15.5:0/3076713434 >> 172.21.15.5:0/3076713434 conn(0x7fce300d37e0 msgr2=0x7fce300d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 -- 172.21.15.5:0/3076713434 shutdown_connections 2023-10-16T13:48:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.471+0000 7fce359c3700 1 -- 172.21.15.5:0/3076713434 wait complete. 2023-10-16T13:48:56.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.472+0000 7fce359c3700 1 Processor -- start 2023-10-16T13:48:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 -- start start 2023-10-16T13:48:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 0x7fce301561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce300d0820 0x7fce300b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce3015dc90 0x7fce3006c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce301f7860 con 0x7fce300ce6b0 2023-10-16T13:48:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30156730 con 0x7fce3015dc90 2023-10-16T13:48:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.473+0000 7fce359c3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce301f6be0 con 0x7fce300d0820 2023-10-16T13:48:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 0x7fce301561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 0x7fce301561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49666/0 (socket says 172.21.15.5:49666) 2023-10-16T13:48:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 -- 172.21.15.5:0/2336776721 learned_addr learned my addr 172.21.15.5:0/2336776721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:56.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2f7fe700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce3015dc90 0x7fce3006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2e7fc700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce300d0820 0x7fce300b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 -- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce300d0820 msgr2=0x7fce300b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce300d0820 0x7fce300b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 -- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce3015dc90 msgr2=0x7fce3006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce3015dc90 0x7fce3006c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 -- 172.21.15.5:0/2336776721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28009a70 con 0x7fce300ce6b0 2023-10-16T13:48:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2f7fe700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce3015dc90 0x7fce3006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce2effd700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 0x7fce301561f0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c700 tx=0x7fce2400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce240074e0 con 0x7fce300ce6b0 2023-10-16T13:48:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce24007640 con 0x7fce300ce6b0 2023-10-16T13:48:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce301f6ec0 con 0x7fce300ce6b0 2023-10-16T13:48:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24005a30 con 0x7fce300ce6b0 2023-10-16T13:48:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.474+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce301f7480 con 0x7fce300ce6b0 2023-10-16T13:48:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.475+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce301f7610 con 0x7fce300ce6b0 2023-10-16T13:48:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.476+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fce24005b90 con 0x7fce300ce6b0 2023-10-16T13:48:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.476+0000 7fce17fff700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce1c06b2f0 0x7fce1c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.476+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce24089100 con 0x7fce300ce6b0 2023-10-16T13:48:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.476+0000 7fce2e7fc700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce1c06b2f0 0x7fce1c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.477+0000 7fce2e7fc700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce1c06b2f0 0x7fce1c06d7b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fce300a11f0 tx=0x7fce20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.481+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce24053d10 con 0x7fce300ce6b0 2023-10-16T13:48:56.705 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-10-16T13:48:56.703+0000 7ff9ae202700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:48:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.761+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fce300cfd30 con 0x7fce300ce6b0 2023-10-16T13:48:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.763+0000 7fce17fff700 1 -- 172.21.15.5:0/2336776721 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7fce240170b0 con 0x7fce300ce6b0 2023-10-16T13:48:56.766 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:48:56.766 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:48:56.767 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:48:56.767 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:48:56.767 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:48:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce1c06b2f0 msgr2=0x7fce1c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce1c06b2f0 0x7fce1c06d7b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fce300a11f0 tx=0x7fce20008040 comp rx=0 tx=0).stop 2023-10-16T13:48:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 msgr2=0x7fce301561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 0x7fce301561f0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c700 tx=0x7fce2400cac0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 shutdown_connections 2023-10-16T13:48:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce3015dc90 0x7fce3006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce300ce6b0 0x7fce301561f0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fce1c06b2f0 0x7fce1c06d7b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 --2- 172.21.15.5:0/2336776721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce300d0820 0x7fce300b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 >> 172.21.15.5:0/2336776721 conn(0x7fce300d37e0 msgr2=0x7fce3015ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:56.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 shutdown_connections 2023-10-16T13:48:56.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.765+0000 7fce359c3700 1 -- 172.21.15.5:0/2336776721 wait complete. 2023-10-16T13:48:56.771 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:48:56.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:48:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.903+0000 7f4e6f026700 1 Processor -- start 2023-10-16T13:48:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.903+0000 7f4e6f026700 1 -- start start 2023-10-16T13:48:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6f026700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e680cfe30 0x7f4e680cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6f026700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6815e7a0 con 0x7f4e6815f1f0 2023-10-16T13:48:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6f026700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680b29a0 con 0x7f4e6815ab10 2023-10-16T13:48:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6f026700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e680b2c80 con 0x7f4e680cfe30 2023-10-16T13:48:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e680cfe30 0x7f4e680cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e680cfe30 0x7f4e680cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49678/0 (socket says 172.21.15.5:49678) 2023-10-16T13:48:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 -- 172.21.15.5:0/608616238 learned_addr learned my addr 172.21.15.5:0/608616238 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e67fff700 1 --1- 172.21.15.5:0/608616238 >> v1:172.21.15.5:6789/0 conn(0x7f4e6815f1f0 0x7f4e680cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59680/0 (socket says 172.21.15.5:59680) 2023-10-16T13:48:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 -- 172.21.15.5:0/608616238 >> v1:172.21.15.112:6789/0 conn(0x7f4e6815ab10 legacy=0x7f4e680b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 -- 172.21.15.5:0/608616238 >> v1:172.21.15.5:6789/0 conn(0x7f4e6815f1f0 legacy=0x7f4e680cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 -- 172.21.15.5:0/608616238 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6815e9f0 con 0x7f4e680cfe30 2023-10-16T13:48:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e677fe700 1 -- 172.21.15.5:0/608616238 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814608667 0 0) 0x7f4e6815e7a0 con 0x7f4e6815f1f0 2023-10-16T13:48:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e6d5c3700 1 --2- 172.21.15.5:0/608616238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e680cbf40 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000d150 tx=0x7f4e6000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b80b456ef7e5caa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e677fe700 1 -- 172.21.15.5:0/608616238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60010070 con 0x7f4e680cfe30 2023-10-16T13:48:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e677fe700 1 -- 172.21.15.5:0/608616238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6000dd80 con 0x7f4e680cfe30 2023-10-16T13:48:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.904+0000 7f4e677fe700 1 -- 172.21.15.5:0/608616238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000b310 con 0x7f4e680cfe30 2023-10-16T13:48:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 -- 172.21.15.5:0/608616238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 msgr2=0x7f4e680cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 --2- 172.21.15.5:0/608616238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e680cbf40 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000d150 tx=0x7f4e6000d460 comp rx=0 tx=0).stop 2023-10-16T13:48:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 -- 172.21.15.5:0/608616238 shutdown_connections 2023-10-16T13:48:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 --2- 172.21.15.5:0/608616238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e680cbf40 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 -- 172.21.15.5:0/608616238 >> 172.21.15.5:0/608616238 conn(0x7f4e6806dae0 msgr2=0x7f4e6806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 -- 172.21.15.5:0/608616238 shutdown_connections 2023-10-16T13:48:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.905+0000 7f4e6f026700 1 -- 172.21.15.5:0/608616238 wait complete. 2023-10-16T13:48:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.906+0000 7f4e6f026700 1 Processor -- start 2023-10-16T13:48:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.906+0000 7f4e6f026700 1 -- start start 2023-10-16T13:48:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6f026700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e681efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6f026700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6815ab10 0x7f4e681f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6f026700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6815f1f0 0x7f4e680cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6f026700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680c9080 con 0x7f4e680cfe30 2023-10-16T13:48:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6f026700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6815c600 con 0x7f4e6815ab10 2023-10-16T13:48:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6f026700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6815c8e0 con 0x7f4e6815f1f0 2023-10-16T13:48:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6cdc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e681efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6cdc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e681efdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49680/0 (socket says 172.21.15.5:49680) 2023-10-16T13:48:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6cdc2700 1 -- 172.21.15.5:0/654351079 learned_addr learned my addr 172.21.15.5:0/654351079 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e67fff700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6815ab10 0x7f4e681f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.907+0000 7f4e6d5c3700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6815f1f0 0x7f4e680cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6cdc2700 1 -- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6815f1f0 msgr2=0x7f4e680cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6cdc2700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6815f1f0 0x7f4e680cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6cdc2700 1 -- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6815ab10 msgr2=0x7f4e681f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6cdc2700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6815ab10 0x7f4e681f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6cdc2700 1 -- 172.21.15.5:0/654351079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6000bd40 con 0x7f4e680cfe30 2023-10-16T13:48:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e67fff700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6815ab10 0x7f4e681f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6cdc2700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e681efdc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00b4a0 tx=0x7f4e5c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011830 con 0x7f4e680cfe30 2023-10-16T13:48:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c011990 con 0x7f4e680cfe30 2023-10-16T13:48:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6815cbc0 con 0x7f4e680cfe30 2023-10-16T13:48:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011d40 con 0x7f4e680cfe30 2023-10-16T13:48:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.908+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e681f0300 con 0x7f4e680cfe30 2023-10-16T13:48:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.909+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e68074460 con 0x7f4e680cfe30 2023-10-16T13:48:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.909+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f4e5c01a400 con 0x7f4e680cfe30 2023-10-16T13:48:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.910+0000 7f4e657fa700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e4c06b2f0 0x7f4e4c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.910+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c0899e0 con 0x7f4e680cfe30 2023-10-16T13:48:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.910+0000 7f4e67fff700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e4c06b2f0 0x7f4e4c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.911+0000 7f4e67fff700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e4c06b2f0 0x7f4e4c06d7b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007a60 tx=0x7f4e54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:56.915+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e68074460 con 0x7f4e680cfe30 2023-10-16T13:48:57.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.158+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e68074460 con 0x7f4e680cfe30 2023-10-16T13:48:57.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.158+0000 7f4e657fa700 1 -- 172.21.15.5:0/654351079 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f4e68074460 con 0x7f4e680cfe30 2023-10-16T13:48:57.161 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:48:57.162 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2690348630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2690348630},{"type":"v1","addr":"172.21.15.112:6837","nonce":2690348630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3556823542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3556823542},{"type":"v1","addr":"172.21.15.112:6836","nonce":3556823542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:51.129490+0000","modified":"2023-10-16T13:48:54.173911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7713":{"gid":7713,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/618714180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":618714180},{"type":"v1","addr":"172.21.15.5:6835","nonce":618714180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-16T13:48:57.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e4c06b2f0 msgr2=0x7f4e4c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e4c06b2f0 0x7f4e4c06d7b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007a60 tx=0x7f4e54009040 comp rx=0 tx=0).stop 2023-10-16T13:48:57.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 msgr2=0x7f4e681efdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e681efdc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00b4a0 tx=0x7f4e5c00b860 comp rx=0 tx=0).stop 2023-10-16T13:48:57.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 shutdown_connections 2023-10-16T13:48:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4e4c06b2f0 0x7f4e4c06d7b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6815f1f0 0x7f4e680cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cfe30 0x7f4e681efdc0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 --2- 172.21.15.5:0/654351079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6815ab10 0x7f4e681f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 >> 172.21.15.5:0/654351079 conn(0x7f4e6806dae0 msgr2=0x7f4e6806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 shutdown_connections 2023-10-16T13:48:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.161+0000 7f4e6f026700 1 -- 172.21.15.5:0/654351079 wait complete. 2023-10-16T13:48:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 79 2023-10-16T13:48:57.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:48:51.129490+0000', 'modified': '2023-10-16T13:48:54.173911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7713}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7713': {'gid': 7713, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/618714180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 618714180}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 618714180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:48:57.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:48:57.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T13:48:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.707+0000 7f63f0bf9700 1 Processor -- start 2023-10-16T13:48:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.707+0000 7f63f0bf9700 1 -- start start 2023-10-16T13:48:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63f0bf9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63ec15a850 0x7f63ec0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63f0bf9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63ec0cd4b0 0x7f63ec0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63f0bf9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0ce3b0 con 0x7f63ec0b2940 2023-10-16T13:48:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63f0bf9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0b2df0 con 0x7f63ec15a850 2023-10-16T13:48:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63f0bf9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0b6290 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63ea59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63ec15a850 0x7f63ec0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63ea59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63ec15a850 0x7f63ec0cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49688/0 (socket says 172.21.15.5:49688) 2023-10-16T13:48:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.708+0000 7f63ea59c700 1 -- 172.21.15.5:0/3778000049 learned_addr learned my addr 172.21.15.5:0/3778000049 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63ead9d700 1 --2- 172.21.15.5:0/3778000049 >> v2:172.21.15.112:3300/0 conn(0x7f63ec0cd4b0 0x7f63ec0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63ea59c700 1 -- 172.21.15.5:0/3778000049 >> v2:172.21.15.112:3300/0 conn(0x7f63ec0cd4b0 msgr2=0x7f63ec0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63ea59c700 1 --2- 172.21.15.5:0/3778000049 >> v2:172.21.15.112:3300/0 conn(0x7f63ec0cd4b0 0x7f63ec0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63ea59c700 1 -- 172.21.15.5:0/3778000049 >> v1:172.21.15.5:6789/0 conn(0x7f63ec0b2940 legacy=0x7f63ec0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63e959a700 1 -- 172.21.15.5:0/3778000049 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467858234 0 0) 0x7f63ec0ce3b0 con 0x7f63ec0b2940 2023-10-16T13:48:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63ea59c700 1 -- 172.21.15.5:0/3778000049 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0cc220 con 0x7f63ec15a850 2023-10-16T13:48:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63ea59c700 1 --2- 172.21.15.5:0/3778000049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec15a850 0x7f63ec0cbc40 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0afee0 tx=0x7f63e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170d8d14191c5d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63e959a700 1 -- 172.21.15.5:0/3778000049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000b870 con 0x7f63ec15a850 2023-10-16T13:48:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63e959a700 1 -- 172.21.15.5:0/3778000049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000b9d0 con 0x7f63ec15a850 2023-10-16T13:48:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.709+0000 7f63e959a700 1 -- 172.21.15.5:0/3778000049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000bd60 con 0x7f63ec15a850 2023-10-16T13:48:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 -- 172.21.15.5:0/3778000049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec15a850 msgr2=0x7f63ec0cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/3778000049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec15a850 0x7f63ec0cbc40 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0afee0 tx=0x7f63e0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 -- 172.21.15.5:0/3778000049 shutdown_connections 2023-10-16T13:48:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/3778000049 >> v2:172.21.15.112:3300/0 conn(0x7f63ec0cd4b0 0x7f63ec0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/3778000049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec15a850 0x7f63ec0cbc40 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 -- 172.21.15.5:0/3778000049 >> 172.21.15.5:0/3778000049 conn(0x7f63ec06dac0 msgr2=0x7f63ec06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 -- 172.21.15.5:0/3778000049 shutdown_connections 2023-10-16T13:48:57.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.710+0000 7f63f0bf9700 1 -- 172.21.15.5:0/3778000049 wait complete. 2023-10-16T13:48:57.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.711+0000 7f63f0bf9700 1 Processor -- start 2023-10-16T13:48:57.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.711+0000 7f63f0bf9700 1 -- start start 2023-10-16T13:48:57.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63f0bf9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec0b2940 0x7f63ec1f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63f0bf9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 0x7f63ec14dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63f0bf9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63ec15a850 0x7f63ec1f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63f0bf9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1f4150 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63f0bf9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1f3b90 con 0x7f63ec0b2940 2023-10-16T13:48:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63f0bf9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1f3e70 con 0x7f63ec15a850 2023-10-16T13:48:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 0x7f63ec14dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 0x7f63ec14dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49696/0 (socket says 172.21.15.5:49696) 2023-10-16T13:48:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 -- 172.21.15.5:0/2695253116 learned_addr learned my addr 172.21.15.5:0/2695253116 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec0b2940 0x7f63ec1f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63ead9d700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63ec15a850 0x7f63ec1f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 -- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63ec15a850 msgr2=0x7f63ec1f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63ec15a850 0x7f63ec1f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 -- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec0b2940 msgr2=0x7f63ec1f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec0b2940 0x7f63ec1f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63e9d9b700 1 -- 172.21.15.5:0/2695253116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0009550 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.712+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec0b2940 0x7f63ec1f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:48:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.713+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 0x7f63ec14dfe0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00c550 tx=0x7f63dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.713+0000 7f63daffd700 1 -- 172.21.15.5:0/2695253116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0054e0 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.713+0000 7f63daffd700 1 -- 172.21.15.5:0/2695253116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc003680 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.713+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec14d7e0 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.713+0000 7f63daffd700 1 -- 172.21.15.5:0/2695253116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc003a30 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.713+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec14e520 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.714+0000 7f63daffd700 1 -- 172.21.15.5:0/2695253116 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f63dc003b90 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.715+0000 7f63daffd700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63cc06b320 0x7f63cc06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.715+0000 7f63daffd700 1 -- 172.21.15.5:0/2695253116 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63dc089110 con 0x7f63ec0cd4b0 2023-10-16T13:48:57.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.715+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63cc06b320 0x7f63cc06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.715+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63cc06b320 0x7f63cc06d7e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f63e0014040 tx=0x7f63e0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 Processor -- start 2023-10-16T13:48:57.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 -- start start 2023-10-16T13:48:57.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe9117a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9117fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe90eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe9061c20 con 0x55cfe9115630 2023-10-16T13:48:57.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.717+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe9046c10 con 0x55cfe90eb010 2023-10-16T13:48:57.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfe9044530 con 0x55cfe9110220 2023-10-16T13:48:57.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9117fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9117fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49704/0 (socket says 172.21.15.5:49704) 2023-10-16T13:48:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 -- 172.21.15.5:0/347592894 learned_addr learned my addr 172.21.15.5:0/347592894 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63ea59c700 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe9117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63ead9d700 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe90eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 -- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 msgr2=0x55cfe9117a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe9117a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 -- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 msgr2=0x55cfe90eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe90eb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 -- 172.21.15.5:0/347592894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfe8ffd3a0 con 0x55cfe9115630 2023-10-16T13:48:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9117fb0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f63dc05f700 tx=0x7f63dc057290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f5bd1c2ed1589d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63cbfff700 1 -- 172.21.15.5:0/347592894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc058030 con 0x55cfe9115630 2023-10-16T13:48:57.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63cbfff700 1 -- 172.21.15.5:0/347592894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc057930 con 0x55cfe9115630 2023-10-16T13:48:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.718+0000 7f63cbfff700 1 -- 172.21.15.5:0/347592894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc05ba80 con 0x55cfe9115630 2023-10-16T13:48:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 -- 172.21.15.5:0/347592894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 msgr2=0x55cfe9117fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9117fb0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f63dc05f700 tx=0x7f63dc057290 comp rx=0 tx=0).stop 2023-10-16T13:48:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 -- 172.21.15.5:0/347592894 shutdown_connections 2023-10-16T13:48:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe90eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe9117a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/347592894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9117fb0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 -- 172.21.15.5:0/347592894 >> 172.21.15.5:0/347592894 conn(0x55cfe901ad80 msgr2=0x55cfe9135ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 -- 172.21.15.5:0/347592894 shutdown_connections 2023-10-16T13:48:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.719+0000 7f63fcde3b80 1 -- 172.21.15.5:0/347592894 wait complete. 2023-10-16T13:48:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.720+0000 7f63fcde3b80 1 -- start start 2023-10-16T13:48:57.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.720+0000 7f63fcde3b80 1 Processor -- start 2023-10-16T13:48:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9118eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 0x55cfe9111c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9115630 0x55cfe9132420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe903fe20 con 0x55cfe9110220 2023-10-16T13:48:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe8fdc6c0 con 0x55cfe9115630 2023-10-16T13:48:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfe8fdc360 con 0x55cfe90eb010 2023-10-16T13:48:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 10 client.0 _ll_register_callbacks cb 0x55cfe8e397b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:48:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 0x55cfe9111c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 0x55cfe9111c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49710/0 (socket says 172.21.15.5:49710) 2023-10-16T13:48:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 -- 172.21.15.5:0/1949847966 learned_addr learned my addr 172.21.15.5:0/1949847966 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63ea59c700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9118eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63ead9d700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9115630 0x55cfe9132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 -- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 msgr2=0x55cfe9118eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9118eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 -- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9115630 msgr2=0x55cfe9132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9115630 0x55cfe9132420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 -- 172.21.15.5:0/1949847966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec14e520 con 0x55cfe9110220 2023-10-16T13:48:57.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 0x55cfe9111c50 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0578c0 tx=0x7f63dc001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f029501a9142f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:48:57.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63c97fa700 1 -- 172.21.15.5:0/1949847966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc058030 con 0x55cfe9110220 2023-10-16T13:48:57.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfe90e05b0 con 0x55cfe9110220 2023-10-16T13:48:57.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63c97fa700 1 -- 172.21.15.5:0/1949847966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63dc05fc30 con 0x55cfe9110220 2023-10-16T13:48:57.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.721+0000 7f63c97fa700 1 -- 172.21.15.5:0/1949847966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63dc05ba80 con 0x55cfe9110220 2023-10-16T13:48:57.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 10 client.7872 fetch_fsmap learned FSMap version 79 2023-10-16T13:48:57.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55cfe8e6ad90 con 0x55cfe9110220 2023-10-16T13:48:57.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63c97fa700 1 -- 172.21.15.5:0/1949847966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cfe90e05b0 con 0x55cfe9110220 2023-10-16T13:48:57.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63c97fa700 1 -- 172.21.15.5:0/1949847966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f63dc05f7a0 con 0x55cfe9110220 2023-10-16T13:48:57.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 10 client.7872 fetch_fsmap finished waiting for FSMap version 79 2023-10-16T13:48:57.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 10 client.7872 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:48:57.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 20 client.7872 populate_metadata read hostname 'smithi005' 2023-10-16T13:48:57.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe90e1f40 0x55cfe90e2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 4 client.7872 mds_command: new command op to 7713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:48:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 --> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfe9038e00 con 0x55cfe90e1f40 2023-10-16T13:48:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63ea59c700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe90e1f40 0x55cfe90e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63ea59c700 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe90e1f40 0x55cfe90e2320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1a103a35da753 server_cookie=4c42c592b66868ab in_seq=0 out_seq=0 2023-10-16T13:48:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.722+0000 7f63c97fa700 10 client.7872 ms_handle_connect on v2:172.21.15.5:6833/618714180 2023-10-16T13:48:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63c97fa700 1 -- 172.21.15.5:0/1949847966 <== mds.0 v2:172.21.15.5:6833/618714180 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cfe9038e00 con 0x55cfe90e1f40 2023-10-16T13:48:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63c97fa700 10 client.7872 handle_command_reply: tid=0 2023-10-16T13:48:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 client.7872 shutdown 2023-10-16T13:48:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 msgr2=0x55cfe9111c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 0x55cfe9111c50 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0578c0 tx=0x7f63dc001080 comp rx=0 tx=0).stop 2023-10-16T13:48:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 shutdown_connections 2023-10-16T13:48:57.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe90e1f40 0x55cfe90e2320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9115630 0x55cfe9132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9118eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/1949847966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9110220 0x55cfe9111c50 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63c97fa700 0 client.7872 ms_handle_reset on v2:172.21.15.5:6833/618714180 2023-10-16T13:48:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 >> 172.21.15.5:0/1949847966 conn(0x55cfe901ad80 msgr2=0x55cfe9133520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 shutdown_connections 2023-10-16T13:48:57.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 1 -- 172.21.15.5:0/1949847966 wait complete. 2023-10-16T13:48:57.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.723+0000 7f63fcde3b80 20 client.7872 trim_cache size 0 max 16384 2023-10-16T13:48:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.741+0000 7f63fcde3b80 1 Processor -- start 2023-10-16T13:48:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.741+0000 7f63fcde3b80 1 -- start start 2023-10-16T13:48:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe9112070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe91149c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe8ec08d0 con 0x55cfe9115630 2023-10-16T13:48:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe90ef330 con 0x55cfe90eb010 2023-10-16T13:48:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfe90eba70 con 0x55cfe9110220 2023-10-16T13:48:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49720/0 (socket says 172.21.15.5:49720) 2023-10-16T13:48:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 -- 172.21.15.5:0/4062791862 learned_addr learned my addr 172.21.15.5:0/4062791862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ea59c700 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe9112070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe91149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 -- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 msgr2=0x55cfe91149c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe91149c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 -- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 msgr2=0x55cfe9112070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe9112070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 -- 172.21.15.5:0/4062791862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfe90e9b20 con 0x55cfe9115630 2023-10-16T13:48:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ea59c700 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe9112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63ead9d700 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9132080 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f63e40153b0 tx=0x7f63e40153e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f1f69d67263a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63d8ff9700 1 -- 172.21.15.5:0/4062791862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4015df0 con 0x55cfe9115630 2023-10-16T13:48:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63d8ff9700 1 -- 172.21.15.5:0/4062791862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400f040 con 0x55cfe9115630 2023-10-16T13:48:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.742+0000 7f63d8ff9700 1 -- 172.21.15.5:0/4062791862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4021650 con 0x55cfe9115630 2023-10-16T13:48:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 -- 172.21.15.5:0/4062791862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 msgr2=0x55cfe9132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9132080 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f63e40153b0 tx=0x7f63e40153e0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 -- 172.21.15.5:0/4062791862 shutdown_connections 2023-10-16T13:48:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9132080 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe90eb010 0x55cfe9112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/4062791862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe9110220 0x55cfe91149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 -- 172.21.15.5:0/4062791862 >> 172.21.15.5:0/4062791862 conn(0x55cfe901ad80 msgr2=0x55cfe91545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 -- 172.21.15.5:0/4062791862 shutdown_connections 2023-10-16T13:48:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.743+0000 7f63fcde3b80 1 -- 172.21.15.5:0/4062791862 wait complete. 2023-10-16T13:48:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.744+0000 7f63fcde3b80 1 -- start start 2023-10-16T13:48:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.744+0000 7f63fcde3b80 1 Processor -- start 2023-10-16T13:48:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9110220 0x55cfe9114830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9114d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe9131a40 con 0x55cfe9115630 2023-10-16T13:48:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe90eb760 con 0x55cfe9110220 2023-10-16T13:48:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfe90e7a90 con 0x55cfe90eb010 2023-10-16T13:48:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 10 client.0 _ll_register_callbacks cb 0x55cfe8e397b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:48:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9114d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9114d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49726/0 (socket says 172.21.15.5:49726) 2023-10-16T13:48:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 -- 172.21.15.5:0/2984222102 learned_addr learned my addr 172.21.15.5:0/2984222102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63e9d9b700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9110220 0x55cfe9114830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 -- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 msgr2=0x55cfe9144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 -- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9110220 msgr2=0x55cfe9114830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9110220 0x55cfe9114830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 -- 172.21.15.5:0/2984222102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e0021070 con 0x55cfe9115630 2023-10-16T13:48:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63ead9d700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9114d70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f63e401d000 tx=0x7f63e4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad00b2495d732cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:48:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63c97fa700 1 -- 172.21.15.5:0/2984222102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400d040 con 0x55cfe9115630 2023-10-16T13:48:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63c97fa700 1 -- 172.21.15.5:0/2984222102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63e4007000 con 0x55cfe9115630 2023-10-16T13:48:57.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63dc057930 con 0x55cfe9115630 2023-10-16T13:48:57.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63c97fa700 1 -- 172.21.15.5:0/2984222102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63e4009650 con 0x55cfe9115630 2023-10-16T13:48:57.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 10 client.7878 fetch_fsmap learned FSMap version 79 2023-10-16T13:48:57.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.745+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x7f63e4009cf0 con 0x55cfe9115630 2023-10-16T13:48:57.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63c97fa700 1 -- 172.21.15.5:0/2984222102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc057930 con 0x55cfe9115630 2023-10-16T13:48:57.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63c97fa700 1 -- 172.21.15.5:0/2984222102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f63e40219f0 con 0x55cfe9115630 2023-10-16T13:48:57.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 10 client.7878 fetch_fsmap finished waiting for FSMap version 79 2023-10-16T13:48:57.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 10 client.7878 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T13:48:57.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 20 client.7878 populate_metadata read hostname 'smithi005' 2023-10-16T13:48:57.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe912e5b0 0x55cfe912e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 4 client.7878 mds_command: new command op to 7713 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:48:57.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 --> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cfe9038b20 con 0x55cfe912e5b0 2023-10-16T13:48:57.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe912e5b0 0x55cfe912e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63c97fa700 10 client.7878 ms_handle_connect on v2:172.21.15.5:6833/618714180 2023-10-16T13:48:57.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63ea59c700 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe912e5b0 0x55cfe912e990 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bee6657b14a12bf server_cookie=e820437a9bdef126 in_seq=0 out_seq=0 2023-10-16T13:48:57.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63c97fa700 1 -- 172.21.15.5:0/2984222102 <== mds.0 v2:172.21.15.5:6833/618714180 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55cfe9038b20 con 0x55cfe912e5b0 2023-10-16T13:48:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63c97fa700 10 client.7878 handle_command_reply: tid=0 2023-10-16T13:48:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.746+0000 7f63fcde3b80 1 client.7878 shutdown 2023-10-16T13:48:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 msgr2=0x55cfe9114d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9114d70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f63e401d000 tx=0x7f63e4004b40 comp rx=0 tx=0).stop 2023-10-16T13:48:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 shutdown_connections 2023-10-16T13:48:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:6833/618714180,v1:172.21.15.5:6835/618714180] conn(0x55cfe912e5b0 0x55cfe912e990 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfe9115630 0x55cfe9114d70 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55cfe90eb010 0x55cfe9144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63c97fa700 0 client.7878 ms_handle_reset on v2:172.21.15.5:6833/618714180 2023-10-16T13:48:57.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 --2- 172.21.15.5:0/2984222102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cfe9110220 0x55cfe9114830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 >> 172.21.15.5:0/2984222102 conn(0x55cfe901ad80 msgr2=0x55cfe90e2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 shutdown_connections 2023-10-16T13:48:57.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 1 -- 172.21.15.5:0/2984222102 wait complete. 2023-10-16T13:48:57.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63fcde3b80 20 client.7878 trim_cache size 0 max 16384 2023-10-16T13:48:57.767 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:48:57.768 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:48:57.768 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:48:57.768 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7713, 2023-10-16T13:48:57.768 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:48:57.768 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:48:57.769 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:48:57.769 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.006200421, 2023-10-16T13:48:57.769 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 79, 2023-10-16T13:48:57.769 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 110, 2023-10-16T13:48:57.769 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 110, 2023-10-16T13:48:57.770 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 11.937083944999999 2023-10-16T13:48:57.770 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:48:57.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63cc06b320 msgr2=0x7f63cc06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63cc06b320 0x7f63cc06d7e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f63e0014040 tx=0x7f63e0008030 comp rx=0 tx=0).stop 2023-10-16T13:48:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 msgr2=0x7f63ec14dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 0x7f63ec14dfe0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00c550 tx=0x7f63dc00c910 comp rx=0 tx=0).stop 2023-10-16T13:48:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 shutdown_connections 2023-10-16T13:48:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63cc06b320 0x7f63cc06d7e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63ec15a850 0x7f63ec1f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec0b2940 0x7f63ec1f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.747+0000 7f63f0bf9700 1 --2- 172.21.15.5:0/2695253116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63ec0cd4b0 0x7f63ec14dfe0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.748+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 >> 172.21.15.5:0/2695253116 conn(0x7f63ec06dac0 msgr2=0x7f63ec0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.748+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 shutdown_connections 2023-10-16T13:48:57.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.748+0000 7f63f0bf9700 1 -- 172.21.15.5:0/2695253116 wait complete. 2023-10-16T13:48:57.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:48:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.896+0000 7f01cc93d700 1 Processor -- start 2023-10-16T13:48:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.896+0000 7f01cc93d700 1 -- start start 2023-10-16T13:48:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01cc93d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01c806a840 0x7f01c80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01cc93d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c806adb0 con 0x7f01c815e030 2023-10-16T13:48:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01cc93d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c806b090 con 0x7f01c806be50 2023-10-16T13:48:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01cc93d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c80cbab0 con 0x7f01c806a840 2023-10-16T13:48:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01c806a840 0x7f01c80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01c806a840 0x7f01c80cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49732/0 (socket says 172.21.15.5:49732) 2023-10-16T13:48:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01c815e030 0x7f01c80cb3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59734/0 (socket says 172.21.15.5:59734) 2023-10-16T13:48:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 -- 172.21.15.5:0/2258538694 learned_addr learned my addr 172.21.15.5:0/2258538694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 -- 172.21.15.5:0/2258538694 >> v1:172.21.15.112:6789/0 conn(0x7f01c806be50 legacy=0x7f01c806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 -- 172.21.15.5:0/2258538694 >> v1:172.21.15.5:6789/0 conn(0x7f01c815e030 legacy=0x7f01c80cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 -- 172.21.15.5:0/2258538694 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c806b370 con 0x7f01c806a840 2023-10-16T13:48:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c559a700 1 -- 172.21.15.5:0/2258538694 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496210073 0 0) 0x7f01c806adb0 con 0x7f01c815e030 2023-10-16T13:48:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.897+0000 7f01c5d9b700 1 --2- 172.21.15.5:0/2258538694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c80cdb70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0098f0 tx=0x7f01bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc10c50471ad0ee6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01c559a700 1 -- 172.21.15.5:0/2258538694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc004230 con 0x7f01c806a840 2023-10-16T13:48:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01c559a700 1 -- 172.21.15.5:0/2258538694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc004390 con 0x7f01c806a840 2023-10-16T13:48:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01c559a700 1 -- 172.21.15.5:0/2258538694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0036a0 con 0x7f01c806a840 2023-10-16T13:48:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 -- 172.21.15.5:0/2258538694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 msgr2=0x7f01c80cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 --2- 172.21.15.5:0/2258538694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c80cdb70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0098f0 tx=0x7f01bc009c00 comp rx=0 tx=0).stop 2023-10-16T13:48:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 -- 172.21.15.5:0/2258538694 shutdown_connections 2023-10-16T13:48:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 --2- 172.21.15.5:0/2258538694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c80cdb70 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 -- 172.21.15.5:0/2258538694 >> 172.21.15.5:0/2258538694 conn(0x7f01c80cc6f0 msgr2=0x7f01c80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 -- 172.21.15.5:0/2258538694 shutdown_connections 2023-10-16T13:48:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.898+0000 7f01cc93d700 1 -- 172.21.15.5:0/2258538694 wait complete. 2023-10-16T13:48:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 Processor -- start 2023-10-16T13:48:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 -- start start 2023-10-16T13:48:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c806be50 0x7f01c80c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c815e030 0x7f01c8160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81612f0 con 0x7f01c806a840 2023-10-16T13:48:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c814e880 con 0x7f01c806be50 2023-10-16T13:48:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01cc93d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80c6390 con 0x7f01c815e030 2023-10-16T13:48:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01c659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.900+0000 7f01c659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c815a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49736/0 (socket says 172.21.15.5:49736) 2023-10-16T13:48:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 -- 172.21.15.5:0/650695269 learned_addr learned my addr 172.21.15.5:0/650695269 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c5d9b700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c806be50 0x7f01c80c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c6d9d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c815e030 0x7f01c8160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 -- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c815e030 msgr2=0x7f01c8160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c815e030 0x7f01c8160db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 -- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c806be50 msgr2=0x7f01c80c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c806be50 0x7f01c80c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 -- 172.21.15.5:0/650695269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc009550 con 0x7f01c806a840 2023-10-16T13:48:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c5d9b700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c806be50 0x7f01c80c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:48:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01c659c700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c815a130 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c550 tx=0x7f01b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8004c80 con 0x7f01c806a840 2023-10-16T13:48:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8004e00 con 0x7f01c806a840 2023-10-16T13:48:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c81590b0 con 0x7f01c806a840 2023-10-16T13:48:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8007310 con 0x7f01c806a840 2023-10-16T13:48:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.901+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8159670 con 0x7f01c806a840 2023-10-16T13:48:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.902+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c8066a30 con 0x7f01c806a840 2023-10-16T13:48:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.903+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f01b8007470 con 0x7f01c806a840 2023-10-16T13:48:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.903+0000 7f01b6ffd700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01a806b2f0 0x7f01a806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.903+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01b8089930 con 0x7f01c806a840 2023-10-16T13:48:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.903+0000 7f01c5d9b700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01a806b2f0 0x7f01a806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.904+0000 7f01c5d9b700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01a806b2f0 0x7f01a806d7b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009c40 tx=0x7f01bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:57.908+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01b8054510 con 0x7f01c806a840 2023-10-16T13:48:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.159+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f01c806ed80 con 0x7f01c806a840 2023-10-16T13:48:58.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.160+0000 7f01b6ffd700 1 -- 172.21.15.5:0/650695269 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7f01b8057b30 con 0x7f01c806a840 2023-10-16T13:48:58.163 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:48:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01a806b2f0 msgr2=0x7f01a806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01a806b2f0 0x7f01a806d7b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009c40 tx=0x7f01bc008030 comp rx=0 tx=0).stop 2023-10-16T13:48:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 msgr2=0x7f01c815a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c815a130 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c550 tx=0x7f01b800c910 comp rx=0 tx=0).stop 2023-10-16T13:48:58.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 shutdown_connections 2023-10-16T13:48:58.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01a806b2f0 0x7f01a806d7b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:58.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c815e030 0x7f01c8160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:58.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c806a840 0x7f01c815a130 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:58.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 --2- 172.21.15.5:0/650695269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c806be50 0x7f01c80c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 >> 172.21.15.5:0/650695269 conn(0x7f01c80cc6f0 msgr2=0x7f01c80cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 shutdown_connections 2023-10-16T13:48:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:58.162+0000 7f01cc93d700 1 -- 172.21.15.5:0/650695269 wait complete. 2023-10-16T13:48:58.177 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:48:58.177 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:48:58.177 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:48:58.178 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:48:58.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:58.178 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:48:58.179 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:48:58.179 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:48:58.179 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:48:58.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.180 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:48:58.198 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:48:58.198 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:48:58.199 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:48:58.199 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.199 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:48:58.199 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.199 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:58.200 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:58.200 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:58.200 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:58.200 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:48:58.200 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:58.200 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:48:58.201 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41764sec preferred_lft 41764sec 2023-10-16T13:48:58.201 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:48:58.201 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.201 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:58.201 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:58.202 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:48:58.202 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:58.202 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:48:58.202 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.202 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:48:58.203 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.203 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:58.203 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:48:58.203 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:48:58.203 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.204 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:58.204 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:48:58.204 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:48:58.204 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:58.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.205 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:48:58.264 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:48:58.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.266 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:48:58.325 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:48:58.325 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:48:58.325 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:48:58.325 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:48:58.325 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:48:58.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.326 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:48:58.327 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:48:58.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:48:58.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:48:58.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:48:58.328 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:48:58.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.431 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:48:58.448 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:48:58.448 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:48:58.449 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:48:58.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:48:58.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:58.516 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:58.574 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:48:58.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:58.574 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:58.630 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:48:58.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:58.717 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:58.718 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:58.748 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:58.748 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:58.748 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:58.749 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:58.749 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:58.749 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:58.749 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:58.749 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:48:58.779 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:58.779 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:58.779 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:58.779 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:58.780 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:58.780 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:58.780 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:58.780 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:48:58.780 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:48:58.781 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:48:58.781 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:48:58.785 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:48:58.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:48:58.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:58.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:48:58.908 INFO:teuthology.orchestra.run.smithi005.stdout:client7890 2023-10-16T13:48:58.908 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:48:58.909 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:48:58.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:48:59.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:48:59.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:48:59.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.127+0000 7f8098740700 1 Processor -- start 2023-10-16T13:48:59.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.127+0000 7f8098740700 1 -- start start 2023-10-16T13:48:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.128+0000 7f8098740700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f809015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.128+0000 7f8098740700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80900b5c70 con 0x7f809006e750 2023-10-16T13:48:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.128+0000 7f8098740700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80900b5990 con 0x7f80900b54f0 2023-10-16T13:48:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.128+0000 7f8098740700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809015b2b0 con 0x7f809006eb30 2023-10-16T13:48:59.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.128+0000 7f80964dc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f809006e750 0x7f80900ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59752/0 (socket says 172.21.15.5:59752) 2023-10-16T13:48:59.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.128+0000 7f80964dc700 1 -- 172.21.15.5:0/2949168198 learned_addr learned my addr 172.21.15.5:0/2949168198 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:48:59.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f8095cdb700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f809015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484606120 0 0) 0x7f80900b5c70 con 0x7f809006e750 2023-10-16T13:48:59.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f807c0057c0 con 0x7f809006e750 2023-10-16T13:48:59.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327547295 0 0) 0x7f80900b5990 con 0x7f80900b54f0 2023-10-16T13:48:59.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80900b5c70 con 0x7f80900b54f0 2023-10-16T13:48:59.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 358329830 0 0) 0x7f807c0057c0 con 0x7f809006e750 2023-10-16T13:48:59.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 msgr2=0x7f809015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:59.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f809015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 >> v1:172.21.15.112:6789/0 conn(0x7f80900b54f0 legacy=0x7f809015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809015b590 con 0x7f809006e750 2023-10-16T13:48:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f808c001670 con 0x7f809006e750 2023-10-16T13:48:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f8095cdb700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f809015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:48:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 >> v1:172.21.15.5:6789/0 conn(0x7f809006e750 legacy=0x7f80900ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f807c0061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f807c006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f807c006fa0 0x7f807c007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809015b2b0 con 0x7f807c005dd0 2023-10-16T13:48:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c00dcd0 con 0x7f807c006fa0 2023-10-16T13:48:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c00de40 con 0x7f809006eb30 2023-10-16T13:48:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f80964dc700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f807c0061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f8095cdb700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f807c006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.129+0000 7f8096cdd700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f807c006fa0 0x7f807c007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80964dc700 1 -- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 msgr2=0x7f807c006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80964dc700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f809006eb30 0x7f807c006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80964dc700 1 -- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f807c006fa0 msgr2=0x7f807c007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:48:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80964dc700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f807c006fa0 0x7f807c007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80964dc700 1 -- 172.21.15.5:0/2949168198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800094a0 con 0x7f807c005dd0 2023-10-16T13:48:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80964dc700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f807c0061d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c210 tx=0x7f807c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d491d5421320ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00cd50 con 0x7f807c005dd0 2023-10-16T13:48:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c001af0 con 0x7f807c005dd0 2023-10-16T13:48:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.130+0000 7f80954da700 1 -- 172.21.15.5:0/2949168198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c005ba0 con 0x7f807c005dd0 2023-10-16T13:48:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8098740700 1 -- 172.21.15.5:0/2949168198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 msgr2=0x7f807c0061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8098740700 1 --2- 172.21.15.5:0/2949168198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f807c0061d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c210 tx=0x7f807c007a90 comp rx=0 tx=0).stop 2023-10-16T13:48:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8096cdd700 1 -- 172.21.15.5:0/2949168198 reap_dead start 2023-10-16T13:48:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8098740700 1 -- 172.21.15.5:0/2949168198 shutdown_connections 2023-10-16T13:48:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8098740700 1 -- 172.21.15.5:0/2949168198 >> 172.21.15.5:0/2949168198 conn(0x7f80900cc6f0 msgr2=0x7f80900ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8098740700 1 -- 172.21.15.5:0/2949168198 shutdown_connections 2023-10-16T13:48:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.131+0000 7f8098740700 1 -- 172.21.15.5:0/2949168198 wait complete. 2023-10-16T13:48:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.132+0000 7f8098740700 1 Processor -- start 2023-10-16T13:48:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.132+0000 7f8098740700 1 -- start start 2023-10-16T13:48:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8098740700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f80900c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8098740700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80900c7a70 0x7f80900b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8098740700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f809015bbe0 0x7f80900b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8098740700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80900c8a70 con 0x7f807c005dd0 2023-10-16T13:48:59.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8098740700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80901427d0 con 0x7f809015bbe0 2023-10-16T13:48:59.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8098740700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8090142ab0 con 0x7f80900c7a70 2023-10-16T13:48:59.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f80900c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f80900c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49760/0 (socket says 172.21.15.5:49760) 2023-10-16T13:48:59.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 -- 172.21.15.5:0/312409492 learned_addr learned my addr 172.21.15.5:0/312409492 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:48:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8095cdb700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80900c7a70 0x7f80900b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f8096cdd700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f809015bbe0 0x7f80900b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 -- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80900c7a70 msgr2=0x7f80900b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80900c7a70 0x7f80900b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 -- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f809015bbe0 msgr2=0x7f80900b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f809015bbe0 0x7f80900b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 -- 172.21.15.5:0/312409492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090142d90 con 0x7f807c005dd0 2023-10-16T13:48:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.133+0000 7f80964dc700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f80900c7530 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f807c006980 tx=0x7f808c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.134+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0072d0 con 0x7f807c005dd0 2023-10-16T13:48:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.134+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c007430 con 0x7f807c005dd0 2023-10-16T13:48:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.134+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0077c0 con 0x7f807c005dd0 2023-10-16T13:48:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.134+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8090143070 con 0x7f807c005dd0 2023-10-16T13:48:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.134+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80900c8070 con 0x7f807c005dd0 2023-10-16T13:48:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.135+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80901433e0 con 0x7f807c005dd0 2023-10-16T13:48:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.135+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f808c01e430 con 0x7f807c005dd0 2023-10-16T13:48:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.136+0000 7f8086ffd700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f807406b2f0 0x7f807406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:48:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.136+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f808c08ac00 con 0x7f807c005dd0 2023-10-16T13:48:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.136+0000 7f8095cdb700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f807406b2f0 0x7f807406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:48:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.137+0000 7f8095cdb700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f807406b2f0 0x7f807406d7b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f80900cfba0 tx=0x7f8080009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:48:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.141+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f808c055810 con 0x7f807c005dd0 2023-10-16T13:48:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.387+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f809006b950 con 0x7f807c005dd0 2023-10-16T13:48:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.387+0000 7f8086ffd700 1 -- 172.21.15.5:0/312409492 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7f808c017060 con 0x7f807c005dd0 2023-10-16T13:48:59.391 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:48:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.389+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f807406b2f0 msgr2=0x7f807406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.389+0000 7f8098740700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f807406b2f0 0x7f807406d7b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f80900cfba0 tx=0x7f8080009210 comp rx=0 tx=0).stop 2023-10-16T13:48:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.389+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 msgr2=0x7f80900c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:48:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.389+0000 7f8098740700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f80900c7530 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f807c006980 tx=0x7f808c001980 comp rx=0 tx=0).stop 2023-10-16T13:48:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.389+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 shutdown_connections 2023-10-16T13:48:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.389+0000 7f8098740700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f809015bbe0 0x7f80900b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.390+0000 7f8098740700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c005dd0 0x7f80900c7530 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.390+0000 7f8098740700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f807406b2f0 0x7f807406d7b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.390+0000 7f8098740700 1 --2- 172.21.15.5:0/312409492 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80900c7a70 0x7f80900b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:48:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.390+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 >> 172.21.15.5:0/312409492 conn(0x7f80900cc6f0 msgr2=0x7f809006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:48:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.390+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 shutdown_connections 2023-10-16T13:48:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:48:59.390+0000 7f8098740700 1 -- 172.21.15.5:0/312409492 wait complete. 2023-10-16T13:48:59.404 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:48:59.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:48:59.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:48:59.406 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:48:59.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:59.406 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:48:59.407 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:48:59.407 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:48:59.407 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:48:59.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.408 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:48:59.430 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:48:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:48:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:48:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:48:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.431 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:59.432 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:59.432 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:48:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:59.432 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:48:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:48:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 41778sec preferred_lft 41778sec 2023-10-16T13:48:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:48:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.433 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:48:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:48:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:48:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:48:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.435 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:48:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:48:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.435 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:48:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:48:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:48:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:48:59.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.437 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:48:59.500 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:48:59.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.502 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:48:59.564 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:48:59.564 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:48:59.564 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:48:59.564 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:48:59.565 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:48:59.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.566 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:48:59.566 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:48:59.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:48:59.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:48:59.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:48:59.568 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:48:59.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.676 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:48:59.693 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:48:59.693 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:48:59.694 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:48:59.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.694 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:48:59.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:59.760 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:59.816 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:48:59.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:48:59.817 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:48:59.872 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:48:59.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:48:59.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:59.957 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:59.957 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:59.983 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:48:59.984 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:48:59.984 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:48:59.984 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:48:59.984 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:48:59.984 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:48:59.984 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:48:59.985 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:49:00.015 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:49:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:49:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:49:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:49:00.017 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:49:00.017 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:49:00.017 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:49:00.017 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:49:00.017 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:49:00.019 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:49:00.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:00.019 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:00.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:00.054 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:49:00.126 INFO:teuthology.orchestra.run.smithi112.stdout:client6539 2023-10-16T13:49:00.127 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:00.127 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:00.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:49:00.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.324+0000 7efd0384e700 1 Processor -- start 2023-10-16T13:49:00.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.325+0000 7efd0384e700 1 -- start start 2023-10-16T13:49:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.325+0000 7efd0384e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc162070 0x7efcfc0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.325+0000 7efd0384e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcfc0cd870 0x7efcfc0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.325+0000 7efd0384e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc0cee20 con 0x7efcfc15d840 2023-10-16T13:49:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.325+0000 7efd0384e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcfc0cdd20 con 0x7efcfc0cd870 2023-10-16T13:49:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.325+0000 7efd0384e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0b2ce0 con 0x7efcfc162070 2023-10-16T13:49:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd01deb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcfc0cd870 0x7efcfc0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd015ea700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efcfc15d840 0x7efcfc0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59772/0 (socket says 172.21.15.5:59772) 2023-10-16T13:49:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd015ea700 1 -- 172.21.15.5:0/946071839 learned_addr learned my addr 172.21.15.5:0/946071839 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd00de9700 1 --2- 172.21.15.5:0/946071839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc162070 0x7efcfc0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd01deb700 1 -- 172.21.15.5:0/946071839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc162070 msgr2=0x7efcfc0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd01deb700 1 --2- 172.21.15.5:0/946071839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc162070 0x7efcfc0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd01deb700 1 -- 172.21.15.5:0/946071839 >> v1:172.21.15.5:6789/0 conn(0x7efcfc15d840 legacy=0x7efcfc0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd01deb700 1 -- 172.21.15.5:0/946071839 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0ceb40 con 0x7efcfc0cd870 2023-10-16T13:49:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efcf3fff700 1 -- 172.21.15.5:0/946071839 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035643659 0 0) 0x7efcfc0cee20 con 0x7efcfc15d840 2023-10-16T13:49:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efd01deb700 1 --2- 172.21.15.5:0/946071839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc0cd870 0x7efcfc0caa50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009d90 tx=0x7efcf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2772f6a73b9a67a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efcf3fff700 1 -- 172.21.15.5:0/946071839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400e070 con 0x7efcfc0cd870 2023-10-16T13:49:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efcf3fff700 1 -- 172.21.15.5:0/946071839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400bbd0 con 0x7efcfc0cd870 2023-10-16T13:49:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.326+0000 7efcf3fff700 1 -- 172.21.15.5:0/946071839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4012430 con 0x7efcfc0cd870 2023-10-16T13:49:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 -- 172.21.15.5:0/946071839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc0cd870 msgr2=0x7efcfc0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 --2- 172.21.15.5:0/946071839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc0cd870 0x7efcfc0caa50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009d90 tx=0x7efcf400b330 comp rx=0 tx=0).stop 2023-10-16T13:49:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 -- 172.21.15.5:0/946071839 shutdown_connections 2023-10-16T13:49:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 --2- 172.21.15.5:0/946071839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc0cd870 0x7efcfc0caa50 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 --2- 172.21.15.5:0/946071839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc162070 0x7efcfc0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 -- 172.21.15.5:0/946071839 >> 172.21.15.5:0/946071839 conn(0x7efcfc06bd70 msgr2=0x7efcfc06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 -- 172.21.15.5:0/946071839 shutdown_connections 2023-10-16T13:49:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.327+0000 7efd0384e700 1 -- 172.21.15.5:0/946071839 wait complete. 2023-10-16T13:49:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.328+0000 7efd0384e700 1 Processor -- start 2023-10-16T13:49:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.328+0000 7efd0384e700 1 -- start start 2023-10-16T13:49:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd0384e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc0cd870 0x7efcfc1f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd0384e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc15d840 0x7efcfc0caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd0384e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 0x7efcfc0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd0384e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc1f73b0 con 0x7efcfc162070 2023-10-16T13:49:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd0384e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc1f64e0 con 0x7efcfc15d840 2023-10-16T13:49:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd0384e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc1f43e0 con 0x7efcfc0cd870 2023-10-16T13:49:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd01deb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 0x7efcfc0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd01deb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 0x7efcfc0cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49776/0 (socket says 172.21.15.5:49776) 2023-10-16T13:49:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd01deb700 1 -- 172.21.15.5:0/845344808 learned_addr learned my addr 172.21.15.5:0/845344808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd015ea700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc0cd870 0x7efcfc1f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.329+0000 7efd00de9700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc15d840 0x7efcfc0caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd01deb700 1 -- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc0cd870 msgr2=0x7efcfc1f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd01deb700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc0cd870 0x7efcfc1f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd01deb700 1 -- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc15d840 msgr2=0x7efcfc0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd01deb700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc15d840 0x7efcfc0caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd01deb700 1 -- 172.21.15.5:0/845344808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4009a70 con 0x7efcfc162070 2023-10-16T13:49:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd015ea700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc0cd870 0x7efcfc1f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd01deb700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 0x7efcfc0cb000 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efcf4014040 tx=0x7efcf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4012430 con 0x7efcfc162070 2023-10-16T13:49:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf4020070 con 0x7efcfc162070 2023-10-16T13:49:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc1f6730 con 0x7efcfc162070 2023-10-16T13:49:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4004280 con 0x7efcfc162070 2023-10-16T13:49:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.330+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc1f6cf0 con 0x7efcfc162070 2023-10-16T13:49:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.331+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc067d20 con 0x7efcfc162070 2023-10-16T13:49:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.332+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7efcf40043e0 con 0x7efcfc162070 2023-10-16T13:49:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.332+0000 7efcf1ffb700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efce006b2f0 0x7efce006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.332+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcf4022070 con 0x7efcfc162070 2023-10-16T13:49:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.332+0000 7efd015ea700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efce006b2f0 0x7efce006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.333+0000 7efd015ea700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efce006b2f0 0x7efce006d7b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efcec000f60 tx=0x7efcec007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.337+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcf40568f0 con 0x7efcfc162070 2023-10-16T13:49:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.587+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efcfc0b20c0 con 0x7efcfc162070 2023-10-16T13:49:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.787+0000 7efcf1ffb700 1 -- 172.21.15.5:0/845344808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 136+0+0 (secure 0 0 0) 0x7efcf4059f10 con 0x7efcfc162070 2023-10-16T13:49:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efce006b2f0 msgr2=0x7efce006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efce006b2f0 0x7efce006d7b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efcec000f60 tx=0x7efcec007ca0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 msgr2=0x7efcfc0cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 0x7efcfc0cb000 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efcf4014040 tx=0x7efcf4004ad0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 shutdown_connections 2023-10-16T13:49:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcfc162070 0x7efcfc0cb000 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efce006b2f0 0x7efce006d7b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcfc0cd870 0x7efcfc1f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 --2- 172.21.15.5:0/845344808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc15d840 0x7efcfc0caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 >> 172.21.15.5:0/845344808 conn(0x7efcfc06bd70 msgr2=0x7efcfc15c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 shutdown_connections 2023-10-16T13:49:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.789+0000 7efd0384e700 1 -- 172.21.15.5:0/845344808 wait complete. 2023-10-16T13:49:00.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:49:00.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.929+0000 7f63e0a98700 1 Processor -- start 2023-10-16T13:49:00.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.929+0000 7f63e0a98700 1 -- start start 2023-10-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63e0a98700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63dc0cc3f0 0x7f63dc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63e0a98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc161670 0x7f63dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63e0a98700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63dc0ccd10 0x7f63dc06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63e0a98700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc071ab0 con 0x7f63dc0cc3f0 2023-10-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63e0a98700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc161bc0 con 0x7f63dc0ccd10 2023-10-16T13:49:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63e0a98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc161ea0 con 0x7f63dc161670 2023-10-16T13:49:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63dc0cc3f0 0x7f63dc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63dc0cc3f0 0x7f63dc0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49782/0 (socket says 172.21.15.5:49782) 2023-10-16T13:49:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 -- 172.21.15.5:0/3056644654 learned_addr learned my addr 172.21.15.5:0/3056644654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:00.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63dad9d700 1 --2- 172.21.15.5:0/3056644654 >> v2:172.21.15.112:3300/0 conn(0x7f63dc0ccd10 0x7f63dc06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63d9d9b700 1 --2- 172.21.15.5:0/3056644654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc161670 0x7f63dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 -- 172.21.15.5:0/3056644654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc161670 msgr2=0x7f63dc06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 --2- 172.21.15.5:0/3056644654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc161670 0x7f63dc06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 -- 172.21.15.5:0/3056644654 >> v2:172.21.15.112:3300/0 conn(0x7f63dc0ccd10 msgr2=0x7f63dc06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 --2- 172.21.15.5:0/3056644654 >> v2:172.21.15.112:3300/0 conn(0x7f63dc0ccd10 0x7f63dc06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.930+0000 7f63da59c700 1 -- 172.21.15.5:0/3056644654 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc162180 con 0x7f63dc0cc3f0 2023-10-16T13:49:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63da59c700 1 --2- 172.21.15.5:0/3056644654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cc3f0 0x7f63dc0cc7d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0c7480 tx=0x7f63d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce32ecc5aa0fb8e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63d959a700 1 -- 172.21.15.5:0/3056644654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000b870 con 0x7f63dc0cc3f0 2023-10-16T13:49:00.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63d959a700 1 -- 172.21.15.5:0/3056644654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000b9d0 con 0x7f63dc0cc3f0 2023-10-16T13:49:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63d959a700 1 -- 172.21.15.5:0/3056644654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000bd60 con 0x7f63dc0cc3f0 2023-10-16T13:49:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 -- 172.21.15.5:0/3056644654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cc3f0 msgr2=0x7f63dc0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 --2- 172.21.15.5:0/3056644654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cc3f0 0x7f63dc0cc7d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0c7480 tx=0x7f63d0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 -- 172.21.15.5:0/3056644654 shutdown_connections 2023-10-16T13:49:00.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 --2- 172.21.15.5:0/3056644654 >> v2:172.21.15.112:3300/0 conn(0x7f63dc0ccd10 0x7f63dc06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 --2- 172.21.15.5:0/3056644654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cc3f0 0x7f63dc0cc7d0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 --2- 172.21.15.5:0/3056644654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc161670 0x7f63dc06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 -- 172.21.15.5:0/3056644654 >> 172.21.15.5:0/3056644654 conn(0x7f63dc06dac0 msgr2=0x7f63dc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 -- 172.21.15.5:0/3056644654 shutdown_connections 2023-10-16T13:49:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.931+0000 7f63e0a98700 1 -- 172.21.15.5:0/3056644654 wait complete. 2023-10-16T13:49:00.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.933+0000 7f63e0a98700 1 Processor -- start 2023-10-16T13:49:00.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.933+0000 7f63e0a98700 1 -- start start 2023-10-16T13:49:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc0cc3f0 0x7f63dc1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc0ccd10 0x7f63dc0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 0x7f63dc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0b4a40 con 0x7f63dc161670 2023-10-16T13:49:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0b4840 con 0x7f63dc0ccd10 2023-10-16T13:49:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc1f37e0 con 0x7f63dc0cc3f0 2023-10-16T13:49:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 0x7f63dc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63da59c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc0cc3f0 0x7f63dc1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 0x7f63dc0c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49792/0 (socket says 172.21.15.5:49792) 2023-10-16T13:49:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 -- 172.21.15.5:0/92172895 learned_addr learned my addr 172.21.15.5:0/92172895 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63d9d9b700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc0ccd10 0x7f63dc0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 -- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc0cc3f0 msgr2=0x7f63dc1f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc0cc3f0 0x7f63dc1f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 -- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc0ccd10 msgr2=0x7f63dc0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:00.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc0ccd10 0x7f63dc0c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 -- 172.21.15.5:0/92172895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009550 con 0x7f63dc161670 2023-10-16T13:49:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63dad9d700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 0x7f63dc0c65f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f63d4007d10 tx=0x7f63d400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400ed30 con 0x7f63dc161670 2023-10-16T13:49:00.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d400ee90 con 0x7f63dc161670 2023-10-16T13:49:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc1f3ac0 con 0x7f63dc161670 2023-10-16T13:49:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.934+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4014660 con 0x7f63dc161670 2023-10-16T13:49:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.935+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc1f4080 con 0x7f63dc161670 2023-10-16T13:49:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.935+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc0b4b80 con 0x7f63dc161670 2023-10-16T13:49:00.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.936+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f63d40147c0 con 0x7f63dc161670 2023-10-16T13:49:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.936+0000 7f63caffd700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63bc06b2f0 0x7f63bc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.937+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63d408a1f0 con 0x7f63dc161670 2023-10-16T13:49:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.937+0000 7f63da59c700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63bc06b2f0 0x7f63bc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.937+0000 7f63da59c700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63bc06b2f0 0x7f63bc06d7b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f63d0014040 tx=0x7f63d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:00.941+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63dc0b4b80 con 0x7f63dc161670 2023-10-16T13:49:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.170+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f63dc162460 con 0x7f63bc06b2f0 2023-10-16T13:49:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.173+0000 7f63caffd700 1 -- 172.21.15.5:0/92172895 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f63d000bb40 con 0x7f63bc06b2f0 2023-10-16T13:49:01.175 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:49:01.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:01.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:49:01.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:01.176 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:49:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63bc06b2f0 msgr2=0x7f63bc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63bc06b2f0 0x7f63bc06d7b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f63d0014040 tx=0x7f63d0008030 comp rx=0 tx=0).stop 2023-10-16T13:49:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 msgr2=0x7f63dc0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 0x7f63dc0c65f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f63d4007d10 tx=0x7f63d400e3c0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 shutdown_connections 2023-10-16T13:49:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc161670 0x7f63dc0c65f0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f63bc06b2f0 0x7f63bc06d7b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63dc0cc3f0 0x7f63dc1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 --2- 172.21.15.5:0/92172895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63dc0ccd10 0x7f63dc0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 >> 172.21.15.5:0/92172895 conn(0x7f63dc06dac0 msgr2=0x7f63dc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 shutdown_connections 2023-10-16T13:49:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.175+0000 7f63e0a98700 1 -- 172.21.15.5:0/92172895 wait complete. 2023-10-16T13:49:01.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:49:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.315+0000 7f6f48626700 1 Processor -- start 2023-10-16T13:49:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.315+0000 7f6f48626700 1 -- start start 2023-10-16T13:49:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f48626700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f4015f1f0 0x7f6f400cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f48626700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4015e7a0 con 0x7f6f400cfc60 2023-10-16T13:49:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f48626700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f400d0090 con 0x7f6f4015ab10 2023-10-16T13:49:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f48626700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f400b29a0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f45bc1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f4015f1f0 0x7f6f400cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f46bc3700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f400cfc60 0x7f6f400cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59804/0 (socket says 172.21.15.5:59804) 2023-10-16T13:49:01.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f46bc3700 1 -- 172.21.15.5:0/969904958 learned_addr learned my addr 172.21.15.5:0/969904958 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:01.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.316+0000 7f6f45bc1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f4015f1f0 0x7f6f400cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49798/0 (socket says 172.21.15.5:49798) 2023-10-16T13:49:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f45bc1700 1 -- 172.21.15.5:0/969904958 >> v1:172.21.15.112:6789/0 conn(0x7f6f4015ab10 legacy=0x7f6f400b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f45bc1700 1 -- 172.21.15.5:0/969904958 >> v1:172.21.15.5:6789/0 conn(0x7f6f400cfc60 legacy=0x7f6f400cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f45bc1700 1 -- 172.21.15.5:0/969904958 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400b2c80 con 0x7f6f4015f1f0 2023-10-16T13:49:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f453c0700 1 -- 172.21.15.5:0/969904958 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394050938 0 0) 0x7f6f4015e7a0 con 0x7f6f400cfc60 2023-10-16T13:49:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f45bc1700 1 --2- 172.21.15.5:0/969904958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400cf720 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009820 tx=0x7f6f3c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f07460ef1344b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f453c0700 1 -- 172.21.15.5:0/969904958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c005e30 con 0x7f6f4015f1f0 2023-10-16T13:49:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f453c0700 1 -- 172.21.15.5:0/969904958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c006030 con 0x7f6f4015f1f0 2023-10-16T13:49:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f453c0700 1 -- 172.21.15.5:0/969904958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0063e0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f48626700 1 -- 172.21.15.5:0/969904958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 msgr2=0x7f6f400cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f48626700 1 --2- 172.21.15.5:0/969904958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400cf720 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009820 tx=0x7f6f3c009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f48626700 1 -- 172.21.15.5:0/969904958 shutdown_connections 2023-10-16T13:49:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.317+0000 7f6f48626700 1 --2- 172.21.15.5:0/969904958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400cf720 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.318+0000 7f6f48626700 1 -- 172.21.15.5:0/969904958 >> 172.21.15.5:0/969904958 conn(0x7f6f4006dae0 msgr2=0x7f6f4006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.318+0000 7f6f48626700 1 -- 172.21.15.5:0/969904958 shutdown_connections 2023-10-16T13:49:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.318+0000 7f6f48626700 1 -- 172.21.15.5:0/969904958 wait complete. 2023-10-16T13:49:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 Processor -- start 2023-10-16T13:49:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 -- start start 2023-10-16T13:49:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f400cfc60 0x7f6f4015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4015ab10 0x7f6f4014ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400c75a0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4014f2b0 con 0x7f6f400cfc60 2023-10-16T13:49:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.319+0000 7f6f48626700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4015c440 con 0x7f6f4015ab10 2023-10-16T13:49:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49806/0 (socket says 172.21.15.5:49806) 2023-10-16T13:49:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 -- 172.21.15.5:0/3815948577 learned_addr learned my addr 172.21.15.5:0/3815948577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f45bc1700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4015ab10 0x7f6f4014ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f463c2700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f400cfc60 0x7f6f4015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 -- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4015ab10 msgr2=0x7f6f4014ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4015ab10 0x7f6f4014ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 -- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f400cfc60 msgr2=0x7f6f4015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f400cfc60 0x7f6f4015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 -- 172.21.15.5:0/3815948577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c009430 con 0x7f6f4015f1f0 2023-10-16T13:49:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f463c2700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f400cfc60 0x7f6f4015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f46bc3700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400b15f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800cba0 tx=0x7f6f3800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800aad0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800ac50 con 0x7f6f4015f1f0 2023-10-16T13:49:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4015c720 con 0x7f6f4015f1f0 2023-10-16T13:49:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f380070d0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.320+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4015cce0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.321+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f400c7710 con 0x7f6f4015f1f0 2023-10-16T13:49:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.322+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6f38007230 con 0x7f6f4015f1f0 2023-10-16T13:49:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.322+0000 7f6f36ffd700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2406b2f0 0x7f6f2406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.322+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f38089aa0 con 0x7f6f4015f1f0 2023-10-16T13:49:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.322+0000 7f6f463c2700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2406b2f0 0x7f6f2406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.323+0000 7f6f463c2700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2406b2f0 0x7f6f2406d7b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6f30000f60 tx=0x7f6f30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.327+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f38054600 con 0x7f6f4015f1f0 2023-10-16T13:49:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.529+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6f40067d20 con 0x7f6f4015f1f0 2023-10-16T13:49:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.530+0000 7f6f36ffd700 1 -- 172.21.15.5:0/3815948577 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f38018020 con 0x7f6f4015f1f0 2023-10-16T13:49:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2406b2f0 msgr2=0x7f6f2406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2406b2f0 0x7f6f2406d7b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6f30000f60 tx=0x7f6f30009040 comp rx=0 tx=0).stop 2023-10-16T13:49:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 msgr2=0x7f6f400b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400b15f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800cba0 tx=0x7f6f3800ceb0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 shutdown_connections 2023-10-16T13:49:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4015f1f0 0x7f6f400b15f0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f400cfc60 0x7f6f4015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6f2406b2f0 0x7f6f2406d7b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 --2- 172.21.15.5:0/3815948577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f4015ab10 0x7f6f4014ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 >> 172.21.15.5:0/3815948577 conn(0x7f6f4006dae0 msgr2=0x7f6f400cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 shutdown_connections 2023-10-16T13:49:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.532+0000 7f6f48626700 1 -- 172.21.15.5:0/3815948577 wait complete. 2023-10-16T13:49:01.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:49:01.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.671+0000 7fe2d357a700 1 Processor -- start 2023-10-16T13:49:01.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.671+0000 7fe2d357a700 1 -- start start 2023-10-16T13:49:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d357a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2cc15a280 0x7fe2cc0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d357a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0cf1d0 con 0x7fe2cc0ced00 2023-10-16T13:49:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d357a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0cafb0 con 0x7fe2cc06d390 2023-10-16T13:49:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d357a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc072200 con 0x7fe2cc15a280 2023-10-16T13:49:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d1316700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2cc15a280 0x7fe2cc0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d1b17700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe2cc0ced00 0x7fe2cc06ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59818/0 (socket says 172.21.15.5:59818) 2023-10-16T13:49:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d1b17700 1 -- 172.21.15.5:0/1175051414 learned_addr learned my addr 172.21.15.5:0/1175051414 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:01.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d1316700 1 -- 172.21.15.5:0/1175051414 >> v1:172.21.15.112:6789/0 conn(0x7fe2cc06d390 legacy=0x7fe2cc0ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.672+0000 7fe2d1316700 1 -- 172.21.15.5:0/1175051414 >> v1:172.21.15.5:6789/0 conn(0x7fe2cc0ced00 legacy=0x7fe2cc06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d1316700 1 -- 172.21.15.5:0/1175051414 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0cb290 con 0x7fe2cc15a280 2023-10-16T13:49:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d1316700 1 --2- 172.21.15.5:0/1175051414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc15a280 0x7fe2cc0cbd70 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009840 tx=0x7fe2c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f22bb0dc5c29da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2c3fff700 1 -- 172.21.15.5:0/1175051414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8004230 con 0x7fe2cc15a280 2023-10-16T13:49:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2c3fff700 1 -- 172.21.15.5:0/1175051414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8004390 con 0x7fe2cc15a280 2023-10-16T13:49:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2c3fff700 1 -- 172.21.15.5:0/1175051414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80036a0 con 0x7fe2cc15a280 2023-10-16T13:49:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d357a700 1 -- 172.21.15.5:0/1175051414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc15a280 msgr2=0x7fe2cc0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d357a700 1 --2- 172.21.15.5:0/1175051414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc15a280 0x7fe2cc0cbd70 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009840 tx=0x7fe2c8009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d357a700 1 -- 172.21.15.5:0/1175051414 shutdown_connections 2023-10-16T13:49:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d357a700 1 --2- 172.21.15.5:0/1175051414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc15a280 0x7fe2cc0cbd70 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.673+0000 7fe2d357a700 1 -- 172.21.15.5:0/1175051414 >> 172.21.15.5:0/1175051414 conn(0x7fe2cc0cfc40 msgr2=0x7fe2cc0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.674+0000 7fe2d357a700 1 -- 172.21.15.5:0/1175051414 shutdown_connections 2023-10-16T13:49:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.674+0000 7fe2d357a700 1 -- 172.21.15.5:0/1175051414 wait complete. 2023-10-16T13:49:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 Processor -- start 2023-10-16T13:49:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 -- start start 2023-10-16T13:49:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 0x7fe2cc157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2cc0ced00 0x7fe2cc0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2cc15a280 0x7fe2cc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0ca050 con 0x7fe2cc06d390 2023-10-16T13:49:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc15b910 con 0x7fe2cc0ced00 2023-10-16T13:49:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.675+0000 7fe2d357a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc15bbf0 con 0x7fe2cc15a280 2023-10-16T13:49:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 0x7fe2cc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 0x7fe2cc157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49816/0 (socket says 172.21.15.5:49816) 2023-10-16T13:49:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 -- 172.21.15.5:0/3851734261 learned_addr learned my addr 172.21.15.5:0/3851734261 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d0b15700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2cc0ced00 0x7fe2cc0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1b17700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2cc15a280 0x7fe2cc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 -- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2cc15a280 msgr2=0x7fe2cc0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2cc15a280 0x7fe2cc0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 -- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2cc0ced00 msgr2=0x7fe2cc0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2cc0ced00 0x7fe2cc0c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 -- 172.21.15.5:0/3851734261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80094a0 con 0x7fe2cc06d390 2023-10-16T13:49:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d1316700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 0x7fe2cc157780 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80090b0 tx=0x7fe2c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8003db0 con 0x7fe2cc06d390 2023-10-16T13:49:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c801f070 con 0x7fe2cc06d390 2023-10-16T13:49:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc15bed0 con 0x7fe2cc06d390 2023-10-16T13:49:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011850 con 0x7fe2cc06d390 2023-10-16T13:49:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.676+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc157cc0 con 0x7fe2cc06d390 2023-10-16T13:49:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.677+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc15c3f0 con 0x7fe2cc06d390 2023-10-16T13:49:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.678+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe2c8021030 con 0x7fe2cc06d390 2023-10-16T13:49:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.678+0000 7fe2c1ffb700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe2b006b2f0 0x7fe2b006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.678+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2c808b140 con 0x7fe2cc06d390 2023-10-16T13:49:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.679+0000 7fe2d0b15700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe2b006b2f0 0x7fe2b006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.679+0000 7fe2d0b15700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe2b006b2f0 0x7fe2b006d7b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0c5930 tx=0x7fe2bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.683+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2cc15c3f0 con 0x7fe2cc06d390 2023-10-16T13:49:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.915+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2cc0cb850 con 0x7fe2b006b2f0 2023-10-16T13:49:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.918+0000 7fe2c1ffb700 1 -- 172.21.15.5:0/3851734261 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe2bc0050d0 con 0x7fe2b006b2f0 2023-10-16T13:49:01.920 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:49:01.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:01.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:49:01.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:01.921 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:49:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe2b006b2f0 msgr2=0x7fe2b006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe2b006b2f0 0x7fe2b006d7b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0c5930 tx=0x7fe2bc009040 comp rx=0 tx=0).stop 2023-10-16T13:49:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 msgr2=0x7fe2cc157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 0x7fe2cc157780 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80090b0 tx=0x7fe2c8004750 comp rx=0 tx=0).stop 2023-10-16T13:49:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 shutdown_connections 2023-10-16T13:49:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe2b006b2f0 0x7fe2b006d7b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2cc15a280 0x7fe2cc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2cc06d390 0x7fe2cc157780 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 --2- 172.21.15.5:0/3851734261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2cc0ced00 0x7fe2cc0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.919+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 >> 172.21.15.5:0/3851734261 conn(0x7fe2cc0cfc40 msgr2=0x7fe2cc071760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.920+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 shutdown_connections 2023-10-16T13:49:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:01.920+0000 7fe2d357a700 1 -- 172.21.15.5:0/3851734261 wait complete. 2023-10-16T13:49:01.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001039163 2023-10-16T13:49:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 Processor -- start 2023-10-16T13:49:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 -- start start 2023-10-16T13:49:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633015bb50 0x7f633006e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63300ce280 0x7f633006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633015bf30 con 0x7f633006ed50 2023-10-16T13:49:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633006f1d0 con 0x7f63300ce280 2023-10-16T13:49:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.059+0000 7f63364b2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300b2d70 con 0x7f633015bb50 2023-10-16T13:49:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f633006ed50 0x7f63300cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59828/0 (socket says 172.21.15.5:59828) 2023-10-16T13:49:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632f7fe700 1 -- 172.21.15.5:0/904552615 learned_addr learned my addr 172.21.15.5:0/904552615 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632ffff700 1 --2- 172.21.15.5:0/904552615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633015bb50 0x7f633006e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f6334a4f700 1 --2- 172.21.15.5:0/904552615 >> v2:172.21.15.112:3300/0 conn(0x7f63300ce280 0x7f633006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632effd700 1 -- 172.21.15.5:0/904552615 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895396582 0 0) 0x7f633015bf30 con 0x7f633006ed50 2023-10-16T13:49:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632effd700 1 -- 172.21.15.5:0/904552615 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f631c0035b0 con 0x7f633006ed50 2023-10-16T13:49:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632effd700 1 -- 172.21.15.5:0/904552615 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174276785 0 0) 0x7f631c0035b0 con 0x7f633006ed50 2023-10-16T13:49:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632ffff700 1 -- 172.21.15.5:0/904552615 >> v2:172.21.15.112:3300/0 conn(0x7f63300ce280 msgr2=0x7f633006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632ffff700 1 --2- 172.21.15.5:0/904552615 >> v2:172.21.15.112:3300/0 conn(0x7f63300ce280 0x7f633006a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632ffff700 1 -- 172.21.15.5:0/904552615 >> v1:172.21.15.5:6789/0 conn(0x7f633006ed50 legacy=0x7f63300cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632ffff700 1 -- 172.21.15.5:0/904552615 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633006d500 con 0x7f633015bb50 2023-10-16T13:49:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f6334a4f700 1 --2- 172.21.15.5:0/904552615 >> v2:172.21.15.112:3300/0 conn(0x7f63300ce280 0x7f633006a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:02.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.060+0000 7f632ffff700 1 --2- 172.21.15.5:0/904552615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633015bb50 0x7f633006e810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6320009840 tx=0x7f6320009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e88e7b38224876b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:02.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f632effd700 1 -- 172.21.15.5:0/904552615 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318001670 con 0x7f633015bb50 2023-10-16T13:49:02.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f632effd700 1 -- 172.21.15.5:0/904552615 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320004030 con 0x7f633015bb50 2023-10-16T13:49:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f632effd700 1 -- 172.21.15.5:0/904552615 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200043c0 con 0x7f633015bb50 2023-10-16T13:49:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 -- 172.21.15.5:0/904552615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633015bb50 msgr2=0x7f633006e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 --2- 172.21.15.5:0/904552615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633015bb50 0x7f633006e810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6320009840 tx=0x7f6320009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 -- 172.21.15.5:0/904552615 shutdown_connections 2023-10-16T13:49:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 --2- 172.21.15.5:0/904552615 >> v2:172.21.15.112:3300/0 conn(0x7f63300ce280 0x7f633006a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 --2- 172.21.15.5:0/904552615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633015bb50 0x7f633006e810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 -- 172.21.15.5:0/904552615 >> 172.21.15.5:0/904552615 conn(0x7f63300cc6f0 msgr2=0x7f63300ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 -- 172.21.15.5:0/904552615 shutdown_connections 2023-10-16T13:49:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.061+0000 7f63364b2700 1 -- 172.21.15.5:0/904552615 wait complete. 2023-10-16T13:49:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.062+0000 7f63364b2700 1 Processor -- start 2023-10-16T13:49:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 -- start start 2023-10-16T13:49:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633006ed50 0x7f63301511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63300ce280 0x7f63300c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 0x7f63301f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300c71c0 con 0x7f633015bb50 2023-10-16T13:49:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63301f2340 con 0x7f63300ce280 2023-10-16T13:49:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f63364b2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63301f1d80 con 0x7f633006ed50 2023-10-16T13:49:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f6334a4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 0x7f63301f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f6334a4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 0x7f63301f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49834/0 (socket says 172.21.15.5:49834) 2023-10-16T13:49:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.063+0000 7f6334a4f700 1 -- 172.21.15.5:0/987479829 learned_addr learned my addr 172.21.15.5:0/987479829 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f632ffff700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633006ed50 0x7f63301511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f632f7fe700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63300ce280 0x7f63300c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f6334a4f700 1 -- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633006ed50 msgr2=0x7f63301511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f6334a4f700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633006ed50 0x7f63301511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f6334a4f700 1 -- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63300ce280 msgr2=0x7f63300c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f6334a4f700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63300ce280 0x7f63300c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f6334a4f700 1 -- 172.21.15.5:0/987479829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328009a70 con 0x7f633015bb50 2023-10-16T13:49:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f6334a4f700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 0x7f63301f13c0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f632800efc0 tx=0x7f632800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328009d70 con 0x7f633015bb50 2023-10-16T13:49:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800f040 con 0x7f633015bb50 2023-10-16T13:49:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800ce00 con 0x7f633015bb50 2023-10-16T13:49:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63200094a0 con 0x7f633015bb50 2023-10-16T13:49:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.064+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63300c6de0 con 0x7f633015bb50 2023-10-16T13:49:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.065+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6330066ff0 con 0x7f633015bb50 2023-10-16T13:49:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.066+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6328014480 con 0x7f633015bb50 2023-10-16T13:49:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.066+0000 7f632cff9700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f631006b2f0 0x7f631006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.066+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f632808a620 con 0x7f633015bb50 2023-10-16T13:49:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.066+0000 7f632ffff700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f631006b2f0 0x7f631006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.067+0000 7f632ffff700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f631006b2f0 0x7f631006d7b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f63200090b0 tx=0x7f6320013040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.071+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6328054f60 con 0x7f633015bb50 2023-10-16T13:49:02.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:02.298+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001039163", "target": ["mon-mgr", ""]}) v1 -- 0x7f633006d7e0 con 0x7f631006b2f0 2023-10-16T13:49:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.816+0000 7f632cff9700 1 -- 172.21.15.5:0/987479829 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f6320004520 con 0x7f631006b2f0 2023-10-16T13:49:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.821+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f631006b2f0 msgr2=0x7f631006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.821+0000 7f63364b2700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f631006b2f0 0x7f631006d7b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f63200090b0 tx=0x7f6320013040 comp rx=0 tx=0).stop 2023-10-16T13:49:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.821+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 msgr2=0x7f63301f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.821+0000 7f63364b2700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 0x7f63301f13c0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f632800efc0 tx=0x7f632800c3a0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 shutdown_connections 2023-10-16T13:49:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f633015bb50 0x7f63301f13c0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f631006b2f0 0x7f631006d7b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633006ed50 0x7f63301511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 --2- 172.21.15.5:0/987479829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63300ce280 0x7f63300c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 >> 172.21.15.5:0/987479829 conn(0x7f63300cc6f0 msgr2=0x7f63300cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 shutdown_connections 2023-10-16T13:49:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.822+0000 7f63364b2700 1 -- 172.21.15.5:0/987479829 wait complete. 2023-10-16T13:49:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:Volume created successfully (no MDS daemons created) 2023-10-16T13:49:04.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001039164 2023-10-16T13:49:04.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.976+0000 7f3bde2ee700 1 Processor -- start 2023-10-16T13:49:04.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.976+0000 7f3bde2ee700 1 -- start start 2023-10-16T13:49:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bde2ee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 0x7f3bd80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bde2ee700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80b2d60 con 0x7f3bd806a840 2023-10-16T13:49:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bde2ee700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80cdd30 con 0x7f3bd80cd950 2023-10-16T13:49:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bde2ee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd81619a0 con 0x7f3bd815e2f0 2023-10-16T13:49:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bdc88b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bd806a840 0x7f3bd8161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59846/0 (socket says 172.21.15.5:59846) 2023-10-16T13:49:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bdc88b700 1 -- 172.21.15.5:0/2706814977 learned_addr learned my addr 172.21.15.5:0/2706814977 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bd77fe700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 0x7f3bd80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280198557 0 0) 0x7f3bd80b2d60 con 0x7f3bd806a840 2023-10-16T13:49:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc00035b0 con 0x7f3bd806a840 2023-10-16T13:49:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627817459 0 0) 0x7f3bd80cdd30 con 0x7f3bd80cd950 2023-10-16T13:49:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.977+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd80b2d60 con 0x7f3bd80cd950 2023-10-16T13:49:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262509763 0 0) 0x7f3bc00035b0 con 0x7f3bd806a840 2023-10-16T13:49:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 msgr2=0x7f3bd80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 0x7f3bd80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 >> v1:172.21.15.112:6789/0 conn(0x7f3bd80cd950 legacy=0x7f3bd815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd815e920 con 0x7f3bd806a840 2023-10-16T13:49:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f3bd00019f0 con 0x7f3bd806a840 2023-10-16T13:49:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 >> v1:172.21.15.5:6789/0 conn(0x7f3bd806a840 legacy=0x7f3bd8161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc0003bc0 0x7f3bc0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 0x7f3bc0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc0004d90 0x7f3bc0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd81619a0 con 0x7f3bc0004d90 2023-10-16T13:49:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc000bac0 con 0x7f3bc0003bc0 2023-10-16T13:49:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc000bc30 con 0x7f3bd815e2f0 2023-10-16T13:49:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc0004d90 0x7f3bc0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd77fe700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 0x7f3bc0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd7fff700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc0003bc0 0x7f3bc0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 -- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 msgr2=0x7f3bc0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd815e2f0 0x7f3bc0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 -- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc0003bc0 msgr2=0x7f3bc0003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc0003bc0 0x7f3bc0003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 -- 172.21.15.5:0/2706814977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00035b0 con 0x7f3bc0004d90 2023-10-16T13:49:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc0004d90 0x7f3bc0005210 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000a7b0 tx=0x7f3bc0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38963298b74fa892 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0012600 con 0x7f3bc0004d90 2023-10-16T13:49:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd00127a0 con 0x7f3bc0004d90 2023-10-16T13:49:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.978+0000 7f3bd6ffd700 1 -- 172.21.15.5:0/2706814977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0012b50 con 0x7f3bc0004d90 2023-10-16T13:49:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bde2ee700 1 -- 172.21.15.5:0/2706814977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc0004d90 msgr2=0x7f3bc0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/2706814977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc0004d90 0x7f3bc0005210 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000a7b0 tx=0x7f3bc0005880 comp rx=0 tx=0).stop 2023-10-16T13:49:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bdc88b700 1 -- 172.21.15.5:0/2706814977 reap_dead start 2023-10-16T13:49:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bde2ee700 1 -- 172.21.15.5:0/2706814977 shutdown_connections 2023-10-16T13:49:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bde2ee700 1 -- 172.21.15.5:0/2706814977 >> 172.21.15.5:0/2706814977 conn(0x7f3bd806dae0 msgr2=0x7f3bd806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bde2ee700 1 -- 172.21.15.5:0/2706814977 shutdown_connections 2023-10-16T13:49:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.979+0000 7f3bde2ee700 1 -- 172.21.15.5:0/2706814977 wait complete. 2023-10-16T13:49:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.980+0000 7f3bde2ee700 1 Processor -- start 2023-10-16T13:49:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.980+0000 7f3bde2ee700 1 -- start start 2023-10-16T13:49:04.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bde2ee700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd80af420 0x7f3bd81f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bde2ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd80b4e10 0x7f3bd81f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bde2ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 0x7f3bd814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bde2ee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd81f7900 con 0x7f3bd81f7450 2023-10-16T13:49:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bde2ee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80cb620 con 0x7f3bd80b4e10 2023-10-16T13:49:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bde2ee700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd814b1c0 con 0x7f3bd80af420 2023-10-16T13:49:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bdc88b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 0x7f3bd814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bdc88b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 0x7f3bd814d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49852/0 (socket says 172.21.15.5:49852) 2023-10-16T13:49:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bdc88b700 1 -- 172.21.15.5:0/3332058160 learned_addr learned my addr 172.21.15.5:0/3332058160 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bd7fff700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd80af420 0x7f3bd81f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.981+0000 7f3bd77fe700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd80b4e10 0x7f3bd81f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bdc88b700 1 -- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd80af420 msgr2=0x7f3bd81f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd80af420 0x7f3bd81f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bdc88b700 1 -- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd80b4e10 msgr2=0x7f3bd81f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd80b4e10 0x7f3bd81f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bdc88b700 1 -- 172.21.15.5:0/3332058160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80b56f0 con 0x7f3bd81f7450 2023-10-16T13:49:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bdc88b700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 0x7f3bd814d510 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0015040 tx=0x7f3bd80b2ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00019c0 con 0x7f3bd81f7450 2023-10-16T13:49:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd000a1f0 con 0x7f3bd81f7450 2023-10-16T13:49:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd001d680 con 0x7f3bd81f7450 2023-10-16T13:49:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd80b59d0 con 0x7f3bd81f7450 2023-10-16T13:49:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.982+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd80b5f90 con 0x7f3bd81f7450 2023-10-16T13:49:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.983+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd80b6180 con 0x7f3bd81f7450 2023-10-16T13:49:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.984+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f3bd001d7e0 con 0x7f3bd81f7450 2023-10-16T13:49:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.984+0000 7f3bd4ff9700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3bc406b2f0 0x7f3bc406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.985+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6607+0+0 (secure 0 0 0) 0x7f3bd008b910 con 0x7f3bd81f7450 2023-10-16T13:49:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.985+0000 7f3bd7fff700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3bc406b2f0 0x7f3bc406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.985+0000 7f3bd7fff700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3bc406b2f0 0x7f3bc406d7b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8007fd0 tx=0x7f3bc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:04.989+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bd00561f0 con 0x7f3bd81f7450 2023-10-16T13:49:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:05.219+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001039164", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bd815eee0 con 0x7f3bc406b2f0 2023-10-16T13:49:06.706 INFO:tasks.ceph.mds.d.smithi112.stderr:2023-10-16T13:49:06.704+0000 7ff39016e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.857+0000 7f3bd4ff9700 1 -- 172.21.15.5:0/3332058160 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f3bc8006860 con 0x7f3bc406b2f0 2023-10-16T13:49:07.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.862+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3bc406b2f0 msgr2=0x7f3bc406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.862+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3bc406b2f0 0x7f3bc406d7b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8007fd0 tx=0x7f3bc8009040 comp rx=0 tx=0).stop 2023-10-16T13:49:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.862+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 msgr2=0x7f3bd814d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.862+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 0x7f3bd814d510 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0015040 tx=0x7f3bd80b2ef0 comp rx=0 tx=0).stop 2023-10-16T13:49:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 shutdown_connections 2023-10-16T13:49:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bd81f7450 0x7f3bd814d510 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f3bc406b2f0 0x7f3bc406d7b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3bd80af420 0x7f3bd81f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 --2- 172.21.15.5:0/3332058160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd80b4e10 0x7f3bd81f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 >> 172.21.15.5:0/3332058160 conn(0x7f3bd806dae0 msgr2=0x7f3bd80ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 shutdown_connections 2023-10-16T13:49:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:07.863+0000 7f3bde2ee700 1 -- 172.21.15.5:0/3332058160 wait complete. 2023-10-16T13:49:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:Volume created successfully (no MDS daemons created) 2023-10-16T13:49:07.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:49:08.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.012+0000 7f002a4cf700 1 Processor -- start 2023-10-16T13:49:08.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f002a4cf700 1 -- start start 2023-10-16T13:49:08.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f002a4cf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f002415ac90 0x7f002406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f002a4cf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cf1a0 0x7f00240cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f002a4cf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002406c160 con 0x7f00240cdb40 2023-10-16T13:49:08.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f002a4cf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00240ce100 con 0x7f002415ac90 2023-10-16T13:49:08.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f002a4cf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240ce3e0 con 0x7f00240cf1a0 2023-10-16T13:49:08.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f0023fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f002415ac90 0x7f002406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f00237fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00240cdb40 0x7f00240b2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59862/0 (socket says 172.21.15.5:59862) 2023-10-16T13:49:08.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f0023fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f002415ac90 0x7f002406bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49858/0 (socket says 172.21.15.5:49858) 2023-10-16T13:49:08.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.013+0000 7f00237fe700 1 -- 172.21.15.5:0/4123339360 learned_addr learned my addr 172.21.15.5:0/4123339360 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:08.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0023fff700 1 -- 172.21.15.5:0/4123339360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cf1a0 msgr2=0x7f00240cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0028a6c700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cf1a0 0x7f00240cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0022ffd700 1 -- 172.21.15.5:0/4123339360 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591442361 0 0) 0x7f002406c160 con 0x7f00240cdb40 2023-10-16T13:49:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0023fff700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cf1a0 0x7f00240cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0023fff700 1 -- 172.21.15.5:0/4123339360 >> v1:172.21.15.5:6789/0 conn(0x7f00240cdb40 legacy=0x7f00240b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0023fff700 1 -- 172.21.15.5:0/4123339360 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240ce6c0 con 0x7f002415ac90 2023-10-16T13:49:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0028a6c700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cf1a0 0x7f00240cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0023fff700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f002415ac90 0x7f002406bc20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0014009840 tx=0x7f0014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecbfa2147f7e09d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0022ffd700 1 -- 172.21.15.5:0/4123339360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014011830 con 0x7f002415ac90 2023-10-16T13:49:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0022ffd700 1 -- 172.21.15.5:0/4123339360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0014011990 con 0x7f002415ac90 2023-10-16T13:49:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.014+0000 7f0022ffd700 1 -- 172.21.15.5:0/4123339360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014011d20 con 0x7f002415ac90 2023-10-16T13:49:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 -- 172.21.15.5:0/4123339360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f002415ac90 msgr2=0x7f002406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f002415ac90 0x7f002406bc20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0014009840 tx=0x7f0014009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 -- 172.21.15.5:0/4123339360 shutdown_connections 2023-10-16T13:49:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cf1a0 0x7f00240cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 --2- 172.21.15.5:0/4123339360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f002415ac90 0x7f002406bc20 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 -- 172.21.15.5:0/4123339360 >> 172.21.15.5:0/4123339360 conn(0x7f00240cfc40 msgr2=0x7f00240d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 -- 172.21.15.5:0/4123339360 shutdown_connections 2023-10-16T13:49:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.015+0000 7f002a4cf700 1 -- 172.21.15.5:0/4123339360 wait complete. 2023-10-16T13:49:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.016+0000 7f002a4cf700 1 Processor -- start 2023-10-16T13:49:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.016+0000 7f002a4cf700 1 -- start start 2023-10-16T13:49:08.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f002a4cf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cdb40 0x7f00241f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f002a4cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 0x7f00240b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f002a4cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002415ac90 0x7f0024156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f002a4cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240c80a0 con 0x7f00240cf1a0 2023-10-16T13:49:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f002a4cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240c8230 con 0x7f002415ac90 2023-10-16T13:49:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f002a4cf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240b3a20 con 0x7f00240cdb40 2023-10-16T13:49:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 0x7f00240b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 0x7f00240b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49866/0 (socket says 172.21.15.5:49866) 2023-10-16T13:49:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 -- 172.21.15.5:0/640341553 learned_addr learned my addr 172.21.15.5:0/640341553 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f0028a6c700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002415ac90 0x7f0024156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f0023fff700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cdb40 0x7f00241f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 -- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cdb40 msgr2=0x7f00241f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cdb40 0x7f00241f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 -- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002415ac90 msgr2=0x7f0024156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002415ac90 0x7f0024156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f00237fe700 1 -- 172.21.15.5:0/640341553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140094a0 con 0x7f00240cf1a0 2023-10-16T13:49:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f0023fff700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cdb40 0x7f00241f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.017+0000 7f0028a6c700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002415ac90 0x7f0024156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.018+0000 7f00237fe700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 0x7f00240b34e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f000c0011e0 tx=0x7f000c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.018+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c004c80 con 0x7f00240cf1a0 2023-10-16T13:49:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.018+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c004e00 con 0x7f00240cf1a0 2023-10-16T13:49:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.018+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00240b3cf0 con 0x7f00240cf1a0 2023-10-16T13:49:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.018+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c007310 con 0x7f00240cf1a0 2023-10-16T13:49:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.018+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00240b42b0 con 0x7f00240cf1a0 2023-10-16T13:49:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.019+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0024067d20 con 0x7f00240cf1a0 2023-10-16T13:49:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.019+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f000c007470 con 0x7f00240cf1a0 2023-10-16T13:49:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.020+0000 7f0020ff9700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f000406b2f0 0x7f000406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.020+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 7505+0+0 (secure 0 0 0) 0x7f000c08a140 con 0x7f00240cf1a0 2023-10-16T13:49:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.020+0000 7f0023fff700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f000406b2f0 0x7f000406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.021+0000 7f0023fff700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f000406b2f0 0x7f000406d7b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f00140090b0 tx=0x7f001401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.025+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f000c054610 con 0x7f00240cf1a0 2023-10-16T13:49:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.251+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f00240cec80 con 0x7f000406b2f0 2023-10-16T13:49:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.254+0000 7f0020ff9700 1 -- 172.21.15.5:0/640341553 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+151 (secure 0 0 0) 0x7f0014011750 con 0x7f000406b2f0 2023-10-16T13:49:08.256 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:49:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:49:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volume_0000000001039163" 2023-10-16T13:49:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volume_0000000001039164" 2023-10-16T13:49:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:08.258 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:49:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f000406b2f0 msgr2=0x7f000406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f000406b2f0 0x7f000406d7b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f00140090b0 tx=0x7f001401c040 comp rx=0 tx=0).stop 2023-10-16T13:49:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 msgr2=0x7f00240b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 0x7f00240b34e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f000c0011e0 tx=0x7f000c00cae0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 shutdown_connections 2023-10-16T13:49:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002415ac90 0x7f0024156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f000406b2f0 0x7f000406d7b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00240cdb40 0x7f00241f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 --2- 172.21.15.5:0/640341553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00240cf1a0 0x7f00240b34e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 >> 172.21.15.5:0/640341553 conn(0x7f00240cfc40 msgr2=0x7f00240b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.255+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 shutdown_connections 2023-10-16T13:49:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.256+0000 7f002a4cf700 1 -- 172.21.15.5:0/640341553 wait complete. 2023-10-16T13:49:08.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039163 --yes-i-really-mean-it 2023-10-16T13:49:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 Processor -- start 2023-10-16T13:49:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 -- start start 2023-10-16T13:49:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12b40cee90 0x7f12b40665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b415dd50 0x7f12b415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b415e6e0 con 0x7f12b4157d40 2023-10-16T13:49:08.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b406e560 con 0x7f12b415dd50 2023-10-16T13:49:08.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.396+0000 7f12bad44700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b40cf2f0 con 0x7f12b40cee90 2023-10-16T13:49:08.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b8ae0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12b4157d40 0x7f12b406de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59876/0 (socket says 172.21.15.5:59876) 2023-10-16T13:49:08.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b8ae0700 1 -- 172.21.15.5:0/2558556151 learned_addr learned my addr 172.21.15.5:0/2558556151 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b92e1700 1 --2- 172.21.15.5:0/2558556151 >> v2:172.21.15.5:3300/0 conn(0x7f12b415dd50 0x7f12b415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b3fff700 1 --2- 172.21.15.5:0/2558556151 >> v2:172.21.15.112:3300/0 conn(0x7f12b40cee90 0x7f12b40665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b92e1700 1 -- 172.21.15.5:0/2558556151 >> v2:172.21.15.112:3300/0 conn(0x7f12b40cee90 msgr2=0x7f12b40665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b92e1700 1 --2- 172.21.15.5:0/2558556151 >> v2:172.21.15.112:3300/0 conn(0x7f12b40cee90 0x7f12b40665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b92e1700 1 -- 172.21.15.5:0/2558556151 >> v1:172.21.15.5:6789/0 conn(0x7f12b4157d40 legacy=0x7f12b406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b92e1700 1 -- 172.21.15.5:0/2558556151 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40cc530 con 0x7f12b415dd50 2023-10-16T13:49:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b37fe700 1 -- 172.21.15.5:0/2558556151 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947167249 0 0) 0x7f12a8001110 con 0x7f12b4157d40 2023-10-16T13:49:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b3fff700 1 --2- 172.21.15.5:0/2558556151 >> v2:172.21.15.112:3300/0 conn(0x7f12b40cee90 0x7f12b40665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b92e1700 1 --2- 172.21.15.5:0/2558556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b415dd50 0x7f12b415e1a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f12b4072660 tx=0x7f12ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2217d6058d69545c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b37fe700 1 -- 172.21.15.5:0/2558556151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00e070 con 0x7f12b415dd50 2023-10-16T13:49:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b37fe700 1 -- 172.21.15.5:0/2558556151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00bbd0 con 0x7f12b415dd50 2023-10-16T13:49:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.397+0000 7f12b37fe700 1 -- 172.21.15.5:0/2558556151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac012430 con 0x7f12b415dd50 2023-10-16T13:49:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 -- 172.21.15.5:0/2558556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b415dd50 msgr2=0x7f12b415e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 --2- 172.21.15.5:0/2558556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b415dd50 0x7f12b415e1a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f12b4072660 tx=0x7f12ac00b330 comp rx=0 tx=0).stop 2023-10-16T13:49:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 -- 172.21.15.5:0/2558556151 shutdown_connections 2023-10-16T13:49:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 --2- 172.21.15.5:0/2558556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b415dd50 0x7f12b415e1a0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 --2- 172.21.15.5:0/2558556151 >> v2:172.21.15.112:3300/0 conn(0x7f12b40cee90 0x7f12b40665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 -- 172.21.15.5:0/2558556151 >> 172.21.15.5:0/2558556151 conn(0x7f12b40cc6f0 msgr2=0x7f12b40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 -- 172.21.15.5:0/2558556151 shutdown_connections 2023-10-16T13:49:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.398+0000 7f12bad44700 1 -- 172.21.15.5:0/2558556151 wait complete. 2023-10-16T13:49:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.399+0000 7f12bad44700 1 Processor -- start 2023-10-16T13:49:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.399+0000 7f12bad44700 1 -- start start 2023-10-16T13:49:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12bad44700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12b40cee90 0x7f12b414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12bad44700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 0x7f12b406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12bad44700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12b415dd50 0x7f12b4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12bad44700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b414d690 con 0x7f12b4157d40 2023-10-16T13:49:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12bad44700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40c4200 con 0x7f12b40cee90 2023-10-16T13:49:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12bad44700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40c3960 con 0x7f12b415dd50 2023-10-16T13:49:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 0x7f12b406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 0x7f12b406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49880/0 (socket says 172.21.15.5:49880) 2023-10-16T13:49:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 -- 172.21.15.5:0/3309705738 learned_addr learned my addr 172.21.15.5:0/3309705738 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b92e1700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12b415dd50 0x7f12b4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 -- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12b415dd50 msgr2=0x7f12b4156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12b415dd50 0x7f12b4156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 -- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12b40cee90 msgr2=0x7f12b414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b8ae0700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12b40cee90 0x7f12b414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12b40cee90 0x7f12b414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b3fff700 1 -- 172.21.15.5:0/3309705738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009a70 con 0x7f12b4157d40 2023-10-16T13:49:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.400+0000 7f12b8ae0700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12b40cee90 0x7f12b414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.401+0000 7f12b3fff700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 0x7f12b406b5c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c7f0 tx=0x7f12a000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.401+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0011800 con 0x7f12b4157d40 2023-10-16T13:49:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.401+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a0011960 con 0x7f12b4157d40 2023-10-16T13:49:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.401+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0011d10 con 0x7f12b4157d40 2023-10-16T13:49:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.401+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b40c3c40 con 0x7f12b4157d40 2023-10-16T13:49:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.401+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b406bb00 con 0x7f12b4157d40 2023-10-16T13:49:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.402+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b4155410 con 0x7f12b4157d40 2023-10-16T13:49:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.403+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f12a0024480 con 0x7f12b4157d40 2023-10-16T13:49:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.403+0000 7f12b17fa700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129806b2f0 0x7f129806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.403+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 7505+0+0 (secure 0 0 0) 0x7f12a008a630 con 0x7f12b4157d40 2023-10-16T13:49:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.403+0000 7f12b8ae0700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129806b2f0 0x7f129806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.404+0000 7f12b8ae0700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129806b2f0 0x7f129806d7b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f12a8007fd0 tx=0x7f12a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.407+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12a0054a70 con 0x7f12b4157d40 2023-10-16T13:49:08.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:08.637+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001039163", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b406a840 con 0x7f129806b2f0 2023-10-16T13:49:08.646 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:49:08.643+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:49:08.651 INFO:tasks.ceph.mds.d.smithi112.stderr: -61> 2023-10-16T13:49:06.704+0000 7ff39016e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:08.680 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:49:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.672+0000 7f12b17fa700 1 -- 172.21.15.5:0/3309705738 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f12a80014c0 con 0x7f129806b2f0 2023-10-16T13:49:11.674 INFO:teuthology.orchestra.run.smithi005.stdout:metadata pool: cephfs.volume_0000000001039163.meta data pool: ['cephfs.volume_0000000001039163.data'] removed 2023-10-16T13:49:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129806b2f0 msgr2=0x7f129806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129806b2f0 0x7f129806d7b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f12a8007fd0 tx=0x7f12a8009040 comp rx=0 tx=0).stop 2023-10-16T13:49:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 msgr2=0x7f12b406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 0x7f12b406b5c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c7f0 tx=0x7f12a000cbb0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 shutdown_connections 2023-10-16T13:49:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f129806b2f0 0x7f129806d7b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12b415dd50 0x7f12b4156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12b40cee90 0x7f12b414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 --2- 172.21.15.5:0/3309705738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b4157d40 0x7f12b406b5c0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 >> 172.21.15.5:0/3309705738 conn(0x7f12b40cc6f0 msgr2=0x7f12b40665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 shutdown_connections 2023-10-16T13:49:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.674+0000 7f12bad44700 1 -- 172.21.15.5:0/3309705738 wait complete. 2023-10-16T13:49:11.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039164 --yes-i-really-mean-it 2023-10-16T13:49:11.709 INFO:tasks.ceph.mds.b.smithi112.stderr:2023-10-16T13:49:11.706+0000 7f9c9c66e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:11.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 Processor -- start 2023-10-16T13:49:11.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 -- start start 2023-10-16T13:49:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe500cd950 0x7fbe5015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe5015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5006a840 0x7fbe5006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe501619a0 con 0x7fbe5006a840 2023-10-16T13:49:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5006b1f0 con 0x7fbe500cd950 2023-10-16T13:49:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.825+0000 7fbe56aa0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500cf260 con 0x7fbe500cede0 2023-10-16T13:49:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5006a840 0x7fbe5006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5006a840 0x7fbe5006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49890/0 (socket says 172.21.15.5:49890) 2023-10-16T13:49:11.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 -- 172.21.15.5:0/1758191514 learned_addr learned my addr 172.21.15.5:0/1758191514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5483c700 1 --2- 172.21.15.5:0/1758191514 >> v2:172.21.15.112:3300/0 conn(0x7fbe500cd950 0x7fbe5015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe4ffff700 1 --2- 172.21.15.5:0/1758191514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe5015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 -- 172.21.15.5:0/1758191514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 msgr2=0x7fbe5015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 --2- 172.21.15.5:0/1758191514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe5015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 -- 172.21.15.5:0/1758191514 >> v2:172.21.15.112:3300/0 conn(0x7fbe500cd950 msgr2=0x7fbe5015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 --2- 172.21.15.5:0/1758191514 >> v2:172.21.15.112:3300/0 conn(0x7fbe500cd950 0x7fbe5015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 -- 172.21.15.5:0/1758191514 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500b2d60 con 0x7fbe5006a840 2023-10-16T13:49:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5483c700 1 --2- 172.21.15.5:0/1758191514 >> v2:172.21.15.112:3300/0 conn(0x7fbe500cd950 0x7fbe5015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe5503d700 1 --2- 172.21.15.5:0/1758191514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe5006acb0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fbe500d0430 tx=0x7fbe4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489f299cf04eaf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe4f7fe700 1 -- 172.21.15.5:0/1758191514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800e070 con 0x7fbe5006a840 2023-10-16T13:49:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe4f7fe700 1 -- 172.21.15.5:0/1758191514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800b9c0 con 0x7fbe5006a840 2023-10-16T13:49:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.826+0000 7fbe4f7fe700 1 -- 172.21.15.5:0/1758191514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800bd70 con 0x7fbe5006a840 2023-10-16T13:49:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 -- 172.21.15.5:0/1758191514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 msgr2=0x7fbe5006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/1758191514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe5006acb0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fbe500d0430 tx=0x7fbe4800b330 comp rx=0 tx=0).stop 2023-10-16T13:49:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 -- 172.21.15.5:0/1758191514 shutdown_connections 2023-10-16T13:49:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/1758191514 >> v2:172.21.15.112:3300/0 conn(0x7fbe500cd950 0x7fbe5015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/1758191514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe5006acb0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/1758191514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe5015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 -- 172.21.15.5:0/1758191514 >> 172.21.15.5:0/1758191514 conn(0x7fbe5006dae0 msgr2=0x7fbe5006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 -- 172.21.15.5:0/1758191514 shutdown_connections 2023-10-16T13:49:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.827+0000 7fbe56aa0700 1 -- 172.21.15.5:0/1758191514 wait complete. 2023-10-16T13:49:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.828+0000 7fbe56aa0700 1 Processor -- start 2023-10-16T13:49:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.828+0000 7fbe56aa0700 1 -- start start 2023-10-16T13:49:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe56aa0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe500b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe56aa0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe500cd950 0x7fbe500c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe56aa0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe501f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe56aa0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b45d0 con 0x7fbe5006a840 2023-10-16T13:49:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe56aa0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b48b0 con 0x7fbe500cd950 2023-10-16T13:49:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe56aa0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b4b90 con 0x7fbe500cede0 2023-10-16T13:49:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe5483c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe500b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe5483c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe500b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49892/0 (socket says 172.21.15.5:49892) 2023-10-16T13:49:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe5483c700 1 -- 172.21.15.5:0/636853298 learned_addr learned my addr 172.21.15.5:0/636853298 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe4ffff700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe500cd950 0x7fbe500c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.829+0000 7fbe5503d700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe501f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe5483c700 1 -- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 msgr2=0x7fbe501f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe5483c700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe501f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe5483c700 1 -- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe500cd950 msgr2=0x7fbe500c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe5483c700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe500cd950 0x7fbe500c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe5483c700 1 -- 172.21.15.5:0/636853298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48009b30 con 0x7fbe5006a840 2023-10-16T13:49:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe5483c700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe500b5670 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400d800 tx=0x7fbe4400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44004030 con 0x7fbe5006a840 2023-10-16T13:49:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44004190 con 0x7fbe5006a840 2023-10-16T13:49:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500b4e70 con 0x7fbe5006a840 2023-10-16T13:49:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44004520 con 0x7fbe5006a840 2023-10-16T13:49:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.830+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500c4700 con 0x7fbe5006a840 2023-10-16T13:49:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.831+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe500b54c0 con 0x7fbe5006a840 2023-10-16T13:49:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.831+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fbe440036a0 con 0x7fbe5006a840 2023-10-16T13:49:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.832+0000 7fbe4d7fa700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3406b2f0 0x7fbe3406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.832+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6693+0+0 (secure 0 0 0) 0x7fbe440898e0 con 0x7fbe5006a840 2023-10-16T13:49:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.832+0000 7fbe4ffff700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3406b2f0 0x7fbe3406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.832+0000 7fbe4ffff700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3406b2f0 0x7fbe3406d7b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbe5015b4c0 tx=0x7fbe3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:11.837+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe44054080 con 0x7fbe5006a840 2023-10-16T13:49:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:12.071+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001039164", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe5015e920 con 0x7fbe3406b2f0 2023-10-16T13:49:12.079 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:49:12.076+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:49:12.082 INFO:tasks.ceph.mds.b.smithi112.stderr: -1305> 2023-10-16T13:48:45.818+0000 7f9ca267a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-16T13:49:12.085 INFO:tasks.ceph.mds.b.smithi112.stderr: -31> 2023-10-16T13:49:11.706+0000 7f9c9c66e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:12.110 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:49:15.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.093+0000 7fbe4d7fa700 1 -- 172.21.15.5:0/636853298 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fbe3c009e30 con 0x7fbe3406b2f0 2023-10-16T13:49:15.095 INFO:teuthology.orchestra.run.smithi005.stdout:metadata pool: cephfs.volume_0000000001039164.meta data pool: ['cephfs.volume_0000000001039164.data'] removed 2023-10-16T13:49:15.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3406b2f0 msgr2=0x7fbe3406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3406b2f0 0x7fbe3406d7b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbe5015b4c0 tx=0x7fbe3c008040 comp rx=0 tx=0).stop 2023-10-16T13:49:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 msgr2=0x7fbe500b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe500b5670 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400d800 tx=0x7fbe4400db10 comp rx=0 tx=0).stop 2023-10-16T13:49:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 shutdown_connections 2023-10-16T13:49:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbe3406b2f0 0x7fbe3406d7b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe500cede0 0x7fbe501f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5006a840 0x7fbe500b5670 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 --2- 172.21.15.5:0/636853298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe500cd950 0x7fbe500c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 >> 172.21.15.5:0/636853298 conn(0x7fbe5006dae0 msgr2=0x7fbe500cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 shutdown_connections 2023-10-16T13:49:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.095+0000 7fbe56aa0700 1 -- 172.21.15.5:0/636853298 wait complete. 2023-10-16T13:49:15.115 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:49:15.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:49:15.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:49:15.212 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:49:15.212 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:15.213 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:15.241 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:15.241 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:15.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.467+0000 7fe13aabd700 1 Processor -- start 2023-10-16T13:49:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.467+0000 7fe13aabd700 1 -- start start 2023-10-16T13:49:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.468+0000 7fe13aabd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe13415f1f0 0x7fe1340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.468+0000 7fe13aabd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13415e7a0 con 0x7fe1340cfc60 2023-10-16T13:49:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.468+0000 7fe13aabd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1340d0090 con 0x7fe13415ab10 2023-10-16T13:49:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.468+0000 7fe13aabd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1340b29a0 con 0x7fe13415f1f0 2023-10-16T13:49:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.468+0000 7fe13905a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe1340cfc60 0x7fe1340cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59908/0 (socket says 172.21.15.5:59908) 2023-10-16T13:49:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.468+0000 7fe13905a700 1 -- 172.21.15.5:0/1280659795 learned_addr learned my addr 172.21.15.5:0/1280659795 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe133fff700 1 --2- 172.21.15.5:0/1280659795 >> v2:172.21.15.112:3300/0 conn(0x7fe13415f1f0 0x7fe1340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884638366 0 0) 0x7fe13415e7a0 con 0x7fe1340cfc60 2023-10-16T13:49:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1240035b0 con 0x7fe1340cfc60 2023-10-16T13:49:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358137183 0 0) 0x7fe1240035b0 con 0x7fe1340cfc60 2023-10-16T13:49:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 >> v2:172.21.15.112:3300/0 conn(0x7fe13415f1f0 msgr2=0x7fe1340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 --2- 172.21.15.5:0/1280659795 >> v2:172.21.15.112:3300/0 conn(0x7fe13415f1f0 0x7fe1340cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 >> v1:172.21.15.112:6789/0 conn(0x7fe13415ab10 legacy=0x7fe1340b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340b2c80 con 0x7fe1340cfc60 2023-10-16T13:49:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fe12c0019f0 con 0x7fe1340cfc60 2023-10-16T13:49:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 >> v1:172.21.15.5:6789/0 conn(0x7fe1340cfc60 legacy=0x7fe1340cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe124003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe124004400 0x7fe1240048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1240050d0 0x7fe12400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1340b29a0 con 0x7fe124003a00 2023-10-16T13:49:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12400c030 con 0x7fe1240050d0 2023-10-16T13:49:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12400c1f0 con 0x7fe124004400 2023-10-16T13:49:15.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe138859700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe124003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe133fff700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe124004400 0x7fe1240048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe13905a700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1240050d0 0x7fe12400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe138859700 1 -- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe124004400 msgr2=0x7fe1240048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:15.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe138859700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe124004400 0x7fe1240048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe138859700 1 -- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1240050d0 msgr2=0x7fe12400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:15.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe138859700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1240050d0 0x7fe12400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe138859700 1 -- 172.21.15.5:0/1280659795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240035b0 con 0x7fe124003a00 2023-10-16T13:49:15.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe13905a700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1240050d0 0x7fe12400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe133fff700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe124004400 0x7fe1240048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.469+0000 7fe13905a700 1 -- 172.21.15.5:0/1280659795 reap_dead start 2023-10-16T13:49:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe138859700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe124003de0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe1280018d0 tx=0x7fe124005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497389b6dadfc5d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280052d0 con 0x7fe124003a00 2023-10-16T13:49:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128005430 con 0x7fe124003a00 2023-10-16T13:49:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe1337fe700 1 -- 172.21.15.5:0/1280659795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280038c0 con 0x7fe124003a00 2023-10-16T13:49:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 -- 172.21.15.5:0/1280659795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 msgr2=0x7fe124003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe124003de0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe1280018d0 tx=0x7fe124005880 comp rx=0 tx=0).stop 2023-10-16T13:49:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 -- 172.21.15.5:0/1280659795 shutdown_connections 2023-10-16T13:49:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1280659795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe124003de0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 -- 172.21.15.5:0/1280659795 >> 172.21.15.5:0/1280659795 conn(0x7fe13406dae0 msgr2=0x7fe13406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:15.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 -- 172.21.15.5:0/1280659795 shutdown_connections 2023-10-16T13:49:15.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.470+0000 7fe13aabd700 1 -- 172.21.15.5:0/1280659795 wait complete. 2023-10-16T13:49:15.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.472+0000 7fe13aabd700 1 Processor -- start 2023-10-16T13:49:15.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.472+0000 7fe13aabd700 1 -- start start 2023-10-16T13:49:15.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.472+0000 7fe13aabd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe1340c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.472+0000 7fe13aabd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe13414bb80 0x7fe1340c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.472+0000 7fe13aabd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe13414dc10 0x7fe13414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13aabd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13414e5e0 con 0x7fe124003a00 2023-10-16T13:49:15.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13aabd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1340ca8a0 con 0x7fe13414dc10 2023-10-16T13:49:15.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13aabd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1340b06b0 con 0x7fe13414bb80 2023-10-16T13:49:15.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe1340c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe1340c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49912/0 (socket says 172.21.15.5:49912) 2023-10-16T13:49:15.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 -- 172.21.15.5:0/1099489214 learned_addr learned my addr 172.21.15.5:0/1099489214 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:15.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13905a700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe13414dc10 0x7fe13414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe133fff700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe13414bb80 0x7fe1340c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 -- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe13414bb80 msgr2=0x7fe1340c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe13414bb80 0x7fe1340c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 -- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe13414dc10 msgr2=0x7fe13414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe13414dc10 0x7fe13414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 -- 172.21.15.5:0/1099489214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340ca5c0 con 0x7fe124003a00 2023-10-16T13:49:15.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13905a700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe13414dc10 0x7fe13414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:15.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe138859700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe1340c7a10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c0e0 tx=0x7fe128001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:15.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12800c690 con 0x7fe124003a00 2023-10-16T13:49:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12800c7f0 con 0x7fe124003a00 2023-10-16T13:49:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1340b0060 con 0x7fe124003a00 2023-10-16T13:49:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12800cb80 con 0x7fe124003a00 2023-10-16T13:49:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.473+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1340ca2d0 con 0x7fe124003a00 2023-10-16T13:49:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.474+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1340b5f40 con 0x7fe124003a00 2023-10-16T13:49:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.475+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe12800cce0 con 0x7fe124003a00 2023-10-16T13:49:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.475+0000 7fe1317fa700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe11806b2f0 0x7fe11806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.475+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe12808ae30 con 0x7fe124003a00 2023-10-16T13:49:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.475+0000 7fe133fff700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe11806b2f0 0x7fe11806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.476+0000 7fe133fff700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe11806b2f0 0x7fe11806d7b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe13414bfa0 tx=0x7fe120008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.480+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe128055a00 con 0x7fe124003a00 2023-10-16T13:49:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.680+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1340afc10 con 0x7fe124003a00 2023-10-16T13:49:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.682+0000 7fe1317fa700 1 -- 172.21.15.5:0/1099489214 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fe128017020 con 0x7fe124003a00 2023-10-16T13:49:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:15.685 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:15.084489+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6835/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6836/3556823542":"2023-10-17T13:49:08.644012+0000","172.21.15.112:6834/3556823542":"2023-10-17T13:49:08.644012+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe11806b2f0 msgr2=0x7fe11806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe11806b2f0 0x7fe11806d7b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe13414bfa0 tx=0x7fe120008040 comp rx=0 tx=0).stop 2023-10-16T13:49:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 msgr2=0x7fe1340c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe1340c7a10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c0e0 tx=0x7fe128001230 comp rx=0 tx=0).stop 2023-10-16T13:49:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 shutdown_connections 2023-10-16T13:49:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe13414dc10 0x7fe13414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe124003a00 0x7fe1340c7a10 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe11806b2f0 0x7fe11806d7b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 --2- 172.21.15.5:0/1099489214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe13414bb80 0x7fe1340c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 >> 172.21.15.5:0/1099489214 conn(0x7fe13406dae0 msgr2=0x7fe1340cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 shutdown_connections 2023-10-16T13:49:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.684+0000 7fe13aabd700 1 -- 172.21.15.5:0/1099489214 wait complete. 2023-10-16T13:49:15.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:48:49.002718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:48:50.114887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:15.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:15.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.827+0000 7f082fa8a700 1 Processor -- start 2023-10-16T13:49:15.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.828+0000 7f082fa8a700 1 -- start start 2023-10-16T13:49:15.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.828+0000 7f082fa8a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.828+0000 7f082fa8a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08280b1f50 0x7f08280cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.828+0000 7f082fa8a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082815e7a0 con 0x7f08280b23d0 2023-10-16T13:49:15.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.828+0000 7f082fa8a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082815f730 con 0x7f08280b1f50 2023-10-16T13:49:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.828+0000 7f082fa8a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280b29a0 con 0x7f082815ab10 2023-10-16T13:49:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082e027700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08280b23d0 0x7f08280cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59928/0 (socket says 172.21.15.5:59928) 2023-10-16T13:49:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082e027700 1 -- 172.21.15.5:0/4137183870 learned_addr learned my addr 172.21.15.5:0/4137183870 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d025700 1 --2- 172.21.15.5:0/4137183870 >> v2:172.21.15.112:3300/0 conn(0x7f08280b1f50 0x7f08280cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d826700 1 --2- 172.21.15.5:0/4137183870 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082c824700 1 -- 172.21.15.5:0/4137183870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640415167 0 0) 0x7f082815e7a0 con 0x7f08280b23d0 2023-10-16T13:49:15.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082c824700 1 -- 172.21.15.5:0/4137183870 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08140035b0 con 0x7f08280b23d0 2023-10-16T13:49:15.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082c824700 1 -- 172.21.15.5:0/4137183870 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1455987695 0 0) 0x7f08140035b0 con 0x7f08280b23d0 2023-10-16T13:49:15.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d826700 1 -- 172.21.15.5:0/4137183870 >> v2:172.21.15.112:3300/0 conn(0x7f08280b1f50 msgr2=0x7f08280cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d826700 1 --2- 172.21.15.5:0/4137183870 >> v2:172.21.15.112:3300/0 conn(0x7f08280b1f50 0x7f08280cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d826700 1 -- 172.21.15.5:0/4137183870 >> v1:172.21.15.5:6789/0 conn(0x7f08280b23d0 legacy=0x7f08280cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d826700 1 -- 172.21.15.5:0/4137183870 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280b2c80 con 0x7f082815ab10 2023-10-16T13:49:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d025700 1 --2- 172.21.15.5:0/4137183870 >> v2:172.21.15.112:3300/0 conn(0x7f08280b1f50 0x7f08280cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.829+0000 7f082d826700 1 --2- 172.21.15.5:0/4137183870 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815f1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0818009840 tx=0x7f0818009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d11c10b1ceb1fb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082c824700 1 -- 172.21.15.5:0/4137183870 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200019f0 con 0x7f082815ab10 2023-10-16T13:49:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082c824700 1 -- 172.21.15.5:0/4137183870 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818004030 con 0x7f082815ab10 2023-10-16T13:49:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082c824700 1 -- 172.21.15.5:0/4137183870 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180043c0 con 0x7f082815ab10 2023-10-16T13:49:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 -- 172.21.15.5:0/4137183870 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 msgr2=0x7f082815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 --2- 172.21.15.5:0/4137183870 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815f1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0818009840 tx=0x7f0818009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 -- 172.21.15.5:0/4137183870 shutdown_connections 2023-10-16T13:49:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 --2- 172.21.15.5:0/4137183870 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815f1f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 --2- 172.21.15.5:0/4137183870 >> v2:172.21.15.112:3300/0 conn(0x7f08280b1f50 0x7f08280cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 -- 172.21.15.5:0/4137183870 >> 172.21.15.5:0/4137183870 conn(0x7f082806dae0 msgr2=0x7f082806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 -- 172.21.15.5:0/4137183870 shutdown_connections 2023-10-16T13:49:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.830+0000 7f082fa8a700 1 -- 172.21.15.5:0/4137183870 wait complete. 2023-10-16T13:49:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.831+0000 7f082fa8a700 1 Processor -- start 2023-10-16T13:49:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.831+0000 7f082fa8a700 1 -- start start 2023-10-16T13:49:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082fa8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08280b1f50 0x7f08280c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082fa8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 0x7f082815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082fa8a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082fa8a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c6f70 con 0x7f08280b23d0 2023-10-16T13:49:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082fa8a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c65d0 con 0x7f08280b1f50 2023-10-16T13:49:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082fa8a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c68b0 con 0x7f082815ab10 2023-10-16T13:49:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082d025700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 0x7f082815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082d025700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 0x7f082815d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49928/0 (socket says 172.21.15.5:49928) 2023-10-16T13:49:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082d025700 1 -- 172.21.15.5:0/2108312059 learned_addr learned my addr 172.21.15.5:0/2108312059 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.832+0000 7f082d826700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08280b1f50 0x7f08280c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082e027700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082d025700 1 -- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 msgr2=0x7f082815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082d025700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082d025700 1 -- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08280b1f50 msgr2=0x7f08280c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082d025700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08280b1f50 0x7f08280c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082d025700 1 -- 172.21.15.5:0/2108312059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824009430 con 0x7f08280b23d0 2023-10-16T13:49:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082d025700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 0x7f082815d6f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f082400ebe0 tx=0x7f082400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824009740 con 0x7f08280b23d0 2023-10-16T13:49:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824005a20 con 0x7f08280b23d0 2023-10-16T13:49:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08180094a0 con 0x7f08280b23d0 2023-10-16T13:49:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824005db0 con 0x7f08280b23d0 2023-10-16T13:49:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.833+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0828146cb0 con 0x7f08280b23d0 2023-10-16T13:49:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.834+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08280c70b0 con 0x7f08280b23d0 2023-10-16T13:49:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.835+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f082400c850 con 0x7f08280b23d0 2023-10-16T13:49:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.835+0000 7f081e7fc700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f080c06b2f0 0x7f080c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.835+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0824089fd0 con 0x7f08280b23d0 2023-10-16T13:49:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.835+0000 7f082d826700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f080c06b2f0 0x7f080c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.836+0000 7f082d826700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f080c06b2f0 0x7f080c06d7b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f08180090b0 tx=0x7f0818008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:15.840+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08240549f0 con 0x7f08280b23d0 2023-10-16T13:49:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.039+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0828067ae0 con 0x7f08280b23d0 2023-10-16T13:49:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.040+0000 7f081e7fc700 1 -- 172.21.15.5:0/2108312059 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0824020020 con 0x7f08280b23d0 2023-10-16T13:49:16.043 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f080c06b2f0 msgr2=0x7f080c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f080c06b2f0 0x7f080c06d7b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f08180090b0 tx=0x7f0818008030 comp rx=0 tx=0).stop 2023-10-16T13:49:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 msgr2=0x7f082815d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 0x7f082815d6f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f082400ebe0 tx=0x7f082400eef0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 shutdown_connections 2023-10-16T13:49:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f080c06b2f0 0x7f080c06d7b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f082815ab10 0x7f082815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08280b1f50 0x7f08280c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 --2- 172.21.15.5:0/2108312059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280b23d0 0x7f082815d6f0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 >> 172.21.15.5:0/2108312059 conn(0x7f082806dae0 msgr2=0x7f08280cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 shutdown_connections 2023-10-16T13:49:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.042+0000 7f082fa8a700 1 -- 172.21.15.5:0/2108312059 wait complete. 2023-10-16T13:49:16.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:49:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.182+0000 7fd1c7a47700 1 Processor -- start 2023-10-16T13:49:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.183+0000 7fd1c7a47700 1 -- start start 2023-10-16T13:49:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.183+0000 7fd1c7a47700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1c00cf8a0 0x7fd1c00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.183+0000 7fd1c7a47700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c015ee90 con 0x7fd1c00d1bc0 2023-10-16T13:49:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1c7a47700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c0158370 con 0x7fd1c015eab0 2023-10-16T13:49:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1c7a47700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c00d23b0 con 0x7fd1c00cf8a0 2023-10-16T13:49:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1c5fe4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1c00d1bc0 0x7fd1c00cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59942/0 (socket says 172.21.15.5:59942) 2023-10-16T13:49:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1c5fe4700 1 -- 172.21.15.5:0/1311062912 learned_addr learned my addr 172.21.15.5:0/1311062912 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495341501 0 0) 0x7fd1c015ee90 con 0x7fd1c00d1bc0 2023-10-16T13:49:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1c4fe2700 1 --2- 172.21.15.5:0/1311062912 >> v2:172.21.15.112:3300/0 conn(0x7fd1c00cf8a0 0x7fd1c00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ac0035b0 con 0x7fd1c00d1bc0 2023-10-16T13:49:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243120639 0 0) 0x7fd1ac0035b0 con 0x7fd1c00d1bc0 2023-10-16T13:49:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 >> v2:172.21.15.112:3300/0 conn(0x7fd1c00cf8a0 msgr2=0x7fd1c00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 --2- 172.21.15.5:0/1311062912 >> v2:172.21.15.112:3300/0 conn(0x7fd1c00cf8a0 0x7fd1c00d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 >> v1:172.21.15.112:6789/0 conn(0x7fd1c015eab0 legacy=0x7fd1c00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00cda20 con 0x7fd1c00d1bc0 2023-10-16T13:49:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fd1b80019f0 con 0x7fd1c00d1bc0 2023-10-16T13:49:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 >> v1:172.21.15.5:6789/0 conn(0x7fd1c00d1bc0 legacy=0x7fd1c00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1ac003a00 0x7fd1ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1ac004850 0x7fd1ac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00d23b0 con 0x7fd1ac005210 2023-10-16T13:49:16.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac00c0b0 con 0x7fd1ac003a00 2023-10-16T13:49:16.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac00c270 con 0x7fd1ac004850 2023-10-16T13:49:16.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.184+0000 7fd1c5fe4700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c57e3700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1ac003a00 0x7fd1ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c4fe2700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1ac004850 0x7fd1ac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 -- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1ac004850 msgr2=0x7fd1ac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:16.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1ac004850 0x7fd1ac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 -- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1ac003a00 msgr2=0x7fd1ac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1ac003a00 0x7fd1ac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 -- 172.21.15.5:0/1311062912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0035b0 con 0x7fd1ac005210 2023-10-16T13:49:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 -- 172.21.15.5:0/1311062912 reap_dead start 2023-10-16T13:49:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1c5fe4700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1ac00ba10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800a830 tx=0x7fd1ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e762a3ce5c61f97 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800a2f0 con 0x7fd1ac005210 2023-10-16T13:49:16.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8012600 con 0x7fd1ac005210 2023-10-16T13:49:16.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.185+0000 7fd1b7fff700 1 -- 172.21.15.5:0/1311062912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80129b0 con 0x7fd1ac005210 2023-10-16T13:49:16.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 -- 172.21.15.5:0/1311062912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 msgr2=0x7fd1ac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1ac00ba10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800a830 tx=0x7fd1ac005880 comp rx=0 tx=0).stop 2023-10-16T13:49:16.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 -- 172.21.15.5:0/1311062912 shutdown_connections 2023-10-16T13:49:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/1311062912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1ac00ba10 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 -- 172.21.15.5:0/1311062912 >> 172.21.15.5:0/1311062912 conn(0x7fd1c00665a0 msgr2=0x7fd1c0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 -- 172.21.15.5:0/1311062912 shutdown_connections 2023-10-16T13:49:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.186+0000 7fd1c7a47700 1 -- 172.21.15.5:0/1311062912 wait complete. 2023-10-16T13:49:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.187+0000 7fd1c7a47700 1 Processor -- start 2023-10-16T13:49:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.187+0000 7fd1c7a47700 1 -- start start 2023-10-16T13:49:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c7a47700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1c01f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c7a47700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1c0151710 0x7fd1c0160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c7a47700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1c0160ad0 0x7fd1c01f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c7a47700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0160f80 con 0x7fd1ac005210 2023-10-16T13:49:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c7a47700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c01f3e10 con 0x7fd1c0160ad0 2023-10-16T13:49:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c7a47700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c015fe80 con 0x7fd1c0151710 2023-10-16T13:49:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1c01f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1c01f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49946/0 (socket says 172.21.15.5:49946) 2023-10-16T13:49:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 -- 172.21.15.5:0/3228077024 learned_addr learned my addr 172.21.15.5:0/3228077024 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c4fe2700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1c0151710 0x7fd1c0160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c5fe4700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1c0160ad0 0x7fd1c01f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 -- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1c0151710 msgr2=0x7fd1c0160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1c0151710 0x7fd1c0160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 -- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1c0160ad0 msgr2=0x7fd1c01f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1c0160ad0 0x7fd1c01f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 -- 172.21.15.5:0/3228077024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c015f300 con 0x7fd1ac005210 2023-10-16T13:49:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1c57e3700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1c01f38d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000f7f0 tx=0x7fd1b000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00052e0 con 0x7fd1ac005210 2023-10-16T13:49:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.188+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0005440 con 0x7fd1ac005210 2023-10-16T13:49:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.189+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c015f5e0 con 0x7fd1ac005210 2023-10-16T13:49:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.189+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00038a0 con 0x7fd1ac005210 2023-10-16T13:49:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.189+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c015fba0 con 0x7fd1ac005210 2023-10-16T13:49:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.189+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c00cf030 con 0x7fd1ac005210 2023-10-16T13:49:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.190+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fd1b0003a00 con 0x7fd1ac005210 2023-10-16T13:49:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.190+0000 7fd1b5ffb700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd1a406b2f0 0x7fd1a406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.191+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd1b0089c00 con 0x7fd1ac005210 2023-10-16T13:49:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.191+0000 7fd1c4fe2700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd1a406b2f0 0x7fd1a406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.191+0000 7fd1c4fe2700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd1a406b2f0 0x7fd1a406d7b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00b73d0 tx=0x7fd1bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.195+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1b0054620 con 0x7fd1ac005210 2023-10-16T13:49:16.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.396+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1c0067d20 con 0x7fd1ac005210 2023-10-16T13:49:16.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.396+0000 7fd1b5ffb700 1 -- 172.21.15.5:0/3228077024 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1b005e070 con 0x7fd1ac005210 2023-10-16T13:49:16.399 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:49:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd1a406b2f0 msgr2=0x7fd1a406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd1a406b2f0 0x7fd1a406d7b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00b73d0 tx=0x7fd1bc008040 comp rx=0 tx=0).stop 2023-10-16T13:49:16.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 msgr2=0x7fd1c01f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1c01f38d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000f7f0 tx=0x7fd1b000fbb0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 shutdown_connections 2023-10-16T13:49:16.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1c0160ad0 0x7fd1c01f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ac005210 0x7fd1c01f38d0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fd1a406b2f0 0x7fd1a406d7b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 --2- 172.21.15.5:0/3228077024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1c0151710 0x7fd1c0160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 >> 172.21.15.5:0/3228077024 conn(0x7fd1c00665a0 msgr2=0x7fd1c00b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 shutdown_connections 2023-10-16T13:49:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.398+0000 7fd1c7a47700 1 -- 172.21.15.5:0/3228077024 wait complete. 2023-10-16T13:49:16.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:49:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.538+0000 7fadd01d1700 1 Processor -- start 2023-10-16T13:49:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.538+0000 7fadd01d1700 1 -- start start 2023-10-16T13:49:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadd01d1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadd01d1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadc806eb30 0x7fadc80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadd01d1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc80b5c70 con 0x7fadc80b54f0 2023-10-16T13:49:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadd01d1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc80b5990 con 0x7fadc806eb30 2023-10-16T13:49:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadd01d1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc815b2b0 con 0x7fadc806e750 2023-10-16T13:49:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadc806eb30 0x7fadc80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadc806eb30 0x7fadc80cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49954/0 (socket says 172.21.15.5:49954) 2023-10-16T13:49:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 -- 172.21.15.5:0/3569272738 learned_addr learned my addr 172.21.15.5:0/3569272738 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcdf6d700 1 --2- 172.21.15.5:0/3569272738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 -- 172.21.15.5:0/3569272738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 msgr2=0x7fadc80ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 --2- 172.21.15.5:0/3569272738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 -- 172.21.15.5:0/3569272738 >> v1:172.21.15.112:6789/0 conn(0x7fadc80b54f0 legacy=0x7fadc815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.539+0000 7fadcd76c700 1 -- 172.21.15.5:0/3569272738 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc815b590 con 0x7fadc806eb30 2023-10-16T13:49:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadcd76c700 1 --2- 172.21.15.5:0/3569272738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc806eb30 0x7fadc80cf400 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fadb80098f0 tx=0x7fadb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1c76849ce2bb12 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadccf6b700 1 -- 172.21.15.5:0/3569272738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8011830 con 0x7fadc806eb30 2023-10-16T13:49:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadccf6b700 1 -- 172.21.15.5:0/3569272738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8011990 con 0x7fadc806eb30 2023-10-16T13:49:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadccf6b700 1 -- 172.21.15.5:0/3569272738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8011d20 con 0x7fadc806eb30 2023-10-16T13:49:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 -- 172.21.15.5:0/3569272738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc806eb30 msgr2=0x7fadc80cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 --2- 172.21.15.5:0/3569272738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc806eb30 0x7fadc80cf400 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fadb80098f0 tx=0x7fadb8009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 -- 172.21.15.5:0/3569272738 shutdown_connections 2023-10-16T13:49:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 --2- 172.21.15.5:0/3569272738 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 --2- 172.21.15.5:0/3569272738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc806eb30 0x7fadc80cf400 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 -- 172.21.15.5:0/3569272738 >> 172.21.15.5:0/3569272738 conn(0x7fadc80cc6f0 msgr2=0x7fadc80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.540+0000 7fadd01d1700 1 -- 172.21.15.5:0/3569272738 shutdown_connections 2023-10-16T13:49:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.541+0000 7fadd01d1700 1 -- 172.21.15.5:0/3569272738 wait complete. 2023-10-16T13:49:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.542+0000 7fadd01d1700 1 Processor -- start 2023-10-16T13:49:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.542+0000 7fadd01d1700 1 -- start start 2023-10-16T13:49:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.542+0000 7fadd01d1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.542+0000 7fadd01d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc806eb30 0x7fadc80c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.542+0000 7fadd01d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 0x7fadc815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadd01d1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8147540 con 0x7fadc80b54f0 2023-10-16T13:49:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadd01d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80c3340 con 0x7fadc806eb30 2023-10-16T13:49:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadd01d1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8146f10 con 0x7fadc806e750 2023-10-16T13:49:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 0x7fadc815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 0x7fadc815bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49964/0 (socket says 172.21.15.5:49964) 2023-10-16T13:49:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 -- 172.21.15.5:0/1331362353 learned_addr learned my addr 172.21.15.5:0/1331362353 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadcd76c700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc806eb30 0x7fadc80c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadcdf6d700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 -- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 msgr2=0x7fadc80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 -- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc806eb30 msgr2=0x7fadc80c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc806eb30 0x7fadc80c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 -- 172.21.15.5:0/1331362353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb8009550 con 0x7fadc80b54f0 2023-10-16T13:49:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadce76e700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 0x7fadc815bbe0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fadc000cb50 tx=0x7fadc000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003c00 con 0x7fadc80b54f0 2023-10-16T13:49:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0003d60 con 0x7fadc80b54f0 2023-10-16T13:49:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc80c99d0 con 0x7fadc80b54f0 2023-10-16T13:49:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000aa20 con 0x7fadc80b54f0 2023-10-16T13:49:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.543+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc81471d0 con 0x7fadc80b54f0 2023-10-16T13:49:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.544+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc8147360 con 0x7fadc80b54f0 2023-10-16T13:49:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.545+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fadc000ab80 con 0x7fadc80b54f0 2023-10-16T13:49:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.545+0000 7fadbe7fc700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadac06b2f0 0x7fadac06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.545+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fadc0089dd0 con 0x7fadc80b54f0 2023-10-16T13:49:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.545+0000 7fadcdf6d700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadac06b2f0 0x7fadac06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.546+0000 7fadcdf6d700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadac06b2f0 0x7fadac06d7b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009be0 tx=0x7fadc4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.550+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadc00547f0 con 0x7fadc80b54f0 2023-10-16T13:49:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.752+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fadc8067d20 con 0x7fadc80b54f0 2023-10-16T13:49:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.752+0000 7fadbe7fc700 1 -- 172.21.15.5:0/1331362353 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7fadc0057e10 con 0x7fadc80b54f0 2023-10-16T13:49:16.756 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:49:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadac06b2f0 msgr2=0x7fadac06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadac06b2f0 0x7fadac06d7b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009be0 tx=0x7fadc4009210 comp rx=0 tx=0).stop 2023-10-16T13:49:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 msgr2=0x7fadc815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 0x7fadc815bbe0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fadc000cb50 tx=0x7fadc000ce60 comp rx=0 tx=0).stop 2023-10-16T13:49:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 shutdown_connections 2023-10-16T13:49:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadc80b54f0 0x7fadc815bbe0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fadac06b2f0 0x7fadac06d7b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadc806e750 0x7fadc80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.754+0000 7fadd01d1700 1 --2- 172.21.15.5:0/1331362353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc806eb30 0x7fadc80c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.755+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 >> 172.21.15.5:0/1331362353 conn(0x7fadc80cc6f0 msgr2=0x7fadc80711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.755+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 shutdown_connections 2023-10-16T13:49:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.755+0000 7fadd01d1700 1 -- 172.21.15.5:0/1331362353 wait complete. 2023-10-16T13:49:16.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:49:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.893+0000 7fe7e756b700 1 Processor -- start 2023-10-16T13:49:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.893+0000 7fe7e756b700 1 -- start start 2023-10-16T13:49:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e756b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7e015a850 0x7fe7e00cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e756b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7e00cd4b0 0x7fe7e00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e756b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00ce3b0 con 0x7fe7e00b2940 2023-10-16T13:49:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e756b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e00b2df0 con 0x7fe7e00cd4b0 2023-10-16T13:49:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e756b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e00b6290 con 0x7fe7e015a850 2023-10-16T13:49:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5b08700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7e00cd4b0 0x7fe7e00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e4b06700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe7e00b2940 0x7fe7e00ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59972/0 (socket says 172.21.15.5:59972) 2023-10-16T13:49:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e4b06700 1 -- 172.21.15.5:0/608588292 learned_addr learned my addr 172.21.15.5:0/608588292 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5307700 1 --2- 172.21.15.5:0/608588292 >> v2:172.21.15.112:3300/0 conn(0x7fe7e015a850 0x7fe7e00cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5b08700 1 -- 172.21.15.5:0/608588292 >> v2:172.21.15.112:3300/0 conn(0x7fe7e015a850 msgr2=0x7fe7e00cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5b08700 1 --2- 172.21.15.5:0/608588292 >> v2:172.21.15.112:3300/0 conn(0x7fe7e015a850 0x7fe7e00cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5b08700 1 -- 172.21.15.5:0/608588292 >> v1:172.21.15.5:6789/0 conn(0x7fe7e00b2940 legacy=0x7fe7e00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5b08700 1 -- 172.21.15.5:0/608588292 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00cc220 con 0x7fe7e00cd4b0 2023-10-16T13:49:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7e5307700 1 --2- 172.21.15.5:0/608588292 >> v2:172.21.15.112:3300/0 conn(0x7fe7e015a850 0x7fe7e00cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.894+0000 7fe7d7fff700 1 -- 172.21.15.5:0/608588292 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773935742 0 0) 0x7fe7e00ce3b0 con 0x7fe7e00b2940 2023-10-16T13:49:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e5b08700 1 --2- 172.21.15.5:0/608588292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00ce840 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe7e006f5b0 tx=0x7fe7d800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c879927a291c2364 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7d7fff700 1 -- 172.21.15.5:0/608588292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8010070 con 0x7fe7e00cd4b0 2023-10-16T13:49:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7d7fff700 1 -- 172.21.15.5:0/608588292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800b2e0 con 0x7fe7e00cd4b0 2023-10-16T13:49:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7d7fff700 1 -- 172.21.15.5:0/608588292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800dcc0 con 0x7fe7e00cd4b0 2023-10-16T13:49:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 -- 172.21.15.5:0/608588292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00cd4b0 msgr2=0x7fe7e00ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 --2- 172.21.15.5:0/608588292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00ce840 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe7e006f5b0 tx=0x7fe7d800d330 comp rx=0 tx=0).stop 2023-10-16T13:49:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 -- 172.21.15.5:0/608588292 shutdown_connections 2023-10-16T13:49:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 --2- 172.21.15.5:0/608588292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00ce840 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 --2- 172.21.15.5:0/608588292 >> v2:172.21.15.112:3300/0 conn(0x7fe7e015a850 0x7fe7e00cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 -- 172.21.15.5:0/608588292 >> 172.21.15.5:0/608588292 conn(0x7fe7e006dac0 msgr2=0x7fe7e006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 -- 172.21.15.5:0/608588292 shutdown_connections 2023-10-16T13:49:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.895+0000 7fe7e756b700 1 -- 172.21.15.5:0/608588292 wait complete. 2023-10-16T13:49:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 Processor -- start 2023-10-16T13:49:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 -- start start 2023-10-16T13:49:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 0x7fe7e00ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7e015a850 0x7fe7e01f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00c5f50 con 0x7fe7e00b2940 2023-10-16T13:49:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e01f4050 con 0x7fe7e00cd4b0 2023-10-16T13:49:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e756b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00c56b0 con 0x7fe7e015a850 2023-10-16T13:49:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e5307700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 0x7fe7e00ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e5307700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 0x7fe7e00ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49974/0 (socket says 172.21.15.5:49974) 2023-10-16T13:49:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.897+0000 7fe7e5307700 1 -- 172.21.15.5:0/4186678982 learned_addr learned my addr 172.21.15.5:0/4186678982 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e4b06700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5b08700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7e015a850 0x7fe7e01f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5307700 1 -- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7e015a850 msgr2=0x7fe7e01f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5307700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7e015a850 0x7fe7e01f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5307700 1 -- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e00cd4b0 msgr2=0x7fe7e00c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5307700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5307700 1 -- 172.21.15.5:0/4186678982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d800bc80 con 0x7fe7e00b2940 2023-10-16T13:49:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e5307700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 0x7fe7e00ad7e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000c7f0 tx=0x7fe7d000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0011800 con 0x7fe7e00b2940 2023-10-16T13:49:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0011960 con 0x7fe7e00b2940 2023-10-16T13:49:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e00c5990 con 0x7fe7e00b2940 2023-10-16T13:49:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0011cf0 con 0x7fe7e00b2940 2023-10-16T13:49:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.898+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00ae430 con 0x7fe7e00b2940 2023-10-16T13:49:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.899+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e00ae7a0 con 0x7fe7e00b2940 2023-10-16T13:49:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.900+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe7d0018360 con 0x7fe7e00b2940 2023-10-16T13:49:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.900+0000 7fe7d5ffb700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe7c406b2f0 0x7fe7c406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.900+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe7d0089d00 con 0x7fe7e00b2940 2023-10-16T13:49:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.901+0000 7fe7e4b06700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe7c406b2f0 0x7fe7c406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.901+0000 7fe7e4b06700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe7c406b2f0 0x7fe7c406d7b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00c6640 tx=0x7fe7dc007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:16.905+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7d00546a0 con 0x7fe7e00b2940 2023-10-16T13:49:17.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.121+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7e006b730 con 0x7fe7e00b2940 2023-10-16T13:49:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.122+0000 7fe7d5ffb700 1 -- 172.21.15.5:0/4186678982 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v124) v1 ==== 80+0+248 (secure 0 0 0) 0x7fe7d001f110 con 0x7fe7e00b2940 2023-10-16T13:49:17.125 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6837/2690348630 2023-10-17T13:49:12.077139+0000 2023-10-16T13:49:17.125 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6835/2690348630 2023-10-17T13:49:12.077139+0000 2023-10-16T13:49:17.125 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6836/3556823542 2023-10-17T13:49:08.644012+0000 2023-10-16T13:49:17.126 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6834/3556823542 2023-10-17T13:49:08.644012+0000 2023-10-16T13:49:17.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe7c406b2f0 msgr2=0x7fe7c406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe7c406b2f0 0x7fe7c406d7b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00c6640 tx=0x7fe7dc007e70 comp rx=0 tx=0).stop 2023-10-16T13:49:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 msgr2=0x7fe7e00ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 0x7fe7e00ad7e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000c7f0 tx=0x7fe7d000cb00 comp rx=0 tx=0).stop 2023-10-16T13:49:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 shutdown_connections 2023-10-16T13:49:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe7c406b2f0 0x7fe7c406d7b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7e015a850 0x7fe7e01f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00b2940 0x7fe7e00ad7e0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 --2- 172.21.15.5:0/4186678982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e00cd4b0 0x7fe7e00c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 >> 172.21.15.5:0/4186678982 conn(0x7fe7e006dac0 msgr2=0x7fe7e00afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 shutdown_connections 2023-10-16T13:49:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.124+0000 7fe7e756b700 1 -- 172.21.15.5:0/4186678982 wait complete. 2023-10-16T13:49:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2023-10-16T13:49:17.139 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:49:17.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:17.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:49:17.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:49:17.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:17.187 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:49:17.204 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:17.204 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:17.226 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:17.226 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:17.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.408+0000 7efce8925700 1 Processor -- start 2023-10-16T13:49:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.409+0000 7efce8925700 1 -- start start 2023-10-16T13:49:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.409+0000 7efce8925700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce415ab10 0x7efce415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.409+0000 7efce8925700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efce40b1f50 0x7efce40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.409+0000 7efce8925700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce415e7a0 con 0x7efce40b23d0 2023-10-16T13:49:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.409+0000 7efce8925700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce415f730 con 0x7efce40b1f50 2023-10-16T13:49:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.409+0000 7efce8925700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce40b29a0 con 0x7efce415ab10 2023-10-16T13:49:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efce40b1f50 0x7efce40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efce40b1f50 0x7efce40cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49982/0 (socket says 172.21.15.5:49982) 2023-10-16T13:49:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 -- 172.21.15.5:0/2605230962 learned_addr learned my addr 172.21.15.5:0/2605230962 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce259c700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce415ab10 0x7efce415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 -- 172.21.15.5:0/2605230962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce415ab10 msgr2=0x7efce415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce415ab10 0x7efce415f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 -- 172.21.15.5:0/2605230962 >> v1:172.21.15.112:6789/0 conn(0x7efce40b23d0 legacy=0x7efce40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 -- 172.21.15.5:0/2605230962 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40b2c80 con 0x7efce40b1f50 2023-10-16T13:49:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce259c700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce415ab10 0x7efce415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce1d9b700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40cf720 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efcd4006fd0 tx=0x7efcd4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d07055a5bc63145 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce159a700 1 -- 172.21.15.5:0/2605230962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4005e30 con 0x7efce40b1f50 2023-10-16T13:49:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce159a700 1 -- 172.21.15.5:0/2605230962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4004030 con 0x7efce40b1f50 2023-10-16T13:49:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.410+0000 7efce159a700 1 -- 172.21.15.5:0/2605230962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40043e0 con 0x7efce40b1f50 2023-10-16T13:49:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 -- 172.21.15.5:0/2605230962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 msgr2=0x7efce40cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40cf720 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efcd4006fd0 tx=0x7efcd4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 -- 172.21.15.5:0/2605230962 shutdown_connections 2023-10-16T13:49:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce415ab10 0x7efce415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 --2- 172.21.15.5:0/2605230962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40cf720 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 -- 172.21.15.5:0/2605230962 >> 172.21.15.5:0/2605230962 conn(0x7efce406dae0 msgr2=0x7efce406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 -- 172.21.15.5:0/2605230962 shutdown_connections 2023-10-16T13:49:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.411+0000 7efce8925700 1 -- 172.21.15.5:0/2605230962 wait complete. 2023-10-16T13:49:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.412+0000 7efce8925700 1 Processor -- start 2023-10-16T13:49:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.412+0000 7efce8925700 1 -- start start 2023-10-16T13:49:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce8925700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce8925700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce40b23d0 0x7efce414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce8925700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce415ab10 0x7efce414a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce8925700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40b56d0 con 0x7efce40b1f50 2023-10-16T13:49:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce8925700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce414fd60 con 0x7efce415ab10 2023-10-16T13:49:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce8925700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce414f7a0 con 0x7efce40b23d0 2023-10-16T13:49:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49986/0 (socket says 172.21.15.5:49986) 2023-10-16T13:49:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 -- 172.21.15.5:0/2363105041 learned_addr learned my addr 172.21.15.5:0/2363105041 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce2d9d700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce415ab10 0x7efce414a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce1d9b700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce40b23d0 0x7efce414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 -- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce40b23d0 msgr2=0x7efce414ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce40b23d0 0x7efce414ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 -- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce415ab10 msgr2=0x7efce414a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce415ab10 0x7efce414a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce259c700 1 -- 172.21.15.5:0/2363105041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4009500 con 0x7efce40b1f50 2023-10-16T13:49:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.413+0000 7efce1d9b700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce40b23d0 0x7efce414ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.414+0000 7efce259c700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40b5b60 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7efcd800e810 tx=0x7efcd800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.414+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8004230 con 0x7efce40b1f50 2023-10-16T13:49:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.414+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd80043b0 con 0x7efce40b1f50 2023-10-16T13:49:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.414+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce414fa80 con 0x7efce40b1f50 2023-10-16T13:49:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.414+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80038e0 con 0x7efce40b1f50 2023-10-16T13:49:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.414+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce414f380 con 0x7efce40b1f50 2023-10-16T13:49:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.415+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4067d20 con 0x7efce40b1f50 2023-10-16T13:49:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.415+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7efcd8003a40 con 0x7efce40b1f50 2023-10-16T13:49:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.416+0000 7efcd2ffd700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efcc406b2f0 0x7efcc406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.416+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7efcd80898d0 con 0x7efce40b1f50 2023-10-16T13:49:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.416+0000 7efce1d9b700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efcc406b2f0 0x7efcc406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.416+0000 7efce1d9b700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efcc406b2f0 0x7efcc406d7b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efcd4000c00 tx=0x7efcd4008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.421+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcd8054270 con 0x7efce40b1f50 2023-10-16T13:49:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.624+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efce40afc10 con 0x7efce40b1f50 2023-10-16T13:49:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.625+0000 7efcd2ffd700 1 -- 172.21.15.5:0/2363105041 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16770 (secure 0 0 0) 0x7efcd8089020 con 0x7efce40b1f50 2023-10-16T13:49:17.629 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:17.629 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:15.084489+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6835/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6836/3556823542":"2023-10-17T13:49:08.644012+0000","172.21.15.112:6834/3556823542":"2023-10-17T13:49:08.644012+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efcc406b2f0 msgr2=0x7efcc406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efcc406b2f0 0x7efcc406d7b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efcd4000c00 tx=0x7efcd4008070 comp rx=0 tx=0).stop 2023-10-16T13:49:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 msgr2=0x7efce40b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40b5b60 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7efcd800e810 tx=0x7efcd800eb20 comp rx=0 tx=0).stop 2023-10-16T13:49:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 shutdown_connections 2023-10-16T13:49:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce415ab10 0x7efce414a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efce40b1f50 0x7efce40b5b60 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efcc406b2f0 0x7efcc406d7b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 --2- 172.21.15.5:0/2363105041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce40b23d0 0x7efce414ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 >> 172.21.15.5:0/2363105041 conn(0x7efce406dae0 msgr2=0x7efce40afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 shutdown_connections 2023-10-16T13:49:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.628+0000 7efce8925700 1 -- 172.21.15.5:0/2363105041 wait complete. 2023-10-16T13:49:17.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:48:49.002718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:48:50.114887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:17.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:17.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.768+0000 7f252070e700 1 Processor -- start 2023-10-16T13:49:17.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.768+0000 7f252070e700 1 -- start start 2023-10-16T13:49:17.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f252070e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f251815ab10 0x7f251815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f252070e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251815e7a0 con 0x7f25180cfe30 2023-10-16T13:49:17.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f252070e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251815f730 con 0x7f25180b1f50 2023-10-16T13:49:17.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f252070e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180b29a0 con 0x7f251815ab10 2023-10-16T13:49:17.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f251e4aa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f251815ab10 0x7f251815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f251ecab700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25180cfe30 0x7f25180cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60002/0 (socket says 172.21.15.5:60002) 2023-10-16T13:49:17.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.769+0000 7f251ecab700 1 -- 172.21.15.5:0/3021442740 learned_addr learned my addr 172.21.15.5:0/3021442740 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:17.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251e4aa700 1 -- 172.21.15.5:0/3021442740 >> v1:172.21.15.112:6789/0 conn(0x7f25180b1f50 legacy=0x7f25180cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251e4aa700 1 -- 172.21.15.5:0/3021442740 >> v1:172.21.15.5:6789/0 conn(0x7f25180cfe30 legacy=0x7f25180cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251e4aa700 1 -- 172.21.15.5:0/3021442740 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180b2c80 con 0x7f251815ab10 2023-10-16T13:49:17.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251d4a8700 1 -- 172.21.15.5:0/3021442740 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071857455 0 0) 0x7f251815e7a0 con 0x7f25180cfe30 2023-10-16T13:49:17.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251e4aa700 1 --2- 172.21.15.5:0/3021442740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251815ab10 0x7f251815f1f0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2508009840 tx=0x7f2508009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c5552b8fa34ddd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:17.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251d4a8700 1 -- 172.21.15.5:0/3021442740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011830 con 0x7f251815ab10 2023-10-16T13:49:17.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251d4a8700 1 -- 172.21.15.5:0/3021442740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508011990 con 0x7f251815ab10 2023-10-16T13:49:17.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.770+0000 7f251d4a8700 1 -- 172.21.15.5:0/3021442740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011d20 con 0x7f251815ab10 2023-10-16T13:49:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 -- 172.21.15.5:0/3021442740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251815ab10 msgr2=0x7f251815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 --2- 172.21.15.5:0/3021442740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251815ab10 0x7f251815f1f0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2508009840 tx=0x7f2508009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 -- 172.21.15.5:0/3021442740 shutdown_connections 2023-10-16T13:49:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 --2- 172.21.15.5:0/3021442740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251815ab10 0x7f251815f1f0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 -- 172.21.15.5:0/3021442740 >> 172.21.15.5:0/3021442740 conn(0x7f251806dae0 msgr2=0x7f251806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:17.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 -- 172.21.15.5:0/3021442740 shutdown_connections 2023-10-16T13:49:17.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.771+0000 7f252070e700 1 -- 172.21.15.5:0/3021442740 wait complete. 2023-10-16T13:49:17.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.772+0000 7f252070e700 1 Processor -- start 2023-10-16T13:49:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.772+0000 7f252070e700 1 -- start start 2023-10-16T13:49:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f252070e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 0x7f2518148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f252070e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25180cfe30 0x7f25180c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f252070e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f251815ab10 0x7f25180adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f252070e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180ac8b0 con 0x7f25180b1f50 2023-10-16T13:49:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f252070e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180ad6a0 con 0x7f25180cfe30 2023-10-16T13:49:17.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f252070e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180aca90 con 0x7f251815ab10 2023-10-16T13:49:17.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 0x7f2518148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 0x7f2518148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50000/0 (socket says 172.21.15.5:50000) 2023-10-16T13:49:17.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 -- 172.21.15.5:0/3736375593 learned_addr learned my addr 172.21.15.5:0/3736375593 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:17.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251dca9700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25180cfe30 0x7f25180c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251ecab700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f251815ab10 0x7f25180adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 -- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f251815ab10 msgr2=0x7f25180adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f251815ab10 0x7f25180adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 -- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25180cfe30 msgr2=0x7f25180c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25180cfe30 0x7f25180c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 -- 172.21.15.5:0/3736375593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080094a0 con 0x7f25180b1f50 2023-10-16T13:49:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251ecab700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f251815ab10 0x7f25180adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f251e4aa700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 0x7f2518148b10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f25080090b0 tx=0x7f2508004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.773+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250801a8d0 con 0x7f25180b1f50 2023-10-16T13:49:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.774+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250801aa50 con 0x7f25180b1f50 2023-10-16T13:49:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.774+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25180acd70 con 0x7f25180b1f50 2023-10-16T13:49:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.774+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250801ae00 con 0x7f25180b1f50 2023-10-16T13:49:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.774+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25180ad330 con 0x7f25180b1f50 2023-10-16T13:49:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.775+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2518067d20 con 0x7f25180b1f50 2023-10-16T13:49:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.775+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2508022070 con 0x7f25180b1f50 2023-10-16T13:49:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.775+0000 7f250effd700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f24fc06b2f0 0x7f24fc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.776+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f250808b0c0 con 0x7f25180b1f50 2023-10-16T13:49:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.776+0000 7f251dca9700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f24fc06b2f0 0x7f24fc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.776+0000 7f251dca9700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f24fc06b2f0 0x7f24fc06d7b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f251815a360 tx=0x7f2514009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.780+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2508055b70 con 0x7f25180b1f50 2023-10-16T13:49:17.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.981+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25180afc10 con 0x7f25180b1f50 2023-10-16T13:49:17.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.982+0000 7f250effd700 1 -- 172.21.15.5:0/3736375593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25080150a0 con 0x7f25180b1f50 2023-10-16T13:49:17.985 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f24fc06b2f0 msgr2=0x7f24fc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f24fc06b2f0 0x7f24fc06d7b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f251815a360 tx=0x7f2514009040 comp rx=0 tx=0).stop 2023-10-16T13:49:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 msgr2=0x7f2518148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 0x7f2518148b10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f25080090b0 tx=0x7f2508004750 comp rx=0 tx=0).stop 2023-10-16T13:49:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 shutdown_connections 2023-10-16T13:49:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f24fc06b2f0 0x7f24fc06d7b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f251815ab10 0x7f25180adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25180b1f50 0x7f2518148b10 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 --2- 172.21.15.5:0/3736375593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25180cfe30 0x7f25180c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 >> 172.21.15.5:0/3736375593 conn(0x7f251806dae0 msgr2=0x7f25180b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 shutdown_connections 2023-10-16T13:49:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:17.984+0000 7f252070e700 1 -- 172.21.15.5:0/3736375593 wait complete. 2023-10-16T13:49:17.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:49:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.125+0000 7fcc98b2a700 1 Processor -- start 2023-10-16T13:49:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.125+0000 7fcc98b2a700 1 -- start start 2023-10-16T13:49:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.125+0000 7fcc98b2a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cd950 0x7fcc9415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc98b2a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc940cede0 0x7fcc9415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc98b2a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc940cf260 con 0x7fcc9406a840 2023-10-16T13:49:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc98b2a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc941619a0 con 0x7fcc940cede0 2023-10-16T13:49:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc98b2a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940b2d60 con 0x7fcc940cd950 2023-10-16T13:49:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc92d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc9406a840 0x7fcc94161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60016/0 (socket says 172.21.15.5:60016) 2023-10-16T13:49:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc92d9d700 1 -- 172.21.15.5:0/1147087940 learned_addr learned my addr 172.21.15.5:0/1147087940 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc91d9b700 1 --2- 172.21.15.5:0/1147087940 >> v2:172.21.15.112:3300/0 conn(0x7fcc940cede0 0x7fcc9415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc9259c700 1 --2- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cd950 0x7fcc9415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc9159a700 1 -- 172.21.15.5:0/1147087940 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902586313 0 0) 0x7fcc940cf260 con 0x7fcc9406a840 2023-10-16T13:49:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc9159a700 1 -- 172.21.15.5:0/1147087940 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc7c0035b0 con 0x7fcc9406a840 2023-10-16T13:49:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc91d9b700 1 -- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cd950 msgr2=0x7fcc9415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc91d9b700 1 --2- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cd950 0x7fcc9415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc91d9b700 1 -- 172.21.15.5:0/1147087940 >> v1:172.21.15.5:6789/0 conn(0x7fcc9406a840 legacy=0x7fcc94161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc91d9b700 1 -- 172.21.15.5:0/1147087940 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940cdd30 con 0x7fcc940cede0 2023-10-16T13:49:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.126+0000 7fcc91d9b700 1 --2- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cede0 0x7fcc9415f570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009820 tx=0x7fcc84009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96ebfeaee38d91f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc9159a700 1 -- 172.21.15.5:0/1147087940 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84005e30 con 0x7fcc940cede0 2023-10-16T13:49:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc9159a700 1 -- 172.21.15.5:0/1147087940 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84006030 con 0x7fcc940cede0 2023-10-16T13:49:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc9159a700 1 -- 172.21.15.5:0/1147087940 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc840063c0 con 0x7fcc940cede0 2023-10-16T13:49:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 -- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cede0 msgr2=0x7fcc9415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cede0 0x7fcc9415f570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009820 tx=0x7fcc84009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 -- 172.21.15.5:0/1147087940 shutdown_connections 2023-10-16T13:49:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cd950 0x7fcc9415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/1147087940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cede0 0x7fcc9415f570 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 -- 172.21.15.5:0/1147087940 >> 172.21.15.5:0/1147087940 conn(0x7fcc9406dae0 msgr2=0x7fcc9406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 -- 172.21.15.5:0/1147087940 shutdown_connections 2023-10-16T13:49:18.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.127+0000 7fcc98b2a700 1 -- 172.21.15.5:0/1147087940 wait complete. 2023-10-16T13:49:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 Processor -- start 2023-10-16T13:49:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 -- start start 2023-10-16T13:49:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 0x7fcc940c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd950 0x7fcc940c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cede0 0x7fcc940c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc941f80f0 con 0x7fcc9406a840 2023-10-16T13:49:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940b4a00 con 0x7fcc940cd950 2023-10-16T13:49:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.129+0000 7fcc98b2a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940b4ce0 con 0x7fcc940cede0 2023-10-16T13:49:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 0x7fcc940c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 0x7fcc940c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50016/0 (socket says 172.21.15.5:50016) 2023-10-16T13:49:18.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 -- 172.21.15.5:0/3675869960 learned_addr learned my addr 172.21.15.5:0/3675869960 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc91d9b700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd950 0x7fcc940c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc92d9d700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cede0 0x7fcc940c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 -- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cede0 msgr2=0x7fcc940c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cede0 0x7fcc940c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 -- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd950 msgr2=0x7fcc940c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd950 0x7fcc940c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 -- 172.21.15.5:0/3675869960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84009430 con 0x7fcc9406a840 2023-10-16T13:49:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc92d9d700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cede0 0x7fcc940c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc9259c700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 0x7fcc940c5970 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9b0 tx=0x7fcc8800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88009710 con 0x7fcc9406a840 2023-10-16T13:49:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800c850 con 0x7fcc9406a840 2023-10-16T13:49:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc940b4fc0 con 0x7fcc9406a840 2023-10-16T13:49:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800cbc0 con 0x7fcc9406a840 2023-10-16T13:49:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.130+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc940c5eb0 con 0x7fcc9406a840 2023-10-16T13:49:18.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.131+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc94067d20 con 0x7fcc9406a840 2023-10-16T13:49:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.132+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fcc8800cd20 con 0x7fcc9406a840 2023-10-16T13:49:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.132+0000 7fcc82ffd700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc7406b2f0 0x7fcc7406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.132+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fcc88089ed0 con 0x7fcc9406a840 2023-10-16T13:49:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.132+0000 7fcc91d9b700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc7406b2f0 0x7fcc7406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.133+0000 7fcc91d9b700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc7406b2f0 0x7fcc7406d7b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcc84000c00 tx=0x7fcc84008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.137+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc880548f0 con 0x7fcc9406a840 2023-10-16T13:49:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.337+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc940b5610 con 0x7fcc9406a840 2023-10-16T13:49:18.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.338+0000 7fcc82ffd700 1 -- 172.21.15.5:0/3675869960 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc88021020 con 0x7fcc9406a840 2023-10-16T13:49:18.341 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:49:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc7406b2f0 msgr2=0x7fcc7406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc7406b2f0 0x7fcc7406d7b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcc84000c00 tx=0x7fcc84008070 comp rx=0 tx=0).stop 2023-10-16T13:49:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 msgr2=0x7fcc940c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 0x7fcc940c5970 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9b0 tx=0x7fcc8800ed70 comp rx=0 tx=0).stop 2023-10-16T13:49:18.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 shutdown_connections 2023-10-16T13:49:18.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcc7406b2f0 0x7fcc7406d7b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc940cede0 0x7fcc940c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc9406a840 0x7fcc940c5970 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 --2- 172.21.15.5:0/3675869960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd950 0x7fcc940c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 >> 172.21.15.5:0/3675869960 conn(0x7fcc9406dae0 msgr2=0x7fcc940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:18.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 shutdown_connections 2023-10-16T13:49:18.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.340+0000 7fcc98b2a700 1 -- 172.21.15.5:0/3675869960 wait complete. 2023-10-16T13:49:18.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:49:18.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.480+0000 7f80ef459700 1 Processor -- start 2023-10-16T13:49:18.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.480+0000 7f80ef459700 1 -- start start 2023-10-16T13:49:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ef459700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80e8160e30 0x7f80e80d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ef459700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80b6610 con 0x7f80e80d08a0 2023-10-16T13:49:18.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ef459700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80d1da0 con 0x7f80e8161210 2023-10-16T13:49:18.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ef459700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80d2080 con 0x7f80e8160e30 2023-10-16T13:49:18.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ed1f5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80e8160e30 0x7f80e80d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ed9f6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80e80d08a0 0x7f80e80ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60030/0 (socket says 172.21.15.5:60030) 2023-10-16T13:49:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.481+0000 7f80ed9f6700 1 -- 172.21.15.5:0/1054297953 learned_addr learned my addr 172.21.15.5:0/1054297953 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80ed1f5700 1 -- 172.21.15.5:0/1054297953 >> v1:172.21.15.112:6789/0 conn(0x7f80e8161210 legacy=0x7f80e80d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80ed1f5700 1 -- 172.21.15.5:0/1054297953 >> v1:172.21.15.5:6789/0 conn(0x7f80e80d08a0 legacy=0x7f80e80ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80dffff700 1 -- 172.21.15.5:0/1054297953 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457475072 0 0) 0x7f80e80b6610 con 0x7f80e80d08a0 2023-10-16T13:49:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80ed1f5700 1 -- 172.21.15.5:0/1054297953 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80d2360 con 0x7f80e8160e30 2023-10-16T13:49:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80ed1f5700 1 --2- 172.21.15.5:0/1054297953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8160e30 0x7f80e80d4200 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009820 tx=0x7f80d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bd57040c43814a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80dffff700 1 -- 172.21.15.5:0/1054297953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8005e30 con 0x7f80e8160e30 2023-10-16T13:49:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80dffff700 1 -- 172.21.15.5:0/1054297953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8006030 con 0x7f80e8160e30 2023-10-16T13:49:18.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80dffff700 1 -- 172.21.15.5:0/1054297953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80063e0 con 0x7f80e8160e30 2023-10-16T13:49:18.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80ef459700 1 -- 172.21.15.5:0/1054297953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8160e30 msgr2=0x7f80e80d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.482+0000 7f80ef459700 1 --2- 172.21.15.5:0/1054297953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8160e30 0x7f80e80d4200 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009820 tx=0x7f80d8009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:18.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.483+0000 7f80ef459700 1 -- 172.21.15.5:0/1054297953 shutdown_connections 2023-10-16T13:49:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.483+0000 7f80ef459700 1 --2- 172.21.15.5:0/1054297953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8160e30 0x7f80e80d4200 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.483+0000 7f80ef459700 1 -- 172.21.15.5:0/1054297953 >> 172.21.15.5:0/1054297953 conn(0x7f80e809cb40 msgr2=0x7f80e80d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.483+0000 7f80ef459700 1 -- 172.21.15.5:0/1054297953 shutdown_connections 2023-10-16T13:49:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.483+0000 7f80ef459700 1 -- 172.21.15.5:0/1054297953 wait complete. 2023-10-16T13:49:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.484+0000 7f80ef459700 1 Processor -- start 2023-10-16T13:49:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.484+0000 7f80ef459700 1 -- start start 2023-10-16T13:49:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e80d08a0 0x7f80e81f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80e8160e30 0x7f80e8150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 0x7f80e815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81f3e90 con 0x7f80e8161210 2023-10-16T13:49:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80cba90 con 0x7f80e80d08a0 2023-10-16T13:49:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80cbd30 con 0x7f80e8160e30 2023-10-16T13:49:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 0x7f80e815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 0x7f80e815d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50032/0 (socket says 172.21.15.5:50032) 2023-10-16T13:49:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 -- 172.21.15.5:0/428021478 learned_addr learned my addr 172.21.15.5:0/428021478 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ec9f4700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80e8160e30 0x7f80e8150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed1f5700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e80d08a0 0x7f80e81f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 -- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80e8160e30 msgr2=0x7f80e8150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80e8160e30 0x7f80e8150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 -- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e80d08a0 msgr2=0x7f80e81f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e80d08a0 0x7f80e81f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 -- 172.21.15.5:0/428021478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009430 con 0x7f80e8161210 2023-10-16T13:49:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ed9f6700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 0x7f80e815d070 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f80e000cba0 tx=0x7f80e000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000aaa0 con 0x7f80e8161210 2023-10-16T13:49:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000ac20 con 0x7f80e8161210 2023-10-16T13:49:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80cc010 con 0x7f80e8161210 2023-10-16T13:49:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.485+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00070d0 con 0x7f80e8161210 2023-10-16T13:49:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.486+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80cc5d0 con 0x7f80e8161210 2023-10-16T13:49:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.487+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e80cc7c0 con 0x7f80e8161210 2023-10-16T13:49:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.487+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f80e0007230 con 0x7f80e8161210 2023-10-16T13:49:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.487+0000 7f80ddffb700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80cc06b2f0 0x7f80cc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.487+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f80e0089b80 con 0x7f80e8161210 2023-10-16T13:49:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.488+0000 7f80ed1f5700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80cc06b2f0 0x7f80cc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.488+0000 7f80ed1f5700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80cc06b2f0 0x7f80cc06d7b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f80d8000c00 tx=0x7f80d8008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.492+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80e0054510 con 0x7f80e8161210 2023-10-16T13:49:18.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.690+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80e8067d20 con 0x7f80e8161210 2023-10-16T13:49:18.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.690+0000 7f80ddffb700 1 -- 172.21.15.5:0/428021478 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80e0018070 con 0x7f80e8161210 2023-10-16T13:49:18.694 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:49:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.692+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80cc06b2f0 msgr2=0x7f80cc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.692+0000 7f80ef459700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80cc06b2f0 0x7f80cc06d7b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f80d8000c00 tx=0x7f80d8008070 comp rx=0 tx=0).stop 2023-10-16T13:49:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 msgr2=0x7f80e815d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 0x7f80e815d070 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f80e000cba0 tx=0x7f80e000ceb0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 shutdown_connections 2023-10-16T13:49:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8161210 0x7f80e815d070 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e80d08a0 0x7f80e81f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f80cc06b2f0 0x7f80cc06d7b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 --2- 172.21.15.5:0/428021478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80e8160e30 0x7f80e8150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 >> 172.21.15.5:0/428021478 conn(0x7f80e809cb40 msgr2=0x7f80e806d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 shutdown_connections 2023-10-16T13:49:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.693+0000 7f80ef459700 1 -- 172.21.15.5:0/428021478 wait complete. 2023-10-16T13:49:18.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:49:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.831+0000 7f6f06fcc700 1 Processor -- start 2023-10-16T13:49:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.831+0000 7f6f06fcc700 1 -- start start 2023-10-16T13:49:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f06fcc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f000cc3f0 0x7f6f000cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f06fcc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f00161670 0x7f6f0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f06fcc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f000ccd10 0x7f6f0006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f06fcc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f00071ab0 con 0x7f6f000ccd10 2023-10-16T13:49:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f06fcc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f00161bc0 con 0x7f6f00161670 2023-10-16T13:49:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f06fcc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00161ea0 con 0x7f6f000cc3f0 2023-10-16T13:49:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f000ccd10 0x7f6f0006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f000ccd10 0x7f6f0006ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50040/0 (socket says 172.21.15.5:50040) 2023-10-16T13:49:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 -- 172.21.15.5:0/1387096632 learned_addr learned my addr 172.21.15.5:0/1387096632 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6efffff700 1 --2- 172.21.15.5:0/1387096632 >> v2:172.21.15.112:3300/0 conn(0x7f6f00161670 0x7f6f0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 -- 172.21.15.5:0/1387096632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f000cc3f0 msgr2=0x7f6f000cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:18.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f04d68700 1 --2- 172.21.15.5:0/1387096632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f000cc3f0 0x7f6f000cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 --2- 172.21.15.5:0/1387096632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f000cc3f0 0x7f6f000cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 -- 172.21.15.5:0/1387096632 >> v2:172.21.15.112:3300/0 conn(0x7f6f00161670 msgr2=0x7f6f0006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:18.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 --2- 172.21.15.5:0/1387096632 >> v2:172.21.15.112:3300/0 conn(0x7f6f00161670 0x7f6f0006a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 -- 172.21.15.5:0/1387096632 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00162180 con 0x7f6f000ccd10 2023-10-16T13:49:18.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6efffff700 1 --2- 172.21.15.5:0/1387096632 >> v2:172.21.15.112:3300/0 conn(0x7f6f00161670 0x7f6f0006a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:18.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.832+0000 7f6f05569700 1 --2- 172.21.15.5:0/1387096632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000ccd10 0x7f6f0006ad80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6f0006eba0 tx=0x7f6ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4c012a7293713d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6eff7fe700 1 -- 172.21.15.5:0/1387096632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800e070 con 0x7f6f000ccd10 2023-10-16T13:49:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6eff7fe700 1 -- 172.21.15.5:0/1387096632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef800b9c0 con 0x7f6f000ccd10 2023-10-16T13:49:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6eff7fe700 1 -- 172.21.15.5:0/1387096632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800bd70 con 0x7f6f000ccd10 2023-10-16T13:49:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 -- 172.21.15.5:0/1387096632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000ccd10 msgr2=0x7f6f0006ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/1387096632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000ccd10 0x7f6f0006ad80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6f0006eba0 tx=0x7f6ef800b330 comp rx=0 tx=0).stop 2023-10-16T13:49:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 -- 172.21.15.5:0/1387096632 shutdown_connections 2023-10-16T13:49:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/1387096632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000ccd10 0x7f6f0006ad80 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/1387096632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f000cc3f0 0x7f6f000cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/1387096632 >> v2:172.21.15.112:3300/0 conn(0x7f6f00161670 0x7f6f0006a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 -- 172.21.15.5:0/1387096632 >> 172.21.15.5:0/1387096632 conn(0x7f6f0006dac0 msgr2=0x7f6f0006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 -- 172.21.15.5:0/1387096632 shutdown_connections 2023-10-16T13:49:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.833+0000 7f6f06fcc700 1 -- 172.21.15.5:0/1387096632 wait complete. 2023-10-16T13:49:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.834+0000 7f6f06fcc700 1 Processor -- start 2023-10-16T13:49:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.834+0000 7f6f06fcc700 1 -- start start 2023-10-16T13:49:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f06fcc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 0x7f6f000aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f06fcc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f000ccd10 0x7f6f0015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f06fcc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f00161670 0x7f6f000b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f06fcc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000af140 con 0x7f6f000cc3f0 2023-10-16T13:49:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f06fcc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000adb60 con 0x7f6f000ccd10 2023-10-16T13:49:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f06fcc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000ade40 con 0x7f6f00161670 2023-10-16T13:49:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.835+0000 7f6f04d68700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 0x7f6f000aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 0x7f6f000aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50042/0 (socket says 172.21.15.5:50042) 2023-10-16T13:49:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 -- 172.21.15.5:0/2205025036 learned_addr learned my addr 172.21.15.5:0/2205025036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f05569700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f00161670 0x7f6f000b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6efffff700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f000ccd10 0x7f6f0015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 -- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f00161670 msgr2=0x7f6f000b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f00161670 0x7f6f000b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 -- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f000ccd10 msgr2=0x7f6f0015b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f000ccd10 0x7f6f0015b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 -- 172.21.15.5:0/2205025036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8009b30 con 0x7f6f000cc3f0 2023-10-16T13:49:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f04d68700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 0x7f6f000aec00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c7f0 tx=0x7f6ef400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4011800 con 0x7f6f000cc3f0 2023-10-16T13:49:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4011960 con 0x7f6f000cc3f0 2023-10-16T13:49:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f000ae120 con 0x7f6f000cc3f0 2023-10-16T13:49:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4011d10 con 0x7f6f000cc3f0 2023-10-16T13:49:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.836+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f000ae6e0 con 0x7f6f000cc3f0 2023-10-16T13:49:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.837+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00067d20 con 0x7f6f000cc3f0 2023-10-16T13:49:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.838+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6ef4018360 con 0x7f6f000cc3f0 2023-10-16T13:49:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.838+0000 7f6efd7fa700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ee406b2f0 0x7f6ee406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.838+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f6ef40899a0 con 0x7f6f000cc3f0 2023-10-16T13:49:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.838+0000 7f6efffff700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ee406b2f0 0x7f6ee406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.839+0000 7f6efffff700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ee406b2f0 0x7f6ee406d7b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6f001606f0 tx=0x7f6eec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:18.843+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ef4054300 con 0x7f6f000cc3f0 2023-10-16T13:49:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.060+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f000b6430 con 0x7f6f000cc3f0 2023-10-16T13:49:19.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.060+0000 7f6efd7fa700 1 -- 172.21.15.5:0/2205025036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v124) v1 ==== 80+0+248 (secure 0 0 0) 0x7f6ef401f110 con 0x7f6f000cc3f0 2023-10-16T13:49:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6837/2690348630 2023-10-17T13:49:12.077139+0000 2023-10-16T13:49:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6835/2690348630 2023-10-17T13:49:12.077139+0000 2023-10-16T13:49:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6836/3556823542 2023-10-17T13:49:08.644012+0000 2023-10-16T13:49:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.112:6834/3556823542 2023-10-17T13:49:08.644012+0000 2023-10-16T13:49:19.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.062+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ee406b2f0 msgr2=0x7f6ee406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.062+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ee406b2f0 0x7f6ee406d7b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6f001606f0 tx=0x7f6eec008040 comp rx=0 tx=0).stop 2023-10-16T13:49:19.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.062+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 msgr2=0x7f6f000aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.062+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 0x7f6f000aec00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c7f0 tx=0x7f6ef400cbb0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.062+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 shutdown_connections 2023-10-16T13:49:19.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ee406b2f0 0x7f6ee406d7b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f00161670 0x7f6f000b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f000cc3f0 0x7f6f000aec00 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 --2- 172.21.15.5:0/2205025036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f000ccd10 0x7f6f0015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 >> 172.21.15.5:0/2205025036 conn(0x7f6f0006dac0 msgr2=0x7f6f0006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:19.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 shutdown_connections 2023-10-16T13:49:19.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.063+0000 7f6f06fcc700 1 -- 172.21.15.5:0/2205025036 wait complete. 2023-10-16T13:49:19.069 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2023-10-16T13:49:19.077 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:49:19.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:19.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:19.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:49:19.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:19.130 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:49:19.149 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:19.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:19.167 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:19.168 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:19.168 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:19.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:19.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:19.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.330+0000 7f20817f4700 1 Processor -- start 2023-10-16T13:49:19.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.330+0000 7f20817f4700 1 -- start start 2023-10-16T13:49:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f20817f4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c1600e0 0x7f207c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f20817f4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c0cbb10 con 0x7f207c15b8d0 2023-10-16T13:49:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f20817f4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c0cb830 con 0x7f207c0afc60 2023-10-16T13:49:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f20817f4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0b00f0 con 0x7f207c1600e0 2023-10-16T13:49:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f207affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f207c15b8d0 0x7f207c0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60054/0 (socket says 172.21.15.5:60054) 2023-10-16T13:49:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f207affd700 1 -- 172.21.15.5:0/2258525071 learned_addr learned my addr 172.21.15.5:0/2258525071 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.331+0000 7f207a7fc700 1 --2- 172.21.15.5:0/2258525071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c1600e0 0x7f207c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221284716 0 0) 0x7f207c0cbb10 con 0x7f207c15b8d0 2023-10-16T13:49:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20640035b0 con 0x7f207c15b8d0 2023-10-16T13:49:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681218869 0 0) 0x7f207c0cb830 con 0x7f207c0afc60 2023-10-16T13:49:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f207c0cbb10 con 0x7f207c0afc60 2023-10-16T13:49:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3447751515 0 0) 0x7f20640035b0 con 0x7f207c15b8d0 2023-10-16T13:49:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f207a7fc700 1 -- 172.21.15.5:0/2258525071 >> v1:172.21.15.112:6789/0 conn(0x7f207c0afc60 legacy=0x7f207c06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f207a7fc700 1 -- 172.21.15.5:0/2258525071 >> v1:172.21.15.5:6789/0 conn(0x7f207c15b8d0 legacy=0x7f207c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f207a7fc700 1 -- 172.21.15.5:0/2258525071 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c15f600 con 0x7f207c1600e0 2023-10-16T13:49:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f207a7fc700 1 --2- 172.21.15.5:0/2258525071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c1600e0 0x7f207c0af720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f206c009870 tx=0x7f206c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcaba7b8e074f532 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20700017f0 con 0x7f207c1600e0 2023-10-16T13:49:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c004030 con 0x7f207c1600e0 2023-10-16T13:49:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.332+0000 7f2079ffb700 1 -- 172.21.15.5:0/2258525071 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c0043c0 con 0x7f207c1600e0 2023-10-16T13:49:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 -- 172.21.15.5:0/2258525071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c1600e0 msgr2=0x7f207c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 --2- 172.21.15.5:0/2258525071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c1600e0 0x7f207c0af720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f206c009870 tx=0x7f206c009b80 comp rx=0 tx=0).stop 2023-10-16T13:49:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 -- 172.21.15.5:0/2258525071 shutdown_connections 2023-10-16T13:49:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 --2- 172.21.15.5:0/2258525071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c1600e0 0x7f207c0af720 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 -- 172.21.15.5:0/2258525071 >> 172.21.15.5:0/2258525071 conn(0x7f207c0cd270 msgr2=0x7f207c0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 -- 172.21.15.5:0/2258525071 shutdown_connections 2023-10-16T13:49:19.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.333+0000 7f20817f4700 1 -- 172.21.15.5:0/2258525071 wait complete. 2023-10-16T13:49:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.334+0000 7f20817f4700 1 Processor -- start 2023-10-16T13:49:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.334+0000 7f20817f4700 1 -- start start 2023-10-16T13:49:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f20817f4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f207c0afc60 0x7f207c1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f20817f4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c15b8d0 0x7f207c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f20817f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 0x7f207c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f20817f4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c149910 con 0x7f207c1600e0 2023-10-16T13:49:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f20817f4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0c5be0 con 0x7f207c0afc60 2023-10-16T13:49:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f20817f4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0c5ec0 con 0x7f207c15b8d0 2023-10-16T13:49:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 0x7f207c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 0x7f207c0b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50058/0 (socket says 172.21.15.5:50058) 2023-10-16T13:49:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 -- 172.21.15.5:0/3632896652 learned_addr learned my addr 172.21.15.5:0/3632896652 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207affd700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f207c0afc60 0x7f207c1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207a7fc700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c15b8d0 0x7f207c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 -- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c15b8d0 msgr2=0x7f207c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c15b8d0 0x7f207c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 -- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f207c0afc60 msgr2=0x7f207c1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f207c0afc60 0x7f207c1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207b7fe700 1 -- 172.21.15.5:0/3632896652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0094a0 con 0x7f207c1600e0 2023-10-16T13:49:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.335+0000 7f207a7fc700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c15b8d0 0x7f207c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.336+0000 7f207b7fe700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 0x7f207c0b21f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f207400cbc0 tx=0x7f207400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.336+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074003c00 con 0x7f207c1600e0 2023-10-16T13:49:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.336+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074003d60 con 0x7f207c1600e0 2023-10-16T13:49:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.336+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c0c61a0 con 0x7f207c1600e0 2023-10-16T13:49:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.336+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400ab00 con 0x7f207c1600e0 2023-10-16T13:49:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.336+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c149f20 con 0x7f207c1600e0 2023-10-16T13:49:19.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.337+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c070720 con 0x7f207c1600e0 2023-10-16T13:49:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.337+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f207400ac60 con 0x7f207c1600e0 2023-10-16T13:49:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.338+0000 7f20637fe700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f206806b2f0 0x7f206806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.338+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2074089d90 con 0x7f207c1600e0 2023-10-16T13:49:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.338+0000 7f207affd700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f206806b2f0 0x7f206806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.338+0000 7f207affd700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f206806b2f0 0x7f206806d7b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2070001360 tx=0x7f2070000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.342+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2074054840 con 0x7f207c1600e0 2023-10-16T13:49:19.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.587+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f207c071e10 con 0x7f207c1600e0 2023-10-16T13:49:19.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.588+0000 7f20637fe700 1 -- 172.21.15.5:0/3632896652 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f2074057e60 con 0x7f207c1600e0 2023-10-16T13:49:19.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:19.592 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7363,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/4208236815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4208236815},{"type":"v1","addr":"172.21.15.112:6836","nonce":4208236815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3176905904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3176905904},{"type":"v1","addr":"172.21.15.112:6837","nonce":3176905904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:51.129490+0000","modified":"2023-10-16T13:48:54.173911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7713":{"gid":7713,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/618714180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":618714180},{"type":"v1","addr":"172.21.15.5:6835","nonce":618714180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-16T13:49:19.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f206806b2f0 msgr2=0x7f206806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f206806b2f0 0x7f206806d7b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2070001360 tx=0x7f2070000bc0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 msgr2=0x7f207c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 0x7f207c0b21f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f207400cbc0 tx=0x7f207400ced0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 shutdown_connections 2023-10-16T13:49:19.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207c1600e0 0x7f207c0b21f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f207c0afc60 0x7f207c1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f206806b2f0 0x7f206806d7b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 --2- 172.21.15.5:0/3632896652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f207c15b8d0 0x7f207c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 >> 172.21.15.5:0/3632896652 conn(0x7f207c0cd270 msgr2=0x7f207c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:19.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 shutdown_connections 2023-10-16T13:49:19.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.590+0000 7f20817f4700 1 -- 172.21.15.5:0/3632896652 wait complete. 2023-10-16T13:49:19.596 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 89 2023-10-16T13:49:19.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:19.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.728+0000 7f39c87a6700 1 Processor -- start 2023-10-16T13:49:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.728+0000 7f39c87a6700 1 -- start start 2023-10-16T13:49:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.729+0000 7f39c87a6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39c015e460 0x7f39c01650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.729+0000 7f39c87a6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c0158120 con 0x7f39c0157d40 2023-10-16T13:49:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.729+0000 7f39c87a6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c006a840 con 0x7f39c00cee90 2023-10-16T13:49:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.729+0000 7f39c87a6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c006e560 con 0x7f39c015e460 2023-10-16T13:49:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.729+0000 7f39c6d43700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39c015e460 0x7f39c01650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c6542700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39c0157d40 0x7f39c006de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60066/0 (socket says 172.21.15.5:60066) 2023-10-16T13:49:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c6542700 1 -- 172.21.15.5:0/2982231550 learned_addr learned my addr 172.21.15.5:0/2982231550 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c6d43700 1 -- 172.21.15.5:0/2982231550 >> v1:172.21.15.112:6789/0 conn(0x7f39c00cee90 legacy=0x7f39c015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c6d43700 1 -- 172.21.15.5:0/2982231550 >> v1:172.21.15.5:6789/0 conn(0x7f39c0157d40 legacy=0x7f39c006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c6d43700 1 -- 172.21.15.5:0/2982231550 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00caef0 con 0x7f39c015e460 2023-10-16T13:49:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c5540700 1 -- 172.21.15.5:0/2982231550 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269969839 0 0) 0x7f39c0158120 con 0x7f39c0157d40 2023-10-16T13:49:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c6d43700 1 --2- 172.21.15.5:0/2982231550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c01650e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f39b800aea0 tx=0x7f39b800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed180c2f57339991 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c5540700 1 -- 172.21.15.5:0/2982231550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800f070 con 0x7f39c015e460 2023-10-16T13:49:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c5540700 1 -- 172.21.15.5:0/2982231550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b8003a20 con 0x7f39c015e460 2023-10-16T13:49:19.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.730+0000 7f39c5540700 1 -- 172.21.15.5:0/2982231550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8003dd0 con 0x7f39c015e460 2023-10-16T13:49:19.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 -- 172.21.15.5:0/2982231550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 msgr2=0x7f39c01650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2982231550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c01650e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f39b800aea0 tx=0x7f39b800c330 comp rx=0 tx=0).stop 2023-10-16T13:49:19.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 -- 172.21.15.5:0/2982231550 shutdown_connections 2023-10-16T13:49:19.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2982231550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c01650e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 -- 172.21.15.5:0/2982231550 >> 172.21.15.5:0/2982231550 conn(0x7f39c00cc6f0 msgr2=0x7f39c00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:19.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 -- 172.21.15.5:0/2982231550 shutdown_connections 2023-10-16T13:49:19.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.731+0000 7f39c87a6700 1 -- 172.21.15.5:0/2982231550 wait complete. 2023-10-16T13:49:19.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.732+0000 7f39c87a6700 1 Processor -- start 2023-10-16T13:49:19.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.732+0000 7f39c87a6700 1 -- start start 2023-10-16T13:49:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c87a6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00cee90 0x7f39c01505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c87a6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39c0157d40 0x7f39c014c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c87a6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c0150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c87a6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c014f840 con 0x7f39c015e460 2023-10-16T13:49:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c87a6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c014fae0 con 0x7f39c00cee90 2023-10-16T13:49:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c87a6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c014fdc0 con 0x7f39c0157d40 2023-10-16T13:49:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c0150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c0150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50072/0 (socket says 172.21.15.5:50072) 2023-10-16T13:49:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 -- 172.21.15.5:0/2609173984 learned_addr learned my addr 172.21.15.5:0/2609173984 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6542700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00cee90 0x7f39c01505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c5d41700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39c0157d40 0x7f39c014c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 -- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39c0157d40 msgr2=0x7f39c014c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39c0157d40 0x7f39c014c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 -- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00cee90 msgr2=0x7f39c01505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00cee90 0x7f39c01505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 -- 172.21.15.5:0/2609173984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b800ab80 con 0x7f39c015e460 2023-10-16T13:49:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c5d41700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39c0157d40 0x7f39c014c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39c6d43700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c0150e80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f39b8004000 tx=0x7f39b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.733+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8004440 con 0x7f39c015e460 2023-10-16T13:49:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.734+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80045c0 con 0x7f39c015e460 2023-10-16T13:49:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.734+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c01500a0 con 0x7f39c015e460 2023-10-16T13:49:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.734+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8004970 con 0x7f39c015e460 2023-10-16T13:49:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.734+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c014cd30 con 0x7f39c015e460 2023-10-16T13:49:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.734+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c015ec80 con 0x7f39c015e460 2023-10-16T13:49:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.735+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f39b801a050 con 0x7f39c015e460 2023-10-16T13:49:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.735+0000 7f39b2ffd700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39a406b2f0 0x7f39a406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.735+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f39b808b510 con 0x7f39c015e460 2023-10-16T13:49:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.736+0000 7f39c6542700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39a406b2f0 0x7f39a406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.736+0000 7f39c6542700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39a406b2f0 0x7f39a406d7b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.740+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39b8055f90 con 0x7f39c015e460 2023-10-16T13:49:19.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.944+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39c006ecf0 con 0x7f39c015e460 2023-10-16T13:49:19.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.946+0000 7f39b2ffd700 1 -- 172.21.15.5:0/2609173984 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f39c006ecf0 con 0x7f39c015e460 2023-10-16T13:49:19.949 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:19.949 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:15.084489+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6835/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6836/3556823542":"2023-10-17T13:49:08.644012+0000","172.21.15.112:6834/3556823542":"2023-10-17T13:49:08.644012+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39a406b2f0 msgr2=0x7f39a406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39a406b2f0 0x7f39a406d7b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc007c00 comp rx=0 tx=0).stop 2023-10-16T13:49:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 msgr2=0x7f39c0150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c0150e80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f39b8004000 tx=0x7f39b8004ad0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 shutdown_connections 2023-10-16T13:49:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39c015e460 0x7f39c0150e80 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00cee90 0x7f39c01505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f39a406b2f0 0x7f39a406d7b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 --2- 172.21.15.5:0/2609173984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39c0157d40 0x7f39c014c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 >> 172.21.15.5:0/2609173984 conn(0x7f39c00cc6f0 msgr2=0x7f39c00ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:19.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 shutdown_connections 2023-10-16T13:49:19.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:19.948+0000 7f39c87a6700 1 -- 172.21.15.5:0/2609173984 wait complete. 2023-10-16T13:49:19.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:48:49.002718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:48:50.114887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:19.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.090+0000 7f926b780700 1 Processor -- start 2023-10-16T13:49:20.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.090+0000 7f926b780700 1 -- start start 2023-10-16T13:49:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f926b780700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f926415e2f0 0x7f92640cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f926b780700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f926406a840 0x7f926406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f926b780700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926406b1a0 con 0x7f92640cd950 2023-10-16T13:49:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f926b780700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92641619a0 con 0x7f926415e2f0 2023-10-16T13:49:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f926b780700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92640b2d60 con 0x7f926406a840 2023-10-16T13:49:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f926415e2f0 0x7f92640cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f926415e2f0 0x7f92640cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50078/0 (socket says 172.21.15.5:50078) 2023-10-16T13:49:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 -- 172.21.15.5:0/2366801807 learned_addr learned my addr 172.21.15.5:0/2366801807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9269d1d700 1 --2- 172.21.15.5:0/2366801807 >> v2:172.21.15.112:3300/0 conn(0x7f926406a840 0x7f926406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 -- 172.21.15.5:0/2366801807 >> v2:172.21.15.112:3300/0 conn(0x7f926406a840 msgr2=0x7f926406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 --2- 172.21.15.5:0/2366801807 >> v2:172.21.15.112:3300/0 conn(0x7f926406a840 0x7f926406ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 -- 172.21.15.5:0/2366801807 >> v1:172.21.15.112:6789/0 conn(0x7f92640cd950 legacy=0x7f926415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.091+0000 7f9268d1b700 1 -- 172.21.15.5:0/2366801807 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92640cdd30 con 0x7f926415e2f0 2023-10-16T13:49:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f9268d1b700 1 --2- 172.21.15.5:0/2366801807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926415e2f0 0x7f92640cede0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f92640afed0 tx=0x7f9260009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8049c416d4e6f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f925bfff700 1 -- 172.21.15.5:0/2366801807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260005e30 con 0x7f926415e2f0 2023-10-16T13:49:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f925bfff700 1 -- 172.21.15.5:0/2366801807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260004030 con 0x7f926415e2f0 2023-10-16T13:49:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f925bfff700 1 -- 172.21.15.5:0/2366801807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600043e0 con 0x7f926415e2f0 2023-10-16T13:49:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 -- 172.21.15.5:0/2366801807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926415e2f0 msgr2=0x7f92640cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 --2- 172.21.15.5:0/2366801807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926415e2f0 0x7f92640cede0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f92640afed0 tx=0x7f9260009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 -- 172.21.15.5:0/2366801807 shutdown_connections 2023-10-16T13:49:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 --2- 172.21.15.5:0/2366801807 >> v2:172.21.15.112:3300/0 conn(0x7f926406a840 0x7f926406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 --2- 172.21.15.5:0/2366801807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926415e2f0 0x7f92640cede0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 -- 172.21.15.5:0/2366801807 >> 172.21.15.5:0/2366801807 conn(0x7f926406dae0 msgr2=0x7f926406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 -- 172.21.15.5:0/2366801807 shutdown_connections 2023-10-16T13:49:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.092+0000 7f926b780700 1 -- 172.21.15.5:0/2366801807 wait complete. 2023-10-16T13:49:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.094+0000 7f926b780700 1 Processor -- start 2023-10-16T13:49:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.094+0000 7f926b780700 1 -- start start 2023-10-16T13:49:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926b780700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f926406a840 0x7f92640c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926b780700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 0x7f9264153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926b780700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f926415e2f0 0x7f92640cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926b780700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92640c96a0 con 0x7f92640cd950 2023-10-16T13:49:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926b780700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9264153fe0 con 0x7f926415e2f0 2023-10-16T13:49:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926b780700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92640c8a90 con 0x7f926406a840 2023-10-16T13:49:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 0x7f9264153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 0x7f9264153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50084/0 (socket says 172.21.15.5:50084) 2023-10-16T13:49:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 -- 172.21.15.5:0/846041192 learned_addr learned my addr 172.21.15.5:0/846041192 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9269d1d700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f926415e2f0 0x7f92640cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f926951c700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f926406a840 0x7f92640c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 -- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f926406a840 msgr2=0x7f92640c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f926406a840 0x7f92640c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 -- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f926415e2f0 msgr2=0x7f92640cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.095+0000 7f9268d1b700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f926415e2f0 0x7f92640cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f9268d1b700 1 -- 172.21.15.5:0/846041192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260009500 con 0x7f92640cd950 2023-10-16T13:49:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f9268d1b700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 0x7f9264153aa0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9260009c10 tx=0x7f9260004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260003d90 con 0x7f92640cd950 2023-10-16T13:49:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926001c420 con 0x7f92640cd950 2023-10-16T13:49:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92640c8d70 con 0x7f92640cd950 2023-10-16T13:49:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926001c7b0 con 0x7f92640cd950 2023-10-16T13:49:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.096+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92640c9330 con 0x7f92640cd950 2023-10-16T13:49:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.097+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9264067d20 con 0x7f92640cd950 2023-10-16T13:49:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.098+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f926001c910 con 0x7f92640cd950 2023-10-16T13:49:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.098+0000 7f9259ffb700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f924806b2f0 0x7f924806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.098+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f926008ad60 con 0x7f92640cd950 2023-10-16T13:49:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.098+0000 7f926951c700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f924806b2f0 0x7f924806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.099+0000 7f926951c700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f924806b2f0 0x7f924806d7b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9254000f60 tx=0x7f9254009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.103+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9260055810 con 0x7f92640cd950 2023-10-16T13:49:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.300+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92641f3c20 con 0x7f92640cd950 2023-10-16T13:49:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.301+0000 7f9259ffb700 1 -- 172.21.15.5:0/846041192 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9260058e30 con 0x7f92640cd950 2023-10-16T13:49:20.305 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f924806b2f0 msgr2=0x7f924806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f924806b2f0 0x7f924806d7b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9254000f60 tx=0x7f9254009040 comp rx=0 tx=0).stop 2023-10-16T13:49:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 msgr2=0x7f9264153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 0x7f9264153aa0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9260009c10 tx=0x7f9260004750 comp rx=0 tx=0).stop 2023-10-16T13:49:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 shutdown_connections 2023-10-16T13:49:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f926415e2f0 0x7f92640cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f924806b2f0 0x7f924806d7b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f926406a840 0x7f92640c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 --2- 172.21.15.5:0/846041192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92640cd950 0x7f9264153aa0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 >> 172.21.15.5:0/846041192 conn(0x7f926406dae0 msgr2=0x7f92640b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 shutdown_connections 2023-10-16T13:49:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.303+0000 7f926b780700 1 -- 172.21.15.5:0/846041192 wait complete. 2023-10-16T13:49:20.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:49:20.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.443+0000 7f5231a66700 1 Processor -- start 2023-10-16T13:49:20.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.443+0000 7f5231a66700 1 -- start start 2023-10-16T13:49:20.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.444+0000 7f5231a66700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 0x7f522c0d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.444+0000 7f5231a66700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c0b6610 con 0x7f522c161210 2023-10-16T13:49:20.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.444+0000 7f5231a66700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c0d1da0 con 0x7f522c0d08a0 2023-10-16T13:49:20.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.444+0000 7f5231a66700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0d2080 con 0x7f522c160e30 2023-10-16T13:49:20.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.444+0000 7f522affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f522c161210 0x7f522c0d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60094/0 (socket says 172.21.15.5:60094) 2023-10-16T13:49:20.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.444+0000 7f522affd700 1 -- 172.21.15.5:0/847983697 learned_addr learned my addr 172.21.15.5:0/847983697 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:20.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282167404 0 0) 0x7f522c0b6610 con 0x7f522c161210 2023-10-16T13:49:20.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52180035b0 con 0x7f522c161210 2023-10-16T13:49:20.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 0x7f522c0d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121403585 0 0) 0x7f52180035b0 con 0x7f522c161210 2023-10-16T13:49:20.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 msgr2=0x7f522c0d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:20.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 0x7f522c0d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 >> v1:172.21.15.112:6789/0 conn(0x7f522c0d08a0 legacy=0x7f522c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c0d2360 con 0x7f522c161210 2023-10-16T13:49:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f5214001670 con 0x7f522c161210 2023-10-16T13:49:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 >> v1:172.21.15.5:6789/0 conn(0x7f522c161210 legacy=0x7f522c0d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218003a30 0x7f5218003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218004850 0x7f5218004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 0x7f521800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0d2080 con 0x7f5218003a30 2023-10-16T13:49:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218005570 con 0x7f5218004850 2023-10-16T13:49:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521800bf50 con 0x7f522c160e30 2023-10-16T13:49:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218003a30 0x7f5218003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522affd700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218004850 0x7f5218004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522bfff700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 0x7f521800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 -- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 msgr2=0x7f521800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c160e30 0x7f521800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 -- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218004850 msgr2=0x7f5218004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218004850 0x7f5218004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.445+0000 7f522b7fe700 1 -- 172.21.15.5:0/847983697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180035b0 con 0x7f5218003a30 2023-10-16T13:49:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f522b7fe700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218003a30 0x7f5218003e50 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f521c009880 tx=0x7f5218005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79074791b5ef32b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00c070 con 0x7f5218003a30 2023-10-16T13:49:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c005c20 con 0x7f5218003a30 2023-10-16T13:49:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f522a7fc700 1 -- 172.21.15.5:0/847983697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c006050 con 0x7f5218003a30 2023-10-16T13:49:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f5231a66700 1 -- 172.21.15.5:0/847983697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218003a30 msgr2=0x7f5218003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f5231a66700 1 --2- 172.21.15.5:0/847983697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218003a30 0x7f5218003e50 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f521c009880 tx=0x7f5218005880 comp rx=0 tx=0).stop 2023-10-16T13:49:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f522bfff700 1 -- 172.21.15.5:0/847983697 reap_dead start 2023-10-16T13:49:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f5231a66700 1 -- 172.21.15.5:0/847983697 shutdown_connections 2023-10-16T13:49:20.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f5231a66700 1 -- 172.21.15.5:0/847983697 >> 172.21.15.5:0/847983697 conn(0x7f522c09cb40 msgr2=0x7f522c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:20.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f5231a66700 1 -- 172.21.15.5:0/847983697 shutdown_connections 2023-10-16T13:49:20.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.446+0000 7f5231a66700 1 -- 172.21.15.5:0/847983697 wait complete. 2023-10-16T13:49:20.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 Processor -- start 2023-10-16T13:49:20.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 -- start start 2023-10-16T13:49:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218003a30 0x7f522c1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 0x7f522c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c0c9940 0x7f522c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0c9df0 con 0x7f522c15b3b0 2023-10-16T13:49:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0c7c80 con 0x7f5218003a30 2023-10-16T13:49:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.448+0000 7f5231a66700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0c70b0 con 0x7f522c0c9940 2023-10-16T13:49:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 0x7f522c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 0x7f522c0c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50106/0 (socket says 172.21.15.5:50106) 2023-10-16T13:49:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 -- 172.21.15.5:0/164518269 learned_addr learned my addr 172.21.15.5:0/164518269 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522b7fe700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218003a30 0x7f522c1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522bfff700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c0c9940 0x7f522c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 -- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c0c9940 msgr2=0x7f522c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c0c9940 0x7f522c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 -- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218003a30 msgr2=0x7f522c1f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218003a30 0x7f522c1f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 -- 172.21.15.5:0/164518269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c1f3880 con 0x7f522c15b3b0 2023-10-16T13:49:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f522affd700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 0x7f522c0c9400 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f52140072c0 tx=0x7f52140075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521400f5e0 con 0x7f522c15b3b0 2023-10-16T13:49:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521400f740 con 0x7f522c15b3b0 2023-10-16T13:49:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c0c7350 con 0x7f522c15b3b0 2023-10-16T13:49:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521400faf0 con 0x7f522c15b3b0 2023-10-16T13:49:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.449+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c0c7910 con 0x7f522c15b3b0 2023-10-16T13:49:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.450+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c0c7ad0 con 0x7f522c15b3b0 2023-10-16T13:49:20.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.451+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f521400fc50 con 0x7f522c15b3b0 2023-10-16T13:49:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.451+0000 7f5223fff700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f520c06b2f0 0x7f520c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.451+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f5214089bc0 con 0x7f522c15b3b0 2023-10-16T13:49:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.451+0000 7f522b7fe700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f520c06b2f0 0x7f520c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.452+0000 7f522b7fe700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f520c06b2f0 0x7f520c06d7b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f521c008010 tx=0x7f521c00c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.456+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52140547a0 con 0x7f522c15b3b0 2023-10-16T13:49:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.655+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f522c0c7e10 con 0x7f522c15b3b0 2023-10-16T13:49:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.655+0000 7f5223fff700 1 -- 172.21.15.5:0/164518269 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5214057dc0 con 0x7f522c15b3b0 2023-10-16T13:49:20.660 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:49:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f520c06b2f0 msgr2=0x7f520c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f520c06b2f0 0x7f520c06d7b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f521c008010 tx=0x7f521c00c000 comp rx=0 tx=0).stop 2023-10-16T13:49:20.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 msgr2=0x7f522c0c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 0x7f522c0c9400 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f52140072c0 tx=0x7f52140075d0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 shutdown_connections 2023-10-16T13:49:20.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f520c06b2f0 0x7f520c06d7b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f522c0c9940 0x7f522c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5218003a30 0x7f522c1f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 --2- 172.21.15.5:0/164518269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f522c15b3b0 0x7f522c0c9400 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 >> 172.21.15.5:0/164518269 conn(0x7f522c09cb40 msgr2=0x7f522c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:20.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 shutdown_connections 2023-10-16T13:49:20.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.657+0000 7f5231a66700 1 -- 172.21.15.5:0/164518269 wait complete. 2023-10-16T13:49:20.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:49:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.797+0000 7f8aed046700 1 Processor -- start 2023-10-16T13:49:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.798+0000 7f8aed046700 1 -- start start 2023-10-16T13:49:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.798+0000 7f8aed046700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae806af50 0x7f8ae80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.798+0000 7f8aed046700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae80b3530 con 0x7f8ae815f130 2023-10-16T13:49:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.798+0000 7f8aed046700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae80cd180 con 0x7f8ae80b28b0 2023-10-16T13:49:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.798+0000 7f8aed046700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80cde00 con 0x7f8ae806af50 2023-10-16T13:49:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.798+0000 7f8ae6d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ae815f130 0x7f8ae806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60114/0 (socket says 172.21.15.5:60114) 2023-10-16T13:49:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae6d9d700 1 -- 172.21.15.5:0/1231246764 learned_addr learned my addr 172.21.15.5:0/1231246764 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae659c700 1 --2- 172.21.15.5:0/1231246764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae806af50 0x7f8ae80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251162652 0 0) 0x7f8ae80b3530 con 0x7f8ae815f130 2023-10-16T13:49:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad00035b0 con 0x7f8ae815f130 2023-10-16T13:49:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73141777 0 0) 0x7f8ae80cd180 con 0x7f8ae80b28b0 2023-10-16T13:49:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae80b3530 con 0x7f8ae80b28b0 2023-10-16T13:49:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae659c700 1 -- 172.21.15.5:0/1231246764 >> v1:172.21.15.112:6789/0 conn(0x7f8ae80b28b0 legacy=0x7f8ae80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae659c700 1 -- 172.21.15.5:0/1231246764 >> v1:172.21.15.5:6789/0 conn(0x7f8ae815f130 legacy=0x7f8ae806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3607759748 0 0) 0x7f8ad00035b0 con 0x7f8ae815f130 2023-10-16T13:49:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae659c700 1 -- 172.21.15.5:0/1231246764 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80cd460 con 0x7f8ae806af50 2023-10-16T13:49:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae659c700 1 --2- 172.21.15.5:0/1231246764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae806af50 0x7f8ae80cede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009850 tx=0x7f8adc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b712ec501a68081a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8001670 con 0x7f8ae806af50 2023-10-16T13:49:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc005c30 con 0x7f8ae806af50 2023-10-16T13:49:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.799+0000 7f8ae5d9b700 1 -- 172.21.15.5:0/1231246764 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc004030 con 0x7f8ae806af50 2023-10-16T13:49:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 -- 172.21.15.5:0/1231246764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae806af50 msgr2=0x7f8ae80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 --2- 172.21.15.5:0/1231246764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae806af50 0x7f8ae80cede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009850 tx=0x7f8adc009b60 comp rx=0 tx=0).stop 2023-10-16T13:49:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 -- 172.21.15.5:0/1231246764 shutdown_connections 2023-10-16T13:49:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 --2- 172.21.15.5:0/1231246764 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae806af50 0x7f8ae80cede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 -- 172.21.15.5:0/1231246764 >> 172.21.15.5:0/1231246764 conn(0x7f8ae806dae0 msgr2=0x7f8ae806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 -- 172.21.15.5:0/1231246764 shutdown_connections 2023-10-16T13:49:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.800+0000 7f8aed046700 1 -- 172.21.15.5:0/1231246764 wait complete. 2023-10-16T13:49:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 Processor -- start 2023-10-16T13:49:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 -- start start 2023-10-16T13:49:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 0x7f8ae8149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ae80b28b0 0x7f8ae815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae815f130 0x7f8ae815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae815d4d0 con 0x7f8ae806af50 2023-10-16T13:49:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80b4bf0 con 0x7f8ae80b28b0 2023-10-16T13:49:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8aed046700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae815ab10 con 0x7f8ae815f130 2023-10-16T13:49:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8ae6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 0x7f8ae8149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8ae6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 0x7f8ae8149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50116/0 (socket says 172.21.15.5:50116) 2023-10-16T13:49:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.802+0000 7f8ae6d9d700 1 -- 172.21.15.5:0/2176182917 learned_addr learned my addr 172.21.15.5:0/2176182917 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae659c700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ae80b28b0 0x7f8ae815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae759e700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae815f130 0x7f8ae815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae6d9d700 1 -- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae815f130 msgr2=0x7f8ae815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae6d9d700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae815f130 0x7f8ae815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae6d9d700 1 -- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ae80b28b0 msgr2=0x7f8ae815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae6d9d700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ae80b28b0 0x7f8ae815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae6d9d700 1 -- 172.21.15.5:0/2176182917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009430 con 0x7f8ae806af50 2023-10-16T13:49:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8ae6d9d700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 0x7f8ae8149870 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800c4d0 tx=0x7f8ad800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8004c80 con 0x7f8ae806af50 2023-10-16T13:49:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8004e00 con 0x7f8ae806af50 2023-10-16T13:49:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae80b4300 con 0x7f8ae806af50 2023-10-16T13:49:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8007310 con 0x7f8ae806af50 2023-10-16T13:49:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.803+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae80b45a0 con 0x7f8ae806af50 2023-10-16T13:49:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.804+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae8067d20 con 0x7f8ae806af50 2023-10-16T13:49:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.805+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f8ad8007470 con 0x7f8ae806af50 2023-10-16T13:49:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.805+0000 7f8acf7fe700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ad406b2f0 0x7f8ad406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.805+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8ad80897d0 con 0x7f8ae806af50 2023-10-16T13:49:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.805+0000 7f8ae659c700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ad406b2f0 0x7f8ad406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.806+0000 7f8ae659c700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ad406b2f0 0x7f8ad406d7b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0097a0 tx=0x7f8adc008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:20.810+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ad8054410 con 0x7f8ae806af50 2023-10-16T13:49:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.008+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ae80afb00 con 0x7f8ae806af50 2023-10-16T13:49:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.009+0000 7f8acf7fe700 1 -- 172.21.15.5:0/2176182917 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ad8057a30 con 0x7f8ae806af50 2023-10-16T13:49:21.013 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:49:21.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ad406b2f0 msgr2=0x7f8ad406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ad406b2f0 0x7f8ad406d7b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0097a0 tx=0x7f8adc008070 comp rx=0 tx=0).stop 2023-10-16T13:49:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 msgr2=0x7f8ae8149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 0x7f8ae8149870 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800c4d0 tx=0x7f8ad800c7e0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 shutdown_connections 2023-10-16T13:49:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8ad406b2f0 0x7f8ad406d7b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ae815f130 0x7f8ae815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ae806af50 0x7f8ae8149870 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 --2- 172.21.15.5:0/2176182917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ae80b28b0 0x7f8ae815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 >> 172.21.15.5:0/2176182917 conn(0x7f8ae806dae0 msgr2=0x7f8ae806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 shutdown_connections 2023-10-16T13:49:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.011+0000 7f8aed046700 1 -- 172.21.15.5:0/2176182917 wait complete. 2023-10-16T13:49:21.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.148+0000 7f0513bd4700 1 Processor -- start 2023-10-16T13:49:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.149+0000 7f0513bd4700 1 -- start start 2023-10-16T13:49:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.149+0000 7f0513bd4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 0x7f050c1688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.149+0000 7f0513bd4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0ccc20 con 0x7f050c0cf8a0 2023-10-16T13:49:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.149+0000 7f0513bd4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c15ee90 con 0x7f050c15eab0 2023-10-16T13:49:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.149+0000 7f0513bd4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c158370 con 0x7f050c0d1d90 2023-10-16T13:49:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.149+0000 7f051116f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f050c0cf8a0 0x7f050c0d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60130/0 (socket says 172.21.15.5:60130) 2023-10-16T13:49:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051116f700 1 -- 172.21.15.5:0/3909234076 learned_addr learned my addr 172.21.15.5:0/3909234076 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:21.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f0512171700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 0x7f050c1688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327430028 0 0) 0x7f050c0ccc20 con 0x7f050c0cf8a0 2023-10-16T13:49:21.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f80035b0 con 0x7f050c0cf8a0 2023-10-16T13:49:21.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793055770 0 0) 0x7f050c15ee90 con 0x7f050c15eab0 2023-10-16T13:49:21.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0ccc20 con 0x7f050c15eab0 2023-10-16T13:49:21.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4062270951 0 0) 0x7f04f80035b0 con 0x7f050c0cf8a0 2023-10-16T13:49:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 msgr2=0x7f050c1688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 0x7f050c1688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 >> v1:172.21.15.112:6789/0 conn(0x7f050c15eab0 legacy=0x7f050c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0d23b0 con 0x7f050c0cf8a0 2023-10-16T13:49:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f0500001670 con 0x7f050c0cf8a0 2023-10-16T13:49:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 >> v1:172.21.15.5:6789/0 conn(0x7f050c0cf8a0 legacy=0x7f050c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 0x7f04f8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f8004140 0x7f04f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04f8004d90 0x7f04f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c158370 con 0x7f04f8004140 2023-10-16T13:49:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f800baf0 con 0x7f04f8004d90 2023-10-16T13:49:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f800bcb0 con 0x7f050c0d1d90 2023-10-16T13:49:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f051116f700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f8004140 0x7f04f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f0511970700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 0x7f04f8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.150+0000 7f0512171700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04f8004d90 0x7f04f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051116f700 1 -- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 msgr2=0x7f04f8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051116f700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f050c0d1d90 0x7f04f8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051116f700 1 -- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04f8004d90 msgr2=0x7f04f8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051116f700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04f8004d90 0x7f04f8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051116f700 1 -- 172.21.15.5:0/3909234076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80035b0 con 0x7f04f8004140 2023-10-16T13:49:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051116f700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f8004140 0x7f04f8004850 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f050000c240 tx=0x7f04f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190ca5edb6911c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000cd80 con 0x7f04f8004140 2023-10-16T13:49:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500007b10 con 0x7f04f8004140 2023-10-16T13:49:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f051096e700 1 -- 172.21.15.5:0/3909234076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500005ba0 con 0x7f04f8004140 2023-10-16T13:49:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f0513bd4700 1 -- 172.21.15.5:0/3909234076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f8004140 msgr2=0x7f04f8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f0513bd4700 1 --2- 172.21.15.5:0/3909234076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f8004140 0x7f04f8004850 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f050000c240 tx=0x7f04f8005880 comp rx=0 tx=0).stop 2023-10-16T13:49:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f0512171700 1 -- 172.21.15.5:0/3909234076 reap_dead start 2023-10-16T13:49:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f0513bd4700 1 -- 172.21.15.5:0/3909234076 shutdown_connections 2023-10-16T13:49:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.151+0000 7f0513bd4700 1 -- 172.21.15.5:0/3909234076 >> 172.21.15.5:0/3909234076 conn(0x7f050c0665a0 msgr2=0x7f050c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.152+0000 7f0513bd4700 1 -- 172.21.15.5:0/3909234076 shutdown_connections 2023-10-16T13:49:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.152+0000 7f0513bd4700 1 -- 172.21.15.5:0/3909234076 wait complete. 2023-10-16T13:49:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.153+0000 7f0513bd4700 1 Processor -- start 2023-10-16T13:49:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.153+0000 7f0513bd4700 1 -- start start 2023-10-16T13:49:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.153+0000 7f0513bd4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04f8004140 0x7f050c161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.153+0000 7f0513bd4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 0x7f050c1e8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.153+0000 7f0513bd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c0c72c0 0x7f050c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.153+0000 7f0513bd4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c7c90 con 0x7f050c1e9230 2023-10-16T13:49:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f0513bd4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0afca0 con 0x7f050c0c72c0 2023-10-16T13:49:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f0513bd4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c157670 con 0x7f04f8004140 2023-10-16T13:49:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 0x7f050c1e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 0x7f050c1e8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50138/0 (socket says 172.21.15.5:50138) 2023-10-16T13:49:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 -- 172.21.15.5:0/2620197344 learned_addr learned my addr 172.21.15.5:0/2620197344 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f0511970700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04f8004140 0x7f050c161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f0512171700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c0c72c0 0x7f050c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 -- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04f8004140 msgr2=0x7f050c161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04f8004140 0x7f050c161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 -- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c0c72c0 msgr2=0x7f050c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c0c72c0 0x7f050c0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 -- 172.21.15.5:0/2620197344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c1e9710 con 0x7f050c1e9230 2023-10-16T13:49:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f051116f700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 0x7f050c1e8950 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0500007cc0 tx=0x7f050c15df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500000ed0 con 0x7f050c1e9230 2023-10-16T13:49:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05000070d0 con 0x7f050c1e9230 2023-10-16T13:49:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500007480 con 0x7f050c1e9230 2023-10-16T13:49:21.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c1e7e70 con 0x7f050c1e9230 2023-10-16T13:49:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.154+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c1e8430 con 0x7f050c1e9230 2023-10-16T13:49:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.155+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c1e85f0 con 0x7f050c1e9230 2023-10-16T13:49:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.156+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f05000075e0 con 0x7f050c1e9230 2023-10-16T13:49:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.156+0000 7f04fe7fc700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04f006b2f0 0x7f04f006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.156+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f050008ae00 con 0x7f050c1e9230 2023-10-16T13:49:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.157+0000 7f0511970700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04f006b2f0 0x7f04f006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.157+0000 7f0511970700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04f006b2f0 0x7f04f006d7b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0508007fd0 tx=0x7f0508009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.161+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0500055870 con 0x7f050c1e9230 2023-10-16T13:49:21.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.405+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f050c1e87a0 con 0x7f050c1e9230 2023-10-16T13:49:21.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.406+0000 7f04fe7fc700 1 -- 172.21.15.5:0/2620197344 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f0500058e90 con 0x7f050c1e9230 2023-10-16T13:49:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:21.410 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7363,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/4208236815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4208236815},{"type":"v1","addr":"172.21.15.112:6836","nonce":4208236815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3176905904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3176905904},{"type":"v1","addr":"172.21.15.112:6837","nonce":3176905904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:51.129490+0000","modified":"2023-10-16T13:48:54.173911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7713":{"gid":7713,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/618714180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":618714180},{"type":"v1","addr":"172.21.15.5:6835","nonce":618714180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-16T13:49:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04f006b2f0 msgr2=0x7f04f006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04f006b2f0 0x7f04f006d7b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0508007fd0 tx=0x7f0508009040 comp rx=0 tx=0).stop 2023-10-16T13:49:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 msgr2=0x7f050c1e8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 0x7f050c1e8950 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0500007cc0 tx=0x7f050c15df20 comp rx=0 tx=0).stop 2023-10-16T13:49:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 shutdown_connections 2023-10-16T13:49:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c0c72c0 0x7f050c0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f04f006b2f0 0x7f04f006d7b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04f8004140 0x7f050c161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 --2- 172.21.15.5:0/2620197344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1e9230 0x7f050c1e8950 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 >> 172.21.15.5:0/2620197344 conn(0x7f050c0665a0 msgr2=0x7f050c0b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 shutdown_connections 2023-10-16T13:49:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.408+0000 7f0513bd4700 1 -- 172.21.15.5:0/2620197344 wait complete. 2023-10-16T13:49:21.415 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 89 2023-10-16T13:49:21.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.545+0000 7f91c0211700 1 Processor -- start 2023-10-16T13:49:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.545+0000 7f91c0211700 1 -- start start 2023-10-16T13:49:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91c0211700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91b8160fb0 0x7f91b80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91c0211700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b8161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91c0211700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b8161390 con 0x7f91b80727b0 2023-10-16T13:49:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91c0211700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b80b23f0 con 0x7f91b8160fb0 2023-10-16T13:49:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91c0211700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80b26b0 con 0x7f91b806af50 2023-10-16T13:49:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91bdfad700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91b8160fb0 0x7f91b80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91bdfad700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91b8160fb0 0x7f91b80cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50144/0 (socket says 172.21.15.5:50144) 2023-10-16T13:49:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.546+0000 7f91bdfad700 1 -- 172.21.15.5:0/405431391 learned_addr learned my addr 172.21.15.5:0/405431391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91be7ae700 1 --2- 172.21.15.5:0/405431391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b8161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bdfad700 1 -- 172.21.15.5:0/405431391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 msgr2=0x7f91b8161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bdfad700 1 --2- 172.21.15.5:0/405431391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b8161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bdfad700 1 -- 172.21.15.5:0/405431391 >> v1:172.21.15.5:6789/0 conn(0x7f91b80727b0 legacy=0x7f91b806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bdfad700 1 -- 172.21.15.5:0/405431391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80b2990 con 0x7f91b8160fb0 2023-10-16T13:49:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bcfab700 1 -- 172.21.15.5:0/405431391 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202370332 0 0) 0x7f91b8161390 con 0x7f91b80727b0 2023-10-16T13:49:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bdfad700 1 --2- 172.21.15.5:0/405431391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b8160fb0 0x7f91b80cee40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f91a8006fd0 tx=0x7f91a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793e4b0d6c6b5f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bcfab700 1 -- 172.21.15.5:0/405431391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8005e30 con 0x7f91b8160fb0 2023-10-16T13:49:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bcfab700 1 -- 172.21.15.5:0/405431391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8004030 con 0x7f91b8160fb0 2023-10-16T13:49:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91bcfab700 1 -- 172.21.15.5:0/405431391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80043e0 con 0x7f91b8160fb0 2023-10-16T13:49:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91c0211700 1 -- 172.21.15.5:0/405431391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b8160fb0 msgr2=0x7f91b80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.547+0000 7f91c0211700 1 --2- 172.21.15.5:0/405431391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b8160fb0 0x7f91b80cee40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f91a8006fd0 tx=0x7f91a8009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.548+0000 7f91c0211700 1 -- 172.21.15.5:0/405431391 shutdown_connections 2023-10-16T13:49:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.548+0000 7f91c0211700 1 --2- 172.21.15.5:0/405431391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b8161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.548+0000 7f91c0211700 1 --2- 172.21.15.5:0/405431391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b8160fb0 0x7f91b80cee40 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.548+0000 7f91c0211700 1 -- 172.21.15.5:0/405431391 >> 172.21.15.5:0/405431391 conn(0x7f91b80cd270 msgr2=0x7f91b80cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:21.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.548+0000 7f91c0211700 1 -- 172.21.15.5:0/405431391 shutdown_connections 2023-10-16T13:49:21.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.548+0000 7f91c0211700 1 -- 172.21.15.5:0/405431391 wait complete. 2023-10-16T13:49:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.549+0000 7f91c0211700 1 Processor -- start 2023-10-16T13:49:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.549+0000 7f91c0211700 1 -- start start 2023-10-16T13:49:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 0x7f91b806f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8160fb0 0x7f91b806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b814e760 con 0x7f91b80727b0 2023-10-16T13:49:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b81519b0 con 0x7f91b8160fb0 2023-10-16T13:49:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b814eb00 con 0x7f91b806af50 2023-10-16T13:49:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 0x7f91b806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 0x7f91b806f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50152/0 (socket says 172.21.15.5:50152) 2023-10-16T13:49:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 -- 172.21.15.5:0/2675895592 learned_addr learned my addr 172.21.15.5:0/2675895592 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bdfad700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91be7ae700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8160fb0 0x7f91b806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 -- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 msgr2=0x7f91b814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 -- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8160fb0 msgr2=0x7f91b806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8160fb0 0x7f91b806fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 -- 172.21.15.5:0/2675895592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009500 con 0x7f91b80727b0 2023-10-16T13:49:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91bd7ac700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 0x7f91b806f550 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f91b40011e0 tx=0x7f91b400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40054e0 con 0x7f91b80727b0 2023-10-16T13:49:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4003680 con 0x7f91b80727b0 2023-10-16T13:49:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b814ede0 con 0x7f91b80727b0 2023-10-16T13:49:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4003a30 con 0x7f91b80727b0 2023-10-16T13:49:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.550+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b814f3a0 con 0x7f91b80727b0 2023-10-16T13:49:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.551+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b8067d20 con 0x7f91b80727b0 2023-10-16T13:49:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.552+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f91b4003b90 con 0x7f91b80727b0 2023-10-16T13:49:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.552+0000 7f91ae7fc700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919c06b2f0 0x7f919c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.552+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f91b4089190 con 0x7f91b80727b0 2023-10-16T13:49:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.552+0000 7f91bdfad700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919c06b2f0 0x7f919c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.553+0000 7f91bdfad700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919c06b2f0 0x7f919c06d7b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f91a8000c00 tx=0x7f91a8008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.557+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91b4053c00 con 0x7f91b80727b0 2023-10-16T13:49:21.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.760+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91b814f560 con 0x7f91b80727b0 2023-10-16T13:49:21.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.761+0000 7f91ae7fc700 1 -- 172.21.15.5:0/2675895592 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f91b4057220 con 0x7f91b80727b0 2023-10-16T13:49:21.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:21.765 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:15.084489+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6835/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6836/3556823542":"2023-10-17T13:49:08.644012+0000","172.21.15.112:6834/3556823542":"2023-10-17T13:49:08.644012+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:21.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919c06b2f0 msgr2=0x7f919c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919c06b2f0 0x7f919c06d7b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f91a8000c00 tx=0x7f91a8008070 comp rx=0 tx=0).stop 2023-10-16T13:49:21.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 msgr2=0x7f91b806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 0x7f91b806f550 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f91b40011e0 tx=0x7f91b400ca30 comp rx=0 tx=0).stop 2023-10-16T13:49:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 shutdown_connections 2023-10-16T13:49:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8160fb0 0x7f91b806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f919c06b2f0 0x7f919c06d7b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b806af50 0x7f91b814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 --2- 172.21.15.5:0/2675895592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91b80727b0 0x7f91b806f550 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 >> 172.21.15.5:0/2675895592 conn(0x7f91b80cd270 msgr2=0x7f91b80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 shutdown_connections 2023-10-16T13:49:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.763+0000 7f91c0211700 1 -- 172.21.15.5:0/2675895592 wait complete. 2023-10-16T13:49:21.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:49:21.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.901+0000 7fe616b8a700 1 Processor -- start 2023-10-16T13:49:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.901+0000 7fe616b8a700 1 -- start start 2023-10-16T13:49:21.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe616b8a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe61015b740 0x7fe6100d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe616b8a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6100d0c70 0x7fe6100cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe616b8a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100cf190 con 0x7fe6100c5110 2023-10-16T13:49:21.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe616b8a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61015bb20 con 0x7fe6100d0c70 2023-10-16T13:49:21.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe616b8a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100cbd40 con 0x7fe61015b740 2023-10-16T13:49:21.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6100d0c70 0x7fe6100cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6100d0c70 0x7fe6100cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50160/0 (socket says 172.21.15.5:50160) 2023-10-16T13:49:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 -- 172.21.15.5:0/1337504965 learned_addr learned my addr 172.21.15.5:0/1337504965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe615127700 1 --1- 172.21.15.5:0/1337504965 >> v1:172.21.15.5:6789/0 conn(0x7fe6100c5110 0x7fe6100cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60166/0 (socket says 172.21.15.5:60166) 2023-10-16T13:49:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe614926700 1 --2- 172.21.15.5:0/1337504965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe61015b740 0x7fe6100d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 -- 172.21.15.5:0/1337504965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe61015b740 msgr2=0x7fe6100d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 --2- 172.21.15.5:0/1337504965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe61015b740 0x7fe6100d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 -- 172.21.15.5:0/1337504965 >> v1:172.21.15.5:6789/0 conn(0x7fe6100c5110 legacy=0x7fe6100cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60f7fe700 1 -- 172.21.15.5:0/1337504965 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582362478 0 0) 0x7fe6100cf190 con 0x7fe6100c5110 2023-10-16T13:49:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 -- 172.21.15.5:0/1337504965 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100cc020 con 0x7fe6100d0c70 2023-10-16T13:49:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.902+0000 7fe60ffff700 1 --2- 172.21.15.5:0/1337504965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6100d0c70 0x7fe6100cdfd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0098f0 tx=0x7fe5fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1695912d131c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe60f7fe700 1 -- 172.21.15.5:0/1337504965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00b8a0 con 0x7fe6100d0c70 2023-10-16T13:49:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe60f7fe700 1 -- 172.21.15.5:0/1337504965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00ba00 con 0x7fe6100d0c70 2023-10-16T13:49:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe60f7fe700 1 -- 172.21.15.5:0/1337504965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00bd90 con 0x7fe6100d0c70 2023-10-16T13:49:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 -- 172.21.15.5:0/1337504965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6100d0c70 msgr2=0x7fe6100cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1337504965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6100d0c70 0x7fe6100cdfd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0098f0 tx=0x7fe5fc009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 -- 172.21.15.5:0/1337504965 shutdown_connections 2023-10-16T13:49:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1337504965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe61015b740 0x7fe6100d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1337504965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6100d0c70 0x7fe6100cdfd0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 -- 172.21.15.5:0/1337504965 >> 172.21.15.5:0/1337504965 conn(0x7fe6100665a0 msgr2=0x7fe610066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 -- 172.21.15.5:0/1337504965 shutdown_connections 2023-10-16T13:49:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.903+0000 7fe616b8a700 1 -- 172.21.15.5:0/1337504965 wait complete. 2023-10-16T13:49:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.904+0000 7fe616b8a700 1 Processor -- start 2023-10-16T13:49:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.904+0000 7fe616b8a700 1 -- start start 2023-10-16T13:49:21.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe616b8a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6100c5110 0x7fe6101f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe616b8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6100d0c70 0x7fe6100c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe616b8a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 0x7fe61015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe616b8a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c8f90 con 0x7fe61015b740 2023-10-16T13:49:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe616b8a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c9270 con 0x7fe6100d0c70 2023-10-16T13:49:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe616b8a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c9550 con 0x7fe6100c5110 2023-10-16T13:49:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe615127700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 0x7fe61015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe615127700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 0x7fe61015d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50168/0 (socket says 172.21.15.5:50168) 2023-10-16T13:49:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.905+0000 7fe615127700 1 -- 172.21.15.5:0/1609465292 learned_addr learned my addr 172.21.15.5:0/1609465292 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe614926700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6100c5110 0x7fe6101f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe60ffff700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6100d0c70 0x7fe6100c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe615127700 1 -- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6100c5110 msgr2=0x7fe6101f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe615127700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6100c5110 0x7fe6101f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe615127700 1 -- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6100d0c70 msgr2=0x7fe6100c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe615127700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6100d0c70 0x7fe6100c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe615127700 1 -- 172.21.15.5:0/1609465292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc009550 con 0x7fe61015b740 2023-10-16T13:49:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe615127700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 0x7fe61015d4c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fe60800cc70 tx=0x7fe60800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800ad80 con 0x7fe61015b740 2023-10-16T13:49:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800ce70 con 0x7fe61015b740 2023-10-16T13:49:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080072f0 con 0x7fe61015b740 2023-10-16T13:49:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61006bad0 con 0x7fe61015b740 2023-10-16T13:49:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.906+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61014df60 con 0x7fe61015b740 2023-10-16T13:49:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.907+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61006bcc0 con 0x7fe61015b740 2023-10-16T13:49:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.907+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe608007450 con 0x7fe61015b740 2023-10-16T13:49:21.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.908+0000 7fe60d7fa700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5f406b2f0 0x7fe5f406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:21.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.908+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe608089910 con 0x7fe61015b740 2023-10-16T13:49:21.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.908+0000 7fe614926700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5f406b2f0 0x7fe5f406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:21.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.909+0000 7fe614926700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5f406b2f0 0x7fe5f406d7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe60400b9b0 tx=0x7fe604008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:21.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:21.913+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe608054330 con 0x7fe61015b740 2023-10-16T13:49:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.158+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe610067d20 con 0x7fe61015b740 2023-10-16T13:49:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.158+0000 7fe60d7fa700 1 -- 172.21.15.5:0/1609465292 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fe608018090 con 0x7fe61015b740 2023-10-16T13:49:22.163 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:22.163 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7363,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/4208236815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4208236815},{"type":"v1","addr":"172.21.15.112:6836","nonce":4208236815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3176905904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3176905904},{"type":"v1","addr":"172.21.15.112:6837","nonce":3176905904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:51.129490+0000","modified":"2023-10-16T13:48:54.173911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7713":{"gid":7713,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/618714180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":618714180},{"type":"v1","addr":"172.21.15.5:6835","nonce":618714180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-16T13:49:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.160+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5f406b2f0 msgr2=0x7fe5f406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.160+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5f406b2f0 0x7fe5f406d7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe60400b9b0 tx=0x7fe604008040 comp rx=0 tx=0).stop 2023-10-16T13:49:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 msgr2=0x7fe61015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 0x7fe61015d4c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fe60800cc70 tx=0x7fe60800a340 comp rx=0 tx=0).stop 2023-10-16T13:49:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 shutdown_connections 2023-10-16T13:49:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe61015b740 0x7fe61015d4c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe5f406b2f0 0x7fe5f406d7b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6100c5110 0x7fe6101f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 --2- 172.21.15.5:0/1609465292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6100d0c70 0x7fe6100c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 >> 172.21.15.5:0/1609465292 conn(0x7fe6100665a0 msgr2=0x7fe61015a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 shutdown_connections 2023-10-16T13:49:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.161+0000 7fe616b8a700 1 -- 172.21.15.5:0/1609465292 wait complete. 2023-10-16T13:49:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 89 2023-10-16T13:49:22.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.297+0000 7f70203cc700 1 Processor -- start 2023-10-16T13:49:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.297+0000 7f70203cc700 1 -- start start 2023-10-16T13:49:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.298+0000 7f70203cc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f70181600e0 0x7f70180af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.298+0000 7f70203cc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70180cbb10 con 0x7f70180afc60 2023-10-16T13:49:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.298+0000 7f70203cc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70180cb830 con 0x7f701815b8d0 2023-10-16T13:49:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.298+0000 7f70203cc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70180b00f0 con 0x7f70181600e0 2023-10-16T13:49:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701e969700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70180afc60 0x7f701806f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60180/0 (socket says 172.21.15.5:60180) 2023-10-16T13:49:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701e969700 1 -- 172.21.15.5:0/1345570403 learned_addr learned my addr 172.21.15.5:0/1345570403 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d967700 1 --2- 172.21.15.5:0/1345570403 >> v2:172.21.15.112:3300/0 conn(0x7f70181600e0 0x7f70180af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803409891 0 0) 0x7f70180cbb10 con 0x7f70180afc60 2023-10-16T13:49:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70040035b0 con 0x7f70180afc60 2023-10-16T13:49:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155777344 0 0) 0x7f70040035b0 con 0x7f70180afc60 2023-10-16T13:49:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 >> v2:172.21.15.112:3300/0 conn(0x7f70181600e0 msgr2=0x7f70180af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 --2- 172.21.15.5:0/1345570403 >> v2:172.21.15.112:3300/0 conn(0x7f70181600e0 0x7f70180af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 >> v1:172.21.15.112:6789/0 conn(0x7f701815b8d0 legacy=0x7f70180cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701815f600 con 0x7f70180afc60 2023-10-16T13:49:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f70100019f0 con 0x7f70180afc60 2023-10-16T13:49:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 >> v1:172.21.15.5:6789/0 conn(0x7f70180afc60 legacy=0x7f701806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7004003a30 0x7f7004003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7004004850 0x7f7004004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004005260 0x7f700400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70180b00f0 con 0x7f7004004850 2023-10-16T13:49:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700400c190 con 0x7f7004005260 2023-10-16T13:49:22.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700400c350 con 0x7f7004003a30 2023-10-16T13:49:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701d967700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7004004850 0x7f7004004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701e969700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004005260 0x7f700400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.299+0000 7f701e168700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7004003a30 0x7f7004003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d967700 1 -- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7004003a30 msgr2=0x7f7004003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d967700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7004003a30 0x7f7004003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d967700 1 -- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004005260 msgr2=0x7f700400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d967700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004005260 0x7f700400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d967700 1 -- 172.21.15.5:0/1345570403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040035b0 con 0x7f7004004850 2023-10-16T13:49:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701e969700 1 -- 172.21.15.5:0/1345570403 reap_dead start 2023-10-16T13:49:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d967700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7004004850 0x7f7004004cd0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f700c009b60 tx=0x7f7004005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fb8b17d4e4e911 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00e6c0 con 0x7f7004004850 2023-10-16T13:49:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00e820 con 0x7f7004004850 2023-10-16T13:49:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f701d166700 1 -- 172.21.15.5:0/1345570403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00eb90 con 0x7f7004004850 2023-10-16T13:49:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f70203cc700 1 -- 172.21.15.5:0/1345570403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7004004850 msgr2=0x7f7004004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.300+0000 7f70203cc700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7004004850 0x7f7004004cd0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f700c009b60 tx=0x7f7004005880 comp rx=0 tx=0).stop 2023-10-16T13:49:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.301+0000 7f70203cc700 1 -- 172.21.15.5:0/1345570403 shutdown_connections 2023-10-16T13:49:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.301+0000 7f70203cc700 1 --2- 172.21.15.5:0/1345570403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7004004850 0x7f7004004cd0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.301+0000 7f70203cc700 1 -- 172.21.15.5:0/1345570403 >> 172.21.15.5:0/1345570403 conn(0x7f70180cd270 msgr2=0x7f70180cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.301+0000 7f70203cc700 1 -- 172.21.15.5:0/1345570403 shutdown_connections 2023-10-16T13:49:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.301+0000 7f70203cc700 1 -- 172.21.15.5:0/1345570403 wait complete. 2023-10-16T13:49:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.302+0000 7f70203cc700 1 Processor -- start 2023-10-16T13:49:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.302+0000 7f70203cc700 1 -- start start 2023-10-16T13:49:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004004850 0x7f70180c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 0x7f70180ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70180ce330 0x7f70180ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70180ac950 con 0x7f7018156c60 2023-10-16T13:49:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70180acc30 con 0x7f7004004850 2023-10-16T13:49:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70180acf10 con 0x7f70180ce330 2023-10-16T13:49:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 0x7f70180ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 0x7f70180ad9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50186/0 (socket says 172.21.15.5:50186) 2023-10-16T13:49:22.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 -- 172.21.15.5:0/2398501078 learned_addr learned my addr 172.21.15.5:0/2398501078 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:22.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701e168700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004004850 0x7f70180c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701e969700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70180ce330 0x7f70180ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 -- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70180ce330 msgr2=0x7f70180ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70180ce330 0x7f70180ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 -- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004004850 msgr2=0x7f70180c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004004850 0x7f70180c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 -- 172.21.15.5:0/2398501078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70180ad1f0 con 0x7f7018156c60 2023-10-16T13:49:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701e969700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70180ce330 0x7f70180ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f701d967700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 0x7f70180ad9f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f700400c160 tx=0x7f700c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00e6c0 con 0x7f7018156c60 2023-10-16T13:49:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c003ad0 con 0x7f7018156c60 2023-10-16T13:49:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.303+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70180ad4d0 con 0x7f7018156c60 2023-10-16T13:49:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.304+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c003e80 con 0x7f7018156c60 2023-10-16T13:49:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.304+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70181570e0 con 0x7f7018156c60 2023-10-16T13:49:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.305+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7018070330 con 0x7f7018156c60 2023-10-16T13:49:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.305+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f700c013470 con 0x7f7018156c60 2023-10-16T13:49:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.305+0000 7f700affd700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ffc06b2f0 0x7f6ffc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.305+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f700c08b750 con 0x7f7018156c60 2023-10-16T13:49:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.306+0000 7f701e168700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ffc06b2f0 0x7f6ffc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.306+0000 7f701e168700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ffc06b2f0 0x7f6ffc06d7b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f701806a8b0 tx=0x7f7014009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.310+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f700c059db0 con 0x7f7018156c60 2023-10-16T13:49:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.553+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7018070720 con 0x7f7018156c60 2023-10-16T13:49:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.553+0000 7f700affd700 1 -- 172.21.15.5:0/2398501078 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f700c059940 con 0x7f7018156c60 2023-10-16T13:49:22.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:22.558 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7363,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/4208236815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4208236815},{"type":"v1","addr":"172.21.15.112:6836","nonce":4208236815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3176905904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3176905904},{"type":"v1","addr":"172.21.15.112:6837","nonce":3176905904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:48:51.129490+0000","modified":"2023-10-16T13:48:54.173911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7713":{"gid":7713,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/618714180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":618714180},{"type":"v1","addr":"172.21.15.5:6835","nonce":618714180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-16T13:49:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ffc06b2f0 msgr2=0x7f6ffc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ffc06b2f0 0x7f6ffc06d7b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f701806a8b0 tx=0x7f7014009040 comp rx=0 tx=0).stop 2023-10-16T13:49:22.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 msgr2=0x7f70180ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 0x7f70180ad9f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f700400c160 tx=0x7f700c0047c0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 shutdown_connections 2023-10-16T13:49:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6ffc06b2f0 0x7f6ffc06d7b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70180ce330 0x7f70180ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7004004850 0x7f70180c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 --2- 172.21.15.5:0/2398501078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7018156c60 0x7f70180ad9f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 >> 172.21.15.5:0/2398501078 conn(0x7f70180cd270 msgr2=0x7f70180c39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:22.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 shutdown_connections 2023-10-16T13:49:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.556+0000 7f70203cc700 1 -- 172.21.15.5:0/2398501078 wait complete. 2023-10-16T13:49:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 89 2023-10-16T13:49:22.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.693+0000 7f08edf87700 1 Processor -- start 2023-10-16T13:49:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.693+0000 7f08edf87700 1 -- start start 2023-10-16T13:49:22.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08edf87700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08e815ab10 0x7f08e815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08edf87700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e80b1f50 0x7f08e80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08edf87700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e815e7a0 con 0x7f08e80b23d0 2023-10-16T13:49:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08edf87700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e815f730 con 0x7f08e815ab10 2023-10-16T13:49:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08edf87700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80b29a0 con 0x7f08e80b1f50 2023-10-16T13:49:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08e7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08e80b23d0 0x7f08e80cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60200/0 (socket says 172.21.15.5:60200) 2023-10-16T13:49:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08e7fff700 1 -- 172.21.15.5:0/2967620502 learned_addr learned my addr 172.21.15.5:0/2967620502 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08e77fe700 1 --2- 172.21.15.5:0/2967620502 >> v2:172.21.15.112:3300/0 conn(0x7f08e815ab10 0x7f08e815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.694+0000 7f08e6ffd700 1 --2- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e80b1f50 0x7f08e80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e67fc700 1 -- 172.21.15.5:0/2967620502 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757559369 0 0) 0x7f08e815e7a0 con 0x7f08e80b23d0 2023-10-16T13:49:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e67fc700 1 -- 172.21.15.5:0/2967620502 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d40035b0 con 0x7f08e80b23d0 2023-10-16T13:49:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e77fe700 1 -- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e80b1f50 msgr2=0x7f08e80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e77fe700 1 --2- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e80b1f50 0x7f08e80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e77fe700 1 -- 172.21.15.5:0/2967620502 >> v1:172.21.15.5:6789/0 conn(0x7f08e80b23d0 legacy=0x7f08e80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e77fe700 1 -- 172.21.15.5:0/2967620502 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e80b2c80 con 0x7f08e815ab10 2023-10-16T13:49:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e77fe700 1 --2- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e815ab10 0x7f08e815f1f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009840 tx=0x7f08d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe2861e9a1f1dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e67fc700 1 -- 172.21.15.5:0/2967620502 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0011830 con 0x7f08e815ab10 2023-10-16T13:49:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e67fc700 1 -- 172.21.15.5:0/2967620502 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0011990 con 0x7f08e815ab10 2023-10-16T13:49:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.695+0000 7f08e67fc700 1 -- 172.21.15.5:0/2967620502 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0011d20 con 0x7f08e815ab10 2023-10-16T13:49:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 -- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e815ab10 msgr2=0x7f08e815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 --2- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e815ab10 0x7f08e815f1f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009840 tx=0x7f08d0009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 -- 172.21.15.5:0/2967620502 shutdown_connections 2023-10-16T13:49:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 --2- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e815ab10 0x7f08e815f1f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 --2- 172.21.15.5:0/2967620502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e80b1f50 0x7f08e80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 -- 172.21.15.5:0/2967620502 >> 172.21.15.5:0/2967620502 conn(0x7f08e806dae0 msgr2=0x7f08e806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 -- 172.21.15.5:0/2967620502 shutdown_connections 2023-10-16T13:49:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.696+0000 7f08edf87700 1 -- 172.21.15.5:0/2967620502 wait complete. 2023-10-16T13:49:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.697+0000 7f08edf87700 1 Processor -- start 2023-10-16T13:49:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.697+0000 7f08edf87700 1 -- start start 2023-10-16T13:49:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08edf87700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e80b1f50 0x7f08e80aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08edf87700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 0x7f08e81f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08edf87700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e815ab10 0x7f08e81567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08edf87700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e81f3540 con 0x7f08e80b23d0 2023-10-16T13:49:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08edf87700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80c3c00 con 0x7f08e80b1f50 2023-10-16T13:49:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08edf87700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e81f37f0 con 0x7f08e815ab10 2023-10-16T13:49:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 0x7f08e81f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 0x7f08e81f42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50200/0 (socket says 172.21.15.5:50200) 2023-10-16T13:49:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 -- 172.21.15.5:0/2169480380 learned_addr learned my addr 172.21.15.5:0/2169480380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e7fff700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e815ab10 0x7f08e81567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e77fe700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e80b1f50 0x7f08e80aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 -- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e815ab10 msgr2=0x7f08e81567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e815ab10 0x7f08e81567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 -- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e80b1f50 msgr2=0x7f08e80aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e80b1f50 0x7f08e80aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 -- 172.21.15.5:0/2169480380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00094a0 con 0x7f08e80b23d0 2023-10-16T13:49:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e7fff700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e815ab10 0x7f08e81567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08e6ffd700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 0x7f08e81f42d0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f08d800e900 tx=0x7f08d800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8009650 con 0x7f08e80b23d0 2023-10-16T13:49:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.698+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800ee50 con 0x7f08e80b23d0 2023-10-16T13:49:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.699+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e81f3ad0 con 0x7f08e80b23d0 2023-10-16T13:49:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.699+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800ca50 con 0x7f08e80b23d0 2023-10-16T13:49:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.699+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e8156fa0 con 0x7f08e80b23d0 2023-10-16T13:49:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.700+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e81f3ff0 con 0x7f08e80b23d0 2023-10-16T13:49:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.700+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f08d800cbb0 con 0x7f08e80b23d0 2023-10-16T13:49:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.700+0000 7f08dffff700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f08c806b2f0 0x7f08c806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.701+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f08d808a090 con 0x7f08e80b23d0 2023-10-16T13:49:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.701+0000 7f08e77fe700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f08c806b2f0 0x7f08c806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.701+0000 7f08e77fe700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f08c806b2f0 0x7f08c806d7b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000c00 tx=0x7f08d001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.705+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08e81f3ff0 con 0x7f08e80b23d0 2023-10-16T13:49:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.909+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e81f3ff0 con 0x7f08e80b23d0 2023-10-16T13:49:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.910+0000 7f08dffff700 1 -- 172.21.15.5:0/2169480380 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f08e81f3ff0 con 0x7f08e80b23d0 2023-10-16T13:49:22.914 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:22.914 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:15.084489+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:48:49.002718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-16T13:48:50.114887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6835/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6836/3556823542":"2023-10-17T13:49:08.644012+0000","172.21.15.112:6834/3556823542":"2023-10-17T13:49:08.644012+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f08c806b2f0 msgr2=0x7f08c806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f08c806b2f0 0x7f08c806d7b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000c00 tx=0x7f08d001c040 comp rx=0 tx=0).stop 2023-10-16T13:49:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 msgr2=0x7f08e81f42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 0x7f08e81f42d0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f08d800e900 tx=0x7f08d800ec10 comp rx=0 tx=0).stop 2023-10-16T13:49:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 shutdown_connections 2023-10-16T13:49:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f08c806b2f0 0x7f08c806d7b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08e815ab10 0x7f08e81567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e80b1f50 0x7f08e80aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 --2- 172.21.15.5:0/2169480380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e80b23d0 0x7f08e81f42d0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 >> 172.21.15.5:0/2169480380 conn(0x7f08e806dae0 msgr2=0x7f08e8159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 shutdown_connections 2023-10-16T13:49:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:22.912+0000 7f08edf87700 1 -- 172.21.15.5:0/2169480380 wait complete. 2023-10-16T13:49:22.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:49:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.051+0000 7fa3dd9e6700 1 Processor -- start 2023-10-16T13:49:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.051+0000 7fa3dd9e6700 1 -- start start 2023-10-16T13:49:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3dd9e6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3d815dbc0 0x7fa3d815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3dd9e6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d80d3fc0 0x7fa3d80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3dd9e6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d815e4e0 con 0x7fa3d80b7050 2023-10-16T13:49:23.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3dd9e6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d80b7560 con 0x7fa3d815dbc0 2023-10-16T13:49:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3dd9e6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80b7840 con 0x7fa3d80d3fc0 2023-10-16T13:49:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3d815dbc0 0x7fa3d815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa3d80b7050 0x7fa3d80d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60212/0 (socket says 172.21.15.5:60212) 2023-10-16T13:49:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3d815dbc0 0x7fa3d815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50206/0 (socket says 172.21.15.5:50206) 2023-10-16T13:49:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d77fe700 1 -- 172.21.15.5:0/3724941936 learned_addr learned my addr 172.21.15.5:0/3724941936 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d67fc700 1 --2- 172.21.15.5:0/3724941936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d80d3fc0 0x7fa3d80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/3724941936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d80d3fc0 msgr2=0x7fa3d80d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 --2- 172.21.15.5:0/3724941936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d80d3fc0 0x7fa3d80d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/3724941936 >> v1:172.21.15.5:6789/0 conn(0x7fa3d80b7050 legacy=0x7fa3d80d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/3724941936 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80b7b20 con 0x7fa3d815dbc0 2023-10-16T13:49:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d5ffb700 1 -- 172.21.15.5:0/3724941936 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276048337 0 0) 0x7fa3d815e4e0 con 0x7fa3d80b7050 2023-10-16T13:49:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d6ffd700 1 --2- 172.21.15.5:0/3724941936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d815dbc0 0x7fa3d815dfa0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009820 tx=0x7fa3cc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e708e848578b954 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.052+0000 7fa3d5ffb700 1 -- 172.21.15.5:0/3724941936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc005e30 con 0x7fa3d815dbc0 2023-10-16T13:49:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3d5ffb700 1 -- 172.21.15.5:0/3724941936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc006030 con 0x7fa3d815dbc0 2023-10-16T13:49:23.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3d5ffb700 1 -- 172.21.15.5:0/3724941936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0063e0 con 0x7fa3d815dbc0 2023-10-16T13:49:23.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/3724941936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d815dbc0 msgr2=0x7fa3d815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/3724941936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d815dbc0 0x7fa3d815dfa0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009820 tx=0x7fa3cc009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:23.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/3724941936 shutdown_connections 2023-10-16T13:49:23.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/3724941936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d815dbc0 0x7fa3d815dfa0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/3724941936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d80d3fc0 0x7fa3d80d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/3724941936 >> 172.21.15.5:0/3724941936 conn(0x7fa3d809cb40 msgr2=0x7fa3d80d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/3724941936 shutdown_connections 2023-10-16T13:49:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.053+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/3724941936 wait complete. 2023-10-16T13:49:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.054+0000 7fa3dd9e6700 1 Processor -- start 2023-10-16T13:49:23.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.054+0000 7fa3dd9e6700 1 -- start start 2023-10-16T13:49:23.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3dd9e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 0x7fa3d8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3dd9e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3d80d3fc0 0x7fa3d8155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3dd9e6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d815dbc0 0x7fa3d80c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3dd9e6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81579b0 con 0x7fa3d80b7050 2023-10-16T13:49:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3dd9e6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80ca860 con 0x7fa3d80d3fc0 2023-10-16T13:49:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3dd9e6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80cab40 con 0x7fa3d815dbc0 2023-10-16T13:49:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 0x7fa3d8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 0x7fa3d8157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50210/0 (socket says 172.21.15.5:50210) 2023-10-16T13:49:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.055+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/1330120634 learned_addr learned my addr 172.21.15.5:0/1330120634 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d815dbc0 msgr2=0x7fa3d80c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d6ffd700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d815dbc0 0x7fa3d80c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3d80d3fc0 msgr2=0x7fa3d8155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d67fc700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3d80d3fc0 0x7fa3d8155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d6ffd700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3d80d3fc0 0x7fa3d8155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d6ffd700 1 -- 172.21.15.5:0/1330120634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc009430 con 0x7fa3d80b7050 2023-10-16T13:49:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3d6ffd700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 0x7fa3d8157470 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc013040 tx=0x7fa3cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc025430 con 0x7fa3d80b7050 2023-10-16T13:49:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc020070 con 0x7fa3d80b7050 2023-10-16T13:49:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d80cae20 con 0x7fa3d80b7050 2023-10-16T13:49:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc025810 con 0x7fa3d80b7050 2023-10-16T13:49:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.056+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d80cb3e0 con 0x7fa3d80b7050 2023-10-16T13:49:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.057+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d804ebb0 con 0x7fa3d80b7050 2023-10-16T13:49:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.058+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fa3cc022030 con 0x7fa3d80b7050 2023-10-16T13:49:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.058+0000 7fa3bffff700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3c406b2f0 0x7fa3c406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.058+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa3cc08b2c0 con 0x7fa3d80b7050 2023-10-16T13:49:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.058+0000 7fa3d67fc700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3c406b2f0 0x7fa3c406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.059+0000 7fa3d67fc700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3c406b2f0 0x7fa3c406d7b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80a1680 tx=0x7fa3c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.063+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3cc055e80 con 0x7fa3d80b7050 2023-10-16T13:49:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.311+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa3d80ce1b0 con 0x7fa3d80b7050 2023-10-16T13:49:23.316 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:49:23.312+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:49:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.313+0000 7fa3bffff700 1 -- 172.21.15.5:0/1330120634 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa3cc0594a0 con 0x7fa3d80b7050 2023-10-16T13:49:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3c406b2f0 msgr2=0x7fa3c406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3c406b2f0 0x7fa3c406d7b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80a1680 tx=0x7fa3c8008040 comp rx=0 tx=0).stop 2023-10-16T13:49:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 msgr2=0x7fa3d8157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 0x7fa3d8157470 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc013040 tx=0x7fa3cc004750 comp rx=0 tx=0).stop 2023-10-16T13:49:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 shutdown_connections 2023-10-16T13:49:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa3c406b2f0 0x7fa3c406d7b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3d815dbc0 0x7fa3d80c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d80b7050 0x7fa3d8157470 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 --2- 172.21.15.5:0/1330120634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3d80d3fc0 0x7fa3d8155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.316+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 >> 172.21.15.5:0/1330120634 conn(0x7fa3d809cb40 msgr2=0x7fa3d80d1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.317+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 shutdown_connections 2023-10-16T13:49:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.317+0000 7fa3dd9e6700 1 -- 172.21.15.5:0/1330120634 wait complete. 2023-10-16T13:49:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:49:23.324 INFO:tasks.ceph.mds.a.smithi005.stderr: -3970> 2023-10-16T13:48:56.703+0000 7ff9ae202700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:23.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:49:23.352 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:49:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.458+0000 7f41c915f700 1 Processor -- start 2023-10-16T13:49:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.458+0000 7f41c915f700 1 -- start start 2023-10-16T13:49:23.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c915f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41c40cd950 0x7f41c415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c915f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c915f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c40cf290 con 0x7f41c40cede0 2023-10-16T13:49:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c915f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c41619a0 con 0x7f41c40cd950 2023-10-16T13:49:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c915f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c406b1f0 con 0x7f41c406a840 2023-10-16T13:49:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c2d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41c40cd950 0x7f41c415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c2d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41c40cd950 0x7f41c415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50236/0 (socket says 172.21.15.5:50236) 2023-10-16T13:49:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c2d9d700 1 -- 172.21.15.5:0/697479031 learned_addr learned my addr 172.21.15.5:0/697479031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c2d9d700 1 -- 172.21.15.5:0/697479031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 msgr2=0x7f41c406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c2d9d700 1 --2- 172.21.15.5:0/697479031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.459+0000 7f41c2d9d700 1 -- 172.21.15.5:0/697479031 >> v1:172.21.15.112:6789/0 conn(0x7f41c40cede0 legacy=0x7f41c415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:23.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c2d9d700 1 -- 172.21.15.5:0/697479031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40b2d60 con 0x7f41c40cd950 2023-10-16T13:49:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c2d9d700 1 --2- 172.21.15.5:0/697479031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c415e2f0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f41b80098f0 tx=0x7f41b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa3e2d190732f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c1d9b700 1 -- 172.21.15.5:0/697479031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8004230 con 0x7f41c40cd950 2023-10-16T13:49:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c1d9b700 1 -- 172.21.15.5:0/697479031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8004390 con 0x7f41c40cd950 2023-10-16T13:49:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c1d9b700 1 -- 172.21.15.5:0/697479031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b80036a0 con 0x7f41c40cd950 2023-10-16T13:49:23.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 -- 172.21.15.5:0/697479031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 msgr2=0x7f41c415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 --2- 172.21.15.5:0/697479031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c415e2f0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f41b80098f0 tx=0x7f41b8009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 -- 172.21.15.5:0/697479031 shutdown_connections 2023-10-16T13:49:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 --2- 172.21.15.5:0/697479031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 --2- 172.21.15.5:0/697479031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c415e2f0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 -- 172.21.15.5:0/697479031 >> 172.21.15.5:0/697479031 conn(0x7f41c406dae0 msgr2=0x7f41c406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 -- 172.21.15.5:0/697479031 shutdown_connections 2023-10-16T13:49:23.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.460+0000 7f41c915f700 1 -- 172.21.15.5:0/697479031 wait complete. 2023-10-16T13:49:23.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.462+0000 7f41c915f700 1 Processor -- start 2023-10-16T13:49:23.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.462+0000 7f41c915f700 1 -- start start 2023-10-16T13:49:23.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c915f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c40b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c915f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c40c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c915f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41c40cede0 0x7f41c40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c915f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b49a0 con 0x7f41c40cd950 2023-10-16T13:49:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c915f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b43e0 con 0x7f41c40cede0 2023-10-16T13:49:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c915f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b46c0 con 0x7f41c406a840 2023-10-16T13:49:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c40c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c40c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50242/0 (socket says 172.21.15.5:50242) 2023-10-16T13:49:23.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 -- 172.21.15.5:0/831036118 learned_addr learned my addr 172.21.15.5:0/831036118 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:23.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c359e700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41c40cede0 0x7f41c40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c2d9d700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c40b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 -- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 msgr2=0x7f41c40b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c40b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 -- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41c40cede0 msgr2=0x7f41c40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:23.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41c40cede0 0x7f41c40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:23.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 -- 172.21.15.5:0/831036118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8009550 con 0x7f41c40cd950 2023-10-16T13:49:23.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.463+0000 7f41c259c700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c40c8790 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c4b0 tx=0x7f41b400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:23.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.464+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011790 con 0x7f41c40cd950 2023-10-16T13:49:23.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.464+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b40118f0 con 0x7f41c40cd950 2023-10-16T13:49:23.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.464+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c40ac950 con 0x7f41c40cd950 2023-10-16T13:49:23.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.464+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011ca0 con 0x7f41c40cd950 2023-10-16T13:49:23.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.464+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c4153dc0 con 0x7f41c40cd950 2023-10-16T13:49:23.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.465+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c40ace70 con 0x7f41c40cd950 2023-10-16T13:49:23.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.465+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f41b4012420 con 0x7f41c40cd950 2023-10-16T13:49:23.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.465+0000 7f41ab7fe700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41b006b2f0 0x7f41b006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:23.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.465+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f41b4089950 con 0x7f41c40cd950 2023-10-16T13:49:23.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.466+0000 7f41c2d9d700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41b006b2f0 0x7f41b006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:23.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.466+0000 7f41c2d9d700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41b006b2f0 0x7f41b006d7b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009130 tx=0x7f41b8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:23.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.471+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41c40ace70 con 0x7f41c40cd950 2023-10-16T13:49:23.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:23.717+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f41c40ace70 con 0x7f41c40cd950 2023-10-16T13:49:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.318+0000 7f41ab7fe700 1 -- 172.21.15.5:0/831036118 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41c40ace70 con 0x7f41c40cd950 2023-10-16T13:49:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41b006b2f0 msgr2=0x7f41b006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41b006b2f0 0x7f41b006d7b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009130 tx=0x7f41b8008030 comp rx=0 tx=0).stop 2023-10-16T13:49:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 msgr2=0x7f41c40c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c40c8790 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c4b0 tx=0x7f41b400c7c0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 shutdown_connections 2023-10-16T13:49:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41c40cede0 0x7f41c40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41b006b2f0 0x7f41b006d7b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41c406a840 0x7f41c40b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 --2- 172.21.15.5:0/831036118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c40cd950 0x7f41c40c8790 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.321+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 >> 172.21.15.5:0/831036118 conn(0x7f41c406dae0 msgr2=0x7f41c415d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.322+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 shutdown_connections 2023-10-16T13:49:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.322+0000 7f41c915f700 1 -- 172.21.15.5:0/831036118 wait complete. 2023-10-16T13:49:24.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:49:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.515+0000 7fb0cad78700 1 Processor -- start 2023-10-16T13:49:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.515+0000 7fb0cad78700 1 -- start start 2023-10-16T13:49:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0cad78700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0c40cdf40 0x7fb0c40d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0cad78700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0c40b0d30 0x7fb0c40b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0cad78700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c40d05e0 con 0x7fb0c40cf430 2023-10-16T13:49:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0cad78700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40b08d0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0cad78700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40cfcb0 con 0x7fb0c40cdf40 2023-10-16T13:49:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c9315700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0c40b0d30 0x7fb0c40b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb0c40cf430 0x7fb0c40ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60254/0 (socket says 172.21.15.5:60254) 2023-10-16T13:49:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c3fff700 1 -- 172.21.15.5:0/3186293284 learned_addr learned my addr 172.21.15.5:0/3186293284 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c8b14700 1 --2- 172.21.15.5:0/3186293284 >> v2:172.21.15.112:3300/0 conn(0x7fb0c40cdf40 0x7fb0c40d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c9315700 1 -- 172.21.15.5:0/3186293284 >> v2:172.21.15.112:3300/0 conn(0x7fb0c40cdf40 msgr2=0x7fb0c40d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c9315700 1 --2- 172.21.15.5:0/3186293284 >> v2:172.21.15.112:3300/0 conn(0x7fb0c40cdf40 0x7fb0c40d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c9315700 1 -- 172.21.15.5:0/3186293284 >> v1:172.21.15.5:6789/0 conn(0x7fb0c40cf430 legacy=0x7fb0c40ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c9315700 1 -- 172.21.15.5:0/3186293284 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c40cff90 con 0x7fb0c40b0d30 2023-10-16T13:49:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.516+0000 7fb0c37fe700 1 -- 172.21.15.5:0/3186293284 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922116862 0 0) 0x7fb0c40d05e0 con 0x7fb0c40cf430 2023-10-16T13:49:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0c9315700 1 --2- 172.21.15.5:0/3186293284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c40b11c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40b40f0 tx=0x7fb0bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaa6190832ff502 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0c37fe700 1 -- 172.21.15.5:0/3186293284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00e070 con 0x7fb0c40b0d30 2023-10-16T13:49:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0c37fe700 1 -- 172.21.15.5:0/3186293284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc00bb20 con 0x7fb0c40b0d30 2023-10-16T13:49:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0c37fe700 1 -- 172.21.15.5:0/3186293284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc012430 con 0x7fb0c40b0d30 2023-10-16T13:49:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 -- 172.21.15.5:0/3186293284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 msgr2=0x7fb0c40b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 --2- 172.21.15.5:0/3186293284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c40b11c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40b40f0 tx=0x7fb0bc00b330 comp rx=0 tx=0).stop 2023-10-16T13:49:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 -- 172.21.15.5:0/3186293284 shutdown_connections 2023-10-16T13:49:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 --2- 172.21.15.5:0/3186293284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c40b11c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 --2- 172.21.15.5:0/3186293284 >> v2:172.21.15.112:3300/0 conn(0x7fb0c40cdf40 0x7fb0c40d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 -- 172.21.15.5:0/3186293284 >> 172.21.15.5:0/3186293284 conn(0x7fb0c40d1530 msgr2=0x7fb0c40d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 -- 172.21.15.5:0/3186293284 shutdown_connections 2023-10-16T13:49:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.517+0000 7fb0cad78700 1 -- 172.21.15.5:0/3186293284 wait complete. 2023-10-16T13:49:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.519+0000 7fb0cad78700 1 Processor -- start 2023-10-16T13:49:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.519+0000 7fb0cad78700 1 -- start start 2023-10-16T13:49:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.519+0000 7fb0cad78700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c41e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0c40cdf40 0x7fb0c40cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c40cf430 0x7fb0c41e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40c45d0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40c42f0 con 0x7fb0c40cf430 2023-10-16T13:49:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40c9080 con 0x7fb0c40cdf40 2023-10-16T13:49:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c41e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c41e5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50254/0 (socket says 172.21.15.5:50254) 2023-10-16T13:49:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 -- 172.21.15.5:0/280484299 learned_addr learned my addr 172.21.15.5:0/280484299 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c9315700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c40cf430 0x7fb0c41e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c3fff700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0c40cdf40 0x7fb0c40cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 -- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0c40cdf40 msgr2=0x7fb0c40cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0c40cdf40 0x7fb0c40cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 -- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c40cf430 msgr2=0x7fb0c41e21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c40cf430 0x7fb0c41e21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 -- 172.21.15.5:0/280484299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc009a70 con 0x7fb0c40b0d30 2023-10-16T13:49:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c3fff700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0c40cdf40 0x7fb0c40cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c8b14700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c41e5b20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800e990 tx=0x7fb0b800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80096f0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b800c850 con 0x7fb0c40b0d30 2023-10-16T13:49:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800eee0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c40c9360 con 0x7fb0c40b0d30 2023-10-16T13:49:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.520+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c40c87e0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.521+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c4067d20 con 0x7fb0c40b0d30 2023-10-16T13:49:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.522+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fb0b800cbc0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.522+0000 7fb0c17fa700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb0a806b2f0 0x7fb0a806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.523+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb0b808a240 con 0x7fb0c40b0d30 2023-10-16T13:49:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.523+0000 7fb0c3fff700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb0a806b2f0 0x7fb0a806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.523+0000 7fb0c3fff700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb0a806b2f0 0x7fb0a806d7b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40c8e00 tx=0x7fb0b0007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.527+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0b8054bd0 con 0x7fb0c40b0d30 2023-10-16T13:49:24.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:24.728+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0c406b950 con 0x7fb0c40b0d30 2023-10-16T13:49:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.320+0000 7fb0c17fa700 1 -- 172.21.15.5:0/280484299 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb0b80581f0 con 0x7fb0c40b0d30 2023-10-16T13:49:25.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb0a806b2f0 msgr2=0x7fb0a806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:25.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb0a806b2f0 0x7fb0a806d7b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40c8e00 tx=0x7fb0b0007ca0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 msgr2=0x7fb0c41e5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c41e5b20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800e990 tx=0x7fb0b800eca0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 shutdown_connections 2023-10-16T13:49:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0c40cf430 0x7fb0c41e21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0c40b0d30 0x7fb0c41e5b20 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb0a806b2f0 0x7fb0a806d7b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 --2- 172.21.15.5:0/280484299 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0c40cdf40 0x7fb0c40cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 >> 172.21.15.5:0/280484299 conn(0x7fb0c40d1530 msgr2=0x7fb0c40b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 shutdown_connections 2023-10-16T13:49:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.323+0000 7fb0cad78700 1 -- 172.21.15.5:0/280484299 wait complete. 2023-10-16T13:49:25.329 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:49:25.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:49:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.475+0000 7f5b62675700 1 Processor -- start 2023-10-16T13:49:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.475+0000 7f5b62675700 1 -- start start 2023-10-16T13:49:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b62675700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b5c0cf0d0 0x7f5b5c165570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b62675700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c15aad0 con 0x7f5b5c071920 2023-10-16T13:49:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b62675700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0ce2b0 con 0x7f5b5c15a6f0 2023-10-16T13:49:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b62675700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0cf680 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b5b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5b5c071920 0x7f5b5c0ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60268/0 (socket says 172.21.15.5:60268) 2023-10-16T13:49:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b60c12700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b5c0cf0d0 0x7f5b5c165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.476+0000 7f5b5b7fe700 1 -- 172.21.15.5:0/2897345964 learned_addr learned my addr 172.21.15.5:0/2897345964 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b60c12700 1 -- 172.21.15.5:0/2897345964 >> v1:172.21.15.112:6789/0 conn(0x7f5b5c15a6f0 legacy=0x7f5b5c071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b60c12700 1 -- 172.21.15.5:0/2897345964 >> v1:172.21.15.5:6789/0 conn(0x7f5b5c071920 legacy=0x7f5b5c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b5affd700 1 -- 172.21.15.5:0/2897345964 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646677384 0 0) 0x7f5b5c15aad0 con 0x7f5b5c071920 2023-10-16T13:49:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b60c12700 1 -- 172.21.15.5:0/2897345964 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0ce740 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b60c12700 1 --2- 172.21.15.5:0/2897345964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c165570 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009d90 tx=0x7f5b5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123df7377b6b30e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b5affd700 1 -- 172.21.15.5:0/2897345964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400e070 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b5affd700 1 -- 172.21.15.5:0/2897345964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5400bb90 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b5affd700 1 -- 172.21.15.5:0/2897345964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54003a20 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b62675700 1 -- 172.21.15.5:0/2897345964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 msgr2=0x7f5b5c165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.477+0000 7f5b62675700 1 --2- 172.21.15.5:0/2897345964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c165570 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009d90 tx=0x7f5b5400b330 comp rx=0 tx=0).stop 2023-10-16T13:49:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.478+0000 7f5b62675700 1 -- 172.21.15.5:0/2897345964 shutdown_connections 2023-10-16T13:49:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.478+0000 7f5b62675700 1 --2- 172.21.15.5:0/2897345964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c165570 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.478+0000 7f5b62675700 1 -- 172.21.15.5:0/2897345964 >> 172.21.15.5:0/2897345964 conn(0x7f5b5c0cfc10 msgr2=0x7f5b5c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.478+0000 7f5b62675700 1 -- 172.21.15.5:0/2897345964 shutdown_connections 2023-10-16T13:49:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.478+0000 7f5b62675700 1 -- 172.21.15.5:0/2897345964 wait complete. 2023-10-16T13:49:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.479+0000 7f5b62675700 1 Processor -- start 2023-10-16T13:49:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.479+0000 7f5b62675700 1 -- start start 2023-10-16T13:49:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b62675700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b5c071920 0x7f5b5c0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b62675700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b62675700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b5c15a6f0 0x7f5b5c1f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b62675700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0c28c0 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b62675700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c167c70 con 0x7f5b5c15a6f0 2023-10-16T13:49:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b62675700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c167f50 con 0x7f5b5c071920 2023-10-16T13:49:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50270/0 (socket says 172.21.15.5:50270) 2023-10-16T13:49:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 -- 172.21.15.5:0/654164989 learned_addr learned my addr 172.21.15.5:0/654164989 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b60c12700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b5c15a6f0 0x7f5b5c1f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5bfff700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b5c071920 0x7f5b5c0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 -- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b5c071920 msgr2=0x7f5b5c0c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b5c071920 0x7f5b5c0c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 -- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b5c15a6f0 msgr2=0x7f5b5c1f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b5c15a6f0 0x7f5b5c1f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 -- 172.21.15.5:0/654164989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009a70 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.480+0000 7f5b5b7fe700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c149010 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0011e0 tx=0x7f5b4c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.481+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c004c80 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.481+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c004e00 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.481+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c168230 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.481+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c007310 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.481+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c149550 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.482+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c168860 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.482+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5b4c007470 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.482+0000 7f5b58ff9700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b4806b2f0 0x7f5b4806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.483+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5529+0+0 (secure 0 0 0) 0x7f5b4c0897d0 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.483+0000 7f5b5bfff700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b4806b2f0 0x7f5b4806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.483+0000 7f5b5bfff700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b4806b2f0 0x7f5b4806d7b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b2c10 tx=0x7f5b500090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.487+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b4c0544f0 con 0x7f5b5c0cf0d0 2023-10-16T13:49:25.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:25.688+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b5c0cdc30 con 0x7f5b5c0cf0d0 2023-10-16T13:49:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.325+0000 7f5b58ff9700 1 -- 172.21.15.5:0/654164989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v127) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5b4c057b10 con 0x7f5b5c0cf0d0 2023-10-16T13:49:26.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.328+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b4806b2f0 msgr2=0x7f5b4806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.328+0000 7f5b62675700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b4806b2f0 0x7f5b4806d7b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b2c10 tx=0x7f5b500090e0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.328+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 msgr2=0x7f5b5c149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.328+0000 7f5b62675700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c149010 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0011e0 tx=0x7f5b4c00ca30 comp rx=0 tx=0).stop 2023-10-16T13:49:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 shutdown_connections 2023-10-16T13:49:26.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b5c15a6f0 0x7f5b5c1f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5b4806b2f0 0x7f5b4806d7b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b5c071920 0x7f5b5c0c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 --2- 172.21.15.5:0/654164989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b5c0cf0d0 0x7f5b5c149010 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 >> 172.21.15.5:0/654164989 conn(0x7f5b5c0cfc10 msgr2=0x7f5b5c0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:26.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 shutdown_connections 2023-10-16T13:49:26.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.329+0000 7f5b62675700 1 -- 172.21.15.5:0/654164989 wait complete. 2023-10-16T13:49:26.335 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:49:26.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:49:26.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.479+0000 7f097a807700 1 Processor -- start 2023-10-16T13:49:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.480+0000 7f097a807700 1 -- start start 2023-10-16T13:49:26.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.480+0000 7f097a807700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f097415eab0 0x7f09740cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.480+0000 7f097a807700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09740d2170 con 0x7f09740cf6d0 2023-10-16T13:49:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.480+0000 7f097a807700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097415ee90 con 0x7f09740d1d90 2023-10-16T13:49:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.480+0000 7f097a807700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09740cfb60 con 0x7f097415eab0 2023-10-16T13:49:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0973fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f097415eab0 0x7f09740cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f09737fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f09740cf6d0 0x7f09740d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60280/0 (socket says 172.21.15.5:60280) 2023-10-16T13:49:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f09737fe700 1 -- 172.21.15.5:0/2323082591 learned_addr learned my addr 172.21.15.5:0/2323082591 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0973fff700 1 -- 172.21.15.5:0/2323082591 >> v1:172.21.15.112:6789/0 conn(0x7f09740d1d90 legacy=0x7f09740cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0973fff700 1 -- 172.21.15.5:0/2323082591 >> v1:172.21.15.5:6789/0 conn(0x7f09740cf6d0 legacy=0x7f09740d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0973fff700 1 -- 172.21.15.5:0/2323082591 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974158370 con 0x7f097415eab0 2023-10-16T13:49:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0972ffd700 1 -- 172.21.15.5:0/2323082591 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437397710 0 0) 0x7f0968001110 con 0x7f09740cf6d0 2023-10-16T13:49:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0973fff700 1 --2- 172.21.15.5:0/2323082591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097415eab0 0x7f09740cf190 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0964009840 tx=0x7f0964009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147a6a6f0fd9e7be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0972ffd700 1 -- 172.21.15.5:0/2323082591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964004230 con 0x7f097415eab0 2023-10-16T13:49:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0972ffd700 1 -- 172.21.15.5:0/2323082591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964004390 con 0x7f097415eab0 2023-10-16T13:49:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.481+0000 7f0972ffd700 1 -- 172.21.15.5:0/2323082591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09640036a0 con 0x7f097415eab0 2023-10-16T13:49:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 -- 172.21.15.5:0/2323082591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097415eab0 msgr2=0x7f09740cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 --2- 172.21.15.5:0/2323082591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097415eab0 0x7f09740cf190 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0964009840 tx=0x7f0964009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 -- 172.21.15.5:0/2323082591 shutdown_connections 2023-10-16T13:49:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 --2- 172.21.15.5:0/2323082591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097415eab0 0x7f09740cf190 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 -- 172.21.15.5:0/2323082591 >> 172.21.15.5:0/2323082591 conn(0x7f09740665a0 msgr2=0x7f0974066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 -- 172.21.15.5:0/2323082591 shutdown_connections 2023-10-16T13:49:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.482+0000 7f097a807700 1 -- 172.21.15.5:0/2323082591 wait complete. 2023-10-16T13:49:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.483+0000 7f097a807700 1 Processor -- start 2023-10-16T13:49:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.483+0000 7f097a807700 1 -- start start 2023-10-16T13:49:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f097a807700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09740cf6d0 0x7f0974157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f097a807700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 0x7f09740b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f097a807700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f097415eab0 0x7f09740b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f097a807700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740ae120 con 0x7f09740d1d90 2023-10-16T13:49:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f097a807700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740c7ed0 con 0x7f09740cf6d0 2023-10-16T13:49:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f097a807700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740c6f90 con 0x7f097415eab0 2023-10-16T13:49:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 0x7f09740b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 0x7f09740b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50284/0 (socket says 172.21.15.5:50284) 2023-10-16T13:49:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 -- 172.21.15.5:0/2415050803 learned_addr learned my addr 172.21.15.5:0/2415050803 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f0973fff700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09740cf6d0 0x7f0974157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 -- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f097415eab0 msgr2=0x7f09740b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f097415eab0 0x7f09740b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 -- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09740cf6d0 msgr2=0x7f0974157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09740cf6d0 0x7f0974157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 -- 172.21.15.5:0/2415050803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640094a0 con 0x7f09740d1d90 2023-10-16T13:49:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f0973fff700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09740cf6d0 0x7f0974157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.484+0000 7f09737fe700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 0x7f09740b63b0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f096800c550 tx=0x7f096800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.485+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968004c80 con 0x7f09740d1d90 2023-10-16T13:49:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.485+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968004e00 con 0x7f09740d1d90 2023-10-16T13:49:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.485+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09740c61d0 con 0x7f09740d1d90 2023-10-16T13:49:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.485+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968007310 con 0x7f09740d1d90 2023-10-16T13:49:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.485+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09740c6790 con 0x7f09740d1d90 2023-10-16T13:49:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.486+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09741f4290 con 0x7f09740d1d90 2023-10-16T13:49:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.486+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f0968007470 con 0x7f09740d1d90 2023-10-16T13:49:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.486+0000 7f0970ff9700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f096006b2f0 0x7f096006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.487+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f09680894a0 con 0x7f09740d1d90 2023-10-16T13:49:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.487+0000 7f0973fff700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f096006b2f0 0x7f096006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.487+0000 7f0973fff700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f096006b2f0 0x7f096006d7b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0964009b90 tx=0x7f0964008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.491+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09680543e0 con 0x7f09740d1d90 2023-10-16T13:49:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.695+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09740d2170 con 0x7f09740d1d90 2023-10-16T13:49:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.698+0000 7f0970ff9700 1 -- 172.21.15.5:0/2415050803 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09740d2170 con 0x7f09740d1d90 2023-10-16T13:49:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f096006b2f0 msgr2=0x7f096006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f096006b2f0 0x7f096006d7b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0964009b90 tx=0x7f0964008030 comp rx=0 tx=0).stop 2023-10-16T13:49:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 msgr2=0x7f09740b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 0x7f09740b63b0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f096800c550 tx=0x7f096800c910 comp rx=0 tx=0).stop 2023-10-16T13:49:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 shutdown_connections 2023-10-16T13:49:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f096006b2f0 0x7f096006d7b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f097415eab0 0x7f09740b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09740cf6d0 0x7f0974157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 --2- 172.21.15.5:0/2415050803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09740d1d90 0x7f09740b63b0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 >> 172.21.15.5:0/2415050803 conn(0x7f09740665a0 msgr2=0x7f09740b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 shutdown_connections 2023-10-16T13:49:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.700+0000 7f097a807700 1 -- 172.21.15.5:0/2415050803 wait complete. 2023-10-16T13:49:26.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-16T13:49:26.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.838+0000 7ff5bae3b700 1 Processor -- start 2023-10-16T13:49:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.838+0000 7ff5bae3b700 1 -- start start 2023-10-16T13:49:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5bae3b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5b40cee90 0x7ff5b415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5bae3b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b415e290 0x7ff5b40cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5bae3b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b4158120 con 0x7ff5b4157d40 2023-10-16T13:49:26.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5bae3b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b406e560 con 0x7ff5b40cee90 2023-10-16T13:49:26.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5bae3b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415e720 con 0x7ff5b415e290 2023-10-16T13:49:26.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5b40cee90 0x7ff5b415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5b8bd7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5b4157d40 0x7ff5b406de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60294/0 (socket says 172.21.15.5:60294) 2023-10-16T13:49:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.839+0000 7ff5b8bd7700 1 -- 172.21.15.5:0/1684979235 learned_addr learned my addr 172.21.15.5:0/1684979235 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b93d8700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b415e290 0x7ff5b40cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b3fff700 1 -- 172.21.15.5:0/1684979235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b415e290 msgr2=0x7ff5b40cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b3fff700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b415e290 0x7ff5b40cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b3fff700 1 -- 172.21.15.5:0/1684979235 >> v1:172.21.15.5:6789/0 conn(0x7ff5b4157d40 legacy=0x7ff5b406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b3fff700 1 -- 172.21.15.5:0/1684979235 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b406a840 con 0x7ff5b40cee90 2023-10-16T13:49:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b37fe700 1 -- 172.21.15.5:0/1684979235 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340956685 0 0) 0x7ff5b4158120 con 0x7ff5b4157d40 2023-10-16T13:49:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b93d8700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b415e290 0x7ff5b40cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b3fff700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b40cee90 0x7ff5b415dd50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000bb10 tx=0x7ff5a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703c33debff3d6d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b37fe700 1 -- 172.21.15.5:0/1684979235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000dcf0 con 0x7ff5b40cee90 2023-10-16T13:49:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b37fe700 1 -- 172.21.15.5:0/1684979235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000de50 con 0x7ff5b40cee90 2023-10-16T13:49:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5b37fe700 1 -- 172.21.15.5:0/1684979235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0010690 con 0x7ff5b40cee90 2023-10-16T13:49:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5bae3b700 1 -- 172.21.15.5:0/1684979235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b40cee90 msgr2=0x7ff5b415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.840+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b40cee90 0x7ff5b415dd50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000bb10 tx=0x7ff5a000be20 comp rx=0 tx=0).stop 2023-10-16T13:49:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.841+0000 7ff5bae3b700 1 -- 172.21.15.5:0/1684979235 shutdown_connections 2023-10-16T13:49:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.841+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b415e290 0x7ff5b40cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.841+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/1684979235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b40cee90 0x7ff5b415dd50 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.841+0000 7ff5bae3b700 1 -- 172.21.15.5:0/1684979235 >> 172.21.15.5:0/1684979235 conn(0x7ff5b40cc6f0 msgr2=0x7ff5b40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:26.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.841+0000 7ff5bae3b700 1 -- 172.21.15.5:0/1684979235 shutdown_connections 2023-10-16T13:49:26.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.841+0000 7ff5bae3b700 1 -- 172.21.15.5:0/1684979235 wait complete. 2023-10-16T13:49:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.842+0000 7ff5bae3b700 1 Processor -- start 2023-10-16T13:49:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.842+0000 7ff5bae3b700 1 -- start start 2023-10-16T13:49:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5bae3b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b40cee90 0x7ff5b40c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5bae3b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b4157d40 0x7ff5b40c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5bae3b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 0x7ff5b4146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5bae3b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c3aa0 con 0x7ff5b415e290 2023-10-16T13:49:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5bae3b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c3520 con 0x7ff5b40cee90 2023-10-16T13:49:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5bae3b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4146a70 con 0x7ff5b4157d40 2023-10-16T13:49:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.843+0000 7ff5b93d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 0x7ff5b4146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 0x7ff5b4146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50300/0 (socket says 172.21.15.5:50300) 2023-10-16T13:49:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 -- 172.21.15.5:0/3193951668 learned_addr learned my addr 172.21.15.5:0/3193951668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b8bd7700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b40cee90 0x7ff5b40c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b3fff700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b4157d40 0x7ff5b40c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 -- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b4157d40 msgr2=0x7ff5b40c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b4157d40 0x7ff5b40c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 -- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b40cee90 msgr2=0x7ff5b40c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b40cee90 0x7ff5b40c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 -- 172.21.15.5:0/3193951668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a000b740 con 0x7ff5b415e290 2023-10-16T13:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b93d8700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 0x7ff5b4146530 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00cd50 tx=0x7ff5ac00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00f480 con 0x7ff5b415e290 2023-10-16T13:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac00f600 con 0x7ff5b415e290 2023-10-16T13:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b40c37c0 con 0x7ff5b415e290 2023-10-16T13:49:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00f9b0 con 0x7ff5b415e290 2023-10-16T13:49:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.844+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40c75e0 con 0x7ff5b415e290 2023-10-16T13:49:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.845+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4067d20 con 0x7ff5b415e290 2023-10-16T13:49:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.846+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7ff5ac00b040 con 0x7ff5b415e290 2023-10-16T13:49:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.846+0000 7ff5b17fa700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff59806b2f0 0x7ff59806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.846+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff5ac08a410 con 0x7ff5b415e290 2023-10-16T13:49:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.846+0000 7ff5b8bd7700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff59806b2f0 0x7ff59806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.847+0000 7ff5b8bd7700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff59806b2f0 0x7ff59806d7b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8000f60 tx=0x7ff5a8007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:26.851+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5ac055090 con 0x7ff5b415e290 2023-10-16T13:49:27.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.144+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7ff5b40c78f0 con 0x7ff5b415e290 2023-10-16T13:49:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.326+0000 7ff5b17fa700 1 -- 172.21.15.5:0/3193951668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v492) v1 ==== 131+0+0 (secure 0 0 0) 0x7ff5ac0586b0 con 0x7ff5b415e290 2023-10-16T13:49:27.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff59806b2f0 msgr2=0x7ff59806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff59806b2f0 0x7ff59806d7b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8000f60 tx=0x7ff5a8007be0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 msgr2=0x7ff5b4146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 0x7ff5b4146530 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00cd50 tx=0x7ff5ac00a560 comp rx=0 tx=0).stop 2023-10-16T13:49:27.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 shutdown_connections 2023-10-16T13:49:27.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b415e290 0x7ff5b4146530 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b40cee90 0x7ff5b40c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff59806b2f0 0x7ff59806d7b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 --2- 172.21.15.5:0/3193951668 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5b4157d40 0x7ff5b40c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.328+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 >> 172.21.15.5:0/3193951668 conn(0x7ff5b40cc6f0 msgr2=0x7ff5b40711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.329+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 shutdown_connections 2023-10-16T13:49:27.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.329+0000 7ff5bae3b700 1 -- 172.21.15.5:0/3193951668 wait complete. 2023-10-16T13:49:27.352 INFO:tasks.cephfs_test_runner:That the existing and the newly created volumes can be listed and ... ok 2023-10-16T13:49:27.353 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) That volume, its file system and pools, can be renamed. 2023-10-16T13:49:27.353 INFO:tasks.cephfs_test_runner:test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:49:27.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:27.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.476+0000 7f4659860700 1 Processor -- start 2023-10-16T13:49:27.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.476+0000 7f4659860700 1 -- start start 2023-10-16T13:49:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f4659860700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4654160e30 0x7f46540d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f4659860700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4654161210 0x7f46540d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f4659860700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540b6610 con 0x7f46540d06d0 2023-10-16T13:49:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f4659860700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540d0b40 con 0x7f4654161210 2023-10-16T13:49:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f4659860700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540d1da0 con 0x7f4654160e30 2023-10-16T13:49:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f46527fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4654161210 0x7f46540d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f46527fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4654161210 0x7f46540d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50304/0 (socket says 172.21.15.5:50304) 2023-10-16T13:49:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f46527fc700 1 -- 172.21.15.5:0/230974947 learned_addr learned my addr 172.21.15.5:0/230974947 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.477+0000 7f4652ffd700 1 --2- 172.21.15.5:0/230974947 >> v2:172.21.15.112:3300/0 conn(0x7f4654160e30 0x7f46540d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f46527fc700 1 -- 172.21.15.5:0/230974947 >> v2:172.21.15.112:3300/0 conn(0x7f4654160e30 msgr2=0x7f46540d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f46527fc700 1 --2- 172.21.15.5:0/230974947 >> v2:172.21.15.112:3300/0 conn(0x7f4654160e30 0x7f46540d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f46527fc700 1 -- 172.21.15.5:0/230974947 >> v1:172.21.15.112:6789/0 conn(0x7f46540d06d0 legacy=0x7f46540b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f46527fc700 1 -- 172.21.15.5:0/230974947 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540d2080 con 0x7f4654161210 2023-10-16T13:49:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f46527fc700 1 --2- 172.21.15.5:0/230974947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654161210 0x7f46540d0190 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f465408c920 tx=0x7f4644009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99f8e436def0951 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f4651ffb700 1 -- 172.21.15.5:0/230974947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644011830 con 0x7f4654161210 2023-10-16T13:49:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f4651ffb700 1 -- 172.21.15.5:0/230974947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644011990 con 0x7f4654161210 2023-10-16T13:49:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f4651ffb700 1 -- 172.21.15.5:0/230974947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644011d20 con 0x7f4654161210 2023-10-16T13:49:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f4659860700 1 -- 172.21.15.5:0/230974947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654161210 msgr2=0x7f46540d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.478+0000 7f4659860700 1 --2- 172.21.15.5:0/230974947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654161210 0x7f46540d0190 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f465408c920 tx=0x7f4644009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.479+0000 7f4659860700 1 -- 172.21.15.5:0/230974947 shutdown_connections 2023-10-16T13:49:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.479+0000 7f4659860700 1 --2- 172.21.15.5:0/230974947 >> v2:172.21.15.112:3300/0 conn(0x7f4654160e30 0x7f46540d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.479+0000 7f4659860700 1 --2- 172.21.15.5:0/230974947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654161210 0x7f46540d0190 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.479+0000 7f4659860700 1 -- 172.21.15.5:0/230974947 >> 172.21.15.5:0/230974947 conn(0x7f465409cb40 msgr2=0x7f46540d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.479+0000 7f4659860700 1 -- 172.21.15.5:0/230974947 shutdown_connections 2023-10-16T13:49:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.479+0000 7f4659860700 1 -- 172.21.15.5:0/230974947 wait complete. 2023-10-16T13:49:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.480+0000 7f4659860700 1 Processor -- start 2023-10-16T13:49:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.480+0000 7f4659860700 1 -- start start 2023-10-16T13:49:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f4659860700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46540d06d0 0x7f46541f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f4659860700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 0x7f4654156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f4659860700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4654161210 0x7f46540cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f4659860700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46540cd410 con 0x7f4654160e30 2023-10-16T13:49:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f4659860700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f3360 con 0x7f46540d06d0 2023-10-16T13:49:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f4659860700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654159430 con 0x7f4654161210 2023-10-16T13:49:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f46527fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 0x7f4654156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f46527fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 0x7f4654156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50312/0 (socket says 172.21.15.5:50312) 2023-10-16T13:49:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.481+0000 7f46527fc700 1 -- 172.21.15.5:0/771113560 learned_addr learned my addr 172.21.15.5:0/771113560 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f4652ffd700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46540d06d0 0x7f46541f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46537fe700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4654161210 0x7f46540cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46527fc700 1 -- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4654161210 msgr2=0x7f46540cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46527fc700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4654161210 0x7f46540cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46527fc700 1 -- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46540d06d0 msgr2=0x7f46541f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46527fc700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46540d06d0 0x7f46541f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46527fc700 1 -- 172.21.15.5:0/771113560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009550 con 0x7f4654160e30 2023-10-16T13:49:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46537fe700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4654161210 0x7f46540cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f46527fc700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 0x7f4654156cd0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4644009c10 tx=0x7f4644004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644004590 con 0x7f4654160e30 2023-10-16T13:49:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464401e070 con 0x7f4654160e30 2023-10-16T13:49:27.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440038e0 con 0x7f4654160e30 2023-10-16T13:49:27.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46541596d0 con 0x7f4654160e30 2023-10-16T13:49:27.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.482+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654159c90 con 0x7f4654160e30 2023-10-16T13:49:27.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.483+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4654067d20 con 0x7f4654160e30 2023-10-16T13:49:27.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.484+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f4644003a40 con 0x7f4654160e30 2023-10-16T13:49:27.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.484+0000 7f463bfff700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f464006b2f0 0x7f464006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.484+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f464408a7c0 con 0x7f4654160e30 2023-10-16T13:49:27.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.484+0000 7f4652ffd700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f464006b2f0 0x7f464006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.485+0000 7f4652ffd700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f464006b2f0 0x7f464006d7b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4648009bc0 tx=0x7f46480091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:27.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.489+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4644055680 con 0x7f4654160e30 2023-10-16T13:49:27.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.690+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f465408d840 con 0x7f4654160e30 2023-10-16T13:49:27.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.691+0000 7f463bfff700 1 -- 172.21.15.5:0/771113560 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+13184 (secure 0 0 0) 0x7f4644058ca0 con 0x7f4654160e30 2023-10-16T13:49:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:27.695 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":127,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:26.321689+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/618714180":"2023-10-17T13:49:23.314058+0000","172.21.15.112:6837/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6835/2690348630":"2023-10-17T13:49:12.077139+0000","172.21.15.112:6836/3556823542":"2023-10-17T13:49:08.644012+0000","172.21.15.5:6835/618714180":"2023-10-17T13:49:23.314058+0000","172.21.15.112:6834/3556823542":"2023-10-17T13:49:08.644012+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f464006b2f0 msgr2=0x7f464006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f464006b2f0 0x7f464006d7b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4648009bc0 tx=0x7f46480091c0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 msgr2=0x7f4654156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 0x7f4654156cd0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4644009c10 tx=0x7f4644004750 comp rx=0 tx=0).stop 2023-10-16T13:49:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 shutdown_connections 2023-10-16T13:49:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f464006b2f0 0x7f464006d7b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4654161210 0x7f46540cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46540d06d0 0x7f46541f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 --2- 172.21.15.5:0/771113560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4654160e30 0x7f4654156cd0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 >> 172.21.15.5:0/771113560 conn(0x7f465409cb40 msgr2=0x7f46540b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:27.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.693+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 shutdown_connections 2023-10-16T13:49:27.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.694+0000 7f4659860700 1 -- 172.21.15.5:0/771113560 wait complete. 2023-10-16T13:49:27.709 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:27.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 Processor -- start 2023-10-16T13:49:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 -- start start 2023-10-16T13:49:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabdc15f130 0x7fabdc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc0b3530 con 0x7fabdc0b28b0 2023-10-16T13:49:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0cde00 con 0x7fabdc15f130 2023-10-16T13:49:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.835+0000 7fabe15cb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0cd180 con 0x7fabdc06af50 2023-10-16T13:49:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabdc15f130 0x7fabdc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabdc15f130 0x7fabdc0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50318/0 (socket says 172.21.15.5:50318) 2023-10-16T13:49:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 -- 172.21.15.5:0/1579288539 learned_addr learned my addr 172.21.15.5:0/1579288539 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdb7fe700 1 --2- 172.21.15.5:0/1579288539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 -- 172.21.15.5:0/1579288539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 msgr2=0x7fabdc0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 --2- 172.21.15.5:0/1579288539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 -- 172.21.15.5:0/1579288539 >> v1:172.21.15.112:6789/0 conn(0x7fabdc0b28b0 legacy=0x7fabdc06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 -- 172.21.15.5:0/1579288539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0cd460 con 0x7fabdc15f130 2023-10-16T13:49:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabdaffd700 1 --2- 172.21.15.5:0/1579288539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc0cede0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0098f0 tx=0x7fabcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8dc64d0d7787db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabd9ffb700 1 -- 172.21.15.5:0/1579288539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00b8a0 con 0x7fabdc15f130 2023-10-16T13:49:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabd9ffb700 1 -- 172.21.15.5:0/1579288539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00ba00 con 0x7fabdc15f130 2023-10-16T13:49:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.836+0000 7fabd9ffb700 1 -- 172.21.15.5:0/1579288539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00bd90 con 0x7fabdc15f130 2023-10-16T13:49:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 -- 172.21.15.5:0/1579288539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 msgr2=0x7fabdc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1579288539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc0cede0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0098f0 tx=0x7fabcc009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 -- 172.21.15.5:0/1579288539 shutdown_connections 2023-10-16T13:49:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1579288539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1579288539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc0cede0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 -- 172.21.15.5:0/1579288539 >> 172.21.15.5:0/1579288539 conn(0x7fabdc06dae0 msgr2=0x7fabdc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 -- 172.21.15.5:0/1579288539 shutdown_connections 2023-10-16T13:49:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.837+0000 7fabe15cb700 1 -- 172.21.15.5:0/1579288539 wait complete. 2023-10-16T13:49:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.838+0000 7fabe15cb700 1 Processor -- start 2023-10-16T13:49:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.838+0000 7fabe15cb700 1 -- start start 2023-10-16T13:49:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabe15cb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabe15cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabdc0b28b0 0x7fabdc146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabe15cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabe15cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc156fa0 con 0x7fabdc15f130 2023-10-16T13:49:27.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabe15cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc156340 con 0x7fabdc0b28b0 2023-10-16T13:49:27.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabe15cb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0ca390 con 0x7fabdc06af50 2023-10-16T13:49:27.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50328/0 (socket says 172.21.15.5:50328) 2023-10-16T13:49:27.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 -- 172.21.15.5:0/1656877682 learned_addr learned my addr 172.21.15.5:0/1656877682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:27.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabda7fc700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabdc0b28b0 0x7fabdc146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdaffd700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 -- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 msgr2=0x7fabdc0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 -- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabdc0b28b0 msgr2=0x7fabdc146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabdc0b28b0 0x7fabdc146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 -- 172.21.15.5:0/1656877682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc009550 con 0x7fabdc15f130 2023-10-16T13:49:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabda7fc700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabdc0b28b0 0x7fabdc146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.839+0000 7fabdb7fe700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc147320 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fabd4007e60 tx=0x7fabd400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.840+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400ede0 con 0x7fabdc15f130 2023-10-16T13:49:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.840+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4014420 con 0x7fabdc15f130 2023-10-16T13:49:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.840+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc156600 con 0x7fabdc15f130 2023-10-16T13:49:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.840+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40147d0 con 0x7fabdc15f130 2023-10-16T13:49:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.840+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc156bc0 con 0x7fabdc15f130 2023-10-16T13:49:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.841+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc1570e0 con 0x7fabdc15f130 2023-10-16T13:49:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.841+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fabd4014930 con 0x7fabdc15f130 2023-10-16T13:49:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.841+0000 7fabc37fe700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabc806b2f0 0x7fabc806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.842+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fabd408a250 con 0x7fabdc15f130 2023-10-16T13:49:27.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.842+0000 7fabdaffd700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabc806b2f0 0x7fabc806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:27.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.842+0000 7fabdaffd700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabc806b2f0 0x7fabc806d7b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009c40 tx=0x7fabcc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:27.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:27.846+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabdc1570e0 con 0x7fabdc15f130 2023-10-16T13:49:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.047+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabdc1570e0 con 0x7fabdc15f130 2023-10-16T13:49:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.047+0000 7fabc37fe700 1 -- 172.21.15.5:0/1656877682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v127) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabdc1570e0 con 0x7fabdc15f130 2023-10-16T13:49:28.050 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabc806b2f0 msgr2=0x7fabc806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabc806b2f0 0x7fabc806d7b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009c40 tx=0x7fabcc008030 comp rx=0 tx=0).stop 2023-10-16T13:49:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 msgr2=0x7fabdc147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc147320 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fabd4007e60 tx=0x7fabd400e3c0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 shutdown_connections 2023-10-16T13:49:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc15f130 0x7fabdc147320 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fabc806b2f0 0x7fabc806d7b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fabdc06af50 0x7fabdc0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 --2- 172.21.15.5:0/1656877682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabdc0b28b0 0x7fabdc146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 >> 172.21.15.5:0/1656877682 conn(0x7fabdc06dae0 msgr2=0x7fabdc0b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 shutdown_connections 2023-10-16T13:49:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.049+0000 7fabe15cb700 1 -- 172.21.15.5:0/1656877682 wait complete. 2023-10-16T13:49:28.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-16T13:49:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.187+0000 7f5ce594b700 1 Processor -- start 2023-10-16T13:49:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.187+0000 7f5ce594b700 1 -- start start 2023-10-16T13:49:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5ce594b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ce015dbc0 0x7f5ce015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5ce594b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ce00b7050 0x7f5ce00d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:28.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5ce594b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce015e4e0 con 0x7f5ce00d3fc0 2023-10-16T13:49:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5ce594b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00b7560 con 0x7f5ce00b7050 2023-10-16T13:49:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5ce594b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00b7840 con 0x7f5ce015dbc0 2023-10-16T13:49:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5cdf7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ce00b7050 0x7f5ce00d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5cde7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ce00d3fc0 0x7f5ce00d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60336/0 (socket says 172.21.15.5:60336) 2023-10-16T13:49:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5cde7fc700 1 -- 172.21.15.5:0/2976268786 learned_addr learned my addr 172.21.15.5:0/2976268786 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5cdeffd700 1 --2- 172.21.15.5:0/2976268786 >> v2:172.21.15.112:3300/0 conn(0x7f5ce015dbc0 0x7f5ce015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5cdf7fe700 1 -- 172.21.15.5:0/2976268786 >> v2:172.21.15.112:3300/0 conn(0x7f5ce015dbc0 msgr2=0x7f5ce015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.188+0000 7f5cdf7fe700 1 --2- 172.21.15.5:0/2976268786 >> v2:172.21.15.112:3300/0 conn(0x7f5ce015dbc0 0x7f5ce015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cdf7fe700 1 -- 172.21.15.5:0/2976268786 >> v1:172.21.15.5:6789/0 conn(0x7f5ce00d3fc0 legacy=0x7f5ce00d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cdf7fe700 1 -- 172.21.15.5:0/2976268786 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00b7b20 con 0x7f5ce00b7050 2023-10-16T13:49:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cddffb700 1 -- 172.21.15.5:0/2976268786 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454016427 0 0) 0x7f5ce015e4e0 con 0x7f5ce00d3fc0 2023-10-16T13:49:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cdf7fe700 1 --2- 172.21.15.5:0/2976268786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce00d21d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0072db0 tx=0x7f5cd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150b274b4a555590 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cddffb700 1 -- 172.21.15.5:0/2976268786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800e070 con 0x7f5ce00b7050 2023-10-16T13:49:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cddffb700 1 -- 172.21.15.5:0/2976268786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800bbd0 con 0x7f5ce00b7050 2023-10-16T13:49:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5cddffb700 1 -- 172.21.15.5:0/2976268786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8012430 con 0x7f5ce00b7050 2023-10-16T13:49:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 -- 172.21.15.5:0/2976268786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 msgr2=0x7f5ce00d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 --2- 172.21.15.5:0/2976268786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce00d21d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0072db0 tx=0x7f5cd800b330 comp rx=0 tx=0).stop 2023-10-16T13:49:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 -- 172.21.15.5:0/2976268786 shutdown_connections 2023-10-16T13:49:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 --2- 172.21.15.5:0/2976268786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce00d21d0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 --2- 172.21.15.5:0/2976268786 >> v2:172.21.15.112:3300/0 conn(0x7f5ce015dbc0 0x7f5ce015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 -- 172.21.15.5:0/2976268786 >> 172.21.15.5:0/2976268786 conn(0x7f5ce009cb40 msgr2=0x7f5ce00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.189+0000 7f5ce594b700 1 -- 172.21.15.5:0/2976268786 shutdown_connections 2023-10-16T13:49:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.190+0000 7f5ce594b700 1 -- 172.21.15.5:0/2976268786 wait complete. 2023-10-16T13:49:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.191+0000 7f5ce594b700 1 Processor -- start 2023-10-16T13:49:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.191+0000 7f5ce594b700 1 -- start start 2023-10-16T13:49:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce01584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce00d3fc0 0x7f5ce0156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce015dbc0 0x7f5ce01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0155eb0 con 0x7f5ce00b7050 2023-10-16T13:49:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0159eb0 con 0x7f5ce015dbc0 2023-10-16T13:49:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00cb330 con 0x7f5ce00d3fc0 2023-10-16T13:49:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce01584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce01584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50336/0 (socket says 172.21.15.5:50336) 2023-10-16T13:49:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 -- 172.21.15.5:0/1493173611 learned_addr learned my addr 172.21.15.5:0/1493173611 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdf7fe700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce015dbc0 0x7f5ce01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cde7fc700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce00d3fc0 0x7f5ce0156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 -- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce00d3fc0 msgr2=0x7f5ce0156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce00d3fc0 0x7f5ce0156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 -- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce015dbc0 msgr2=0x7f5ce01554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce015dbc0 0x7f5ce01554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 -- 172.21.15.5:0/1493173611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009a70 con 0x7f5ce00b7050 2023-10-16T13:49:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdf7fe700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce015dbc0 0x7f5ce01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cdeffd700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce01584f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000d7d0 tx=0x7f5cd000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00125f0 con 0x7f5ce00b7050 2023-10-16T13:49:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0012750 con 0x7f5ce00b7050 2023-10-16T13:49:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00caa00 con 0x7f5ce00b7050 2023-10-16T13:49:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0012b00 con 0x7f5ce00b7050 2023-10-16T13:49:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.192+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce00cafc0 con 0x7f5ce00b7050 2023-10-16T13:49:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.193+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce01e4f80 con 0x7f5ce00b7050 2023-10-16T13:49:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.194+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5cd0012c60 con 0x7f5ce00b7050 2023-10-16T13:49:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.194+0000 7f5cd7fff700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cc006b2f0 0x7f5cc006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.194+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5cd0089bb0 con 0x7f5ce00b7050 2023-10-16T13:49:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.194+0000 7f5cde7fc700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cc006b2f0 0x7f5cc006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.195+0000 7f5cde7fc700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cc006b2f0 0x7f5cc006d7b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00a1680 tx=0x7f5cc8007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.199+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cd00548d0 con 0x7f5ce00b7050 2023-10-16T13:49:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:28.486+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f5ce004ebb0 con 0x7f5ce00b7050 2023-10-16T13:49:29.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:49:29.179 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:49:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.335+0000 7f5cd7fff700 1 -- 172.21.15.5:0/1493173611 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v494) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5cd0057ef0 con 0x7f5ce00b7050 2023-10-16T13:49:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cc006b2f0 msgr2=0x7f5cc006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cc006b2f0 0x7f5cc006d7b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00a1680 tx=0x7f5cc8007be0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 msgr2=0x7f5ce01584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce01584f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000d7d0 tx=0x7f5cd000db90 comp rx=0 tx=0).stop 2023-10-16T13:49:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 shutdown_connections 2023-10-16T13:49:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ce015dbc0 0x7f5ce01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce00b7050 0x7f5ce01584f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5cc006b2f0 0x7f5cc006d7b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 --2- 172.21.15.5:0/1493173611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ce00d3fc0 0x7f5ce0156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 >> 172.21.15.5:0/1493173611 conn(0x7f5ce009cb40 msgr2=0x7f5ce00ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 shutdown_connections 2023-10-16T13:49:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.338+0000 7f5ce594b700 1 -- 172.21.15.5:0/1493173611 wait complete. 2023-10-16T13:49:29.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:49:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.488+0000 7f084bb92700 1 Processor -- start 2023-10-16T13:49:29.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.488+0000 7f084bb92700 1 -- start start 2023-10-16T13:49:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084bb92700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f084415b740 0x7f08440d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084bb92700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08440d0c70 0x7f08440cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084bb92700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440cf190 con 0x7f08440c5110 2023-10-16T13:49:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084bb92700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084415bb20 con 0x7f08440d0c70 2023-10-16T13:49:29.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084bb92700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440cbd40 con 0x7f084415b740 2023-10-16T13:49:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084912d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08440d0c70 0x7f08440cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084a12f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08440c5110 0x7f08440cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60350/0 (socket says 172.21.15.5:60350) 2023-10-16T13:49:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084a12f700 1 -- 172.21.15.5:0/2792714646 learned_addr learned my addr 172.21.15.5:0/2792714646 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084992e700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f084415b740 0x7f08440d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084912d700 1 -- 172.21.15.5:0/2792714646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f084415b740 msgr2=0x7f08440d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084912d700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f084415b740 0x7f08440d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084912d700 1 -- 172.21.15.5:0/2792714646 >> v1:172.21.15.5:6789/0 conn(0x7f08440c5110 legacy=0x7f08440cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084912d700 1 -- 172.21.15.5:0/2792714646 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440cc020 con 0x7f08440d0c70 2023-10-16T13:49:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084892c700 1 -- 172.21.15.5:0/2792714646 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843612285 0 0) 0x7f08440cf190 con 0x7f08440c5110 2023-10-16T13:49:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.489+0000 7f084992e700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f084415b740 0x7f08440d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084912d700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08440d0c70 0x7f08440cdfd0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f0840009840 tx=0x7f0840009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a4596e5b45bd4b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084892c700 1 -- 172.21.15.5:0/2792714646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840011830 con 0x7f08440d0c70 2023-10-16T13:49:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084892c700 1 -- 172.21.15.5:0/2792714646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840011990 con 0x7f08440d0c70 2023-10-16T13:49:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084892c700 1 -- 172.21.15.5:0/2792714646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840011d20 con 0x7f08440d0c70 2023-10-16T13:49:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 -- 172.21.15.5:0/2792714646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08440d0c70 msgr2=0x7f08440cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08440d0c70 0x7f08440cdfd0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f0840009840 tx=0x7f0840009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 -- 172.21.15.5:0/2792714646 shutdown_connections 2023-10-16T13:49:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f084415b740 0x7f08440d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 --2- 172.21.15.5:0/2792714646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08440d0c70 0x7f08440cdfd0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 -- 172.21.15.5:0/2792714646 >> 172.21.15.5:0/2792714646 conn(0x7f08440665a0 msgr2=0x7f0844066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 -- 172.21.15.5:0/2792714646 shutdown_connections 2023-10-16T13:49:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.490+0000 7f084bb92700 1 -- 172.21.15.5:0/2792714646 wait complete. 2023-10-16T13:49:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 Processor -- start 2023-10-16T13:49:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 -- start start 2023-10-16T13:49:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08440c5110 0x7f0844158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08440d0c70 0x7f08440b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 0x7f08440b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084415d790 con 0x7f084415b740 2023-10-16T13:49:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084415cb80 con 0x7f08440c5110 2023-10-16T13:49:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084bb92700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084415ce60 con 0x7f08440d0c70 2023-10-16T13:49:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.492+0000 7f084a12f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 0x7f08440b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 0x7f08440b6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50352/0 (socket says 172.21.15.5:50352) 2023-10-16T13:49:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 -- 172.21.15.5:0/812623963 learned_addr learned my addr 172.21.15.5:0/812623963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084992e700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08440c5110 0x7f0844158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084912d700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08440d0c70 0x7f08440b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 -- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08440d0c70 msgr2=0x7f08440b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08440d0c70 0x7f08440b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 -- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08440c5110 msgr2=0x7f0844158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08440c5110 0x7f0844158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 -- 172.21.15.5:0/812623963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400094a0 con 0x7f084415b740 2023-10-16T13:49:29.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084a12f700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 0x7f08440b6500 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f083c00cc70 tx=0x7f083c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:29.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00aaa0 con 0x7f084415b740 2023-10-16T13:49:29.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00ac20 con 0x7f084415b740 2023-10-16T13:49:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0070d0 con 0x7f084415b740 2023-10-16T13:49:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084415d140 con 0x7f084415b740 2023-10-16T13:49:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.493+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08441590f0 con 0x7f084415b740 2023-10-16T13:49:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.494+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084415d900 con 0x7f084415b740 2023-10-16T13:49:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.495+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f083c007230 con 0x7f084415b740 2023-10-16T13:49:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.495+0000 7f083a7fc700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f082806b2f0 0x7f082806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.495+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f083c0894c0 con 0x7f084415b740 2023-10-16T13:49:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.495+0000 7f084992e700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f082806b2f0 0x7f082806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.496+0000 7f084992e700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f082806b2f0 0x7f082806d7b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f083400c940 tx=0x7f0834008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.500+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f083c0542f0 con 0x7f084415b740 2023-10-16T13:49:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.703+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0844067d20 con 0x7f084415b740 2023-10-16T13:49:29.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.707+0000 7f083a7fc700 1 -- 172.21.15.5:0/812623963 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f083c0180c0 con 0x7f084415b740 2023-10-16T13:49:29.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f082806b2f0 msgr2=0x7f082806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f082806b2f0 0x7f082806d7b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f083400c940 tx=0x7f0834008040 comp rx=0 tx=0).stop 2023-10-16T13:49:29.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 msgr2=0x7f08440b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:29.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 0x7f08440b6500 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f083c00cc70 tx=0x7f083c00cf80 comp rx=0 tx=0).stop 2023-10-16T13:49:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 shutdown_connections 2023-10-16T13:49:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f084415b740 0x7f08440b6500 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08440c5110 0x7f0844158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f082806b2f0 0x7f082806d7b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 --2- 172.21.15.5:0/812623963 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08440d0c70 0x7f08440b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 >> 172.21.15.5:0/812623963 conn(0x7f08440665a0 msgr2=0x7f084415a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 shutdown_connections 2023-10-16T13:49:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:29.709+0000 7f084bb92700 1 -- 172.21.15.5:0/812623963 wait complete. 2023-10-16T13:49:29.724 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:49:29.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:49:29.763 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:49:29.811 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:49:29.812 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:29.812 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:29.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:29.830 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:29.830 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:29.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:29.851 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:29.851 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:29.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:29.887 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:29.887 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:29.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:29.909 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T13:49:29.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:30.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.048+0000 7fedb92eb700 1 Processor -- start 2023-10-16T13:49:30.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.048+0000 7fedb92eb700 1 -- start start 2023-10-16T13:49:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb92eb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedb415e2f0 0x7fedb40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb92eb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fedb406a840 0x7fedb406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb92eb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb406b1a0 con 0x7fedb40cd950 2023-10-16T13:49:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb92eb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb41619a0 con 0x7fedb415e2f0 2023-10-16T13:49:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb92eb700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40b2d60 con 0x7fedb406a840 2023-10-16T13:49:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb27fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedb415e2f0 0x7fedb40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.049+0000 7fedb2ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fedb40cd950 0x7fedb415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60360/0 (socket says 172.21.15.5:60360) 2023-10-16T13:49:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb27fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedb415e2f0 0x7fedb40cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50358/0 (socket says 172.21.15.5:50358) 2023-10-16T13:49:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb2ffd700 1 -- 172.21.15.5:0/2906694188 learned_addr learned my addr 172.21.15.5:0/2906694188 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb37fe700 1 --2- 172.21.15.5:0/2906694188 >> v2:172.21.15.112:3300/0 conn(0x7fedb406a840 0x7fedb406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb27fc700 1 -- 172.21.15.5:0/2906694188 >> v2:172.21.15.112:3300/0 conn(0x7fedb406a840 msgr2=0x7fedb406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb27fc700 1 --2- 172.21.15.5:0/2906694188 >> v2:172.21.15.112:3300/0 conn(0x7fedb406a840 0x7fedb406ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb27fc700 1 -- 172.21.15.5:0/2906694188 >> v1:172.21.15.5:6789/0 conn(0x7fedb40cd950 legacy=0x7fedb415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb27fc700 1 -- 172.21.15.5:0/2906694188 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40cdd30 con 0x7fedb415e2f0 2023-10-16T13:49:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb1ffb700 1 -- 172.21.15.5:0/2906694188 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170360604 0 0) 0x7fedb406b1a0 con 0x7fedb40cd950 2023-10-16T13:49:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb37fe700 1 --2- 172.21.15.5:0/2906694188 >> v2:172.21.15.112:3300/0 conn(0x7fedb406a840 0x7fedb406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb27fc700 1 --2- 172.21.15.5:0/2906694188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb415e2f0 0x7fedb40cede0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fedb40afed0 tx=0x7feda4009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4063c112a8a38f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb1ffb700 1 -- 172.21.15.5:0/2906694188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4005e30 con 0x7fedb415e2f0 2023-10-16T13:49:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb1ffb700 1 -- 172.21.15.5:0/2906694188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda4006030 con 0x7fedb415e2f0 2023-10-16T13:49:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.050+0000 7fedb1ffb700 1 -- 172.21.15.5:0/2906694188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40063c0 con 0x7fedb415e2f0 2023-10-16T13:49:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 -- 172.21.15.5:0/2906694188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb415e2f0 msgr2=0x7fedb40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 --2- 172.21.15.5:0/2906694188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb415e2f0 0x7fedb40cede0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fedb40afed0 tx=0x7feda4009b00 comp rx=0 tx=0).stop 2023-10-16T13:49:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 -- 172.21.15.5:0/2906694188 shutdown_connections 2023-10-16T13:49:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 --2- 172.21.15.5:0/2906694188 >> v2:172.21.15.112:3300/0 conn(0x7fedb406a840 0x7fedb406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 --2- 172.21.15.5:0/2906694188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb415e2f0 0x7fedb40cede0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 -- 172.21.15.5:0/2906694188 >> 172.21.15.5:0/2906694188 conn(0x7fedb406dae0 msgr2=0x7fedb406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 -- 172.21.15.5:0/2906694188 shutdown_connections 2023-10-16T13:49:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.051+0000 7fedb92eb700 1 -- 172.21.15.5:0/2906694188 wait complete. 2023-10-16T13:49:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.052+0000 7fedb92eb700 1 Processor -- start 2023-10-16T13:49:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.052+0000 7fedb92eb700 1 -- start start 2023-10-16T13:49:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb92eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 0x7fedb406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb92eb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedb40cd950 0x7fedb40c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb92eb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedb415e2f0 0x7fedb40b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb92eb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40c8a90 con 0x7fedb406a840 2023-10-16T13:49:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb92eb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40c8d70 con 0x7fedb415e2f0 2023-10-16T13:49:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb92eb700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40c9400 con 0x7fedb40cd950 2023-10-16T13:49:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 0x7fedb406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 0x7fedb406e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50362/0 (socket says 172.21.15.5:50362) 2023-10-16T13:49:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 -- 172.21.15.5:0/4175710503 learned_addr learned my addr 172.21.15.5:0/4175710503 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb37fe700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedb415e2f0 0x7fedb40b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb27fc700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedb40cd950 0x7fedb40c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 -- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedb40cd950 msgr2=0x7fedb40c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedb40cd950 0x7fedb40c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 -- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedb415e2f0 msgr2=0x7fedb40b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedb415e2f0 0x7fedb40b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 -- 172.21.15.5:0/4175710503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4009430 con 0x7fedb406a840 2023-10-16T13:49:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb27fc700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedb40cd950 0x7fedb40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.053+0000 7fedb2ffd700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 0x7fedb406e130 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7feda80011e0 tx=0x7feda800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:30.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.054+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8004c80 con 0x7fedb406a840 2023-10-16T13:49:30.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.054+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8004de0 con 0x7fedb406a840 2023-10-16T13:49:30.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.054+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb40c96e0 con 0x7fedb406a840 2023-10-16T13:49:30.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.054+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8007310 con 0x7fedb406a840 2023-10-16T13:49:30.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.054+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb406e850 con 0x7fedb406a840 2023-10-16T13:49:30.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.055+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb4067d20 con 0x7fedb406a840 2023-10-16T13:49:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.055+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7feda8007470 con 0x7fedb406a840 2023-10-16T13:49:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.055+0000 7fed9b7fe700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feda006b2f0 0x7feda006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.056+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7feda8089450 con 0x7fedb406a840 2023-10-16T13:49:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.056+0000 7fedb27fc700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feda006b2f0 0x7feda006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.056+0000 7fedb27fc700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feda006b2f0 0x7feda006d7b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7feda4000c00 tx=0x7feda4008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.061+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feda8054330 con 0x7fedb406a840 2023-10-16T13:49:30.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.306+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedb406e850 con 0x7fedb406a840 2023-10-16T13:49:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.307+0000 7fed9b7fe700 1 -- 172.21.15.5:0/4175710503 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fedb406e850 con 0x7fedb406a840 2023-10-16T13:49:30.310 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6428,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2448584641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2448584641},{"type":"v1","addr":"172.21.15.5:6834","nonce":2448584641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7363,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/4208236815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4208236815},{"type":"v1","addr":"172.21.15.112:6836","nonce":4208236815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3176905904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3176905904},{"type":"v1","addr":"172.21.15.112:6837","nonce":3176905904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3294797003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3294797003},{"type":"v1","addr":"172.21.15.5:6835","nonce":3294797003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[]} 2023-10-16T13:49:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feda006b2f0 msgr2=0x7feda006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feda006b2f0 0x7feda006d7b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7feda4000c00 tx=0x7feda4008070 comp rx=0 tx=0).stop 2023-10-16T13:49:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 msgr2=0x7fedb406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 0x7fedb406e130 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7feda80011e0 tx=0x7feda800ca30 comp rx=0 tx=0).stop 2023-10-16T13:49:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 shutdown_connections 2023-10-16T13:49:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedb415e2f0 0x7fedb40b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedb406a840 0x7fedb406e130 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7feda006b2f0 0x7feda006d7b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 --2- 172.21.15.5:0/4175710503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedb40cd950 0x7fedb40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 >> 172.21.15.5:0/4175710503 conn(0x7fedb406dae0 msgr2=0x7fedb415d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:30.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 shutdown_connections 2023-10-16T13:49:30.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.309+0000 7fedb92eb700 1 -- 172.21.15.5:0/4175710503 wait complete. 2023-10-16T13:49:30.314 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 91 2023-10-16T13:49:30.324 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T13:49:30.324 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T13:49:30.324 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:49:30.325 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:49:30.325 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T13:49:30.325 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T13:49:30.325 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:49:30.326 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:49:30.326 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T13:49:30.326 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T13:49:30.327 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:49:30.327 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:49:30.327 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T13:49:30.327 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T13:49:30.328 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:49:30.328 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:49:30.333 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:49:30.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T13:49:30.335 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:49:30.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T13:49:30.338 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:49:30.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T13:49:30.339 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:49:30.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T13:49:30.376 INFO:tasks.ceph.mds.a:Started 2023-10-16T13:49:30.376 DEBUG:teuthology.parallel:result is None 2023-10-16T13:49:30.377 INFO:tasks.ceph.mds.c:Started 2023-10-16T13:49:30.377 DEBUG:teuthology.parallel:result is None 2023-10-16T13:49:30.381 INFO:tasks.ceph.mds.b:Started 2023-10-16T13:49:30.381 DEBUG:teuthology.parallel:result is None 2023-10-16T13:49:30.382 INFO:tasks.ceph.mds.d:Started 2023-10-16T13:49:30.382 DEBUG:teuthology.parallel:result is None 2023-10-16T13:49:30.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T13:49:30.457 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-10-16T13:49:30.458 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-10-16T13:49:30.466 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2023-10-16T13:49:30.467 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:49:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.512+0000 7ff35cc62700 1 Processor -- start 2023-10-16T13:49:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.512+0000 7ff35cc62700 1 -- start start 2023-10-16T13:49:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff35cc62700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3580cd0a0 0x7ff3580b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff35cc62700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3580d0310 con 0x7ff35815e0c0 2023-10-16T13:49:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff35cc62700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35806cb70 con 0x7ff35815dce0 2023-10-16T13:49:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff35cc62700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580cbc40 con 0x7ff3580cd0a0 2023-10-16T13:49:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff356d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3580cd0a0 0x7ff3580b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff355d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff35815e0c0 0x7ff3580cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60398/0 (socket says 172.21.15.5:60398) 2023-10-16T13:49:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff356d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3580cd0a0 0x7ff3580b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50398/0 (socket says 172.21.15.5:50398) 2023-10-16T13:49:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff355d9b700 1 -- 172.21.15.5:0/1415584493 learned_addr learned my addr 172.21.15.5:0/1415584493 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff356d9d700 1 -- 172.21.15.5:0/1415584493 >> v1:172.21.15.112:6789/0 conn(0x7ff35815dce0 legacy=0x7ff3580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff356d9d700 1 -- 172.21.15.5:0/1415584493 >> v1:172.21.15.5:6789/0 conn(0x7ff35815e0c0 legacy=0x7ff3580cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff35559a700 1 -- 172.21.15.5:0/1415584493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161390885 0 0) 0x7ff3580d0310 con 0x7ff35815e0c0 2023-10-16T13:49:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.513+0000 7ff356d9d700 1 -- 172.21.15.5:0/1415584493 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35806ce50 con 0x7ff3580cd0a0 2023-10-16T13:49:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff356d9d700 1 --2- 172.21.15.5:0/1415584493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff3580b03c0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff350009d90 tx=0x7ff35000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0be8de419b478fc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35559a700 1 -- 172.21.15.5:0/1415584493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000e070 con 0x7ff3580cd0a0 2023-10-16T13:49:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35559a700 1 -- 172.21.15.5:0/1415584493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000bb90 con 0x7ff3580cd0a0 2023-10-16T13:49:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35559a700 1 -- 172.21.15.5:0/1415584493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350003a20 con 0x7ff3580cd0a0 2023-10-16T13:49:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 -- 172.21.15.5:0/1415584493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 msgr2=0x7ff3580b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 --2- 172.21.15.5:0/1415584493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff3580b03c0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff350009d90 tx=0x7ff35000b330 comp rx=0 tx=0).stop 2023-10-16T13:49:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 -- 172.21.15.5:0/1415584493 shutdown_connections 2023-10-16T13:49:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 --2- 172.21.15.5:0/1415584493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff3580b03c0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 -- 172.21.15.5:0/1415584493 >> 172.21.15.5:0/1415584493 conn(0x7ff3580d15f0 msgr2=0x7ff3580d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 -- 172.21.15.5:0/1415584493 shutdown_connections 2023-10-16T13:49:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.514+0000 7ff35cc62700 1 -- 172.21.15.5:0/1415584493 wait complete. 2023-10-16T13:49:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 Processor -- start 2023-10-16T13:49:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 -- start start 2023-10-16T13:49:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff358158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff35815dce0 0x7ff3580cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35815e0c0 0x7ff3580ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35806f7f0 con 0x7ff3580cd0a0 2023-10-16T13:49:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580c6cc0 con 0x7ff35815e0c0 2023-10-16T13:49:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.516+0000 7ff35cc62700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580c6fa0 con 0x7ff35815dce0 2023-10-16T13:49:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff358158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff358158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50400/0 (socket says 172.21.15.5:50400) 2023-10-16T13:49:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 -- 172.21.15.5:0/321115698 learned_addr learned my addr 172.21.15.5:0/321115698 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff356d9d700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35815e0c0 0x7ff3580ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff355d9b700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff35815dce0 0x7ff3580cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 -- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff35815dce0 msgr2=0x7ff3580cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff35815dce0 0x7ff3580cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 -- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35815e0c0 msgr2=0x7ff3580ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:30.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35815e0c0 0x7ff3580ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 -- 172.21.15.5:0/321115698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350009a70 con 0x7ff3580cd0a0 2023-10-16T13:49:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35659c700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff358158f20 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c4d0 tx=0x7ff34c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011790 con 0x7ff3580cd0a0 2023-10-16T13:49:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0118f0 con 0x7ff3580cd0a0 2023-10-16T13:49:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35806fa90 con 0x7ff3580cd0a0 2023-10-16T13:49:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011ca0 con 0x7ff3580cd0a0 2023-10-16T13:49:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.517+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3580c7280 con 0x7ff3580cd0a0 2023-10-16T13:49:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.518+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35806fcb0 con 0x7ff3580cd0a0 2023-10-16T13:49:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.519+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7ff34c01c460 con 0x7ff3580cd0a0 2023-10-16T13:49:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.519+0000 7ff346ffd700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff33806b2f0 0x7ff33806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.519+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff34c089770 con 0x7ff3580cd0a0 2023-10-16T13:49:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.519+0000 7ff355d9b700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff33806b2f0 0x7ff33806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.520+0000 7ff355d9b700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff33806b2f0 0x7ff33806d7b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff3580b35a0 tx=0x7ff348004a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.524+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff34c054520 con 0x7ff3580cd0a0 2023-10-16T13:49:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:30.741+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff3580cee30 con 0x7ff3580cd0a0 2023-10-16T13:49:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.355+0000 7ff346ffd700 1 -- 172.21.15.5:0/321115698 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v129) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff34c057b40 con 0x7ff3580cd0a0 2023-10-16T13:49:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.358+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff33806b2f0 msgr2=0x7ff33806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.358+0000 7ff35cc62700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff33806b2f0 0x7ff33806d7b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff3580b35a0 tx=0x7ff348004a50 comp rx=0 tx=0).stop 2023-10-16T13:49:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.358+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 msgr2=0x7ff358158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.358+0000 7ff35cc62700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff358158f20 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c4d0 tx=0x7ff34c00c7e0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 shutdown_connections 2023-10-16T13:49:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35815e0c0 0x7ff3580ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3580cd0a0 0x7ff358158f20 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff33806b2f0 0x7ff33806d7b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 --2- 172.21.15.5:0/321115698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff35815dce0 0x7ff3580cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 >> 172.21.15.5:0/321115698 conn(0x7ff3580d15f0 msgr2=0x7ff35815ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 shutdown_connections 2023-10-16T13:49:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.359+0000 7ff35cc62700 1 -- 172.21.15.5:0/321115698 wait complete. 2023-10-16T13:49:31.364 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-10-16T13:49:31.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T13:49:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.508+0000 7fde636fe700 1 Processor -- start 2023-10-16T13:49:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.508+0000 7fde636fe700 1 -- start start 2023-10-16T13:49:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde636fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde5c0cd950 0x7fde5c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde636fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde5c0cede0 0x7fde5c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde636fe700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0cf290 con 0x7fde5c06a840 2023-10-16T13:49:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde636fe700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c1619a0 con 0x7fde5c0cede0 2023-10-16T13:49:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde636fe700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0b2d60 con 0x7fde5c0cd950 2023-10-16T13:49:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde5c0cede0 0x7fde5c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde5c0cede0 0x7fde5c15f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50410/0 (socket says 172.21.15.5:50410) 2023-10-16T13:49:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 -- 172.21.15.5:0/1451595489 learned_addr learned my addr 172.21.15.5:0/1451595489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde61c9b700 1 --1- 172.21.15.5:0/1451595489 >> v1:172.21.15.5:6789/0 conn(0x7fde5c06a840 0x7fde5c161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60418/0 (socket says 172.21.15.5:60418) 2023-10-16T13:49:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde6149a700 1 --2- 172.21.15.5:0/1451595489 >> v2:172.21.15.112:3300/0 conn(0x7fde5c0cd950 0x7fde5c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 -- 172.21.15.5:0/1451595489 >> v2:172.21.15.112:3300/0 conn(0x7fde5c0cd950 msgr2=0x7fde5c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 --2- 172.21.15.5:0/1451595489 >> v2:172.21.15.112:3300/0 conn(0x7fde5c0cd950 0x7fde5c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 -- 172.21.15.5:0/1451595489 >> v1:172.21.15.5:6789/0 conn(0x7fde5c06a840 legacy=0x7fde5c161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 -- 172.21.15.5:0/1451595489 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0cdd30 con 0x7fde5c0cede0 2023-10-16T13:49:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde53fff700 1 -- 172.21.15.5:0/1451595489 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484962209 0 0) 0x7fde5c0cf290 con 0x7fde5c06a840 2023-10-16T13:49:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.509+0000 7fde60c99700 1 --2- 172.21.15.5:0/1451595489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cede0 0x7fde5c15f570 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fde5c161ae0 tx=0x7fde4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c4ee8744fec14d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde53fff700 1 -- 172.21.15.5:0/1451595489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c005c20 con 0x7fde5c0cede0 2023-10-16T13:49:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde53fff700 1 -- 172.21.15.5:0/1451595489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c005da0 con 0x7fde5c0cede0 2023-10-16T13:49:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde53fff700 1 -- 172.21.15.5:0/1451595489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c004270 con 0x7fde5c0cede0 2023-10-16T13:49:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 -- 172.21.15.5:0/1451595489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cede0 msgr2=0x7fde5c15f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 --2- 172.21.15.5:0/1451595489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cede0 0x7fde5c15f570 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fde5c161ae0 tx=0x7fde4c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 -- 172.21.15.5:0/1451595489 shutdown_connections 2023-10-16T13:49:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 --2- 172.21.15.5:0/1451595489 >> v2:172.21.15.112:3300/0 conn(0x7fde5c0cd950 0x7fde5c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 --2- 172.21.15.5:0/1451595489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cede0 0x7fde5c15f570 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 -- 172.21.15.5:0/1451595489 >> 172.21.15.5:0/1451595489 conn(0x7fde5c06dae0 msgr2=0x7fde5c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 -- 172.21.15.5:0/1451595489 shutdown_connections 2023-10-16T13:49:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.510+0000 7fde636fe700 1 -- 172.21.15.5:0/1451595489 wait complete. 2023-10-16T13:49:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.511+0000 7fde636fe700 1 Processor -- start 2023-10-16T13:49:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.511+0000 7fde636fe700 1 -- start start 2023-10-16T13:49:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde636fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5c06a840 0x7fde5c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde636fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 0x7fde5c15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde636fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde5c0cede0 0x7fde5c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde636fe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15d070 con 0x7fde5c0cd950 2023-10-16T13:49:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde636fe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0aeac0 con 0x7fde5c06a840 2023-10-16T13:49:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde636fe700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0c6930 con 0x7fde5c0cede0 2023-10-16T13:49:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde60c99700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 0x7fde5c15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde60c99700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 0x7fde5c15cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50416/0 (socket says 172.21.15.5:50416) 2023-10-16T13:49:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.512+0000 7fde60c99700 1 -- 172.21.15.5:0/3402102227 learned_addr learned my addr 172.21.15.5:0/3402102227 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde6149a700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5c06a840 0x7fde5c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde61c9b700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde5c0cede0 0x7fde5c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde60c99700 1 -- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde5c0cede0 msgr2=0x7fde5c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde60c99700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde5c0cede0 0x7fde5c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde60c99700 1 -- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5c06a840 msgr2=0x7fde5c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde60c99700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5c06a840 0x7fde5c0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde60c99700 1 -- 172.21.15.5:0/3402102227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009500 con 0x7fde5c0cd950 2023-10-16T13:49:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde6149a700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5c06a840 0x7fde5c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde61c9b700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde5c0cede0 0x7fde5c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde60c99700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 0x7fde5c15cb30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0cf420 tx=0x7fde4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c003ab0 con 0x7fde5c0cd950 2023-10-16T13:49:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c003c30 con 0x7fde5c0cd950 2023-10-16T13:49:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00b670 con 0x7fde5c0cd950 2023-10-16T13:49:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c0ae470 con 0x7fde5c0cd950 2023-10-16T13:49:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.513+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c0acb60 con 0x7fde5c0cd950 2023-10-16T13:49:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.514+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c067d20 con 0x7fde5c0cd950 2023-10-16T13:49:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.515+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fde4c020020 con 0x7fde5c0cd950 2023-10-16T13:49:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.515+0000 7fde51ffb700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde4006b2f0 0x7fde4006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.515+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde4c08a9a0 con 0x7fde5c0cd950 2023-10-16T13:49:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.515+0000 7fde6149a700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde4006b2f0 0x7fde4006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.516+0000 7fde6149a700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde4006b2f0 0x7fde4006d7b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fde58006fd0 tx=0x7fde58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.520+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde4c055960 con 0x7fde5c0cd950 2023-10-16T13:49:31.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.805+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fde5c0b2630 con 0x7fde5c0cd950 2023-10-16T13:49:31.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.805+0000 7fde51ffb700 1 -- 172.21.15.5:0/3402102227 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fde4c015090 con 0x7fde5c0cd950 2023-10-16T13:49:31.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:31.809 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:49:31.809 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-10-16T13:49:31.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.810 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-10-16T13:49:31.810 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ldHetMxAAsVlorjTT4qsmkwTivDoK2g==", 2023-10-16T13:49:31.810 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.810 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.810 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:49:31.811 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:49:31.811 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.812 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-10-16T13:49:31.812 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lCviLBBAALpmlu/Klyw+MUi/KknmqmQ==", 2023-10-16T13:49:31.812 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.812 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.812 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:49:31.813 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:49:31.813 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.813 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.814 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-10-16T13:49:31.814 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1lhxUkOxAAcNlSzebtfZyh+5GlEfwu8w==", 2023-10-16T13:49:31.814 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.814 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.814 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:49:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:49:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-10-16T13:49:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1ln4u/CxAAHOOAjVXdaVmOfw7qhvNGug==", 2023-10-16T13:49:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:49:31.817 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:49:31.817 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.818 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-10-16T13:49:31.818 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCbPC1lI6xlMRAAmMzWmTMyy5Tru1jssZixgQ==", 2023-10-16T13:49:31.818 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.819 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.819 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-10-16T13:49:31.819 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCePC1lJpMtMRAALJtTjGLbrariu7w/iR1dUQ==", 2023-10-16T13:49:31.820 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.820 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.821 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-10-16T13:49:31.821 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQChPC1lmgv/MBAAkYEYUgpjq7URkrY2Ri5h3w==", 2023-10-16T13:49:31.821 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.822 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.822 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.823 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-10-16T13:49:31.823 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCkPC1lxzd2MBAAisyzzak9I/JSiNa2JQGZ5A==", 2023-10-16T13:49:31.823 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.823 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.824 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-10-16T13:49:31.824 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCqPC1lFVxqMxAARHCMm3nK3hxsDFWh3CEWKQ==", 2023-10-16T13:49:31.824 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.825 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.826 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-10-16T13:49:31.826 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCtPC1lsAr+MRAAwhhgJakEj3/wpsnvuhl8vg==", 2023-10-16T13:49:31.826 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.827 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.827 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-10-16T13:49:31.827 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCwPC1l/uO8MRAAufZThxBnbsNpVvs8AepjUA==", 2023-10-16T13:49:31.828 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.829 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-10-16T13:49:31.829 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCzPC1lGGpFMRAA4K+Hy6Ao7uNQVWkbDWBjgw==", 2023-10-16T13:49:31.829 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-10-16T13:49:31.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-10-16T13:49:31.830 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.830 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-10-16T13:49:31.831 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ==", 2023-10-16T13:49:31.831 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.831 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.831 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-10-16T13:49:31.831 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-16T13:49:31.831 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.832 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-10-16T13:49:31.832 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lTRrrFhAAZ1AUNO+s3DHy8qOGSi9cOw==", 2023-10-16T13:49:31.832 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.832 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:49:31.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:49:31.833 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:49:31.833 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.834 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-10-16T13:49:31.834 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1l3omUExAA/i5O7MCwXYuAxsulh9PVkw==", 2023-10-16T13:49:31.834 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.834 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.834 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:49:31.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:49:31.835 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:49:31.835 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.835 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCaPC1lmV2ZHBAAA2131DZeLX33okF2gXxzFg==", 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-10-16T13:49:31.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.837 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-10-16T13:49:31.837 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1ln9J1DxAAmOdbUmhG8sb3rXsANPl62Q==", 2023-10-16T13:49:31.837 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.837 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:49:31.838 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-10-16T13:49:31.838 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-10-16T13:49:31.838 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.838 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.839 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-10-16T13:49:31.839 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l6gY0MBAAd9qUJ0Fq8hahLJk5AAQwZQ==", 2023-10-16T13:49:31.839 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.840 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:49:31.840 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:49:31.840 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-16T13:49:31.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:31.841 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-10-16T13:49:31.841 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZPC1l2tutKhAAEnbqYaA4hG0dv36cdcMkKA==", 2023-10-16T13:49:31.841 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-10-16T13:49:31.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-10-16T13:49:31.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-10-16T13:49:31.842 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-10-16T13:49:31.842 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.842 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:31.842 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-16T13:49:31.842 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:49:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde4006b2f0 msgr2=0x7fde4006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde4006b2f0 0x7fde4006d7b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fde58006fd0 tx=0x7fde58008040 comp rx=0 tx=0).stop 2023-10-16T13:49:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 msgr2=0x7fde5c15cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 0x7fde5c15cb30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0cf420 tx=0x7fde4c004750 comp rx=0 tx=0).stop 2023-10-16T13:49:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 shutdown_connections 2023-10-16T13:49:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fde4006b2f0 0x7fde4006d7b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde5c0cede0 0x7fde5c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde5c06a840 0x7fde5c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 --2- 172.21.15.5:0/3402102227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde5c0cd950 0x7fde5c15cb30 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 >> 172.21.15.5:0/3402102227 conn(0x7fde5c06dae0 msgr2=0x7fde5c072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 shutdown_connections 2023-10-16T13:49:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.808+0000 7fde636fe700 1 -- 172.21.15.5:0/3402102227 wait complete. 2023-10-16T13:49:31.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:31.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.968+0000 7f055e99d700 1 Processor -- start 2023-10-16T13:49:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.969+0000 7f055e99d700 1 -- start start 2023-10-16T13:49:31.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.969+0000 7f055e99d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f055806ef20 0x7f05580cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.969+0000 7f055e99d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05580ce0b0 0x7f055806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.969+0000 7f055e99d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055815bf30 con 0x7f055815bb50 2023-10-16T13:49:31.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.969+0000 7f055e99d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05580ce540 con 0x7f05580ce0b0 2023-10-16T13:49:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.969+0000 7f055e99d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05580b2d70 con 0x7f055806ef20 2023-10-16T13:49:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05580ce0b0 0x7f055806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f05577fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f055806ef20 0x7f05580cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05580ce0b0 0x7f055806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50428/0 (socket says 172.21.15.5:50428) 2023-10-16T13:49:31.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 -- 172.21.15.5:0/2847966698 learned_addr learned my addr 172.21.15.5:0/2847966698 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 -- 172.21.15.5:0/2847966698 >> v2:172.21.15.112:3300/0 conn(0x7f055806ef20 msgr2=0x7f05580cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 --2- 172.21.15.5:0/2847966698 >> v2:172.21.15.112:3300/0 conn(0x7f055806ef20 0x7f05580cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 -- 172.21.15.5:0/2847966698 >> v1:172.21.15.112:6789/0 conn(0x7f055815bb50 legacy=0x7f055806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 -- 172.21.15.5:0/2847966698 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055806d500 con 0x7f05580ce0b0 2023-10-16T13:49:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f055cf3a700 1 --2- 172.21.15.5:0/2847966698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05580ce0b0 0x7f055806a840 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0558070e90 tx=0x7f055000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40abd92021c96c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f0556ffd700 1 -- 172.21.15.5:0/2847966698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000e070 con 0x7f05580ce0b0 2023-10-16T13:49:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f0556ffd700 1 -- 172.21.15.5:0/2847966698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000b910 con 0x7f05580ce0b0 2023-10-16T13:49:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.970+0000 7f0556ffd700 1 -- 172.21.15.5:0/2847966698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000bcc0 con 0x7f05580ce0b0 2023-10-16T13:49:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 -- 172.21.15.5:0/2847966698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05580ce0b0 msgr2=0x7f055806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 --2- 172.21.15.5:0/2847966698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05580ce0b0 0x7f055806a840 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0558070e90 tx=0x7f055000b330 comp rx=0 tx=0).stop 2023-10-16T13:49:31.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 -- 172.21.15.5:0/2847966698 shutdown_connections 2023-10-16T13:49:31.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 --2- 172.21.15.5:0/2847966698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05580ce0b0 0x7f055806a840 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 --2- 172.21.15.5:0/2847966698 >> v2:172.21.15.112:3300/0 conn(0x7f055806ef20 0x7f05580cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 -- 172.21.15.5:0/2847966698 >> 172.21.15.5:0/2847966698 conn(0x7f05580cc6f0 msgr2=0x7f05580ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:31.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 -- 172.21.15.5:0/2847966698 shutdown_connections 2023-10-16T13:49:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.971+0000 7f055e99d700 1 -- 172.21.15.5:0/2847966698 wait complete. 2023-10-16T13:49:31.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.972+0000 7f055e99d700 1 Processor -- start 2023-10-16T13:49:31.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.972+0000 7f055e99d700 1 -- start start 2023-10-16T13:49:31.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055e99d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055806ef20 0x7f0558155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055e99d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05580ce0b0 0x7f0558151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055e99d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 0x7f055815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055e99d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558154cb0 con 0x7f055815bb50 2023-10-16T13:49:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055e99d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558154f90 con 0x7f055806ef20 2023-10-16T13:49:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055e99d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0558155270 con 0x7f05580ce0b0 2023-10-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055cf3a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 0x7f055815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055cf3a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 0x7f055815db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50434/0 (socket says 172.21.15.5:50434) 2023-10-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f055cf3a700 1 -- 172.21.15.5:0/1867845135 learned_addr learned my addr 172.21.15.5:0/1867845135 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f0557fff700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055806ef20 0x7f0558155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.973+0000 7f05577fe700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05580ce0b0 0x7f0558151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055cf3a700 1 -- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05580ce0b0 msgr2=0x7f0558151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055cf3a700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05580ce0b0 0x7f0558151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055cf3a700 1 -- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055806ef20 msgr2=0x7f0558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055cf3a700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055806ef20 0x7f0558155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055cf3a700 1 -- 172.21.15.5:0/1867845135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550009b30 con 0x7f055815bb50 2023-10-16T13:49:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055cf3a700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 0x7f055815db00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f055000b370 tx=0x7f0550004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550004880 con 0x7f055815bb50 2023-10-16T13:49:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05500099b0 con 0x7f055815bb50 2023-10-16T13:49:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055001c680 con 0x7f055815bb50 2023-10-16T13:49:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0558155550 con 0x7f055815bb50 2023-10-16T13:49:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.974+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0558151e40 con 0x7f055815bb50 2023-10-16T13:49:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.975+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558155a10 con 0x7f055815bb50 2023-10-16T13:49:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.975+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f055001c7e0 con 0x7f055815bb50 2023-10-16T13:49:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.976+0000 7f0554ff9700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f054406b2f0 0x7f054406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.976+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f055008b270 con 0x7f055815bb50 2023-10-16T13:49:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.976+0000 7f0557fff700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f054406b2f0 0x7f054406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.977+0000 7f0557fff700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f054406b2f0 0x7f054406d7b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0558152850 tx=0x7f0548009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:31.981+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0550056110 con 0x7f055815bb50 2023-10-16T13:49:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.182+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05580668b0 con 0x7f055815bb50 2023-10-16T13:49:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.182+0000 7f0554ff9700 1 -- 172.21.15.5:0/1867845135 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+12795 (secure 0 0 0) 0x7f0550059730 con 0x7f055815bb50 2023-10-16T13:49:32.185 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:32.186 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":131,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:31.363160+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f054406b2f0 msgr2=0x7f054406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f054406b2f0 0x7f054406d7b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0558152850 tx=0x7f0548009040 comp rx=0 tx=0).stop 2023-10-16T13:49:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 msgr2=0x7f055815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 0x7f055815db00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f055000b370 tx=0x7f0550004ad0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 shutdown_connections 2023-10-16T13:49:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055815bb50 0x7f055815db00 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f055806ef20 0x7f0558155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f054406b2f0 0x7f054406d7b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 --2- 172.21.15.5:0/1867845135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05580ce0b0 0x7f0558151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 >> 172.21.15.5:0/1867845135 conn(0x7f05580cc6f0 msgr2=0x7f055815ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 shutdown_connections 2023-10-16T13:49:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.185+0000 7f055e99d700 1 -- 172.21.15.5:0/1867845135 wait complete. 2023-10-16T13:49:32.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:32.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:32.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.326+0000 7f41fe043700 1 Processor -- start 2023-10-16T13:49:32.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.326+0000 7f41fe043700 1 -- start start 2023-10-16T13:49:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41fe043700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41f815e2f0 0x7f41f80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41fe043700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f806a840 0x7f41f806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41fe043700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f80b2d60 con 0x7f41f80cd950 2023-10-16T13:49:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41fe043700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f81619a0 con 0x7f41f815e2f0 2023-10-16T13:49:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41fe043700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f806b1f0 con 0x7f41f806a840 2023-10-16T13:49:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41f80cd950 0x7f41f815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60442/0 (socket says 172.21.15.5:60442) 2023-10-16T13:49:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f77fe700 1 -- 172.21.15.5:0/156922637 learned_addr learned my addr 172.21.15.5:0/156922637 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f6ffd700 1 --2- 172.21.15.5:0/156922637 >> v2:172.21.15.112:3300/0 conn(0x7f41f815e2f0 0x7f41f80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f7fff700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f806a840 0x7f41f806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f67fc700 1 -- 172.21.15.5:0/156922637 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468473226 0 0) 0x7f41f80b2d60 con 0x7f41f80cd950 2023-10-16T13:49:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f67fc700 1 -- 172.21.15.5:0/156922637 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e40035b0 con 0x7f41f80cd950 2023-10-16T13:49:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f6ffd700 1 -- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f806a840 msgr2=0x7f41f806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f6ffd700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f806a840 0x7f41f806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f67fc700 1 -- 172.21.15.5:0/156922637 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922146056 0 0) 0x7f41e40035b0 con 0x7f41f80cd950 2023-10-16T13:49:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f6ffd700 1 -- 172.21.15.5:0/156922637 >> v1:172.21.15.5:6789/0 conn(0x7f41f80cd950 legacy=0x7f41f815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f6ffd700 1 -- 172.21.15.5:0/156922637 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80cdd30 con 0x7f41f815e2f0 2023-10-16T13:49:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.327+0000 7f41f7fff700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f806a840 0x7f41f806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41f6ffd700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f815e2f0 0x7f41f80cede0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f41f8161ae0 tx=0x7f41e0009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bbe20e58fcbb36b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41f67fc700 1 -- 172.21.15.5:0/156922637 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8001670 con 0x7f41f815e2f0 2023-10-16T13:49:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41f67fc700 1 -- 172.21.15.5:0/156922637 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0005c30 con 0x7f41f815e2f0 2023-10-16T13:49:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41f67fc700 1 -- 172.21.15.5:0/156922637 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0004030 con 0x7f41f815e2f0 2023-10-16T13:49:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 -- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f815e2f0 msgr2=0x7f41f80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f815e2f0 0x7f41f80cede0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f41f8161ae0 tx=0x7f41e0009b00 comp rx=0 tx=0).stop 2023-10-16T13:49:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 -- 172.21.15.5:0/156922637 shutdown_connections 2023-10-16T13:49:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f806a840 0x7f41f806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 --2- 172.21.15.5:0/156922637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f815e2f0 0x7f41f80cede0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 -- 172.21.15.5:0/156922637 >> 172.21.15.5:0/156922637 conn(0x7f41f806dae0 msgr2=0x7f41f806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.328+0000 7f41fe043700 1 -- 172.21.15.5:0/156922637 shutdown_connections 2023-10-16T13:49:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.329+0000 7f41fe043700 1 -- 172.21.15.5:0/156922637 wait complete. 2023-10-16T13:49:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.330+0000 7f41fe043700 1 Processor -- start 2023-10-16T13:49:32.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.330+0000 7f41fe043700 1 -- start start 2023-10-16T13:49:32.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f806a840 0x7f41f80c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f80cd950 0x7f41f80cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 0x7f41f80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c9940 con 0x7f41f815e2f0 2023-10-16T13:49:32.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c75a0 con 0x7f41f806a840 2023-10-16T13:49:32.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c9660 con 0x7f41f80cd950 2023-10-16T13:49:32.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 0x7f41f80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 0x7f41f80c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50448/0 (socket says 172.21.15.5:50448) 2023-10-16T13:49:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 -- 172.21.15.5:0/2725490500 learned_addr learned my addr 172.21.15.5:0/2725490500 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f6ffd700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f80cd950 0x7f41f80cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f77fe700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f806a840 0x7f41f80c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 -- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f80cd950 msgr2=0x7f41f80cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f80cd950 0x7f41f80cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 -- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f806a840 msgr2=0x7f41f80c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f806a840 0x7f41f80c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 -- 172.21.15.5:0/2725490500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009a70 con 0x7f41f815e2f0 2023-10-16T13:49:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41f7fff700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 0x7f41f80c8ba0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f41f000efc0 tx=0x7f41f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000ca90 con 0x7f41f815e2f0 2023-10-16T13:49:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000f040 con 0x7f41f815e2f0 2023-10-16T13:49:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000ce10 con 0x7f41f815e2f0 2023-10-16T13:49:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e0009430 con 0x7f41f815e2f0 2023-10-16T13:49:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.331+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f80c7ad0 con 0x7f41f815e2f0 2023-10-16T13:49:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.332+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8067d20 con 0x7f41f815e2f0 2023-10-16T13:49:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.333+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f41f0014480 con 0x7f41f815e2f0 2023-10-16T13:49:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.333+0000 7f41effff700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d806b2f0 0x7f41d806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.333+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41f008a1e0 con 0x7f41f815e2f0 2023-10-16T13:49:32.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.333+0000 7f41f77fe700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d806b2f0 0x7f41d806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.334+0000 7f41f77fe700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d806b2f0 0x7f41d806d7b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000f60 tx=0x7f41e8001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:32.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.338+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41f0054eb0 con 0x7f41f815e2f0 2023-10-16T13:49:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.540+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41f80b2100 con 0x7f41f815e2f0 2023-10-16T13:49:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.540+0000 7f41effff700 1 -- 172.21.15.5:0/2725490500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41f0009d70 con 0x7f41f815e2f0 2023-10-16T13:49:32.543 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d806b2f0 msgr2=0x7f41d806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d806b2f0 0x7f41d806d7b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000f60 tx=0x7f41e8001230 comp rx=0 tx=0).stop 2023-10-16T13:49:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 msgr2=0x7f41f80c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 0x7f41f80c8ba0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f41f000efc0 tx=0x7f41f000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 shutdown_connections 2023-10-16T13:49:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815e2f0 0x7f41f80c8ba0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f806a840 0x7f41f80c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f41d806b2f0 0x7f41d806d7b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 --2- 172.21.15.5:0/2725490500 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41f80cd950 0x7f41f80cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 >> 172.21.15.5:0/2725490500 conn(0x7f41f806dae0 msgr2=0x7f41f8160730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 shutdown_connections 2023-10-16T13:49:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.542+0000 7f41fe043700 1 -- 172.21.15.5:0/2725490500 wait complete. 2023-10-16T13:49:32.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:49:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.679+0000 7efde3333700 1 Processor -- start 2023-10-16T13:49:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.679+0000 7efde3333700 1 -- start start 2023-10-16T13:49:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde3333700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efddc06af50 0x7efddc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde3333700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde3333700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc0b3530 con 0x7efddc15f130 2023-10-16T13:49:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde3333700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc0cde00 con 0x7efddc06af50 2023-10-16T13:49:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde3333700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0cd180 con 0x7efddc0b28b0 2023-10-16T13:49:32.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde18d0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde10cf700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efddc15f130 0x7efddc06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:51434/0 (socket says 172.21.15.5:51434) 2023-10-16T13:49:32.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde10cf700 1 -- 172.21.15.5:0/2628221552 learned_addr learned my addr 172.21.15.5:0/2628221552 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:32.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde08ce700 1 --2- 172.21.15.5:0/2628221552 >> v2:172.21.15.112:3300/0 conn(0x7efddc06af50 0x7efddc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde08ce700 1 -- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 msgr2=0x7efddc0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:32.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde08ce700 1 --2- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde08ce700 1 -- 172.21.15.5:0/2628221552 >> v1:172.21.15.112:6789/0 conn(0x7efddc15f130 legacy=0x7efddc06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efdd3fff700 1 -- 172.21.15.5:0/2628221552 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945808544 0 0) 0x7efddc0b3530 con 0x7efddc15f130 2023-10-16T13:49:32.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde08ce700 1 -- 172.21.15.5:0/2628221552 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0cd460 con 0x7efddc06af50 2023-10-16T13:49:32.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.680+0000 7efde18d0700 1 --2- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:32.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde08ce700 1 --2- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc0cede0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009820 tx=0x7efdcc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210d1bfc431cb00b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:32.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efdd3fff700 1 -- 172.21.15.5:0/2628221552 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc005e30 con 0x7efddc06af50 2023-10-16T13:49:32.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efdd3fff700 1 -- 172.21.15.5:0/2628221552 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc006030 con 0x7efddc06af50 2023-10-16T13:49:32.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efdd3fff700 1 -- 172.21.15.5:0/2628221552 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0063c0 con 0x7efddc06af50 2023-10-16T13:49:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde3333700 1 -- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 msgr2=0x7efddc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde3333700 1 --2- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc0cede0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009820 tx=0x7efdcc009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde3333700 1 -- 172.21.15.5:0/2628221552 shutdown_connections 2023-10-16T13:49:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde3333700 1 --2- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde3333700 1 --2- 172.21.15.5:0/2628221552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc0cede0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.681+0000 7efde3333700 1 -- 172.21.15.5:0/2628221552 >> 172.21.15.5:0/2628221552 conn(0x7efddc06dae0 msgr2=0x7efddc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.682+0000 7efde3333700 1 -- 172.21.15.5:0/2628221552 shutdown_connections 2023-10-16T13:49:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.682+0000 7efde3333700 1 -- 172.21.15.5:0/2628221552 wait complete. 2023-10-16T13:49:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 Processor -- start 2023-10-16T13:49:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 -- start start 2023-10-16T13:49:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 0x7efddc0aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0aec50 con 0x7efddc15f130 2023-10-16T13:49:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0ae970 con 0x7efddc06af50 2023-10-16T13:49:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.683+0000 7efde3333700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc15a260 con 0x7efddc0b28b0 2023-10-16T13:49:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 0x7efddc0aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 0x7efddc0aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50464/0 (socket says 172.21.15.5:50464) 2023-10-16T13:49:32.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 -- 172.21.15.5:0/2764309102 learned_addr learned my addr 172.21.15.5:0/2764309102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:32.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde10cf700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde08ce700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 -- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 msgr2=0x7efddc0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 -- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 msgr2=0x7efddc159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 -- 172.21.15.5:0/2764309102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4009a70 con 0x7efddc15f130 2023-10-16T13:49:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde18d0700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 0x7efddc0aff30 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7efdd400efc0 tx=0x7efdd400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:32.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd400ca90 con 0x7efddc15f130 2023-10-16T13:49:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd400f040 con 0x7efddc15f130 2023-10-16T13:49:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc009430 con 0x7efddc15f130 2023-10-16T13:49:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.684+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd400ce10 con 0x7efddc15f130 2023-10-16T13:49:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.685+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc0adfd0 con 0x7efddc15f130 2023-10-16T13:49:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.685+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc0aeab0 con 0x7efddc15f130 2023-10-16T13:49:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.686+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7efdd4014480 con 0x7efddc15f130 2023-10-16T13:49:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.686+0000 7efdd1ffb700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdc006b2f0 0x7efdc006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.686+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efdd408a1b0 con 0x7efddc15f130 2023-10-16T13:49:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.686+0000 7efde10cf700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdc006b2f0 0x7efdc006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:32.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.687+0000 7efde10cf700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdc006b2f0 0x7efdc006d7b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efdd8007fd0 tx=0x7efdd8007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:32.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.691+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efddc0aeab0 con 0x7efddc15f130 2023-10-16T13:49:32.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.894+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efddc0aeab0 con 0x7efddc15f130 2023-10-16T13:49:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.895+0000 7efdd1ffb700 1 -- 172.21.15.5:0/2764309102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) v1 ==== 84+0+65 (secure 0 0 0) 0x7efddc0aeab0 con 0x7efddc15f130 2023-10-16T13:49:32.898 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:32.898 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:49:32.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:32.899 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-16T13:49:32.899 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-16T13:49:32.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:32.899 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:49:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.896+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdc006b2f0 msgr2=0x7efdc006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.896+0000 7efde3333700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdc006b2f0 0x7efdc006d7b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efdd8007fd0 tx=0x7efdd8007de0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.896+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 msgr2=0x7efddc0aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.896+0000 7efde3333700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 0x7efddc0aff30 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7efdd400efc0 tx=0x7efdd400c3a0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 shutdown_connections 2023-10-16T13:49:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efddc15f130 0x7efddc0aff30 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efddc06af50 0x7efddc159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efdc006b2f0 0x7efdc006d7b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 --2- 172.21.15.5:0/2764309102 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efddc0b28b0 0x7efddc0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 >> 172.21.15.5:0/2764309102 conn(0x7efddc06dae0 msgr2=0x7efddc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 shutdown_connections 2023-10-16T13:49:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:32.897+0000 7efde3333700 1 -- 172.21.15.5:0/2764309102 wait complete. 2023-10-16T13:49:32.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:49:32.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:49:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.039+0000 7f12de29f700 1 Processor -- start 2023-10-16T13:49:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.039+0000 7f12de29f700 1 -- start start 2023-10-16T13:49:33.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12de29f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d8151680 0x7f12d815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12de29f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12d806da30 0x7f12d806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12de29f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d80b2e40 con 0x7f12d80727e0 2023-10-16T13:49:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12de29f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d806e400 con 0x7f12d806da30 2023-10-16T13:49:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12de29f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d815e7c0 con 0x7f12d8151680 2023-10-16T13:49:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12d80727e0 0x7f12d80b1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60472/0 (socket says 172.21.15.5:60472) 2023-10-16T13:49:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d77fe700 1 -- 172.21.15.5:0/2100797518 learned_addr learned my addr 172.21.15.5:0/2100797518 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d7fff700 1 --2- 172.21.15.5:0/2100797518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d8151680 0x7f12d815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12dc83c700 1 --2- 172.21.15.5:0/2100797518 >> v2:172.21.15.112:3300/0 conn(0x7f12d806da30 0x7f12d806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d6ffd700 1 -- 172.21.15.5:0/2100797518 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018872389 0 0) 0x7f12c0001110 con 0x7f12d80727e0 2023-10-16T13:49:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d6ffd700 1 -- 172.21.15.5:0/2100797518 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c40035b0 con 0x7f12d80727e0 2023-10-16T13:49:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d7fff700 1 -- 172.21.15.5:0/2100797518 >> v2:172.21.15.112:3300/0 conn(0x7f12d806da30 msgr2=0x7f12d806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d7fff700 1 --2- 172.21.15.5:0/2100797518 >> v2:172.21.15.112:3300/0 conn(0x7f12d806da30 0x7f12d806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d7fff700 1 -- 172.21.15.5:0/2100797518 >> v1:172.21.15.5:6789/0 conn(0x7f12d80727e0 legacy=0x7f12d80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d6ffd700 1 -- 172.21.15.5:0/2100797518 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2038346129 0 0) 0x7f12c40035b0 con 0x7f12d80727e0 2023-10-16T13:49:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12d7fff700 1 -- 172.21.15.5:0/2100797518 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80b2620 con 0x7f12d8151680 2023-10-16T13:49:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.040+0000 7f12dc83c700 1 --2- 172.21.15.5:0/2100797518 >> v2:172.21.15.112:3300/0 conn(0x7f12d806da30 0x7f12d806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12d7fff700 1 --2- 172.21.15.5:0/2100797518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d8151680 0x7f12d815ec50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009840 tx=0x7f12c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5507659edd251ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12d6ffd700 1 -- 172.21.15.5:0/2100797518 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c0001800 con 0x7f12d8151680 2023-10-16T13:49:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12d6ffd700 1 -- 172.21.15.5:0/2100797518 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8004030 con 0x7f12d8151680 2023-10-16T13:49:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12d6ffd700 1 -- 172.21.15.5:0/2100797518 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80043a0 con 0x7f12d8151680 2023-10-16T13:49:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 -- 172.21.15.5:0/2100797518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d8151680 msgr2=0x7f12d815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 --2- 172.21.15.5:0/2100797518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d8151680 0x7f12d815ec50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009840 tx=0x7f12c8009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 -- 172.21.15.5:0/2100797518 shutdown_connections 2023-10-16T13:49:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 --2- 172.21.15.5:0/2100797518 >> v2:172.21.15.112:3300/0 conn(0x7f12d806da30 0x7f12d806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 --2- 172.21.15.5:0/2100797518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d8151680 0x7f12d815ec50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 -- 172.21.15.5:0/2100797518 >> 172.21.15.5:0/2100797518 conn(0x7f12d806bd70 msgr2=0x7f12d806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 -- 172.21.15.5:0/2100797518 shutdown_connections 2023-10-16T13:49:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.041+0000 7f12de29f700 1 -- 172.21.15.5:0/2100797518 wait complete. 2023-10-16T13:49:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.043+0000 7f12de29f700 1 Processor -- start 2023-10-16T13:49:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.043+0000 7f12de29f700 1 -- start start 2023-10-16T13:49:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.043+0000 7f12de29f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d806da30 0x7f12d80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.043+0000 7f12de29f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d80727e0 0x7f12d815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12de29f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 0x7f12d815d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12de29f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b6200 con 0x7f12d8151680 2023-10-16T13:49:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12de29f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b35f0 con 0x7f12d80727e0 2023-10-16T13:49:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12de29f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d81f2e10 con 0x7f12d806da30 2023-10-16T13:49:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 0x7f12d815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 0x7f12d815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50478/0 (socket says 172.21.15.5:50478) 2023-10-16T13:49:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 -- 172.21.15.5:0/259493951 learned_addr learned my addr 172.21.15.5:0/259493951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12d7fff700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d806da30 0x7f12d80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12d77fe700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d80727e0 0x7f12d815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 -- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d806da30 msgr2=0x7f12d80b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d806da30 0x7f12d80b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 -- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d80727e0 msgr2=0x7f12d815d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d80727e0 0x7f12d815d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 -- 172.21.15.5:0/259493951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d0009a70 con 0x7f12d8151680 2023-10-16T13:49:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12dc83c700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 0x7f12d815d690 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f12d000efc0 tx=0x7f12d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0009d70 con 0x7f12d8151680 2023-10-16T13:49:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d000f040 con 0x7f12d8151680 2023-10-16T13:49:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c80094a0 con 0x7f12d8151680 2023-10-16T13:49:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000ce00 con 0x7f12d8151680 2023-10-16T13:49:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.044+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d80b5860 con 0x7f12d8151680 2023-10-16T13:49:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.045+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d8072e10 con 0x7f12d8151680 2023-10-16T13:49:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.046+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f12d0014480 con 0x7f12d8151680 2023-10-16T13:49:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.046+0000 7f12d4ff9700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12b806b2f0 0x7f12b806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.046+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f12d008a1e0 con 0x7f12d8151680 2023-10-16T13:49:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.046+0000 7f12d7fff700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12b806b2f0 0x7f12b806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.047+0000 7f12d7fff700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12b806b2f0 0x7f12b806d7b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f12c80090b0 tx=0x7f12c8013040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:33.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.051+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12d0054f80 con 0x7f12d8151680 2023-10-16T13:49:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.255+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f12d8067d20 con 0x7f12d8151680 2023-10-16T13:49:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.366+0000 7f12d4ff9700 1 -- 172.21.15.5:0/259493951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v132) v1 ==== 138+0+0 (secure 0 0 0) 0x7f12d00585a0 con 0x7f12d8151680 2023-10-16T13:49:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12b806b2f0 msgr2=0x7f12b806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12b806b2f0 0x7f12b806d7b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f12c80090b0 tx=0x7f12c8013040 comp rx=0 tx=0).stop 2023-10-16T13:49:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 msgr2=0x7f12d815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 0x7f12d815d690 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f12d000efc0 tx=0x7f12d000c3a0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 shutdown_connections 2023-10-16T13:49:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8151680 0x7f12d815d690 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f12b806b2f0 0x7f12b806d7b0 secure :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f12c80090b0 tx=0x7f12c8013040 comp rx=0 tx=0).stop 2023-10-16T13:49:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12d806da30 0x7f12d80b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 --2- 172.21.15.5:0/259493951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d80727e0 0x7f12d815d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 >> 172.21.15.5:0/259493951 conn(0x7f12d806bd70 msgr2=0x7f12d81506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 shutdown_connections 2023-10-16T13:49:33.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.369+0000 7f12de29f700 1 -- 172.21.15.5:0/259493951 wait complete. 2023-10-16T13:49:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-16T13:49:33.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:49:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.517+0000 7f2acd1a0700 1 Processor -- start 2023-10-16T13:49:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.517+0000 7f2acd1a0700 1 -- start start 2023-10-16T13:49:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2acd1a0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ac80b03d0 0x7f2ac80cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2acd1a0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80b0c30 con 0x7f2ac815de80 2023-10-16T13:49:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2acd1a0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac815f040 con 0x7f2ac806d070 2023-10-16T13:49:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2acd1a0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac815f320 con 0x7f2ac80b03d0 2023-10-16T13:49:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ac80b03d0 0x7f2ac80cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ac80b03d0 0x7f2ac80cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50484/0 (socket says 172.21.15.5:50484) 2023-10-16T13:49:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac659c700 1 -- 172.21.15.5:0/1725743391 learned_addr learned my addr 172.21.15.5:0/1725743391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac6d9d700 1 --1- 172.21.15.5:0/1725743391 >> v1:172.21.15.5:6789/0 conn(0x7f2ac815de80 0x7f2ac806c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60486/0 (socket says 172.21.15.5:60486) 2023-10-16T13:49:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac659c700 1 -- 172.21.15.5:0/1725743391 >> v1:172.21.15.112:6789/0 conn(0x7f2ac806d070 legacy=0x7f2ac80cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac659c700 1 -- 172.21.15.5:0/1725743391 >> v1:172.21.15.5:6789/0 conn(0x7f2ac815de80 legacy=0x7f2ac806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac659c700 1 -- 172.21.15.5:0/1725743391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac806c160 con 0x7f2ac80b03d0 2023-10-16T13:49:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.518+0000 7f2ac5d9b700 1 -- 172.21.15.5:0/1725743391 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360027632 0 0) 0x7f2ac80b0c30 con 0x7f2ac815de80 2023-10-16T13:49:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2ac659c700 1 --2- 172.21.15.5:0/1725743391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac80b03d0 0x7f2ac80cbbe0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098f0 tx=0x7f2abc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb87b16325030568 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2ac5d9b700 1 -- 172.21.15.5:0/1725743391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc004230 con 0x7f2ac80b03d0 2023-10-16T13:49:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2ac5d9b700 1 -- 172.21.15.5:0/1725743391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc004390 con 0x7f2ac80b03d0 2023-10-16T13:49:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2ac5d9b700 1 -- 172.21.15.5:0/1725743391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0036a0 con 0x7f2ac80b03d0 2023-10-16T13:49:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 -- 172.21.15.5:0/1725743391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac80b03d0 msgr2=0x7f2ac80cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/1725743391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac80b03d0 0x7f2ac80cbbe0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098f0 tx=0x7f2abc009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 -- 172.21.15.5:0/1725743391 shutdown_connections 2023-10-16T13:49:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/1725743391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac80b03d0 0x7f2ac80cbbe0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 -- 172.21.15.5:0/1725743391 >> 172.21.15.5:0/1725743391 conn(0x7f2ac80d1590 msgr2=0x7f2ac80d1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 -- 172.21.15.5:0/1725743391 shutdown_connections 2023-10-16T13:49:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.519+0000 7f2acd1a0700 1 -- 172.21.15.5:0/1725743391 wait complete. 2023-10-16T13:49:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.521+0000 7f2acd1a0700 1 Processor -- start 2023-10-16T13:49:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.521+0000 7f2acd1a0700 1 -- start start 2023-10-16T13:49:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2acd1a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 0x7f2ac8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2acd1a0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ac80b03d0 0x7f2ac8158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2acd1a0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ac815de80 0x7f2ac80c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2acd1a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8158ed0 con 0x7f2ac806d070 2023-10-16T13:49:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2acd1a0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80c6080 con 0x7f2ac80b03d0 2023-10-16T13:49:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2acd1a0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8159100 con 0x7f2ac815de80 2023-10-16T13:49:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2ac6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 0x7f2ac8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2ac6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 0x7f2ac8157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50488/0 (socket says 172.21.15.5:50488) 2023-10-16T13:49:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.522+0000 7f2ac6d9d700 1 -- 172.21.15.5:0/963945874 learned_addr learned my addr 172.21.15.5:0/963945874 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac659c700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ac80b03d0 0x7f2ac8158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac759e700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ac815de80 0x7f2ac80c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac6d9d700 1 -- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ac815de80 msgr2=0x7f2ac80c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac6d9d700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ac815de80 0x7f2ac80c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac6d9d700 1 -- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ac80b03d0 msgr2=0x7f2ac8158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac6d9d700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ac80b03d0 0x7f2ac8158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac6d9d700 1 -- 172.21.15.5:0/963945874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009550 con 0x7f2ac806d070 2023-10-16T13:49:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac659c700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ac80b03d0 0x7f2ac8158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2ac6d9d700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 0x7f2ac8157db0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c520 tx=0x7f2ab800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8004c80 con 0x7f2ac806d070 2023-10-16T13:49:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8004e00 con 0x7f2ac806d070 2023-10-16T13:49:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac81593e0 con 0x7f2ac806d070 2023-10-16T13:49:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8007310 con 0x7f2ac806d070 2023-10-16T13:49:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.523+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac81599a0 con 0x7f2ac806d070 2023-10-16T13:49:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.524+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac8067d20 con 0x7f2ac806d070 2023-10-16T13:49:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.525+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2ab8007470 con 0x7f2ac806d070 2023-10-16T13:49:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.526+0000 7f2aaf7fe700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ab406b2f0 0x7f2ab406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.526+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2ab8089e70 con 0x7f2ac806d070 2023-10-16T13:49:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.526+0000 7f2ac659c700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ab406b2f0 0x7f2ab406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.526+0000 7f2ac659c700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ab406b2f0 0x7f2ab406d7b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098f0 tx=0x7f2abc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.530+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ab8054bf0 con 0x7f2ac806d070 2023-10-16T13:49:33.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:33.729+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2ac80b0c50 con 0x7f2ac806d070 2023-10-16T13:49:34.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.373+0000 7f2aaf7fe700 1 -- 172.21.15.5:0/963945874 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v133) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2ab8058210 con 0x7f2ac806d070 2023-10-16T13:49:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.377+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ab406b2f0 msgr2=0x7f2ab406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.377+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ab406b2f0 0x7f2ab406d7b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098f0 tx=0x7f2abc008030 comp rx=0 tx=0).stop 2023-10-16T13:49:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.377+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 msgr2=0x7f2ac8157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.377+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 0x7f2ac8157db0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c520 tx=0x7f2ab800c8e0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 shutdown_connections 2023-10-16T13:49:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2ab406b2f0 0x7f2ab406d7b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ac815de80 0x7f2ac80c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac806d070 0x7f2ac8157db0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 --2- 172.21.15.5:0/963945874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ac80b03d0 0x7f2ac8158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 >> 172.21.15.5:0/963945874 conn(0x7f2ac80d1590 msgr2=0x7f2ac806c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 shutdown_connections 2023-10-16T13:49:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.378+0000 7f2acd1a0700 1 -- 172.21.15.5:0/963945874 wait complete. 2023-10-16T13:49:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-16T13:49:34.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:49:34.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.537+0000 7f5937ab2700 1 Processor -- start 2023-10-16T13:49:34.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.537+0000 7f5937ab2700 1 -- start start 2023-10-16T13:49:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.538+0000 7f5937ab2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59300cd950 0x7f593015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.538+0000 7f5937ab2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300cf290 con 0x7f593006a840 2023-10-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.538+0000 7f5937ab2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300b2d60 con 0x7f59300cede0 2023-10-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.538+0000 7f5937ab2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59301619a0 con 0x7f59300cd950 2023-10-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.538+0000 7f593604f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f593006a840 0x7f5930161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60504/0 (socket says 172.21.15.5:60504) 2023-10-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.538+0000 7f593604f700 1 -- 172.21.15.5:0/4128003159 learned_addr learned my addr 172.21.15.5:0/4128003159 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593584e700 1 --2- 172.21.15.5:0/4128003159 >> v2:172.21.15.112:3300/0 conn(0x7f59300cd950 0x7f593015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939363409 0 0) 0x7f59300cf290 con 0x7f593006a840 2023-10-16T13:49:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c0035b0 con 0x7f593006a840 2023-10-16T13:49:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296195156 0 0) 0x7f59300b2d60 con 0x7f59300cede0 2023-10-16T13:49:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59300cf290 con 0x7f59300cede0 2023-10-16T13:49:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3269944480 0 0) 0x7f591c0035b0 con 0x7f593006a840 2023-10-16T13:49:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 >> v2:172.21.15.112:3300/0 conn(0x7f59300cd950 msgr2=0x7f593015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 --2- 172.21.15.5:0/4128003159 >> v2:172.21.15.112:3300/0 conn(0x7f59300cd950 0x7f593015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 >> v1:172.21.15.112:6789/0 conn(0x7f59300cede0 legacy=0x7f593015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300cdd30 con 0x7f593006a840 2023-10-16T13:49:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f59280019f0 con 0x7f593006a840 2023-10-16T13:49:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 >> v1:172.21.15.5:6789/0 conn(0x7f593006a840 legacy=0x7f5930161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f591c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c004850 0x7f591c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c005210 0x7f591c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301619a0 con 0x7f591c003b90 2023-10-16T13:49:34.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c00c090 con 0x7f591c004850 2023-10-16T13:49:34.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c00c250 con 0x7f591c005210 2023-10-16T13:49:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593584e700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f591c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593504d700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c004850 0x7f591c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.539+0000 7f593604f700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c005210 0x7f591c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593584e700 1 -- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c005210 msgr2=0x7f591c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593584e700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c005210 0x7f591c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593584e700 1 -- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c004850 msgr2=0x7f591c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593584e700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c004850 0x7f591c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593604f700 1 -- 172.21.15.5:0/4128003159 reap_dead start 2023-10-16T13:49:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593584e700 1 -- 172.21.15.5:0/4128003159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c0035b0 con 0x7f591c003b90 2023-10-16T13:49:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593584e700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f591c003f90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5920009b60 tx=0x7f591c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc46ebff3771565 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000e6c0 con 0x7f591c003b90 2023-10-16T13:49:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000e820 con 0x7f591c003b90 2023-10-16T13:49:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f593484c700 1 -- 172.21.15.5:0/4128003159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000eb90 con 0x7f591c003b90 2023-10-16T13:49:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f5937ab2700 1 -- 172.21.15.5:0/4128003159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 msgr2=0x7f591c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f5937ab2700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f591c003f90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5920009b60 tx=0x7f591c005880 comp rx=0 tx=0).stop 2023-10-16T13:49:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f5937ab2700 1 -- 172.21.15.5:0/4128003159 shutdown_connections 2023-10-16T13:49:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f5937ab2700 1 --2- 172.21.15.5:0/4128003159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f591c003f90 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.540+0000 7f5937ab2700 1 -- 172.21.15.5:0/4128003159 >> 172.21.15.5:0/4128003159 conn(0x7f593006dae0 msgr2=0x7f593006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.541+0000 7f5937ab2700 1 -- 172.21.15.5:0/4128003159 shutdown_connections 2023-10-16T13:49:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.541+0000 7f5937ab2700 1 -- 172.21.15.5:0/4128003159 wait complete. 2023-10-16T13:49:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.542+0000 7f5937ab2700 1 Processor -- start 2023-10-16T13:49:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.542+0000 7f5937ab2700 1 -- start start 2023-10-16T13:49:34.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f5930151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59300aee80 0x7f59300cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59300af300 0x7f59300cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b6190 con 0x7f591c003b90 2023-10-16T13:49:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301528a0 con 0x7f59300af300 2023-10-16T13:49:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b30f0 con 0x7f59300aee80 2023-10-16T13:49:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f5930151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f5930151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50508/0 (socket says 172.21.15.5:50508) 2023-10-16T13:49:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 -- 172.21.15.5:0/1971537264 learned_addr learned my addr 172.21.15.5:0/1971537264 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593604f700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59300af300 0x7f59300cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593504d700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59300aee80 0x7f59300cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 -- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59300aee80 msgr2=0x7f59300cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59300aee80 0x7f59300cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 -- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59300af300 msgr2=0x7f59300cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59300af300 0x7f59300cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 -- 172.21.15.5:0/1971537264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930151c90 con 0x7f591c003b90 2023-10-16T13:49:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f593584e700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f5930151530 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f592000e4b0 tx=0x7f59200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000e6c0 con 0x7f591c003b90 2023-10-16T13:49:34.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920003ad0 con 0x7f591c003b90 2023-10-16T13:49:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5930151f70 con 0x7f591c003b90 2023-10-16T13:49:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920003e80 con 0x7f591c003b90 2023-10-16T13:49:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.543+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930152530 con 0x7f591c003b90 2023-10-16T13:49:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.544+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59301526c0 con 0x7f591c003b90 2023-10-16T13:49:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.545+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5920013470 con 0x7f591c003b90 2023-10-16T13:49:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.545+0000 7f59267fc700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f591406b320 0x7f591406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.545+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f592008bac0 con 0x7f591c003b90 2023-10-16T13:49:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.546+0000 7f593504d700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f591406b320 0x7f591406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.546+0000 7f593504d700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f591406b320 0x7f591406d7e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f59300ca320 tx=0x7f592c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:34.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.550+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5920056780 con 0x7f591c003b90 2023-10-16T13:49:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:34.793+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5930067d20 con 0x7f591c003b90 2023-10-16T13:49:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.394+0000 7f59267fc700 1 -- 172.21.15.5:0/1971537264 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v94) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5920059da0 con 0x7f591c003b90 2023-10-16T13:49:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f591406b320 msgr2=0x7f591406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f591406b320 0x7f591406d7e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f59300ca320 tx=0x7f592c009040 comp rx=0 tx=0).stop 2023-10-16T13:49:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 msgr2=0x7f5930151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f5930151530 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f592000e4b0 tx=0x7f59200047c0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 shutdown_connections 2023-10-16T13:49:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59300af300 0x7f59300cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c003b90 0x7f5930151530 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f591406b320 0x7f591406d7e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 --2- 172.21.15.5:0/1971537264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59300aee80 0x7f59300cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.403+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 >> 172.21.15.5:0/1971537264 conn(0x7f593006dae0 msgr2=0x7f5930160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.405+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 shutdown_connections 2023-10-16T13:49:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.406+0000 7f5937ab2700 1 -- 172.21.15.5:0/1971537264 wait complete. 2023-10-16T13:49:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 24 and data pool 25 2023-10-16T13:49:35.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:35.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.556+0000 7fa2924c4700 1 Processor -- start 2023-10-16T13:49:35.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.556+0000 7fa2924c4700 1 -- start start 2023-10-16T13:49:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.556+0000 7fa2924c4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 0x7fa28c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.556+0000 7fa2924c4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0b2d60 con 0x7fa28c0cd950 2023-10-16T13:49:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.556+0000 7fa2924c4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0cdd30 con 0x7fa28c15e2f0 2023-10-16T13:49:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.556+0000 7fa2924c4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1619a0 con 0x7fa28c06af50 2023-10-16T13:49:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa28c0cd950 0x7fa28c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60520/0 (socket says 172.21.15.5:60520) 2023-10-16T13:49:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28bfff700 1 -- 172.21.15.5:0/197399095 learned_addr learned my addr 172.21.15.5:0/197399095 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa290a61700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 0x7fa28c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51859321 0 0) 0x7fa28c0b2d60 con 0x7fa28c0cd950 2023-10-16T13:49:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2740035b0 con 0x7fa28c0cd950 2023-10-16T13:49:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829147436 0 0) 0x7fa2740035b0 con 0x7fa28c0cd950 2023-10-16T13:49:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 msgr2=0x7fa28c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 0x7fa28c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 >> v1:172.21.15.112:6789/0 conn(0x7fa28c15e2f0 legacy=0x7fa28c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c15e920 con 0x7fa28c0cd950 2023-10-16T13:49:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fa27c001670 con 0x7fa28c0cd950 2023-10-16T13:49:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 >> v1:172.21.15.5:6789/0 conn(0x7fa28c0cd950 legacy=0x7fa28c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa274003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2740043e0 0x7fa2740048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 0x7fa274005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1619a0 con 0x7fa274003a30 2023-10-16T13:49:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27400ba40 con 0x7fa2740043e0 2023-10-16T13:49:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27400bc00 con 0x7fa28c06af50 2023-10-16T13:49:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.557+0000 7fa28bfff700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa274003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa290a61700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 0x7fa274005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28b7fe700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2740043e0 0x7fa2740048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28bfff700 1 -- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 msgr2=0x7fa274005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28bfff700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c06af50 0x7fa274005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28bfff700 1 -- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2740043e0 msgr2=0x7fa2740048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28bfff700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2740043e0 0x7fa2740048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28bfff700 1 -- 172.21.15.5:0/197399095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740035b0 con 0x7fa274003a30 2023-10-16T13:49:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28b7fe700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2740043e0 0x7fa2740048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28bfff700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa274003e10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c2f0 tx=0x7fa274005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e095526d545e253 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00ce30 con 0x7fa274003a30 2023-10-16T13:49:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c005960 con 0x7fa274003a30 2023-10-16T13:49:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa28affd700 1 -- 172.21.15.5:0/197399095 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c005cf0 con 0x7fa274003a30 2023-10-16T13:49:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa2924c4700 1 -- 172.21.15.5:0/197399095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 msgr2=0x7fa274003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa2924c4700 1 --2- 172.21.15.5:0/197399095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa274003e10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c2f0 tx=0x7fa274005880 comp rx=0 tx=0).stop 2023-10-16T13:49:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.558+0000 7fa290a61700 1 -- 172.21.15.5:0/197399095 reap_dead start 2023-10-16T13:49:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.559+0000 7fa2924c4700 1 -- 172.21.15.5:0/197399095 shutdown_connections 2023-10-16T13:49:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.559+0000 7fa2924c4700 1 -- 172.21.15.5:0/197399095 >> 172.21.15.5:0/197399095 conn(0x7fa28c06dae0 msgr2=0x7fa28c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.559+0000 7fa2924c4700 1 -- 172.21.15.5:0/197399095 shutdown_connections 2023-10-16T13:49:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.559+0000 7fa2924c4700 1 -- 172.21.15.5:0/197399095 wait complete. 2023-10-16T13:49:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.560+0000 7fa2924c4700 1 Processor -- start 2023-10-16T13:49:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.560+0000 7fa2924c4700 1 -- start start 2023-10-16T13:49:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa2924c4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa28c0af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa2924c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa28c0c9c40 0x7fa28c0ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa2924c4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c0c8920 0x7fa28c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa2924c4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0af760 con 0x7fa274003a30 2023-10-16T13:49:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa2924c4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0ad980 con 0x7fa28c0c9c40 2023-10-16T13:49:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa2924c4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0adc60 con 0x7fa28c0c8920 2023-10-16T13:49:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa28c0af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa28c0af160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50530/0 (socket says 172.21.15.5:50530) 2023-10-16T13:49:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 -- 172.21.15.5:0/2721446608 learned_addr learned my addr 172.21.15.5:0/2721446608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa290a61700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c0c8920 0x7fa28c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28b7fe700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa28c0c9c40 0x7fa28c0ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 -- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c0c8920 msgr2=0x7fa28c15ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c0c8920 0x7fa28c15ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 -- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa28c0c9c40 msgr2=0x7fa28c0ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa28c0c9c40 0x7fa28c0ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 -- 172.21.15.5:0/2721446608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0adf40 con 0x7fa274003a30 2023-10-16T13:49:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.561+0000 7fa28bfff700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa28c0af160 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa27400ba10 tx=0x7fa27c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.562+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c001660 con 0x7fa274003a30 2023-10-16T13:49:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.562+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c004a80 con 0x7fa274003a30 2023-10-16T13:49:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.562+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c0ae220 con 0x7fa274003a30 2023-10-16T13:49:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.562+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c004e30 con 0x7fa274003a30 2023-10-16T13:49:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.562+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0ca0c0 con 0x7fa274003a30 2023-10-16T13:49:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.562+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c0ca2b0 con 0x7fa274003a30 2023-10-16T13:49:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.563+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fa27c0070d0 con 0x7fa274003a30 2023-10-16T13:49:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.563+0000 7fa288ff9700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa27806b2f0 0x7fa27806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.563+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa27c08b370 con 0x7fa274003a30 2023-10-16T13:49:35.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.564+0000 7fa28b7fe700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa27806b2f0 0x7fa27806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.564+0000 7fa28b7fe700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa27806b2f0 0x7fa27806d7b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa280001730 tx=0x7fa280009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:35.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.568+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa28c0ca2b0 con 0x7fa274003a30 2023-10-16T13:49:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.772+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa28c0ca2b0 con 0x7fa274003a30 2023-10-16T13:49:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.773+0000 7fa288ff9700 1 -- 172.21.15.5:0/2721446608 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16520 (secure 0 0 0) 0x7fa28c0ca2b0 con 0x7fa274003a30 2023-10-16T13:49:35.776 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:35.776 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":134,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:34.794549+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa27806b2f0 msgr2=0x7fa27806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa27806b2f0 0x7fa27806d7b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa280001730 tx=0x7fa280009040 comp rx=0 tx=0).stop 2023-10-16T13:49:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 msgr2=0x7fa28c0af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa28c0af160 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa27400ba10 tx=0x7fa27c001a00 comp rx=0 tx=0).stop 2023-10-16T13:49:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 shutdown_connections 2023-10-16T13:49:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa27806b2f0 0x7fa27806d7b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa28c0c8920 0x7fa28c15ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa274003a30 0x7fa28c0af160 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 --2- 172.21.15.5:0/2721446608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa28c0c9c40 0x7fa28c0ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 >> 172.21.15.5:0/2721446608 conn(0x7fa28c06dae0 msgr2=0x7fa28c0cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 shutdown_connections 2023-10-16T13:49:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.775+0000 7fa2924c4700 1 -- 172.21.15.5:0/2721446608 wait complete. 2023-10-16T13:49:35.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.913+0000 7fa26fa25700 1 Processor -- start 2023-10-16T13:49:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.913+0000 7fa26fa25700 1 -- start start 2023-10-16T13:49:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26fa25700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa2680cf8a0 0x7fa2680d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26fa25700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26815ee90 con 0x7fa26815eab0 2023-10-16T13:49:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26fa25700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa268158370 con 0x7fa2680d1bc0 2023-10-16T13:49:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26fa25700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680d23b0 con 0x7fa2680cf8a0 2023-10-16T13:49:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26d7c1700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa26815eab0 0x7fa2680cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60540/0 (socket says 172.21.15.5:60540) 2023-10-16T13:49:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26d7c1700 1 -- 172.21.15.5:0/707869242 learned_addr learned my addr 172.21.15.5:0/707869242 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26cfc0700 1 --2- 172.21.15.5:0/707869242 >> v2:172.21.15.112:3300/0 conn(0x7fa2680cf8a0 0x7fa2680d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907166308 0 0) 0x7fa26815ee90 con 0x7fa26815eab0 2023-10-16T13:49:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2540035b0 con 0x7fa26815eab0 2023-10-16T13:49:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439491570 0 0) 0x7fa268158370 con 0x7fa2680d1bc0 2023-10-16T13:49:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26815ee90 con 0x7fa2680d1bc0 2023-10-16T13:49:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26cfc0700 1 -- 172.21.15.5:0/707869242 >> v1:172.21.15.112:6789/0 conn(0x7fa2680d1bc0 legacy=0x7fa2680cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472960828 0 0) 0x7fa2540035b0 con 0x7fa26815eab0 2023-10-16T13:49:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26cfc0700 1 -- 172.21.15.5:0/707869242 >> v1:172.21.15.5:6789/0 conn(0x7fa26815eab0 legacy=0x7fa2680cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.914+0000 7fa26cfc0700 1 -- 172.21.15.5:0/707869242 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680cda20 con 0x7fa2680cf8a0 2023-10-16T13:49:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26cfc0700 1 --2- 172.21.15.5:0/707869242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680cf8a0 0x7fa2680d1680 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa264009840 tx=0x7fa264009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d887448b4f30a16b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258001670 con 0x7fa2680cf8a0 2023-10-16T13:49:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264004030 con 0x7fa2680cf8a0 2023-10-16T13:49:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa25ffff700 1 -- 172.21.15.5:0/707869242 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640043c0 con 0x7fa2680cf8a0 2023-10-16T13:49:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 -- 172.21.15.5:0/707869242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680cf8a0 msgr2=0x7fa2680d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 --2- 172.21.15.5:0/707869242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680cf8a0 0x7fa2680d1680 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa264009840 tx=0x7fa264009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 -- 172.21.15.5:0/707869242 shutdown_connections 2023-10-16T13:49:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 --2- 172.21.15.5:0/707869242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680cf8a0 0x7fa2680d1680 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 -- 172.21.15.5:0/707869242 >> 172.21.15.5:0/707869242 conn(0x7fa2680665a0 msgr2=0x7fa268066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 -- 172.21.15.5:0/707869242 shutdown_connections 2023-10-16T13:49:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.915+0000 7fa26fa25700 1 -- 172.21.15.5:0/707869242 wait complete. 2023-10-16T13:49:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 Processor -- start 2023-10-16T13:49:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 -- start start 2023-10-16T13:49:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 0x7fa2681476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680d1bc0 0x7fa2680ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa26815eab0 0x7fa2680ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268147c00 con 0x7fa2680cf8a0 2023-10-16T13:49:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268162100 con 0x7fa2680d1bc0 2023-10-16T13:49:35.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26fa25700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268161860 con 0x7fa26815eab0 2023-10-16T13:49:35.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26d7c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 0x7fa2681476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26d7c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 0x7fa2681476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50542/0 (socket says 172.21.15.5:50542) 2023-10-16T13:49:35.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.917+0000 7fa26d7c1700 1 -- 172.21.15.5:0/2351257173 learned_addr learned my addr 172.21.15.5:0/2351257173 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:35.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26dfc2700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa26815eab0 0x7fa2680ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26cfc0700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680d1bc0 0x7fa2680ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26d7c1700 1 -- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa26815eab0 msgr2=0x7fa2680ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26d7c1700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa26815eab0 0x7fa2680ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26d7c1700 1 -- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680d1bc0 msgr2=0x7fa2680ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26d7c1700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680d1bc0 0x7fa2680ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26d7c1700 1 -- 172.21.15.5:0/2351257173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640094a0 con 0x7fa2680cf8a0 2023-10-16T13:49:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26dfc2700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa26815eab0 0x7fa2680ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26cfc0700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680d1bc0 0x7fa2680ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26d7c1700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 0x7fa2681476c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c700 tx=0x7fa25800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258004c80 con 0x7fa2680cf8a0 2023-10-16T13:49:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258004de0 con 0x7fa2680cf8a0 2023-10-16T13:49:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa268161b40 con 0x7fa2680cf8a0 2023-10-16T13:49:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258007310 con 0x7fa2680cf8a0 2023-10-16T13:49:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.918+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680b42d0 con 0x7fa2680cf8a0 2023-10-16T13:49:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.919+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2680b7540 con 0x7fa2680cf8a0 2023-10-16T13:49:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.920+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fa258007470 con 0x7fa2680cf8a0 2023-10-16T13:49:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.920+0000 7fa25dffb700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa24c06b2f0 0x7fa24c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.920+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa258089af0 con 0x7fa2680cf8a0 2023-10-16T13:49:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.920+0000 7fa26cfc0700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa24c06b2f0 0x7fa24c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.921+0000 7fa26cfc0700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa24c06b2f0 0x7fa24c06d7b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa2680caf60 tx=0x7fa264008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:35.925+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa258054650 con 0x7fa2680cf8a0 2023-10-16T13:49:36.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.127+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2680b3d70 con 0x7fa2680cf8a0 2023-10-16T13:49:36.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.128+0000 7fa25dffb700 1 -- 172.21.15.5:0/2351257173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16520 (secure 0 0 0) 0x7fa258057c70 con 0x7fa2680cf8a0 2023-10-16T13:49:36.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:36.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":134,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:34.794549+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa24c06b2f0 msgr2=0x7fa24c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa24c06b2f0 0x7fa24c06d7b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa2680caf60 tx=0x7fa264008030 comp rx=0 tx=0).stop 2023-10-16T13:49:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 msgr2=0x7fa2681476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 0x7fa2681476c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c700 tx=0x7fa25800cac0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 shutdown_connections 2023-10-16T13:49:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa24c06b2f0 0x7fa24c06d7b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa26815eab0 0x7fa2680ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2680cf8a0 0x7fa2681476c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 --2- 172.21.15.5:0/2351257173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2680d1bc0 0x7fa2680ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 >> 172.21.15.5:0/2351257173 conn(0x7fa2680665a0 msgr2=0x7fa2680b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 shutdown_connections 2023-10-16T13:49:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.130+0000 7fa26fa25700 1 -- 172.21.15.5:0/2351257173 wait complete. 2023-10-16T13:49:36.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:49:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.271+0000 7f7196d9b700 1 Processor -- start 2023-10-16T13:49:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.271+0000 7f7196d9b700 1 -- start start 2023-10-16T13:49:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7196d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f719006ef20 0x7f71900cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7196d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71900ce0b0 0x7f719006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7196d9b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719015bf30 con 0x7f719015bb50 2023-10-16T13:49:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7196d9b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71900ce540 con 0x7f71900ce0b0 2023-10-16T13:49:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7196d9b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71900b2d70 con 0x7f719006ef20 2023-10-16T13:49:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71900ce0b0 0x7f719006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71900ce0b0 0x7f719006a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50554/0 (socket says 172.21.15.5:50554) 2023-10-16T13:49:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 -- 172.21.15.5:0/3126311409 learned_addr learned my addr 172.21.15.5:0/3126311409 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:36.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f718ffff700 1 --2- 172.21.15.5:0/3126311409 >> v2:172.21.15.112:3300/0 conn(0x7f719006ef20 0x7f71900cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:36.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 -- 172.21.15.5:0/3126311409 >> v2:172.21.15.112:3300/0 conn(0x7f719006ef20 msgr2=0x7f71900cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:36.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 --2- 172.21.15.5:0/3126311409 >> v2:172.21.15.112:3300/0 conn(0x7f719006ef20 0x7f71900cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 -- 172.21.15.5:0/3126311409 >> v1:172.21.15.112:6789/0 conn(0x7f719015bb50 legacy=0x7f719006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:36.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 -- 172.21.15.5:0/3126311409 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719006d500 con 0x7f71900ce0b0 2023-10-16T13:49:36.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f7195338700 1 --2- 172.21.15.5:0/3126311409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f719006a840 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f7190070e90 tx=0x7f718800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5134613546e3d3dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:36.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f718f7fe700 1 -- 172.21.15.5:0/3126311409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800e070 con 0x7f71900ce0b0 2023-10-16T13:49:36.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f718f7fe700 1 -- 172.21.15.5:0/3126311409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188003a20 con 0x7f71900ce0b0 2023-10-16T13:49:36.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.272+0000 7f718f7fe700 1 -- 172.21.15.5:0/3126311409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188003dd0 con 0x7f71900ce0b0 2023-10-16T13:49:36.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 -- 172.21.15.5:0/3126311409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 msgr2=0x7f719006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:36.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 --2- 172.21.15.5:0/3126311409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f719006a840 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f7190070e90 tx=0x7f718800b330 comp rx=0 tx=0).stop 2023-10-16T13:49:36.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 -- 172.21.15.5:0/3126311409 shutdown_connections 2023-10-16T13:49:36.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 --2- 172.21.15.5:0/3126311409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f719006a840 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 --2- 172.21.15.5:0/3126311409 >> v2:172.21.15.112:3300/0 conn(0x7f719006ef20 0x7f71900cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 -- 172.21.15.5:0/3126311409 >> 172.21.15.5:0/3126311409 conn(0x7f71900cc6f0 msgr2=0x7f71900ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:36.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 -- 172.21.15.5:0/3126311409 shutdown_connections 2023-10-16T13:49:36.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.273+0000 7f7196d9b700 1 -- 172.21.15.5:0/3126311409 wait complete. 2023-10-16T13:49:36.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.274+0000 7f7196d9b700 1 Processor -- start 2023-10-16T13:49:36.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.274+0000 7f7196d9b700 1 -- start start 2023-10-16T13:49:36.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7196d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719006ef20 0x7f71901f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:36.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7196d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f7190154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:36.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7196d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f719015bb50 0x7f7190152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7196d9b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901f3010 con 0x7f71900ce0b0 2023-10-16T13:49:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7196d9b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71900c8920 con 0x7f719006ef20 2023-10-16T13:49:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7196d9b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71900c8c00 con 0x7f719015bb50 2023-10-16T13:49:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f718ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f7190154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:36.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f718ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f7190154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50558/0 (socket says 172.21.15.5:50558) 2023-10-16T13:49:36.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f718ffff700 1 -- 172.21.15.5:0/1723649112 learned_addr learned my addr 172.21.15.5:0/1723649112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:36.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.275+0000 7f7194b37700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719006ef20 0x7f71901f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:36.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f7195338700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f719015bb50 0x7f7190152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:36.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718ffff700 1 -- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f719015bb50 msgr2=0x7f7190152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:36.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718ffff700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f719015bb50 0x7f7190152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718ffff700 1 -- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719006ef20 msgr2=0x7f71901f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718ffff700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719006ef20 0x7f71901f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718ffff700 1 -- 172.21.15.5:0/1723649112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009b30 con 0x7f71900ce0b0 2023-10-16T13:49:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f7194b37700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719006ef20 0x7f71901f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:36.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f7195338700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f719015bb50 0x7f7190152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718ffff700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f7190154800 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f717c00e810 tx=0x7f717c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c013610 con 0x7f71900ce0b0 2023-10-16T13:49:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c013770 con 0x7f71900ce0b0 2023-10-16T13:49:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71900c8ee0 con 0x7f71900ce0b0 2023-10-16T13:49:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c013b20 con 0x7f71900ce0b0 2023-10-16T13:49:36.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.276+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71900c94a0 con 0x7f71900ce0b0 2023-10-16T13:49:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.277+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190067d20 con 0x7f71900ce0b0 2023-10-16T13:49:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.277+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f717c013c80 con 0x7f71900ce0b0 2023-10-16T13:49:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.278+0000 7f718d7fa700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f717406b2f0 0x7f717406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.278+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f717c089bc0 con 0x7f71900ce0b0 2023-10-16T13:49:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.278+0000 7f7194b37700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f717406b2f0 0x7f717406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:36.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.279+0000 7f7194b37700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f717406b2f0 0x7f717406d7b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7184009930 tx=0x7f7184008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:36.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.283+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f717c054550 con 0x7f71900ce0b0 2023-10-16T13:49:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:36.536+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f71900668b0 con 0x7f71900ce0b0 2023-10-16T13:49:37.361 INFO:tasks.ceph.mds.d.smithi112.stderr:2023-10-16T13:49:37.359+0000 7fc10dd77700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:37.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.406+0000 7f718d7fa700 1 -- 172.21.15.5:0/1723649112 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) v1 ==== 118+0+0 (secure 0 0 0) 0x7f717c057b70 con 0x7f71900ce0b0 2023-10-16T13:49:37.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f717406b2f0 msgr2=0x7f717406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:37.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f717406b2f0 0x7f717406d7b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7184009930 tx=0x7f7184008040 comp rx=0 tx=0).stop 2023-10-16T13:49:37.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 msgr2=0x7f7190154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:37.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f7190154800 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f717c00e810 tx=0x7f717c00ebd0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 shutdown_connections 2023-10-16T13:49:37.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f717406b2f0 0x7f717406d7b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f719015bb50 0x7f7190152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719006ef20 0x7f71901f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 --2- 172.21.15.5:0/1723649112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71900ce0b0 0x7f7190154800 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 >> 172.21.15.5:0/1723649112 conn(0x7f71900cc6f0 msgr2=0x7f719015cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 shutdown_connections 2023-10-16T13:49:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.409+0000 7f7196d9b700 1 -- 172.21.15.5:0/1723649112 wait complete. 2023-10-16T13:49:37.427 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:49:37.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:49:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.560+0000 7f311b404700 1 Processor -- start 2023-10-16T13:49:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.561+0000 7f311b404700 1 -- start start 2023-10-16T13:49:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.561+0000 7f311b404700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f311415e2f0 0x7f31140cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.561+0000 7f311b404700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31140b2d60 con 0x7f31140cd950 2023-10-16T13:49:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.561+0000 7f311b404700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31140cdd30 con 0x7f311406a840 2023-10-16T13:49:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.561+0000 7f311b404700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31141619a0 con 0x7f311415e2f0 2023-10-16T13:49:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f311899f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f311415e2f0 0x7f31140cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f31191a0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f31140cd950 0x7f311415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60568/0 (socket says 172.21.15.5:60568) 2023-10-16T13:49:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f31191a0700 1 -- 172.21.15.5:0/768498869 learned_addr learned my addr 172.21.15.5:0/768498869 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f311899f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f311415e2f0 0x7f31140cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50566/0 (socket says 172.21.15.5:50566) 2023-10-16T13:49:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f311899f700 1 -- 172.21.15.5:0/768498869 >> v1:172.21.15.112:6789/0 conn(0x7f311406a840 legacy=0x7f311406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f311899f700 1 -- 172.21.15.5:0/768498869 >> v1:172.21.15.5:6789/0 conn(0x7f31140cd950 legacy=0x7f311415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f311899f700 1 -- 172.21.15.5:0/768498869 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311415e920 con 0x7f311415e2f0 2023-10-16T13:49:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f311899f700 1 --2- 172.21.15.5:0/768498869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311415e2f0 0x7f31140cede0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f3108009820 tx=0x7f3108009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8785887681706c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f3107fff700 1 -- 172.21.15.5:0/768498869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108005e30 con 0x7f311415e2f0 2023-10-16T13:49:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f3107fff700 1 -- 172.21.15.5:0/768498869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108004030 con 0x7f311415e2f0 2023-10-16T13:49:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.562+0000 7f3107fff700 1 -- 172.21.15.5:0/768498869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080043e0 con 0x7f311415e2f0 2023-10-16T13:49:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 -- 172.21.15.5:0/768498869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311415e2f0 msgr2=0x7f31140cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 --2- 172.21.15.5:0/768498869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311415e2f0 0x7f31140cede0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f3108009820 tx=0x7f3108009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 -- 172.21.15.5:0/768498869 shutdown_connections 2023-10-16T13:49:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 --2- 172.21.15.5:0/768498869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311415e2f0 0x7f31140cede0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 -- 172.21.15.5:0/768498869 >> 172.21.15.5:0/768498869 conn(0x7f311406dae0 msgr2=0x7f311406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 -- 172.21.15.5:0/768498869 shutdown_connections 2023-10-16T13:49:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.563+0000 7f311b404700 1 -- 172.21.15.5:0/768498869 wait complete. 2023-10-16T13:49:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.564+0000 7f311b404700 1 Processor -- start 2023-10-16T13:49:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.564+0000 7f311b404700 1 -- start start 2023-10-16T13:49:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311b404700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f311406a840 0x7f3114157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311b404700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 0x7f31140c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311b404700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311415e2f0 0x7f31140c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311b404700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b4ad0 con 0x7f31140cd950 2023-10-16T13:49:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311b404700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b5930 con 0x7f311415e2f0 2023-10-16T13:49:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311b404700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3114157fb0 con 0x7f311406a840 2023-10-16T13:49:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 0x7f31140c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 0x7f31140c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50572/0 (socket says 172.21.15.5:50572) 2023-10-16T13:49:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 -- 172.21.15.5:0/4163517941 learned_addr learned my addr 172.21.15.5:0/4163517941 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f31191a0700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f311406a840 0x7f3114157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f31199a1700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311415e2f0 0x7f31140c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 -- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f311406a840 msgr2=0x7f3114157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f311406a840 0x7f3114157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 -- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311415e2f0 msgr2=0x7f31140c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311415e2f0 0x7f31140c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 -- 172.21.15.5:0/4163517941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108009430 con 0x7f31140cd950 2023-10-16T13:49:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f311899f700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 0x7f31140c6520 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f3108009b70 tx=0x7f3108004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:37.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.565+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310801c620 con 0x7f31140cd950 2023-10-16T13:49:37.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.566+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310801c7c0 con 0x7f31140cd950 2023-10-16T13:49:37.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.566+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310801cb70 con 0x7f31140cd950 2023-10-16T13:49:37.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.566+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31140b4d20 con 0x7f31140cd950 2023-10-16T13:49:37.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.566+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31140b52e0 con 0x7f31140cd950 2023-10-16T13:49:37.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.567+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31140b5aa0 con 0x7f31140cd950 2023-10-16T13:49:37.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.567+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f310801ccd0 con 0x7f31140cd950 2023-10-16T13:49:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.568+0000 7f3105ffb700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f30f806b2f0 0x7f30f806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.568+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f310808b120 con 0x7f31140cd950 2023-10-16T13:49:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.568+0000 7f31191a0700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f30f806b2f0 0x7f30f806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.569+0000 7f31191a0700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f30f806b2f0 0x7f30f806d7b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3110005910 tx=0x7f3110009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:37.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.573+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3108055c40 con 0x7f31140cd950 2023-10-16T13:49:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:37.819+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3114067d20 con 0x7f31140cd950 2023-10-16T13:49:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.410+0000 7f3105ffb700 1 -- 172.21.15.5:0/4163517941 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3108059260 con 0x7f31140cd950 2023-10-16T13:49:38.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f30f806b2f0 msgr2=0x7f30f806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f30f806b2f0 0x7f30f806d7b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3110005910 tx=0x7f3110009040 comp rx=0 tx=0).stop 2023-10-16T13:49:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 msgr2=0x7f31140c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 0x7f31140c6520 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f3108009b70 tx=0x7f3108004750 comp rx=0 tx=0).stop 2023-10-16T13:49:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 shutdown_connections 2023-10-16T13:49:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311415e2f0 0x7f31140c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f30f806b2f0 0x7f30f806d7b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f311406a840 0x7f3114157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 --2- 172.21.15.5:0/4163517941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140cd950 0x7f31140c6520 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.413+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 >> 172.21.15.5:0/4163517941 conn(0x7f311406dae0 msgr2=0x7f31140caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.414+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 shutdown_connections 2023-10-16T13:49:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.414+0000 7f311b404700 1 -- 172.21.15.5:0/4163517941 wait complete. 2023-10-16T13:49:38.432 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:49:38.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:38.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.565+0000 7ff1d396a700 1 Processor -- start 2023-10-16T13:49:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.566+0000 7ff1d396a700 1 -- start start 2023-10-16T13:49:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.566+0000 7ff1d396a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15e2f0 0x7ff1cc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.566+0000 7ff1d396a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0b2d60 con 0x7ff1cc0cd950 2023-10-16T13:49:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.566+0000 7ff1d396a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0cdd30 con 0x7ff1cc06a840 2023-10-16T13:49:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.566+0000 7ff1d396a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1619a0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d1706700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1cc0cd950 0x7ff1cc15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60582/0 (socket says 172.21.15.5:60582) 2023-10-16T13:49:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d1706700 1 -- 172.21.15.5:0/1782647777 learned_addr learned my addr 172.21.15.5:0/1782647777 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d0f05700 1 --2- 172.21.15.5:0/1782647777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15e2f0 0x7ff1cc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518186430 0 0) 0x7ff1cc0b2d60 con 0x7ff1cc0cd950 2023-10-16T13:49:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b80035b0 con 0x7ff1cc0cd950 2023-10-16T13:49:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369432060 0 0) 0x7ff1cc0cdd30 con 0x7ff1cc06a840 2023-10-16T13:49:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc0b2d60 con 0x7ff1cc06a840 2023-10-16T13:49:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d0f05700 1 -- 172.21.15.5:0/1782647777 >> v1:172.21.15.112:6789/0 conn(0x7ff1cc06a840 legacy=0x7ff1cc161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d0f05700 1 -- 172.21.15.5:0/1782647777 >> v1:172.21.15.5:6789/0 conn(0x7ff1cc0cd950 legacy=0x7ff1cc15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1079093711 0 0) 0x7ff1b80035b0 con 0x7ff1cc0cd950 2023-10-16T13:49:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d0f05700 1 -- 172.21.15.5:0/1782647777 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc15e920 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.567+0000 7ff1d0f05700 1 --2- 172.21.15.5:0/1782647777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15e2f0 0x7ff1cc0cede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009850 tx=0x7ff1c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dcd68b339f47e9c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0005e30 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0006030 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1bffff700 1 -- 172.21.15.5:0/1782647777 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00063e0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 -- 172.21.15.5:0/1782647777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15e2f0 msgr2=0x7ff1cc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 --2- 172.21.15.5:0/1782647777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15e2f0 0x7ff1cc0cede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009850 tx=0x7ff1c0009b60 comp rx=0 tx=0).stop 2023-10-16T13:49:38.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 -- 172.21.15.5:0/1782647777 shutdown_connections 2023-10-16T13:49:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 --2- 172.21.15.5:0/1782647777 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15e2f0 0x7ff1cc0cede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 -- 172.21.15.5:0/1782647777 >> 172.21.15.5:0/1782647777 conn(0x7ff1cc06dae0 msgr2=0x7ff1cc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 -- 172.21.15.5:0/1782647777 shutdown_connections 2023-10-16T13:49:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.568+0000 7ff1d396a700 1 -- 172.21.15.5:0/1782647777 wait complete. 2023-10-16T13:49:38.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.569+0000 7ff1d396a700 1 Processor -- start 2023-10-16T13:49:38.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.569+0000 7ff1d396a700 1 -- start start 2023-10-16T13:49:38.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d396a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc06a840 0x7ff1cc15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d396a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc0cd950 0x7ff1cc0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d396a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 0x7ff1cc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d396a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cb520 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d396a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c53a0 con 0x7ff1cc0cd950 2023-10-16T13:49:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d396a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cb7e0 con 0x7ff1cc06a840 2023-10-16T13:49:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d1f07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 0x7ff1cc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d1f07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 0x7ff1cc0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50588/0 (socket says 172.21.15.5:50588) 2023-10-16T13:49:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d1f07700 1 -- 172.21.15.5:0/787509775 learned_addr learned my addr 172.21.15.5:0/787509775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d0f05700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc0cd950 0x7ff1cc0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.570+0000 7ff1d1706700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc06a840 0x7ff1cc15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d1f07700 1 -- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc06a840 msgr2=0x7ff1cc15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d1f07700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc06a840 0x7ff1cc15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d1f07700 1 -- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc0cd950 msgr2=0x7ff1cc0adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d1f07700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc0cd950 0x7ff1cc0adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d1f07700 1 -- 172.21.15.5:0/787509775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c0009430 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d1f07700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 0x7ff1cc0c4a90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400cc20 tx=0x7ff1c400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4003c00 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c4003d60 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400aae0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0cbac0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.571+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0ae070 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.572+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0cbfe0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.573+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7ff1c400ac40 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.573+0000 7ff1bdffb700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff1b006b2f0 0x7ff1b006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.573+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1c4089d50 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.573+0000 7ff1d1706700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff1b006b2f0 0x7ff1b006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.574+0000 7ff1d1706700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff1b006b2f0 0x7ff1b006d7b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8000f60 tx=0x7ff1c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:38.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.578+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1cc0cbfe0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.819+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1cc0cbfe0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.820+0000 7ff1bdffb700 1 -- 172.21.15.5:0/787509775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4917 (secure 0 0 0) 0x7ff1cc0cbfe0 con 0x7ff1cc15e2f0 2023-10-16T13:49:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:38.823 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:49:34.794871+0000","modified":"2023-10-16T13:49:37.820862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8229":{"gid":8229,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2779373791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2779373791},{"type":"v1","addr":"172.21.15.112:6837","nonce":2779373791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-10-16T13:49:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff1b006b2f0 msgr2=0x7ff1b006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff1b006b2f0 0x7ff1b006d7b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8000f60 tx=0x7ff1c8009040 comp rx=0 tx=0).stop 2023-10-16T13:49:38.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 msgr2=0x7ff1cc0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 0x7ff1cc0c4a90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400cc20 tx=0x7ff1c400cf30 comp rx=0 tx=0).stop 2023-10-16T13:49:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 shutdown_connections 2023-10-16T13:49:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1cc15e2f0 0x7ff1cc0c4a90 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ff1b006b2f0 0x7ff1b006d7b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc06a840 0x7ff1cc15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 --2- 172.21.15.5:0/787509775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc0cd950 0x7ff1cc0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 >> 172.21.15.5:0/787509775 conn(0x7ff1cc06dae0 msgr2=0x7ff1cc15d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 shutdown_connections 2023-10-16T13:49:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.822+0000 7ff1d396a700 1 -- 172.21.15.5:0/787509775 wait complete. 2023-10-16T13:49:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 98 2023-10-16T13:49:38.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.959+0000 7f28e61bd700 1 Processor -- start 2023-10-16T13:49:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.959+0000 7f28e61bd700 1 -- start start 2023-10-16T13:49:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28e61bd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28e00cd950 0x7f28e015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28e61bd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e006a840 0x7f28e006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28e61bd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e00cf290 con 0x7f28e00cede0 2023-10-16T13:49:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28e61bd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e01619a0 con 0x7f28e00cd950 2023-10-16T13:49:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28e61bd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e006b1f0 con 0x7f28e006a840 2023-10-16T13:49:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28df7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28e00cd950 0x7f28e015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28df7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28e00cd950 0x7f28e015e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50592/0 (socket says 172.21.15.5:50592) 2023-10-16T13:49:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28df7fe700 1 -- 172.21.15.5:0/105225880 learned_addr learned my addr 172.21.15.5:0/105225880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28dffff700 1 --2- 172.21.15.5:0/105225880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e006a840 0x7f28e006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28df7fe700 1 -- 172.21.15.5:0/105225880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e006a840 msgr2=0x7f28e006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.960+0000 7f28df7fe700 1 --2- 172.21.15.5:0/105225880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e006a840 0x7f28e006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28df7fe700 1 -- 172.21.15.5:0/105225880 >> v1:172.21.15.112:6789/0 conn(0x7f28e00cede0 legacy=0x7f28e015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28df7fe700 1 -- 172.21.15.5:0/105225880 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00b2d60 con 0x7f28e00cd950 2023-10-16T13:49:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28df7fe700 1 --2- 172.21.15.5:0/105225880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cd950 0x7f28e015e2f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f28d00098f0 tx=0x7f28d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92e50d11ac10a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28de7fc700 1 -- 172.21.15.5:0/105225880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0004230 con 0x7f28e00cd950 2023-10-16T13:49:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28de7fc700 1 -- 172.21.15.5:0/105225880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0004390 con 0x7f28e00cd950 2023-10-16T13:49:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28de7fc700 1 -- 172.21.15.5:0/105225880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d00036a0 con 0x7f28e00cd950 2023-10-16T13:49:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 -- 172.21.15.5:0/105225880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cd950 msgr2=0x7f28e015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 --2- 172.21.15.5:0/105225880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cd950 0x7f28e015e2f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f28d00098f0 tx=0x7f28d0009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 -- 172.21.15.5:0/105225880 shutdown_connections 2023-10-16T13:49:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 --2- 172.21.15.5:0/105225880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e006a840 0x7f28e006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 --2- 172.21.15.5:0/105225880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cd950 0x7f28e015e2f0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 -- 172.21.15.5:0/105225880 >> 172.21.15.5:0/105225880 conn(0x7f28e006dae0 msgr2=0x7f28e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 -- 172.21.15.5:0/105225880 shutdown_connections 2023-10-16T13:49:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.961+0000 7f28e61bd700 1 -- 172.21.15.5:0/105225880 wait complete. 2023-10-16T13:49:38.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.963+0000 7f28e61bd700 1 Processor -- start 2023-10-16T13:49:38.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.963+0000 7f28e61bd700 1 -- start start 2023-10-16T13:49:38.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28e61bd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28e006a840 0x7f28e00c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28e61bd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e00cd950 0x7f28e014f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28e61bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 0x7f28e014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28e61bd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00b3e30 con 0x7f28e00cede0 2023-10-16T13:49:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28e61bd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00b31b0 con 0x7f28e006a840 2023-10-16T13:49:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28e61bd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00b3490 con 0x7f28e00cd950 2023-10-16T13:49:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 0x7f28e014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 0x7f28e014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50602/0 (socket says 172.21.15.5:50602) 2023-10-16T13:49:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.964+0000 7f28dffff700 1 -- 172.21.15.5:0/295894717 learned_addr learned my addr 172.21.15.5:0/295894717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28df7fe700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28e006a840 0x7f28e00c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28deffd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e00cd950 0x7f28e014f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28dffff700 1 -- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e00cd950 msgr2=0x7f28e014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28dffff700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e00cd950 0x7f28e014f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28dffff700 1 -- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28e006a840 msgr2=0x7f28e00c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28dffff700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28e006a840 0x7f28e00c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28dffff700 1 -- 172.21.15.5:0/295894717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0009550 con 0x7f28e00cede0 2023-10-16T13:49:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28df7fe700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28e006a840 0x7f28e00c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28deffd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e00cd950 0x7f28e014f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28dffff700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 0x7f28e014fa90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f28d800cc30 tx=0x7f28d800a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800ab70 con 0x7f28e00cede0 2023-10-16T13:49:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800acd0 con 0x7f28e00cede0 2023-10-16T13:49:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e00b3770 con 0x7f28e00cede0 2023-10-16T13:49:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8003c40 con 0x7f28e00cede0 2023-10-16T13:49:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.965+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e00c9f20 con 0x7f28e00cede0 2023-10-16T13:49:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.966+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e00b3f70 con 0x7f28e00cede0 2023-10-16T13:49:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.966+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f28d800f3f0 con 0x7f28e00cede0 2023-10-16T13:49:38.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.967+0000 7f28d7fff700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28c006b2f0 0x7f28c006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.967+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28d8089f40 con 0x7f28e00cede0 2023-10-16T13:49:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.967+0000 7f28df7fe700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28c006b2f0 0x7f28c006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.968+0000 7f28df7fe700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28c006b2f0 0x7f28c006d7b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009c40 tx=0x7f28d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:38.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:38.972+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28e00b3f70 con 0x7f28e00cede0 2023-10-16T13:49:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.174+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e00b3f70 con 0x7f28e00cede0 2023-10-16T13:49:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.175+0000 7f28d7fff700 1 -- 172.21.15.5:0/295894717 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f28e00b3f70 con 0x7f28e00cede0 2023-10-16T13:49:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:39.179 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":135,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:36.376754+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28c006b2f0 msgr2=0x7f28c006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28c006b2f0 0x7f28c006d7b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009c40 tx=0x7f28d0008030 comp rx=0 tx=0).stop 2023-10-16T13:49:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 msgr2=0x7f28e014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 0x7f28e014fa90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f28d800cc30 tx=0x7f28d800a1f0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 shutdown_connections 2023-10-16T13:49:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00cede0 0x7f28e014fa90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28e006a840 0x7f28e00c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f28c006b2f0 0x7f28c006d7b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 --2- 172.21.15.5:0/295894717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28e00cd950 0x7f28e014f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 >> 172.21.15.5:0/295894717 conn(0x7f28e006dae0 msgr2=0x7f28e006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.177+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 shutdown_connections 2023-10-16T13:49:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.178+0000 7f28e61bd700 1 -- 172.21.15.5:0/295894717 wait complete. 2023-10-16T13:49:39.193 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:49:39.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:49:39.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.315+0000 7fb1d30ce700 1 Processor -- start 2023-10-16T13:49:39.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.315+0000 7fb1d30ce700 1 -- start start 2023-10-16T13:49:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d30ce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1cc0728e0 0x7fb1cc06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d30ce700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc070040 con 0x7fb1cc0b2980 2023-10-16T13:49:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d30ce700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc0afce0 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d30ce700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc0d0420 con 0x7fb1cc0728e0 2023-10-16T13:49:39.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d166b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1cc0728e0 0x7fb1cc06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1cbfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1cc0b2980 0x7fb1cc15e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60612/0 (socket says 172.21.15.5:60612) 2023-10-16T13:49:39.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1cbfff700 1 -- 172.21.15.5:0/2926944847 learned_addr learned my addr 172.21.15.5:0/2926944847 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:39.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d166b700 1 -- 172.21.15.5:0/2926944847 >> v1:172.21.15.112:6789/0 conn(0x7fb1cc15a8e0 legacy=0x7fb1cc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:39.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.316+0000 7fb1d166b700 1 -- 172.21.15.5:0/2926944847 >> v1:172.21.15.5:6789/0 conn(0x7fb1cc0b2980 legacy=0x7fb1cc15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d166b700 1 -- 172.21.15.5:0/2926944847 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc071e00 con 0x7fb1cc0728e0 2023-10-16T13:49:39.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1cb7fe700 1 -- 172.21.15.5:0/2926944847 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161454882 0 0) 0x7fb1cc070040 con 0x7fb1cc0b2980 2023-10-16T13:49:39.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d166b700 1 --2- 172.21.15.5:0/2926944847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc06fb00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009d90 tx=0x7fb1c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af73b46cecddb6e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:39.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1cb7fe700 1 -- 172.21.15.5:0/2926944847 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400e070 con 0x7fb1cc0728e0 2023-10-16T13:49:39.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1cb7fe700 1 -- 172.21.15.5:0/2926944847 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400bb90 con 0x7fb1cc0728e0 2023-10-16T13:49:39.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1cb7fe700 1 -- 172.21.15.5:0/2926944847 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4003a20 con 0x7fb1cc0728e0 2023-10-16T13:49:39.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 -- 172.21.15.5:0/2926944847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc0728e0 msgr2=0x7fb1cc06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/2926944847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc06fb00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009d90 tx=0x7fb1c400b330 comp rx=0 tx=0).stop 2023-10-16T13:49:39.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 -- 172.21.15.5:0/2926944847 shutdown_connections 2023-10-16T13:49:39.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/2926944847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc06fb00 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 -- 172.21.15.5:0/2926944847 >> 172.21.15.5:0/2926944847 conn(0x7fb1cc0cd270 msgr2=0x7fb1cc0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:39.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 -- 172.21.15.5:0/2926944847 shutdown_connections 2023-10-16T13:49:39.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.317+0000 7fb1d30ce700 1 -- 172.21.15.5:0/2926944847 wait complete. 2023-10-16T13:49:39.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.319+0000 7fb1d30ce700 1 Processor -- start 2023-10-16T13:49:39.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.319+0000 7fb1d30ce700 1 -- start start 2023-10-16T13:49:39.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.319+0000 7fb1d30ce700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc1e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.319+0000 7fb1d30ce700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc0b2980 0x7fb1cc159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d30ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 0x7fb1cc0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d30ce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c8640 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d30ce700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1e39d0 con 0x7fb1cc0728e0 2023-10-16T13:49:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d30ce700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1e3cb0 con 0x7fb1cc0b2980 2023-10-16T13:49:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 0x7fb1cc0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 0x7fb1cc0c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50616/0 (socket says 172.21.15.5:50616) 2023-10-16T13:49:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 -- 172.21.15.5:0/1719635054 learned_addr learned my addr 172.21.15.5:0/1719635054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:39.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1cbfff700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc0b2980 0x7fb1cc159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d0e6a700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc1e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 -- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc0b2980 msgr2=0x7fb1cc159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc0b2980 0x7fb1cc159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 -- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc0728e0 msgr2=0x7fb1cc1e30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc1e30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 -- 172.21.15.5:0/1719635054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009a70 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d166b700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 0x7fb1cc0c8ad0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4004000 tx=0x7fb1c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:39.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4012630 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c40127b0 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc0c82d0 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4012b60 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.320+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc1e3630 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.321+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc0c87b0 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.322+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fb1c4012cc0 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.322+0000 7fb1c97fa700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1b006b2f0 0x7fb1b006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.322+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1c408c0a0 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.323+0000 7fb1d0e6a700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1b006b2f0 0x7fb1b006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.323+0000 7fb1d0e6a700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1b006b2f0 0x7fb1b006d7b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0006fd0 tx=0x7fb1c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:39.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.327+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1c4056a70 con 0x7fb1cc15a8e0 2023-10-16T13:49:39.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.524+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1cc0723c0 con 0x7fb1b006b2f0 2023-10-16T13:49:39.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.532+0000 7fb1c97fa700 1 -- 172.21.15.5:0/1719635054 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277722 (secure 0 0 0) 0x7fb1c00123e0 con 0x7fb1b006b2f0 2023-10-16T13:49:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:39.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1b006b2f0 msgr2=0x7fb1b006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1b006b2f0 0x7fb1b006d7b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0006fd0 tx=0x7fb1c0008040 comp rx=0 tx=0).stop 2023-10-16T13:49:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 msgr2=0x7fb1cc0c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 0x7fb1cc0c8ad0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4004000 tx=0x7fb1c4004ad0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 shutdown_connections 2023-10-16T13:49:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc15a8e0 0x7fb1cc0c8ad0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc0728e0 0x7fb1cc1e30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb1b006b2f0 0x7fb1b006d7b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 --2- 172.21.15.5:0/1719635054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc0b2980 0x7fb1cc159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 >> 172.21.15.5:0/1719635054 conn(0x7fb1cc0cd270 msgr2=0x7fb1cc06c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:39.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 shutdown_connections 2023-10-16T13:49:39.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.535+0000 7fb1d30ce700 1 -- 172.21.15.5:0/1719635054 wait complete. 2023-10-16T13:49:39.543 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:49:39.550 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":470,"stamp":"2023-10-16T13:49:37.628017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276084,"kb_used_data":14124,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754698636,"statfs":{"total":773094113280,"available":772811403264,"internally_reserved":0,"allocated":14462976,"data_stored":7129499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":268095032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.258527"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373389+0000","last_change":"2023-10-16T13:49:33.373389+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373389+0000","last_undegraded":"2023-10-16T13:49:33.373389+0000","last_fullsized":"2023-10-16T13:49:33.373389+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371317+0000","last_change":"2023-10-16T13:49:33.371317+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371317+0000","last_undegraded":"2023-10-16T13:49:33.371317+0000","last_fullsized":"2023-10-16T13:49:33.371317+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371085+0000","last_change":"2023-10-16T13:49:33.371085+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371085+0000","last_undegraded":"2023-10-16T13:49:33.371085+0000","last_fullsized":"2023-10-16T13:49:33.371085+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373280+0000","last_change":"2023-10-16T13:49:33.373280+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373280+0000","last_undegraded":"2023-10-16T13:49:33.373280+0000","last_fullsized":"2023-10-16T13:49:33.373280+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.372840+0000","last_change":"2023-10-16T13:49:33.372840+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.372840+0000","last_undegraded":"2023-10-16T13:49:33.372840+0000","last_fullsized":"2023-10-16T13:49:33.372840+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.375867+0000","last_change":"2023-10-16T13:49:33.375867+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.375867+0000","last_undegraded":"2023-10-16T13:49:33.375867+0000","last_fullsized":"2023-10-16T13:49:33.375867+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.374617+0000","last_change":"2023-10-16T13:49:33.374617+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.374617+0000","last_undegraded":"2023-10-16T13:49:33.374617+0000","last_fullsized":"2023-10-16T13:49:33.374617+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373944+0000","last_change":"2023-10-16T13:49:33.373944+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373944+0000","last_undegraded":"2023-10-16T13:49:33.373944+0000","last_fullsized":"2023-10-16T13:49:33.373944+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373141+0000","last_change":"2023-10-16T13:49:33.373141+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373141+0000","last_undegraded":"2023-10-16T13:49:33.373141+0000","last_fullsized":"2023-10-16T13:49:33.373141+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373229+0000","last_change":"2023-10-16T13:49:33.373229+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373229+0000","last_undegraded":"2023-10-16T13:49:33.373229+0000","last_fullsized":"2023-10-16T13:49:33.373229+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371085+0000","last_change":"2023-10-16T13:49:33.371085+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371085+0000","last_undegraded":"2023-10-16T13:49:33.371085+0000","last_fullsized":"2023-10-16T13:49:33.371085+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.374190+0000","last_change":"2023-10-16T13:49:33.374190+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.374190+0000","last_undegraded":"2023-10-16T13:49:33.374190+0000","last_fullsized":"2023-10-16T13:49:33.374190+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.370357+0000","last_change":"2023-10-16T13:49:33.370357+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.370357+0000","last_undegraded":"2023-10-16T13:49:33.370357+0000","last_fullsized":"2023-10-16T13:49:33.370357+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.375946+0000","last_change":"2023-10-16T13:49:33.375946+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.375946+0000","last_undegraded":"2023-10-16T13:49:33.375946+0000","last_fullsized":"2023-10-16T13:49:33.375946+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.374062+0000","last_change":"2023-10-16T13:49:33.374062+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.374062+0000","last_undegraded":"2023-10-16T13:49:33.374062+0000","last_fullsized":"2023-10-16T13:49:33.374062+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.372861+0000","last_change":"2023-10-16T13:49:33.372861+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.372861+0000","last_undegraded":"2023-10-16T13:49:33.372861+0000","last_fullsized":"2023-10-16T13:49:33.372861+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.376102+0000","last_change":"2023-10-16T13:49:33.376102+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.376102+0000","last_undegraded":"2023-10-16T13:49:33.376102+0000","last_fullsized":"2023-10-16T13:49:33.376102+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.374605+0000","last_change":"2023-10-16T13:49:33.374605+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.374605+0000","last_undegraded":"2023-10-16T13:49:33.374605+0000","last_fullsized":"2023-10-16T13:49:33.374605+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373972+0000","last_change":"2023-10-16T13:49:33.373972+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373972+0000","last_undegraded":"2023-10-16T13:49:33.373972+0000","last_fullsized":"2023-10-16T13:49:33.373972+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371074+0000","last_change":"2023-10-16T13:49:33.371074+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371074+0000","last_undegraded":"2023-10-16T13:49:33.371074+0000","last_fullsized":"2023-10-16T13:49:33.371074+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.372790+0000","last_change":"2023-10-16T13:49:33.372790+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.372790+0000","last_undegraded":"2023-10-16T13:49:33.372790+0000","last_fullsized":"2023-10-16T13:49:33.372790+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371013+0000","last_change":"2023-10-16T13:49:33.371013+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371013+0000","last_undegraded":"2023-10-16T13:49:33.371013+0000","last_fullsized":"2023-10-16T13:49:33.371013+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371241+0000","last_change":"2023-10-16T13:49:33.371241+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371241+0000","last_undegraded":"2023-10-16T13:49:33.371241+0000","last_fullsized":"2023-10-16T13:49:33.371241+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.375210+0000","last_change":"2023-10-16T13:49:33.375210+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.375210+0000","last_undegraded":"2023-10-16T13:49:33.375210+0000","last_fullsized":"2023-10-16T13:49:33.375210+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.370469+0000","last_change":"2023-10-16T13:49:33.370469+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.370469+0000","last_undegraded":"2023-10-16T13:49:33.370469+0000","last_fullsized":"2023-10-16T13:49:33.370469+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.370512+0000","last_change":"2023-10-16T13:49:33.370512+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.370512+0000","last_undegraded":"2023-10-16T13:49:33.370512+0000","last_fullsized":"2023-10-16T13:49:33.370512+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.375905+0000","last_change":"2023-10-16T13:49:33.375905+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.375905+0000","last_undegraded":"2023-10-16T13:49:33.375905+0000","last_fullsized":"2023-10-16T13:49:33.375905+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371690+0000","last_change":"2023-10-16T13:49:33.371690+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371690+0000","last_undegraded":"2023-10-16T13:49:33.371690+0000","last_fullsized":"2023-10-16T13:49:33.371690+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371260+0000","last_change":"2023-10-16T13:49:33.371260+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371260+0000","last_undegraded":"2023-10-16T13:49:33.371260+0000","last_fullsized":"2023-10-16T13:49:33.371260+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.373249+0000","last_change":"2023-10-16T13:49:33.373249+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.373249+0000","last_undegraded":"2023-10-16T13:49:33.373249+0000","last_fullsized":"2023-10-16T13:49:33.373249+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.371298+0000","last_change":"2023-10-16T13:49:33.371298+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.371298+0000","last_undegraded":"2023-10-16T13:49:33.371298+0000","last_fullsized":"2023-10-16T13:49:33.371298+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:49:34.368255+0000","last_change":"2023-10-16T13:49:34.368255+0000","last_active":"2023-10-16T13:49:34.368255+0000","last_peered":"2023-10-16T13:49:34.368255+0000","last_clean":"2023-10-16T13:49:34.368255+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:34.368255+0000","last_undegraded":"2023-10-16T13:49:34.368255+0000","last_fullsized":"2023-10-16T13:49:34.368255+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":132,"state":"creating+peering","last_fresh":"2023-10-16T13:49:33.374119+0000","last_change":"2023-10-16T13:49:33.374119+0000","last_active":"2023-10-16T13:49:33.366153+0000","last_peered":"2023-10-16T13:49:33.366153+0000","last_clean":"2023-10-16T13:49:33.366153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:49:33.374119+0000","last_undegraded":"2023-10-16T13:49:33.374119+0000","last_fullsized":"2023-10-16T13:49:33.374119+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-16T13:49:32.112777+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:49:32.112777+0000","last_peered":"2023-10-16T13:49:32.112777+0000","last_clean":"2023-10-16T13:49:32.112777+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:49:32.112777+0000","last_undegraded":"2023-10-16T13:49:32.112777+0000","last_fullsized":"2023-10-16T13:49:32.112777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2252800,"data_stored":1333491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.83099999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.82799999999999996,"15min":0.93100000000000005},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.76800000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.76400000000000001,"5min":0.80500000000000005,"15min":0.81699999999999995},"last":0.64800000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.309},"max":{"1min":0.77500000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.752},{"interface":"front","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.80500000000000005,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.871}]}]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1658880,"data_stored":743123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.63800000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.41299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36968,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334872,"statfs":{"total":96636764160,"available":96598908928,"internally_reserved":0,"allocated":1658880,"data_stored":743123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.33200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46500000000000002,"5min":0.51200000000000001,"15min":0.53500000000000003},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.47699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.56999999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.496,"5min":0.53300000000000003,"15min":1.1619999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.5,"5min":0.61699999999999999,"15min":0.752},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.40899999999999997},"min":{"1min":0.28399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.88},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.52100000000000002,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.39100000000000001,"15min":0.39000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.905},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.52000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":1.879},"last":0.42299999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.38300000000000001},"max":{"1min":0.81000000000000005,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.44700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.96399999999999997,"15min":1.0549999999999999},"last":0.44600000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.748,"5min":0.90400000000000003,"15min":1.925},"last":0.93899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.624},"min":{"1min":0.53100000000000003,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.81100000000000005,"5min":0.872,"15min":1.085},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33384,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338456,"statfs":{"total":96636764160,"available":96602578944,"internally_reserved":0,"allocated":2248704,"data_stored":1332472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.379}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.499},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.64100000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":1.02}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.998}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36960,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334880,"statfs":{"total":96636764160,"available":96598917120,"internally_reserved":0,"allocated":1654784,"data_stored":742104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.317,"15min":0.33400000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.99199999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.34599999999999997,"15min":0.36299999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.78700000000000003},"last":0.32700000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.221,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.67800000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.374,"15min":0.375},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.66100000000000003},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.20599999999999999},"max":{"1min":0.629,"5min":0.67100000000000004,"15min":0.88500000000000001},"last":0.374},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":0.621,"15min":1.153},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.629},"min":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.58499999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85099999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.93400000000000005,"15min":2.2210000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60199999999999998,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.96999999999999997,"15min":1.379},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.38900000000000001,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.98199999999999998,"15min":1.395},"last":0.45700000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:48:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":4.0609999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.875,"15min":6.0499999999999998},"last":0.56999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36960,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334880,"statfs":{"total":96636764160,"available":96598917120,"internally_reserved":0,"allocated":1658880,"data_stored":743123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.45400000000000001},"min":{"1min":0.251,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.378,"15min":0.40400000000000003},"min":{"1min":0.28599999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":2.181},"last":0.32700000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.308},{"interface":"front","average":{"1min":0.435,"5min":0.40300000000000002,"15min":0.434},"min":{"1min":0.28599999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.39000000000000001},"min":{"1min":0.28799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.438,"15min":0.46000000000000002},"min":{"1min":0.34100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.435}]},{"osd":4,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.60899999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61299999999999999,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.621,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.264,"5min":1.264,"15min":2.4039999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.622,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.371,"15min":0.371},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Oct 16 13:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.76100000000000001},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64900000000000002,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":2.4430000000000001},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1658880,"data_stored":743123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.59499999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.624},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.41799999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.501},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.58199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":748940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48799999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.54200000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:49:39.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:49:39.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.712+0000 7ffbdfabc700 1 Processor -- start 2023-10-16T13:49:39.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.712+0000 7ffbdfabc700 1 -- start start 2023-10-16T13:49:39.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdfabc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbd815bb50 0x7ffbd806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdfabc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdfabc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd815bf30 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdfabc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd806f1d0 con 0x7ffbd815bb50 2023-10-16T13:49:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdfabc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80ce540 con 0x7ffbd806ed50 2023-10-16T13:49:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdd858700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbd815bb50 0x7ffbd806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdd858700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbd815bb50 0x7ffbd806e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50620/0 (socket says 172.21.15.5:50620) 2023-10-16T13:49:39.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdd858700 1 -- 172.21.15.5:0/622281181 learned_addr learned my addr 172.21.15.5:0/622281181 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:39.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.713+0000 7ffbdd057700 1 --2- 172.21.15.5:0/622281181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdd858700 1 -- 172.21.15.5:0/622281181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 msgr2=0x7ffbd80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:39.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdd858700 1 --2- 172.21.15.5:0/622281181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdd858700 1 -- 172.21.15.5:0/622281181 >> v1:172.21.15.112:6789/0 conn(0x7ffbd80ce0b0 legacy=0x7ffbd815f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdd858700 1 -- 172.21.15.5:0/622281181 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd806d500 con 0x7ffbd815bb50 2023-10-16T13:49:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdd858700 1 --2- 172.21.15.5:0/622281181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd815bb50 0x7ffbd806e810 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009920 tx=0x7ffbd4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20c6586af8ce662 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdc856700 1 -- 172.21.15.5:0/622281181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4011830 con 0x7ffbd815bb50 2023-10-16T13:49:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdc856700 1 -- 172.21.15.5:0/622281181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4011990 con 0x7ffbd815bb50 2023-10-16T13:49:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdc856700 1 -- 172.21.15.5:0/622281181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4011d20 con 0x7ffbd815bb50 2023-10-16T13:49:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdfabc700 1 -- 172.21.15.5:0/622281181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd815bb50 msgr2=0x7ffbd806e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/622281181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd815bb50 0x7ffbd806e810 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009920 tx=0x7ffbd4009c30 comp rx=0 tx=0).stop 2023-10-16T13:49:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdfabc700 1 -- 172.21.15.5:0/622281181 shutdown_connections 2023-10-16T13:49:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/622281181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd815bb50 0x7ffbd806e810 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/622281181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.714+0000 7ffbdfabc700 1 -- 172.21.15.5:0/622281181 >> 172.21.15.5:0/622281181 conn(0x7ffbd80cc6f0 msgr2=0x7ffbd80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:39.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.715+0000 7ffbdfabc700 1 -- 172.21.15.5:0/622281181 shutdown_connections 2023-10-16T13:49:39.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.715+0000 7ffbdfabc700 1 -- 172.21.15.5:0/622281181 wait complete. 2023-10-16T13:49:39.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 Processor -- start 2023-10-16T13:49:39.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 -- start start 2023-10-16T13:49:39.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 0x7ffbd80ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd815bb50 0x7ffbd81f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8152250 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8155250 con 0x7ffbd815bb50 2023-10-16T13:49:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.716+0000 7ffbdfabc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80ad800 con 0x7ffbd806ed50 2023-10-16T13:49:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 0x7ffbd80ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 0x7ffbd80ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50628/0 (socket says 172.21.15.5:50628) 2023-10-16T13:49:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 -- 172.21.15.5:0/4291949713 learned_addr learned my addr 172.21.15.5:0/4291949713 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd858700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbde059700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd815bb50 0x7ffbd81f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 -- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 msgr2=0x7ffbd80adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 -- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd815bb50 msgr2=0x7ffbd81f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd815bb50 0x7ffbd81f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 -- 172.21.15.5:0/4291949713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009550 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbde059700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd815bb50 0x7ffbd81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdd057700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 0x7ffbd80ad2c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e9b0 tx=0x7ffbc800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8009710 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800c850 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd80ae5b0 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800cbc0 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.717+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd8151ee0 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.718+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd8151a60 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.719+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7ffbc800cd20 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.719+0000 7ffbce7fc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbbc06b2f0 0x7ffbbc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:39.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.719+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbc8089d50 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.719+0000 7ffbdd858700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbbc06b2f0 0x7ffbbc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:39.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.720+0000 7ffbdd858700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbbc06b2f0 0x7ffbbc06d7b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4014040 tx=0x7ffbd4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:39.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.724+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbd8151a60 con 0x7ffbd80ce0b0 2023-10-16T13:49:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.918+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbd806dac0 con 0x7ffbbc06b2f0 2023-10-16T13:49:39.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.926+0000 7ffbce7fc700 1 -- 172.21.15.5:0/4291949713 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289676 (secure 0 0 0) 0x7ffbd4011b80 con 0x7ffbbc06b2f0 2023-10-16T13:49:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:39.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbbc06b2f0 msgr2=0x7ffbbc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbbc06b2f0 0x7ffbbc06d7b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4014040 tx=0x7ffbd4008030 comp rx=0 tx=0).stop 2023-10-16T13:49:39.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 msgr2=0x7ffbd80ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:39.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 0x7ffbd80ad2c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e9b0 tx=0x7ffbc800ecc0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 shutdown_connections 2023-10-16T13:49:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd815bb50 0x7ffbd81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7ffbbc06b2f0 0x7ffbbc06d7b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd806ed50 0x7ffbd80adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 --2- 172.21.15.5:0/4291949713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80ce0b0 0x7ffbd80ad2c0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:39.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.929+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 >> 172.21.15.5:0/4291949713 conn(0x7ffbd80cc6f0 msgr2=0x7ffbd815ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:39.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.930+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 shutdown_connections 2023-10-16T13:49:39.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:39.930+0000 7ffbdfabc700 1 -- 172.21.15.5:0/4291949713 wait complete. 2023-10-16T13:49:39.937 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:49:39.944 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":471,"stamp":"2023-10-16T13:49:39.628462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":280688,"kb_used_data":14560,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754694032,"statfs":{"total":773094113280,"available":772806688768,"internally_reserved":0,"allocated":14909440,"data_stored":7329838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":272354872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001613"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509678+0000","last_change":"2023-10-16T13:49:35.409351+0000","last_active":"2023-10-16T13:49:36.509678+0000","last_peered":"2023-10-16T13:49:36.509678+0000","last_clean":"2023-10-16T13:49:36.509678+0000","last_became_active":"2023-10-16T13:49:35.409028+0000","last_became_peered":"2023-10-16T13:49:35.409028+0000","last_unstale":"2023-10-16T13:49:36.509678+0000","last_undegraded":"2023-10-16T13:49:36.509678+0000","last_fullsized":"2023-10-16T13:49:36.509678+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:06.631415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389549+0000","last_change":"2023-10-16T13:49:35.389785+0000","last_active":"2023-10-16T13:49:36.389549+0000","last_peered":"2023-10-16T13:49:36.389549+0000","last_clean":"2023-10-16T13:49:36.389549+0000","last_became_active":"2023-10-16T13:49:35.389464+0000","last_became_peered":"2023-10-16T13:49:35.389464+0000","last_unstale":"2023-10-16T13:49:36.389549+0000","last_undegraded":"2023-10-16T13:49:36.389549+0000","last_fullsized":"2023-10-16T13:49:36.389549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:08:34.760067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509716+0000","last_change":"2023-10-16T13:49:35.394221+0000","last_active":"2023-10-16T13:49:36.509716+0000","last_peered":"2023-10-16T13:49:36.509716+0000","last_clean":"2023-10-16T13:49:36.509716+0000","last_became_active":"2023-10-16T13:49:35.393917+0000","last_became_peered":"2023-10-16T13:49:35.393917+0000","last_unstale":"2023-10-16T13:49:36.509716+0000","last_undegraded":"2023-10-16T13:49:36.509716+0000","last_fullsized":"2023-10-16T13:49:36.509716+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:56.217892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.388824+0000","last_change":"2023-10-16T13:49:35.391722+0000","last_active":"2023-10-16T13:49:36.388824+0000","last_peered":"2023-10-16T13:49:36.388824+0000","last_clean":"2023-10-16T13:49:36.388824+0000","last_became_active":"2023-10-16T13:49:35.391464+0000","last_became_peered":"2023-10-16T13:49:35.391464+0000","last_unstale":"2023-10-16T13:49:36.388824+0000","last_undegraded":"2023-10-16T13:49:36.388824+0000","last_fullsized":"2023-10-16T13:49:36.388824+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:58.657097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.508629+0000","last_change":"2023-10-16T13:49:35.396894+0000","last_active":"2023-10-16T13:49:36.508629+0000","last_peered":"2023-10-16T13:49:36.508629+0000","last_clean":"2023-10-16T13:49:36.508629+0000","last_became_active":"2023-10-16T13:49:35.396587+0000","last_became_peered":"2023-10-16T13:49:35.396587+0000","last_unstale":"2023-10-16T13:49:36.508629+0000","last_undegraded":"2023-10-16T13:49:36.508629+0000","last_fullsized":"2023-10-16T13:49:36.508629+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:29:36.094478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510122+0000","last_change":"2023-10-16T13:49:35.391018+0000","last_active":"2023-10-16T13:49:36.510122+0000","last_peered":"2023-10-16T13:49:36.510122+0000","last_clean":"2023-10-16T13:49:36.510122+0000","last_became_active":"2023-10-16T13:49:35.390642+0000","last_became_peered":"2023-10-16T13:49:35.390642+0000","last_unstale":"2023-10-16T13:49:36.510122+0000","last_undegraded":"2023-10-16T13:49:36.510122+0000","last_fullsized":"2023-10-16T13:49:36.510122+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:40.919757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.388987+0000","last_change":"2023-10-16T13:49:35.402752+0000","last_active":"2023-10-16T13:49:36.388987+0000","last_peered":"2023-10-16T13:49:36.388987+0000","last_clean":"2023-10-16T13:49:36.388987+0000","last_became_active":"2023-10-16T13:49:35.402465+0000","last_became_peered":"2023-10-16T13:49:35.402465+0000","last_unstale":"2023-10-16T13:49:36.388987+0000","last_undegraded":"2023-10-16T13:49:36.388987+0000","last_fullsized":"2023-10-16T13:49:36.388987+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:56.217892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509125+0000","last_change":"2023-10-16T13:49:35.394645+0000","last_active":"2023-10-16T13:49:36.509125+0000","last_peered":"2023-10-16T13:49:36.509125+0000","last_clean":"2023-10-16T13:49:36.509125+0000","last_became_active":"2023-10-16T13:49:35.394303+0000","last_became_peered":"2023-10-16T13:49:35.394303+0000","last_unstale":"2023-10-16T13:49:36.509125+0000","last_undegraded":"2023-10-16T13:49:36.509125+0000","last_fullsized":"2023-10-16T13:49:36.509125+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:33.201553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.390293+0000","last_change":"2023-10-16T13:49:35.403485+0000","last_active":"2023-10-16T13:49:36.390293+0000","last_peered":"2023-10-16T13:49:36.390293+0000","last_clean":"2023-10-16T13:49:36.390293+0000","last_became_active":"2023-10-16T13:49:35.403229+0000","last_became_peered":"2023-10-16T13:49:35.403229+0000","last_unstale":"2023-10-16T13:49:36.390293+0000","last_undegraded":"2023-10-16T13:49:36.390293+0000","last_fullsized":"2023-10-16T13:49:36.390293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:47.329152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510184+0000","last_change":"2023-10-16T13:49:35.400468+0000","last_active":"2023-10-16T13:49:36.510184+0000","last_peered":"2023-10-16T13:49:36.510184+0000","last_clean":"2023-10-16T13:49:36.510184+0000","last_became_active":"2023-10-16T13:49:35.400084+0000","last_became_peered":"2023-10-16T13:49:35.400084+0000","last_unstale":"2023-10-16T13:49:36.510184+0000","last_undegraded":"2023-10-16T13:49:36.510184+0000","last_fullsized":"2023-10-16T13:49:36.510184+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:04.517205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389317+0000","last_change":"2023-10-16T13:49:35.394253+0000","last_active":"2023-10-16T13:49:36.389317+0000","last_peered":"2023-10-16T13:49:36.389317+0000","last_clean":"2023-10-16T13:49:36.389317+0000","last_became_active":"2023-10-16T13:49:35.393971+0000","last_became_peered":"2023-10-16T13:49:35.393971+0000","last_unstale":"2023-10-16T13:49:36.389317+0000","last_undegraded":"2023-10-16T13:49:36.389317+0000","last_fullsized":"2023-10-16T13:49:36.389317+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:34:11.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389678+0000","last_change":"2023-10-16T13:49:35.391386+0000","last_active":"2023-10-16T13:49:36.389678+0000","last_peered":"2023-10-16T13:49:36.389678+0000","last_clean":"2023-10-16T13:49:36.389678+0000","last_became_active":"2023-10-16T13:49:35.391033+0000","last_became_peered":"2023-10-16T13:49:35.391033+0000","last_unstale":"2023-10-16T13:49:36.389678+0000","last_undegraded":"2023-10-16T13:49:36.389678+0000","last_fullsized":"2023-10-16T13:49:36.389678+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:29.899503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389074+0000","last_change":"2023-10-16T13:49:35.394753+0000","last_active":"2023-10-16T13:49:36.389074+0000","last_peered":"2023-10-16T13:49:36.389074+0000","last_clean":"2023-10-16T13:49:36.389074+0000","last_became_active":"2023-10-16T13:49:35.394501+0000","last_became_peered":"2023-10-16T13:49:35.394501+0000","last_unstale":"2023-10-16T13:49:36.389074+0000","last_undegraded":"2023-10-16T13:49:36.389074+0000","last_fullsized":"2023-10-16T13:49:36.389074+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:23.211072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389897+0000","last_change":"2023-10-16T13:49:35.407795+0000","last_active":"2023-10-16T13:49:36.389897+0000","last_peered":"2023-10-16T13:49:36.389897+0000","last_clean":"2023-10-16T13:49:36.389897+0000","last_became_active":"2023-10-16T13:49:35.407546+0000","last_became_peered":"2023-10-16T13:49:35.407546+0000","last_unstale":"2023-10-16T13:49:36.389897+0000","last_undegraded":"2023-10-16T13:49:36.389897+0000","last_fullsized":"2023-10-16T13:49:36.389897+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:48.030566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389126+0000","last_change":"2023-10-16T13:49:35.392363+0000","last_active":"2023-10-16T13:49:36.389126+0000","last_peered":"2023-10-16T13:49:36.389126+0000","last_clean":"2023-10-16T13:49:36.389126+0000","last_became_active":"2023-10-16T13:49:35.392120+0000","last_became_peered":"2023-10-16T13:49:35.392120+0000","last_unstale":"2023-10-16T13:49:36.389126+0000","last_undegraded":"2023-10-16T13:49:36.389126+0000","last_fullsized":"2023-10-16T13:49:36.389126+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:11.534641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510127+0000","last_change":"2023-10-16T13:49:35.396152+0000","last_active":"2023-10-16T13:49:36.510127+0000","last_peered":"2023-10-16T13:49:36.510127+0000","last_clean":"2023-10-16T13:49:36.510127+0000","last_became_active":"2023-10-16T13:49:35.395845+0000","last_became_peered":"2023-10-16T13:49:35.395845+0000","last_unstale":"2023-10-16T13:49:36.510127+0000","last_undegraded":"2023-10-16T13:49:36.510127+0000","last_fullsized":"2023-10-16T13:49:36.510127+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:42.776130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.508721+0000","last_change":"2023-10-16T13:49:35.403083+0000","last_active":"2023-10-16T13:49:36.508721+0000","last_peered":"2023-10-16T13:49:36.508721+0000","last_clean":"2023-10-16T13:49:36.508721+0000","last_became_active":"2023-10-16T13:49:35.402782+0000","last_became_peered":"2023-10-16T13:49:35.402782+0000","last_unstale":"2023-10-16T13:49:36.508721+0000","last_undegraded":"2023-10-16T13:49:36.508721+0000","last_fullsized":"2023-10-16T13:49:36.508721+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:35.942322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509601+0000","last_change":"2023-10-16T13:49:35.393630+0000","last_active":"2023-10-16T13:49:36.509601+0000","last_peered":"2023-10-16T13:49:36.509601+0000","last_clean":"2023-10-16T13:49:36.509601+0000","last_became_active":"2023-10-16T13:49:35.393326+0000","last_became_peered":"2023-10-16T13:49:35.393326+0000","last_unstale":"2023-10-16T13:49:36.509601+0000","last_undegraded":"2023-10-16T13:49:36.509601+0000","last_fullsized":"2023-10-16T13:49:36.509601+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:57:48.301456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510247+0000","last_change":"2023-10-16T13:49:35.403881+0000","last_active":"2023-10-16T13:49:36.510247+0000","last_peered":"2023-10-16T13:49:36.510247+0000","last_clean":"2023-10-16T13:49:36.510247+0000","last_became_active":"2023-10-16T13:49:35.403584+0000","last_became_peered":"2023-10-16T13:49:35.403584+0000","last_unstale":"2023-10-16T13:49:36.510247+0000","last_undegraded":"2023-10-16T13:49:36.510247+0000","last_fullsized":"2023-10-16T13:49:36.510247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:06:02.465846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.508642+0000","last_change":"2023-10-16T13:49:35.395280+0000","last_active":"2023-10-16T13:49:36.508642+0000","last_peered":"2023-10-16T13:49:36.508642+0000","last_clean":"2023-10-16T13:49:36.508642+0000","last_became_active":"2023-10-16T13:49:35.394946+0000","last_became_peered":"2023-10-16T13:49:35.394946+0000","last_unstale":"2023-10-16T13:49:36.508642+0000","last_undegraded":"2023-10-16T13:49:36.508642+0000","last_fullsized":"2023-10-16T13:49:36.508642+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:59:34.252418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.508764+0000","last_change":"2023-10-16T13:49:35.396696+0000","last_active":"2023-10-16T13:49:36.508764+0000","last_peered":"2023-10-16T13:49:36.508764+0000","last_clean":"2023-10-16T13:49:36.508764+0000","last_became_active":"2023-10-16T13:49:35.396360+0000","last_became_peered":"2023-10-16T13:49:35.396360+0000","last_unstale":"2023-10-16T13:49:36.508764+0000","last_undegraded":"2023-10-16T13:49:36.508764+0000","last_fullsized":"2023-10-16T13:49:36.508764+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:27.690675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509989+0000","last_change":"2023-10-16T13:49:35.406279+0000","last_active":"2023-10-16T13:49:36.509989+0000","last_peered":"2023-10-16T13:49:36.509989+0000","last_clean":"2023-10-16T13:49:36.509989+0000","last_became_active":"2023-10-16T13:49:35.405905+0000","last_became_peered":"2023-10-16T13:49:35.405905+0000","last_unstale":"2023-10-16T13:49:36.509989+0000","last_undegraded":"2023-10-16T13:49:36.509989+0000","last_fullsized":"2023-10-16T13:49:36.509989+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:07.964253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509556+0000","last_change":"2023-10-16T13:49:35.401120+0000","last_active":"2023-10-16T13:49:36.509556+0000","last_peered":"2023-10-16T13:49:36.509556+0000","last_clean":"2023-10-16T13:49:36.509556+0000","last_became_active":"2023-10-16T13:49:35.400641+0000","last_became_peered":"2023-10-16T13:49:35.400641+0000","last_unstale":"2023-10-16T13:49:36.509556+0000","last_undegraded":"2023-10-16T13:49:36.509556+0000","last_fullsized":"2023-10-16T13:49:36.509556+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:00.686663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510258+0000","last_change":"2023-10-16T13:49:35.390752+0000","last_active":"2023-10-16T13:49:36.510258+0000","last_peered":"2023-10-16T13:49:36.510258+0000","last_clean":"2023-10-16T13:49:36.510258+0000","last_became_active":"2023-10-16T13:49:35.390423+0000","last_became_peered":"2023-10-16T13:49:35.390423+0000","last_unstale":"2023-10-16T13:49:36.510258+0000","last_undegraded":"2023-10-16T13:49:36.510258+0000","last_fullsized":"2023-10-16T13:49:36.510258+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:03:00.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389752+0000","last_change":"2023-10-16T13:49:35.407128+0000","last_active":"2023-10-16T13:49:36.389752+0000","last_peered":"2023-10-16T13:49:36.389752+0000","last_clean":"2023-10-16T13:49:36.389752+0000","last_became_active":"2023-10-16T13:49:35.406876+0000","last_became_peered":"2023-10-16T13:49:35.406876+0000","last_unstale":"2023-10-16T13:49:36.389752+0000","last_undegraded":"2023-10-16T13:49:36.389752+0000","last_fullsized":"2023-10-16T13:49:36.389752+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:47.329152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389084+0000","last_change":"2023-10-16T13:49:35.407896+0000","last_active":"2023-10-16T13:49:36.389084+0000","last_peered":"2023-10-16T13:49:36.389084+0000","last_clean":"2023-10-16T13:49:36.389084+0000","last_became_active":"2023-10-16T13:49:35.407653+0000","last_became_peered":"2023-10-16T13:49:35.407653+0000","last_unstale":"2023-10-16T13:49:36.389084+0000","last_undegraded":"2023-10-16T13:49:36.389084+0000","last_fullsized":"2023-10-16T13:49:36.389084+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:07.964253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509845+0000","last_change":"2023-10-16T13:49:35.393627+0000","last_active":"2023-10-16T13:49:36.509845+0000","last_peered":"2023-10-16T13:49:36.509845+0000","last_clean":"2023-10-16T13:49:36.509845+0000","last_became_active":"2023-10-16T13:49:35.393333+0000","last_became_peered":"2023-10-16T13:49:35.393333+0000","last_unstale":"2023-10-16T13:49:36.509845+0000","last_undegraded":"2023-10-16T13:49:36.509845+0000","last_fullsized":"2023-10-16T13:49:36.509845+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:07.964253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.508641+0000","last_change":"2023-10-16T13:49:35.408061+0000","last_active":"2023-10-16T13:49:36.508641+0000","last_peered":"2023-10-16T13:49:36.508641+0000","last_clean":"2023-10-16T13:49:36.508641+0000","last_became_active":"2023-10-16T13:49:35.407674+0000","last_became_peered":"2023-10-16T13:49:35.407674+0000","last_unstale":"2023-10-16T13:49:36.508641+0000","last_undegraded":"2023-10-16T13:49:36.508641+0000","last_fullsized":"2023-10-16T13:49:36.508641+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:39:01.527689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389349+0000","last_change":"2023-10-16T13:49:35.391198+0000","last_active":"2023-10-16T13:49:36.389349+0000","last_peered":"2023-10-16T13:49:36.389349+0000","last_clean":"2023-10-16T13:49:36.389349+0000","last_became_active":"2023-10-16T13:49:35.390891+0000","last_became_peered":"2023-10-16T13:49:35.390891+0000","last_unstale":"2023-10-16T13:49:36.389349+0000","last_undegraded":"2023-10-16T13:49:36.389349+0000","last_fullsized":"2023-10-16T13:49:36.389349+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:50.860336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389858+0000","last_change":"2023-10-16T13:49:35.395729+0000","last_active":"2023-10-16T13:49:36.389858+0000","last_peered":"2023-10-16T13:49:36.389858+0000","last_clean":"2023-10-16T13:49:36.389858+0000","last_became_active":"2023-10-16T13:49:35.395313+0000","last_became_peered":"2023-10-16T13:49:35.395313+0000","last_unstale":"2023-10-16T13:49:36.389858+0000","last_undegraded":"2023-10-16T13:49:36.389858+0000","last_fullsized":"2023-10-16T13:49:36.389858+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:50.860336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509680+0000","last_change":"2023-10-16T13:49:35.407425+0000","last_active":"2023-10-16T13:49:36.509680+0000","last_peered":"2023-10-16T13:49:36.509680+0000","last_clean":"2023-10-16T13:49:36.509680+0000","last_became_active":"2023-10-16T13:49:35.405615+0000","last_became_peered":"2023-10-16T13:49:35.405615+0000","last_unstale":"2023-10-16T13:49:36.509680+0000","last_undegraded":"2023-10-16T13:49:36.509680+0000","last_fullsized":"2023-10-16T13:49:36.509680+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:07.897573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.508442+0000","last_change":"2023-10-16T13:49:35.394945+0000","last_active":"2023-10-16T13:49:36.508442+0000","last_peered":"2023-10-16T13:49:36.508442+0000","last_clean":"2023-10-16T13:49:36.508442+0000","last_became_active":"2023-10-16T13:49:35.394630+0000","last_became_peered":"2023-10-16T13:49:35.394630+0000","last_unstale":"2023-10-16T13:49:36.508442+0000","last_undegraded":"2023-10-16T13:49:36.508442+0000","last_fullsized":"2023-10-16T13:49:36.508442+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:59:52.398538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509987+0000","last_change":"2023-10-16T13:49:35.398199+0000","last_active":"2023-10-16T13:49:36.509987+0000","last_peered":"2023-10-16T13:49:36.509987+0000","last_clean":"2023-10-16T13:49:36.509987+0000","last_became_active":"2023-10-16T13:49:35.397996+0000","last_became_peered":"2023-10-16T13:49:35.397996+0000","last_unstale":"2023-10-16T13:49:36.509987+0000","last_undegraded":"2023-10-16T13:49:36.509987+0000","last_fullsized":"2023-10-16T13:49:36.509987+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:52.704547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"134'4","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.417404+0000","last_change":"2023-10-16T13:49:34.394756+0000","last_active":"2023-10-16T13:49:35.417404+0000","last_peered":"2023-10-16T13:49:35.417404+0000","last_clean":"2023-10-16T13:49:35.417404+0000","last_became_active":"2023-10-16T13:49:34.394177+0000","last_became_peered":"2023-10-16T13:49:34.394177+0000","last_unstale":"2023-10-16T13:49:35.417404+0000","last_undegraded":"2023-10-16T13:49:35.417404+0000","last_fullsized":"2023-10-16T13:49:35.417404+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:32:42.310706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510492+0000","last_change":"2023-10-16T13:49:35.399675+0000","last_active":"2023-10-16T13:49:36.510492+0000","last_peered":"2023-10-16T13:49:36.510492+0000","last_clean":"2023-10-16T13:49:36.510492+0000","last_became_active":"2023-10-16T13:49:35.399316+0000","last_became_peered":"2023-10-16T13:49:35.399316+0000","last_unstale":"2023-10-16T13:49:36.510492+0000","last_undegraded":"2023-10-16T13:49:36.510492+0000","last_fullsized":"2023-10-16T13:49:36.510492+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:04.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.409288+0000","last_change":"2023-10-16T13:49:34.389593+0000","last_active":"2023-10-16T13:49:35.409288+0000","last_peered":"2023-10-16T13:49:35.409288+0000","last_clean":"2023-10-16T13:49:35.409288+0000","last_became_active":"2023-10-16T13:49:34.389328+0000","last_became_peered":"2023-10-16T13:49:34.389328+0000","last_unstale":"2023-10-16T13:49:35.409288+0000","last_undegraded":"2023-10-16T13:49:35.409288+0000","last_fullsized":"2023-10-16T13:49:35.409288+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.238075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.388736+0000","last_change":"2023-10-16T13:49:35.394755+0000","last_active":"2023-10-16T13:49:36.388736+0000","last_peered":"2023-10-16T13:49:36.388736+0000","last_clean":"2023-10-16T13:49:36.388736+0000","last_became_active":"2023-10-16T13:49:35.394396+0000","last_became_peered":"2023-10-16T13:49:35.394396+0000","last_unstale":"2023-10-16T13:49:36.388736+0000","last_undegraded":"2023-10-16T13:49:36.388736+0000","last_fullsized":"2023-10-16T13:49:36.388736+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:00.686663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.409312+0000","last_change":"2023-10-16T13:49:34.389837+0000","last_active":"2023-10-16T13:49:35.409312+0000","last_peered":"2023-10-16T13:49:35.409312+0000","last_clean":"2023-10-16T13:49:35.409312+0000","last_became_active":"2023-10-16T13:49:34.389516+0000","last_became_peered":"2023-10-16T13:49:34.389516+0000","last_unstale":"2023-10-16T13:49:35.409312+0000","last_undegraded":"2023-10-16T13:49:35.409312+0000","last_fullsized":"2023-10-16T13:49:35.409312+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:55:43.192479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.390283+0000","last_change":"2023-10-16T13:49:35.401639+0000","last_active":"2023-10-16T13:49:36.390283+0000","last_peered":"2023-10-16T13:49:36.390283+0000","last_clean":"2023-10-16T13:49:36.390283+0000","last_became_active":"2023-10-16T13:49:35.401365+0000","last_became_peered":"2023-10-16T13:49:35.401365+0000","last_unstale":"2023-10-16T13:49:36.390283+0000","last_undegraded":"2023-10-16T13:49:36.390283+0000","last_fullsized":"2023-10-16T13:49:36.390283+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:07.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.409786+0000","last_change":"2023-10-16T13:49:34.391007+0000","last_active":"2023-10-16T13:49:35.409786+0000","last_peered":"2023-10-16T13:49:35.409786+0000","last_clean":"2023-10-16T13:49:35.409786+0000","last_became_active":"2023-10-16T13:49:34.390723+0000","last_became_peered":"2023-10-16T13:49:34.390723+0000","last_unstale":"2023-10-16T13:49:35.409786+0000","last_undegraded":"2023-10-16T13:49:35.409786+0000","last_fullsized":"2023-10-16T13:49:35.409786+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:12.917122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510129+0000","last_change":"2023-10-16T13:49:35.400943+0000","last_active":"2023-10-16T13:49:36.510129+0000","last_peered":"2023-10-16T13:49:36.510129+0000","last_clean":"2023-10-16T13:49:36.510129+0000","last_became_active":"2023-10-16T13:49:35.400565+0000","last_became_peered":"2023-10-16T13:49:35.400565+0000","last_unstale":"2023-10-16T13:49:36.510129+0000","last_undegraded":"2023-10-16T13:49:36.510129+0000","last_fullsized":"2023-10-16T13:49:36.510129+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:26:07.179208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.410970+0000","last_change":"2023-10-16T13:49:34.398579+0000","last_active":"2023-10-16T13:49:35.410970+0000","last_peered":"2023-10-16T13:49:35.410970+0000","last_clean":"2023-10-16T13:49:35.410970+0000","last_became_active":"2023-10-16T13:49:34.398279+0000","last_became_peered":"2023-10-16T13:49:34.398279+0000","last_unstale":"2023-10-16T13:49:35.410970+0000","last_undegraded":"2023-10-16T13:49:35.410970+0000","last_fullsized":"2023-10-16T13:49:35.410970+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:32.664738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509293+0000","last_change":"2023-10-16T13:49:35.397398+0000","last_active":"2023-10-16T13:49:36.509293+0000","last_peered":"2023-10-16T13:49:36.509293+0000","last_clean":"2023-10-16T13:49:36.509293+0000","last_became_active":"2023-10-16T13:49:35.397080+0000","last_became_peered":"2023-10-16T13:49:35.397080+0000","last_unstale":"2023-10-16T13:49:36.509293+0000","last_undegraded":"2023-10-16T13:49:36.509293+0000","last_fullsized":"2023-10-16T13:49:36.509293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:11:19.567060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.410648+0000","last_change":"2023-10-16T13:49:34.398131+0000","last_active":"2023-10-16T13:49:35.410648+0000","last_peered":"2023-10-16T13:49:35.410648+0000","last_clean":"2023-10-16T13:49:35.410648+0000","last_became_active":"2023-10-16T13:49:34.397348+0000","last_became_peered":"2023-10-16T13:49:34.397348+0000","last_unstale":"2023-10-16T13:49:35.410648+0000","last_undegraded":"2023-10-16T13:49:35.410648+0000","last_fullsized":"2023-10-16T13:49:35.410648+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:34:56.875464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.388699+0000","last_change":"2023-10-16T13:49:35.389062+0000","last_active":"2023-10-16T13:49:36.388699+0000","last_peered":"2023-10-16T13:49:36.388699+0000","last_clean":"2023-10-16T13:49:36.388699+0000","last_became_active":"2023-10-16T13:49:35.388764+0000","last_became_peered":"2023-10-16T13:49:35.388764+0000","last_unstale":"2023-10-16T13:49:36.388699+0000","last_undegraded":"2023-10-16T13:49:36.388699+0000","last_fullsized":"2023-10-16T13:49:36.388699+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:07.505761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.381112+0000","last_change":"2023-10-16T13:49:34.400842+0000","last_active":"2023-10-16T13:49:35.381112+0000","last_peered":"2023-10-16T13:49:35.381112+0000","last_clean":"2023-10-16T13:49:35.381112+0000","last_became_active":"2023-10-16T13:49:34.400551+0000","last_became_peered":"2023-10-16T13:49:34.400551+0000","last_unstale":"2023-10-16T13:49:35.381112+0000","last_undegraded":"2023-10-16T13:49:35.381112+0000","last_fullsized":"2023-10-16T13:49:35.381112+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:21:01.135412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509627+0000","last_change":"2023-10-16T13:49:35.387916+0000","last_active":"2023-10-16T13:49:36.509627+0000","last_peered":"2023-10-16T13:49:36.509627+0000","last_clean":"2023-10-16T13:49:36.509627+0000","last_became_active":"2023-10-16T13:49:35.387303+0000","last_became_peered":"2023-10-16T13:49:35.387303+0000","last_unstale":"2023-10-16T13:49:36.509627+0000","last_undegraded":"2023-10-16T13:49:36.509627+0000","last_fullsized":"2023-10-16T13:49:36.509627+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:55.003376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.383989+0000","last_change":"2023-10-16T13:49:34.389650+0000","last_active":"2023-10-16T13:49:35.383989+0000","last_peered":"2023-10-16T13:49:35.383989+0000","last_clean":"2023-10-16T13:49:35.383989+0000","last_became_active":"2023-10-16T13:49:34.389351+0000","last_became_peered":"2023-10-16T13:49:34.389351+0000","last_unstale":"2023-10-16T13:49:35.383989+0000","last_undegraded":"2023-10-16T13:49:35.383989+0000","last_fullsized":"2023-10-16T13:49:35.383989+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:36.237990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510311+0000","last_change":"2023-10-16T13:49:35.412443+0000","last_active":"2023-10-16T13:49:36.510311+0000","last_peered":"2023-10-16T13:49:36.510311+0000","last_clean":"2023-10-16T13:49:36.510311+0000","last_became_active":"2023-10-16T13:49:35.412028+0000","last_became_peered":"2023-10-16T13:49:35.412028+0000","last_unstale":"2023-10-16T13:49:36.510311+0000","last_undegraded":"2023-10-16T13:49:36.510311+0000","last_fullsized":"2023-10-16T13:49:36.510311+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:29:26.233885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.385357+0000","last_change":"2023-10-16T13:49:34.388093+0000","last_active":"2023-10-16T13:49:35.385357+0000","last_peered":"2023-10-16T13:49:35.385357+0000","last_clean":"2023-10-16T13:49:35.385357+0000","last_became_active":"2023-10-16T13:49:34.387751+0000","last_became_peered":"2023-10-16T13:49:34.387751+0000","last_unstale":"2023-10-16T13:49:35.385357+0000","last_undegraded":"2023-10-16T13:49:35.385357+0000","last_fullsized":"2023-10-16T13:49:35.385357+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:53.355764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.388902+0000","last_change":"2023-10-16T13:49:35.398023+0000","last_active":"2023-10-16T13:49:36.388902+0000","last_peered":"2023-10-16T13:49:36.388902+0000","last_clean":"2023-10-16T13:49:36.388902+0000","last_became_active":"2023-10-16T13:49:35.397466+0000","last_became_peered":"2023-10-16T13:49:35.397466+0000","last_unstale":"2023-10-16T13:49:36.388902+0000","last_undegraded":"2023-10-16T13:49:36.388902+0000","last_fullsized":"2023-10-16T13:49:36.388902+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:07.897573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"134'3","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.412970+0000","last_change":"2023-10-16T13:49:34.398183+0000","last_active":"2023-10-16T13:49:35.412970+0000","last_peered":"2023-10-16T13:49:35.412970+0000","last_clean":"2023-10-16T13:49:35.412970+0000","last_became_active":"2023-10-16T13:49:34.397043+0000","last_became_peered":"2023-10-16T13:49:34.397043+0000","last_unstale":"2023-10-16T13:49:35.412970+0000","last_undegraded":"2023-10-16T13:49:35.412970+0000","last_fullsized":"2023-10-16T13:49:35.412970+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:22:14.042897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510459+0000","last_change":"2023-10-16T13:49:35.395970+0000","last_active":"2023-10-16T13:49:36.510459+0000","last_peered":"2023-10-16T13:49:36.510459+0000","last_clean":"2023-10-16T13:49:36.510459+0000","last_became_active":"2023-10-16T13:49:35.395674+0000","last_became_peered":"2023-10-16T13:49:35.395674+0000","last_unstale":"2023-10-16T13:49:36.510459+0000","last_undegraded":"2023-10-16T13:49:36.510459+0000","last_fullsized":"2023-10-16T13:49:36.510459+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:21:02.137514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"134'6","reported_seq":18,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.417293+0000","last_change":"2023-10-16T13:49:34.389899+0000","last_active":"2023-10-16T13:49:35.417293+0000","last_peered":"2023-10-16T13:49:35.417293+0000","last_clean":"2023-10-16T13:49:35.417293+0000","last_became_active":"2023-10-16T13:49:34.389634+0000","last_became_peered":"2023-10-16T13:49:34.389634+0000","last_unstale":"2023-10-16T13:49:35.417293+0000","last_undegraded":"2023-10-16T13:49:35.417293+0000","last_fullsized":"2023-10-16T13:49:35.417293+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:36.237990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510258+0000","last_change":"2023-10-16T13:49:35.407628+0000","last_active":"2023-10-16T13:49:36.510258+0000","last_peered":"2023-10-16T13:49:36.510258+0000","last_clean":"2023-10-16T13:49:36.510258+0000","last_became_active":"2023-10-16T13:49:35.406430+0000","last_became_peered":"2023-10-16T13:49:35.406430+0000","last_unstale":"2023-10-16T13:49:36.510258+0000","last_undegraded":"2023-10-16T13:49:36.510258+0000","last_fullsized":"2023-10-16T13:49:36.510258+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:34:11.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.415304+0000","last_change":"2023-10-16T13:49:34.400798+0000","last_active":"2023-10-16T13:49:35.415304+0000","last_peered":"2023-10-16T13:49:35.415304+0000","last_clean":"2023-10-16T13:49:35.415304+0000","last_became_active":"2023-10-16T13:49:34.400515+0000","last_became_peered":"2023-10-16T13:49:34.400515+0000","last_unstale":"2023-10-16T13:49:35.415304+0000","last_undegraded":"2023-10-16T13:49:35.415304+0000","last_fullsized":"2023-10-16T13:49:35.415304+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:04.876567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.388888+0000","last_change":"2023-10-16T13:49:35.400750+0000","last_active":"2023-10-16T13:49:36.388888+0000","last_peered":"2023-10-16T13:49:36.388888+0000","last_clean":"2023-10-16T13:49:36.388888+0000","last_became_active":"2023-10-16T13:49:35.400457+0000","last_became_peered":"2023-10-16T13:49:35.400457+0000","last_unstale":"2023-10-16T13:49:36.388888+0000","last_undegraded":"2023-10-16T13:49:36.388888+0000","last_fullsized":"2023-10-16T13:49:36.388888+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:55.003376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.398647+0000","last_change":"2023-10-16T13:49:34.400922+0000","last_active":"2023-10-16T13:49:35.398647+0000","last_peered":"2023-10-16T13:49:35.398647+0000","last_clean":"2023-10-16T13:49:35.398647+0000","last_became_active":"2023-10-16T13:49:34.400562+0000","last_became_peered":"2023-10-16T13:49:34.400562+0000","last_unstale":"2023-10-16T13:49:35.398647+0000","last_undegraded":"2023-10-16T13:49:35.398647+0000","last_fullsized":"2023-10-16T13:49:35.398647+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:06.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389971+0000","last_change":"2023-10-16T13:49:35.404669+0000","last_active":"2023-10-16T13:49:36.389971+0000","last_peered":"2023-10-16T13:49:36.389971+0000","last_clean":"2023-10-16T13:49:36.389971+0000","last_became_active":"2023-10-16T13:49:35.404410+0000","last_became_peered":"2023-10-16T13:49:35.404410+0000","last_unstale":"2023-10-16T13:49:36.389971+0000","last_undegraded":"2023-10-16T13:49:36.389971+0000","last_fullsized":"2023-10-16T13:49:36.389971+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:08:34.760067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.382554+0000","last_change":"2023-10-16T13:49:34.397761+0000","last_active":"2023-10-16T13:49:35.382554+0000","last_peered":"2023-10-16T13:49:35.382554+0000","last_clean":"2023-10-16T13:49:35.382554+0000","last_became_active":"2023-10-16T13:49:34.396603+0000","last_became_peered":"2023-10-16T13:49:34.396603+0000","last_unstale":"2023-10-16T13:49:35.382554+0000","last_undegraded":"2023-10-16T13:49:35.382554+0000","last_fullsized":"2023-10-16T13:49:35.382554+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:40:05.339415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509616+0000","last_change":"2023-10-16T13:49:35.403082+0000","last_active":"2023-10-16T13:49:36.509616+0000","last_peered":"2023-10-16T13:49:36.509616+0000","last_clean":"2023-10-16T13:49:36.509616+0000","last_became_active":"2023-10-16T13:49:35.402761+0000","last_became_peered":"2023-10-16T13:49:35.402761+0000","last_unstale":"2023-10-16T13:49:36.509616+0000","last_undegraded":"2023-10-16T13:49:36.509616+0000","last_fullsized":"2023-10-16T13:49:36.509616+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:07.897573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"134'8","reported_seq":20,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.415622+0000","last_change":"2023-10-16T13:49:34.400657+0000","last_active":"2023-10-16T13:49:35.415622+0000","last_peered":"2023-10-16T13:49:35.415622+0000","last_clean":"2023-10-16T13:49:35.415622+0000","last_became_active":"2023-10-16T13:49:34.400358+0000","last_became_peered":"2023-10-16T13:49:34.400358+0000","last_unstale":"2023-10-16T13:49:35.415622+0000","last_undegraded":"2023-10-16T13:49:35.415622+0000","last_fullsized":"2023-10-16T13:49:35.415622+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:05:00.706959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510047+0000","last_change":"2023-10-16T13:49:35.401724+0000","last_active":"2023-10-16T13:49:36.510047+0000","last_peered":"2023-10-16T13:49:36.510047+0000","last_clean":"2023-10-16T13:49:36.510047+0000","last_became_active":"2023-10-16T13:49:35.400521+0000","last_became_peered":"2023-10-16T13:49:35.400521+0000","last_unstale":"2023-10-16T13:49:36.510047+0000","last_undegraded":"2023-10-16T13:49:36.510047+0000","last_fullsized":"2023-10-16T13:49:36.510047+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:40.919757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.412038+0000","last_change":"2023-10-16T13:49:34.396563+0000","last_active":"2023-10-16T13:49:35.412038+0000","last_peered":"2023-10-16T13:49:35.412038+0000","last_clean":"2023-10-16T13:49:35.412038+0000","last_became_active":"2023-10-16T13:49:34.396262+0000","last_became_peered":"2023-10-16T13:49:34.396262+0000","last_unstale":"2023-10-16T13:49:35.412038+0000","last_undegraded":"2023-10-16T13:49:35.412038+0000","last_fullsized":"2023-10-16T13:49:35.412038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:48:48.490864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.390372+0000","last_change":"2023-10-16T13:49:35.412243+0000","last_active":"2023-10-16T13:49:36.390372+0000","last_peered":"2023-10-16T13:49:36.390372+0000","last_clean":"2023-10-16T13:49:36.390372+0000","last_became_active":"2023-10-16T13:49:35.411913+0000","last_became_peered":"2023-10-16T13:49:35.411913+0000","last_unstale":"2023-10-16T13:49:36.390372+0000","last_undegraded":"2023-10-16T13:49:36.390372+0000","last_fullsized":"2023-10-16T13:49:36.390372+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:33:49.889095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.411991+0000","last_change":"2023-10-16T13:49:34.399474+0000","last_active":"2023-10-16T13:49:35.411991+0000","last_peered":"2023-10-16T13:49:35.411991+0000","last_clean":"2023-10-16T13:49:35.411991+0000","last_became_active":"2023-10-16T13:49:34.399186+0000","last_became_peered":"2023-10-16T13:49:34.399186+0000","last_unstale":"2023-10-16T13:49:35.411991+0000","last_undegraded":"2023-10-16T13:49:35.411991+0000","last_fullsized":"2023-10-16T13:49:35.411991+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:25:31.618302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.390193+0000","last_change":"2023-10-16T13:49:35.395108+0000","last_active":"2023-10-16T13:49:36.390193+0000","last_peered":"2023-10-16T13:49:36.390193+0000","last_clean":"2023-10-16T13:49:36.390193+0000","last_became_active":"2023-10-16T13:49:35.394778+0000","last_became_peered":"2023-10-16T13:49:35.394778+0000","last_unstale":"2023-10-16T13:49:36.390193+0000","last_undegraded":"2023-10-16T13:49:36.390193+0000","last_fullsized":"2023-10-16T13:49:36.390193+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:29.899503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.413715+0000","last_change":"2023-10-16T13:49:34.400761+0000","last_active":"2023-10-16T13:49:35.413715+0000","last_peered":"2023-10-16T13:49:35.413715+0000","last_clean":"2023-10-16T13:49:35.413715+0000","last_became_active":"2023-10-16T13:49:34.400399+0000","last_became_peered":"2023-10-16T13:49:34.400399+0000","last_unstale":"2023-10-16T13:49:35.413715+0000","last_undegraded":"2023-10-16T13:49:35.413715+0000","last_fullsized":"2023-10-16T13:49:35.413715+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:01.468176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389361+0000","last_change":"2023-10-16T13:49:35.387693+0000","last_active":"2023-10-16T13:49:36.389361+0000","last_peered":"2023-10-16T13:49:36.389361+0000","last_clean":"2023-10-16T13:49:36.389361+0000","last_became_active":"2023-10-16T13:49:35.387401+0000","last_became_peered":"2023-10-16T13:49:35.387401+0000","last_unstale":"2023-10-16T13:49:36.389361+0000","last_undegraded":"2023-10-16T13:49:36.389361+0000","last_fullsized":"2023-10-16T13:49:36.389361+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:22:48.030566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.387439+0000","last_change":"2023-10-16T13:49:34.395404+0000","last_active":"2023-10-16T13:49:35.387439+0000","last_peered":"2023-10-16T13:49:35.387439+0000","last_clean":"2023-10-16T13:49:35.387439+0000","last_became_active":"2023-10-16T13:49:34.395082+0000","last_became_peered":"2023-10-16T13:49:34.395082+0000","last_unstale":"2023-10-16T13:49:35.387439+0000","last_undegraded":"2023-10-16T13:49:35.387439+0000","last_fullsized":"2023-10-16T13:49:35.387439+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:39:40.338942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510105+0000","last_change":"2023-10-16T13:49:35.408969+0000","last_active":"2023-10-16T13:49:36.510105+0000","last_peered":"2023-10-16T13:49:36.510105+0000","last_clean":"2023-10-16T13:49:36.510105+0000","last_became_active":"2023-10-16T13:49:35.408637+0000","last_became_peered":"2023-10-16T13:49:35.408637+0000","last_unstale":"2023-10-16T13:49:36.510105+0000","last_undegraded":"2023-10-16T13:49:36.510105+0000","last_fullsized":"2023-10-16T13:49:36.510105+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:34:11.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.411744+0000","last_change":"2023-10-16T13:49:34.394620+0000","last_active":"2023-10-16T13:49:35.411744+0000","last_peered":"2023-10-16T13:49:35.411744+0000","last_clean":"2023-10-16T13:49:35.411744+0000","last_became_active":"2023-10-16T13:49:34.394333+0000","last_became_peered":"2023-10-16T13:49:34.394333+0000","last_unstale":"2023-10-16T13:49:35.411744+0000","last_undegraded":"2023-10-16T13:49:35.411744+0000","last_fullsized":"2023-10-16T13:49:35.411744+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:34:59.645060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389097+0000","last_change":"2023-10-16T13:49:35.391791+0000","last_active":"2023-10-16T13:49:36.389097+0000","last_peered":"2023-10-16T13:49:36.389097+0000","last_clean":"2023-10-16T13:49:36.389097+0000","last_became_active":"2023-10-16T13:49:35.391536+0000","last_became_peered":"2023-10-16T13:49:35.391536+0000","last_unstale":"2023-10-16T13:49:36.389097+0000","last_undegraded":"2023-10-16T13:49:36.389097+0000","last_fullsized":"2023-10-16T13:49:36.389097+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:40.919757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.382300+0000","last_change":"2023-10-16T13:49:34.387996+0000","last_active":"2023-10-16T13:49:35.382300+0000","last_peered":"2023-10-16T13:49:35.382300+0000","last_clean":"2023-10-16T13:49:35.382300+0000","last_became_active":"2023-10-16T13:49:34.387651+0000","last_became_peered":"2023-10-16T13:49:34.387651+0000","last_unstale":"2023-10-16T13:49:35.382300+0000","last_undegraded":"2023-10-16T13:49:35.382300+0000","last_fullsized":"2023-10-16T13:49:35.382300+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:00:46.395237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389073+0000","last_change":"2023-10-16T13:49:35.389993+0000","last_active":"2023-10-16T13:49:36.389073+0000","last_peered":"2023-10-16T13:49:36.389073+0000","last_clean":"2023-10-16T13:49:36.389073+0000","last_became_active":"2023-10-16T13:49:35.389237+0000","last_became_peered":"2023-10-16T13:49:35.389237+0000","last_unstale":"2023-10-16T13:49:36.389073+0000","last_undegraded":"2023-10-16T13:49:36.389073+0000","last_fullsized":"2023-10-16T13:49:36.389073+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:10.183592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.386409+0000","last_change":"2023-10-16T13:49:34.387240+0000","last_active":"2023-10-16T13:49:35.386409+0000","last_peered":"2023-10-16T13:49:35.386409+0000","last_clean":"2023-10-16T13:49:35.386409+0000","last_became_active":"2023-10-16T13:49:34.386929+0000","last_became_peered":"2023-10-16T13:49:34.386929+0000","last_unstale":"2023-10-16T13:49:35.386409+0000","last_undegraded":"2023-10-16T13:49:35.386409+0000","last_fullsized":"2023-10-16T13:49:35.386409+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:06.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509090+0000","last_change":"2023-10-16T13:49:35.394036+0000","last_active":"2023-10-16T13:49:36.509090+0000","last_peered":"2023-10-16T13:49:36.509090+0000","last_clean":"2023-10-16T13:49:36.509090+0000","last_became_active":"2023-10-16T13:49:35.393718+0000","last_became_peered":"2023-10-16T13:49:35.393718+0000","last_unstale":"2023-10-16T13:49:36.509090+0000","last_undegraded":"2023-10-16T13:49:36.509090+0000","last_fullsized":"2023-10-16T13:49:36.509090+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:42.240131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.391638+0000","last_change":"2023-10-16T13:49:34.391096+0000","last_active":"2023-10-16T13:49:35.391638+0000","last_peered":"2023-10-16T13:49:35.391638+0000","last_clean":"2023-10-16T13:49:35.391638+0000","last_became_active":"2023-10-16T13:49:34.390814+0000","last_became_peered":"2023-10-16T13:49:34.390814+0000","last_unstale":"2023-10-16T13:49:35.391638+0000","last_undegraded":"2023-10-16T13:49:35.391638+0000","last_fullsized":"2023-10-16T13:49:35.391638+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:09.181489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509859+0000","last_change":"2023-10-16T13:49:35.390505+0000","last_active":"2023-10-16T13:49:36.509859+0000","last_peered":"2023-10-16T13:49:36.509859+0000","last_clean":"2023-10-16T13:49:36.509859+0000","last_became_active":"2023-10-16T13:49:35.390202+0000","last_became_peered":"2023-10-16T13:49:35.390202+0000","last_unstale":"2023-10-16T13:49:36.509859+0000","last_undegraded":"2023-10-16T13:49:36.509859+0000","last_fullsized":"2023-10-16T13:49:36.509859+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:38:13.919225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.405180+0000","last_change":"2023-10-16T13:49:34.400612+0000","last_active":"2023-10-16T13:49:35.405180+0000","last_peered":"2023-10-16T13:49:35.405180+0000","last_clean":"2023-10-16T13:49:35.405180+0000","last_became_active":"2023-10-16T13:49:34.400132+0000","last_became_peered":"2023-10-16T13:49:34.400132+0000","last_unstale":"2023-10-16T13:49:35.405180+0000","last_undegraded":"2023-10-16T13:49:35.405180+0000","last_fullsized":"2023-10-16T13:49:35.405180+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:25:59.229758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.510308+0000","last_change":"2023-10-16T13:49:35.406458+0000","last_active":"2023-10-16T13:49:36.510308+0000","last_peered":"2023-10-16T13:49:36.510308+0000","last_clean":"2023-10-16T13:49:36.510308+0000","last_became_active":"2023-10-16T13:49:35.405773+0000","last_became_peered":"2023-10-16T13:49:35.405773+0000","last_unstale":"2023-10-16T13:49:36.510308+0000","last_undegraded":"2023-10-16T13:49:36.510308+0000","last_fullsized":"2023-10-16T13:49:36.510308+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:57:39.821246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.399152+0000","last_change":"2023-10-16T13:49:34.392898+0000","last_active":"2023-10-16T13:49:35.399152+0000","last_peered":"2023-10-16T13:49:35.399152+0000","last_clean":"2023-10-16T13:49:35.399152+0000","last_became_active":"2023-10-16T13:49:34.392606+0000","last_became_peered":"2023-10-16T13:49:34.392606+0000","last_unstale":"2023-10-16T13:49:35.399152+0000","last_undegraded":"2023-10-16T13:49:35.399152+0000","last_fullsized":"2023-10-16T13:49:35.399152+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:54.001274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509466+0000","last_change":"2023-10-16T13:49:35.390726+0000","last_active":"2023-10-16T13:49:36.509466+0000","last_peered":"2023-10-16T13:49:36.509466+0000","last_clean":"2023-10-16T13:49:36.509466+0000","last_became_active":"2023-10-16T13:49:35.390344+0000","last_became_peered":"2023-10-16T13:49:35.390344+0000","last_unstale":"2023-10-16T13:49:36.509466+0000","last_undegraded":"2023-10-16T13:49:36.509466+0000","last_fullsized":"2023-10-16T13:49:36.509466+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:51:16.457742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.398959+0000","last_change":"2023-10-16T13:49:34.393826+0000","last_active":"2023-10-16T13:49:35.398959+0000","last_peered":"2023-10-16T13:49:35.398959+0000","last_clean":"2023-10-16T13:49:35.398959+0000","last_became_active":"2023-10-16T13:49:34.393554+0000","last_became_peered":"2023-10-16T13:49:34.393554+0000","last_unstale":"2023-10-16T13:49:35.398959+0000","last_undegraded":"2023-10-16T13:49:35.398959+0000","last_fullsized":"2023-10-16T13:49:35.398959+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:59.684561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509641+0000","last_change":"2023-10-16T13:49:35.397596+0000","last_active":"2023-10-16T13:49:36.509641+0000","last_peered":"2023-10-16T13:49:36.509641+0000","last_clean":"2023-10-16T13:49:36.509641+0000","last_became_active":"2023-10-16T13:49:35.397026+0000","last_became_peered":"2023-10-16T13:49:35.397026+0000","last_unstale":"2023-10-16T13:49:36.509641+0000","last_undegraded":"2023-10-16T13:49:36.509641+0000","last_fullsized":"2023-10-16T13:49:36.509641+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:39:40.174342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.382310+0000","last_change":"2023-10-16T13:49:34.396417+0000","last_active":"2023-10-16T13:49:35.382310+0000","last_peered":"2023-10-16T13:49:35.382310+0000","last_clean":"2023-10-16T13:49:35.382310+0000","last_became_active":"2023-10-16T13:49:34.396124+0000","last_became_peered":"2023-10-16T13:49:34.396124+0000","last_unstale":"2023-10-16T13:49:35.382310+0000","last_undegraded":"2023-10-16T13:49:35.382310+0000","last_fullsized":"2023-10-16T13:49:35.382310+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:02.004729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509340+0000","last_change":"2023-10-16T13:49:35.388193+0000","last_active":"2023-10-16T13:49:36.509340+0000","last_peered":"2023-10-16T13:49:36.509340+0000","last_clean":"2023-10-16T13:49:36.509340+0000","last_became_active":"2023-10-16T13:49:35.387880+0000","last_became_peered":"2023-10-16T13:49:35.387880+0000","last_unstale":"2023-10-16T13:49:36.509340+0000","last_undegraded":"2023-10-16T13:49:36.509340+0000","last_fullsized":"2023-10-16T13:49:36.509340+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:25:32.620405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.391856+0000","last_change":"2023-10-16T13:49:34.395215+0000","last_active":"2023-10-16T13:49:35.391856+0000","last_peered":"2023-10-16T13:49:35.391856+0000","last_clean":"2023-10-16T13:49:35.391856+0000","last_became_active":"2023-10-16T13:49:34.394976+0000","last_became_peered":"2023-10-16T13:49:34.394976+0000","last_unstale":"2023-10-16T13:49:35.391856+0000","last_undegraded":"2023-10-16T13:49:35.391856+0000","last_fullsized":"2023-10-16T13:49:35.391856+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:10.532539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509344+0000","last_change":"2023-10-16T13:49:35.395065+0000","last_active":"2023-10-16T13:49:36.509344+0000","last_peered":"2023-10-16T13:49:36.509344+0000","last_clean":"2023-10-16T13:49:36.509344+0000","last_became_active":"2023-10-16T13:49:35.394777+0000","last_became_peered":"2023-10-16T13:49:35.394777+0000","last_unstale":"2023-10-16T13:49:36.509344+0000","last_undegraded":"2023-10-16T13:49:36.509344+0000","last_fullsized":"2023-10-16T13:49:36.509344+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:10:03.395149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.391002+0000","last_change":"2023-10-16T13:49:34.390635+0000","last_active":"2023-10-16T13:49:35.391002+0000","last_peered":"2023-10-16T13:49:35.391002+0000","last_clean":"2023-10-16T13:49:35.391002+0000","last_became_active":"2023-10-16T13:49:34.390362+0000","last_became_peered":"2023-10-16T13:49:34.390362+0000","last_unstale":"2023-10-16T13:49:35.391002+0000","last_undegraded":"2023-10-16T13:49:35.391002+0000","last_fullsized":"2023-10-16T13:49:35.391002+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:54:22.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.389244+0000","last_change":"2023-10-16T13:49:35.392363+0000","last_active":"2023-10-16T13:49:36.389244+0000","last_peered":"2023-10-16T13:49:36.389244+0000","last_clean":"2023-10-16T13:49:36.389244+0000","last_became_active":"2023-10-16T13:49:35.392091+0000","last_became_peered":"2023-10-16T13:49:35.392091+0000","last_unstale":"2023-10-16T13:49:36.389244+0000","last_undegraded":"2023-10-16T13:49:36.389244+0000","last_fullsized":"2023-10-16T13:49:36.389244+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:36.240177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.385119+0000","last_change":"2023-10-16T13:49:34.388026+0000","last_active":"2023-10-16T13:49:35.385119+0000","last_peered":"2023-10-16T13:49:35.385119+0000","last_clean":"2023-10-16T13:49:35.385119+0000","last_became_active":"2023-10-16T13:49:34.387683+0000","last_became_peered":"2023-10-16T13:49:34.387683+0000","last_unstale":"2023-10-16T13:49:35.385119+0000","last_undegraded":"2023-10-16T13:49:35.385119+0000","last_fullsized":"2023-10-16T13:49:35.385119+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:41.098255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509887+0000","last_change":"2023-10-16T13:49:35.402799+0000","last_active":"2023-10-16T13:49:36.509887+0000","last_peered":"2023-10-16T13:49:36.509887+0000","last_clean":"2023-10-16T13:49:36.509887+0000","last_became_active":"2023-10-16T13:49:35.402392+0000","last_became_peered":"2023-10-16T13:49:35.402392+0000","last_unstale":"2023-10-16T13:49:36.509887+0000","last_undegraded":"2023-10-16T13:49:36.509887+0000","last_fullsized":"2023-10-16T13:49:36.509887+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:34.523242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.381840+0000","last_change":"2023-10-16T13:49:34.384137+0000","last_active":"2023-10-16T13:49:35.381840+0000","last_peered":"2023-10-16T13:49:35.381840+0000","last_clean":"2023-10-16T13:49:35.381840+0000","last_became_active":"2023-10-16T13:49:34.383811+0000","last_became_peered":"2023-10-16T13:49:34.383811+0000","last_unstale":"2023-10-16T13:49:35.381840+0000","last_undegraded":"2023-10-16T13:49:35.381840+0000","last_fullsized":"2023-10-16T13:49:35.381840+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:58:31.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-16T13:49:36.509894+0000","last_change":"2023-10-16T13:49:35.404619+0000","last_active":"2023-10-16T13:49:36.509894+0000","last_peered":"2023-10-16T13:49:36.509894+0000","last_clean":"2023-10-16T13:49:36.509894+0000","last_became_active":"2023-10-16T13:49:35.404349+0000","last_became_peered":"2023-10-16T13:49:35.404349+0000","last_unstale":"2023-10-16T13:49:36.509894+0000","last_undegraded":"2023-10-16T13:49:36.509894+0000","last_fullsized":"2023-10-16T13:49:36.509894+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:34.368255+0000","last_clean_scrub_stamp":"2023-10-16T13:49:34.368255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:56.217892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.380785+0000","last_change":"2023-10-16T13:49:34.393087+0000","last_active":"2023-10-16T13:49:35.380785+0000","last_peered":"2023-10-16T13:49:35.380785+0000","last_clean":"2023-10-16T13:49:35.380785+0000","last_became_active":"2023-10-16T13:49:34.392733+0000","last_became_peered":"2023-10-16T13:49:34.392733+0000","last_unstale":"2023-10-16T13:49:35.380785+0000","last_undegraded":"2023-10-16T13:49:35.380785+0000","last_fullsized":"2023-10-16T13:49:35.380785+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:49:33.366153+0000","last_clean_scrub_stamp":"2023-10-16T13:49:33.366153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:26.585894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":266,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-10-16T13:49:35.381237+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:49:35.381237+0000","last_peered":"2023-10-16T13:49:35.381237+0000","last_clean":"2023-10-16T13:49:35.381237+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:49:35.381237+0000","last_undegraded":"2023-10-16T13:49:35.381237+0000","last_fullsized":"2023-10-16T13:49:35.381237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574988,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33440,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338400,"statfs":{"total":96636764160,"available":96602521600,"internally_reserved":0,"allocated":2310144,"data_stored":1358762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.753}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.58699999999999997,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.93100000000000005},"last":0.72299999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.56999999999999995,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.47799999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.309},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.46000000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.90600000000000003},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.51000000000000001,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574989,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":1708032,"data_stored":768290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.497},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.36899999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.40000000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.46600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1720320,"data_stored":769902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.26500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.622,"5min":0.622,"15min":1.1619999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.752},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":0.88},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.34899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":1.905},"last":0.63},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.879},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0549999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.925},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.085},"last":0.67900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":2301952,"data_stored":1357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.23100000000000001}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.26900000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.504}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.49099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":1716224,"data_stored":767965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34399999999999997,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.38700000000000001},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.29199999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.48899999999999999,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.20599999999999999},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48899999999999999,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":8.1129999999999995,"5min":8.1129999999999995,"15min":8.1129999999999995},"last":0.32600000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.367,"5min":5.367,"15min":5.367},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.379},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61399999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":2.141,"5min":2.141,"15min":4.0609999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.2690000000000001,"5min":5.2690000000000001,"15min":6.0499999999999998},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1720320,"data_stored":768484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.629,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65000000000000002,"5min":0.73599999999999999,"15min":2.181},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.5,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.435},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"max":{"1min":0.67100000000000004,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.70799999999999996}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.71199999999999997},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.66000000000000003},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":1.264,"15min":2.4039999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.752}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.63},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":1.298,"15min":2.4430000000000001},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1724416,"data_stored":770484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.376},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.313},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.5}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.41399999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.33700000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.47399999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.46200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574989,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":1708032,"data_stored":768290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41699999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.39700000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.504},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:49:39.950 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:49:39.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:49:40.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.114+0000 7f9bc3b05700 1 Processor -- start 2023-10-16T13:49:40.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 -- start start 2023-10-16T13:49:40.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9bbc0cc7d0 0x7f9bbc0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bbc06a840 0x7f9bbc06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0cb040 con 0x7f9bbc06a840 2023-10-16T13:49:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc06b1e0 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.115+0000 7f9bc3b05700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc15df90 con 0x7f9bbc15dbb0 2023-10-16T13:49:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bbc06a840 0x7f9bbc06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bbc06a840 0x7f9bbc06aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50634/0 (socket says 172.21.15.5:50634) 2023-10-16T13:49:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 -- 172.21.15.5:0/1057603421 learned_addr learned my addr 172.21.15.5:0/1057603421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc18a1700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 -- 172.21.15.5:0/1057603421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 msgr2=0x7f9bbc0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc10a0700 1 --2- 172.21.15.5:0/1057603421 >> v2:172.21.15.112:3300/0 conn(0x7f9bbc0cc7d0 0x7f9bbc0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 -- 172.21.15.5:0/1057603421 >> v2:172.21.15.112:3300/0 conn(0x7f9bbc0cc7d0 msgr2=0x7f9bbc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 --2- 172.21.15.5:0/1057603421 >> v2:172.21.15.112:3300/0 conn(0x7f9bbc0cc7d0 0x7f9bbc0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 -- 172.21.15.5:0/1057603421 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc161a60 con 0x7f9bbc06a840 2023-10-16T13:49:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc18a1700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc10a0700 1 --2- 172.21.15.5:0/1057603421 >> v2:172.21.15.112:3300/0 conn(0x7f9bbc0cc7d0 0x7f9bbc0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc20a2700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc06a840 0x7f9bbc06aca0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0cdff0 tx=0x7f9bb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c0be944d3ed261 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc089f700 1 -- 172.21.15.5:0/1057603421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400e070 con 0x7f9bbc06a840 2023-10-16T13:49:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc089f700 1 -- 172.21.15.5:0/1057603421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400b9c0 con 0x7f9bbc06a840 2023-10-16T13:49:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.116+0000 7f9bc089f700 1 -- 172.21.15.5:0/1057603421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400bd70 con 0x7f9bbc06a840 2023-10-16T13:49:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 -- 172.21.15.5:0/1057603421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc06a840 msgr2=0x7f9bbc06aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc06a840 0x7f9bbc06aca0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0cdff0 tx=0x7f9bb400b330 comp rx=0 tx=0).stop 2023-10-16T13:49:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 -- 172.21.15.5:0/1057603421 shutdown_connections 2023-10-16T13:49:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc06a840 0x7f9bbc06aca0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/1057603421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/1057603421 >> v2:172.21.15.112:3300/0 conn(0x7f9bbc0cc7d0 0x7f9bbc0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 -- 172.21.15.5:0/1057603421 >> 172.21.15.5:0/1057603421 conn(0x7f9bbc06dac0 msgr2=0x7f9bbc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 -- 172.21.15.5:0/1057603421 shutdown_connections 2023-10-16T13:49:40.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.117+0000 7f9bc3b05700 1 -- 172.21.15.5:0/1057603421 wait complete. 2023-10-16T13:49:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.118+0000 7f9bc3b05700 1 Processor -- start 2023-10-16T13:49:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.118+0000 7f9bc3b05700 1 -- start start 2023-10-16T13:49:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc3b05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc06a840 0x7f9bbc1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc3b05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 0x7f9bbc157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc3b05700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc3b05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc1f6c50 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc3b05700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc1f6f30 con 0x7f9bbc06a840 2023-10-16T13:49:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc3b05700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc1f7210 con 0x7f9bbc15dbb0 2023-10-16T13:49:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc10a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 0x7f9bbc157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc10a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 0x7f9bbc157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50642/0 (socket says 172.21.15.5:50642) 2023-10-16T13:49:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc10a0700 1 -- 172.21.15.5:0/2888783278 learned_addr learned my addr 172.21.15.5:0/2888783278 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc18a1700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc06a840 0x7f9bbc1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.119+0000 7f9bc20a2700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc10a0700 1 -- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 msgr2=0x7f9bbc0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc10a0700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc10a0700 1 -- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc06a840 msgr2=0x7f9bbc1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc10a0700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc06a840 0x7f9bbc1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc10a0700 1 -- 172.21.15.5:0/2888783278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009b30 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc18a1700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc06a840 0x7f9bbc1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc10a0700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 0x7f9bbc157de0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c750 tx=0x7f9bb800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011800 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8011960 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc15e200 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011cd0 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.120+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0c6df0 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.121+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc067d20 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.121+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f9bb8021350 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.122+0000 7f9bb27fc700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9ba006b2f0 0x7f9ba006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.122+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bb8089d00 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.122+0000 7f9bc18a1700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9ba006b2f0 0x7f9ba006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.123+0000 7f9bc18a1700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9ba006b2f0 0x7f9ba006d7b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9bac006fd0 tx=0x7f9bac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.127+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bb8054750 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.414+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9bbc0b6430 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.419+0000 7f9bb27fc700 1 -- 172.21.15.5:0/2888783278 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9bb801e0e0 con 0x7f9bbc0cc7d0 2023-10-16T13:49:40.422 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-16T13:49:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCaPC1law4nEBAAMIsgPw0P2S/Xn+fimFH5kQ== 2023-10-16T13:49:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-10-16T13:49:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-10-16T13:49:40.423 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:49:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.421+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9ba006b2f0 msgr2=0x7f9ba006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.421+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9ba006b2f0 0x7f9ba006d7b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9bac006fd0 tx=0x7f9bac008040 comp rx=0 tx=0).stop 2023-10-16T13:49:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.421+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 msgr2=0x7f9bbc157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.421+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 0x7f9bbc157de0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c750 tx=0x7f9bb800cb10 comp rx=0 tx=0).stop 2023-10-16T13:49:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 shutdown_connections 2023-10-16T13:49:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9ba006b2f0 0x7f9ba006d7b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bbc15dbb0 0x7f9bbc0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc06a840 0x7f9bbc1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 --2- 172.21.15.5:0/2888783278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bbc0cc7d0 0x7f9bbc157de0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 >> 172.21.15.5:0/2888783278 conn(0x7f9bbc06dac0 msgr2=0x7f9bbc0cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 shutdown_connections 2023-10-16T13:49:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.422+0000 7f9bc3b05700 1 -- 172.21.15.5:0/2888783278 wait complete. 2023-10-16T13:49:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-10-16T13:49:40.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.559+0000 7f6dc8136700 1 Processor -- start 2023-10-16T13:49:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.559+0000 7f6dc8136700 1 -- start start 2023-10-16T13:49:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc8136700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6dc015ab10 0x7f6dc015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc8136700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b1f50 0x7f6dc00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc8136700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6dc00b23d0 0x7f6dc00cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc8136700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc015e7a0 con 0x7f6dc00b23d0 2023-10-16T13:49:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc8136700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc015f730 con 0x7f6dc015ab10 2023-10-16T13:49:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc8136700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00b29a0 con 0x7f6dc00b1f50 2023-10-16T13:49:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc66d3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6dc00b23d0 0x7f6dc00cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc66d3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6dc00b23d0 0x7f6dc00cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50652/0 (socket says 172.21.15.5:50652) 2023-10-16T13:49:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc66d3700 1 -- 172.21.15.5:0/3281871081 learned_addr learned my addr 172.21.15.5:0/3281871081 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc5ed2700 1 --2- 172.21.15.5:0/3281871081 >> v2:172.21.15.112:3300/0 conn(0x7f6dc015ab10 0x7f6dc015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc56d1700 1 --2- 172.21.15.5:0/3281871081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b1f50 0x7f6dc00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc66d3700 1 -- 172.21.15.5:0/3281871081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b1f50 msgr2=0x7f6dc00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.560+0000 7f6dc66d3700 1 --2- 172.21.15.5:0/3281871081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b1f50 0x7f6dc00cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc66d3700 1 -- 172.21.15.5:0/3281871081 >> v2:172.21.15.112:3300/0 conn(0x7f6dc015ab10 msgr2=0x7f6dc015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc66d3700 1 --2- 172.21.15.5:0/3281871081 >> v2:172.21.15.112:3300/0 conn(0x7f6dc015ab10 0x7f6dc015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc66d3700 1 -- 172.21.15.5:0/3281871081 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc00b2c80 con 0x7f6dc00b23d0 2023-10-16T13:49:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc5ed2700 1 --2- 172.21.15.5:0/3281871081 >> v2:172.21.15.112:3300/0 conn(0x7f6dc015ab10 0x7f6dc015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc66d3700 1 --2- 172.21.15.5:0/3281871081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b23d0 0x7f6dc00cfc60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00d0430 tx=0x7f6db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce04793bd7582328 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc4ed0700 1 -- 172.21.15.5:0/3281871081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db800e070 con 0x7f6dc00b23d0 2023-10-16T13:49:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc4ed0700 1 -- 172.21.15.5:0/3281871081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db800b9c0 con 0x7f6dc00b23d0 2023-10-16T13:49:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc4ed0700 1 -- 172.21.15.5:0/3281871081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db800bd70 con 0x7f6dc00b23d0 2023-10-16T13:49:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 -- 172.21.15.5:0/3281871081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b23d0 msgr2=0x7f6dc00cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 --2- 172.21.15.5:0/3281871081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b23d0 0x7f6dc00cfc60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00d0430 tx=0x7f6db800b330 comp rx=0 tx=0).stop 2023-10-16T13:49:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 -- 172.21.15.5:0/3281871081 shutdown_connections 2023-10-16T13:49:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 --2- 172.21.15.5:0/3281871081 >> v2:172.21.15.112:3300/0 conn(0x7f6dc015ab10 0x7f6dc015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 --2- 172.21.15.5:0/3281871081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b23d0 0x7f6dc00cfc60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 --2- 172.21.15.5:0/3281871081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b1f50 0x7f6dc00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.561+0000 7f6dc8136700 1 -- 172.21.15.5:0/3281871081 >> 172.21.15.5:0/3281871081 conn(0x7f6dc006dae0 msgr2=0x7f6dc006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.562+0000 7f6dc8136700 1 -- 172.21.15.5:0/3281871081 shutdown_connections 2023-10-16T13:49:40.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.562+0000 7f6dc8136700 1 -- 172.21.15.5:0/3281871081 wait complete. 2023-10-16T13:49:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.563+0000 7f6dc8136700 1 Processor -- start 2023-10-16T13:49:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.563+0000 7f6dc8136700 1 -- start start 2023-10-16T13:49:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc8136700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 0x7f6dc00c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc8136700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b23d0 0x7f6dc00c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc8136700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dc015ab10 0x7f6dc015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc8136700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc015d9b0 con 0x7f6dc00b1f50 2023-10-16T13:49:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc8136700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc015dc00 con 0x7f6dc015ab10 2023-10-16T13:49:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc8136700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00c7e10 con 0x7f6dc00b23d0 2023-10-16T13:49:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc5ed2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 0x7f6dc00c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc5ed2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 0x7f6dc00c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50654/0 (socket says 172.21.15.5:50654) 2023-10-16T13:49:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc5ed2700 1 -- 172.21.15.5:0/507215223 learned_addr learned my addr 172.21.15.5:0/507215223 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.564+0000 7f6dc56d1700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b23d0 0x7f6dc00c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc5ed2700 1 -- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b23d0 msgr2=0x7f6dc00c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc5ed2700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b23d0 0x7f6dc00c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc5ed2700 1 -- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dc015ab10 msgr2=0x7f6dc015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc5ed2700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dc015ab10 0x7f6dc015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc5ed2700 1 -- 172.21.15.5:0/507215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8009b30 con 0x7f6dc00b1f50 2023-10-16T13:49:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc5ed2700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 0x7f6dc00c6f80 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c7f0 tx=0x7f6dbc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc011800 con 0x7f6dc00b1f50 2023-10-16T13:49:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc011960 con 0x7f6dc00b1f50 2023-10-16T13:49:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc00c80f0 con 0x7f6dc00b1f50 2023-10-16T13:49:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc011d10 con 0x7f6dc00b1f50 2023-10-16T13:49:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.565+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc01efbc0 con 0x7f6dc00b1f50 2023-10-16T13:49:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.566+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc0067d20 con 0x7f6dc00b1f50 2023-10-16T13:49:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.566+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6dbc018360 con 0x7f6dc00b1f50 2023-10-16T13:49:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.567+0000 7f6db67fc700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6da406b2f0 0x7f6da406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.567+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dbc089dd0 con 0x7f6dc00b1f50 2023-10-16T13:49:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.567+0000 7f6dc56d1700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6da406b2f0 0x7f6da406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.568+0000 7f6dc56d1700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6da406b2f0 0x7f6da406d7b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6dc015b9f0 tx=0x7f6db0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.572+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dbc054790 con 0x7f6dc00b1f50 2023-10-16T13:49:40.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.813+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dc00cf820 con 0x7f6dc00b1f50 2023-10-16T13:49:40.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.814+0000 7f6db67fc700 1 -- 172.21.15.5:0/507215223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f6dbc01f090 con 0x7f6dc00b1f50 2023-10-16T13:49:40.817 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:40.817 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:49:34.794871+0000","modified":"2023-10-16T13:49:37.820862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8229":{"gid":8229,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2779373791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2779373791},{"type":"v1","addr":"172.21.15.112:6837","nonce":2779373791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-10-16T13:49:40.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6da406b2f0 msgr2=0x7f6da406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6da406b2f0 0x7f6da406d7b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6dc015b9f0 tx=0x7f6db0008040 comp rx=0 tx=0).stop 2023-10-16T13:49:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 msgr2=0x7f6dc00c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 0x7f6dc00c6f80 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c7f0 tx=0x7f6dbc00cbb0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 shutdown_connections 2023-10-16T13:49:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dc015ab10 0x7f6dc015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc00b1f50 0x7f6dc00c6f80 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6da406b2f0 0x7f6da406d7b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 --2- 172.21.15.5:0/507215223 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6dc00b23d0 0x7f6dc00c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 >> 172.21.15.5:0/507215223 conn(0x7f6dc006dae0 msgr2=0x7f6dc01586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 shutdown_connections 2023-10-16T13:49:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:40.816+0000 7f6dc8136700 1 -- 172.21.15.5:0/507215223 wait complete. 2023-10-16T13:49:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 98 2023-10-16T13:49:41.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:49:34.794871+0000', 'modified': '2023-10-16T13:49:37.820862+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8229}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8229': {'gid': 8229, 'name': 'd', 'rank': 0, 'incarnation': 94, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/2779373791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 2779373791}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 2779373791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:49:41.235 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:49:41.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T13:49:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.366+0000 7f54240c6700 1 Processor -- start 2023-10-16T13:49:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f54240c6700 1 -- start start 2023-10-16T13:49:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f54240c6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f541c15a850 0x7f541c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f54240c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0b2940 0x7f541c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f54240c6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0ce3b0 con 0x7f541c0cd2e0 2023-10-16T13:49:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f54240c6700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c0b2df0 con 0x7f541c15a850 2023-10-16T13:49:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f54240c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0b6290 con 0x7f541c0b2940 2023-10-16T13:49:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f5421e62700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f541c15a850 0x7f541c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f5421e62700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f541c15a850 0x7f541c0cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50662/0 (socket says 172.21.15.5:50662) 2023-10-16T13:49:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f5422663700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f541c0cd2e0 0x7f541c071ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60670/0 (socket says 172.21.15.5:60670) 2023-10-16T13:49:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.367+0000 7f5421e62700 1 -- 172.21.15.5:0/238089137 learned_addr learned my addr 172.21.15.5:0/238089137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5421661700 1 --2- 172.21.15.5:0/238089137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0b2940 0x7f541c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5421e62700 1 -- 172.21.15.5:0/238089137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0b2940 msgr2=0x7f541c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5421e62700 1 --2- 172.21.15.5:0/238089137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0b2940 0x7f541c0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5421e62700 1 -- 172.21.15.5:0/238089137 >> v1:172.21.15.5:6789/0 conn(0x7f541c0cd2e0 legacy=0x7f541c071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5421e62700 1 -- 172.21.15.5:0/238089137 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0cc220 con 0x7f541c15a850 2023-10-16T13:49:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5420e60700 1 -- 172.21.15.5:0/238089137 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180282121 0 0) 0x7f541c0ce3b0 con 0x7f541c0cd2e0 2023-10-16T13:49:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5421e62700 1 --2- 172.21.15.5:0/238089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c15a850 0x7f541c0cbc40 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f54180098f0 tx=0x7f5418009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cecd7408ec8b50 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5420e60700 1 -- 172.21.15.5:0/238089137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800b8a0 con 0x7f541c15a850 2023-10-16T13:49:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5420e60700 1 -- 172.21.15.5:0/238089137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800ba00 con 0x7f541c15a850 2023-10-16T13:49:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.368+0000 7f5420e60700 1 -- 172.21.15.5:0/238089137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800bd90 con 0x7f541c15a850 2023-10-16T13:49:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 -- 172.21.15.5:0/238089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c15a850 msgr2=0x7f541c0cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 --2- 172.21.15.5:0/238089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c15a850 0x7f541c0cbc40 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f54180098f0 tx=0x7f5418009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 -- 172.21.15.5:0/238089137 shutdown_connections 2023-10-16T13:49:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 --2- 172.21.15.5:0/238089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c15a850 0x7f541c0cbc40 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 --2- 172.21.15.5:0/238089137 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0b2940 0x7f541c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 -- 172.21.15.5:0/238089137 >> 172.21.15.5:0/238089137 conn(0x7f541c06dac0 msgr2=0x7f541c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 -- 172.21.15.5:0/238089137 shutdown_connections 2023-10-16T13:49:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.369+0000 7f54240c6700 1 -- 172.21.15.5:0/238089137 wait complete. 2023-10-16T13:49:41.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.370+0000 7f54240c6700 1 Processor -- start 2023-10-16T13:49:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.370+0000 7f54240c6700 1 -- start start 2023-10-16T13:49:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f54240c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 0x7f541c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f54240c6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0cd2e0 0x7f541c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f54240c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541c15a850 0x7f541c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f54240c6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c15c7d0 con 0x7f541c0b2940 2023-10-16T13:49:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f54240c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14fdb0 con 0x7f541c15a850 2023-10-16T13:49:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f54240c6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c15daa0 con 0x7f541c0cd2e0 2023-10-16T13:49:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 0x7f541c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 0x7f541c15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50668/0 (socket says 172.21.15.5:50668) 2023-10-16T13:49:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 -- 172.21.15.5:0/3211664666 learned_addr learned my addr 172.21.15.5:0/3211664666 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421661700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0cd2e0 0x7f541c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5422663700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541c15a850 0x7f541c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 -- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0cd2e0 msgr2=0x7f541c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0cd2e0 0x7f541c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 -- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541c15a850 msgr2=0x7f541c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541c15a850 0x7f541c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 -- 172.21.15.5:0/3211664666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009550 con 0x7f541c0b2940 2023-10-16T13:49:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f5421e62700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 0x7f541c15c130 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5418009c40 tx=0x7f5418004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.371+0000 7f540e7fc700 1 -- 172.21.15.5:0/3211664666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180036a0 con 0x7f541c0b2940 2023-10-16T13:49:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.372+0000 7f540e7fc700 1 -- 172.21.15.5:0/3211664666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541801f070 con 0x7f541c0b2940 2023-10-16T13:49:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.372+0000 7f540e7fc700 1 -- 172.21.15.5:0/3211664666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418003a60 con 0x7f541c0b2940 2023-10-16T13:49:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.372+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c14f480 con 0x7f541c0b2940 2023-10-16T13:49:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.372+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c14fa40 con 0x7f541c0b2940 2023-10-16T13:49:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.373+0000 7f540e7fc700 1 -- 172.21.15.5:0/3211664666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5418003bc0 con 0x7f541c0b2940 2023-10-16T13:49:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.373+0000 7f540e7fc700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f540006b2f0 0x7f540006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.373+0000 7f540e7fc700 1 -- 172.21.15.5:0/3211664666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5418021070 con 0x7f541c0b2940 2023-10-16T13:49:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.374+0000 7f5421661700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f540006b2f0 0x7f540006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.374+0000 7f5421661700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f540006b2f0 0x7f540006d7b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f541c0cf7e0 tx=0x7f5410008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.375+0000 7f54302b0b80 1 Processor -- start 2023-10-16T13:49:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 -- start start 2023-10-16T13:49:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b4220 0x55c7c02bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c028f010 0x55c7c028f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c0205c20 con 0x55c7c02b9630 2023-10-16T13:49:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c01eac10 con 0x55c7c02b4220 2023-10-16T13:49:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c01e8530 con 0x55c7c028f010 2023-10-16T13:49:41.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f5421661700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f5421661700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02bbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50678/0 (socket says 172.21.15.5:50678) 2023-10-16T13:49:41.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f5421661700 1 -- 172.21.15.5:0/2455271779 learned_addr learned my addr 172.21.15.5:0/2455271779 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f5422663700 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c028f010 0x55c7c028f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.376+0000 7f5421e62700 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b4220 0x55c7c02bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f5421661700 1 -- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c028f010 msgr2=0x55c7c028f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f5421661700 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c028f010 0x55c7c028f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f5421661700 1 -- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b4220 msgr2=0x55c7c02bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f5421661700 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b4220 0x55c7c02bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f5421661700 1 -- 172.21.15.5:0/2455271779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7c01a13a0 con 0x55c7c02b9630 2023-10-16T13:49:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f5421661700 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02bbfb0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f541000b170 tx=0x7f5410012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e88a2631eb046d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f53ff7fe700 1 -- 172.21.15.5:0/2455271779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410014660 con 0x55c7c02b9630 2023-10-16T13:49:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f53ff7fe700 1 -- 172.21.15.5:0/2455271779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410019070 con 0x55c7c02b9630 2023-10-16T13:49:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.377+0000 7f53ff7fe700 1 -- 172.21.15.5:0/2455271779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100149c0 con 0x55c7c02b9630 2023-10-16T13:49:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 -- 172.21.15.5:0/2455271779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 msgr2=0x55c7c02bbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02bbfb0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f541000b170 tx=0x7f5410012000 comp rx=0 tx=0).stop 2023-10-16T13:49:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 -- 172.21.15.5:0/2455271779 shutdown_connections 2023-10-16T13:49:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c028f010 0x55c7c028f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b4220 0x55c7c02bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 --2- 172.21.15.5:0/2455271779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02bbfb0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 -- 172.21.15.5:0/2455271779 >> 172.21.15.5:0/2455271779 conn(0x55c7c01bed80 msgr2=0x55c7c02d9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 -- 172.21.15.5:0/2455271779 shutdown_connections 2023-10-16T13:49:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 -- 172.21.15.5:0/2455271779 wait complete. 2023-10-16T13:49:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 -- start start 2023-10-16T13:49:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.378+0000 7f54302b0b80 1 Processor -- start 2023-10-16T13:49:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c02d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c01e3e20 con 0x55c7c028f010 2023-10-16T13:49:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c01806c0 con 0x55c7c02b9630 2023-10-16T13:49:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c0180360 con 0x55c7c02b4220 2023-10-16T13:49:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f54302b0b80 10 client.0 _ll_register_callbacks cb 0x55c7bffdd7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:49:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f5421e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.379+0000 7f5421e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50682/0 (socket says 172.21.15.5:50682) 2023-10-16T13:49:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 -- 172.21.15.5:0/3711619701 learned_addr learned my addr 172.21.15.5:0/3711619701 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5422663700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421661700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c02d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 -- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 msgr2=0x55c7c02d6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c02d6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 -- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 msgr2=0x55c7c02b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 -- 172.21.15.5:0/3711619701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541000e040 con 0x55c7c028f010 2023-10-16T13:49:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421661700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c02d6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f5421e62700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02bf140 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f5418009520 tx=0x7f5418058430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a03e945e58192c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f53fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:49:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f53fcff9700 1 -- 172.21.15.5:0/3711619701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418089ea0 con 0x55c7c028f010 2023-10-16T13:49:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f53fcff9700 1 -- 172.21.15.5:0/3711619701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5418059e80 con 0x55c7c028f010 2023-10-16T13:49:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7c02845b0 con 0x55c7c028f010 2023-10-16T13:49:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f53fcff9700 1 -- 172.21.15.5:0/3711619701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f541805dfd0 con 0x55c7c028f010 2023-10-16T13:49:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f54302b0b80 10 client.8364 fetch_fsmap learned FSMap version 98 2023-10-16T13:49:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x55c7c000ed90 con 0x55c7c028f010 2023-10-16T13:49:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f53fcff9700 1 -- 172.21.15.5:0/3711619701 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7c02845b0 con 0x55c7c028f010 2023-10-16T13:49:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.380+0000 7f53fcff9700 1 -- 172.21.15.5:0/3711619701 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 98) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f541806dbd0 con 0x55c7c028f010 2023-10-16T13:49:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f54302b0b80 10 client.8364 fetch_fsmap finished waiting for FSMap version 98 2023-10-16T13:49:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f54302b0b80 10 client.8364 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T13:49:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f54302b0b80 20 client.8364 populate_metadata read hostname 'smithi005' 2023-10-16T13:49:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bc9e0 0x55c7c02bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f54302b0b80 4 client.8364 mds_command: new command op to 8229 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:49:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 --> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7c01dce00 con 0x55c7c02bc9e0 2023-10-16T13:49:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f5421661700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bc9e0 0x55c7c02bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f5421661700 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bc9e0 0x55c7c02bcdc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7adf2639b63ac server_cookie=e58023ef69716da1 in_seq=0 out_seq=0 2023-10-16T13:49:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.381+0000 7f53fcff9700 10 client.8364 ms_handle_connect on v2:172.21.15.112:6835/2779373791 2023-10-16T13:49:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f53fcff9700 1 -- 172.21.15.5:0/3711619701 <== mds.0 v2:172.21.15.112:6835/2779373791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7c01dce00 con 0x55c7c02bc9e0 2023-10-16T13:49:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f53fcff9700 10 client.8364 handle_command_reply: tid=0 2023-10-16T13:49:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 client.8364 shutdown 2023-10-16T13:49:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 msgr2=0x55c7c02bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02bf140 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f5418009520 tx=0x7f5418058430 comp rx=0 tx=0).stop 2023-10-16T13:49:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 shutdown_connections 2023-10-16T13:49:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bc9e0 0x55c7c02bcdc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02bf140 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f53fcff9700 0 client.8364 ms_handle_reset on v2:172.21.15.112:6835/2779373791 2023-10-16T13:49:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3711619701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c02d6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 >> 172.21.15.5:0/3711619701 conn(0x55c7c01bed80 msgr2=0x55c7c02d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 shutdown_connections 2023-10-16T13:49:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 1 -- 172.21.15.5:0/3711619701 wait complete. 2023-10-16T13:49:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.382+0000 7f54302b0b80 20 client.8364 trim_cache size 0 max 16384 2023-10-16T13:49:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.400+0000 7f54302b0b80 1 Processor -- start 2023-10-16T13:49:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.400+0000 7f54302b0b80 1 -- start start 2023-10-16T13:49:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c028f010 0x55c7c028ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c028bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f54302b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c00648d0 con 0x55c7c02b9630 2023-10-16T13:49:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c02b7510 con 0x55c7c028f010 2023-10-16T13:49:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c026e4c0 con 0x55c7c02b4220 2023-10-16T13:49:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50694/0 (socket says 172.21.15.5:50694) 2023-10-16T13:49:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 -- 172.21.15.5:0/3710592651 learned_addr learned my addr 172.21.15.5:0/3710592651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5421661700 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c028bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5421e62700 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c028f010 0x55c7c028ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 -- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 msgr2=0x55c7c028bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c028bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 -- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c028f010 msgr2=0x55c7c028ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c028f010 0x55c7c028ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5422663700 1 -- 172.21.15.5:0/3710592651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0c52d0 con 0x55c7c02b9630 2023-10-16T13:49:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.401+0000 7f5421e62700 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c028f010 0x55c7c028ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f5422663700 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02b5610 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f5414007050 tx=0x7f5414007360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97854da60346caf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f53fffff700 1 -- 172.21.15.5:0/3710592651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414016630 con 0x55c7c02b9630 2023-10-16T13:49:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f53fffff700 1 -- 172.21.15.5:0/3710592651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414016790 con 0x55c7c02b9630 2023-10-16T13:49:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f53fffff700 1 -- 172.21.15.5:0/3710592651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414016b20 con 0x55c7c02b9630 2023-10-16T13:49:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 -- 172.21.15.5:0/3710592651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 msgr2=0x55c7c02b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02b5610 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f5414007050 tx=0x7f5414007360 comp rx=0 tx=0).stop 2023-10-16T13:49:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 -- 172.21.15.5:0/3710592651 shutdown_connections 2023-10-16T13:49:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c02b9630 0x55c7c02b5610 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c028f010 0x55c7c028ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 --2- 172.21.15.5:0/3710592651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c028bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 -- 172.21.15.5:0/3710592651 >> 172.21.15.5:0/3710592651 conn(0x55c7c01bed80 msgr2=0x55c7c02f8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 -- 172.21.15.5:0/3710592651 shutdown_connections 2023-10-16T13:49:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.402+0000 7f54302b0b80 1 -- 172.21.15.5:0/3710592651 wait complete. 2023-10-16T13:49:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.403+0000 7f54302b0b80 1 -- start start 2023-10-16T13:49:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.403+0000 7f54302b0b80 1 Processor -- start 2023-10-16T13:49:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c0341a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c02e89e0 con 0x55c7c028f010 2023-10-16T13:49:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c0341f80 con 0x55c7c02b9630 2023-10-16T13:49:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c02900a0 con 0x55c7c02b4220 2023-10-16T13:49:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f54302b0b80 10 client.0 _ll_register_callbacks cb 0x7f5418059a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:49:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02d9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50696/0 (socket says 172.21.15.5:50696) 2023-10-16T13:49:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 -- 172.21.15.5:0/604986813 learned_addr learned my addr 172.21.15.5:0/604986813 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421661700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c0341a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5422663700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 -- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 msgr2=0x55c7c0341a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c0341a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 -- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 msgr2=0x55c7c02b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421e62700 1 -- 172.21.15.5:0/604986813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541400f040 con 0x55c7c028f010 2023-10-16T13:49:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5421661700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c0341a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.404+0000 7f5422663700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f5421e62700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02d9f00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f541800b160 tx=0x7f5418006b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9a61f682c2cd01 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f53fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-16T13:49:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f53fcff9700 1 -- 172.21.15.5:0/604986813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418089ea0 con 0x55c7c028f010 2023-10-16T13:49:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f53fcff9700 1 -- 172.21.15.5:0/604986813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5418059e80 con 0x55c7c028f010 2023-10-16T13:49:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5410019070 con 0x55c7c028f010 2023-10-16T13:49:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f53fcff9700 1 -- 172.21.15.5:0/604986813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f541805dfd0 con 0x55c7c028f010 2023-10-16T13:49:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 10 client.8370 fetch_fsmap learned FSMap version 98 2023-10-16T13:49:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x55c7bfff7c10 con 0x55c7c028f010 2023-10-16T13:49:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f53fcff9700 1 -- 172.21.15.5:0/604986813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410019070 con 0x55c7c028f010 2023-10-16T13:49:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f53fcff9700 1 -- 172.21.15.5:0/604986813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 98) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f54180831f0 con 0x55c7c028f010 2023-10-16T13:49:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 10 client.8370 fetch_fsmap finished waiting for FSMap version 98 2023-10-16T13:49:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 10 client.8370 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T13:49:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 20 client.8370 populate_metadata read hostname 'smithi005' 2023-10-16T13:49:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bd7e0 0x55c7c02bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 4 client.8370 mds_command: new command op to 8229 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:49:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 --> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7c01dcb20 con 0x55c7c02bd7e0 2023-10-16T13:49:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.405+0000 7f5421661700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bd7e0 0x55c7c02bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f53fcff9700 10 client.8370 ms_handle_connect on v2:172.21.15.112:6835/2779373791 2023-10-16T13:49:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f5421661700 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bd7e0 0x55c7c02bdbc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12a54741f772c92 server_cookie=32f7ae5479ce5981 in_seq=0 out_seq=0 2023-10-16T13:49:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f53fcff9700 1 -- 172.21.15.5:0/604986813 <== mds.0 v2:172.21.15.112:6835/2779373791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55c7c01dcb20 con 0x55c7c02bd7e0 2023-10-16T13:49:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f53fcff9700 10 client.8370 handle_command_reply: tid=0 2023-10-16T13:49:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 client.8370 shutdown 2023-10-16T13:49:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 msgr2=0x55c7c02d9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02d9f00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f541800b160 tx=0x7f5418006b60 comp rx=0 tx=0).stop 2023-10-16T13:49:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 shutdown_connections 2023-10-16T13:49:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:6835/2779373791,v1:172.21.15.112:6837/2779373791] conn(0x55c7c02bd7e0 0x55c7c02bdbc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c7c02b9630 0x55c7c02b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7c028f010 0x55c7c02d9f00 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 --2- 172.21.15.5:0/604986813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55c7c02b4220 0x55c7c0341a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f53fcff9700 0 client.8370 ms_handle_reset on v2:172.21.15.112:6835/2779373791 2023-10-16T13:49:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 >> 172.21.15.5:0/604986813 conn(0x55c7c01bed80 msgr2=0x55c7c02d6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 shutdown_connections 2023-10-16T13:49:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 1 -- 172.21.15.5:0/604986813 wait complete. 2023-10-16T13:49:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.406+0000 7f54302b0b80 20 client.8370 trim_cache size 0 max 16384 2023-10-16T13:49:41.429 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:49:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c", 2023-10-16T13:49:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-16T13:49:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8229, 2023-10-16T13:49:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-16T13:49:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-16T13:49:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-16T13:49:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.0115873530000004, 2023-10-16T13:49:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 98, 2023-10-16T13:49:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 135, 2023-10-16T13:49:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 135, 2023-10-16T13:49:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.94057538 2023-10-16T13:49:41.431 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:49:41.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f540006b2f0 msgr2=0x7f540006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f540006b2f0 0x7f540006d7b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f541c0cf7e0 tx=0x7f5410008040 comp rx=0 tx=0).stop 2023-10-16T13:49:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 msgr2=0x7f541c15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 0x7f541c15c130 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5418009c40 tx=0x7f5418004750 comp rx=0 tx=0).stop 2023-10-16T13:49:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 shutdown_connections 2023-10-16T13:49:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f541c15a850 0x7f541c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f541c0b2940 0x7f541c15c130 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f540006b2f0 0x7f540006d7b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 --2- 172.21.15.5:0/3211664666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f541c0cd2e0 0x7f541c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 >> 172.21.15.5:0/3211664666 conn(0x7f541c06dac0 msgr2=0x7f541c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 shutdown_connections 2023-10-16T13:49:41.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.407+0000 7f54240c6700 1 -- 172.21.15.5:0/3211664666 wait complete. 2023-10-16T13:49:41.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:49:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.557+0000 7f285d211700 1 Processor -- start 2023-10-16T13:49:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.557+0000 7f285d211700 1 -- start start 2023-10-16T13:49:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f285d211700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f285815b740 0x7f28580d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f285d211700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28580ce6e0 0x7f28580cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f285d211700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580cf190 con 0x7f28580d0c70 2023-10-16T13:49:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f285d211700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285815bb20 con 0x7f285815b740 2023-10-16T13:49:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f285d211700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580cbd40 con 0x7f28580ce6e0 2023-10-16T13:49:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f2856d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f285815b740 0x7f28580d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f2856d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f285815b740 0x7f28580d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50706/0 (socket says 172.21.15.5:50706) 2023-10-16T13:49:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f2856d9d700 1 -- 172.21.15.5:0/2943272665 learned_addr learned my addr 172.21.15.5:0/2943272665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.558+0000 7f285759e700 1 --2- 172.21.15.5:0/2943272665 >> v2:172.21.15.112:3300/0 conn(0x7f28580ce6e0 0x7f28580cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2856d9d700 1 -- 172.21.15.5:0/2943272665 >> v2:172.21.15.112:3300/0 conn(0x7f28580ce6e0 msgr2=0x7f28580cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2856d9d700 1 --2- 172.21.15.5:0/2943272665 >> v2:172.21.15.112:3300/0 conn(0x7f28580ce6e0 0x7f28580cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2856d9d700 1 -- 172.21.15.5:0/2943272665 >> v1:172.21.15.112:6789/0 conn(0x7f28580d0c70 legacy=0x7f28580cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2856d9d700 1 -- 172.21.15.5:0/2943272665 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580cc020 con 0x7f285815b740 2023-10-16T13:49:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2856d9d700 1 --2- 172.21.15.5:0/2943272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580d1cd0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f28580c8620 tx=0x7f2848009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9237a06c3b2e4664 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2855d9b700 1 -- 172.21.15.5:0/2943272665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011830 con 0x7f285815b740 2023-10-16T13:49:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2855d9b700 1 -- 172.21.15.5:0/2943272665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848011990 con 0x7f285815b740 2023-10-16T13:49:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.559+0000 7f2855d9b700 1 -- 172.21.15.5:0/2943272665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011d20 con 0x7f285815b740 2023-10-16T13:49:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 -- 172.21.15.5:0/2943272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 msgr2=0x7f28580d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 --2- 172.21.15.5:0/2943272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580d1cd0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f28580c8620 tx=0x7f2848009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 -- 172.21.15.5:0/2943272665 shutdown_connections 2023-10-16T13:49:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 --2- 172.21.15.5:0/2943272665 >> v2:172.21.15.112:3300/0 conn(0x7f28580ce6e0 0x7f28580cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 --2- 172.21.15.5:0/2943272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580d1cd0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 -- 172.21.15.5:0/2943272665 >> 172.21.15.5:0/2943272665 conn(0x7f28580665a0 msgr2=0x7f2858066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 -- 172.21.15.5:0/2943272665 shutdown_connections 2023-10-16T13:49:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.560+0000 7f285d211700 1 -- 172.21.15.5:0/2943272665 wait complete. 2023-10-16T13:49:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.562+0000 7f285d211700 1 Processor -- start 2023-10-16T13:49:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.562+0000 7f285d211700 1 -- start start 2023-10-16T13:49:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28580ce6e0 0x7f2858146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28580d0c70 0x7f28580b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580cb330 con 0x7f285815b740 2023-10-16T13:49:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858147180 con 0x7f28580d0c70 2023-10-16T13:49:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285814a3e0 con 0x7f28580ce6e0 2023-10-16T13:49:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50714/0 (socket says 172.21.15.5:50714) 2023-10-16T13:49:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 -- 172.21.15.5:0/71941889 learned_addr learned my addr 172.21.15.5:0/71941889 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f2856d9d700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28580ce6e0 0x7f2858146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285659c700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28580d0c70 0x7f28580b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 -- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28580ce6e0 msgr2=0x7f2858146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28580ce6e0 0x7f2858146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 -- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28580d0c70 msgr2=0x7f28580b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28580d0c70 0x7f28580b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 -- 172.21.15.5:0/71941889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009550 con 0x7f285815b740 2023-10-16T13:49:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285759e700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580b5900 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f285000efc0 tx=0x7f2850009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850009b20 con 0x7f285815b740 2023-10-16T13:49:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285000f040 con 0x7f285815b740 2023-10-16T13:49:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28580ca990 con 0x7f285815b740 2023-10-16T13:49:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000cc90 con 0x7f285815b740 2023-10-16T13:49:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.563+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28580caf50 con 0x7f285815b740 2023-10-16T13:49:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.564+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28580cb470 con 0x7f285815b740 2023-10-16T13:49:41.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.565+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2850014480 con 0x7f285815b740 2023-10-16T13:49:41.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.565+0000 7f284f7fe700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f283806b2f0 0x7f283806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:41.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.565+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f285008a8a0 con 0x7f285815b740 2023-10-16T13:49:41.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.566+0000 7f2856d9d700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f283806b2f0 0x7f283806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:41.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.566+0000 7f2856d9d700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f283806b2f0 0x7f283806d7b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2848009c10 tx=0x7f2848008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:41.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.570+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28580cb470 con 0x7f285815b740 2023-10-16T13:49:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.817+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28580cb470 con 0x7f285815b740 2023-10-16T13:49:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.818+0000 7f284f7fe700 1 -- 172.21.15.5:0/71941889 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28580cb470 con 0x7f285815b740 2023-10-16T13:49:41.821 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:49:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f283806b2f0 msgr2=0x7f283806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f283806b2f0 0x7f283806d7b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2848009c10 tx=0x7f2848008030 comp rx=0 tx=0).stop 2023-10-16T13:49:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 msgr2=0x7f28580b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580b5900 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f285000efc0 tx=0x7f2850009f60 comp rx=0 tx=0).stop 2023-10-16T13:49:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 shutdown_connections 2023-10-16T13:49:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f285815b740 0x7f28580b5900 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f283806b2f0 0x7f283806d7b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28580ce6e0 0x7f2858146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 --2- 172.21.15.5:0/71941889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28580d0c70 0x7f28580b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 >> 172.21.15.5:0/71941889 conn(0x7f28580665a0 msgr2=0x7f285815f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 shutdown_connections 2023-10-16T13:49:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:41.820+0000 7f285d211700 1 -- 172.21.15.5:0/71941889 wait complete. 2023-10-16T13:49:41.835 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:49:41.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:49:41.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-16T13:49:41.836 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:49:41.836 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:49:41.836 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:49:41.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:49:41.837 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:49:41.837 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:49:41.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:41.838 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-16T13:49:41.856 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:49:41.856 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:49:41.856 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:49:41.856 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.856 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-16T13:49:41.857 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.857 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:49:41.857 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:41.857 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:49:41.857 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:41.857 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:49:41.858 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:41.858 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T13:49:41.858 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41720sec preferred_lft 41720sec 2023-10-16T13:49:41.858 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-16T13:49:41.858 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.859 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:49:41.859 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:41.859 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:49:41.859 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:41.859 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:49:41.860 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.860 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b895:d4ff:fe31:d65e/64 scope link 2023-10-16T13:49:41.860 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.860 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:49:41.860 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 12:c9:13:19:dc:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:49:41.860 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::10c9:13ff:fe19:dc73/64 scope link 2023-10-16T13:49:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.861 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:49:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:31:91:35:4b:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:49:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2431:91ff:fe35:4b19/64 scope link 2023-10-16T13:49:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:41.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:41.862 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:49:41.921 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-16T13:49:41.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:41.923 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-16T13:49:41.982 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-16T13:49:41.982 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:49:41.983 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T13:49:41.983 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T13:49:41.983 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:49:41.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:41.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-16T13:49:41.984 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-16T13:49:41.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T13:49:41.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T13:49:41.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T13:49:41.986 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-16T13:49:42.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:42.090 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:49:42.107 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:49:42.107 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:49:42.107 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:49:42.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:42.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-16T13:49:42.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:49:42.175 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:49:42.231 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:49:42.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:49:42.232 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:49:42.288 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:49:42.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:42.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:42.375 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:42.375 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:42.406 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:42.406 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:42.406 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:49:42.407 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:49:42.407 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:49:42.407 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:49:42.407 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:49:42.407 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:49:42.440 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:42.440 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:42.440 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:49:42.440 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:49:42.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:49:42.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:49:42.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:49:42.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:49:42.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:49:42.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:49:42.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:49:42.447 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:49:42.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:42.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:49:42.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:42.485 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:49:42.573 INFO:teuthology.orchestra.run.smithi005.stdout:client8379 2023-10-16T13:49:42.574 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:42.574 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:42.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:49:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.755+0000 7f6505861700 1 Processor -- start 2023-10-16T13:49:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.755+0000 7f6505861700 1 -- start start 2023-10-16T13:49:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f6505861700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f650015da80 0x7f65000d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f6505861700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650006bed0 con 0x7f65000d2170 2023-10-16T13:49:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f6505861700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650006bbf0 con 0x7f650006c9e0 2023-10-16T13:49:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f6505861700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65000cfb60 con 0x7f650015da80 2023-10-16T13:49:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64fe7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f65000d2170 0x7f650006c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60726/0 (socket says 172.21.15.5:60726) 2023-10-16T13:49:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64fe7fc700 1 -- 172.21.15.5:0/1846164641 learned_addr learned my addr 172.21.15.5:0/1846164641 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:42.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64feffd700 1 --2- 172.21.15.5:0/1846164641 >> v2:172.21.15.112:3300/0 conn(0x7f650015da80 0x7f65000d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:42.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64fdffb700 1 -- 172.21.15.5:0/1846164641 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556918506 0 0) 0x7f650006bed0 con 0x7f65000d2170 2023-10-16T13:49:42.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64fdffb700 1 -- 172.21.15.5:0/1846164641 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e80035b0 con 0x7f65000d2170 2023-10-16T13:49:42.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64feffd700 1 -- 172.21.15.5:0/1846164641 >> v1:172.21.15.112:6789/0 conn(0x7f650006c9e0 legacy=0x7f65000cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:42.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64feffd700 1 -- 172.21.15.5:0/1846164641 >> v1:172.21.15.5:6789/0 conn(0x7f65000d2170 legacy=0x7f650006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:42.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.756+0000 7f64feffd700 1 -- 172.21.15.5:0/1846164641 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65000cfe40 con 0x7f650015da80 2023-10-16T13:49:42.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f64feffd700 1 --2- 172.21.15.5:0/1846164641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f650015da80 0x7f65000d0920 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009870 tx=0x7f64f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f438385b5d1ae998 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:42.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f64fdffb700 1 -- 172.21.15.5:0/1846164641 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4011830 con 0x7f650015da80 2023-10-16T13:49:42.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f64fdffb700 1 -- 172.21.15.5:0/1846164641 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f4011990 con 0x7f650015da80 2023-10-16T13:49:42.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f64fdffb700 1 -- 172.21.15.5:0/1846164641 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4011d20 con 0x7f650015da80 2023-10-16T13:49:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 -- 172.21.15.5:0/1846164641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f650015da80 msgr2=0x7f65000d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 --2- 172.21.15.5:0/1846164641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f650015da80 0x7f65000d0920 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009870 tx=0x7f64f4009b80 comp rx=0 tx=0).stop 2023-10-16T13:49:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 -- 172.21.15.5:0/1846164641 shutdown_connections 2023-10-16T13:49:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 --2- 172.21.15.5:0/1846164641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f650015da80 0x7f65000d0920 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 -- 172.21.15.5:0/1846164641 >> 172.21.15.5:0/1846164641 conn(0x7f65000d1650 msgr2=0x7f65000d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 -- 172.21.15.5:0/1846164641 shutdown_connections 2023-10-16T13:49:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.757+0000 7f6505861700 1 -- 172.21.15.5:0/1846164641 wait complete. 2023-10-16T13:49:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.759+0000 7f6505861700 1 Processor -- start 2023-10-16T13:49:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.759+0000 7f6505861700 1 -- start start 2023-10-16T13:49:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 0x7f6500154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65000d2170 0x7f65000c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f650015da80 0x7f65000cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65001f39b0 con 0x7f650006c9e0 2023-10-16T13:49:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65000c9b80 con 0x7f65000d2170 2023-10-16T13:49:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65000c9e60 con 0x7f650015da80 2023-10-16T13:49:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 0x7f6500154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 0x7f6500154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50728/0 (socket says 172.21.15.5:50728) 2023-10-16T13:49:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 -- 172.21.15.5:0/1955306041 learned_addr learned my addr 172.21.15.5:0/1955306041 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64fe7fc700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65000d2170 0x7f65000c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64ff7fe700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f650015da80 0x7f65000cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 -- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f650015da80 msgr2=0x7f65000cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f650015da80 0x7f65000cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 -- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65000d2170 msgr2=0x7f65000c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65000d2170 0x7f65000c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 -- 172.21.15.5:0/1955306041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40094a0 con 0x7f650006c9e0 2023-10-16T13:49:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64ff7fe700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f650015da80 0x7f65000cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64feffd700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 0x7f6500154b90 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f64f40090b0 tx=0x7f64f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40036a0 con 0x7f650006c9e0 2023-10-16T13:49:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f401f070 con 0x7f650006c9e0 2023-10-16T13:49:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65000ca140 con 0x7f650006c9e0 2023-10-16T13:49:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4003a00 con 0x7f650006c9e0 2023-10-16T13:49:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.760+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65001550d0 con 0x7f650006c9e0 2023-10-16T13:49:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.761+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650004ebb0 con 0x7f650006c9e0 2023-10-16T13:49:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.762+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f64f4003b60 con 0x7f650006c9e0 2023-10-16T13:49:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.762+0000 7f64e7fff700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f64ec06b2f0 0x7f64ec06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.762+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f4021070 con 0x7f650006c9e0 2023-10-16T13:49:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.763+0000 7f64fe7fc700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f64ec06b2f0 0x7f64ec06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.763+0000 7f64fe7fc700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f64ec06b2f0 0x7f64ec06d7b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f64f0007fd0 tx=0x7f64f0007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:42.767+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64f4056130 con 0x7f650006c9e0 2023-10-16T13:49:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.014+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f650006c7c0 con 0x7f650006c9e0 2023-10-16T13:49:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.015+0000 7f64e7fff700 1 -- 172.21.15.5:0/1955306041 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64f4059750 con 0x7f650006c9e0 2023-10-16T13:49:43.019 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:49:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f64ec06b2f0 msgr2=0x7f64ec06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f64ec06b2f0 0x7f64ec06d7b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f64f0007fd0 tx=0x7f64f0007dc0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 msgr2=0x7f6500154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 0x7f6500154b90 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f64f40090b0 tx=0x7f64f4004750 comp rx=0 tx=0).stop 2023-10-16T13:49:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 shutdown_connections 2023-10-16T13:49:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f64ec06b2f0 0x7f64ec06d7b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f650015da80 0x7f65000cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f650006c9e0 0x7f6500154b90 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 --2- 172.21.15.5:0/1955306041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65000d2170 0x7f65000c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 >> 172.21.15.5:0/1955306041 conn(0x7f65000d1650 msgr2=0x7f650006c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 shutdown_connections 2023-10-16T13:49:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.017+0000 7f6505861700 1 -- 172.21.15.5:0/1955306041 wait complete. 2023-10-16T13:49:43.032 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:49:43.032 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:49:43.032 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-16T13:49:43.033 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T13:49:43.033 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:43.033 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:49:43.034 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:49:43.034 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:49:43.034 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:49:43.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.035 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-16T13:49:43.056 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:49:43.057 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:49:43.057 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:49:43.057 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.057 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-16T13:49:43.058 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.058 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:49:43.058 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:43.058 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:49:43.058 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:49:43.059 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:43.059 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:49:43.059 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:43.059 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:49:43.060 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 41734sec preferred_lft 41734sec 2023-10-16T13:49:43.060 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c56:4cc1:1686:ba72/64 scope link noprefixroute 2023-10-16T13:49:43.060 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.060 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:49:43.060 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff 2023-10-16T13:49:43.061 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:49:43.061 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.061 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2878:6ff:fe4b:662b/64 scope link 2023-10-16T13:49:43.061 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.061 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:49:43.061 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:38:fc:a0:dd:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:49:43.062 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c38:fcff:fea0:dd7c/64 scope link 2023-10-16T13:49:43.062 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.062 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:49:43.062 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 6e:5e:cb:3b:e1:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:49:43.062 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::6c5e:cbff:fe3b:e1e2/64 scope link 2023-10-16T13:49:43.063 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:49:43.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.063 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:49:43.126 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-16T13:49:43.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.128 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-16T13:49:43.189 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-16T13:49:43.189 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:49:43.190 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:49:43.190 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:49:43.190 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:49:43.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.191 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-16T13:49:43.191 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-16T13:49:43.192 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:49:43.192 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:49:43.192 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:49:43.193 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-16T13:49:43.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.298 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:49:43.315 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:49:43.316 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:49:43.316 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:49:43.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-16T13:49:43.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:49:43.383 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:43.439 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T13:49:43.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:49:43.440 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:43.496 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T13:49:43.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:43.581 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:43.581 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:43.605 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:43.605 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:43.605 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:49:43.605 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:49:43.605 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:49:43.606 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:49:43.606 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:49:43.606 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:49:43.685 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:49:43.686 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:49:43.686 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.112:3300,172.21.15.112:3301" 2023-10-16T13:49:43.686 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 1@c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c.cephfs=/ 2023-10-16T13:49:43.686 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2023-10-16T13:49:43.686 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:49:43.687 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:49:43.687 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:49:43.687 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790" 2023-10-16T13:49:43.687 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2023-10-16T13:49:43.687 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c" will pass to kernel 2023-10-16T13:49:43.688 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:49:43.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:43.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:43.716 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:49:43.787 INFO:teuthology.orchestra.run.smithi112.stdout:client8388 2023-10-16T13:49:43.788 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:43.788 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:43.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-16T13:49:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.985+0000 7fceef7f2700 1 Processor -- start 2023-10-16T13:49:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.985+0000 7fceef7f2700 1 -- start start 2023-10-16T13:49:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceef7f2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceef7f2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcee80727e0 0x7fcee80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceef7f2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee80b2e40 con 0x7fcee806da30 2023-10-16T13:49:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceef7f2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee815e7c0 con 0x7fcee80727e0 2023-10-16T13:49:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceef7f2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80b2880 con 0x7fcee8151680 2023-10-16T13:49:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceedd8f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcee806da30 0x7fcee815acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60744/0 (socket says 172.21.15.5:60744) 2023-10-16T13:49:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceedd8f700 1 -- 172.21.15.5:0/2411569044 learned_addr learned my addr 172.21.15.5:0/2411569044 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceed58e700 1 --2- 172.21.15.5:0/2411569044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fceecd8d700 1 --2- 172.21.15.5:0/2411569044 >> v2:172.21.15.112:3300/0 conn(0x7fcee80727e0 0x7fcee80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.986+0000 7fcedbfff700 1 -- 172.21.15.5:0/2411569044 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140834220 0 0) 0x7fcee0001490 con 0x7fcee806da30 2023-10-16T13:49:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fcedbfff700 1 -- 172.21.15.5:0/2411569044 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced40035b0 con 0x7fcee806da30 2023-10-16T13:49:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fcedbfff700 1 -- 172.21.15.5:0/2411569044 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420243755 0 0) 0x7fced40035b0 con 0x7fcee806da30 2023-10-16T13:49:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fceed58e700 1 -- 172.21.15.5:0/2411569044 >> v2:172.21.15.112:3300/0 conn(0x7fcee80727e0 msgr2=0x7fcee80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fceed58e700 1 --2- 172.21.15.5:0/2411569044 >> v2:172.21.15.112:3300/0 conn(0x7fcee80727e0 0x7fcee80b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fceed58e700 1 -- 172.21.15.5:0/2411569044 >> v1:172.21.15.5:6789/0 conn(0x7fcee806da30 legacy=0x7fcee815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:43.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fceed58e700 1 -- 172.21.15.5:0/2411569044 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee80b2b60 con 0x7fcee8151680 2023-10-16T13:49:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fceecd8d700 1 --2- 172.21.15.5:0/2411569044 >> v2:172.21.15.112:3300/0 conn(0x7fcee80727e0 0x7fcee80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fceed58e700 1 --2- 172.21.15.5:0/2411569044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee815ec50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009840 tx=0x7fcedc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=482c547f0c0eba57 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fcedbfff700 1 -- 172.21.15.5:0/2411569044 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0001b80 con 0x7fcee8151680 2023-10-16T13:49:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fcedbfff700 1 -- 172.21.15.5:0/2411569044 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc004030 con 0x7fcee8151680 2023-10-16T13:49:43.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.987+0000 7fcedbfff700 1 -- 172.21.15.5:0/2411569044 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0043c0 con 0x7fcee8151680 2023-10-16T13:49:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 -- 172.21.15.5:0/2411569044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 msgr2=0x7fcee815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 --2- 172.21.15.5:0/2411569044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee815ec50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009840 tx=0x7fcedc009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 -- 172.21.15.5:0/2411569044 shutdown_connections 2023-10-16T13:49:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 --2- 172.21.15.5:0/2411569044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee815ec50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 --2- 172.21.15.5:0/2411569044 >> v2:172.21.15.112:3300/0 conn(0x7fcee80727e0 0x7fcee80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 -- 172.21.15.5:0/2411569044 >> 172.21.15.5:0/2411569044 conn(0x7fcee806bd70 msgr2=0x7fcee806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 -- 172.21.15.5:0/2411569044 shutdown_connections 2023-10-16T13:49:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.988+0000 7fceef7f2700 1 -- 172.21.15.5:0/2411569044 wait complete. 2023-10-16T13:49:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.989+0000 7fceef7f2700 1 Processor -- start 2023-10-16T13:49:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.989+0000 7fceef7f2700 1 -- start start 2023-10-16T13:49:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceef7f2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee806da30 0x7fcee81f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceef7f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 0x7fcee80c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceef7f2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee814b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceef7f2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80b0c50 con 0x7fcee80727e0 2023-10-16T13:49:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceef7f2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee81f2b40 con 0x7fcee806da30 2023-10-16T13:49:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceef7f2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee81f2e20 con 0x7fcee8151680 2023-10-16T13:49:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 0x7fcee80c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 0x7fcee80c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50744/0 (socket says 172.21.15.5:50744) 2023-10-16T13:49:44.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 -- 172.21.15.5:0/328797860 learned_addr learned my addr 172.21.15.5:0/328797860 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceed58e700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee806da30 0x7fcee81f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceedd8f700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee814b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 -- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 msgr2=0x7fcee814b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee814b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 -- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee806da30 msgr2=0x7fcee81f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee806da30 0x7fcee81f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceecd8d700 1 -- 172.21.15.5:0/328797860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40094a0 con 0x7fcee80727e0 2023-10-16T13:49:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.990+0000 7fceed58e700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee806da30 0x7fcee81f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.991+0000 7fceecd8d700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 0x7fcee80c9e30 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcee400ebe0 tx=0x7fcee400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:44.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.991+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400c850 con 0x7fcee80727e0 2023-10-16T13:49:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.991+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee400c9b0 con 0x7fcee80727e0 2023-10-16T13:49:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.991+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400cd40 con 0x7fcee80727e0 2023-10-16T13:49:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.991+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0094a0 con 0x7fcee80727e0 2023-10-16T13:49:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.991+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee81f33e0 con 0x7fcee80727e0 2023-10-16T13:49:44.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.992+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee8072e10 con 0x7fcee80727e0 2023-10-16T13:49:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.993+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fcee4013470 con 0x7fcee80727e0 2023-10-16T13:49:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.993+0000 7fced9ffb700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcecc06b320 0x7fcecc06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.993+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcee4089cb0 con 0x7fcee80727e0 2023-10-16T13:49:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.993+0000 7fceed58e700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcecc06b320 0x7fcecc06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.994+0000 7fceed58e700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcecc06b320 0x7fcecc06d7e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0090b0 tx=0x7fcedc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:43.998+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcee4054810 con 0x7fcee80727e0 2023-10-16T13:49:44.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.252+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcee80b0d90 con 0x7fcee80727e0 2023-10-16T13:49:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.726+0000 7fced9ffb700 1 -- 172.21.15.5:0/328797860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v99) v1 ==== 136+0+0 (secure 0 0 0) 0x7fcee80b0d90 con 0x7fcee80727e0 2023-10-16T13:49:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.728+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcecc06b320 msgr2=0x7fcecc06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.728+0000 7fceef7f2700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcecc06b320 0x7fcecc06d7e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0090b0 tx=0x7fcedc008030 comp rx=0 tx=0).stop 2023-10-16T13:49:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.728+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 msgr2=0x7fcee80c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.728+0000 7fceef7f2700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 0x7fcee80c9e30 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcee400ebe0 tx=0x7fcee400eef0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 shutdown_connections 2023-10-16T13:49:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fcecc06b320 0x7fcecc06d7e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcee8151680 0x7fcee814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee806da30 0x7fcee81f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 --2- 172.21.15.5:0/328797860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee80727e0 0x7fcee80c9e30 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 >> 172.21.15.5:0/328797860 conn(0x7fcee806bd70 msgr2=0x7fcee815cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 shutdown_connections 2023-10-16T13:49:44.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.729+0000 7fceef7f2700 1 -- 172.21.15.5:0/328797860 wait complete. 2023-10-16T13:49:44.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-16T13:49:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.873+0000 7f2d986c0700 1 Processor -- start 2023-10-16T13:49:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.873+0000 7f2d986c0700 1 -- start start 2023-10-16T13:49:44.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d986c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d9015a280 0x7f2d900cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d986c0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d9006d390 0x7f2d9006d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d986c0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d900cf1d0 con 0x7f2d900ce5f0 2023-10-16T13:49:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d986c0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d90072200 con 0x7f2d9015a280 2023-10-16T13:49:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d986c0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9006dd40 con 0x7f2d9006d390 2023-10-16T13:49:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9645c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d9015a280 0x7f2d900cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d96c5d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d900ce5f0 0x7f2d900cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60756/0 (socket says 172.21.15.5:60756) 2023-10-16T13:49:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d96c5d700 1 -- 172.21.15.5:0/2745366317 learned_addr learned my addr 172.21.15.5:0/2745366317 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d95c5b700 1 --2- 172.21.15.5:0/2745366317 >> v2:172.21.15.112:3300/0 conn(0x7f2d9006d390 0x7f2d9006d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9645c700 1 -- 172.21.15.5:0/2745366317 >> v2:172.21.15.112:3300/0 conn(0x7f2d9006d390 msgr2=0x7f2d9006d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9645c700 1 --2- 172.21.15.5:0/2745366317 >> v2:172.21.15.112:3300/0 conn(0x7f2d9006d390 0x7f2d9006d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9645c700 1 -- 172.21.15.5:0/2745366317 >> v1:172.21.15.5:6789/0 conn(0x7f2d900ce5f0 legacy=0x7f2d900cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9645c700 1 -- 172.21.15.5:0/2745366317 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d900cafb0 con 0x7f2d9015a280 2023-10-16T13:49:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9545a700 1 -- 172.21.15.5:0/2745366317 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170307543 0 0) 0x7f2d900cf1d0 con 0x7f2d900ce5f0 2023-10-16T13:49:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9645c700 1 --2- 172.21.15.5:0/2745366317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9015a280 0x7f2d900cbd70 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f2d9015ed60 tx=0x7f2d8c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a08823da12d4d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.874+0000 7f2d9545a700 1 -- 172.21.15.5:0/2745366317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011830 con 0x7f2d9015a280 2023-10-16T13:49:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d9545a700 1 -- 172.21.15.5:0/2745366317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c011990 con 0x7f2d9015a280 2023-10-16T13:49:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d9545a700 1 -- 172.21.15.5:0/2745366317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011d20 con 0x7f2d9015a280 2023-10-16T13:49:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 -- 172.21.15.5:0/2745366317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9015a280 msgr2=0x7f2d900cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 --2- 172.21.15.5:0/2745366317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9015a280 0x7f2d900cbd70 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f2d9015ed60 tx=0x7f2d8c009b20 comp rx=0 tx=0).stop 2023-10-16T13:49:44.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 -- 172.21.15.5:0/2745366317 shutdown_connections 2023-10-16T13:49:44.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 --2- 172.21.15.5:0/2745366317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9015a280 0x7f2d900cbd70 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 --2- 172.21.15.5:0/2745366317 >> v2:172.21.15.112:3300/0 conn(0x7f2d9006d390 0x7f2d9006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 -- 172.21.15.5:0/2745366317 >> 172.21.15.5:0/2745366317 conn(0x7f2d900cfc40 msgr2=0x7f2d900d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:44.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 -- 172.21.15.5:0/2745366317 shutdown_connections 2023-10-16T13:49:44.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.875+0000 7f2d986c0700 1 -- 172.21.15.5:0/2745366317 wait complete. 2023-10-16T13:49:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.876+0000 7f2d986c0700 1 Processor -- start 2023-10-16T13:49:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 -- start start 2023-10-16T13:49:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9006d390 0x7f2d900c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 0x7f2d901f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d9015a280 0x7f2d900c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901f3020 con 0x7f2d900ce5f0 2023-10-16T13:49:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901f3f70 con 0x7f2d9006d390 2023-10-16T13:49:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d986c0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900c5fb0 con 0x7f2d9015a280 2023-10-16T13:49:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d95c5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 0x7f2d901f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d95c5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 0x7f2d901f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50756/0 (socket says 172.21.15.5:50756) 2023-10-16T13:49:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.877+0000 7f2d95c5b700 1 -- 172.21.15.5:0/452989078 learned_addr learned my addr 172.21.15.5:0/452989078 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d96c5d700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d9015a280 0x7f2d900c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d9645c700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9006d390 0x7f2d900c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d95c5b700 1 -- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d9015a280 msgr2=0x7f2d900c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d95c5b700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d9015a280 0x7f2d900c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d95c5b700 1 -- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9006d390 msgr2=0x7f2d900c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d95c5b700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9006d390 0x7f2d900c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d95c5b700 1 -- 172.21.15.5:0/452989078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0094a0 con 0x7f2d900ce5f0 2023-10-16T13:49:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d9645c700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9006d390 0x7f2d900c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d95c5b700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 0x7f2d901f3a30 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e810 tx=0x7f2d8000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80013610 con 0x7f2d900ce5f0 2023-10-16T13:49:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80013770 con 0x7f2d900ce5f0 2023-10-16T13:49:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d900c6290 con 0x7f2d900ce5f0 2023-10-16T13:49:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80013b20 con 0x7f2d900ce5f0 2023-10-16T13:49:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.878+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d901f3510 con 0x7f2d900ce5f0 2023-10-16T13:49:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.879+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d901f3880 con 0x7f2d900ce5f0 2023-10-16T13:49:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.880+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2d80013c80 con 0x7f2d900ce5f0 2023-10-16T13:49:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.880+0000 7f2d86ffd700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d7406b2f0 0x7f2d7406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.880+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d80089b00 con 0x7f2d900ce5f0 2023-10-16T13:49:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.880+0000 7f2d9645c700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d7406b2f0 0x7f2d7406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:44.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.881+0000 7f2d9645c700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d7406b2f0 0x7f2d7406d7b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0090b0 tx=0x7f2d8c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:44.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:44.885+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d8008be60 con 0x7f2d900ce5f0 2023-10-16T13:49:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.114+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d900cb570 con 0x7f2d7406b2f0 2023-10-16T13:49:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.116+0000 7f2d86ffd700 1 -- 172.21.15.5:0/452989078 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2d8c011c80 con 0x7f2d7406b2f0 2023-10-16T13:49:45.119 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-16T13:49:45.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-16T13:49:45.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-10-16T13:49:45.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-16T13:49:45.119 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-16T13:49:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d7406b2f0 msgr2=0x7f2d7406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d7406b2f0 0x7f2d7406d7b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0090b0 tx=0x7f2d8c01c040 comp rx=0 tx=0).stop 2023-10-16T13:49:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 msgr2=0x7f2d901f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 0x7f2d901f3a30 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e810 tx=0x7f2d8000ebd0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 shutdown_connections 2023-10-16T13:49:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f2d7406b2f0 0x7f2d7406d7b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d9015a280 0x7f2d900c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9006d390 0x7f2d900c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 --2- 172.21.15.5:0/452989078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d900ce5f0 0x7f2d901f3a30 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 >> 172.21.15.5:0/452989078 conn(0x7f2d900cfc40 msgr2=0x7f2d90071760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 shutdown_connections 2023-10-16T13:49:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.118+0000 7f2d986c0700 1 -- 172.21.15.5:0/452989078 wait complete. 2023-10-16T13:49:45.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T13:49:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.258+0000 7f6ab513c700 1 Processor -- start 2023-10-16T13:49:45.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.258+0000 7f6ab513c700 1 -- start start 2023-10-16T13:49:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.259+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015f130 0x7f6ab00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.259+0000 7f6ab513c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ab00b28b0 0x7f6ab006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.259+0000 7f6ab513c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00b3530 con 0x7f6ab006ad80 2023-10-16T13:49:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.259+0000 7f6ab513c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00cde00 con 0x7f6ab00b28b0 2023-10-16T13:49:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.259+0000 7f6ab513c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab006b1b0 con 0x7f6ab015f130 2023-10-16T13:49:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aae59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ab00b28b0 0x7f6ab006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aaed9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015f130 0x7f6ab00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aaf59e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6ab006ad80 0x7f6ab0071af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:51746/0 (socket says 172.21.15.5:51746) 2023-10-16T13:49:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aaf59e700 1 -- 172.21.15.5:0/1031722401 learned_addr learned my addr 172.21.15.5:0/1031722401 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aadd9b700 1 -- 172.21.15.5:0/1031722401 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348279867 0 0) 0x7f6ab00b3530 con 0x7f6ab006ad80 2023-10-16T13:49:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aadd9b700 1 -- 172.21.15.5:0/1031722401 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0035b0 con 0x7f6ab006ad80 2023-10-16T13:49:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aae59c700 1 -- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015f130 msgr2=0x7f6ab00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aae59c700 1 --2- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015f130 0x7f6ab00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aae59c700 1 -- 172.21.15.5:0/1031722401 >> v1:172.21.15.112:6789/0 conn(0x7f6ab006ad80 legacy=0x7f6ab0071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aae59c700 1 -- 172.21.15.5:0/1031722401 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00cd180 con 0x7f6ab00b28b0 2023-10-16T13:49:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aaed9d700 1 --2- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015f130 0x7f6ab00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aae59c700 1 --2- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab006a840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009820 tx=0x7f6a98009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05c0e4215eaa72b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aadd9b700 1 -- 172.21.15.5:0/1031722401 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98005e30 con 0x7f6ab00b28b0 2023-10-16T13:49:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aadd9b700 1 -- 172.21.15.5:0/1031722401 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98006030 con 0x7f6ab00b28b0 2023-10-16T13:49:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.260+0000 7f6aadd9b700 1 -- 172.21.15.5:0/1031722401 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980063a0 con 0x7f6ab00b28b0 2023-10-16T13:49:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 -- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 msgr2=0x7f6ab006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab006a840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009820 tx=0x7f6a98009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 -- 172.21.15.5:0/1031722401 shutdown_connections 2023-10-16T13:49:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab015f130 0x7f6ab00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1031722401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab006a840 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 -- 172.21.15.5:0/1031722401 >> 172.21.15.5:0/1031722401 conn(0x7f6ab006dae0 msgr2=0x7f6ab006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 -- 172.21.15.5:0/1031722401 shutdown_connections 2023-10-16T13:49:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.261+0000 7f6ab513c700 1 -- 172.21.15.5:0/1031722401 wait complete. 2023-10-16T13:49:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.262+0000 7f6ab513c700 1 Processor -- start 2023-10-16T13:49:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.262+0000 7f6ab513c700 1 -- start start 2023-10-16T13:49:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab006ad80 0x7f6ab015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 0x7f6ab00cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6ab513c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cbaa0 con 0x7f6ab015f130 2023-10-16T13:49:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6ab513c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab015b040 con 0x7f6ab00b28b0 2023-10-16T13:49:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6ab513c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cb4e0 con 0x7f6ab006ad80 2023-10-16T13:49:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6aaf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 0x7f6ab00cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6aaf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 0x7f6ab00cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50772/0 (socket says 172.21.15.5:50772) 2023-10-16T13:49:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6aaf59e700 1 -- 172.21.15.5:0/1347867246 learned_addr learned my addr 172.21.15.5:0/1347867246 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.263+0000 7f6aaed9d700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab006ad80 0x7f6ab015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aae59c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aaf59e700 1 -- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab006ad80 msgr2=0x7f6ab015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aaf59e700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab006ad80 0x7f6ab015cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aaf59e700 1 -- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 msgr2=0x7f6ab015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aaf59e700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aaf59e700 1 -- 172.21.15.5:0/1347867246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa00094a0 con 0x7f6ab015f130 2023-10-16T13:49:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aaf59e700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 0x7f6ab00cab20 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800caa0 tx=0x7f6aa800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800aa80 con 0x7f6ab015f130 2023-10-16T13:49:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a98009430 con 0x7f6ab015f130 2023-10-16T13:49:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800abe0 con 0x7f6ab015f130 2023-10-16T13:49:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8012400 con 0x7f6ab015f130 2023-10-16T13:49:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.264+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab00ac9c0 con 0x7f6ab015f130 2023-10-16T13:49:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.265+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0067d20 con 0x7f6ab015f130 2023-10-16T13:49:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.266+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6aa801b3b0 con 0x7f6ab015f130 2023-10-16T13:49:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.266+0000 7f6aa77fe700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006b2f0 0x7f6a9006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.266+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aa8089b70 con 0x7f6ab015f130 2023-10-16T13:49:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.266+0000 7f6aaed9d700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006b2f0 0x7f6a9006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.267+0000 7f6aaed9d700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006b2f0 0x7f6a9006d7b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009d00 tx=0x7f6aa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.271+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6aa80545c0 con 0x7f6ab015f130 2023-10-16T13:49:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.471+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6ab00ca900 con 0x7f6ab015f130 2023-10-16T13:49:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.471+0000 7f6aa77fe700 1 -- 172.21.15.5:0/1347867246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6aa8057be0 con 0x7f6ab015f130 2023-10-16T13:49:45.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006b2f0 msgr2=0x7f6a9006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006b2f0 0x7f6a9006d7b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009d00 tx=0x7f6aa0008040 comp rx=0 tx=0).stop 2023-10-16T13:49:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 msgr2=0x7f6ab00cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 0x7f6ab00cab20 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800caa0 tx=0x7f6aa800ce60 comp rx=0 tx=0).stop 2023-10-16T13:49:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 shutdown_connections 2023-10-16T13:49:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab015f130 0x7f6ab00cab20 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a9006b2f0 0x7f6a9006d7b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab006ad80 0x7f6ab015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 --2- 172.21.15.5:0/1347867246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab00b28b0 0x7f6ab015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 >> 172.21.15.5:0/1347867246 conn(0x7f6ab006dae0 msgr2=0x7f6ab00b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 shutdown_connections 2023-10-16T13:49:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.473+0000 7f6ab513c700 1 -- 172.21.15.5:0/1347867246 wait complete. 2023-10-16T13:49:45.488 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:45.489 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:45.506 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:45.507 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:45.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.727+0000 7f4fb7027700 1 Processor -- start 2023-10-16T13:49:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.727+0000 7f4fb7027700 1 -- start start 2023-10-16T13:49:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4fb7027700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fb015eab0 0x7f4fb00cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4fb7027700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb00d1d90 0x7f4fb00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4fb7027700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb015ee90 con 0x7f4fb00cf6d0 2023-10-16T13:49:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4fb7027700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00d21c0 con 0x7f4fb015eab0 2023-10-16T13:49:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4fb7027700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00cfb60 con 0x7f4fb00d1d90 2023-10-16T13:49:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4fb4dc3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fb015eab0 0x7f4fb00cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4faffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4fb00cf6d0 0x7f4fb00d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60780/0 (socket says 172.21.15.5:60780) 2023-10-16T13:49:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.728+0000 7f4faffff700 1 -- 172.21.15.5:0/2002145212 learned_addr learned my addr 172.21.15.5:0/2002145212 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4fb55c4700 1 --2- 172.21.15.5:0/2002145212 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb00d1d90 0x7f4fb00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4fb4dc3700 1 -- 172.21.15.5:0/2002145212 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb00d1d90 msgr2=0x7f4fb00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4fb4dc3700 1 --2- 172.21.15.5:0/2002145212 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb00d1d90 0x7f4fb00cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4fb4dc3700 1 -- 172.21.15.5:0/2002145212 >> v1:172.21.15.5:6789/0 conn(0x7f4fb00cf6d0 legacy=0x7f4fb00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4fb4dc3700 1 -- 172.21.15.5:0/2002145212 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0158370 con 0x7f4fb015eab0 2023-10-16T13:49:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4faf7fe700 1 -- 172.21.15.5:0/2002145212 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349102654 0 0) 0x7f4fb015ee90 con 0x7f4fb00cf6d0 2023-10-16T13:49:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4fb4dc3700 1 --2- 172.21.15.5:0/2002145212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb015eab0 0x7f4fb00cf190 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009840 tx=0x7f4fa4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b850ddc0a9000a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4faf7fe700 1 -- 172.21.15.5:0/2002145212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4011830 con 0x7f4fb015eab0 2023-10-16T13:49:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4faf7fe700 1 -- 172.21.15.5:0/2002145212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4011990 con 0x7f4fb015eab0 2023-10-16T13:49:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.729+0000 7f4faf7fe700 1 -- 172.21.15.5:0/2002145212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4011d20 con 0x7f4fb015eab0 2023-10-16T13:49:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 -- 172.21.15.5:0/2002145212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb015eab0 msgr2=0x7f4fb00cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 --2- 172.21.15.5:0/2002145212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb015eab0 0x7f4fb00cf190 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009840 tx=0x7f4fa4009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 -- 172.21.15.5:0/2002145212 shutdown_connections 2023-10-16T13:49:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 --2- 172.21.15.5:0/2002145212 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb00d1d90 0x7f4fb00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 --2- 172.21.15.5:0/2002145212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb015eab0 0x7f4fb00cf190 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 -- 172.21.15.5:0/2002145212 >> 172.21.15.5:0/2002145212 conn(0x7f4fb00665a0 msgr2=0x7f4fb0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 -- 172.21.15.5:0/2002145212 shutdown_connections 2023-10-16T13:49:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.730+0000 7f4fb7027700 1 -- 172.21.15.5:0/2002145212 wait complete. 2023-10-16T13:49:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.731+0000 7f4fb7027700 1 Processor -- start 2023-10-16T13:49:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.731+0000 7f4fb7027700 1 -- start start 2023-10-16T13:49:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb7027700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fb00cf6d0 0x7f4fb014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb7027700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 0x7f4fb015f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb7027700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb015eab0 0x7f4fb00ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb7027700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb014af80 con 0x7f4fb00d1d90 2023-10-16T13:49:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb7027700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00aee70 con 0x7f4fb00cf6d0 2023-10-16T13:49:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb7027700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00ae260 con 0x7f4fb015eab0 2023-10-16T13:49:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 0x7f4fb015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 0x7f4fb015f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50784/0 (socket says 172.21.15.5:50784) 2023-10-16T13:49:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 -- 172.21.15.5:0/1418248182 learned_addr learned my addr 172.21.15.5:0/1418248182 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb4dc3700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fb00cf6d0 0x7f4fb014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb55c4700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb015eab0 0x7f4fb00ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 -- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb015eab0 msgr2=0x7f4fb00ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb015eab0 0x7f4fb00ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 -- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fb00cf6d0 msgr2=0x7f4fb014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fb00cf6d0 0x7f4fb014aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 -- 172.21.15.5:0/1418248182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40094a0 con 0x7f4fb00d1d90 2023-10-16T13:49:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4fb55c4700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb015eab0 0x7f4fb00ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.732+0000 7f4faffff700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 0x7f4fb015f050 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c550 tx=0x7f4f9c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.733+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c004c80 con 0x7f4fb00d1d90 2023-10-16T13:49:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.733+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c004e00 con 0x7f4fb00d1d90 2023-10-16T13:49:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.733+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb00ae540 con 0x7f4fb00d1d90 2023-10-16T13:49:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.734+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c007310 con 0x7f4fb00d1d90 2023-10-16T13:49:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.734+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb00aeb00 con 0x7f4fb00d1d90 2023-10-16T13:49:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.734+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb0067d20 con 0x7f4fb00d1d90 2023-10-16T13:49:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.735+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f4f9c007470 con 0x7f4fb00d1d90 2023-10-16T13:49:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.736+0000 7f4fad7fa700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f9406b2f0 0x7f4f9406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.736+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f9c0897c0 con 0x7f4fb00d1d90 2023-10-16T13:49:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.736+0000 7f4fb4dc3700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f9406b2f0 0x7f4f9406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.736+0000 7f4fb4dc3700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f9406b2f0 0x7f4f9406d7b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40090b0 tx=0x7f4fa4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.742+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f9c054430 con 0x7f4fb00d1d90 2023-10-16T13:49:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.947+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fb00b7540 con 0x7f4fb00d1d90 2023-10-16T13:49:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.949+0000 7f4fad7fa700 1 -- 172.21.15.5:0/1418248182 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f4f9c057a50 con 0x7f4fb00d1d90 2023-10-16T13:49:45.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:45.952 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":135,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:36.376754+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f9406b2f0 msgr2=0x7f4f9406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f9406b2f0 0x7f4f9406d7b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40090b0 tx=0x7f4fa4008030 comp rx=0 tx=0).stop 2023-10-16T13:49:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 msgr2=0x7f4fb015f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:45.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 0x7f4fb015f050 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c550 tx=0x7f4f9c00c860 comp rx=0 tx=0).stop 2023-10-16T13:49:45.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 shutdown_connections 2023-10-16T13:49:45.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4f9406b2f0 0x7f4f9406d7b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fb015eab0 0x7f4fb00ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fb00cf6d0 0x7f4fb014aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 --2- 172.21.15.5:0/1418248182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d1d90 0x7f4fb015f050 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:45.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 >> 172.21.15.5:0/1418248182 conn(0x7f4fb00665a0 msgr2=0x7f4fb00b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:45.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 shutdown_connections 2023-10-16T13:49:45.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:45.951+0000 7f4fb7027700 1 -- 172.21.15.5:0/1418248182 wait complete. 2023-10-16T13:49:45.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:49:33.286763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:49:33.761808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:45.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:46.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.092+0000 7f6a6835a700 1 Processor -- start 2023-10-16T13:49:46.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.092+0000 7f6a6835a700 1 -- start start 2023-10-16T13:49:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a6835a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6a6015ab10 0x7f6a6015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a6835a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a600cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a6835a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6015e7a0 con 0x7f6a600b1f50 2023-10-16T13:49:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a6835a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6015f730 con 0x7f6a6015ab10 2023-10-16T13:49:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a6835a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b29a0 con 0x7f6a600cfe30 2023-10-16T13:49:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a658f5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6a600b1f50 0x7f6a600cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60796/0 (socket says 172.21.15.5:60796) 2023-10-16T13:49:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a658f5700 1 -- 172.21.15.5:0/4165931251 learned_addr learned my addr 172.21.15.5:0/4165931251 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a668f7700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a600cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a660f6700 1 --2- 172.21.15.5:0/4165931251 >> v2:172.21.15.112:3300/0 conn(0x7f6a6015ab10 0x7f6a6015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422856544 0 0) 0x7f6a6015e7a0 con 0x7f6a600b1f50 2023-10-16T13:49:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.093+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c0035b0 con 0x7f6a600b1f50 2023-10-16T13:49:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4202292515 0 0) 0x7f6a4c0035b0 con 0x7f6a600b1f50 2023-10-16T13:49:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 msgr2=0x7f6a600cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a600cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 >> v2:172.21.15.112:3300/0 conn(0x7f6a6015ab10 msgr2=0x7f6a6015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 --2- 172.21.15.5:0/4165931251 >> v2:172.21.15.112:3300/0 conn(0x7f6a6015ab10 0x7f6a6015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600b2c80 con 0x7f6a600b1f50 2023-10-16T13:49:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6a5c0017f0 con 0x7f6a600b1f50 2023-10-16T13:49:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 >> v1:172.21.15.5:6789/0 conn(0x7f6a600b1f50 legacy=0x7f6a600cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a4c003a00 0x7f6a4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c004d90 0x7f6a4c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6015f730 con 0x7f6a4c003a00 2023-10-16T13:49:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b29a0 con 0x7f6a4c004d90 2023-10-16T13:49:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c00ba10 con 0x7f6a600cfe30 2023-10-16T13:49:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a4c003a00 0x7f6a4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a658f5700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a668f7700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c004d90 0x7f6a4c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 -- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 msgr2=0x7f6a4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 -- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c004d90 msgr2=0x7f6a4c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c004d90 0x7f6a4c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 -- 172.21.15.5:0/4165931251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0035b0 con 0x7f6a4c003a00 2023-10-16T13:49:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a658f5700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a600cfe30 0x7f6a4c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a660f6700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a4c003a00 0x7f6a4c003e20 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009b90 tx=0x7f6a4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3808b012a4d7d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000e6c0 con 0x7f6a4c003a00 2023-10-16T13:49:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000e820 con 0x7f6a4c003a00 2023-10-16T13:49:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.094+0000 7f6a650f4700 1 -- 172.21.15.5:0/4165931251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000eb90 con 0x7f6a4c003a00 2023-10-16T13:49:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a6835a700 1 -- 172.21.15.5:0/4165931251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a4c003a00 msgr2=0x7f6a4c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a6835a700 1 --2- 172.21.15.5:0/4165931251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a4c003a00 0x7f6a4c003e20 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009b90 tx=0x7f6a4c005880 comp rx=0 tx=0).stop 2023-10-16T13:49:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a668f7700 1 -- 172.21.15.5:0/4165931251 reap_dead start 2023-10-16T13:49:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a6835a700 1 -- 172.21.15.5:0/4165931251 shutdown_connections 2023-10-16T13:49:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a6835a700 1 -- 172.21.15.5:0/4165931251 >> 172.21.15.5:0/4165931251 conn(0x7f6a6006dae0 msgr2=0x7f6a6006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a6835a700 1 -- 172.21.15.5:0/4165931251 shutdown_connections 2023-10-16T13:49:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.095+0000 7f6a6835a700 1 -- 172.21.15.5:0/4165931251 wait complete. 2023-10-16T13:49:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.096+0000 7f6a6835a700 1 Processor -- start 2023-10-16T13:49:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.096+0000 7f6a6835a700 1 -- start start 2023-10-16T13:49:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a6835a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c003a00 0x7f6a600aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a6835a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 0x7f6a6014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a6835a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a6015b250 0x7f6a6015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a6835a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6015cc40 con 0x7f6a6014a980 2023-10-16T13:49:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a6835a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6014b340 con 0x7f6a4c003a00 2023-10-16T13:49:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a6835a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6015bfc0 con 0x7f6a6015b250 2023-10-16T13:49:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 0x7f6a6014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 0x7f6a6014ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50804/0 (socket says 172.21.15.5:50804) 2023-10-16T13:49:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 -- 172.21.15.5:0/1809371582 learned_addr learned my addr 172.21.15.5:0/1809371582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a660f6700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c003a00 0x7f6a600aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a668f7700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a6015b250 0x7f6a6015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 -- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a6015b250 msgr2=0x7f6a6015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a6015b250 0x7f6a6015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 -- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c003a00 msgr2=0x7f6a600aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c003a00 0x7f6a600aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a658f5700 1 -- 172.21.15.5:0/1809371582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6015c2a0 con 0x7f6a6014a980 2023-10-16T13:49:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.097+0000 7f6a660f6700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c003a00 0x7f6a600aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.098+0000 7f6a658f5700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 0x7f6a6014ae00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001380 tx=0x7f6a5c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.098+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0072e0 con 0x7f6a6014a980 2023-10-16T13:49:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.098+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c007440 con 0x7f6a6014a980 2023-10-16T13:49:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.098+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c005830 con 0x7f6a6014a980 2023-10-16T13:49:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.098+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6015c580 con 0x7f6a6014a980 2023-10-16T13:49:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.098+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600af2b0 con 0x7f6a6014a980 2023-10-16T13:49:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.099+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a60148930 con 0x7f6a6014a980 2023-10-16T13:49:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.099+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f6a5c005990 con 0x7f6a6014a980 2023-10-16T13:49:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.100+0000 7f6a56ffd700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a4406b2f0 0x7f6a4406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.100+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a5c089bc0 con 0x7f6a6014a980 2023-10-16T13:49:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.100+0000 7f6a660f6700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a4406b2f0 0x7f6a4406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.100+0000 7f6a660f6700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a4406b2f0 0x7f6a4406d7b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009ab0 tx=0x7f6a50008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.104+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a60148930 con 0x7f6a6014a980 2023-10-16T13:49:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.304+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a60148930 con 0x7f6a6014a980 2023-10-16T13:49:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.305+0000 7f6a56ffd700 1 -- 172.21.15.5:0/1809371582 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a60148930 con 0x7f6a6014a980 2023-10-16T13:49:46.308 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a4406b2f0 msgr2=0x7f6a4406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a4406b2f0 0x7f6a4406d7b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009ab0 tx=0x7f6a50008030 comp rx=0 tx=0).stop 2023-10-16T13:49:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 msgr2=0x7f6a6014ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 0x7f6a6014ae00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001380 tx=0x7f6a5c00eaa0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 shutdown_connections 2023-10-16T13:49:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f6a4406b2f0 0x7f6a4406d7b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a6015b250 0x7f6a6015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a4c003a00 0x7f6a600aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 --2- 172.21.15.5:0/1809371582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6014a980 0x7f6a6014ae00 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 >> 172.21.15.5:0/1809371582 conn(0x7f6a6006dae0 msgr2=0x7f6a60159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 shutdown_connections 2023-10-16T13:49:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.307+0000 7f6a6835a700 1 -- 172.21.15.5:0/1809371582 wait complete. 2023-10-16T13:49:46.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:49:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.447+0000 7efc5e6ce700 1 Processor -- start 2023-10-16T13:49:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.447+0000 7efc5e6ce700 1 -- start start 2023-10-16T13:49:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc5e6ce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc58072880 0x7efc580c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc5e6ce700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efc580ce870 0x7efc580ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc5e6ce700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc58071dc0 con 0x7efc5815ac40 2023-10-16T13:49:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc5e6ce700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580ce450 con 0x7efc58072880 2023-10-16T13:49:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc5e6ce700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580ce0e0 con 0x7efc580ce870 2023-10-16T13:49:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc577fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc58072880 0x7efc580c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc57fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc5815ac40 0x7efc580cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60814/0 (socket says 172.21.15.5:60814) 2023-10-16T13:49:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.448+0000 7efc57fff700 1 -- 172.21.15.5:0/1528084015 learned_addr learned my addr 172.21.15.5:0/1528084015 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5cc6b700 1 --2- 172.21.15.5:0/1528084015 >> v2:172.21.15.112:3300/0 conn(0x7efc580ce870 0x7efc580ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc577fe700 1 -- 172.21.15.5:0/1528084015 >> v2:172.21.15.112:3300/0 conn(0x7efc580ce870 msgr2=0x7efc580ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc577fe700 1 --2- 172.21.15.5:0/1528084015 >> v2:172.21.15.112:3300/0 conn(0x7efc580ce870 0x7efc580ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc577fe700 1 -- 172.21.15.5:0/1528084015 >> v1:172.21.15.5:6789/0 conn(0x7efc5815ac40 legacy=0x7efc580cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc577fe700 1 -- 172.21.15.5:0/1528084015 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580cc5e0 con 0x7efc58072880 2023-10-16T13:49:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5cc6b700 1 --2- 172.21.15.5:0/1528084015 >> v2:172.21.15.112:3300/0 conn(0x7efc580ce870 0x7efc580ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc577fe700 1 --2- 172.21.15.5:0/1528084015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c3fc0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7efc580afe40 tx=0x7efc40009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b44c97174f9a9b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc56ffd700 1 -- 172.21.15.5:0/1528084015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40011830 con 0x7efc58072880 2023-10-16T13:49:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc56ffd700 1 -- 172.21.15.5:0/1528084015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40011990 con 0x7efc58072880 2023-10-16T13:49:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc56ffd700 1 -- 172.21.15.5:0/1528084015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40011d20 con 0x7efc58072880 2023-10-16T13:49:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5e6ce700 1 -- 172.21.15.5:0/1528084015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 msgr2=0x7efc580c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/1528084015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c3fc0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7efc580afe40 tx=0x7efc40009b20 comp rx=0 tx=0).stop 2023-10-16T13:49:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5e6ce700 1 -- 172.21.15.5:0/1528084015 shutdown_connections 2023-10-16T13:49:46.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/1528084015 >> v2:172.21.15.112:3300/0 conn(0x7efc580ce870 0x7efc580ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/1528084015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c3fc0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.449+0000 7efc5e6ce700 1 -- 172.21.15.5:0/1528084015 >> 172.21.15.5:0/1528084015 conn(0x7efc5806da50 msgr2=0x7efc5806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:46.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.450+0000 7efc5e6ce700 1 -- 172.21.15.5:0/1528084015 shutdown_connections 2023-10-16T13:49:46.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.450+0000 7efc5e6ce700 1 -- 172.21.15.5:0/1528084015 wait complete. 2023-10-16T13:49:46.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.451+0000 7efc5e6ce700 1 Processor -- start 2023-10-16T13:49:46.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.451+0000 7efc5e6ce700 1 -- start start 2023-10-16T13:49:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc580ce870 0x7efc580afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc5815ac40 0x7efc580b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f14d0 con 0x7efc58072880 2023-10-16T13:49:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f17b0 con 0x7efc5815ac40 2023-10-16T13:49:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f1a90 con 0x7efc580ce870 2023-10-16T13:49:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50816/0 (socket says 172.21.15.5:50816) 2023-10-16T13:49:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 -- 172.21.15.5:0/4212338693 learned_addr learned my addr 172.21.15.5:0/4212338693 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5cc6b700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc5815ac40 0x7efc580b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc577fe700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc580ce870 0x7efc580afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 -- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc580ce870 msgr2=0x7efc580afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc580ce870 0x7efc580afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 -- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc5815ac40 msgr2=0x7efc580b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc5815ac40 0x7efc580b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 -- 172.21.15.5:0/4212338693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400094a0 con 0x7efc58072880 2023-10-16T13:49:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc57fff700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c9e50 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7efc4800c480 tx=0x7efc4800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48005d70 con 0x7efc58072880 2023-10-16T13:49:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800ce90 con 0x7efc58072880 2023-10-16T13:49:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc581f1d70 con 0x7efc58072880 2023-10-16T13:49:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc480072d0 con 0x7efc58072880 2023-10-16T13:49:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.452+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc580ca390 con 0x7efc58072880 2023-10-16T13:49:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.453+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc581f1f60 con 0x7efc58072880 2023-10-16T13:49:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.454+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7efc48007430 con 0x7efc58072880 2023-10-16T13:49:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.454+0000 7efc54ff9700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efc3806b2f0 0x7efc3806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.454+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc48088f70 con 0x7efc58072880 2023-10-16T13:49:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.455+0000 7efc577fe700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efc3806b2f0 0x7efc3806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.455+0000 7efc577fe700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efc3806b2f0 0x7efc3806d7b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efc580afe40 tx=0x7efc4001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.459+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc48053ab0 con 0x7efc58072880 2023-10-16T13:49:46.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.660+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc581f1610 con 0x7efc58072880 2023-10-16T13:49:46.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.660+0000 7efc54ff9700 1 -- 172.21.15.5:0/4212338693 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc48017020 con 0x7efc58072880 2023-10-16T13:49:46.664 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:49:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efc3806b2f0 msgr2=0x7efc3806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efc3806b2f0 0x7efc3806d7b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efc580afe40 tx=0x7efc4001c040 comp rx=0 tx=0).stop 2023-10-16T13:49:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 msgr2=0x7efc580c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c9e50 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7efc4800c480 tx=0x7efc4800c790 comp rx=0 tx=0).stop 2023-10-16T13:49:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 shutdown_connections 2023-10-16T13:49:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc5815ac40 0x7efc580b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc58072880 0x7efc580c9e50 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7efc3806b2f0 0x7efc3806d7b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 --2- 172.21.15.5:0/4212338693 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efc580ce870 0x7efc580afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 >> 172.21.15.5:0/4212338693 conn(0x7efc5806da50 msgr2=0x7efc580cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 shutdown_connections 2023-10-16T13:49:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.662+0000 7efc5e6ce700 1 -- 172.21.15.5:0/4212338693 wait complete. 2023-10-16T13:49:46.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:49:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.802+0000 7f79af514700 1 Processor -- start 2023-10-16T13:49:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.803+0000 7f79af514700 1 -- start start 2023-10-16T13:49:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.803+0000 7f79af514700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79a80cfe30 0x7f79a80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.803+0000 7f79af514700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a815e7a0 con 0x7f79a815f1f0 2023-10-16T13:49:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.803+0000 7f79af514700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80b29a0 con 0x7f79a815ab10 2023-10-16T13:49:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.803+0000 7f79af514700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80b2c80 con 0x7f79a80cfe30 2023-10-16T13:49:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f79acaaf700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79a815f1f0 0x7f79a80cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60828/0 (socket says 172.21.15.5:60828) 2023-10-16T13:49:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f79acaaf700 1 -- 172.21.15.5:0/1345189811 learned_addr learned my addr 172.21.15.5:0/1345189811 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966055251 0 0) 0x7f79a815e7a0 con 0x7f79a815f1f0 2023-10-16T13:49:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f79adab1700 1 --2- 172.21.15.5:0/1345189811 >> v2:172.21.15.112:3300/0 conn(0x7f79a80cfe30 0x7f79a80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79940035b0 con 0x7f79a815f1f0 2023-10-16T13:49:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980242834 0 0) 0x7f79940035b0 con 0x7f79a815f1f0 2023-10-16T13:49:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 >> v2:172.21.15.112:3300/0 conn(0x7f79a80cfe30 msgr2=0x7f79a80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 --2- 172.21.15.5:0/1345189811 >> v2:172.21.15.112:3300/0 conn(0x7f79a80cfe30 0x7f79a80cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 >> v1:172.21.15.112:6789/0 conn(0x7f79a815ab10 legacy=0x7f79a80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a815e9f0 con 0x7f79a815f1f0 2023-10-16T13:49:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f799c0017f0 con 0x7f79a815f1f0 2023-10-16T13:49:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 >> v1:172.21.15.5:6789/0 conn(0x7f79a815f1f0 legacy=0x7f79a80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7994003a00 0x7f7994003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994004850 0x7f7994004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7994005210 0x7f799400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80b2c80 con 0x7f7994005210 2023-10-16T13:49:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799400c0b0 con 0x7f7994003a00 2023-10-16T13:49:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799400c270 con 0x7f7994004850 2023-10-16T13:49:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f79adab1700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7994005210 0x7f799400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f79acaaf700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994004850 0x7f7994004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.804+0000 7f79ad2b0700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7994003a00 0x7f7994003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 -- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994004850 msgr2=0x7f7994004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994004850 0x7f7994004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 -- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7994003a00 msgr2=0x7f7994003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:46.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7994003a00 0x7f7994003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 -- 172.21.15.5:0/1345189811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940035b0 con 0x7f7994005210 2023-10-16T13:49:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 -- 172.21.15.5:0/1345189811 reap_dead start 2023-10-16T13:49:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79adab1700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7994005210 0x7f799400ba10 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009f90 tx=0x7f7994005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03fdbb11fe3d624 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000ec30 con 0x7f7994005210 2023-10-16T13:49:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000f040 con 0x7f7994005210 2023-10-16T13:49:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f799bfff700 1 -- 172.21.15.5:0/1345189811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0014480 con 0x7f7994005210 2023-10-16T13:49:46.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79af514700 1 -- 172.21.15.5:0/1345189811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7994005210 msgr2=0x7f799400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.805+0000 7f79af514700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7994005210 0x7f799400ba10 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009f90 tx=0x7f7994005880 comp rx=0 tx=0).stop 2023-10-16T13:49:46.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.806+0000 7f79af514700 1 -- 172.21.15.5:0/1345189811 shutdown_connections 2023-10-16T13:49:46.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.806+0000 7f79af514700 1 --2- 172.21.15.5:0/1345189811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7994005210 0x7f799400ba10 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.806+0000 7f79af514700 1 -- 172.21.15.5:0/1345189811 >> 172.21.15.5:0/1345189811 conn(0x7f79a806dae0 msgr2=0x7f79a806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.806+0000 7f79af514700 1 -- 172.21.15.5:0/1345189811 shutdown_connections 2023-10-16T13:49:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.806+0000 7f79af514700 1 -- 172.21.15.5:0/1345189811 wait complete. 2023-10-16T13:49:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.807+0000 7f79af514700 1 Processor -- start 2023-10-16T13:49:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.807+0000 7f79af514700 1 -- start start 2023-10-16T13:49:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994005210 0x7f79a8155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79a81567d0 0x7f79a8071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 0x7f79a815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8155ae0 con 0x7f79a8072420 2023-10-16T13:49:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80728a0 con 0x7f79a81567d0 2023-10-16T13:49:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80c6f50 con 0x7f7994005210 2023-10-16T13:49:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 0x7f79a815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79ad2b0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994005210 0x7f79a8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 0x7f79a815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50840/0 (socket says 172.21.15.5:50840) 2023-10-16T13:49:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79acaaf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79a81567d0 0x7f79a8071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 -- 172.21.15.5:0/617004031 learned_addr learned my addr 172.21.15.5:0/617004031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 -- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994005210 msgr2=0x7f79a8155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994005210 0x7f79a8155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 -- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79a81567d0 msgr2=0x7f79a8071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79a81567d0 0x7f79a8071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 -- 172.21.15.5:0/617004031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a815dc00 con 0x7f79a8072420 2023-10-16T13:49:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79adab1700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 0x7f79a815cf90 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f79a815e700 tx=0x7f79a0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0007000 con 0x7f79a8072420 2023-10-16T13:49:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0003e30 con 0x7f79a8072420 2023-10-16T13:49:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0015a80 con 0x7f79a8072420 2023-10-16T13:49:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.808+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a8155cf0 con 0x7f79a8072420 2023-10-16T13:49:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.809+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a81562b0 con 0x7f79a8072420 2023-10-16T13:49:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.810+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a8067d20 con 0x7f79a8072420 2023-10-16T13:49:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.810+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f79a0024070 con 0x7f79a8072420 2023-10-16T13:49:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.811+0000 7f7999ffb700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f798c06b2f0 0x7f798c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.811+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79a008b610 con 0x7f79a8072420 2023-10-16T13:49:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.811+0000 7f79ad2b0700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f798c06b2f0 0x7f798c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.811+0000 7f79ad2b0700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f798c06b2f0 0x7f798c06d7b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000c00 tx=0x7f79a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:46.815+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79a0056250 con 0x7f79a8072420 2023-10-16T13:49:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.015+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79a80afc10 con 0x7f79a8072420 2023-10-16T13:49:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.015+0000 7f7999ffb700 1 -- 172.21.15.5:0/617004031 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79a0059870 con 0x7f79a8072420 2023-10-16T13:49:47.019 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:49:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f798c06b2f0 msgr2=0x7f798c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f798c06b2f0 0x7f798c06d7b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000c00 tx=0x7f79a4009040 comp rx=0 tx=0).stop 2023-10-16T13:49:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 msgr2=0x7f79a815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 0x7f79a815cf90 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f79a815e700 tx=0x7f79a0004b40 comp rx=0 tx=0).stop 2023-10-16T13:49:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 shutdown_connections 2023-10-16T13:49:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a8072420 0x7f79a815cf90 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f798c06b2f0 0x7f798c06d7b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7994005210 0x7f79a8155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 --2- 172.21.15.5:0/617004031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79a81567d0 0x7f79a8071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 >> 172.21.15.5:0/617004031 conn(0x7f79a806dae0 msgr2=0x7f79a80aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 shutdown_connections 2023-10-16T13:49:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.017+0000 7f79af514700 1 -- 172.21.15.5:0/617004031 wait complete. 2023-10-16T13:49:47.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:49:47.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.156+0000 7f698dfbc700 1 Processor -- start 2023-10-16T13:49:47.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.156+0000 7f698dfbc700 1 -- start start 2023-10-16T13:49:47.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f698dfbc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f698815dce0 0x7f69880b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f698dfbc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 0x7f69880cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f698dfbc700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698806cb70 con 0x7f698815e0c0 2023-10-16T13:49:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f698dfbc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69880cbc40 con 0x7f698815dce0 2023-10-16T13:49:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f698dfbc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698806ce50 con 0x7f69880cfc00 2023-10-16T13:49:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f6986ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f698815e0c0 0x7f69880cf4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60850/0 (socket says 172.21.15.5:60850) 2023-10-16T13:49:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f6986ffd700 1 -- 172.21.15.5:0/4199757653 learned_addr learned my addr 172.21.15.5:0/4199757653 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f6987fff700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 0x7f69880cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f69877fe700 1 --2- 172.21.15.5:0/4199757653 >> v2:172.21.15.112:3300/0 conn(0x7f698815dce0 0x7f69880b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254152365 0 0) 0x7f698806cb70 con 0x7f698815e0c0 2023-10-16T13:49:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.157+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69700035b0 con 0x7f698815e0c0 2023-10-16T13:49:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4010460345 0 0) 0x7f69700035b0 con 0x7f698815e0c0 2023-10-16T13:49:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 msgr2=0x7f69880cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 0x7f69880cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 >> v2:172.21.15.112:3300/0 conn(0x7f698815dce0 msgr2=0x7f69880b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 --2- 172.21.15.5:0/4199757653 >> v2:172.21.15.112:3300/0 conn(0x7f698815dce0 0x7f69880b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698806d130 con 0x7f698815e0c0 2023-10-16T13:49:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f6978001670 con 0x7f698815e0c0 2023-10-16T13:49:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 >> v1:172.21.15.5:6789/0 conn(0x7f698815e0c0 legacy=0x7f69880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 0x7f6970003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6970003f80 0x7f6970004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6970004d90 0x7f6970005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69880cbc40 con 0x7f6970003f80 2023-10-16T13:49:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698806ce50 con 0x7f6970004d90 2023-10-16T13:49:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697000ba60 con 0x7f69880cfc00 2023-10-16T13:49:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6970003f80 0x7f6970004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f69877fe700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 0x7f6970003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6987fff700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6970004d90 0x7f6970005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 -- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 msgr2=0x7f6970003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69880cfc00 0x7f6970003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 -- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6970004d90 msgr2=0x7f6970005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6970004d90 0x7f6970005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 -- 172.21.15.5:0/4199757653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700035b0 con 0x7f6970003f80 2023-10-16T13:49:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.158+0000 7f6986ffd700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6970003f80 0x7f6970004850 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f697800c3a0 tx=0x7f6970005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dce11d3f0b1f9b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978007c60 con 0x7f6970003f80 2023-10-16T13:49:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978005960 con 0x7f6970003f80 2023-10-16T13:49:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f69867fc700 1 -- 172.21.15.5:0/4199757653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800cea0 con 0x7f6970003f80 2023-10-16T13:49:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f698dfbc700 1 -- 172.21.15.5:0/4199757653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6970003f80 msgr2=0x7f6970004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f698dfbc700 1 --2- 172.21.15.5:0/4199757653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6970003f80 0x7f6970004850 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f697800c3a0 tx=0x7f6970005880 comp rx=0 tx=0).stop 2023-10-16T13:49:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f6987fff700 1 -- 172.21.15.5:0/4199757653 reap_dead start 2023-10-16T13:49:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f698dfbc700 1 -- 172.21.15.5:0/4199757653 shutdown_connections 2023-10-16T13:49:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f698dfbc700 1 -- 172.21.15.5:0/4199757653 >> 172.21.15.5:0/4199757653 conn(0x7f69880d15f0 msgr2=0x7f69880d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f698dfbc700 1 -- 172.21.15.5:0/4199757653 shutdown_connections 2023-10-16T13:49:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.159+0000 7f698dfbc700 1 -- 172.21.15.5:0/4199757653 wait complete. 2023-10-16T13:49:47.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.160+0000 7f698dfbc700 1 Processor -- start 2023-10-16T13:49:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 -- start start 2023-10-16T13:49:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6970003f80 0x7f69881602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69880c7d40 0x7f69880caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 0x7f69880cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698815e4f0 con 0x7f6988160820 2023-10-16T13:49:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69881563b0 con 0x7f69880c7d40 2023-10-16T13:49:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f698dfbc700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69881533e0 con 0x7f6970003f80 2023-10-16T13:49:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f6987fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 0x7f69880cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f6987fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 0x7f69880cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50860/0 (socket says 172.21.15.5:50860) 2023-10-16T13:49:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f6987fff700 1 -- 172.21.15.5:0/1055013571 learned_addr learned my addr 172.21.15.5:0/1055013571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.161+0000 7f69877fe700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6970003f80 0x7f69881602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6986ffd700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69880c7d40 0x7f69880caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6987fff700 1 -- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6970003f80 msgr2=0x7f69881602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6987fff700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6970003f80 0x7f69881602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6987fff700 1 -- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69880c7d40 msgr2=0x7f69880caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6987fff700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69880c7d40 0x7f69880caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6987fff700 1 -- 172.21.15.5:0/1055013571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698815e700 con 0x7f6988160820 2023-10-16T13:49:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f6987fff700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 0x7f69880cb400 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6988067c30 tx=0x7f6980011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000e040 con 0x7f6988160820 2023-10-16T13:49:47.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698000f040 con 0x7f6988160820 2023-10-16T13:49:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698815e9e0 con 0x7f6988160820 2023-10-16T13:49:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000fbe0 con 0x7f6988160820 2023-10-16T13:49:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.162+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698815efa0 con 0x7f6988160820 2023-10-16T13:49:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.163+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6988067d20 con 0x7f6988160820 2023-10-16T13:49:47.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.164+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f698000fd40 con 0x7f6988160820 2023-10-16T13:49:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.164+0000 7f696ffff700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f697406b2f0 0x7f697406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.164+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f698008a0f0 con 0x7f6988160820 2023-10-16T13:49:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.164+0000 7f69877fe700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f697406b2f0 0x7f697406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.165+0000 7f69877fe700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f697406b2f0 0x7f697406d7b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f697c009c60 tx=0x7f697c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.169+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6980054b40 con 0x7f6988160820 2023-10-16T13:49:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.387+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f698815fda0 con 0x7f6988160820 2023-10-16T13:49:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.387+0000 7f696ffff700 1 -- 172.21.15.5:0/1055013571 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6980058160 con 0x7f6988160820 2023-10-16T13:49:47.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f697406b2f0 msgr2=0x7f697406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f697406b2f0 0x7f697406d7b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f697c009c60 tx=0x7f697c009210 comp rx=0 tx=0).stop 2023-10-16T13:49:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 msgr2=0x7f69880cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 0x7f69880cb400 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6988067c30 tx=0x7f6980011ed0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 shutdown_connections 2023-10-16T13:49:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6988160820 0x7f69880cb400 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f697406b2f0 0x7f697406d7b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6970003f80 0x7f69881602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 --2- 172.21.15.5:0/1055013571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69880c7d40 0x7f69880caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 >> 172.21.15.5:0/1055013571 conn(0x7f69880d15f0 msgr2=0x7f69880c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 shutdown_connections 2023-10-16T13:49:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.389+0000 7f698dfbc700 1 -- 172.21.15.5:0/1055013571 wait complete. 2023-10-16T13:49:47.395 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:49:47.404 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T13:49:47.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:47.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-16T13:49:47.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:49:47.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:47.445 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T13:49:47.501 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:47.502 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:47.523 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:47.523 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:47.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:47.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.706+0000 7f9d69465700 1 Processor -- start 2023-10-16T13:49:47.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.707+0000 7f9d69465700 1 -- start start 2023-10-16T13:49:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.707+0000 7f9d69465700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d6406bf60 0x7f9d640cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.707+0000 7f9d69465700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d640cbe80 con 0x7f9d640cab20 2023-10-16T13:49:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.707+0000 7f9d69465700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d640c5ae0 con 0x7f9d640c67d0 2023-10-16T13:49:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.707+0000 7f9d69465700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d640cdfd0 con 0x7f9d6406bf60 2023-10-16T13:49:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d627fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d6406bf60 0x7f9d640cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d637fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9d640cab20 0x7f9d6415cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60872/0 (socket says 172.21.15.5:60872) 2023-10-16T13:49:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d637fe700 1 -- 172.21.15.5:0/2936128602 learned_addr learned my addr 172.21.15.5:0/2936128602 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d627fc700 1 -- 172.21.15.5:0/2936128602 >> v1:172.21.15.112:6789/0 conn(0x7f9d640c67d0 legacy=0x7f9d6406b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d627fc700 1 -- 172.21.15.5:0/2936128602 >> v1:172.21.15.5:6789/0 conn(0x7f9d640cab20 legacy=0x7f9d6415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d627fc700 1 -- 172.21.15.5:0/2936128602 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640cb270 con 0x7f9d6406bf60 2023-10-16T13:49:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d627fc700 1 --2- 172.21.15.5:0/2936128602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d640cec20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009840 tx=0x7f9d4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff5dccb2d117bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d61ffb700 1 -- 172.21.15.5:0/2936128602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c004230 con 0x7f9d6406bf60 2023-10-16T13:49:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d61ffb700 1 -- 172.21.15.5:0/2936128602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c004390 con 0x7f9d6406bf60 2023-10-16T13:49:47.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.708+0000 7f9d61ffb700 1 -- 172.21.15.5:0/2936128602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0036a0 con 0x7f9d6406bf60 2023-10-16T13:49:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 -- 172.21.15.5:0/2936128602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 msgr2=0x7f9d640cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 --2- 172.21.15.5:0/2936128602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d640cec20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009840 tx=0x7f9d4c009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 -- 172.21.15.5:0/2936128602 shutdown_connections 2023-10-16T13:49:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 --2- 172.21.15.5:0/2936128602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d640cec20 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 -- 172.21.15.5:0/2936128602 >> 172.21.15.5:0/2936128602 conn(0x7f9d64071310 msgr2=0x7f9d64071720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 -- 172.21.15.5:0/2936128602 shutdown_connections 2023-10-16T13:49:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.709+0000 7f9d69465700 1 -- 172.21.15.5:0/2936128602 wait complete. 2023-10-16T13:49:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.710+0000 7f9d69465700 1 Processor -- start 2023-10-16T13:49:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.710+0000 7f9d69465700 1 -- start start 2023-10-16T13:49:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d69465700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d6414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d69465700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d640c67d0 0x7f9d640b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d69465700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d640cab20 0x7f9d64159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d69465700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6414dbe0 con 0x7f9d6406bf60 2023-10-16T13:49:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d69465700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640b3340 con 0x7f9d640c67d0 2023-10-16T13:49:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d69465700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640b3ec0 con 0x7f9d640cab20 2023-10-16T13:49:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d6414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d6414d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50870/0 (socket says 172.21.15.5:50870) 2023-10-16T13:49:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 -- 172.21.15.5:0/543310396 learned_addr learned my addr 172.21.15.5:0/543310396 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 -- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d640cab20 msgr2=0x7f9d64159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d640cab20 0x7f9d64159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 -- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d640c67d0 msgr2=0x7f9d640b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d627fc700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d640c67d0 0x7f9d640b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d640c67d0 0x7f9d640b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d62ffd700 1 -- 172.21.15.5:0/543310396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0094a0 con 0x7f9d6406bf60 2023-10-16T13:49:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.711+0000 7f9d627fc700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d640c67d0 0x7f9d640b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.712+0000 7f9d62ffd700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d6414d6a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400c500 tx=0x7f9d5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.712+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011790 con 0x7f9d6406bf60 2023-10-16T13:49:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.712+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540118f0 con 0x7f9d6406bf60 2023-10-16T13:49:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.712+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d640b3590 con 0x7f9d6406bf60 2023-10-16T13:49:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.712+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011ca0 con 0x7f9d6406bf60 2023-10-16T13:49:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.712+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d640b3b50 con 0x7f9d6406bf60 2023-10-16T13:49:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.713+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6404ebb0 con 0x7f9d6406bf60 2023-10-16T13:49:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.713+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f9d5401c460 con 0x7f9d6406bf60 2023-10-16T13:49:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.714+0000 7f9d5b7fe700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d4406b2f0 0x7f9d4406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.714+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d54089c00 con 0x7f9d6406bf60 2023-10-16T13:49:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.714+0000 7f9d627fc700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d4406b2f0 0x7f9d4406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.714+0000 7f9d627fc700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d4406b2f0 0x7f9d4406d7b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9d640cc3c0 tx=0x7f9d4c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.718+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d54054650 con 0x7f9d6406bf60 2023-10-16T13:49:47.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.924+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d640b3ce0 con 0x7f9d6406bf60 2023-10-16T13:49:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.925+0000 7f9d5b7fe700 1 -- 172.21.15.5:0/543310396 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f9d54057c70 con 0x7f9d6406bf60 2023-10-16T13:49:47.928 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:47.929 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":135,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:36.376754+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:47.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d4406b2f0 msgr2=0x7f9d4406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d4406b2f0 0x7f9d4406d7b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9d640cc3c0 tx=0x7f9d4c008030 comp rx=0 tx=0).stop 2023-10-16T13:49:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 msgr2=0x7f9d6414d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d6414d6a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400c500 tx=0x7f9d5400c8c0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 shutdown_connections 2023-10-16T13:49:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d4406b2f0 0x7f9d4406d7b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d640cab20 0x7f9d64159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d6406bf60 0x7f9d6414d6a0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 --2- 172.21.15.5:0/543310396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d640c67d0 0x7f9d640b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:47.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 >> 172.21.15.5:0/543310396 conn(0x7f9d64071310 msgr2=0x7f9d6415e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 shutdown_connections 2023-10-16T13:49:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:47.927+0000 7f9d69465700 1 -- 172.21.15.5:0/543310396 wait complete. 2023-10-16T13:49:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:49:33.286763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:49:33.761808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:47.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:48.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.069+0000 7fea24077700 1 Processor -- start 2023-10-16T13:49:48.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.069+0000 7fea24077700 1 -- start start 2023-10-16T13:49:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea24077700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 0x7fea1c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea24077700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c0d23e0 con 0x7fea1c15b740 2023-10-16T13:49:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea24077700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c0cf190 con 0x7fea1c0c5110 2023-10-16T13:49:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea24077700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15bb20 con 0x7fea1c0d0c70 2023-10-16T13:49:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea21e13700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea1c15b740 0x7fea1c0d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60882/0 (socket says 172.21.15.5:60882) 2023-10-16T13:49:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea21e13700 1 -- 172.21.15.5:0/2336106632 learned_addr learned my addr 172.21.15.5:0/2336106632 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:48.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea21612700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 0x7fea1c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205967868 0 0) 0x7fea18001110 con 0x7fea1c15b740 2023-10-16T13:49:48.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea080035b0 con 0x7fea1c15b740 2023-10-16T13:49:48.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390462577 0 0) 0x7fea080035b0 con 0x7fea1c15b740 2023-10-16T13:49:48.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 msgr2=0x7fea1c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:48.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 0x7fea1c0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 >> v1:172.21.15.112:6789/0 conn(0x7fea1c0c5110 legacy=0x7fea1c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0cbd40 con 0x7fea1c15b740 2023-10-16T13:49:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.070+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fea18001800 con 0x7fea1c15b740 2023-10-16T13:49:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 >> v1:172.21.15.5:6789/0 conn(0x7fea1c15b740 legacy=0x7fea1c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea08003a30 0x7fea08003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea080043e0 0x7fea080048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 0x7fea080051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15bb20 con 0x7fea080043e0 2023-10-16T13:49:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0800bac0 con 0x7fea08003a30 2023-10-16T13:49:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0800bc80 con 0x7fea1c0d0c70 2023-10-16T13:49:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea080043e0 0x7fea080048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21e13700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea08003a30 0x7fea08003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea22614700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 0x7fea080051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 -- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 msgr2=0x7fea080051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c0d0c70 0x7fea080051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 -- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea08003a30 msgr2=0x7fea08003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:48.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea08003a30 0x7fea08003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 -- 172.21.15.5:0/2336106632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080035b0 con 0x7fea080043e0 2023-10-16T13:49:48.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea21612700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea080043e0 0x7fea080048b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009b60 tx=0x7fea08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ea22a2536aa1ab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00e6c0 con 0x7fea080043e0 2023-10-16T13:49:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00e820 con 0x7fea080043e0 2023-10-16T13:49:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.071+0000 7fea20e11700 1 -- 172.21.15.5:0/2336106632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00eb90 con 0x7fea080043e0 2023-10-16T13:49:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea24077700 1 -- 172.21.15.5:0/2336106632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea080043e0 msgr2=0x7fea080048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea24077700 1 --2- 172.21.15.5:0/2336106632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea080043e0 0x7fea080048b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009b60 tx=0x7fea08005880 comp rx=0 tx=0).stop 2023-10-16T13:49:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea22614700 1 -- 172.21.15.5:0/2336106632 reap_dead start 2023-10-16T13:49:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea24077700 1 -- 172.21.15.5:0/2336106632 shutdown_connections 2023-10-16T13:49:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea24077700 1 -- 172.21.15.5:0/2336106632 >> 172.21.15.5:0/2336106632 conn(0x7fea1c0665a0 msgr2=0x7fea1c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea24077700 1 -- 172.21.15.5:0/2336106632 shutdown_connections 2023-10-16T13:49:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.072+0000 7fea24077700 1 -- 172.21.15.5:0/2336106632 wait complete. 2023-10-16T13:49:48.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.073+0000 7fea24077700 1 Processor -- start 2023-10-16T13:49:48.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.073+0000 7fea24077700 1 -- start start 2023-10-16T13:49:48.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea24077700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 0x7fea1c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea24077700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c153c80 0x7fea1c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea24077700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c157dc0 0x7fea1c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea24077700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1f0e60 con 0x7fea1c1538a0 2023-10-16T13:49:48.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea24077700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1573f0 con 0x7fea1c157dc0 2023-10-16T13:49:48.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea24077700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1567e0 con 0x7fea1c153c80 2023-10-16T13:49:48.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 0x7fea1c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 0x7fea1c0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50890/0 (socket says 172.21.15.5:50890) 2023-10-16T13:49:48.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 -- 172.21.15.5:0/3813586106 learned_addr learned my addr 172.21.15.5:0/3813586106 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:48.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21612700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c153c80 0x7fea1c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea22614700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c157dc0 0x7fea1c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 -- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c153c80 msgr2=0x7fea1c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c153c80 0x7fea1c157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 -- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c157dc0 msgr2=0x7fea1c149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c157dc0 0x7fea1c149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.074+0000 7fea21e13700 1 -- 172.21.15.5:0/3813586106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c156ac0 con 0x7fea1c1538a0 2023-10-16T13:49:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.075+0000 7fea21e13700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 0x7fea1c0cb320 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fea180072a0 tx=0x7fea18007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.075+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18007780 con 0x7fea1c1538a0 2023-10-16T13:49:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.075+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800f870 con 0x7fea1c1538a0 2023-10-16T13:49:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.075+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800fc20 con 0x7fea1c1538a0 2023-10-16T13:49:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.075+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c156da0 con 0x7fea1c1538a0 2023-10-16T13:49:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.075+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c14a990 con 0x7fea1c1538a0 2023-10-16T13:49:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.076+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c1576d0 con 0x7fea1c1538a0 2023-10-16T13:49:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.076+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fea1800fd80 con 0x7fea1c1538a0 2023-10-16T13:49:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.077+0000 7fea127fc700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fea0006b2f0 0x7fea0006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.077+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea18089070 con 0x7fea1c1538a0 2023-10-16T13:49:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.077+0000 7fea21612700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fea0006b2f0 0x7fea0006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.077+0000 7fea21612700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fea0006b2f0 0x7fea0006d7b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0644a0 tx=0x7fea0c01e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.081+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea180bbca0 con 0x7fea1c1538a0 2023-10-16T13:49:48.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.280+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea1c0d23e0 con 0x7fea1c1538a0 2023-10-16T13:49:48.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.281+0000 7fea127fc700 1 -- 172.21.15.5:0/3813586106 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea1c0d23e0 con 0x7fea1c1538a0 2023-10-16T13:49:48.284 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fea0006b2f0 msgr2=0x7fea0006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fea0006b2f0 0x7fea0006d7b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0644a0 tx=0x7fea0c01e040 comp rx=0 tx=0).stop 2023-10-16T13:49:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 msgr2=0x7fea1c0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 0x7fea1c0cb320 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fea180072a0 tx=0x7fea18007660 comp rx=0 tx=0).stop 2023-10-16T13:49:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 shutdown_connections 2023-10-16T13:49:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c157dc0 0x7fea1c149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1c1538a0 0x7fea1c0cb320 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fea0006b2f0 0x7fea0006d7b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 --2- 172.21.15.5:0/3813586106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea1c153c80 0x7fea1c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 >> 172.21.15.5:0/3813586106 conn(0x7fea1c0665a0 msgr2=0x7fea1c0c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:48.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 shutdown_connections 2023-10-16T13:49:48.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.283+0000 7fea24077700 1 -- 172.21.15.5:0/3813586106 wait complete. 2023-10-16T13:49:48.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:49:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.423+0000 7fb7acc45700 1 Processor -- start 2023-10-16T13:49:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.423+0000 7fb7acc45700 1 -- start start 2023-10-16T13:49:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7acc45700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7acc45700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7a80ce0b0 0x7fb7a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7acc45700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a815bf30 con 0x7fb7a815bb50 2023-10-16T13:49:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7acc45700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80ce540 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7acc45700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b2d70 con 0x7fb7a806ef20 2023-10-16T13:49:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a5d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a6d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7a80ce0b0 0x7fb7a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb7a815bb50 0x7fb7a806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:51878/0 (socket says 172.21.15.5:51878) 2023-10-16T13:49:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a6d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7a80ce0b0 0x7fb7a806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:46798/0 (socket says 172.21.15.5:46798) 2023-10-16T13:49:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a5d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a80cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:48804/0 (socket says 172.21.15.5:48804) 2023-10-16T13:49:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a659c700 1 -- 172.21.15.5:0/1184513796 learned_addr learned my addr 172.21.15.5:0/1184513796 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a6d9d700 1 -- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 msgr2=0x7fb7a80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a6d9d700 1 --2- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a6d9d700 1 -- 172.21.15.5:0/1184513796 >> v1:172.21.15.112:6789/0 conn(0x7fb7a815bb50 legacy=0x7fb7a806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a6d9d700 1 -- 172.21.15.5:0/1184513796 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a806d500 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.424+0000 7fb7a559a700 1 -- 172.21.15.5:0/1184513796 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172536913 0 0) 0x7fb7a815bf30 con 0x7fb7a815bb50 2023-10-16T13:49:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7a6d9d700 1 --2- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a806a840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009d90 tx=0x7fb7a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b34053a9bb9b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7a559a700 1 -- 172.21.15.5:0/1184513796 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a000e070 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7a559a700 1 -- 172.21.15.5:0/1184513796 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a000bb20 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7a559a700 1 -- 172.21.15.5:0/1184513796 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0012430 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 -- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a80ce0b0 msgr2=0x7fb7a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 --2- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a806a840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009d90 tx=0x7fb7a000b330 comp rx=0 tx=0).stop 2023-10-16T13:49:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 -- 172.21.15.5:0/1184513796 shutdown_connections 2023-10-16T13:49:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 --2- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a806a840 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 --2- 172.21.15.5:0/1184513796 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 -- 172.21.15.5:0/1184513796 >> 172.21.15.5:0/1184513796 conn(0x7fb7a80cc6f0 msgr2=0x7fb7a80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 -- 172.21.15.5:0/1184513796 shutdown_connections 2023-10-16T13:49:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.425+0000 7fb7acc45700 1 -- 172.21.15.5:0/1184513796 wait complete. 2023-10-16T13:49:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 Processor -- start 2023-10-16T13:49:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 -- start start 2023-10-16T13:49:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a8151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a815bb50 0x7fb7a80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80adba0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8151d80 con 0x7fb7a815bb50 2023-10-16T13:49:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.427+0000 7fb7acc45700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80acf20 con 0x7fb7a806ef20 2023-10-16T13:49:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a80caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50906/0 (socket says 172.21.15.5:50906) 2023-10-16T13:49:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 -- 172.21.15.5:0/4160556151 learned_addr learned my addr 172.21.15.5:0/4160556151 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a659c700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a8151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a6d9d700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a815bb50 0x7fb7a80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 -- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 msgr2=0x7fb7a8151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a8151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 -- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a815bb50 msgr2=0x7fb7a80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a815bb50 0x7fb7a80af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 -- 172.21.15.5:0/4160556151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0009a70 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7a5d9b700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a80caca0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00e9b0 tx=0x7fb79c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c009710 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c00ee50 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a80ad200 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00ca50 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.428+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a80ad7c0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.429+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a80adce0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.430+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fb79c00cbb0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.430+0000 7fb796ffd700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb78806b2f0 0x7fb78806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.431+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb79c089d70 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.431+0000 7fb7a659c700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb78806b2f0 0x7fb78806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.431+0000 7fb7a659c700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb78806b2f0 0x7fb78806d7b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb798000f60 tx=0x7fb798007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.435+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7a80adce0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.636+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7a80adce0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.637+0000 7fb796ffd700 1 -- 172.21.15.5:0/4160556151 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7a80adce0 con 0x7fb7a80ce0b0 2023-10-16T13:49:48.640 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:49:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb78806b2f0 msgr2=0x7fb78806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb78806b2f0 0x7fb78806d7b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb798000f60 tx=0x7fb798007e70 comp rx=0 tx=0).stop 2023-10-16T13:49:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 msgr2=0x7fb7a80caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a80caca0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00e9b0 tx=0x7fb79c00ecc0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 shutdown_connections 2023-10-16T13:49:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a815bb50 0x7fb7a80af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fb78806b2f0 0x7fb78806d7b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7a806ef20 0x7fb7a8151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 --2- 172.21.15.5:0/4160556151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7a80ce0b0 0x7fb7a80caca0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 >> 172.21.15.5:0/4160556151 conn(0x7fb7a80cc6f0 msgr2=0x7fb7a80b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 shutdown_connections 2023-10-16T13:49:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.639+0000 7fb7acc45700 1 -- 172.21.15.5:0/4160556151 wait complete. 2023-10-16T13:49:48.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:49:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.780+0000 7f065de99700 1 Processor -- start 2023-10-16T13:49:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.780+0000 7f065de99700 1 -- start start 2023-10-16T13:49:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f065de99700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06580cd950 0x7f065815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f065de99700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580cf290 con 0x7f06580cede0 2023-10-16T13:49:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f065de99700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580b2d60 con 0x7f065806a840 2023-10-16T13:49:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f065de99700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06581619a0 con 0x7f06580cd950 2023-10-16T13:49:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f0656ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06580cede0 0x7f065815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60916/0 (socket says 172.21.15.5:60916) 2023-10-16T13:49:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f0656ffd700 1 -- 172.21.15.5:0/2633171820 learned_addr learned my addr 172.21.15.5:0/2633171820 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06577fe700 1 --2- 172.21.15.5:0/2633171820 >> v2:172.21.15.112:3300/0 conn(0x7f06580cd950 0x7f065815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06567fc700 1 -- 172.21.15.5:0/2633171820 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070824287 0 0) 0x7f06580cf290 con 0x7f06580cede0 2023-10-16T13:49:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06567fc700 1 -- 172.21.15.5:0/2633171820 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06400035b0 con 0x7f06580cede0 2023-10-16T13:49:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06577fe700 1 -- 172.21.15.5:0/2633171820 >> v1:172.21.15.112:6789/0 conn(0x7f065806a840 legacy=0x7f0658161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06577fe700 1 -- 172.21.15.5:0/2633171820 >> v1:172.21.15.5:6789/0 conn(0x7f06580cede0 legacy=0x7f065815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06567fc700 1 -- 172.21.15.5:0/2633171820 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180069421 0 0) 0x7f06400035b0 con 0x7f06580cede0 2023-10-16T13:49:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.781+0000 7f06577fe700 1 -- 172.21.15.5:0/2633171820 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580cdd30 con 0x7f06580cd950 2023-10-16T13:49:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f06577fe700 1 --2- 172.21.15.5:0/2633171820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06580cd950 0x7f065815e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0648009840 tx=0x7f0648009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f3cf33f982e2df server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f06567fc700 1 -- 172.21.15.5:0/2633171820 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0017f0 con 0x7f06580cd950 2023-10-16T13:49:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f06567fc700 1 -- 172.21.15.5:0/2633171820 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648004030 con 0x7f06580cd950 2023-10-16T13:49:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f06567fc700 1 -- 172.21.15.5:0/2633171820 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480043c0 con 0x7f06580cd950 2023-10-16T13:49:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 -- 172.21.15.5:0/2633171820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06580cd950 msgr2=0x7f065815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 --2- 172.21.15.5:0/2633171820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06580cd950 0x7f065815e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0648009840 tx=0x7f0648009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 -- 172.21.15.5:0/2633171820 shutdown_connections 2023-10-16T13:49:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 --2- 172.21.15.5:0/2633171820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06580cd950 0x7f065815e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 -- 172.21.15.5:0/2633171820 >> 172.21.15.5:0/2633171820 conn(0x7f065806dae0 msgr2=0x7f065806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 -- 172.21.15.5:0/2633171820 shutdown_connections 2023-10-16T13:49:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.782+0000 7f065de99700 1 -- 172.21.15.5:0/2633171820 wait complete. 2023-10-16T13:49:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 Processor -- start 2023-10-16T13:49:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 -- start start 2023-10-16T13:49:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f065806a840 0x7f06580ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06580cd950 0x7f06581f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 0x7f065814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065814e020 con 0x7f06580cede0 2023-10-16T13:49:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580b4f70 con 0x7f065806a840 2023-10-16T13:49:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.784+0000 7f065de99700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580b5250 con 0x7f06580cd950 2023-10-16T13:49:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 0x7f065814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 0x7f065814d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50922/0 (socket says 172.21.15.5:50922) 2023-10-16T13:49:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 -- 172.21.15.5:0/2096739242 learned_addr learned my addr 172.21.15.5:0/2096739242 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:48.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f06577fe700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f065806a840 0x7f06580ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0656ffd700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06580cd950 0x7f06581f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 -- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06580cd950 msgr2=0x7f06581f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06580cd950 0x7f06581f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 -- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f065806a840 msgr2=0x7f06580ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f065806a840 0x7f06580ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 -- 172.21.15.5:0/2096739242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480094a0 con 0x7f06580cede0 2023-10-16T13:49:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f0657fff700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 0x7f065814d1c0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f065000cc50 tx=0x7f065000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650003c00 con 0x7f06580cede0 2023-10-16T13:49:48.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650003d60 con 0x7f06580cede0 2023-10-16T13:49:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06580b5530 con 0x7f06580cede0 2023-10-16T13:49:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000aab0 con 0x7f06580cede0 2023-10-16T13:49:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.785+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06580acdf0 con 0x7f06580cede0 2023-10-16T13:49:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.786+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0658067d20 con 0x7f06580cede0 2023-10-16T13:49:48.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.787+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f065000ac10 con 0x7f06580cede0 2023-10-16T13:49:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.787+0000 7f063ffff700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f064406b2f0 0x7f064406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.787+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0650089c70 con 0x7f06580cede0 2023-10-16T13:49:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.788+0000 7f06577fe700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f064406b2f0 0x7f064406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:48.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.788+0000 7f06577fe700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f064406b2f0 0x7f064406d7b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f06480090b0 tx=0x7f0648008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:48.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.792+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06500547d0 con 0x7f06580cede0 2023-10-16T13:49:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.992+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06580b2630 con 0x7f06580cede0 2023-10-16T13:49:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.992+0000 7f063ffff700 1 -- 172.21.15.5:0/2096739242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0650057df0 con 0x7f06580cede0 2023-10-16T13:49:48.996 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:49:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.994+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f064406b2f0 msgr2=0x7f064406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.994+0000 7f065de99700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f064406b2f0 0x7f064406d7b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f06480090b0 tx=0x7f0648008030 comp rx=0 tx=0).stop 2023-10-16T13:49:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.994+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 msgr2=0x7f065814d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:48.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.994+0000 7f065de99700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 0x7f065814d1c0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f065000cc50 tx=0x7f065000cf60 comp rx=0 tx=0).stop 2023-10-16T13:49:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 shutdown_connections 2023-10-16T13:49:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06580cede0 0x7f065814d1c0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f065806a840 0x7f06580ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f064406b2f0 0x7f064406d7b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 --2- 172.21.15.5:0/2096739242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06580cd950 0x7f06581f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 >> 172.21.15.5:0/2096739242 conn(0x7f065806dae0 msgr2=0x7f06580ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 shutdown_connections 2023-10-16T13:49:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:48.995+0000 7f065de99700 1 -- 172.21.15.5:0/2096739242 wait complete. 2023-10-16T13:49:49.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T13:49:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 Processor -- start 2023-10-16T13:49:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 -- start start 2023-10-16T13:49:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d200ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d200b3630 0x7f9d200b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d20072a10 con 0x7f9d2015b8b0 2023-10-16T13:49:49.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200ced70 con 0x7f9d200b3630 2023-10-16T13:49:49.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.133+0000 7f9d25451700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200b2230 con 0x7f9d200ce3b0 2023-10-16T13:49:49.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d200b3630 0x7f9d200b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9d2015b8b0 0x7f9d200b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60930/0 (socket says 172.21.15.5:60930) 2023-10-16T13:49:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d200b3630 0x7f9d200b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50928/0 (socket says 172.21.15.5:50928) 2023-10-16T13:49:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1effd700 1 -- 172.21.15.5:0/1520209635 learned_addr learned my addr 172.21.15.5:0/1520209635 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1e7fc700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d200ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 -- 172.21.15.5:0/1520209635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 msgr2=0x7f9d200ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d200ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 -- 172.21.15.5:0/1520209635 >> v1:172.21.15.5:6789/0 conn(0x7f9d2015b8b0 legacy=0x7f9d200b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 -- 172.21.15.5:0/1520209635 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20071e90 con 0x7f9d200b3630 2023-10-16T13:49:49.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1dffb700 1 -- 172.21.15.5:0/1520209635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721450575 0 0) 0x7f9d20072a10 con 0x7f9d2015b8b0 2023-10-16T13:49:49.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1e7fc700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d200ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:49.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1f7fe700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200b3a80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009d90 tx=0x7f9d1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e2aaffbd08d13d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:49.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1dffb700 1 -- 172.21.15.5:0/1520209635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800e070 con 0x7f9d200b3630 2023-10-16T13:49:49.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1dffb700 1 -- 172.21.15.5:0/1520209635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800bbd0 con 0x7f9d200b3630 2023-10-16T13:49:49.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.134+0000 7f9d1dffb700 1 -- 172.21.15.5:0/1520209635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18012430 con 0x7f9d200b3630 2023-10-16T13:49:49.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 -- 172.21.15.5:0/1520209635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 msgr2=0x7f9d200b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200b3a80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009d90 tx=0x7f9d1800b330 comp rx=0 tx=0).stop 2023-10-16T13:49:49.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 -- 172.21.15.5:0/1520209635 shutdown_connections 2023-10-16T13:49:49.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200b3a80 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 --2- 172.21.15.5:0/1520209635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d200ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 -- 172.21.15.5:0/1520209635 >> 172.21.15.5:0/1520209635 conn(0x7f9d2006dac0 msgr2=0x7f9d2006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:49.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 -- 172.21.15.5:0/1520209635 shutdown_connections 2023-10-16T13:49:49.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.135+0000 7f9d25451700 1 -- 172.21.15.5:0/1520209635 wait complete. 2023-10-16T13:49:49.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.136+0000 7f9d25451700 1 Processor -- start 2023-10-16T13:49:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.136+0000 7f9d25451700 1 -- start start 2023-10-16T13:49:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d25451700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d25451700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d201f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d25451700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d2015b8b0 0x7f9d200b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d25451700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200cba60 con 0x7f9d200b3630 2023-10-16T13:49:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d25451700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200cbd40 con 0x7f9d2015b8b0 2023-10-16T13:49:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d25451700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200cc020 con 0x7f9d200ce3b0 2023-10-16T13:49:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50930/0 (socket says 172.21.15.5:50930) 2023-10-16T13:49:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 -- 172.21.15.5:0/3273918125 learned_addr learned my addr 172.21.15.5:0/3273918125 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1f7fe700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d2015b8b0 0x7f9d200b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1e7fc700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d201f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 -- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 msgr2=0x7f9d201f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d201f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 -- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d2015b8b0 msgr2=0x7f9d200b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d2015b8b0 0x7f9d200b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.137+0000 7f9d1effd700 1 -- 172.21.15.5:0/3273918125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009a70 con 0x7f9d200b3630 2023-10-16T13:49:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.138+0000 7f9d1effd700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200cacd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c550 tx=0x7f9d1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.138+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14004c80 con 0x7f9d200b3630 2023-10-16T13:49:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.138+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14004e00 con 0x7f9d200b3630 2023-10-16T13:49:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.138+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200cc300 con 0x7f9d200b3630 2023-10-16T13:49:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.138+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14007310 con 0x7f9d200b3630 2023-10-16T13:49:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.138+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d201f2fc0 con 0x7f9d200b3630 2023-10-16T13:49:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.139+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20067d20 con 0x7f9d200b3630 2023-10-16T13:49:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.139+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f9d14007470 con 0x7f9d200b3630 2023-10-16T13:49:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.140+0000 7f9d077fe700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0c06b2f0 0x7f9d0c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.140+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d14089980 con 0x7f9d200b3630 2023-10-16T13:49:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.140+0000 7f9d1e7fc700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0c06b2f0 0x7f9d0c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.140+0000 7f9d1e7fc700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0c06b2f0 0x7f9d0c06d7b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ccce0 tx=0x7f9d10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:49.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.144+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d14054560 con 0x7f9d200b3630 2023-10-16T13:49:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.359+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d200b5670 con 0x7f9d200b3630 2023-10-16T13:49:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.359+0000 7f9d077fe700 1 -- 172.21.15.5:0/3273918125 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d14057b80 con 0x7f9d200b3630 2023-10-16T13:49:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0c06b2f0 msgr2=0x7f9d0c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0c06b2f0 0x7f9d0c06d7b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ccce0 tx=0x7f9d10008040 comp rx=0 tx=0).stop 2023-10-16T13:49:49.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 msgr2=0x7f9d200cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200cacd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c550 tx=0x7f9d1400c910 comp rx=0 tx=0).stop 2023-10-16T13:49:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 shutdown_connections 2023-10-16T13:49:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d2015b8b0 0x7f9d200b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d200b3630 0x7f9d200cacd0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f9d0c06b2f0 0x7f9d0c06d7b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 --2- 172.21.15.5:0/3273918125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d200ce3b0 0x7f9d201f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 >> 172.21.15.5:0/3273918125 conn(0x7f9d2006dac0 msgr2=0x7f9d20159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 shutdown_connections 2023-10-16T13:49:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.362+0000 7f9d25451700 1 -- 172.21.15.5:0/3273918125 wait complete. 2023-10-16T13:49:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-10-16T13:49:49.377 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T13:49:49.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:49.377 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-16T13:49:49.425 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:49:49.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:49.426 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T13:49:49.446 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:49.446 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:49.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:49.464 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:49:49.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:49.465 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T13:49:49.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:49:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-16T13:49:49.521 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:49.521 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:49.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:49.542 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:49:49.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:49.543 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T13:49:49.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:49:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-16T13:49:49.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000690504 --yes-i-really-mean-it 2023-10-16T13:49:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 Processor -- start 2023-10-16T13:49:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 -- start start 2023-10-16T13:49:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 0x7f8e940d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8e940b0730 0x7f8e940ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940cbdb0 con 0x7f8e9406bd80 2023-10-16T13:49:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e940ce830 con 0x7f8e940b0730 2023-10-16T13:49:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.728+0000 7f8e9b15c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940d0b40 con 0x7f8e940cdf10 2023-10-16T13:49:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e98ef8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 0x7f8e940d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e98ef8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 0x7f8e940d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:48842/0 (socket says 172.21.15.5:48842) 2023-10-16T13:49:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e93fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8e940b0730 0x7f8e940ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e98ef8700 1 -- 172.21.15.5:0/2518654667 learned_addr learned my addr 172.21.15.5:0/2518654667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e93fff700 1 -- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 msgr2=0x7f8e940d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e93fff700 1 --2- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 0x7f8e940d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e93fff700 1 -- 172.21.15.5:0/2518654667 >> v1:172.21.15.112:6789/0 conn(0x7f8e9406bd80 legacy=0x7f8e9406c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e93fff700 1 -- 172.21.15.5:0/2518654667 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e940d0e20 con 0x7f8e940b0730 2023-10-16T13:49:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e937fe700 1 -- 172.21.15.5:0/2518654667 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697499540 0 0) 0x7f8e940cbdb0 con 0x7f8e9406bd80 2023-10-16T13:49:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.729+0000 7f8e98ef8700 1 --2- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 0x7f8e940d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:49:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e93fff700 1 --2- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e940b0730 0x7f8e940ce2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009840 tx=0x7f8e80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27420a58249eb2c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e937fe700 1 -- 172.21.15.5:0/2518654667 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80011830 con 0x7f8e940b0730 2023-10-16T13:49:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e937fe700 1 -- 172.21.15.5:0/2518654667 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80011990 con 0x7f8e940b0730 2023-10-16T13:49:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e937fe700 1 -- 172.21.15.5:0/2518654667 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80011d20 con 0x7f8e940b0730 2023-10-16T13:49:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 -- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e940b0730 msgr2=0x7f8e940ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 --2- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e940b0730 0x7f8e940ce2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009840 tx=0x7f8e80009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 -- 172.21.15.5:0/2518654667 shutdown_connections 2023-10-16T13:49:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 --2- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940cdf10 0x7f8e940d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 --2- 172.21.15.5:0/2518654667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e940b0730 0x7f8e940ce2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 -- 172.21.15.5:0/2518654667 >> 172.21.15.5:0/2518654667 conn(0x7f8e940d1530 msgr2=0x7f8e940d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 -- 172.21.15.5:0/2518654667 shutdown_connections 2023-10-16T13:49:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.730+0000 7f8e9b15c700 1 -- 172.21.15.5:0/2518654667 wait complete. 2023-10-16T13:49:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.731+0000 7f8e9b15c700 1 Processor -- start 2023-10-16T13:49:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 -- start start 2023-10-16T13:49:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e9406bd80 0x7f8e94158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940b0730 0x7f8e9415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e940cdf10 0x7f8e940aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940b6060 con 0x7f8e940cdf10 2023-10-16T13:49:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94158c50 con 0x7f8e9406bd80 2023-10-16T13:49:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.732+0000 7f8e9b15c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940b6300 con 0x7f8e940b0730 2023-10-16T13:49:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e940cdf10 0x7f8e940aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e940cdf10 0x7f8e940aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50948/0 (socket says 172.21.15.5:50948) 2023-10-16T13:49:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 -- 172.21.15.5:0/3485209606 learned_addr learned my addr 172.21.15.5:0/3485209606 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e98ef8700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e9406bd80 0x7f8e94158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e93fff700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940b0730 0x7f8e9415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 -- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940b0730 msgr2=0x7f8e9415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940b0730 0x7f8e9415ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 -- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e9406bd80 msgr2=0x7f8e94158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e9406bd80 0x7f8e94158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 -- 172.21.15.5:0/3485209606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009500 con 0x7f8e940cdf10 2023-10-16T13:49:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e98ef8700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e9406bd80 0x7f8e94158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e93fff700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e940b0730 0x7f8e9415ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e996f9700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e940cdf10 0x7f8e940aedb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00c780 tx=0x7f8e8c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c003e30 con 0x7f8e940cdf10 2023-10-16T13:49:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c005070 con 0x7f8e940cdf10 2023-10-16T13:49:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e9b15c700 1 -- 172.21.15.5:0/3485209606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e800094a0 con 0x7f8e940cdf10 2023-10-16T13:49:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c005400 con 0x7f8e940cdf10 2023-10-16T13:49:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.733+0000 7f8e9b15c700 1 -- 172.21.15.5:0/3485209606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e940b68c0 con 0x7f8e940cdf10 2023-10-16T13:49:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.734+0000 7f8e9b15c700 1 -- 172.21.15.5:0/3485209606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e940b6de0 con 0x7f8e940cdf10 2023-10-16T13:49:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.735+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f8e8c005560 con 0x7f8e940cdf10 2023-10-16T13:49:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.735+0000 7f8e917fa700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8e7806b320 0x7f8e7806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.735+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e8c089a20 con 0x7f8e940cdf10 2023-10-16T13:49:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.735+0000 7f8e98ef8700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8e7806b320 0x7f8e7806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.736+0000 7f8e98ef8700 1 --2- 172.21.15.5:0/3485209606 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f8e7806b320 0x7f8e7806d7e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8e88006fd0 tx=0x7f8e88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.740+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e940b6de0 con 0x7f8e940cdf10 2023-10-16T13:49:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.970+0000 7f8e9b15c700 1 -- 172.21.15.5:0/3485209606 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000690504", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8e940b0490 con 0x7f8e7806b320 2023-10-16T13:49:49.976 INFO:tasks.ceph.mgr.x.smithi112.stderr:2023-10-16T13:49:49.974+0000 7fdd0965a700 -1 mgr.server reply reply (1) Operation not permitted Failed to rename file system 'cephfs' to 'volume_0000000000690504'; All MDSs for an FS must be down before renaming the file system. See `ceph fs fail`. 2023-10-16T13:49:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:49.974+0000 7f8e917fa700 1 -- 172.21.15.5:0/3485209606 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: -1 Failed to rename file system 'cephfs' to 'volume_0000000000690504'; All MDSs for an FS must be down before renaming the file system. See `ceph fs fail`.) v1 ==== 160+0+0 (secure 0 0 0) 0x7f8e88009970 con 0x7f8e7806b320 2023-10-16T13:49:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:Error EPERM: Failed to rename file system 'cephfs' to 'volume_0000000000690504'; All MDSs for an FS must be down before renaming the file system. See `ceph fs fail`. 2023-10-16T13:49:49.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:49:49.982 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T13:49:49.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:49:50.025 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T13:49:50.076 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T13:49:50.077 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:50.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:50.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:50.095 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:50.096 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:50.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:50.116 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:50.116 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:50.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:50.153 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:50.154 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:50.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:50.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.315+0000 7f7cf0b9a700 1 Processor -- start 2023-10-16T13:49:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.315+0000 7f7cf0b9a700 1 -- start start 2023-10-16T13:49:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7cf0b9a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec15ab10 0x7f7cec15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7cf0b9a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cec0cfe30 0x7f7cec0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7cf0b9a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec15e7a0 con 0x7f7cec0b1f50 2023-10-16T13:49:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7cf0b9a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cec15f730 con 0x7f7cec0cfe30 2023-10-16T13:49:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7cf0b9a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b29a0 con 0x7f7cec15ab10 2023-10-16T13:49:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7cead9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cec0cfe30 0x7f7cec0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.316+0000 7f7ce9d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7cec0b1f50 0x7f7cec0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60956/0 (socket says 172.21.15.5:60956) 2023-10-16T13:49:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7ce9d9b700 1 -- 172.21.15.5:0/1145780662 learned_addr learned my addr 172.21.15.5:0/1145780662 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cead9d700 1 -- 172.21.15.5:0/1145780662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec15ab10 msgr2=0x7f7cec15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cea59c700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec15ab10 0x7f7cec15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cead9d700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec15ab10 0x7f7cec15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7ce959a700 1 -- 172.21.15.5:0/1145780662 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880601296 0 0) 0x7f7cec15e7a0 con 0x7f7cec0b1f50 2023-10-16T13:49:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cead9d700 1 -- 172.21.15.5:0/1145780662 >> v1:172.21.15.5:6789/0 conn(0x7f7cec0b1f50 legacy=0x7f7cec0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cead9d700 1 -- 172.21.15.5:0/1145780662 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0b2c80 con 0x7f7cec0cfe30 2023-10-16T13:49:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cea59c700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec15ab10 0x7f7cec15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7cead9d700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec0cfe30 0x7f7cec0cbf40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009d90 tx=0x7f7ce400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08d074d33844c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7ce959a700 1 -- 172.21.15.5:0/1145780662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400e070 con 0x7f7cec0cfe30 2023-10-16T13:49:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7ce959a700 1 -- 172.21.15.5:0/1145780662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400bbd0 con 0x7f7cec0cfe30 2023-10-16T13:49:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.317+0000 7f7ce959a700 1 -- 172.21.15.5:0/1145780662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4012430 con 0x7f7cec0cfe30 2023-10-16T13:49:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1145780662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec0cfe30 msgr2=0x7f7cec0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec0cfe30 0x7f7cec0cbf40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009d90 tx=0x7f7ce400b330 comp rx=0 tx=0).stop 2023-10-16T13:49:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1145780662 shutdown_connections 2023-10-16T13:49:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec0cfe30 0x7f7cec0cbf40 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1145780662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec15ab10 0x7f7cec15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1145780662 >> 172.21.15.5:0/1145780662 conn(0x7f7cec06dae0 msgr2=0x7f7cec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1145780662 shutdown_connections 2023-10-16T13:49:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.318+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1145780662 wait complete. 2023-10-16T13:49:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.319+0000 7f7cf0b9a700 1 Processor -- start 2023-10-16T13:49:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.319+0000 7f7cf0b9a700 1 -- start start 2023-10-16T13:49:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cf0b9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cec0b1f50 0x7f7cec0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cf0b9a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec0cfe30 0x7f7cec15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cf0b9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 0x7f7cec154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cf0b9a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0ca1f0 con 0x7f7cec15ab10 2023-10-16T13:49:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cf0b9a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0ca610 con 0x7f7cec0b1f50 2023-10-16T13:49:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cf0b9a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0c4650 con 0x7f7cec0cfe30 2023-10-16T13:49:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 0x7f7cec154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 0x7f7cec154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50962/0 (socket says 172.21.15.5:50962) 2023-10-16T13:49:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 -- 172.21.15.5:0/1544674781 learned_addr learned my addr 172.21.15.5:0/1544674781 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 -- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec0cfe30 msgr2=0x7f7cec15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec0cfe30 0x7f7cec15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 -- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cec0b1f50 msgr2=0x7f7cec0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cea59c700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cec0b1f50 0x7f7cec0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cec0b1f50 0x7f7cec0c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 -- 172.21.15.5:0/1544674781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4009a70 con 0x7f7cec15ab10 2023-10-16T13:49:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.320+0000 7f7cead9d700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 0x7f7cec154330 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7cec06d4f0 tx=0x7f7ce4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.321+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4003ea0 con 0x7f7cec15ab10 2023-10-16T13:49:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.321+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4020070 con 0x7f7cec15ab10 2023-10-16T13:49:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.321+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec0c9850 con 0x7f7cec15ab10 2023-10-16T13:49:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.321+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004280 con 0x7f7cec15ab10 2023-10-16T13:49:50.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.321+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec0c9e10 con 0x7f7cec15ab10 2023-10-16T13:49:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.322+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec0ca330 con 0x7f7cec15ab10 2023-10-16T13:49:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.322+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f7ce40043e0 con 0x7f7cec15ab10 2023-10-16T13:49:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.322+0000 7f7cdaffd700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7ccc06b2f0 0x7f7ccc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.322+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ce4022070 con 0x7f7cec15ab10 2023-10-16T13:49:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.323+0000 7f7cea59c700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7ccc06b2f0 0x7f7ccc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.323+0000 7f7cea59c700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7ccc06b2f0 0x7f7ccc06d7b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc006fd0 tx=0x7f7cdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.327+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ce4056890 con 0x7f7cec15ab10 2023-10-16T13:49:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.576+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cec067d20 con 0x7f7cec15ab10 2023-10-16T13:49:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.576+0000 7f7cdaffd700 1 -- 172.21.15.5:0/1544674781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f7ce4059eb0 con 0x7f7cec15ab10 2023-10-16T13:49:50.580 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:50.580 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:49:34.794871+0000","modified":"2023-10-16T13:49:37.820862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8229":{"gid":8229,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2779373791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2779373791},{"type":"v1","addr":"172.21.15.112:6837","nonce":2779373791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-10-16T13:49:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7ccc06b2f0 msgr2=0x7f7ccc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7ccc06b2f0 0x7f7ccc06d7b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc006fd0 tx=0x7f7cdc008040 comp rx=0 tx=0).stop 2023-10-16T13:49:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 msgr2=0x7f7cec154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 0x7f7cec154330 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7cec06d4f0 tx=0x7f7ce4004ad0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 shutdown_connections 2023-10-16T13:49:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cec15ab10 0x7f7cec154330 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cec0b1f50 0x7f7cec0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7ccc06b2f0 0x7f7ccc06d7b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 --2- 172.21.15.5:0/1544674781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cec0cfe30 0x7f7cec15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 >> 172.21.15.5:0/1544674781 conn(0x7f7cec06dae0 msgr2=0x7f7cec0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 shutdown_connections 2023-10-16T13:49:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.579+0000 7f7cf0b9a700 1 -- 172.21.15.5:0/1544674781 wait complete. 2023-10-16T13:49:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 99 2023-10-16T13:49:50.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.716+0000 7f26ab091700 1 Processor -- start 2023-10-16T13:49:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.716+0000 7f26ab091700 1 -- start start 2023-10-16T13:49:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26ab091700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26a415f1f0 0x7f26a40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26ab091700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26a40cfc60 0x7f26a40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26ab091700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a415e7a0 con 0x7f26a415ab10 2023-10-16T13:49:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26ab091700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a40d0090 con 0x7f26a40cfc60 2023-10-16T13:49:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26ab091700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a40b29a0 con 0x7f26a415f1f0 2023-10-16T13:49:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26a40cfc60 0x7f26a40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26a40cfc60 0x7f26a40cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50970/0 (socket says 172.21.15.5:50970) 2023-10-16T13:49:50.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 -- 172.21.15.5:0/3908012011 learned_addr learned my addr 172.21.15.5:0/3908012011 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a8e2d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26a415ab10 0x7f26a40b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60970/0 (socket says 172.21.15.5:60970) 2023-10-16T13:49:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a3fff700 1 --2- 172.21.15.5:0/3908012011 >> v2:172.21.15.112:3300/0 conn(0x7f26a415f1f0 0x7f26a40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 -- 172.21.15.5:0/3908012011 >> v2:172.21.15.112:3300/0 conn(0x7f26a415f1f0 msgr2=0x7f26a40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 --2- 172.21.15.5:0/3908012011 >> v2:172.21.15.112:3300/0 conn(0x7f26a415f1f0 0x7f26a40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 -- 172.21.15.5:0/3908012011 >> v1:172.21.15.5:6789/0 conn(0x7f26a415ab10 legacy=0x7f26a40b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a962e700 1 -- 172.21.15.5:0/3908012011 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40b2c80 con 0x7f26a40cfc60 2023-10-16T13:49:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a37fe700 1 -- 172.21.15.5:0/3908012011 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179873356 0 0) 0x7f26a415e7a0 con 0x7f26a415ab10 2023-10-16T13:49:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.717+0000 7f26a3fff700 1 --2- 172.21.15.5:0/3908012011 >> v2:172.21.15.112:3300/0 conn(0x7f26a415f1f0 0x7f26a40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26a962e700 1 --2- 172.21.15.5:0/3908012011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40cbf40 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f26a406d470 tx=0x7f269c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba407672d34dae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26a37fe700 1 -- 172.21.15.5:0/3908012011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00e070 con 0x7f26a40cfc60 2023-10-16T13:49:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26a37fe700 1 -- 172.21.15.5:0/3908012011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c00b9c0 con 0x7f26a40cfc60 2023-10-16T13:49:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26a37fe700 1 -- 172.21.15.5:0/3908012011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00bd70 con 0x7f26a40cfc60 2023-10-16T13:49:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 -- 172.21.15.5:0/3908012011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 msgr2=0x7f26a40cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 --2- 172.21.15.5:0/3908012011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40cbf40 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f26a406d470 tx=0x7f269c00b330 comp rx=0 tx=0).stop 2023-10-16T13:49:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 -- 172.21.15.5:0/3908012011 shutdown_connections 2023-10-16T13:49:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 --2- 172.21.15.5:0/3908012011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40cbf40 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 --2- 172.21.15.5:0/3908012011 >> v2:172.21.15.112:3300/0 conn(0x7f26a415f1f0 0x7f26a40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 -- 172.21.15.5:0/3908012011 >> 172.21.15.5:0/3908012011 conn(0x7f26a406dae0 msgr2=0x7f26a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 -- 172.21.15.5:0/3908012011 shutdown_connections 2023-10-16T13:49:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.718+0000 7f26ab091700 1 -- 172.21.15.5:0/3908012011 wait complete. 2023-10-16T13:49:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.719+0000 7f26ab091700 1 Processor -- start 2023-10-16T13:49:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 -- start start 2023-10-16T13:49:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26a415ab10 0x7f26a4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a415f1f0 0x7f26a40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a41f55f0 con 0x7f26a40cfc60 2023-10-16T13:49:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40c9980 con 0x7f26a415f1f0 2023-10-16T13:49:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26ab091700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40d1060 con 0x7f26a415ab10 2023-10-16T13:49:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26a8e2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26a8e2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50972/0 (socket says 172.21.15.5:50972) 2023-10-16T13:49:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.720+0000 7f26a8e2d700 1 -- 172.21.15.5:0/3632025032 learned_addr learned my addr 172.21.15.5:0/3632025032 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a962e700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a415f1f0 0x7f26a40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a3fff700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26a415ab10 0x7f26a4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a8e2d700 1 -- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26a415ab10 msgr2=0x7f26a4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a8e2d700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26a415ab10 0x7f26a4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a8e2d700 1 -- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a415f1f0 msgr2=0x7f26a40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a8e2d700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a415f1f0 0x7f26a40b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a8e2d700 1 -- 172.21.15.5:0/3632025032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c009b30 con 0x7f26a40cfc60 2023-10-16T13:49:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a8e2d700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40d0b20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f269800c550 tx=0x7f269800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698004c80 con 0x7f26a40cfc60 2023-10-16T13:49:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698004e00 con 0x7f26a40cfc60 2023-10-16T13:49:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a41f4690 con 0x7f26a40cfc60 2023-10-16T13:49:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698007310 con 0x7f26a40cfc60 2023-10-16T13:49:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.721+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a41f4c50 con 0x7f26a40cfc60 2023-10-16T13:49:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.722+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a40c7940 con 0x7f26a40cfc60 2023-10-16T13:49:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.723+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2698007470 con 0x7f26a40cfc60 2023-10-16T13:49:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.723+0000 7f26a17fa700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f268806b2f0 0x7f268806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.723+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2698089980 con 0x7f26a40cfc60 2023-10-16T13:49:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.723+0000 7f26a3fff700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f268806b2f0 0x7f268806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.724+0000 7f26a3fff700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f268806b2f0 0x7f268806d7b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26a40c76c0 tx=0x7f2690008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.728+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26a40c7940 con 0x7f26a40cfc60 2023-10-16T13:49:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.931+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26a40c7940 con 0x7f26a40cfc60 2023-10-16T13:49:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.932+0000 7f26a17fa700 1 -- 172.21.15.5:0/3632025032 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f26a40c7940 con 0x7f26a40cfc60 2023-10-16T13:49:50.936 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:50.937 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":135,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:36.376754+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f268806b2f0 msgr2=0x7f268806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f268806b2f0 0x7f268806d7b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26a40c76c0 tx=0x7f2690008040 comp rx=0 tx=0).stop 2023-10-16T13:49:50.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 msgr2=0x7f26a40d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:50.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40d0b20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f269800c550 tx=0x7f269800c910 comp rx=0 tx=0).stop 2023-10-16T13:49:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 shutdown_connections 2023-10-16T13:49:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a415f1f0 0x7f26a40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26a40cfc60 0x7f26a40d0b20 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f268806b2f0 0x7f268806d7b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 --2- 172.21.15.5:0/3632025032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26a415ab10 0x7f26a4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.934+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 >> 172.21.15.5:0/3632025032 conn(0x7f26a406dae0 msgr2=0x7f26a4158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.935+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 shutdown_connections 2023-10-16T13:49:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:50.935+0000 7f26ab091700 1 -- 172.21.15.5:0/3632025032 wait complete. 2023-10-16T13:49:50.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T13:38:13.510769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:49:33.286763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:49:33.761808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:49:50.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:49:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.078+0000 7fec01419700 1 Processor -- start 2023-10-16T13:49:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.078+0000 7fec01419700 1 -- start start 2023-10-16T13:49:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7fec01419700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febfc0cd950 0x7febfc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7fec01419700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febfc06a840 0x7febfc06ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7fec01419700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0cf290 con 0x7febfc0cede0 2023-10-16T13:49:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7fec01419700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc1619a0 con 0x7febfc0cd950 2023-10-16T13:49:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7fec01419700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc06b1b0 con 0x7febfc06a840 2023-10-16T13:49:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7febfaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febfc0cd950 0x7febfc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7febfaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febfc0cd950 0x7febfc15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50980/0 (socket says 172.21.15.5:50980) 2023-10-16T13:49:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.079+0000 7febfaffd700 1 -- 172.21.15.5:0/4224010101 learned_addr learned my addr 172.21.15.5:0/4224010101 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfb7fe700 1 --2- 172.21.15.5:0/4224010101 >> v2:172.21.15.112:3300/0 conn(0x7febfc06a840 0x7febfc06ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfaffd700 1 -- 172.21.15.5:0/4224010101 >> v2:172.21.15.112:3300/0 conn(0x7febfc06a840 msgr2=0x7febfc06ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfaffd700 1 --2- 172.21.15.5:0/4224010101 >> v2:172.21.15.112:3300/0 conn(0x7febfc06a840 0x7febfc06ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfaffd700 1 -- 172.21.15.5:0/4224010101 >> v1:172.21.15.112:6789/0 conn(0x7febfc0cede0 legacy=0x7febfc15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfaffd700 1 -- 172.21.15.5:0/4224010101 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0b2d60 con 0x7febfc0cd950 2023-10-16T13:49:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfb7fe700 1 --2- 172.21.15.5:0/4224010101 >> v2:172.21.15.112:3300/0 conn(0x7febfc06a840 0x7febfc06ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febfaffd700 1 --2- 172.21.15.5:0/4224010101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc0cd950 0x7febfc15e2f0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7febfc15e830 tx=0x7febf0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef000ea21db6665 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febf9ffb700 1 -- 172.21.15.5:0/4224010101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000b870 con 0x7febfc0cd950 2023-10-16T13:49:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febf9ffb700 1 -- 172.21.15.5:0/4224010101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000b9d0 con 0x7febfc0cd950 2023-10-16T13:49:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.080+0000 7febf9ffb700 1 -- 172.21.15.5:0/4224010101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000bd60 con 0x7febfc0cd950 2023-10-16T13:49:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 -- 172.21.15.5:0/4224010101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc0cd950 msgr2=0x7febfc15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 --2- 172.21.15.5:0/4224010101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc0cd950 0x7febfc15e2f0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7febfc15e830 tx=0x7febf0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 -- 172.21.15.5:0/4224010101 shutdown_connections 2023-10-16T13:49:51.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 --2- 172.21.15.5:0/4224010101 >> v2:172.21.15.112:3300/0 conn(0x7febfc06a840 0x7febfc06ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 --2- 172.21.15.5:0/4224010101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc0cd950 0x7febfc15e2f0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 -- 172.21.15.5:0/4224010101 >> 172.21.15.5:0/4224010101 conn(0x7febfc06dae0 msgr2=0x7febfc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 -- 172.21.15.5:0/4224010101 shutdown_connections 2023-10-16T13:49:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.081+0000 7fec01419700 1 -- 172.21.15.5:0/4224010101 wait complete. 2023-10-16T13:49:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.082+0000 7fec01419700 1 Processor -- start 2023-10-16T13:49:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.082+0000 7fec01419700 1 -- start start 2023-10-16T13:49:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7fec01419700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 0x7febfc0ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7fec01419700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febfc0cd950 0x7febfc0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7fec01419700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febfc0cede0 0x7febfc0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7fec01419700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0ad970 con 0x7febfc06a840 2023-10-16T13:49:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7fec01419700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c40a0 con 0x7febfc0cd950 2023-10-16T13:49:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7fec01419700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c4310 con 0x7febfc0cede0 2023-10-16T13:49:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.083+0000 7febfaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 0x7febfc0ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 0x7febfc0ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50986/0 (socket says 172.21.15.5:50986) 2023-10-16T13:49:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 -- 172.21.15.5:0/593429773 learned_addr learned my addr 172.21.15.5:0/593429773 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfa7fc700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febfc0cd950 0x7febfc0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfb7fe700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febfc0cede0 0x7febfc0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 -- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febfc0cede0 msgr2=0x7febfc0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febfc0cede0 0x7febfc0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 -- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febfc0cd950 msgr2=0x7febfc0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febfc0cd950 0x7febfc0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 -- 172.21.15.5:0/593429773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0009550 con 0x7febfc06a840 2023-10-16T13:49:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febfaffd700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 0x7febfc0ad430 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7febf0000c00 tx=0x7febf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0004480 con 0x7febfc06a840 2023-10-16T13:49:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf00045e0 con 0x7febfc06a840 2023-10-16T13:49:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc0c45f0 con 0x7febfc06a840 2023-10-16T13:49:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00038e0 con 0x7febfc06a840 2023-10-16T13:49:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.084+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc1f7fe0 con 0x7febfc06a840 2023-10-16T13:49:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.085+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc0c4b10 con 0x7febfc06a840 2023-10-16T13:49:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.086+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7febf0021070 con 0x7febfc06a840 2023-10-16T13:49:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.086+0000 7febe37fe700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febe806b2f0 0x7febe806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.086+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febf008b1d0 con 0x7febfc06a840 2023-10-16T13:49:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.086+0000 7febfa7fc700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febe806b2f0 0x7febe806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.087+0000 7febfa7fc700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febe806b2f0 0x7febe806d7b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7febfc0b0d30 tx=0x7febec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.091+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febfc0c4b10 con 0x7febfc06a840 2023-10-16T13:49:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.288+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febfc0c4b10 con 0x7febfc06a840 2023-10-16T13:49:51.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.288+0000 7febe37fe700 1 -- 172.21.15.5:0/593429773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7febfc0c4b10 con 0x7febfc06a840 2023-10-16T13:49:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-16T13:49:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febe806b2f0 msgr2=0x7febe806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febe806b2f0 0x7febe806d7b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7febfc0b0d30 tx=0x7febec009040 comp rx=0 tx=0).stop 2023-10-16T13:49:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 msgr2=0x7febfc0ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 0x7febfc0ad430 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7febf0000c00 tx=0x7febf0004750 comp rx=0 tx=0).stop 2023-10-16T13:49:51.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 shutdown_connections 2023-10-16T13:49:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7febe806b2f0 0x7febe806d7b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febfc0cede0 0x7febfc0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febfc06a840 0x7febfc0ad430 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 --2- 172.21.15.5:0/593429773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febfc0cd950 0x7febfc0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 >> 172.21.15.5:0/593429773 conn(0x7febfc06dae0 msgr2=0x7febfc1605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:51.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 shutdown_connections 2023-10-16T13:49:51.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.291+0000 7fec01419700 1 -- 172.21.15.5:0/593429773 wait complete. 2023-10-16T13:49:51.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T13:49:51.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.433+0000 7faacac51700 1 Processor -- start 2023-10-16T13:49:51.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.433+0000 7faacac51700 1 -- start start 2023-10-16T13:49:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faacac51700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac415dbc0 0x7faac415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faacac51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faac40d3fc0 0x7faac40d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faacac51700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac40d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faacac51700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac415e4e0 con 0x7faac415dbc0 2023-10-16T13:49:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faacac51700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac40b7560 con 0x7faac40d3fc0 2023-10-16T13:49:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faacac51700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac40b7840 con 0x7faac40b7050 2023-10-16T13:49:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faac89ed700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac415dbc0 0x7faac415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faac89ed700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac415dbc0 0x7faac415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50994/0 (socket says 172.21.15.5:50994) 2023-10-16T13:49:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.434+0000 7faac89ed700 1 -- 172.21.15.5:0/3097755698 learned_addr learned my addr 172.21.15.5:0/3097755698 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac91ee700 1 --2- 172.21.15.5:0/3097755698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac40d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac3fff700 1 --2- 172.21.15.5:0/3097755698 >> v2:172.21.15.112:3300/0 conn(0x7faac40d3fc0 0x7faac40d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac89ed700 1 -- 172.21.15.5:0/3097755698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 msgr2=0x7faac40d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac89ed700 1 --2- 172.21.15.5:0/3097755698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac40d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac89ed700 1 -- 172.21.15.5:0/3097755698 >> v2:172.21.15.112:3300/0 conn(0x7faac40d3fc0 msgr2=0x7faac40d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac89ed700 1 --2- 172.21.15.5:0/3097755698 >> v2:172.21.15.112:3300/0 conn(0x7faac40d3fc0 0x7faac40d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac89ed700 1 -- 172.21.15.5:0/3097755698 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40b7b20 con 0x7faac415dbc0 2023-10-16T13:49:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac89ed700 1 --2- 172.21.15.5:0/3097755698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac415dbc0 0x7faac415dfa0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7faac40d14e0 tx=0x7faabc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef31a14f89efc87 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac37fe700 1 -- 172.21.15.5:0/3097755698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00e070 con 0x7faac415dbc0 2023-10-16T13:49:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac37fe700 1 -- 172.21.15.5:0/3097755698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc00b9c0 con 0x7faac415dbc0 2023-10-16T13:49:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.435+0000 7faac37fe700 1 -- 172.21.15.5:0/3097755698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00bd70 con 0x7faac415dbc0 2023-10-16T13:49:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 -- 172.21.15.5:0/3097755698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac415dbc0 msgr2=0x7faac415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 --2- 172.21.15.5:0/3097755698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac415dbc0 0x7faac415dfa0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7faac40d14e0 tx=0x7faabc00b330 comp rx=0 tx=0).stop 2023-10-16T13:49:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 -- 172.21.15.5:0/3097755698 shutdown_connections 2023-10-16T13:49:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 --2- 172.21.15.5:0/3097755698 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac40d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 --2- 172.21.15.5:0/3097755698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac415dbc0 0x7faac415dfa0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 --2- 172.21.15.5:0/3097755698 >> v2:172.21.15.112:3300/0 conn(0x7faac40d3fc0 0x7faac40d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 -- 172.21.15.5:0/3097755698 >> 172.21.15.5:0/3097755698 conn(0x7faac409cb40 msgr2=0x7faac40d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 -- 172.21.15.5:0/3097755698 shutdown_connections 2023-10-16T13:49:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.436+0000 7faacac51700 1 -- 172.21.15.5:0/3097755698 wait complete. 2023-10-16T13:49:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.437+0000 7faacac51700 1 Processor -- start 2023-10-16T13:49:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.437+0000 7faacac51700 1 -- start start 2023-10-16T13:49:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faacac51700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac41f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faacac51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 0x7faac406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faacac51700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faac415dbc0 0x7faac406c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faacac51700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac409f7a0 con 0x7faac40d3fc0 2023-10-16T13:49:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faacac51700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac409f1b0 con 0x7faac415dbc0 2023-10-16T13:49:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faacac51700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac41f43b0 con 0x7faac40b7050 2023-10-16T13:49:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 0x7faac406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 0x7faac406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51002/0 (socket says 172.21.15.5:51002) 2023-10-16T13:49:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 -- 172.21.15.5:0/4202907901 learned_addr learned my addr 172.21.15.5:0/4202907901 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac89ed700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac41f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac91ee700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faac415dbc0 0x7faac406c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 -- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 msgr2=0x7faac41f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac41f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 -- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faac415dbc0 msgr2=0x7faac406c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faac415dbc0 0x7faac406c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 -- 172.21.15.5:0/4202907901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc009b30 con 0x7faac40d3fc0 2023-10-16T13:49:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac89ed700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac41f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac91ee700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faac415dbc0 0x7faac406c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac3fff700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 0x7faac406c2d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e810 tx=0x7faaac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.438+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac013610 con 0x7faac40d3fc0 2023-10-16T13:49:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.439+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac013770 con 0x7faac40d3fc0 2023-10-16T13:49:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.439+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac41f3df0 con 0x7faac40d3fc0 2023-10-16T13:49:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.439+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac013b20 con 0x7faac40d3fc0 2023-10-16T13:49:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.439+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac409f3c0 con 0x7faac40d3fc0 2023-10-16T13:49:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.439+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac409f8e0 con 0x7faac40d3fc0 2023-10-16T13:49:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.440+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7faaac013c80 con 0x7faac40d3fc0 2023-10-16T13:49:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.440+0000 7faac17fa700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faaa406b2f0 0x7faaa406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.441+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaac089b40 con 0x7faac40d3fc0 2023-10-16T13:49:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.441+0000 7faac89ed700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faaa406b2f0 0x7faaa406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.441+0000 7faac89ed700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faaa406b2f0 0x7faaa406d7b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faabc000f80 tx=0x7faabc009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.445+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faac409f8e0 con 0x7faac40d3fc0 2023-10-16T13:49:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.645+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faac409f8e0 con 0x7faac40d3fc0 2023-10-16T13:49:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.646+0000 7faac17fa700 1 -- 172.21.15.5:0/4202907901 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7faac409f8e0 con 0x7faac40d3fc0 2023-10-16T13:49:51.649 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-16T13:49:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.647+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faaa406b2f0 msgr2=0x7faaa406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.647+0000 7faacac51700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faaa406b2f0 0x7faaa406d7b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faabc000f80 tx=0x7faabc009000 comp rx=0 tx=0).stop 2023-10-16T13:49:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 msgr2=0x7faac406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 0x7faac406c2d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e810 tx=0x7faaac00ebd0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 shutdown_connections 2023-10-16T13:49:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faac415dbc0 0x7faac406c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7faaa406b2f0 0x7faaa406d7b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faac40b7050 0x7faac41f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 --2- 172.21.15.5:0/4202907901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40d3fc0 0x7faac406c2d0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 >> 172.21.15.5:0/4202907901 conn(0x7faac409cb40 msgr2=0x7faac415bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 shutdown_connections 2023-10-16T13:49:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.648+0000 7faacac51700 1 -- 172.21.15.5:0/4202907901 wait complete. 2023-10-16T13:49:51.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T13:49:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.789+0000 7fc4862f8700 1 Processor -- start 2023-10-16T13:49:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.789+0000 7fc4862f8700 1 -- start start 2023-10-16T13:49:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc4862f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4800cf8a0 0x7fc4800d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc4862f8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800d1bc0 0x7fc4800cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc4862f8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48015ee90 con 0x7fc48015eab0 2023-10-16T13:49:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc4862f8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc480158370 con 0x7fc4800cf8a0 2023-10-16T13:49:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc4862f8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800d23b0 con 0x7fc4800d1bc0 2023-10-16T13:49:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc47f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4800cf8a0 0x7fc4800d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc47f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4800cf8a0 0x7fc4800d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51008/0 (socket says 172.21.15.5:51008) 2023-10-16T13:49:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.790+0000 7fc47f7fe700 1 -- 172.21.15.5:0/629017971 learned_addr learned my addr 172.21.15.5:0/629017971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47f7fe700 1 -- 172.21.15.5:0/629017971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800d1bc0 msgr2=0x7fc4800cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc484895700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800d1bc0 0x7fc4800cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47f7fe700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800d1bc0 0x7fc4800cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47f7fe700 1 -- 172.21.15.5:0/629017971 >> v1:172.21.15.112:6789/0 conn(0x7fc48015eab0 legacy=0x7fc4800cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47f7fe700 1 -- 172.21.15.5:0/629017971 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800cda20 con 0x7fc4800cf8a0 2023-10-16T13:49:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc484895700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800d1bc0 0x7fc4800cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47f7fe700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800cf8a0 0x7fc4800d1680 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc48015f020 tx=0x7fc470009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a2ffcb88036e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47effd700 1 -- 172.21.15.5:0/629017971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470011830 con 0x7fc4800cf8a0 2023-10-16T13:49:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47effd700 1 -- 172.21.15.5:0/629017971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470011990 con 0x7fc4800cf8a0 2023-10-16T13:49:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc47effd700 1 -- 172.21.15.5:0/629017971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470011d20 con 0x7fc4800cf8a0 2023-10-16T13:49:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc4862f8700 1 -- 172.21.15.5:0/629017971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800cf8a0 msgr2=0x7fc4800d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc4862f8700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800cf8a0 0x7fc4800d1680 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc48015f020 tx=0x7fc470009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc4862f8700 1 -- 172.21.15.5:0/629017971 shutdown_connections 2023-10-16T13:49:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc4862f8700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800d1bc0 0x7fc4800cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc4862f8700 1 --2- 172.21.15.5:0/629017971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800cf8a0 0x7fc4800d1680 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.791+0000 7fc4862f8700 1 -- 172.21.15.5:0/629017971 >> 172.21.15.5:0/629017971 conn(0x7fc4800665a0 msgr2=0x7fc480066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.792+0000 7fc4862f8700 1 -- 172.21.15.5:0/629017971 shutdown_connections 2023-10-16T13:49:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.792+0000 7fc4862f8700 1 -- 172.21.15.5:0/629017971 wait complete. 2023-10-16T13:49:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.793+0000 7fc4862f8700 1 Processor -- start 2023-10-16T13:49:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.793+0000 7fc4862f8700 1 -- start start 2023-10-16T13:49:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800cf8a0 0x7fc480160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4800d1bc0 0x7fc480156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 0x7fc480156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800c96e0 con 0x7fc48015eab0 2023-10-16T13:49:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc480161320 con 0x7fc4800d1bc0 2023-10-16T13:49:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4801f48c0 con 0x7fc4800cf8a0 2023-10-16T13:49:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 0x7fc480156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 0x7fc480156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51018/0 (socket says 172.21.15.5:51018) 2023-10-16T13:49:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 -- 172.21.15.5:0/140545419 learned_addr learned my addr 172.21.15.5:0/140545419 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc47ffff700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800cf8a0 0x7fc480160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc47f7fe700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4800d1bc0 0x7fc480156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 -- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800cf8a0 msgr2=0x7fc480160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800cf8a0 0x7fc480160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 -- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4800d1bc0 msgr2=0x7fc480156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4800d1bc0 0x7fc480156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 -- 172.21.15.5:0/140545419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009550 con 0x7fc48015eab0 2023-10-16T13:49:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc484895700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 0x7fc480156bc0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc47800cd50 tx=0x7fc47800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800cea0 con 0x7fc48015eab0 2023-10-16T13:49:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800f480 con 0x7fc48015eab0 2023-10-16T13:49:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.794+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4801615a0 con 0x7fc48015eab0 2023-10-16T13:49:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.795+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800f830 con 0x7fc48015eab0 2023-10-16T13:49:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.795+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc480161b60 con 0x7fc48015eab0 2023-10-16T13:49:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.796+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc480067d20 con 0x7fc48015eab0 2023-10-16T13:49:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.796+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fc47800b040 con 0x7fc48015eab0 2023-10-16T13:49:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.796+0000 7fc47cff9700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc46c06b2f0 0x7fc46c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.796+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc47808a4a0 con 0x7fc48015eab0 2023-10-16T13:49:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.797+0000 7fc47ffff700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc46c06b2f0 0x7fc46c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.797+0000 7fc47ffff700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc46c06b2f0 0x7fc46c06d7b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc474007fd0 tx=0x7fc474007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:51.801+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc478054ef0 con 0x7fc48015eab0 2023-10-16T13:49:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.002+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4800b4af0 con 0x7fc48015eab0 2023-10-16T13:49:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.002+0000 7fc47cff9700 1 -- 172.21.15.5:0/140545419 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc47801d020 con 0x7fc48015eab0 2023-10-16T13:49:52.005 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-16T13:49:52.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc46c06b2f0 msgr2=0x7fc46c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc46c06b2f0 0x7fc46c06d7b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc474007fd0 tx=0x7fc474007ec0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 msgr2=0x7fc480156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 0x7fc480156bc0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc47800cd50 tx=0x7fc47800a560 comp rx=0 tx=0).stop 2023-10-16T13:49:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 shutdown_connections 2023-10-16T13:49:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc48015eab0 0x7fc480156bc0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc46c06b2f0 0x7fc46c06d7b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4800cf8a0 0x7fc480160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 --2- 172.21.15.5:0/140545419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4800d1bc0 0x7fc480156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 >> 172.21.15.5:0/140545419 conn(0x7fc4800665a0 msgr2=0x7fc4800739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:52.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 shutdown_connections 2023-10-16T13:49:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.004+0000 7fc4862f8700 1 -- 172.21.15.5:0/140545419 wait complete. 2023-10-16T13:49:52.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.141+0000 7f033050b700 1 Processor -- start 2023-10-16T13:49:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.141+0000 7f033050b700 1 -- start start 2023-10-16T13:49:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f033050b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f032815dbc0 0x7f032815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f033050b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280b7050 0x7f03280d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f033050b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032815e4e0 con 0x7f03280d3fc0 2023-10-16T13:49:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f033050b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03280b7560 con 0x7f032815dbc0 2023-10-16T13:49:52.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f033050b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03280b7840 con 0x7f03280b7050 2023-10-16T13:49:52.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f032815dbc0 0x7f032815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032daa6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03280d3fc0 0x7f03280d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32794/0 (socket says 172.21.15.5:32794) 2023-10-16T13:49:52.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f032815dbc0 0x7f032815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51022/0 (socket says 172.21.15.5:51022) 2023-10-16T13:49:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032daa6700 1 -- 172.21.15.5:0/2085772977 learned_addr learned my addr 172.21.15.5:0/2085772977 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032eaa8700 1 --2- 172.21.15.5:0/2085772977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280b7050 0x7f03280d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 -- 172.21.15.5:0/2085772977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280b7050 msgr2=0x7f03280d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 --2- 172.21.15.5:0/2085772977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280b7050 0x7f03280d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 -- 172.21.15.5:0/2085772977 >> v1:172.21.15.5:6789/0 conn(0x7f03280d3fc0 legacy=0x7f03280d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 -- 172.21.15.5:0/2085772977 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03280b7b20 con 0x7f032815dbc0 2023-10-16T13:49:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032e2a7700 1 --2- 172.21.15.5:0/2085772977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f032815dfa0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0324009820 tx=0x7f0324009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1246e12d8df53fb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032d2a5700 1 -- 172.21.15.5:0/2085772977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324005e30 con 0x7f032815dbc0 2023-10-16T13:49:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.142+0000 7f032d2a5700 1 -- 172.21.15.5:0/2085772977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324006030 con 0x7f032815dbc0 2023-10-16T13:49:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f032d2a5700 1 -- 172.21.15.5:0/2085772977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240063e0 con 0x7f032815dbc0 2023-10-16T13:49:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 -- 172.21.15.5:0/2085772977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 msgr2=0x7f032815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 --2- 172.21.15.5:0/2085772977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f032815dfa0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0324009820 tx=0x7f0324009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 -- 172.21.15.5:0/2085772977 shutdown_connections 2023-10-16T13:49:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 --2- 172.21.15.5:0/2085772977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280b7050 0x7f03280d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 --2- 172.21.15.5:0/2085772977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f032815dfa0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 -- 172.21.15.5:0/2085772977 >> 172.21.15.5:0/2085772977 conn(0x7f032809cb40 msgr2=0x7f03280d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 -- 172.21.15.5:0/2085772977 shutdown_connections 2023-10-16T13:49:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.143+0000 7f033050b700 1 -- 172.21.15.5:0/2085772977 wait complete. 2023-10-16T13:49:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.144+0000 7f033050b700 1 Processor -- start 2023-10-16T13:49:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.144+0000 7f033050b700 1 -- start start 2023-10-16T13:49:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f033050b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03280b7050 0x7f03280ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f033050b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280d3fc0 0x7f03280c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f033050b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f03281f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f033050b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0328158070 con 0x7f032815dbc0 2023-10-16T13:49:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f033050b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281582c0 con 0x7f03280b7050 2023-10-16T13:49:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f033050b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03281585a0 con 0x7f03280d3fc0 2023-10-16T13:49:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f03281f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f03281f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51032/0 (socket says 172.21.15.5:51032) 2023-10-16T13:49:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 -- 172.21.15.5:0/3818540966 learned_addr learned my addr 172.21.15.5:0/3818540966 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032daa6700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280d3fc0 0x7f03280c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032e2a7700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03280b7050 0x7f03280ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 -- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280d3fc0 msgr2=0x7f03280c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280d3fc0 0x7f03280c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 -- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03280b7050 msgr2=0x7f03280ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03280b7050 0x7f03280ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.145+0000 7f032eaa8700 1 -- 172.21.15.5:0/3818540966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009430 con 0x7f032815dbc0 2023-10-16T13:49:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.146+0000 7f032eaa8700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f03281f3090 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0320007e40 tx=0x7f032000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.146+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000eea0 con 0x7f032815dbc0 2023-10-16T13:49:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.146+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320014420 con 0x7f032815dbc0 2023-10-16T13:49:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.146+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0328158880 con 0x7f032815dbc0 2023-10-16T13:49:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.146+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200147b0 con 0x7f032815dbc0 2023-10-16T13:49:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.146+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03280cada0 con 0x7f032815dbc0 2023-10-16T13:49:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.147+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0328158da0 con 0x7f032815dbc0 2023-10-16T13:49:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.147+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f0320014910 con 0x7f032815dbc0 2023-10-16T13:49:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.148+0000 7f031effd700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f030c06b2f0 0x7f030c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.148+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f032008a510 con 0x7f032815dbc0 2023-10-16T13:49:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.148+0000 7f032e2a7700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f030c06b2f0 0x7f030c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.148+0000 7f032e2a7700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f030c06b2f0 0x7f030c06d7b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0324013040 tx=0x7f0324008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.153+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0328158da0 con 0x7f032815dbc0 2023-10-16T13:49:52.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.397+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0328158da0 con 0x7f032815dbc0 2023-10-16T13:49:52.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.398+0000 7f031effd700 1 -- 172.21.15.5:0/3818540966 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f0328158da0 con 0x7f032815dbc0 2023-10-16T13:49:52.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:52.402 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:49:34.794871+0000","modified":"2023-10-16T13:49:37.820862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8229":{"gid":8229,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2779373791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2779373791},{"type":"v1","addr":"172.21.15.112:6837","nonce":2779373791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-10-16T13:49:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f030c06b2f0 msgr2=0x7f030c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f030c06b2f0 0x7f030c06d7b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0324013040 tx=0x7f0324008070 comp rx=0 tx=0).stop 2023-10-16T13:49:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 msgr2=0x7f03281f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f03281f3090 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0320007e40 tx=0x7f032000e3c0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 shutdown_connections 2023-10-16T13:49:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032815dbc0 0x7f03281f3090 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03280b7050 0x7f03280ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f030c06b2f0 0x7f030c06d7b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 --2- 172.21.15.5:0/3818540966 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03280d3fc0 0x7f03280c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 >> 172.21.15.5:0/3818540966 conn(0x7f032809cb40 msgr2=0x7f03280cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 shutdown_connections 2023-10-16T13:49:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.400+0000 7f033050b700 1 -- 172.21.15.5:0/3818540966 wait complete. 2023-10-16T13:49:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 99 2023-10-16T13:49:52.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.537+0000 7f57134e9700 1 Processor -- start 2023-10-16T13:49:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.537+0000 7f57134e9700 1 -- start start 2023-10-16T13:49:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f57134e9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f570c0cfe30 0x7f570c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f57134e9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570c15e7a0 con 0x7f570c15ab10 2023-10-16T13:49:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f57134e9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570c0b29a0 con 0x7f570c15f1f0 2023-10-16T13:49:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f57134e9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570c0b2c80 con 0x7f570c0cfe30 2023-10-16T13:49:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f5711285700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f570c15ab10 0x7f570c0b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32808/0 (socket says 172.21.15.5:32808) 2023-10-16T13:49:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f5711285700 1 -- 172.21.15.5:0/2784744915 learned_addr learned my addr 172.21.15.5:0/2784744915 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751688970 0 0) 0x7f570c15e7a0 con 0x7f570c15ab10 2023-10-16T13:49:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f5711a86700 1 --2- 172.21.15.5:0/2784744915 >> v2:172.21.15.112:3300/0 conn(0x7f570c0cfe30 0x7f570c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.538+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f80035b0 con 0x7f570c15ab10 2023-10-16T13:49:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057059989 0 0) 0x7f56f80035b0 con 0x7f570c15ab10 2023-10-16T13:49:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 >> v2:172.21.15.112:3300/0 conn(0x7f570c0cfe30 msgr2=0x7f570c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 --2- 172.21.15.5:0/2784744915 >> v2:172.21.15.112:3300/0 conn(0x7f570c0cfe30 0x7f570c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 >> v1:172.21.15.112:6789/0 conn(0x7f570c15f1f0 legacy=0x7f570c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c15e9f0 con 0x7f570c15ab10 2023-10-16T13:49:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f56fc001670 con 0x7f570c15ab10 2023-10-16T13:49:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 >> v1:172.21.15.5:6789/0 conn(0x7f570c15ab10 legacy=0x7f570c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56f8003a00 0x7f56f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8004850 0x7f56f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f8005210 0x7f56f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0b2c80 con 0x7f56f8005210 2023-10-16T13:49:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f800c0b0 con 0x7f56f8004850 2023-10-16T13:49:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f800c270 con 0x7f56f8003a00 2023-10-16T13:49:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f8005210 0x7f56f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5710a84700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8004850 0x7f56f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711285700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56f8003a00 0x7f56f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 -- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56f8003a00 msgr2=0x7f56f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56f8003a00 0x7f56f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 -- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8004850 msgr2=0x7f56f8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8004850 0x7f56f8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 -- 172.21.15.5:0/2784744915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80035b0 con 0x7f56f8005210 2023-10-16T13:49:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5710a84700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8004850 0x7f56f8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711285700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56f8003a00 0x7f56f8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 -- 172.21.15.5:0/2784744915 reap_dead start 2023-10-16T13:49:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.539+0000 7f5711a86700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f8005210 0x7f56f800ba10 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5704009f90 tx=0x7f56f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26101f58c0b4036c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400ec30 con 0x7f56f8005210 2023-10-16T13:49:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400f040 con 0x7f56f8005210 2023-10-16T13:49:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f5703fff700 1 -- 172.21.15.5:0/2784744915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704014480 con 0x7f56f8005210 2023-10-16T13:49:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 -- 172.21.15.5:0/2784744915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f8005210 msgr2=0x7f56f800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f8005210 0x7f56f800ba10 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5704009f90 tx=0x7f56f8005880 comp rx=0 tx=0).stop 2023-10-16T13:49:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 -- 172.21.15.5:0/2784744915 shutdown_connections 2023-10-16T13:49:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 --2- 172.21.15.5:0/2784744915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f8005210 0x7f56f800ba10 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 -- 172.21.15.5:0/2784744915 >> 172.21.15.5:0/2784744915 conn(0x7f570c06dae0 msgr2=0x7f570c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 -- 172.21.15.5:0/2784744915 shutdown_connections 2023-10-16T13:49:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.540+0000 7f57134e9700 1 -- 172.21.15.5:0/2784744915 wait complete. 2023-10-16T13:49:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.541+0000 7f57134e9700 1 Processor -- start 2023-10-16T13:49:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 -- start start 2023-10-16T13:49:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8005210 0x7f570c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f570c0c5cf0 0x7f570c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 0x7f570c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0c5030 con 0x7f570c0c6710 2023-10-16T13:49:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c15dba0 con 0x7f56f8005210 2023-10-16T13:49:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f57134e9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0c6c00 con 0x7f570c0c5cf0 2023-10-16T13:49:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f5711a86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 0x7f570c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f5711a86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 0x7f570c06a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51050/0 (socket says 172.21.15.5:51050) 2023-10-16T13:49:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f5711a86700 1 -- 172.21.15.5:0/3666042641 learned_addr learned my addr 172.21.15.5:0/3666042641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f5711285700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8005210 0x7f570c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.542+0000 7f5710a84700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f570c0c5cf0 0x7f570c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5711a86700 1 -- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f570c0c5cf0 msgr2=0x7f570c0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5711a86700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f570c0c5cf0 0x7f570c0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5711a86700 1 -- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8005210 msgr2=0x7f570c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5711a86700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8005210 0x7f570c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5711a86700 1 -- 172.21.15.5:0/3666042641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0c5210 con 0x7f570c0c6710 2023-10-16T13:49:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5711a86700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 0x7f570c06a840 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f570c15e700 tx=0x7f5704004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704007000 con 0x7f570c0c6710 2023-10-16T13:49:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704003e30 con 0x7f570c0c6710 2023-10-16T13:49:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570c0c54f0 con 0x7f570c0c6710 2023-10-16T13:49:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704015ac0 con 0x7f570c0c6710 2023-10-16T13:49:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.543+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c0ade40 con 0x7f570c0c6710 2023-10-16T13:49:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.544+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c0adfd0 con 0x7f570c0c6710 2023-10-16T13:49:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.545+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5704024070 con 0x7f570c0c6710 2023-10-16T13:49:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.545+0000 7f5701ffb700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f56f006b2f0 0x7f56f006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.545+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f570408b640 con 0x7f570c0c6710 2023-10-16T13:49:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.545+0000 7f5711285700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f56f006b2f0 0x7f56f006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.546+0000 7f5711285700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f56f006b2f0 0x7f56f006d7b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.550+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57040562a0 con 0x7f570c0c6710 2023-10-16T13:49:52.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.750+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f570c0afc10 con 0x7f570c0c6710 2023-10-16T13:49:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.751+0000 7f5701ffb700 1 -- 172.21.15.5:0/3666042641 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f57040598c0 con 0x7f570c0c6710 2023-10-16T13:49:52.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:52.755 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":135,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:36.376754+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f56f006b2f0 msgr2=0x7f56f006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f56f006b2f0 0x7f56f006d7b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc007040 comp rx=0 tx=0).stop 2023-10-16T13:49:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 msgr2=0x7f570c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 0x7f570c06a840 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f570c15e700 tx=0x7f5704004b40 comp rx=0 tx=0).stop 2023-10-16T13:49:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 shutdown_connections 2023-10-16T13:49:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f570c0c6710 0x7f570c06a840 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56f8005210 0x7f570c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f56f006b2f0 0x7f56f006d7b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 --2- 172.21.15.5:0/3666042641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f570c0c5cf0 0x7f570c0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 >> 172.21.15.5:0/3666042641 conn(0x7f570c06dae0 msgr2=0x7f570c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:52.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 shutdown_connections 2023-10-16T13:49:52.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.754+0000 7f57134e9700 1 -- 172.21.15.5:0/3666042641 wait complete. 2023-10-16T13:49:52.769 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:49:52.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.892+0000 7f5095f5e700 1 Processor -- start 2023-10-16T13:49:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.892+0000 7f5095f5e700 1 -- start start 2023-10-16T13:49:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f5095f5e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50900cd950 0x7f509015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f5095f5e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50900cede0 0x7f509015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f5095f5e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900cf290 con 0x7f509006a840 2023-10-16T13:49:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f5095f5e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50901619a0 con 0x7f50900cede0 2023-10-16T13:49:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f5095f5e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50900b2d60 con 0x7f50900cd950 2023-10-16T13:49:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50900cede0 0x7f509015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50900cede0 0x7f509015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51054/0 (socket says 172.21.15.5:51054) 2023-10-16T13:49:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f509006a840 0x7f5090161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32830/0 (socket says 172.21.15.5:32830) 2023-10-16T13:49:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 -- 172.21.15.5:0/2271010126 learned_addr learned my addr 172.21.15.5:0/2271010126 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508f7fe700 1 --2- 172.21.15.5:0/2271010126 >> v2:172.21.15.112:3300/0 conn(0x7f50900cd950 0x7f509015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 -- 172.21.15.5:0/2271010126 >> v2:172.21.15.112:3300/0 conn(0x7f50900cd950 msgr2=0x7f509015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 --2- 172.21.15.5:0/2271010126 >> v2:172.21.15.112:3300/0 conn(0x7f50900cd950 0x7f509015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 -- 172.21.15.5:0/2271010126 >> v1:172.21.15.5:6789/0 conn(0x7f509006a840 legacy=0x7f5090161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508effd700 1 -- 172.21.15.5:0/2271010126 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900cdd30 con 0x7f50900cede0 2023-10-16T13:49:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508f7fe700 1 --2- 172.21.15.5:0/2271010126 >> v2:172.21.15.112:3300/0 conn(0x7f50900cd950 0x7f509015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.893+0000 7f508e7fc700 1 -- 172.21.15.5:0/2271010126 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002009338 0 0) 0x7f50900cf290 con 0x7f509006a840 2023-10-16T13:49:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f508effd700 1 --2- 172.21.15.5:0/2271010126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cede0 0x7f509015f570 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5090161ae0 tx=0x7f5084009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aeb0af18e8c222a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f508e7fc700 1 -- 172.21.15.5:0/2271010126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084005c20 con 0x7f50900cede0 2023-10-16T13:49:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f508e7fc700 1 -- 172.21.15.5:0/2271010126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084005da0 con 0x7f50900cede0 2023-10-16T13:49:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f508e7fc700 1 -- 172.21.15.5:0/2271010126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084004270 con 0x7f50900cede0 2023-10-16T13:49:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 -- 172.21.15.5:0/2271010126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cede0 msgr2=0x7f509015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 --2- 172.21.15.5:0/2271010126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cede0 0x7f509015f570 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5090161ae0 tx=0x7f5084009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 -- 172.21.15.5:0/2271010126 shutdown_connections 2023-10-16T13:49:52.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 --2- 172.21.15.5:0/2271010126 >> v2:172.21.15.112:3300/0 conn(0x7f50900cd950 0x7f509015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 --2- 172.21.15.5:0/2271010126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cede0 0x7f509015f570 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 -- 172.21.15.5:0/2271010126 >> 172.21.15.5:0/2271010126 conn(0x7f509006dae0 msgr2=0x7f509006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 -- 172.21.15.5:0/2271010126 shutdown_connections 2023-10-16T13:49:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.894+0000 7f5095f5e700 1 -- 172.21.15.5:0/2271010126 wait complete. 2023-10-16T13:49:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.895+0000 7f5095f5e700 1 Processor -- start 2023-10-16T13:49:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 -- start start 2023-10-16T13:49:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f509006a840 0x7f50900b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 0x7f50901f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50900cede0 0x7f50901f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900b3d30 con 0x7f50900cd950 2023-10-16T13:49:52.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900b3120 con 0x7f50900cede0 2023-10-16T13:49:52.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.896+0000 7f5095f5e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900b3400 con 0x7f509006a840 2023-10-16T13:49:52.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 0x7f50901f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 0x7f50901f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51062/0 (socket says 172.21.15.5:51062) 2023-10-16T13:49:52.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 -- 172.21.15.5:0/3514163635 learned_addr learned my addr 172.21.15.5:0/3514163635 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:52.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508f7fe700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f509006a840 0x7f50900b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508ffff700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50900cede0 0x7f50901f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 -- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f509006a840 msgr2=0x7f50900b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f509006a840 0x7f50900b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 -- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50900cede0 msgr2=0x7f50901f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50900cede0 0x7f50901f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 -- 172.21.15.5:0/3514163635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084009500 con 0x7f50900cd950 2023-10-16T13:49:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f508effd700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 0x7f50901f67f0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f5084009c10 tx=0x7f5084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084003ab0 con 0x7f50900cd950 2023-10-16T13:49:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084003c10 con 0x7f50900cd950 2023-10-16T13:49:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50900b36e0 con 0x7f50900cd950 2023-10-16T13:49:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400b670 con 0x7f50900cd950 2023-10-16T13:49:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.897+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900cc6b0 con 0x7f50900cd950 2023-10-16T13:49:52.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.898+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5090067d20 con 0x7f50900cd950 2023-10-16T13:49:52.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.899+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5084020020 con 0x7f50900cd950 2023-10-16T13:49:52.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.899+0000 7f5077fff700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f507c06b2f0 0x7f507c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:52.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.899+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f508408ab90 con 0x7f50900cd950 2023-10-16T13:49:52.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.899+0000 7f508f7fe700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f507c06b2f0 0x7f507c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:52.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.900+0000 7f508f7fe700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f507c06b2f0 0x7f507c06d7b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50900b4b10 tx=0x7f5080008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:52.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:52.904+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5084055800 con 0x7f50900cd950 2023-10-16T13:49:53.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.149+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50900b3e70 con 0x7f50900cd950 2023-10-16T13:49:53.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.149+0000 7f5077fff700 1 -- 172.21.15.5:0/3514163635 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f5084028090 con 0x7f50900cd950 2023-10-16T13:49:53.152 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:53.153 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:49:34.794871+0000","modified":"2023-10-16T13:49:37.820862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8229":{"gid":8229,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2779373791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2779373791},{"type":"v1","addr":"172.21.15.112:6837","nonce":2779373791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-10-16T13:49:53.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f507c06b2f0 msgr2=0x7f507c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f507c06b2f0 0x7f507c06d7b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50900b4b10 tx=0x7f5080008040 comp rx=0 tx=0).stop 2023-10-16T13:49:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 msgr2=0x7f50901f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 0x7f50901f67f0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f5084009c10 tx=0x7f5084004750 comp rx=0 tx=0).stop 2023-10-16T13:49:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 shutdown_connections 2023-10-16T13:49:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50900cede0 0x7f50901f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f507c06b2f0 0x7f507c06d7b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f509006a840 0x7f50900b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 --2- 172.21.15.5:0/3514163635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50900cd950 0x7f50901f67f0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 >> 172.21.15.5:0/3514163635 conn(0x7f509006dae0 msgr2=0x7f50900b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:53.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 shutdown_connections 2023-10-16T13:49:53.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.151+0000 7f5095f5e700 1 -- 172.21.15.5:0/3514163635 wait complete. 2023-10-16T13:49:53.157 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 99 2023-10-16T13:49:53.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:49:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.288+0000 7f2618adf700 1 Processor -- start 2023-10-16T13:49:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.288+0000 7f2618adf700 1 -- start start 2023-10-16T13:49:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f2618adf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26140cd950 0x7f261415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f2618adf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f261406a840 0x7f261406ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f2618adf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26140cf290 con 0x7f26140cede0 2023-10-16T13:49:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f2618adf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26141619a0 con 0x7f26140cd950 2023-10-16T13:49:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f2618adf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261406b1b0 con 0x7f261406a840 2023-10-16T13:49:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f261259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26140cd950 0x7f261415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f261259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26140cd950 0x7f261415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51068/0 (socket says 172.21.15.5:51068) 2023-10-16T13:49:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f261259c700 1 -- 172.21.15.5:0/1991987019 learned_addr learned my addr 172.21.15.5:0/1991987019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.289+0000 7f2611d9b700 1 --1- 172.21.15.5:0/1991987019 >> v1:172.21.15.5:6789/0 conn(0x7f26140cede0 0x7f261415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32844/0 (socket says 172.21.15.5:32844) 2023-10-16T13:49:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f2612d9d700 1 --2- 172.21.15.5:0/1991987019 >> v2:172.21.15.112:3300/0 conn(0x7f261406a840 0x7f261406ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261259c700 1 -- 172.21.15.5:0/1991987019 >> v2:172.21.15.112:3300/0 conn(0x7f261406a840 msgr2=0x7f261406ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261259c700 1 --2- 172.21.15.5:0/1991987019 >> v2:172.21.15.112:3300/0 conn(0x7f261406a840 0x7f261406ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261259c700 1 -- 172.21.15.5:0/1991987019 >> v1:172.21.15.5:6789/0 conn(0x7f26140cede0 legacy=0x7f261415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261259c700 1 -- 172.21.15.5:0/1991987019 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140b2d60 con 0x7f26140cd950 2023-10-16T13:49:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261259c700 1 --2- 172.21.15.5:0/1991987019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cd950 0x7f261415e2f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f261415e830 tx=0x7f2608009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ed3bdaf237c94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261159a700 1 -- 172.21.15.5:0/1991987019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608004230 con 0x7f26140cd950 2023-10-16T13:49:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261159a700 1 -- 172.21.15.5:0/1991987019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608004390 con 0x7f26140cd950 2023-10-16T13:49:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.290+0000 7f261159a700 1 -- 172.21.15.5:0/1991987019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080036a0 con 0x7f26140cd950 2023-10-16T13:49:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 -- 172.21.15.5:0/1991987019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cd950 msgr2=0x7f261415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 --2- 172.21.15.5:0/1991987019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cd950 0x7f261415e2f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f261415e830 tx=0x7f2608009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 -- 172.21.15.5:0/1991987019 shutdown_connections 2023-10-16T13:49:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 --2- 172.21.15.5:0/1991987019 >> v2:172.21.15.112:3300/0 conn(0x7f261406a840 0x7f261406ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 --2- 172.21.15.5:0/1991987019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cd950 0x7f261415e2f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 -- 172.21.15.5:0/1991987019 >> 172.21.15.5:0/1991987019 conn(0x7f261406dae0 msgr2=0x7f261406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 -- 172.21.15.5:0/1991987019 shutdown_connections 2023-10-16T13:49:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.291+0000 7f2618adf700 1 -- 172.21.15.5:0/1991987019 wait complete. 2023-10-16T13:49:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.292+0000 7f2618adf700 1 Processor -- start 2023-10-16T13:49:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.292+0000 7f2618adf700 1 -- start start 2023-10-16T13:49:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2618adf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261406a840 0x7f26140ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2618adf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140cd950 0x7f261414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2618adf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 0x7f261414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2618adf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261414b3f0 con 0x7f26140cede0 2023-10-16T13:49:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2618adf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26140caeb0 con 0x7f261406a840 2023-10-16T13:49:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2618adf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140aef50 con 0x7f26140cd950 2023-10-16T13:49:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 0x7f261414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 0x7f261414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51078/0 (socket says 172.21.15.5:51078) 2023-10-16T13:49:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 -- 172.21.15.5:0/2170207290 learned_addr learned my addr 172.21.15.5:0/2170207290 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f261259c700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261406a840 0x7f26140ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2611d9b700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140cd950 0x7f261414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 -- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140cd950 msgr2=0x7f261414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140cd950 0x7f261414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 -- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261406a840 msgr2=0x7f26140ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261406a840 0x7f26140ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2612d9d700 1 -- 172.21.15.5:0/2170207290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608009550 con 0x7f26140cede0 2023-10-16T13:49:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f261259c700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261406a840 0x7f26140ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.293+0000 7f2611d9b700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140cd950 0x7f261414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.294+0000 7f2612d9d700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 0x7f261414dc50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f260c007e40 tx=0x7f260c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.294+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00eea0 con 0x7f26140cede0 2023-10-16T13:49:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.294+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c014420 con 0x7f26140cede0 2023-10-16T13:49:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.294+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26140af230 con 0x7f26140cede0 2023-10-16T13:49:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.294+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0147b0 con 0x7f26140cede0 2023-10-16T13:49:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.294+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26140af7f0 con 0x7f26140cede0 2023-10-16T13:49:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.295+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26140cb060 con 0x7f26140cede0 2023-10-16T13:49:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.296+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f260c014910 con 0x7f26140cede0 2023-10-16T13:49:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.296+0000 7f2602ffd700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406b2f0 0x7f25f406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.296+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f260c08b100 con 0x7f26140cede0 2023-10-16T13:49:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.296+0000 7f261259c700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406b2f0 0x7f25f406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.297+0000 7f261259c700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406b2f0 0x7f25f406d7b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2608009130 tx=0x7f2608008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.300+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f260c055d60 con 0x7f26140cede0 2023-10-16T13:49:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.547+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26140cb020 con 0x7f26140cede0 2023-10-16T13:49:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.548+0000 7f2602ffd700 1 -- 172.21.15.5:0/2170207290 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f260c059380 con 0x7f26140cede0 2023-10-16T13:49:53.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:53.551 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:49:34.794871+0000","modified":"2023-10-16T13:49:37.820862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8229":{"gid":8229,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2779373791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2779373791},{"type":"v1","addr":"172.21.15.112:6837","nonce":2779373791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-10-16T13:49:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406b2f0 msgr2=0x7f25f406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406b2f0 0x7f25f406d7b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2608009130 tx=0x7f2608008030 comp rx=0 tx=0).stop 2023-10-16T13:49:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 msgr2=0x7f261414dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 0x7f261414dc50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f260c007e40 tx=0x7f260c00e3c0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 shutdown_connections 2023-10-16T13:49:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26140cede0 0x7f261414dc50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f261406a840 0x7f26140ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f25f406b2f0 0x7f25f406d7b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 --2- 172.21.15.5:0/2170207290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26140cd950 0x7f261414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 >> 172.21.15.5:0/2170207290 conn(0x7f261406dae0 msgr2=0x7f2614161150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 shutdown_connections 2023-10-16T13:49:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.550+0000 7f2618adf700 1 -- 172.21.15.5:0/2170207290 wait complete. 2023-10-16T13:49:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 99 2023-10-16T13:49:53.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:49:53.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.689+0000 7f4c33323700 1 Processor -- start 2023-10-16T13:49:53.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.689+0000 7f4c33323700 1 -- start start 2023-10-16T13:49:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c33323700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0cd950 0x7f4c2c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c33323700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c2c06a840 0x7f4c2c06ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c33323700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c0cf290 con 0x7f4c2c0cede0 2023-10-16T13:49:53.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c33323700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c1619a0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c33323700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c06b1b0 con 0x7f4c2c06a840 2023-10-16T13:49:53.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0cd950 0x7f4c2c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c2c0cd950 0x7f4c2c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51082/0 (socket says 172.21.15.5:51082) 2023-10-16T13:49:53.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 -- 172.21.15.5:0/714467717 learned_addr learned my addr 172.21.15.5:0/714467717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c318c0700 1 --2- 172.21.15.5:0/714467717 >> v2:172.21.15.112:3300/0 conn(0x7f4c2c06a840 0x7f4c2c06ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 -- 172.21.15.5:0/714467717 >> v2:172.21.15.112:3300/0 conn(0x7f4c2c06a840 msgr2=0x7f4c2c06ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 --2- 172.21.15.5:0/714467717 >> v2:172.21.15.112:3300/0 conn(0x7f4c2c06a840 0x7f4c2c06ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 -- 172.21.15.5:0/714467717 >> v1:172.21.15.112:6789/0 conn(0x7f4c2c0cede0 legacy=0x7f4c2c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:53.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 -- 172.21.15.5:0/714467717 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0b2d60 con 0x7f4c2c0cd950 2023-10-16T13:49:53.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c310bf700 1 --2- 172.21.15.5:0/714467717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c15e2f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c15e830 tx=0x7f4c28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c40e97ea2610fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:53.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c23fff700 1 -- 172.21.15.5:0/714467717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28004230 con 0x7f4c2c0cd950 2023-10-16T13:49:53.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.690+0000 7f4c23fff700 1 -- 172.21.15.5:0/714467717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28004390 con 0x7f4c2c0cd950 2023-10-16T13:49:53.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c23fff700 1 -- 172.21.15.5:0/714467717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c280036a0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 -- 172.21.15.5:0/714467717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 msgr2=0x7f4c2c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 --2- 172.21.15.5:0/714467717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c15e2f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c15e830 tx=0x7f4c28009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 -- 172.21.15.5:0/714467717 shutdown_connections 2023-10-16T13:49:53.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 --2- 172.21.15.5:0/714467717 >> v2:172.21.15.112:3300/0 conn(0x7f4c2c06a840 0x7f4c2c06ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 --2- 172.21.15.5:0/714467717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c15e2f0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 -- 172.21.15.5:0/714467717 >> 172.21.15.5:0/714467717 conn(0x7f4c2c06dae0 msgr2=0x7f4c2c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:53.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 -- 172.21.15.5:0/714467717 shutdown_connections 2023-10-16T13:49:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.691+0000 7f4c33323700 1 -- 172.21.15.5:0/714467717 wait complete. 2023-10-16T13:49:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.692+0000 7f4c33323700 1 Processor -- start 2023-10-16T13:49:53.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.692+0000 7f4c33323700 1 -- start start 2023-10-16T13:49:53.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c33323700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c2c06a840 0x7f4c2c15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c33323700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c33323700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0cede0 0x7f4c2c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c33323700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c15c4b0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c33323700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0c87d0 con 0x7f4c2c0cede0 2023-10-16T13:49:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c33323700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0c8ab0 con 0x7f4c2c06a840 2023-10-16T13:49:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c308be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c308be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51090/0 (socket says 172.21.15.5:51090) 2023-10-16T13:49:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c308be700 1 -- 172.21.15.5:0/2127134468 learned_addr learned my addr 172.21.15.5:0/2127134468 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c318c0700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0cede0 0x7f4c2c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.693+0000 7f4c310bf700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c2c06a840 0x7f4c2c15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c308be700 1 -- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c2c06a840 msgr2=0x7f4c2c15bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c308be700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c2c06a840 0x7f4c2c15bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c308be700 1 -- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0cede0 msgr2=0x7f4c2c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c308be700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0cede0 0x7f4c2c0c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c308be700 1 -- 172.21.15.5:0/2127134468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28009550 con 0x7f4c2c0cd950 2023-10-16T13:49:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c310bf700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c2c06a840 0x7f4c2c15bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c308be700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c0b5920 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00b450 tx=0x7f4c1c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c004020 con 0x7f4c2c0cd950 2023-10-16T13:49:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c004180 con 0x7f4c2c0cd950 2023-10-16T13:49:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c004530 con 0x7f4c2c0cd950 2023-10-16T13:49:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c0c8d90 con 0x7f4c2c0cd950 2023-10-16T13:49:53.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.694+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c0c9350 con 0x7f4c2c0cd950 2023-10-16T13:49:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.695+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c067d20 con 0x7f4c2c0cd950 2023-10-16T13:49:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.696+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f4c1c0036d0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.696+0000 7f4c21ffb700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c1006b2f0 0x7f4c1006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.696+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c1c0894f0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.696+0000 7f4c310bf700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c1006b2f0 0x7f4c1006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.697+0000 7f4c310bf700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c1006b2f0 0x7f4c1006d7b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009130 tx=0x7f4c28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.701+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c1c053fc0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.906+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c2c0b2100 con 0x7f4c2c0cd950 2023-10-16T13:49:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.907+0000 7f4c21ffb700 1 -- 172.21.15.5:0/2127134468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16507 (secure 0 0 0) 0x7f4c1c0575e0 con 0x7f4c2c0cd950 2023-10-16T13:49:53.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:53.910 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":135,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:36.376754+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:49:33.286763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-16T13:49:33.761808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:49:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c1006b2f0 msgr2=0x7f4c1006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c1006b2f0 0x7f4c1006d7b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009130 tx=0x7f4c28008030 comp rx=0 tx=0).stop 2023-10-16T13:49:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 msgr2=0x7f4c2c0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c0b5920 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00b450 tx=0x7f4c1c00b760 comp rx=0 tx=0).stop 2023-10-16T13:49:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 shutdown_connections 2023-10-16T13:49:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0cede0 0x7f4c2c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f4c1006b2f0 0x7f4c1006d7b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c2c06a840 0x7f4c2c15bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 --2- 172.21.15.5:0/2127134468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c2c0cd950 0x7f4c2c0b5920 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 >> 172.21.15.5:0/2127134468 conn(0x7f4c2c06dae0 msgr2=0x7f4c2c0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 shutdown_connections 2023-10-16T13:49:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:53.909+0000 7f4c33323700 1 -- 172.21.15.5:0/2127134468 wait complete. 2023-10-16T13:49:53.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T13:49:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.047+0000 7f7c6df9c700 1 Processor -- start 2023-10-16T13:49:54.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.047+0000 7f7c6df9c700 1 -- start start 2023-10-16T13:49:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.048+0000 7f7c6df9c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7c680cc3f0 0x7f7c680cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.048+0000 7f7c6df9c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c68071ab0 con 0x7f7c6806af50 2023-10-16T13:49:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.048+0000 7f7c6df9c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c68161bc0 con 0x7f7c68161670 2023-10-16T13:49:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.048+0000 7f7c6df9c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c68161ea0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.048+0000 7f7c67fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c6806af50 0x7f7c68071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32872/0 (socket says 172.21.15.5:32872) 2023-10-16T13:49:54.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.048+0000 7f7c67fff700 1 -- 172.21.15.5:0/3415067543 learned_addr learned my addr 172.21.15.5:0/3415067543 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c677fe700 1 --2- 172.21.15.5:0/3415067543 >> v2:172.21.15.112:3300/0 conn(0x7f7c680cc3f0 0x7f7c680cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c667fc700 1 -- 172.21.15.5:0/3415067543 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79397202 0 0) 0x7f7c68071ab0 con 0x7f7c6806af50 2023-10-16T13:49:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c667fc700 1 -- 172.21.15.5:0/3415067543 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c540035b0 con 0x7f7c6806af50 2023-10-16T13:49:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c667fc700 1 -- 172.21.15.5:0/3415067543 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59582613 0 0) 0x7f7c540035b0 con 0x7f7c6806af50 2023-10-16T13:49:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c677fe700 1 -- 172.21.15.5:0/3415067543 >> v1:172.21.15.112:6789/0 conn(0x7f7c68161670 legacy=0x7f7c6806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c677fe700 1 -- 172.21.15.5:0/3415067543 >> v1:172.21.15.5:6789/0 conn(0x7f7c6806af50 legacy=0x7f7c68071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c677fe700 1 -- 172.21.15.5:0/3415067543 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68162180 con 0x7f7c680cc3f0 2023-10-16T13:49:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c677fe700 1 --2- 172.21.15.5:0/3415067543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c680cc3f0 0x7f7c680cc7d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009840 tx=0x7f7c50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7ffa53181985ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c667fc700 1 -- 172.21.15.5:0/3415067543 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600019f0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c667fc700 1 -- 172.21.15.5:0/3415067543 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50004030 con 0x7f7c680cc3f0 2023-10-16T13:49:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.049+0000 7f7c667fc700 1 -- 172.21.15.5:0/3415067543 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500043a0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3415067543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c680cc3f0 msgr2=0x7f7c680cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3415067543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c680cc3f0 0x7f7c680cc7d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009840 tx=0x7f7c50009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3415067543 shutdown_connections 2023-10-16T13:49:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3415067543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c680cc3f0 0x7f7c680cc7d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3415067543 >> 172.21.15.5:0/3415067543 conn(0x7f7c6806dac0 msgr2=0x7f7c6806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3415067543 shutdown_connections 2023-10-16T13:49:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.050+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3415067543 wait complete. 2023-10-16T13:49:54.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.051+0000 7f7c6df9c700 1 Processor -- start 2023-10-16T13:49:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.051+0000 7f7c6df9c700 1 -- start start 2023-10-16T13:49:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c6df9c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c6806af50 0x7f7c680c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c6df9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 0x7f7c680aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c6df9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c68161670 0x7f7c68147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c6df9c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680c5c60 con 0x7f7c680cc3f0 2023-10-16T13:49:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c6df9c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680af440 con 0x7f7c68161670 2023-10-16T13:49:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c6df9c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680aea70 con 0x7f7c6806af50 2023-10-16T13:49:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 0x7f7c680aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 0x7f7c680aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51106/0 (socket says 172.21.15.5:51106) 2023-10-16T13:49:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.052+0000 7f7c66ffd700 1 -- 172.21.15.5:0/3511360932 learned_addr learned my addr 172.21.15.5:0/3511360932 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c677fe700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c6806af50 0x7f7c680c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c67fff700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c68161670 0x7f7c68147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c66ffd700 1 -- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c6806af50 msgr2=0x7f7c680c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c66ffd700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c6806af50 0x7f7c680c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c66ffd700 1 -- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c68161670 msgr2=0x7f7c68147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c66ffd700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c68161670 0x7f7c68147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c66ffd700 1 -- 172.21.15.5:0/3511360932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500094a0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c677fe700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c6806af50 0x7f7c680c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c67fff700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c68161670 0x7f7c68147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c66ffd700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 0x7f7c680aef00 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c760 tx=0x7f7c5800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c580054e0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58003680 con 0x7f7c680cc3f0 2023-10-16T13:49:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6814b0a0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58003a10 con 0x7f7c680cc3f0 2023-10-16T13:49:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.053+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c680ae420 con 0x7f7c680cc3f0 2023-10-16T13:49:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.054+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c680aec20 con 0x7f7c680cc3f0 2023-10-16T13:49:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.055+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f7c58003b70 con 0x7f7c680cc3f0 2023-10-16T13:49:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.055+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c4806b2f0 0x7f7c4806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.055+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c58089230 con 0x7f7c680cc3f0 2023-10-16T13:49:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.055+0000 7f7c677fe700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c4806b2f0 0x7f7c4806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.056+0000 7f7c677fe700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c4806b2f0 0x7f7c4806d7b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000a010 tx=0x7f7c50008000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:54.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.060+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c680aec20 con 0x7f7c680cc3f0 2023-10-16T13:49:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.304+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7c680aebe0 con 0x7f7c680cc3f0 2023-10-16T13:49:54.308 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-10-16T13:49:54.305+0000 7f5783c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T13:49:54.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.306+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3511360932 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7c58017090 con 0x7f7c680cc3f0 2023-10-16T13:49:54.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.308+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c4806b2f0 msgr2=0x7f7c4806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.308+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c4806b2f0 0x7f7c4806d7b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000a010 tx=0x7f7c50008000 comp rx=0 tx=0).stop 2023-10-16T13:49:54.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.308+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 msgr2=0x7f7c680aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.308+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 0x7f7c680aef00 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c760 tx=0x7f7c5800cb20 comp rx=0 tx=0).stop 2023-10-16T13:49:54.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 shutdown_connections 2023-10-16T13:49:54.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c68161670 0x7f7c68147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f7c4806b2f0 0x7f7c4806d7b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c6806af50 0x7f7c680c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 --2- 172.21.15.5:0/3511360932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c680cc3f0 0x7f7c680aef00 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 >> 172.21.15.5:0/3511360932 conn(0x7f7c6806dac0 msgr2=0x7f7c680b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 shutdown_connections 2023-10-16T13:49:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.309+0000 7f7c6df9c700 1 -- 172.21.15.5:0/3511360932 wait complete. 2023-10-16T13:49:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T13:49:54.316 INFO:tasks.ceph.mds.d.smithi112.stderr: -3263> 2023-10-16T13:49:37.359+0000 7fc10dd77700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:49:54.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T13:49:54.344 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2023-10-16T13:49:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.448+0000 7f5fdec98700 1 Processor -- start 2023-10-16T13:49:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.448+0000 7f5fdec98700 1 -- start start 2023-10-16T13:49:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdec98700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fd80cd950 0x7f5fd815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdec98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd80cede0 0x7f5fd815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdec98700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd80cf260 con 0x7f5fd806a840 2023-10-16T13:49:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdec98700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd81619a0 con 0x7f5fd80cd950 2023-10-16T13:49:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdec98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80b2d60 con 0x7f5fd80cede0 2023-10-16T13:49:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdca34700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fd80cd950 0x7f5fd815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdd235700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5fd806a840 0x7f5fd8161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32886/0 (socket says 172.21.15.5:32886) 2023-10-16T13:49:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fdd235700 1 -- 172.21.15.5:0/4278829369 learned_addr learned my addr 172.21.15.5:0/4278829369 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.449+0000 7f5fd7fff700 1 --2- 172.21.15.5:0/4278829369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd80cede0 0x7f5fd815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdca34700 1 -- 172.21.15.5:0/4278829369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd80cede0 msgr2=0x7f5fd815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdca34700 1 --2- 172.21.15.5:0/4278829369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd80cede0 0x7f5fd815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdca34700 1 -- 172.21.15.5:0/4278829369 >> v1:172.21.15.5:6789/0 conn(0x7f5fd806a840 legacy=0x7f5fd8161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fd77fe700 1 -- 172.21.15.5:0/4278829369 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855990010 0 0) 0x7f5fd80cf260 con 0x7f5fd806a840 2023-10-16T13:49:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdca34700 1 -- 172.21.15.5:0/4278829369 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80cdd30 con 0x7f5fd80cd950 2023-10-16T13:49:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdca34700 1 --2- 172.21.15.5:0/4278829369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cd950 0x7f5fd815e2f0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009840 tx=0x7f5fcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f19a19e7b3e7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fd77fe700 1 -- 172.21.15.5:0/4278829369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc011830 con 0x7f5fd80cd950 2023-10-16T13:49:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fd77fe700 1 -- 172.21.15.5:0/4278829369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc011990 con 0x7f5fd80cd950 2023-10-16T13:49:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fd77fe700 1 -- 172.21.15.5:0/4278829369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc011d20 con 0x7f5fd80cd950 2023-10-16T13:49:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdec98700 1 -- 172.21.15.5:0/4278829369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cd950 msgr2=0x7f5fd815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.450+0000 7f5fdec98700 1 --2- 172.21.15.5:0/4278829369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cd950 0x7f5fd815e2f0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009840 tx=0x7f5fcc009b50 comp rx=0 tx=0).stop 2023-10-16T13:49:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.451+0000 7f5fdec98700 1 -- 172.21.15.5:0/4278829369 shutdown_connections 2023-10-16T13:49:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.451+0000 7f5fdec98700 1 --2- 172.21.15.5:0/4278829369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cd950 0x7f5fd815e2f0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.451+0000 7f5fdec98700 1 --2- 172.21.15.5:0/4278829369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd80cede0 0x7f5fd815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.451+0000 7f5fdec98700 1 -- 172.21.15.5:0/4278829369 >> 172.21.15.5:0/4278829369 conn(0x7f5fd806dae0 msgr2=0x7f5fd806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.451+0000 7f5fdec98700 1 -- 172.21.15.5:0/4278829369 shutdown_connections 2023-10-16T13:49:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.451+0000 7f5fdec98700 1 -- 172.21.15.5:0/4278829369 wait complete. 2023-10-16T13:49:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.452+0000 7f5fdec98700 1 Processor -- start 2023-10-16T13:49:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.452+0000 7f5fdec98700 1 -- start start 2023-10-16T13:49:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd806a840 0x7f5fd80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80cd950 0x7f5fd815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 0x7f5fd815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd81547b0 con 0x7f5fd80cede0 2023-10-16T13:49:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd815bf60 con 0x7f5fd80cd950 2023-10-16T13:49:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd815c240 con 0x7f5fd806a840 2023-10-16T13:49:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 0x7f5fd815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 0x7f5fd815b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51120/0 (socket says 172.21.15.5:51120) 2023-10-16T13:49:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 -- 172.21.15.5:0/2186239985 learned_addr learned my addr 172.21.15.5:0/2186239985 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdca34700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd806a840 0x7f5fd80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fd7fff700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80cd950 0x7f5fd815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 -- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd806a840 msgr2=0x7f5fd80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd806a840 0x7f5fd80ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 -- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80cd950 msgr2=0x7f5fd815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80cd950 0x7f5fd815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 -- 172.21.15.5:0/2186239985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0094a0 con 0x7f5fd80cede0 2023-10-16T13:49:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdca34700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd806a840 0x7f5fd80ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:54.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdd235700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 0x7f5fd815b8e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0002230 tx=0x7f5fd000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:54.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000ac20 con 0x7f5fd80cede0 2023-10-16T13:49:54.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd000ada0 con 0x7f5fd80cede0 2023-10-16T13:49:54.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd815c520 con 0x7f5fd80cede0 2023-10-16T13:49:54.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.453+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0007310 con 0x7f5fd80cede0 2023-10-16T13:49:54.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.454+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd815cae0 con 0x7f5fd80cede0 2023-10-16T13:49:54.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.454+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd8067d20 con 0x7f5fd80cede0 2023-10-16T13:49:54.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.455+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5fd0007470 con 0x7f5fd80cede0 2023-10-16T13:49:54.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.455+0000 7f5fd57fa700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fbc06b2f0 0x7f5fbc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:54.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.455+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5fd0089c70 con 0x7f5fd80cede0 2023-10-16T13:49:54.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.456+0000 7f5fdca34700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fbc06b2f0 0x7f5fbc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.456+0000 7f5fdca34700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fbc06b2f0 0x7f5fbc06d7b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc000c00 tx=0x7f5fcc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.460+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fd00546e0 con 0x7f5fd80cede0 2023-10-16T13:49:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:54.711+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5fd80b2630 con 0x7f5fd80cede0 2023-10-16T13:49:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.308+0000 7f5fd57fa700 1 -- 172.21.15.5:0/2186239985 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v101) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5fd00180a0 con 0x7f5fd80cede0 2023-10-16T13:49:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fbc06b2f0 msgr2=0x7f5fbc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fbc06b2f0 0x7f5fbc06d7b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc000c00 tx=0x7f5fcc008030 comp rx=0 tx=0).stop 2023-10-16T13:49:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 msgr2=0x7f5fd815b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 0x7f5fd815b8e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0002230 tx=0x7f5fd000a060 comp rx=0 tx=0).stop 2023-10-16T13:49:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 shutdown_connections 2023-10-16T13:49:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd80cede0 0x7f5fd815b8e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5fbc06b2f0 0x7f5fbc06d7b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fd806a840 0x7f5fd80ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 --2- 172.21.15.5:0/2186239985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80cd950 0x7f5fd815b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 >> 172.21.15.5:0/2186239985 conn(0x7f5fd806dae0 msgr2=0x7f5fd80b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 shutdown_connections 2023-10-16T13:49:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.311+0000 7f5fdec98700 1 -- 172.21.15.5:0/2186239985 wait complete. 2023-10-16T13:49:55.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T13:49:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.462+0000 7f831fcc8700 1 Processor -- start 2023-10-16T13:49:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.462+0000 7f831fcc8700 1 -- start start 2023-10-16T13:49:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831fcc8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83180cdf10 0x7f83180d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831fcc8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83180b0730 0x7f83180ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831fcc8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180cbdb0 con 0x7f831806bd80 2023-10-16T13:49:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831fcc8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180ce830 con 0x7f83180b0730 2023-10-16T13:49:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831fcc8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180d0b40 con 0x7f83180cdf10 2023-10-16T13:49:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831d263700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83180b0730 0x7f83180ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831d263700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83180b0730 0x7f83180ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51124/0 (socket says 172.21.15.5:51124) 2023-10-16T13:49:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.463+0000 7f831d263700 1 -- 172.21.15.5:0/3758906763 learned_addr learned my addr 172.21.15.5:0/3758906763 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831da64700 1 --2- 172.21.15.5:0/3758906763 >> v2:172.21.15.112:3300/0 conn(0x7f83180cdf10 0x7f83180d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831d263700 1 -- 172.21.15.5:0/3758906763 >> v2:172.21.15.112:3300/0 conn(0x7f83180cdf10 msgr2=0x7f83180d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831d263700 1 --2- 172.21.15.5:0/3758906763 >> v2:172.21.15.112:3300/0 conn(0x7f83180cdf10 0x7f83180d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831d263700 1 -- 172.21.15.5:0/3758906763 >> v1:172.21.15.112:6789/0 conn(0x7f831806bd80 legacy=0x7f831806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831d263700 1 -- 172.21.15.5:0/3758906763 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180d0e20 con 0x7f83180b0730 2023-10-16T13:49:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831d263700 1 --2- 172.21.15.5:0/3758906763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180ce2f0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f831806b7d0 tx=0x7f8314009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b903f28080e38a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831ca62700 1 -- 172.21.15.5:0/3758906763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314004230 con 0x7f83180b0730 2023-10-16T13:49:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831ca62700 1 -- 172.21.15.5:0/3758906763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314004390 con 0x7f83180b0730 2023-10-16T13:49:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.464+0000 7f831ca62700 1 -- 172.21.15.5:0/3758906763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140036a0 con 0x7f83180b0730 2023-10-16T13:49:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 -- 172.21.15.5:0/3758906763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 msgr2=0x7f83180ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 --2- 172.21.15.5:0/3758906763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180ce2f0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f831806b7d0 tx=0x7f8314009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 -- 172.21.15.5:0/3758906763 shutdown_connections 2023-10-16T13:49:55.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 --2- 172.21.15.5:0/3758906763 >> v2:172.21.15.112:3300/0 conn(0x7f83180cdf10 0x7f83180d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 --2- 172.21.15.5:0/3758906763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180ce2f0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 -- 172.21.15.5:0/3758906763 >> 172.21.15.5:0/3758906763 conn(0x7f83180d1530 msgr2=0x7f83180d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:55.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 -- 172.21.15.5:0/3758906763 shutdown_connections 2023-10-16T13:49:55.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.465+0000 7f831fcc8700 1 -- 172.21.15.5:0/3758906763 wait complete. 2023-10-16T13:49:55.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.466+0000 7f831fcc8700 1 Processor -- start 2023-10-16T13:49:55.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.466+0000 7f831fcc8700 1 -- start start 2023-10-16T13:49:55.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831fcc8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831806bd80 0x7f83181f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:55.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831fcc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:55.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831fcc8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f83180cdf10 0x7f83180b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831fcc8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815ce10 con 0x7f83180b0730 2023-10-16T13:49:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831fcc8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815c540 con 0x7f831806bd80 2023-10-16T13:49:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831fcc8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c7d40 con 0x7f83180cdf10 2023-10-16T13:49:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51130/0 (socket says 172.21.15.5:51130) 2023-10-16T13:49:55.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 -- 172.21.15.5:0/1054174890 learned_addr learned my addr 172.21.15.5:0/1054174890 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:55.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831da64700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831806bd80 0x7f83181f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:55.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831e265700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f83180cdf10 0x7f83180b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:55.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 -- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f83180cdf10 msgr2=0x7f83180b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f83180cdf10 0x7f83180b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 -- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831806bd80 msgr2=0x7f83181f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831806bd80 0x7f83181f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 -- 172.21.15.5:0/1054174890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314009550 con 0x7f83180b0730 2023-10-16T13:49:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831da64700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831806bd80 0x7f83181f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f831d263700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180b60d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8314009c10 tx=0x7f8314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314003d80 con 0x7f83180b0730 2023-10-16T13:49:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831401f070 con 0x7f83180b0730 2023-10-16T13:49:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.467+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011870 con 0x7f83180b0730 2023-10-16T13:49:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.468+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831815c7c0 con 0x7f83180b0730 2023-10-16T13:49:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.468+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83181f3060 con 0x7f83180b0730 2023-10-16T13:49:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.468+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318067d20 con 0x7f83180b0730 2023-10-16T13:49:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.469+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f8314021030 con 0x7f83180b0730 2023-10-16T13:49:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.469+0000 7f830e7fc700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82fc06b2f0 0x7f82fc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.469+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f831408b320 con 0x7f83180b0730 2023-10-16T13:49:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.470+0000 7f831da64700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82fc06b2f0 0x7f82fc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.470+0000 7f831da64700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82fc06b2f0 0x7f82fc06d7b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f83181f6720 tx=0x7f8308008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.474+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8314056050 con 0x7f83180b0730 2023-10-16T13:49:55.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:55.675+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f83180cd2b0 con 0x7f83180b0730 2023-10-16T13:49:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.317+0000 7f830e7fc700 1 -- 172.21.15.5:0/1054174890 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8314059670 con 0x7f83180b0730 2023-10-16T13:49:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82fc06b2f0 msgr2=0x7f82fc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82fc06b2f0 0x7f82fc06d7b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f83181f6720 tx=0x7f8308008040 comp rx=0 tx=0).stop 2023-10-16T13:49:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 msgr2=0x7f83180b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180b60d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8314009c10 tx=0x7f8314004750 comp rx=0 tx=0).stop 2023-10-16T13:49:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 shutdown_connections 2023-10-16T13:49:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f82fc06b2f0 0x7f82fc06d7b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f83180cdf10 0x7f83180b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831806bd80 0x7f83181f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 --2- 172.21.15.5:0/1054174890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83180b0730 0x7f83180b60d0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 >> 172.21.15.5:0/1054174890 conn(0x7f83180d1530 msgr2=0x7f83180cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.321+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 shutdown_connections 2023-10-16T13:49:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.322+0000 7f831fcc8700 1 -- 172.21.15.5:0/1054174890 wait complete. 2023-10-16T13:49:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-16T13:49:56.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T13:49:56.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.476+0000 7f580d4b9700 1 Processor -- start 2023-10-16T13:49:56.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.476+0000 7f580d4b9700 1 -- start start 2023-10-16T13:49:56.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f580d4b9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58080d2250 0x7f58080b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f580d4b9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815d940 0x7f580815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f580d4b9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080b6190 con 0x7f58080d1760 2023-10-16T13:49:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f580d4b9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080cf6c0 con 0x7f58080d2250 2023-10-16T13:49:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f580d4b9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580815e2f0 con 0x7f580815d940 2023-10-16T13:49:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58080d2250 0x7f58080b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58080d2250 0x7f58080b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51138/0 (socket says 172.21.15.5:51138) 2023-10-16T13:49:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 -- 172.21.15.5:0/518838055 learned_addr learned my addr 172.21.15.5:0/518838055 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58077fe700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815d940 0x7f580815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 -- 172.21.15.5:0/518838055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815d940 msgr2=0x7f580815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815d940 0x7f580815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 -- 172.21.15.5:0/518838055 >> v1:172.21.15.112:6789/0 conn(0x7f58080d1760 legacy=0x7f58080d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 -- 172.21.15.5:0/518838055 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080b58f0 con 0x7f58080d2250 2023-10-16T13:49:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58077fe700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815d940 0x7f580815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f58067fc700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080d2250 0x7f58080b4890 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0098f0 tx=0x7f57fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04952a1da7d38c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f5805ffb700 1 -- 172.21.15.5:0/518838055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00b8a0 con 0x7f58080d2250 2023-10-16T13:49:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f5805ffb700 1 -- 172.21.15.5:0/518838055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00ba00 con 0x7f58080d2250 2023-10-16T13:49:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.477+0000 7f5805ffb700 1 -- 172.21.15.5:0/518838055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00bd90 con 0x7f58080d2250 2023-10-16T13:49:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 -- 172.21.15.5:0/518838055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080d2250 msgr2=0x7f58080b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080d2250 0x7f58080b4890 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0098f0 tx=0x7f57fc009c00 comp rx=0 tx=0).stop 2023-10-16T13:49:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 -- 172.21.15.5:0/518838055 shutdown_connections 2023-10-16T13:49:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580815d940 0x7f580815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 --2- 172.21.15.5:0/518838055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58080d2250 0x7f58080b4890 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 -- 172.21.15.5:0/518838055 >> 172.21.15.5:0/518838055 conn(0x7f58080d37a0 msgr2=0x7f58080d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 -- 172.21.15.5:0/518838055 shutdown_connections 2023-10-16T13:49:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.478+0000 7f580d4b9700 1 -- 172.21.15.5:0/518838055 wait complete. 2023-10-16T13:49:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.479+0000 7f580d4b9700 1 Processor -- start 2023-10-16T13:49:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.479+0000 7f580d4b9700 1 -- start start 2023-10-16T13:49:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f580d4b9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58080d1760 0x7f58080b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f580d4b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080d2250 0x7f5808161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:56.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f580d4b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 0x7f5808155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:56.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f580d4b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cb8a0 con 0x7f580815d940 2023-10-16T13:49:56.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f580d4b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b7090 con 0x7f58080d2250 2023-10-16T13:49:56.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f580d4b9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b7370 con 0x7f58080d1760 2023-10-16T13:49:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 0x7f5808155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 0x7f5808155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51146/0 (socket says 172.21.15.5:51146) 2023-10-16T13:49:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 -- 172.21.15.5:0/64531222 learned_addr learned my addr 172.21.15.5:0/64531222 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58067fc700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080d2250 0x7f5808161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f5806ffd700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58080d1760 0x7f58080b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 -- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58080d1760 msgr2=0x7f58080b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58080d1760 0x7f58080b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 -- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080d2250 msgr2=0x7f5808161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080d2250 0x7f5808161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.480+0000 7f58077fe700 1 -- 172.21.15.5:0/64531222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc009550 con 0x7f580815d940 2023-10-16T13:49:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.481+0000 7f58077fe700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 0x7f5808155930 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f5800007df0 tx=0x7f580000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.481+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000ddd0 con 0x7f580815d940 2023-10-16T13:49:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.481+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580000f040 con 0x7f580815d940 2023-10-16T13:49:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.481+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080cbaf0 con 0x7f580815d940 2023-10-16T13:49:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.481+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800003c60 con 0x7f580815d940 2023-10-16T13:49:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.481+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5808161670 con 0x7f580815d940 2023-10-16T13:49:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.482+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080cc010 con 0x7f580815d940 2023-10-16T13:49:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.483+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5800004030 con 0x7f580815d940 2023-10-16T13:49:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.483+0000 7f57ef7fe700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57f406b2f0 0x7f57f406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.483+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f5800089fb0 con 0x7f580815d940 2023-10-16T13:49:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.483+0000 7f5806ffd700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57f406b2f0 0x7f57f406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:56.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.484+0000 7f5806ffd700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57f406b2f0 0x7f57f406d7b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000fb0 tx=0x7f57f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:56.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.487+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5800054c90 con 0x7f580815d940 2023-10-16T13:49:56.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:56.688+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58080cc010 con 0x7f580815d940 2023-10-16T13:49:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.319+0000 7f57ef7fe700 1 -- 172.21.15.5:0/64531222 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) v1 ==== 169+0+0 (secure 0 0 0) 0x7f58080cc010 con 0x7f580815d940 2023-10-16T13:49:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.322+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57f406b2f0 msgr2=0x7f57f406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.322+0000 7f580d4b9700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57f406b2f0 0x7f57f406d7b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000fb0 tx=0x7f57f8009040 comp rx=0 tx=0).stop 2023-10-16T13:49:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.322+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 msgr2=0x7f5808155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.322+0000 7f580d4b9700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 0x7f5808155930 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f5800007df0 tx=0x7f580000d3b0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 shutdown_connections 2023-10-16T13:49:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580815d940 0x7f5808155930 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57f406b2f0 0x7f57f406d7b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58080d1760 0x7f58080b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 --2- 172.21.15.5:0/64531222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58080d2250 0x7f5808161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 >> 172.21.15.5:0/64531222 conn(0x7f58080d37a0 msgr2=0x7f58080c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 shutdown_connections 2023-10-16T13:49:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.323+0000 7f580d4b9700 1 -- 172.21.15.5:0/64531222 wait complete. 2023-10-16T13:49:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-16T13:49:57.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-16T13:49:57.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.477+0000 7f0638d7d700 1 Processor -- start 2023-10-16T13:49:57.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.477+0000 7f0638d7d700 1 -- start start 2023-10-16T13:49:57.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0638d7d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06340cd950 0x7f063415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0638d7d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06340cede0 0x7f063415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0638d7d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340cf290 con 0x7f063406a840 2023-10-16T13:49:57.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0638d7d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06341619a0 con 0x7f06340cd950 2023-10-16T13:49:57.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0638d7d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340b2d60 con 0x7f06340cede0 2023-10-16T13:49:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f063259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06340cd950 0x7f063415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0632d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f063406a840 0x7f0634161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32924/0 (socket says 172.21.15.5:32924) 2023-10-16T13:49:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.478+0000 7f0632d9d700 1 -- 172.21.15.5:0/212470701 learned_addr learned my addr 172.21.15.5:0/212470701 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f0631d9b700 1 --2- 172.21.15.5:0/212470701 >> v2:172.21.15.112:3300/0 conn(0x7f06340cede0 0x7f063415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063259c700 1 -- 172.21.15.5:0/212470701 >> v2:172.21.15.112:3300/0 conn(0x7f06340cede0 msgr2=0x7f063415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063259c700 1 --2- 172.21.15.5:0/212470701 >> v2:172.21.15.112:3300/0 conn(0x7f06340cede0 0x7f063415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063259c700 1 -- 172.21.15.5:0/212470701 >> v1:172.21.15.5:6789/0 conn(0x7f063406a840 legacy=0x7f0634161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063159a700 1 -- 172.21.15.5:0/212470701 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945529216 0 0) 0x7f06340cf290 con 0x7f063406a840 2023-10-16T13:49:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063259c700 1 -- 172.21.15.5:0/212470701 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340cdd30 con 0x7f06340cd950 2023-10-16T13:49:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f0631d9b700 1 --2- 172.21.15.5:0/212470701 >> v2:172.21.15.112:3300/0 conn(0x7f06340cede0 0x7f063415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063259c700 1 --2- 172.21.15.5:0/212470701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415e2f0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f0634161ae0 tx=0x7f061c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc108fecd698205 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063159a700 1 -- 172.21.15.5:0/212470701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c004020 con 0x7f06340cd950 2023-10-16T13:49:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063159a700 1 -- 172.21.15.5:0/212470701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c004180 con 0x7f06340cd950 2023-10-16T13:49:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f063159a700 1 -- 172.21.15.5:0/212470701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c004530 con 0x7f06340cd950 2023-10-16T13:49:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f0638d7d700 1 -- 172.21.15.5:0/212470701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 msgr2=0x7f063415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.479+0000 7f0638d7d700 1 --2- 172.21.15.5:0/212470701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415e2f0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f0634161ae0 tx=0x7f061c009b20 comp rx=0 tx=0).stop 2023-10-16T13:49:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.480+0000 7f0638d7d700 1 -- 172.21.15.5:0/212470701 shutdown_connections 2023-10-16T13:49:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.480+0000 7f0638d7d700 1 --2- 172.21.15.5:0/212470701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415e2f0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.480+0000 7f0638d7d700 1 --2- 172.21.15.5:0/212470701 >> v2:172.21.15.112:3300/0 conn(0x7f06340cede0 0x7f063415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.480+0000 7f0638d7d700 1 -- 172.21.15.5:0/212470701 >> 172.21.15.5:0/212470701 conn(0x7f063406dae0 msgr2=0x7f063406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:57.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.480+0000 7f0638d7d700 1 -- 172.21.15.5:0/212470701 shutdown_connections 2023-10-16T13:49:57.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.480+0000 7f0638d7d700 1 -- 172.21.15.5:0/212470701 wait complete. 2023-10-16T13:49:57.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.481+0000 7f0638d7d700 1 Processor -- start 2023-10-16T13:49:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.481+0000 7f0638d7d700 1 -- start start 2023-10-16T13:49:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f063406a840 0x7f06341f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340cede0 0x7f063415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c7910 con 0x7f06340cd950 2023-10-16T13:49:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b31d0 con 0x7f06340cede0 2023-10-16T13:49:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340ca580 con 0x7f063406a840 2023-10-16T13:49:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51156/0 (socket says 172.21.15.5:51156) 2023-10-16T13:49:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 -- 172.21.15.5:0/3668080222 learned_addr learned my addr 172.21.15.5:0/3668080222 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0632d9d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340cede0 0x7f063415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f063259c700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f063406a840 0x7f06341f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 -- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f063406a840 msgr2=0x7f06341f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f063406a840 0x7f06341f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 -- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340cede0 msgr2=0x7f063415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340cede0 0x7f063415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 -- 172.21.15.5:0/3668080222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0094a0 con 0x7f06340cd950 2023-10-16T13:49:57.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0632d9d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340cede0 0x7f063415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:57.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f063259c700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f063406a840 0x7f06341f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:49:57.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0631d9b700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415d250 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f062400c7f0 tx=0x7f062400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:57.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624005c20 con 0x7f06340cd950 2023-10-16T13:49:57.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624005d80 con 0x7f06340cd950 2023-10-16T13:49:57.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340b3420 con 0x7f06340cd950 2023-10-16T13:49:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.482+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624011820 con 0x7f06340cd950 2023-10-16T13:49:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.483+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340b39e0 con 0x7f06340cd950 2023-10-16T13:49:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.483+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06340b3c00 con 0x7f06340cd950 2023-10-16T13:49:57.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.484+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f0624011980 con 0x7f06340cd950 2023-10-16T13:49:57.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.484+0000 7f062affd700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f061406b2f0 0x7f061406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.484+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f06240899f0 con 0x7f06340cd950 2023-10-16T13:49:57.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.484+0000 7f063259c700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f061406b2f0 0x7f061406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.485+0000 7f063259c700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f061406b2f0 0x7f061406d7b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f061c0090b0 tx=0x7f061c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.489+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0624054670 con 0x7f06340cd950 2023-10-16T13:49:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.691+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0634067d20 con 0x7f06340cd950 2023-10-16T13:49:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.694+0000 7f062affd700 1 -- 172.21.15.5:0/3668080222 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f062401e0a0 con 0x7f06340cd950 2023-10-16T13:49:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f061406b2f0 msgr2=0x7f061406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f061406b2f0 0x7f061406d7b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f061c0090b0 tx=0x7f061c008030 comp rx=0 tx=0).stop 2023-10-16T13:49:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 msgr2=0x7f063415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415d250 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f062400c7f0 tx=0x7f062400cbb0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 shutdown_connections 2023-10-16T13:49:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340cede0 0x7f063415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f061406b2f0 0x7f061406d7b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f063406a840 0x7f06341f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 --2- 172.21.15.5:0/3668080222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06340cd950 0x7f063415d250 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 >> 172.21.15.5:0/3668080222 conn(0x7f063406dae0 msgr2=0x7f06340afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 shutdown_connections 2023-10-16T13:49:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.696+0000 7f0638d7d700 1 -- 172.21.15.5:0/3668080222 wait complete. 2023-10-16T13:49:57.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-16T13:49:57.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.834+0000 7f0204989700 1 Processor -- start 2023-10-16T13:49:57.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.834+0000 7f0204989700 1 -- start start 2023-10-16T13:49:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f0204989700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f020015e2f0 0x7f02000cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f0204989700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000b2d60 con 0x7f020006a840 2023-10-16T13:49:57.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f0204989700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000cdd30 con 0x7f02000cd950 2023-10-16T13:49:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f0204989700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02001619a0 con 0x7f020015e2f0 2023-10-16T13:49:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fdd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f020015e2f0 0x7f02000cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f020006a840 0x7f020006ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32938/0 (socket says 172.21.15.5:32938) 2023-10-16T13:49:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fed9d700 1 -- 172.21.15.5:0/1971955936 learned_addr learned my addr 172.21.15.5:0/1971955936 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:49:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fd59a700 1 -- 172.21.15.5:0/1971955936 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267253720 0 0) 0x7f02000b2d60 con 0x7f020006a840 2023-10-16T13:49:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fd59a700 1 -- 172.21.15.5:0/1971955936 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e80035b0 con 0x7f020006a840 2023-10-16T13:49:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fdd9b700 1 -- 172.21.15.5:0/1971955936 >> v1:172.21.15.112:6789/0 conn(0x7f02000cd950 legacy=0x7f020015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fdd9b700 1 -- 172.21.15.5:0/1971955936 >> v1:172.21.15.5:6789/0 conn(0x7f020006a840 legacy=0x7f020006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fdd9b700 1 -- 172.21.15.5:0/1971955936 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020015e920 con 0x7f020015e2f0 2023-10-16T13:49:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fdd9b700 1 --2- 172.21.15.5:0/1971955936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f02000cede0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009820 tx=0x7f01f4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc76ca0943e34e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.835+0000 7f01fd59a700 1 -- 172.21.15.5:0/1971955936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4005e30 con 0x7f020015e2f0 2023-10-16T13:49:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f01fd59a700 1 -- 172.21.15.5:0/1971955936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f4006030 con 0x7f020015e2f0 2023-10-16T13:49:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f01fd59a700 1 -- 172.21.15.5:0/1971955936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40063c0 con 0x7f020015e2f0 2023-10-16T13:49:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 -- 172.21.15.5:0/1971955936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 msgr2=0x7f02000cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 --2- 172.21.15.5:0/1971955936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f02000cede0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009820 tx=0x7f01f4009b30 comp rx=0 tx=0).stop 2023-10-16T13:49:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 -- 172.21.15.5:0/1971955936 shutdown_connections 2023-10-16T13:49:57.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 --2- 172.21.15.5:0/1971955936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f02000cede0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 -- 172.21.15.5:0/1971955936 >> 172.21.15.5:0/1971955936 conn(0x7f020006dae0 msgr2=0x7f020006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:57.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 -- 172.21.15.5:0/1971955936 shutdown_connections 2023-10-16T13:49:57.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.836+0000 7f0204989700 1 -- 172.21.15.5:0/1971955936 wait complete. 2023-10-16T13:49:57.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.837+0000 7f0204989700 1 Processor -- start 2023-10-16T13:49:57.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 -- start start 2023-10-16T13:49:57.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f020006a840 0x7f02000b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02000cd950 0x7f02000aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f020015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000b4f50 con 0x7f020015e2f0 2023-10-16T13:49:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000b5f00 con 0x7f02000cd950 2023-10-16T13:49:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f0204989700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000b5c20 con 0x7f020006a840 2023-10-16T13:49:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f01fed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f020015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f01fed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f020015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51172/0 (socket says 172.21.15.5:51172) 2023-10-16T13:49:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.838+0000 7f01fed9d700 1 -- 172.21.15.5:0/2381285264 learned_addr learned my addr 172.21.15.5:0/2381285264 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fdd9b700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02000cd950 0x7f02000aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fe59c700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f020006a840 0x7f02000b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fed9d700 1 -- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f020006a840 msgr2=0x7f02000b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fed9d700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f020006a840 0x7f02000b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fed9d700 1 -- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02000cd950 msgr2=0x7f02000aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fed9d700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02000cd950 0x7f02000aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fed9d700 1 -- 172.21.15.5:0/2381285264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4009430 con 0x7f020015e2f0 2023-10-16T13:49:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01fed9d700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f020015c370 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f01f800cb40 tx=0x7f01f800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:57.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800aaa0 con 0x7f020015e2f0 2023-10-16T13:49:57.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800ac00 con 0x7f020015e2f0 2023-10-16T13:49:57.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02000c7640 con 0x7f020015e2f0 2023-10-16T13:49:57.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8012400 con 0x7f020015e2f0 2023-10-16T13:49:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.839+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02000c7c00 con 0x7f020015e2f0 2023-10-16T13:49:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.840+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02000c4130 con 0x7f020015e2f0 2023-10-16T13:49:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.841+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f01f801b3b0 con 0x7f020015e2f0 2023-10-16T13:49:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.841+0000 7f01eeffd700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01e006b2f0 0x7f01e006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.841+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01f8089760 con 0x7f020015e2f0 2023-10-16T13:49:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.841+0000 7f01fe59c700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01e006b2f0 0x7f01e006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:57.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.842+0000 7f01fe59c700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01e006b2f0 0x7f01e006d7b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000f60 tx=0x7f01f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:57.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:57.846+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01f8054530 con 0x7f020015e2f0 2023-10-16T13:49:58.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.127+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f02000c7df0 con 0x7f020015e2f0 2023-10-16T13:49:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.323+0000 7f01eeffd700 1 -- 172.21.15.5:0/2381285264 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v522) v1 ==== 135+0+0 (secure 0 0 0) 0x7f01f8057b50 con 0x7f020015e2f0 2023-10-16T13:49:58.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.325+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01e006b2f0 msgr2=0x7f01e006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:58.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.325+0000 7f0204989700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01e006b2f0 0x7f01e006d7b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000f60 tx=0x7f01f0009040 comp rx=0 tx=0).stop 2023-10-16T13:49:58.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.325+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 msgr2=0x7f020015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:58.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f020015c370 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f01f800cb40 tx=0x7f01f800ce50 comp rx=0 tx=0).stop 2023-10-16T13:49:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 shutdown_connections 2023-10-16T13:49:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020015e2f0 0x7f020015c370 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f01e006b2f0 0x7f01e006d7b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f020006a840 0x7f02000b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 --2- 172.21.15.5:0/2381285264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02000cd950 0x7f02000aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 >> 172.21.15.5:0/2381285264 conn(0x7f020006dae0 msgr2=0x7f020006ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 shutdown_connections 2023-10-16T13:49:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:58.326+0000 7f0204989700 1 -- 172.21.15.5:0/2381285264 wait complete. 2023-10-16T13:49:58.341 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. ... ERROR 2023-10-16T13:49:58.342 INFO:tasks.cephfs_test_runner: 2023-10-16T13:49:58.343 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T13:49:58.343 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:49:58.343 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. 2023-10-16T13:49:58.344 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T13:49:58.344 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T13:49:58.344 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/test_volumes.py", line 574, in test_volume_rename 2023-10-16T13:49:58.344 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rename", oldvolname, newvolname, 2023-10-16T13:49:58.345 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-16T13:49:58.345 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-10-16T13:49:58.345 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-10-16T13:49:58.346 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-10-16T13:49:58.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-10-16T13:49:58.346 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-10-16T13:49:58.346 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-10-16T13:49:58.347 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-16T13:49:58.347 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T13:49:58.347 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T13:49:58.347 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T13:49:58.348 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T13:49:58.348 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T13:49:58.348 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T13:49:58.349 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T13:49:58.349 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T13:49:58.349 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000690504 --yes-i-really-mean-it' 2023-10-16T13:49:58.349 INFO:tasks.cephfs_test_runner: 2023-10-16T13:49:58.350 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T13:49:58.350 INFO:tasks.cephfs_test_runner:Ran 8 tests in 664.337s 2023-10-16T13:49:58.350 INFO:tasks.cephfs_test_runner: 2023-10-16T13:49:58.351 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-16T13:49:58.351 INFO:tasks.cephfs_test_runner: 2023-10-16T13:49:58.351 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T13:49:58.352 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:49:58.352 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. 2023-10-16T13:49:58.352 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T13:49:58.353 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T13:49:58.353 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/test_volumes.py", line 574, in test_volume_rename 2023-10-16T13:49:58.353 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rename", oldvolname, newvolname, 2023-10-16T13:49:58.353 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-16T13:49:58.354 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-10-16T13:49:58.354 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-10-16T13:49:58.354 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-10-16T13:49:58.355 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-10-16T13:49:58.355 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-10-16T13:49:58.355 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-10-16T13:49:58.356 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-16T13:49:58.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T13:49:58.356 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T13:49:58.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T13:49:58.356 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T13:49:58.357 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T13:49:58.357 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T13:49:58.357 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T13:49:58.358 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T13:49:58.358 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000690504 --yes-i-really-mean-it' 2023-10-16T13:49:58.358 INFO:tasks.cephfs_test_runner: 2023-10-16T13:49:58.359 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:49:58.455 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4fa5429785f541f3bab189fba4654494 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-16T13:49:58.458 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T13:49:58.467 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-16T13:49:58.477 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T13:49:58.477 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:58.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:58.503 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:58.503 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-16T13:49:58.503 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:58.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15761 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T13:49:58.562 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:58.562 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:58.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:58.583 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-16T13:49:58.583 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:49:58.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18588 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T13:49:58.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:58.644 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:49:58.662 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:49:58.663 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:49:58.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:58.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:49:58.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:58.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:49:58.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:58.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-16T13:49:58.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:58.963 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-16T13:49:58.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:58.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-16T13:49:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-10-16T13:49:59.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:49:59.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:59.055 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:49:59.076 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T13:49:59.077 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T13:49:59.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:59.077 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T13:49:59.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:59.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T13:49:59.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:49:59.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:49:59.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:59.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-16T13:49:59.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:59.398 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-16T13:49:59.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:49:59.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-16T13:49:59.487 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-10-16T13:49:59.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:49:59.489 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T13:49:59.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T13:49:59.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:49:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.625+0000 7f2380967700 1 Processor -- start 2023-10-16T13:49:59.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.625+0000 7f2380967700 1 -- start start 2023-10-16T13:49:59.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2380967700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f237c15b740 0x7f237c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2380967700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f237c0d0c70 0x7f237c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2380967700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c0cf190 con 0x7f237c0c5110 2023-10-16T13:49:59.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2380967700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c15bb20 con 0x7f237c0d0c70 2023-10-16T13:49:59.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2380967700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0cbd40 con 0x7f237c15b740 2023-10-16T13:49:59.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f237c0d0c70 0x7f237c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f237c0d0c70 0x7f237c0cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51176/0 (socket says 172.21.15.5:51176) 2023-10-16T13:49:59.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 -- 172.21.15.5:0/252904401 learned_addr learned my addr 172.21.15.5:0/252904401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:59.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 -- 172.21.15.5:0/252904401 >> v2:172.21.15.112:3300/0 conn(0x7f237c15b740 msgr2=0x7f237c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:59.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 --2- 172.21.15.5:0/252904401 >> v2:172.21.15.112:3300/0 conn(0x7f237c15b740 0x7f237c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 -- 172.21.15.5:0/252904401 >> v1:172.21.15.112:6789/0 conn(0x7f237c0c5110 legacy=0x7f237c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:59.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 -- 172.21.15.5:0/252904401 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0cc020 con 0x7f237c0d0c70 2023-10-16T13:49:59.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f2379d9b700 1 --2- 172.21.15.5:0/252904401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0cdfd0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f237c0cee60 tx=0x7f2370009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34072ceab60ff599 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:59.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f237959a700 1 -- 172.21.15.5:0/252904401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370004230 con 0x7f237c0d0c70 2023-10-16T13:49:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f237959a700 1 -- 172.21.15.5:0/252904401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370004390 con 0x7f237c0d0c70 2023-10-16T13:49:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.626+0000 7f237959a700 1 -- 172.21.15.5:0/252904401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23700036a0 con 0x7f237c0d0c70 2023-10-16T13:49:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 -- 172.21.15.5:0/252904401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 msgr2=0x7f237c0cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 --2- 172.21.15.5:0/252904401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0cdfd0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f237c0cee60 tx=0x7f2370009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 -- 172.21.15.5:0/252904401 shutdown_connections 2023-10-16T13:49:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 --2- 172.21.15.5:0/252904401 >> v2:172.21.15.112:3300/0 conn(0x7f237c15b740 0x7f237c0d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 --2- 172.21.15.5:0/252904401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0cdfd0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 -- 172.21.15.5:0/252904401 >> 172.21.15.5:0/252904401 conn(0x7f237c0665a0 msgr2=0x7f237c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 -- 172.21.15.5:0/252904401 shutdown_connections 2023-10-16T13:49:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.627+0000 7f2380967700 1 -- 172.21.15.5:0/252904401 wait complete. 2023-10-16T13:49:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 Processor -- start 2023-10-16T13:49:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 -- start start 2023-10-16T13:49:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f237c0c5110 0x7f237c1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237c15b740 0x7f237c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1f4ef0 con 0x7f237c0d0c70 2023-10-16T13:49:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0ca390 con 0x7f237c15b740 2023-10-16T13:49:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2380967700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0c7010 con 0x7f237c0c5110 2023-10-16T13:49:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2379d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2379d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51182/0 (socket says 172.21.15.5:51182) 2023-10-16T13:49:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.629+0000 7f2379d9b700 1 -- 172.21.15.5:0/1292138743 learned_addr learned my addr 172.21.15.5:0/1292138743 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f237a59c700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f237c0c5110 0x7f237c1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f237ad9d700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237c15b740 0x7f237c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2379d9b700 1 -- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f237c0c5110 msgr2=0x7f237c1f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2379d9b700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f237c0c5110 0x7f237c1f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2379d9b700 1 -- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237c15b740 msgr2=0x7f237c14f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2379d9b700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237c15b740 0x7f237c14f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2379d9b700 1 -- 172.21.15.5:0/1292138743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2370009550 con 0x7f237c0d0c70 2023-10-16T13:49:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f237ad9d700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237c15b740 0x7f237c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f237a59c700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f237c0c5110 0x7f237c1f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:49:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2379d9b700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0ca830 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f237c0cee90 tx=0x7f2370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370003dc0 con 0x7f237c0d0c70 2023-10-16T13:49:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237001f070 con 0x7f237c0d0c70 2023-10-16T13:49:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c0ca0b0 con 0x7f237c0d0c70 2023-10-16T13:49:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370011870 con 0x7f237c0d0c70 2023-10-16T13:49:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.630+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0b53e0 con 0x7f237c0d0c70 2023-10-16T13:49:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.631+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c15af50 con 0x7f237c0d0c70 2023-10-16T13:49:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.632+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f2370021030 con 0x7f237c0d0c70 2023-10-16T13:49:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.632+0000 7f236affd700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235c06b2f0 0x7f235c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.632+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f237008b000 con 0x7f237c0d0c70 2023-10-16T13:49:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.632+0000 7f237a59c700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235c06b2f0 0x7f235c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.633+0000 7f237a59c700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235c06b2f0 0x7f235c06d7b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f236c006fd0 tx=0x7f236c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.637+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2370056090 con 0x7f237c0d0c70 2023-10-16T13:49:59.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.833+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f237c0cc5e0 con 0x7f235c06b2f0 2023-10-16T13:49:59.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.836+0000 7f236affd700 1 -- 172.21.15.5:0/1292138743 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50618 (secure 0 0 0) 0x7f236c009df0 con 0x7f235c06b2f0 2023-10-16T13:49:59.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:49:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235c06b2f0 msgr2=0x7f235c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235c06b2f0 0x7f235c06d7b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f236c006fd0 tx=0x7f236c008040 comp rx=0 tx=0).stop 2023-10-16T13:49:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 msgr2=0x7f237c0ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0ca830 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f237c0cee90 tx=0x7f2370004750 comp rx=0 tx=0).stop 2023-10-16T13:49:59.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 shutdown_connections 2023-10-16T13:49:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f237c15b740 0x7f237c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f235c06b2f0 0x7f235c06d7b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f237c0c5110 0x7f237c1f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 --2- 172.21.15.5:0/1292138743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f237c0d0c70 0x7f237c0ca830 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 >> 172.21.15.5:0/1292138743 conn(0x7f237c0665a0 msgr2=0x7f237c0b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 shutdown_connections 2023-10-16T13:49:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.838+0000 7f2380967700 1 -- 172.21.15.5:0/1292138743 wait complete. 2023-10-16T13:49:59.845 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:49:59.853 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2023-10-16T13:49:59.633898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280892,"kb_used_data":14800,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754693828,"statfs":{"total":773094113280,"available":772806479872,"internally_reserved":0,"allocated":15155200,"data_stored":7449515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":272354872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001589"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-16T13:49:57.391534+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:49:57.391534+0000","last_peered":"2023-10-16T13:49:57.391534+0000","last_clean":"2023-10-16T13:49:57.391534+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:49:57.391534+0000","last_undegraded":"2023-10-16T13:49:57.391534+0000","last_fullsized":"2023-10-16T13:49:57.391534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2347008,"data_stored":1376307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.58699999999999997,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.93100000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.56999999999999995,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.47799999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.309},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.90600000000000003},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.51000000000000001,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32876,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1736704,"data_stored":780374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.75}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"last":0.377}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.26500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.622,"5min":0.622,"15min":1.1619999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.752},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":0.88},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.34899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":1.905},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.879},"last":0.877}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0549999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.925},"last":0.82499999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.085},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37612,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334228,"statfs":{"total":96636764160,"available":96598249472,"internally_reserved":0,"allocated":2326528,"data_stored":1369723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.317}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37032,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1732608,"data_stored":779355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34399999999999997,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.40300000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.38700000000000001},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.48899999999999999,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.20599999999999999},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48899999999999999,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":8.1129999999999995,"5min":8.1129999999999995,"15min":8.1129999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.367,"5min":5.367,"15min":5.367},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.379},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61399999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":2.141,"5min":2.141,"15min":4.0609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.2690000000000001,"5min":5.2690000000000001,"15min":6.0499999999999998},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.629,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65000000000000002,"5min":0.73599999999999999,"15min":2.181},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.5,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.249},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.318}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"max":{"1min":0.67100000000000004,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.71199999999999997},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.66000000000000003},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":1.264,"15min":2.4039999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.71299999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":1.298,"15min":2.4430000000000001},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.435},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.5}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.442},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59499999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.625}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.54200000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:49:59.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:49:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.977+0000 7f522e219700 1 Processor -- start 2023-10-16T13:49:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.977+0000 7f522e219700 1 -- start start 2023-10-16T13:49:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f522e219700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f52280cd950 0x7f522815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f522e219700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52280cede0 0x7f522815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f522e219700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280cf290 con 0x7f522806a840 2023-10-16T13:49:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f522e219700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52281619a0 con 0x7f52280cede0 2023-10-16T13:49:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f522e219700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52280b2d60 con 0x7f52280cd950 2023-10-16T13:49:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52280cede0 0x7f522815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52280cede0 0x7f522815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51190/0 (socket says 172.21.15.5:51190) 2023-10-16T13:49:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 -- 172.21.15.5:0/229861643 learned_addr learned my addr 172.21.15.5:0/229861643 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f52277fe700 1 --2- 172.21.15.5:0/229861643 >> v2:172.21.15.112:3300/0 conn(0x7f52280cd950 0x7f522815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 -- 172.21.15.5:0/229861643 >> v2:172.21.15.112:3300/0 conn(0x7f52280cd950 msgr2=0x7f522815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 --2- 172.21.15.5:0/229861643 >> v2:172.21.15.112:3300/0 conn(0x7f52280cd950 0x7f522815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 -- 172.21.15.5:0/229861643 >> v1:172.21.15.112:6789/0 conn(0x7f522806a840 legacy=0x7f5228161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:49:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 -- 172.21.15.5:0/229861643 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280cdd30 con 0x7f52280cede0 2023-10-16T13:49:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f5226ffd700 1 --2- 172.21.15.5:0/229861643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cede0 0x7f522815f570 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f5228161ae0 tx=0x7f521c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2283efec7dea0691 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f52267fc700 1 -- 172.21.15.5:0/229861643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c005e30 con 0x7f52280cede0 2023-10-16T13:49:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f52267fc700 1 -- 172.21.15.5:0/229861643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c004030 con 0x7f52280cede0 2023-10-16T13:49:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.978+0000 7f52267fc700 1 -- 172.21.15.5:0/229861643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0043e0 con 0x7f52280cede0 2023-10-16T13:49:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 -- 172.21.15.5:0/229861643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cede0 msgr2=0x7f522815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 --2- 172.21.15.5:0/229861643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cede0 0x7f522815f570 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f5228161ae0 tx=0x7f521c009bd0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 -- 172.21.15.5:0/229861643 shutdown_connections 2023-10-16T13:49:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 --2- 172.21.15.5:0/229861643 >> v2:172.21.15.112:3300/0 conn(0x7f52280cd950 0x7f522815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 --2- 172.21.15.5:0/229861643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cede0 0x7f522815f570 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 -- 172.21.15.5:0/229861643 >> 172.21.15.5:0/229861643 conn(0x7f522806dae0 msgr2=0x7f522806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:49:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 -- 172.21.15.5:0/229861643 shutdown_connections 2023-10-16T13:49:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.979+0000 7f522e219700 1 -- 172.21.15.5:0/229861643 wait complete. 2023-10-16T13:49:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.981+0000 7f522e219700 1 Processor -- start 2023-10-16T13:49:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.981+0000 7f522e219700 1 -- start start 2023-10-16T13:49:59.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f522806a840 0x7f52280c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 0x7f52280c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52280cede0 0x7f5228153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c62a0 con 0x7f52280cd950 2023-10-16T13:49:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c53a0 con 0x7f522806a840 2023-10-16T13:49:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c5620 con 0x7f52280cede0 2023-10-16T13:49:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 0x7f52280c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 0x7f52280c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51196/0 (socket says 172.21.15.5:51196) 2023-10-16T13:49:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 -- 172.21.15.5:0/565306788 learned_addr learned my addr 172.21.15.5:0/565306788 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:49:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f52277fe700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f522806a840 0x7f52280c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5227fff700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52280cede0 0x7f5228153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:49:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 -- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52280cede0 msgr2=0x7f5228153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52280cede0 0x7f5228153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 -- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f522806a840 msgr2=0x7f52280c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:49:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f522806a840 0x7f52280c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:49:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 -- 172.21.15.5:0/565306788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c009500 con 0x7f52280cd950 2023-10-16T13:49:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f5226ffd700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 0x7f52280c4e60 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f521c014040 tx=0x7f521c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:49:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c003cb0 con 0x7f52280cd950 2023-10-16T13:49:59.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c003e10 con 0x7f52280cd950 2023-10-16T13:49:59.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52280c5900 con 0x7f52280cd950 2023-10-16T13:49:59.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.982+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c01c660 con 0x7f52280cd950 2023-10-16T13:49:59.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.983+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280c5ec0 con 0x7f52280cd950 2023-10-16T13:49:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.983+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52280ac8b0 con 0x7f52280cd950 2023-10-16T13:49:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.984+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f521c01c7c0 con 0x7f52280cd950 2023-10-16T13:49:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.984+0000 7f520ffff700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f521406b2f0 0x7f521406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:49:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.984+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f521c08a9f0 con 0x7f52280cd950 2023-10-16T13:50:00.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.985+0000 7f52277fe700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f521406b2f0 0x7f521406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.985+0000 7f52277fe700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f521406b2f0 0x7f521406d7b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5218006b20 tx=0x7f5218008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:49:59.989+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52280ac8b0 con 0x7f52280cd950 2023-10-16T13:50:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.184+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f522815ec00 con 0x7f521406b2f0 2023-10-16T13:50:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.187+0000 7f520ffff700 1 -- 172.21.15.5:0/565306788 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50618 (secure 0 0 0) 0x7f5218009e40 con 0x7f521406b2f0 2023-10-16T13:50:00.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:50:00.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f521406b2f0 msgr2=0x7f521406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f521406b2f0 0x7f521406d7b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5218006b20 tx=0x7f5218008040 comp rx=0 tx=0).stop 2023-10-16T13:50:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 msgr2=0x7f52280c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 0x7f52280c4e60 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f521c014040 tx=0x7f521c004750 comp rx=0 tx=0).stop 2023-10-16T13:50:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 shutdown_connections 2023-10-16T13:50:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f521406b2f0 0x7f521406d7b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52280cede0 0x7f5228153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f522806a840 0x7f52280c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 --2- 172.21.15.5:0/565306788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52280cd950 0x7f52280c4e60 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 >> 172.21.15.5:0/565306788 conn(0x7f522806dae0 msgr2=0x7f522815da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 shutdown_connections 2023-10-16T13:50:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.189+0000 7f522e219700 1 -- 172.21.15.5:0/565306788 wait complete. 2023-10-16T13:50:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:50:00.204 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2023-10-16T13:49:59.633898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280892,"kb_used_data":14800,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754693828,"statfs":{"total":773094113280,"available":772806479872,"internally_reserved":0,"allocated":15155200,"data_stored":7449515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":272354872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001589"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-16T13:49:57.391534+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:49:57.391534+0000","last_peered":"2023-10-16T13:49:57.391534+0000","last_clean":"2023-10-16T13:49:57.391534+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:49:57.391534+0000","last_undegraded":"2023-10-16T13:49:57.391534+0000","last_fullsized":"2023-10-16T13:49:57.391534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2347008,"data_stored":1376307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.58699999999999997,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.93100000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.56999999999999995,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.47799999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.309},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.90600000000000003},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.51000000000000001,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32876,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1736704,"data_stored":780374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.75}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"last":0.377}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.26500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.622,"5min":0.622,"15min":1.1619999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.752},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":0.88},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.34899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":1.905},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.879},"last":0.877}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0549999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.925},"last":0.82499999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.085},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37612,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334228,"statfs":{"total":96636764160,"available":96598249472,"internally_reserved":0,"allocated":2326528,"data_stored":1369723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.317}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37032,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1732608,"data_stored":779355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34399999999999997,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.40300000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.38700000000000001},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.48899999999999999,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.20599999999999999},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48899999999999999,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":8.1129999999999995,"5min":8.1129999999999995,"15min":8.1129999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.367,"5min":5.367,"15min":5.367},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.379},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61399999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":2.141,"5min":2.141,"15min":4.0609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.2690000000000001,"5min":5.2690000000000001,"15min":6.0499999999999998},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.629,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65000000000000002,"5min":0.73599999999999999,"15min":2.181},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.5,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.249},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.318}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"max":{"1min":0.67100000000000004,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.71199999999999997},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.66000000000000003},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":1.264,"15min":2.4039999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.71299999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":1.298,"15min":2.4430000000000001},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.435},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.5}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.442},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59499999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.625}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.54200000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:50:00.206 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T13:50:00.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:50:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.330+0000 7fbf57cdf700 1 Processor -- start 2023-10-16T13:50:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.330+0000 7fbf57cdf700 1 -- start start 2023-10-16T13:50:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf57cdf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 0x7fbf500cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf57cdf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 0x7fbf5006b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf57cdf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf500cbe80 con 0x7fbf5006bd90 2023-10-16T13:50:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf57cdf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5006c200 con 0x7fbf500c67d0 2023-10-16T13:50:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf57cdf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500c5ae0 con 0x7fbf500cab20 2023-10-16T13:50:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf5527a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 0x7fbf5006b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf55a7b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 0x7fbf500cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf5527a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 0x7fbf5006b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49108/0 (socket says 172.21.15.5:49108) 2023-10-16T13:50:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf55a7b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 0x7fbf500cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47098/0 (socket says 172.21.15.5:47098) 2023-10-16T13:50:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf5527a700 1 -- 172.21.15.5:0/4183291452 learned_addr learned my addr 172.21.15.5:0/4183291452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.331+0000 7fbf5627c700 1 --1- 172.21.15.5:0/4183291452 >> v1:172.21.15.112:6789/0 conn(0x7fbf5006bd90 0x7fbf5015cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:52186/0 (socket says 172.21.15.5:52186) 2023-10-16T13:50:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.332+0000 7fbf5527a700 1 -- 172.21.15.5:0/4183291452 >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 msgr2=0x7fbf500cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.332+0000 7fbf5527a700 1 --2- 172.21.15.5:0/4183291452 >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 0x7fbf500cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.332+0000 7fbf5527a700 1 -- 172.21.15.5:0/4183291452 >> v1:172.21.15.112:6789/0 conn(0x7fbf5006bd90 legacy=0x7fbf5015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.332+0000 7fbf5527a700 1 -- 172.21.15.5:0/4183291452 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500cdfd0 con 0x7fbf500cab20 2023-10-16T13:50:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.332+0000 7fbf55a7b700 1 --2- 172.21.15.5:0/4183291452 >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 0x7fbf500cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.332+0000 7fbf5527a700 1 --2- 172.21.15.5:0/4183291452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 0x7fbf5006b850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf400098f0 tx=0x7fbf40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e30255cbd0b7fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf54a79700 1 -- 172.21.15.5:0/4183291452 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40011830 con 0x7fbf500cab20 2023-10-16T13:50:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf54a79700 1 -- 172.21.15.5:0/4183291452 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40011990 con 0x7fbf500cab20 2023-10-16T13:50:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf54a79700 1 -- 172.21.15.5:0/4183291452 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40011d20 con 0x7fbf500cab20 2023-10-16T13:50:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf57cdf700 1 -- 172.21.15.5:0/4183291452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 msgr2=0x7fbf5006b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/4183291452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 0x7fbf5006b850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf400098f0 tx=0x7fbf40009c00 comp rx=0 tx=0).stop 2023-10-16T13:50:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf57cdf700 1 -- 172.21.15.5:0/4183291452 shutdown_connections 2023-10-16T13:50:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/4183291452 >> v2:172.21.15.112:3300/0 conn(0x7fbf500c67d0 0x7fbf500cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/4183291452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500cab20 0x7fbf5006b850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.334+0000 7fbf57cdf700 1 -- 172.21.15.5:0/4183291452 >> 172.21.15.5:0/4183291452 conn(0x7fbf50071310 msgr2=0x7fbf50071720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.335+0000 7fbf57cdf700 1 -- 172.21.15.5:0/4183291452 shutdown_connections 2023-10-16T13:50:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.335+0000 7fbf57cdf700 1 -- 172.21.15.5:0/4183291452 wait complete. 2023-10-16T13:50:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.336+0000 7fbf57cdf700 1 Processor -- start 2023-10-16T13:50:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.336+0000 7fbf57cdf700 1 -- start start 2023-10-16T13:50:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf57cdf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 0x7fbf500b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf57cdf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500c67d0 0x7fbf501f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf57cdf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500cab20 0x7fbf500c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf57cdf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501f2d60 con 0x7fbf5006bd90 2023-10-16T13:50:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf57cdf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500b4260 con 0x7fbf500cab20 2023-10-16T13:50:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf57cdf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500b3ca0 con 0x7fbf500c67d0 2023-10-16T13:50:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 0x7fbf500b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 0x7fbf500b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51208/0 (socket says 172.21.15.5:51208) 2023-10-16T13:50:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 -- 172.21.15.5:0/337954686 learned_addr learned my addr 172.21.15.5:0/337954686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf5527a700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500c67d0 0x7fbf501f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf5627c700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500cab20 0x7fbf500c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 -- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500c67d0 msgr2=0x7fbf501f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500c67d0 0x7fbf501f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 -- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500cab20 msgr2=0x7fbf500c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500cab20 0x7fbf500c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 -- 172.21.15.5:0/337954686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0094a0 con 0x7fbf5006bd90 2023-10-16T13:50:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.337+0000 7fbf55a7b700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 0x7fbf500b36c0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00ebe0 tx=0x7fbf4c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.338+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00c910 con 0x7fbf5006bd90 2023-10-16T13:50:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.338+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00ca70 con 0x7fbf5006bd90 2023-10-16T13:50:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.338+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf40009550 con 0x7fbf5006bd90 2023-10-16T13:50:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.338+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00cde0 con 0x7fbf5006bd90 2023-10-16T13:50:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.338+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf500c6ea0 con 0x7fbf5006bd90 2023-10-16T13:50:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.338+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf500c6ce0 con 0x7fbf5006bd90 2023-10-16T13:50:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.339+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fbf4c013470 con 0x7fbf5006bd90 2023-10-16T13:50:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.339+0000 7fbf467fc700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf3406b320 0x7fbf3406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.340+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf4c089c50 con 0x7fbf5006bd90 2023-10-16T13:50:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.340+0000 7fbf5527a700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf3406b320 0x7fbf3406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.340+0000 7fbf5527a700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf3406b320 0x7fbf3406d7e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009c40 tx=0x7fbf40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.344+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf4c0549a0 con 0x7fbf5006bd90 2023-10-16T13:50:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.541+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf500cb550 con 0x7fbf3406b320 2023-10-16T13:50:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.544+0000 7fbf467fc700 1 -- 172.21.15.5:0/337954686 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50618 (secure 0 0 0) 0x7fbf40011c30 con 0x7fbf3406b320 2023-10-16T13:50:00.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:50:00.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf3406b320 msgr2=0x7fbf3406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf3406b320 0x7fbf3406d7e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009c40 tx=0x7fbf40008030 comp rx=0 tx=0).stop 2023-10-16T13:50:00.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 msgr2=0x7fbf500b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 0x7fbf500b36c0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00ebe0 tx=0x7fbf4c009ec0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 shutdown_connections 2023-10-16T13:50:00.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500cab20 0x7fbf500c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5006bd90 0x7fbf500b36c0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf3406b320 0x7fbf3406d7e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 --2- 172.21.15.5:0/337954686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf500c67d0 0x7fbf501f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 >> 172.21.15.5:0/337954686 conn(0x7fbf50071310 msgr2=0x7fbf500b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:00.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 shutdown_connections 2023-10-16T13:50:00.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.546+0000 7fbf57cdf700 1 -- 172.21.15.5:0/337954686 wait complete. 2023-10-16T13:50:00.553 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:50:00.561 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2023-10-16T13:49:59.633898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280892,"kb_used_data":14800,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754693828,"statfs":{"total":773094113280,"available":772806479872,"internally_reserved":0,"allocated":15155200,"data_stored":7449515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":272354872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001589"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-16T13:49:57.391534+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:49:57.391534+0000","last_peered":"2023-10-16T13:49:57.391534+0000","last_clean":"2023-10-16T13:49:57.391534+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:49:57.391534+0000","last_undegraded":"2023-10-16T13:49:57.391534+0000","last_fullsized":"2023-10-16T13:49:57.391534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2347008,"data_stored":1376307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.58699999999999997,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.93100000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.56999999999999995,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.47799999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.309},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.90600000000000003},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.51000000000000001,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32876,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1736704,"data_stored":780374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.75}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"last":0.377}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.26500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.622,"5min":0.622,"15min":1.1619999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.752},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":0.88},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.34899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":1.905},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.879},"last":0.877}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0549999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.925},"last":0.82499999999999996}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.085},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37612,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334228,"statfs":{"total":96636764160,"available":96598249472,"internally_reserved":0,"allocated":2326528,"data_stored":1369723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.317}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37032,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1732608,"data_stored":779355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34399999999999997,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.40300000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.38700000000000001},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.48899999999999999,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.20599999999999999},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48899999999999999,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":8.1129999999999995,"5min":8.1129999999999995,"15min":8.1129999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.367,"5min":5.367,"15min":5.367},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.379},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61399999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":2.141,"5min":2.141,"15min":4.0609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.2690000000000001,"5min":5.2690000000000001,"15min":6.0499999999999998},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.629,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65000000000000002,"5min":0.73599999999999999,"15min":2.181},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.5,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.249},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.318}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"max":{"1min":0.67100000000000004,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.71199999999999997},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.66000000000000003},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":1.264,"15min":2.4039999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.71299999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":1.298,"15min":2.4430000000000001},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.435},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.5}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.442},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59499999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.625}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.54200000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:50:00.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:50:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.685+0000 7f2041971700 1 Processor -- start 2023-10-16T13:50:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.685+0000 7f2041971700 1 -- start start 2023-10-16T13:50:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f2041971700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f203c15eab0 0x7f203c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f2041971700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0d2170 con 0x7f203c0d1d90 2023-10-16T13:50:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f2041971700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c15ee90 con 0x7f203c0cf6d0 2023-10-16T13:50:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f2041971700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c0cfb60 con 0x7f203c15eab0 2023-10-16T13:50:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f203affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f203c15eab0 0x7f203c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f203b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f203c0d1d90 0x7f203c0cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32992/0 (socket says 172.21.15.5:32992) 2023-10-16T13:50:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.686+0000 7f203b7fe700 1 -- 172.21.15.5:0/2357937416 learned_addr learned my addr 172.21.15.5:0/2357937416 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f203affd700 1 -- 172.21.15.5:0/2357937416 >> v1:172.21.15.112:6789/0 conn(0x7f203c0cf6d0 legacy=0x7f203c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f203affd700 1 -- 172.21.15.5:0/2357937416 >> v1:172.21.15.5:6789/0 conn(0x7f203c0d1d90 legacy=0x7f203c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f203affd700 1 -- 172.21.15.5:0/2357937416 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c158370 con 0x7f203c15eab0 2023-10-16T13:50:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2039ffb700 1 -- 172.21.15.5:0/2357937416 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666133408 0 0) 0x7f2034001490 con 0x7f203c0d1d90 2023-10-16T13:50:00.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f203affd700 1 --2- 172.21.15.5:0/2357937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c15eab0 0x7f203c0cf190 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2030009840 tx=0x7f2030009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523ac018d549ad2c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2039ffb700 1 -- 172.21.15.5:0/2357937416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030004230 con 0x7f203c15eab0 2023-10-16T13:50:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2039ffb700 1 -- 172.21.15.5:0/2357937416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030004390 con 0x7f203c15eab0 2023-10-16T13:50:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2039ffb700 1 -- 172.21.15.5:0/2357937416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300036a0 con 0x7f203c15eab0 2023-10-16T13:50:00.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2041971700 1 -- 172.21.15.5:0/2357937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c15eab0 msgr2=0x7f203c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2041971700 1 --2- 172.21.15.5:0/2357937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c15eab0 0x7f203c0cf190 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2030009840 tx=0x7f2030009b50 comp rx=0 tx=0).stop 2023-10-16T13:50:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2041971700 1 -- 172.21.15.5:0/2357937416 shutdown_connections 2023-10-16T13:50:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2041971700 1 --2- 172.21.15.5:0/2357937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c15eab0 0x7f203c0cf190 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.687+0000 7f2041971700 1 -- 172.21.15.5:0/2357937416 >> 172.21.15.5:0/2357937416 conn(0x7f203c0665a0 msgr2=0x7f203c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.688+0000 7f2041971700 1 -- 172.21.15.5:0/2357937416 shutdown_connections 2023-10-16T13:50:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.688+0000 7f2041971700 1 -- 172.21.15.5:0/2357937416 wait complete. 2023-10-16T13:50:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.689+0000 7f2041971700 1 Processor -- start 2023-10-16T13:50:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.689+0000 7f2041971700 1 -- start start 2023-10-16T13:50:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f203c0cf6d0 0x7f203c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 0x7f203c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f203c15eab0 0x7f203c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b0d10 con 0x7f203c0d1d90 2023-10-16T13:50:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0ae560 con 0x7f203c15eab0 2023-10-16T13:50:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0ae750 con 0x7f203c0cf6d0 2023-10-16T13:50:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 0x7f203c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 0x7f203c157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51224/0 (socket says 172.21.15.5:51224) 2023-10-16T13:50:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 -- 172.21.15.5:0/808207348 learned_addr learned my addr 172.21.15.5:0/808207348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203affd700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f203c0cf6d0 0x7f203c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203b7fe700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f203c15eab0 0x7f203c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 -- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f203c0cf6d0 msgr2=0x7f203c0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f203c0cf6d0 0x7f203c0b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 -- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f203c15eab0 msgr2=0x7f203c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f203c15eab0 0x7f203c15f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 -- 172.21.15.5:0/808207348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300094a0 con 0x7f203c0d1d90 2023-10-16T13:50:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203affd700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f203c0cf6d0 0x7f203c0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:50:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f203a7fc700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 0x7f203c157300 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f202c00b4a0 tx=0x7f202c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c011830 con 0x7f203c0d1d90 2023-10-16T13:50:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c011990 con 0x7f203c0d1d90 2023-10-16T13:50:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c011d40 con 0x7f203c0d1d90 2023-10-16T13:50:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c0aea30 con 0x7f203c0d1d90 2023-10-16T13:50:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.690+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c0aeff0 con 0x7f203c0d1d90 2023-10-16T13:50:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.691+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c06d9b0 con 0x7f203c0d1d90 2023-10-16T13:50:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.692+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f202c01a400 con 0x7f203c0d1d90 2023-10-16T13:50:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.692+0000 7f2023fff700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f202806b2f0 0x7f202806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.692+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f202c089720 con 0x7f203c0d1d90 2023-10-16T13:50:00.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.692+0000 7f203affd700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f202806b2f0 0x7f202806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.693+0000 7f203affd700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f202806b2f0 0x7f202806d7b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2030000c00 tx=0x7f203001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:00.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.697+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f202c0544f0 con 0x7f203c0d1d90 2023-10-16T13:50:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.896+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f203c0af210 con 0x7f203c0d1d90 2023-10-16T13:50:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.897+0000 7f2023fff700 1 -- 172.21.15.5:0/808207348 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+12926 (secure 0 0 0) 0x7f202c057b10 con 0x7f203c0d1d90 2023-10-16T13:50:00.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:50:00.900 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":138,"fsid":"c788ad9b-19b9-40dd-ae3e-e8ae361f1f3c","created":"2023-10-16T13:38:01.820740+0000","modified":"2023-10-16T13:49:57.318477+0000","last_up_change":"2023-10-16T13:38:12.622723+0000","last_in_change":"2023-10-16T13:38:04.303908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T13:38:13.510769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb6384d7-c7ad-4db8-99c7-66e9aa9c2b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6809","nonce":2363290793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6811","nonce":2363290793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6815","nonce":2363290793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2363290793},{"type":"v1","addr":"172.21.15.5:6813","nonce":2363290793}]},"public_addr":"172.21.15.5:6809/2363290793","cluster_addr":"172.21.15.5:6811/2363290793","heartbeat_back_addr":"172.21.15.5:6815/2363290793","heartbeat_front_addr":"172.21.15.5:6813/2363290793","state":["exists","up"]},{"osd":1,"uuid":"8e9ffbf0-550d-4af3-945f-a1c2f251ff96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6801","nonce":3441513170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6803","nonce":3441513170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6807","nonce":3441513170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3441513170},{"type":"v1","addr":"172.21.15.5:6805","nonce":3441513170}]},"public_addr":"172.21.15.5:6801/3441513170","cluster_addr":"172.21.15.5:6803/3441513170","heartbeat_back_addr":"172.21.15.5:6807/3441513170","heartbeat_front_addr":"172.21.15.5:6805/3441513170","state":["exists","up"]},{"osd":2,"uuid":"9dfd2a3e-7a40-415b-855b-aace5e923ee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6817","nonce":1041667004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6819","nonce":1041667004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6823","nonce":1041667004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1041667004},{"type":"v1","addr":"172.21.15.5:6821","nonce":1041667004}]},"public_addr":"172.21.15.5:6817/1041667004","cluster_addr":"172.21.15.5:6819/1041667004","heartbeat_back_addr":"172.21.15.5:6823/1041667004","heartbeat_front_addr":"172.21.15.5:6821/1041667004","state":["exists","up"]},{"osd":3,"uuid":"117a625d-a91d-4ff9-be04-2441cc71c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6825","nonce":81511064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6827","nonce":81511064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6831","nonce":81511064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":81511064},{"type":"v1","addr":"172.21.15.5:6829","nonce":81511064}]},"public_addr":"172.21.15.5:6825/81511064","cluster_addr":"172.21.15.5:6827/81511064","heartbeat_back_addr":"172.21.15.5:6831/81511064","heartbeat_front_addr":"172.21.15.5:6829/81511064","state":["exists","up"]},{"osd":4,"uuid":"4e2a8368-8e71-4077-b01a-ef05d0e93192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6817","nonce":3896016116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6819","nonce":3896016116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6823","nonce":3896016116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3896016116},{"type":"v1","addr":"172.21.15.112:6821","nonce":3896016116}]},"public_addr":"172.21.15.112:6817/3896016116","cluster_addr":"172.21.15.112:6819/3896016116","heartbeat_back_addr":"172.21.15.112:6823/3896016116","heartbeat_front_addr":"172.21.15.112:6821/3896016116","state":["exists","up"]},{"osd":5,"uuid":"b748812e-fdac-4919-b5c1-50ff24ab3fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6809","nonce":3215612020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6811","nonce":3215612020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6815","nonce":3215612020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3215612020},{"type":"v1","addr":"172.21.15.112:6813","nonce":3215612020}]},"public_addr":"172.21.15.112:6809/3215612020","cluster_addr":"172.21.15.112:6811/3215612020","heartbeat_back_addr":"172.21.15.112:6815/3215612020","heartbeat_front_addr":"172.21.15.112:6813/3215612020","state":["exists","up"]},{"osd":6,"uuid":"d8174fc3-16fc-4611-9604-3faa9fd3c78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6801","nonce":1905123765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6803","nonce":1905123765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6807","nonce":1905123765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1905123765},{"type":"v1","addr":"172.21.15.112:6805","nonce":1905123765}]},"public_addr":"172.21.15.112:6801/1905123765","cluster_addr":"172.21.15.112:6803/1905123765","heartbeat_back_addr":"172.21.15.112:6807/1905123765","heartbeat_front_addr":"172.21.15.112:6805/1905123765","state":["exists","up"]},{"osd":7,"uuid":"18a2d786-9fcc-4477-913b-2d2e2eb4d1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6825","nonce":678489070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6827","nonce":678489070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6831","nonce":678489070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":678489070},{"type":"v1","addr":"172.21.15.112:6829","nonce":678489070}]},"public_addr":"172.21.15.112:6825/678489070","cluster_addr":"172.21.15.112:6827/678489070","heartbeat_back_addr":"172.21.15.112:6831/678489070","heartbeat_front_addr":"172.21.15.112:6829/678489070","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.517444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.537117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.461975+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.457588+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.535259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.554054+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T13:38:09.474045+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2779373791":"2023-10-17T13:49:54.305715+0000","172.21.15.112:6835/2779373791":"2023-10-17T13:49:54.305715+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:50:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.898+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f202806b2f0 msgr2=0x7f202806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.898+0000 7f2041971700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f202806b2f0 0x7f202806d7b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2030000c00 tx=0x7f203001c040 comp rx=0 tx=0).stop 2023-10-16T13:50:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.898+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 msgr2=0x7f203c157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.898+0000 7f2041971700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 0x7f203c157300 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f202c00b4a0 tx=0x7f202c00b860 comp rx=0 tx=0).stop 2023-10-16T13:50:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 shutdown_connections 2023-10-16T13:50:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f203c15eab0 0x7f203c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f202806b2f0 0x7f202806d7b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f203c0cf6d0 0x7f203c0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 --2- 172.21.15.5:0/808207348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f203c0d1d90 0x7f203c157300 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 >> 172.21.15.5:0/808207348 conn(0x7f203c0665a0 msgr2=0x7f203c0b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 shutdown_connections 2023-10-16T13:50:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:00.899+0000 7f2041971700 1 -- 172.21.15.5:0/808207348 wait complete. 2023-10-16T13:50:01.914 INFO:tasks.ceph:Scrubbing osd.0 2023-10-16T13:50:01.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.057+0000 7f5f93252700 1 Processor -- start 2023-10-16T13:50:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.057+0000 7f5f93252700 1 -- start start 2023-10-16T13:50:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f93252700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f8c0cdf40 0x7f5f8c0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f93252700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0b0d30 0x7f5f8c0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f93252700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c0d05e0 con 0x7f5f8c0cf430 2023-10-16T13:50:02.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f93252700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c0b08d0 con 0x7f5f8c0cdf40 2023-10-16T13:50:02.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f93252700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0cfcb0 con 0x7f5f8c0b0d30 2023-10-16T13:50:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f8bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f8c0cf430 0x7f5f8c0ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33004/0 (socket says 172.21.15.5:33004) 2023-10-16T13:50:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f8bfff700 1 -- 172.21.15.5:0/1559303220 learned_addr learned my addr 172.21.15.5:0/1559303220 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f90fee700 1 --2- 172.21.15.5:0/1559303220 >> v2:172.21.15.112:3300/0 conn(0x7f5f8c0cdf40 0x7f5f8c0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f917ef700 1 --2- 172.21.15.5:0/1559303220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0b0d30 0x7f5f8c0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f8b7fe700 1 -- 172.21.15.5:0/1559303220 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068360874 0 0) 0x7f5f8c0d05e0 con 0x7f5f8c0cf430 2023-10-16T13:50:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f8b7fe700 1 -- 172.21.15.5:0/1559303220 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f7c0035b0 con 0x7f5f8c0cf430 2023-10-16T13:50:02.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f917ef700 1 -- 172.21.15.5:0/1559303220 >> v2:172.21.15.112:3300/0 conn(0x7f5f8c0cdf40 msgr2=0x7f5f8c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f917ef700 1 --2- 172.21.15.5:0/1559303220 >> v2:172.21.15.112:3300/0 conn(0x7f5f8c0cdf40 0x7f5f8c0d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f917ef700 1 -- 172.21.15.5:0/1559303220 >> v1:172.21.15.5:6789/0 conn(0x7f5f8c0cf430 legacy=0x7f5f8c0ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f917ef700 1 -- 172.21.15.5:0/1559303220 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c0cff90 con 0x7f5f8c0b0d30 2023-10-16T13:50:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.058+0000 7f5f90fee700 1 --2- 172.21.15.5:0/1559303220 >> v2:172.21.15.112:3300/0 conn(0x7f5f8c0cdf40 0x7f5f8c0d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f917ef700 1 --2- 172.21.15.5:0/1559303220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0b0d30 0x7f5f8c0b11c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b29d93ea44414ab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f8b7fe700 1 -- 172.21.15.5:0/1559303220 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400e070 con 0x7f5f8c0b0d30 2023-10-16T13:50:02.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f8b7fe700 1 -- 172.21.15.5:0/1559303220 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8400bb20 con 0x7f5f8c0b0d30 2023-10-16T13:50:02.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f8b7fe700 1 -- 172.21.15.5:0/1559303220 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400be90 con 0x7f5f8c0b0d30 2023-10-16T13:50:02.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f93252700 1 -- 172.21.15.5:0/1559303220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0b0d30 msgr2=0x7f5f8c0b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f93252700 1 --2- 172.21.15.5:0/1559303220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0b0d30 0x7f5f8c0b11c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f8400b330 comp rx=0 tx=0).stop 2023-10-16T13:50:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f93252700 1 -- 172.21.15.5:0/1559303220 shutdown_connections 2023-10-16T13:50:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.059+0000 7f5f93252700 1 --2- 172.21.15.5:0/1559303220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0b0d30 0x7f5f8c0b11c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.060+0000 7f5f93252700 1 --2- 172.21.15.5:0/1559303220 >> v2:172.21.15.112:3300/0 conn(0x7f5f8c0cdf40 0x7f5f8c0d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.060+0000 7f5f93252700 1 -- 172.21.15.5:0/1559303220 >> 172.21.15.5:0/1559303220 conn(0x7f5f8c0d1530 msgr2=0x7f5f8c0d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.060+0000 7f5f93252700 1 -- 172.21.15.5:0/1559303220 shutdown_connections 2023-10-16T13:50:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.060+0000 7f5f93252700 1 -- 172.21.15.5:0/1559303220 wait complete. 2023-10-16T13:50:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.061+0000 7f5f93252700 1 Processor -- start 2023-10-16T13:50:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.061+0000 7f5f93252700 1 -- start start 2023-10-16T13:50:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f93252700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8c0b0d30 0x7f5f8c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f93252700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0cdf40 0x7f5f8c1e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f93252700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f8c0cf430 0x7f5f8c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f93252700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0b2dc0 con 0x7f5f8c0cf430 2023-10-16T13:50:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f93252700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1e1e50 con 0x7f5f8c0b0d30 2023-10-16T13:50:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f93252700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c14faa0 con 0x7f5f8c0cdf40 2023-10-16T13:50:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.062+0000 7f5f917ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f8c0cf430 0x7f5f8c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f8c0cf430 0x7f5f8c1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51240/0 (socket says 172.21.15.5:51240) 2023-10-16T13:50:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 -- 172.21.15.5:0/2596303910 learned_addr learned my addr 172.21.15.5:0/2596303910 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f8bfff700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0cdf40 0x7f5f8c1e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f90fee700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8c0b0d30 0x7f5f8c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 -- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0cdf40 msgr2=0x7f5f8c1e43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f8c0cdf40 0x7f5f8c1e43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 -- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8c0b0d30 msgr2=0x7f5f8c14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8c0b0d30 0x7f5f8c14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 -- 172.21.15.5:0/2596303910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009430 con 0x7f5f8c0cf430 2023-10-16T13:50:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f917ef700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f8c0cf430 0x7f5f8c1588c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5f84014040 tx=0x7f5f84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84004800 con 0x7f5f8c0cf430 2023-10-16T13:50:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f84020070 con 0x7f5f8c0cf430 2023-10-16T13:50:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f84009a70 con 0x7f5f8c0cf430 2023-10-16T13:50:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840276c0 con 0x7f5f8c0cf430 2023-10-16T13:50:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.063+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c1e20a0 con 0x7f5f8c0cf430 2023-10-16T13:50:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.064+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f8c0d0270 con 0x7f5f8c0cf430 2023-10-16T13:50:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f5f84012430 con 0x7f5f8c0cf430 2023-10-16T13:50:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f897fa700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f7006b2f0 0x7f5f7006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5f84022070 con 0x7f5f8c0cf430 2023-10-16T13:50:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f897fa700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7f5f70071150 0x7f5f70073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 --> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f70073c40 con 0x7f5f70071150 2023-10-16T13:50:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f8408da60 con 0x7f5f8c0cf430 2023-10-16T13:50:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.065+0000 7f5f90fee700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f7006b2f0 0x7f5f7006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.066+0000 7f5f8bfff700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7f5f70071150 0x7f5f70073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.066+0000 7f5f90fee700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f7006b2f0 0x7f5f7006d7b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009d50 tx=0x7f5f800091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.066+0000 7f5f8bfff700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7f5f70071150 0x7f5f70073570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.067+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== osd.0 v2:172.21.15.5:6808/2363290793 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5f70073c40 con 0x7f5f70071150 2023-10-16T13:50:02.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 --> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f8c067d20 con 0x7f5f70071150 2023-10-16T13:50:02.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f897fa700 1 -- 172.21.15.5:0/2596303910 <== osd.0 v2:172.21.15.5:6808/2363290793 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5f8c067d20 con 0x7f5f70071150 2023-10-16T13:50:02.087 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:02.088 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7f5f70071150 msgr2=0x7f5f70073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:6808/2363290793,v1:172.21.15.5:6809/2363290793] conn(0x7f5f70071150 0x7f5f70073570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f7006b2f0 msgr2=0x7f5f7006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f5f7006b2f0 0x7f5f7006d7b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009d50 tx=0x7f5f800091c0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f8c0cf430 msgr2=0x7f5f8c1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 --2- 172.21.15.5:0/2596303910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f8c0cf430 0x7f5f8c1588c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5f84014040 tx=0x7f5f84004ad0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f917ef700 1 -- 172.21.15.5:0/2596303910 reap_dead start 2023-10-16T13:50:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 shutdown_connections 2023-10-16T13:50:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 >> 172.21.15.5:0/2596303910 conn(0x7f5f8c0d1530 msgr2=0x7f5f8c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 shutdown_connections 2023-10-16T13:50:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.082+0000 7f5f93252700 1 -- 172.21.15.5:0/2596303910 wait complete. 2023-10-16T13:50:02.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-16T13:50:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.221+0000 7fe77a5cd700 1 Processor -- start 2023-10-16T13:50:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.221+0000 7fe77a5cd700 1 -- start start 2023-10-16T13:50:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe77a5cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe7740665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe77a5cd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe77406e270 0x7fe77406d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe77a5cd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe77415c010 0x7fe77406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe77a5cd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77415c500 con 0x7fe77415c010 2023-10-16T13:50:02.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe77a5cd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77415c7e0 con 0x7fe77406e270 2023-10-16T13:50:02.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe77a5cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77415cac0 con 0x7fe77415bc30 2023-10-16T13:50:02.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe77415c010 0x7fe77406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe77415c010 0x7fe77406d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51250/0 (socket says 172.21.15.5:51250) 2023-10-16T13:50:02.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 -- 172.21.15.5:0/181529720 learned_addr learned my addr 172.21.15.5:0/181529720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:02.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe773fff700 1 --2- 172.21.15.5:0/181529720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe7740665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe7737fe700 1 --2- 172.21.15.5:0/181529720 >> v2:172.21.15.112:3300/0 conn(0x7fe77406e270 0x7fe77406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 -- 172.21.15.5:0/181529720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 msgr2=0x7fe7740665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 --2- 172.21.15.5:0/181529720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe7740665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 -- 172.21.15.5:0/181529720 >> v2:172.21.15.112:3300/0 conn(0x7fe77406e270 msgr2=0x7fe77406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 --2- 172.21.15.5:0/181529720 >> v2:172.21.15.112:3300/0 conn(0x7fe77406e270 0x7fe77406d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 -- 172.21.15.5:0/181529720 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77415cda0 con 0x7fe77415c010 2023-10-16T13:50:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe778b6a700 1 --2- 172.21.15.5:0/181529720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77415c010 0x7fe77406d8d0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe7740b27c0 tx=0x7fe76c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8841c8eb0cd6ac3d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.222+0000 7fe772ffd700 1 -- 172.21.15.5:0/181529720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00e070 con 0x7fe77415c010 2023-10-16T13:50:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe772ffd700 1 -- 172.21.15.5:0/181529720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c00b9c0 con 0x7fe77415c010 2023-10-16T13:50:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe772ffd700 1 -- 172.21.15.5:0/181529720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00bd70 con 0x7fe77415c010 2023-10-16T13:50:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 -- 172.21.15.5:0/181529720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77415c010 msgr2=0x7fe77406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/181529720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77415c010 0x7fe77406d8d0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe7740b27c0 tx=0x7fe76c00b330 comp rx=0 tx=0).stop 2023-10-16T13:50:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 -- 172.21.15.5:0/181529720 shutdown_connections 2023-10-16T13:50:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/181529720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe77415c010 0x7fe77406d8d0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/181529720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe7740665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/181529720 >> v2:172.21.15.112:3300/0 conn(0x7fe77406e270 0x7fe77406d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 -- 172.21.15.5:0/181529720 >> 172.21.15.5:0/181529720 conn(0x7fe7740cfc40 msgr2=0x7fe7740d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 -- 172.21.15.5:0/181529720 shutdown_connections 2023-10-16T13:50:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.223+0000 7fe77a5cd700 1 -- 172.21.15.5:0/181529720 wait complete. 2023-10-16T13:50:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.224+0000 7fe77a5cd700 1 Processor -- start 2023-10-16T13:50:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 -- start start 2023-10-16T13:50:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe774159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77415c010 0x7fe7740c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 0x7fe7740ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740ca610 con 0x7fe7740c8770 2023-10-16T13:50:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740c8c70 con 0x7fe77415c010 2023-10-16T13:50:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe77a5cd700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740c8f50 con 0x7fe77415bc30 2023-10-16T13:50:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe778b6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 0x7fe7740ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe778b6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 0x7fe7740ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51256/0 (socket says 172.21.15.5:51256) 2023-10-16T13:50:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.225+0000 7fe778b6a700 1 -- 172.21.15.5:0/1964590837 learned_addr learned my addr 172.21.15.5:0/1964590837 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe773fff700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe774159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe7737fe700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77415c010 0x7fe7740c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe778b6a700 1 -- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 msgr2=0x7fe774159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe778b6a700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe774159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe778b6a700 1 -- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77415c010 msgr2=0x7fe7740c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe778b6a700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77415c010 0x7fe7740c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe778b6a700 1 -- 172.21.15.5:0/1964590837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009b30 con 0x7fe7740c8770 2023-10-16T13:50:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe778b6a700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 0x7fe7740ad2e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe7740b2890 tx=0x7fe76c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c004250 con 0x7fe7740c8770 2023-10-16T13:50:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c0043d0 con 0x7fe7740c8770 2023-10-16T13:50:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c004780 con 0x7fe7740c8770 2023-10-16T13:50:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740c9230 con 0x7fe7740c8770 2023-10-16T13:50:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.226+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe774159840 con 0x7fe7740c8770 2023-10-16T13:50:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.227+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7740c9750 con 0x7fe7740c8770 2023-10-16T13:50:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.228+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe76c01b430 con 0x7fe7740c8770 2023-10-16T13:50:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.228+0000 7fe770ff9700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe76006b2f0 0x7fe76006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.228+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe76c08ad00 con 0x7fe7740c8770 2023-10-16T13:50:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.228+0000 7fe773fff700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe76006b2f0 0x7fe76006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.229+0000 7fe773fff700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe76006b2f0 0x7fe76006d7b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe77415aa20 tx=0x7fe764008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.233+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe76c055a50 con 0x7fe7740c8770 2023-10-16T13:50:02.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.434+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe774067d20 con 0x7fe76006b2f0 2023-10-16T13:50:02.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.436+0000 7fe770ff9700 1 -- 172.21.15.5:0/1964590837 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe774067d20 con 0x7fe76006b2f0 2023-10-16T13:50:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe76006b2f0 msgr2=0x7fe76006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe76006b2f0 0x7fe76006d7b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe77415aa20 tx=0x7fe764008040 comp rx=0 tx=0).stop 2023-10-16T13:50:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 msgr2=0x7fe7740ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 0x7fe7740ad2e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe7740b2890 tx=0x7fe76c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 shutdown_connections 2023-10-16T13:50:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7740c8770 0x7fe7740ad2e0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe76006b2f0 0x7fe76006d7b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe77415bc30 0x7fe774159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 --2- 172.21.15.5:0/1964590837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe77415c010 0x7fe7740c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 >> 172.21.15.5:0/1964590837 conn(0x7fe7740cfc40 msgr2=0x7fe77406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 shutdown_connections 2023-10-16T13:50:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.437+0000 7fe77a5cd700 1 -- 172.21.15.5:0/1964590837 wait complete. 2023-10-16T13:50:02.444 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2023-10-16T13:50:02.452 INFO:tasks.ceph:Scrubbing osd.1 2023-10-16T13:50:02.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:02.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.578+0000 7f087dec3700 1 Processor -- start 2023-10-16T13:50:02.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.578+0000 7f087dec3700 1 -- start start 2023-10-16T13:50:02.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f087dec3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08780cdf40 0x7f08780d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f087dec3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08780cf430 0x7f08780ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f087dec3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cc320 0x7f08780cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f087dec3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780d05e0 con 0x7f08780cf430 2023-10-16T13:50:02.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f087dec3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780ce860 con 0x7f08780cdf40 2023-10-16T13:50:02.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f087dec3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b08d0 con 0x7f08780cc320 2023-10-16T13:50:02.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f0876ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08780cf430 0x7f08780ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f0876ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08780cf430 0x7f08780ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51262/0 (socket says 172.21.15.5:51262) 2023-10-16T13:50:02.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.579+0000 7f0876ffd700 1 -- 172.21.15.5:0/296470302 learned_addr learned my addr 172.21.15.5:0/296470302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:02.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0877fff700 1 --2- 172.21.15.5:0/296470302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cc320 0x7f08780cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f08777fe700 1 --2- 172.21.15.5:0/296470302 >> v2:172.21.15.112:3300/0 conn(0x7f08780cdf40 0x7f08780d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0876ffd700 1 -- 172.21.15.5:0/296470302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cc320 msgr2=0x7f08780cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0876ffd700 1 --2- 172.21.15.5:0/296470302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cc320 0x7f08780cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0876ffd700 1 -- 172.21.15.5:0/296470302 >> v2:172.21.15.112:3300/0 conn(0x7f08780cdf40 msgr2=0x7f08780d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:02.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0876ffd700 1 --2- 172.21.15.5:0/296470302 >> v2:172.21.15.112:3300/0 conn(0x7f08780cdf40 0x7f08780d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0876ffd700 1 -- 172.21.15.5:0/296470302 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08780cfcb0 con 0x7f08780cf430 2023-10-16T13:50:02.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f0876ffd700 1 --2- 172.21.15.5:0/296470302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cf430 0x7f08780ce320 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f08780b40f0 tx=0x7f0860009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b42d5b854da40f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f08767fc700 1 -- 172.21.15.5:0/296470302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000b870 con 0x7f08780cf430 2023-10-16T13:50:02.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f08767fc700 1 -- 172.21.15.5:0/296470302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086000b9d0 con 0x7f08780cf430 2023-10-16T13:50:02.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.580+0000 7f08767fc700 1 -- 172.21.15.5:0/296470302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000bd60 con 0x7f08780cf430 2023-10-16T13:50:02.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 -- 172.21.15.5:0/296470302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cf430 msgr2=0x7f08780ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 --2- 172.21.15.5:0/296470302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cf430 0x7f08780ce320 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f08780b40f0 tx=0x7f0860009bd0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 -- 172.21.15.5:0/296470302 shutdown_connections 2023-10-16T13:50:02.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 --2- 172.21.15.5:0/296470302 >> v2:172.21.15.112:3300/0 conn(0x7f08780cdf40 0x7f08780d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 --2- 172.21.15.5:0/296470302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cc320 0x7f08780cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 --2- 172.21.15.5:0/296470302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cf430 0x7f08780ce320 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 -- 172.21.15.5:0/296470302 >> 172.21.15.5:0/296470302 conn(0x7f08780d1530 msgr2=0x7f08780d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 -- 172.21.15.5:0/296470302 shutdown_connections 2023-10-16T13:50:02.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.581+0000 7f087dec3700 1 -- 172.21.15.5:0/296470302 wait complete. 2023-10-16T13:50:02.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.582+0000 7f087dec3700 1 Processor -- start 2023-10-16T13:50:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.582+0000 7f087dec3700 1 -- start start 2023-10-16T13:50:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f087dec3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cc320 0x7f08780b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f087dec3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cdf40 0x7f08780b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f087dec3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08780cf430 0x7f0878158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f087dec3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b5130 con 0x7f08780cc320 2023-10-16T13:50:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f087dec3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780c5af0 con 0x7f08780cf430 2023-10-16T13:50:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f087dec3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b2080 con 0x7f08780cdf40 2023-10-16T13:50:02.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cc320 0x7f08780b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cc320 0x7f08780b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51266/0 (socket says 172.21.15.5:51266) 2023-10-16T13:50:02.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 -- 172.21.15.5:0/4244257414 learned_addr learned my addr 172.21.15.5:0/4244257414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f0877fff700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08780cf430 0x7f0878158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f0876ffd700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cdf40 0x7f08780b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 -- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cdf40 msgr2=0x7f08780b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cdf40 0x7f08780b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 -- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08780cf430 msgr2=0x7f0878158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08780cf430 0x7f0878158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 -- 172.21.15.5:0/4244257414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860009550 con 0x7f08780cc320 2023-10-16T13:50:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f0876ffd700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08780cdf40 0x7f08780b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:50:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.583+0000 7f08777fe700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cc320 0x7f08780b4bf0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f086800d800 tx=0x7f086800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.584+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868017070 con 0x7f08780cc320 2023-10-16T13:50:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.584+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868005a20 con 0x7f08780cc320 2023-10-16T13:50:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.584+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780b2380 con 0x7f08780cc320 2023-10-16T13:50:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.584+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868005bb0 con 0x7f08780cc320 2023-10-16T13:50:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.584+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08780c5d40 con 0x7f08780cc320 2023-10-16T13:50:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.584+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08780d0270 con 0x7f08780cc320 2023-10-16T13:50:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.585+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f08680125f0 con 0x7f08780cc320 2023-10-16T13:50:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.585+0000 7f086ffff700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f085806b2f0 0x7f085806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0868089f40 con 0x7f08780cc320 2023-10-16T13:50:02.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f086ffff700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7f0858071150 0x7f0858073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 --> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0858073c40 con 0x7f0858071150 2023-10-16T13:50:02.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7f086808a2d0 con 0x7f08780cc320 2023-10-16T13:50:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f0876ffd700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f085806b2f0 0x7f085806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f0877fff700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7f0858071150 0x7f0858073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f0877fff700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7f0858071150 0x7f0858073570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.586+0000 7f0876ffd700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f085806b2f0 0x7f085806d7b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0860009c10 tx=0x7f0860008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.587+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== osd.1 v2:172.21.15.5:6800/3441513170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0858073c40 con 0x7f0858071150 2023-10-16T13:50:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 --> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f08780cff90 con 0x7f0858071150 2023-10-16T13:50:02.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f086ffff700 1 -- 172.21.15.5:0/4244257414 <== osd.1 v2:172.21.15.5:6800/3441513170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0870009a10 con 0x7f0858071150 2023-10-16T13:50:02.609 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:02.610 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:02.610 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7f0858071150 msgr2=0x7f0858073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:6800/3441513170,v1:172.21.15.5:6801/3441513170] conn(0x7f0858071150 0x7f0858073570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f085806b2f0 msgr2=0x7f085806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f085806b2f0 0x7f085806d7b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0860009c10 tx=0x7f0860008030 comp rx=0 tx=0).stop 2023-10-16T13:50:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cc320 msgr2=0x7f08780b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 --2- 172.21.15.5:0/4244257414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08780cc320 0x7f08780b4bf0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f086800d800 tx=0x7f086800db10 comp rx=0 tx=0).stop 2023-10-16T13:50:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f0877fff700 1 -- 172.21.15.5:0/4244257414 reap_dead start 2023-10-16T13:50:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 shutdown_connections 2023-10-16T13:50:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 >> 172.21.15.5:0/4244257414 conn(0x7f08780d1530 msgr2=0x7f08780d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 shutdown_connections 2023-10-16T13:50:02.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.602+0000 7f087dec3700 1 -- 172.21.15.5:0/4244257414 wait complete. 2023-10-16T13:50:02.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-16T13:50:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.740+0000 7fe41835a700 1 Processor -- start 2023-10-16T13:50:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.740+0000 7fe41835a700 1 -- start start 2023-10-16T13:50:02.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe41835a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4100cbc40 0x7fe4100b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe41835a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4100ce3b0 con 0x7fe4100cd4b0 2023-10-16T13:50:02.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe41835a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4100b6290 con 0x7fe41015a850 2023-10-16T13:50:02.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe41835a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4100cc220 con 0x7fe4100cbc40 2023-10-16T13:50:02.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe4168f7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4100cbc40 0x7fe4100b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe4158f5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4100cd4b0 0x7fe4100ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33050/0 (socket says 172.21.15.5:33050) 2023-10-16T13:50:02.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.741+0000 7fe4158f5700 1 -- 172.21.15.5:0/2620005524 learned_addr learned my addr 172.21.15.5:0/2620005524 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:02.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4168f7700 1 -- 172.21.15.5:0/2620005524 >> v1:172.21.15.112:6789/0 conn(0x7fe41015a850 legacy=0x7fe4100ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4168f7700 1 -- 172.21.15.5:0/2620005524 >> v1:172.21.15.5:6789/0 conn(0x7fe4100cd4b0 legacy=0x7fe4100ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4150f4700 1 -- 172.21.15.5:0/2620005524 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135842884 0 0) 0x7fe4100ce3b0 con 0x7fe4100cd4b0 2023-10-16T13:50:02.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4168f7700 1 -- 172.21.15.5:0/2620005524 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100cc500 con 0x7fe4100cbc40 2023-10-16T13:50:02.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4168f7700 1 --2- 172.21.15.5:0/2620005524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cbc40 0x7fe4100b2940 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fe408009d90 tx=0x7fe40800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7cbcb9e6a478dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4150f4700 1 -- 172.21.15.5:0/2620005524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800e070 con 0x7fe4100cbc40 2023-10-16T13:50:02.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4150f4700 1 -- 172.21.15.5:0/2620005524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800bbd0 con 0x7fe4100cbc40 2023-10-16T13:50:02.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.742+0000 7fe4150f4700 1 -- 172.21.15.5:0/2620005524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408012430 con 0x7fe4100cbc40 2023-10-16T13:50:02.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 -- 172.21.15.5:0/2620005524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cbc40 msgr2=0x7fe4100b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 --2- 172.21.15.5:0/2620005524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cbc40 0x7fe4100b2940 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fe408009d90 tx=0x7fe40800b330 comp rx=0 tx=0).stop 2023-10-16T13:50:02.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 -- 172.21.15.5:0/2620005524 shutdown_connections 2023-10-16T13:50:02.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 --2- 172.21.15.5:0/2620005524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cbc40 0x7fe4100b2940 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 -- 172.21.15.5:0/2620005524 >> 172.21.15.5:0/2620005524 conn(0x7fe41006dac0 msgr2=0x7fe41006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 -- 172.21.15.5:0/2620005524 shutdown_connections 2023-10-16T13:50:02.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.743+0000 7fe41835a700 1 -- 172.21.15.5:0/2620005524 wait complete. 2023-10-16T13:50:02.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.744+0000 7fe41835a700 1 Processor -- start 2023-10-16T13:50:02.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.744+0000 7fe41835a700 1 -- start start 2023-10-16T13:50:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4100cbc40 0x7fe41015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 0x7fe410146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe41015a850 0x7fe4101472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41015c070 con 0x7fe4100cd4b0 2023-10-16T13:50:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe410147830 con 0x7fe4100cbc40 2023-10-16T13:50:02.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe410159d50 con 0x7fe41015a850 2023-10-16T13:50:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 0x7fe410146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 0x7fe410146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51284/0 (socket says 172.21.15.5:51284) 2023-10-16T13:50:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 -- 172.21.15.5:0/3347355014 learned_addr learned my addr 172.21.15.5:0/3347355014 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4168f7700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe41015a850 0x7fe4101472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4160f6700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4100cbc40 0x7fe41015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 -- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe41015a850 msgr2=0x7fe4101472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe41015a850 0x7fe4101472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 -- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4100cbc40 msgr2=0x7fe41015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4100cbc40 0x7fe41015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 -- 172.21.15.5:0/3347355014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009a70 con 0x7fe4100cd4b0 2023-10-16T13:50:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4160f6700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4100cbc40 0x7fe41015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe4158f5700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 0x7fe410146db0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00c520 tx=0x7fe40c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c004c80 con 0x7fe4100cd4b0 2023-10-16T13:50:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c004e20 con 0x7fe4100cd4b0 2023-10-16T13:50:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41015a030 con 0x7fe4100cd4b0 2023-10-16T13:50:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c007310 con 0x7fe4100cd4b0 2023-10-16T13:50:02.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.745+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41015bc90 con 0x7fe4100cd4b0 2023-10-16T13:50:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.747+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41015c1b0 con 0x7fe4100cd4b0 2023-10-16T13:50:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.747+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe40c007470 con 0x7fe4100cd4b0 2023-10-16T13:50:02.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.747+0000 7fe406ffd700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3f406b2f0 0x7fe3f406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.747+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe40c089550 con 0x7fe4100cd4b0 2023-10-16T13:50:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.748+0000 7fe4160f6700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3f406b2f0 0x7fe3f406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.748+0000 7fe4160f6700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3f406b2f0 0x7fe3f406d7b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe400000f60 tx=0x7fe400009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.752+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe41015c1b0 con 0x7fe4100cd4b0 2023-10-16T13:50:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.954+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4100ccac0 con 0x7fe3f406b2f0 2023-10-16T13:50:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.955+0000 7fe406ffd700 1 -- 172.21.15.5:0/3347355014 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe400014420 con 0x7fe3f406b2f0 2023-10-16T13:50:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3f406b2f0 msgr2=0x7fe3f406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3f406b2f0 0x7fe3f406d7b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe400000f60 tx=0x7fe400009040 comp rx=0 tx=0).stop 2023-10-16T13:50:02.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 msgr2=0x7fe410146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:02.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 0x7fe410146db0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00c520 tx=0x7fe40c00c8e0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 shutdown_connections 2023-10-16T13:50:02.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe3f406b2f0 0x7fe3f406d7b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe41015a850 0x7fe4101472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4100cbc40 0x7fe41015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 --2- 172.21.15.5:0/3347355014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4100cd4b0 0x7fe410146db0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:02.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 >> 172.21.15.5:0/3347355014 conn(0x7fe41006dac0 msgr2=0x7fe4100b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:02.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 shutdown_connections 2023-10-16T13:50:02.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:02.957+0000 7fe41835a700 1 -- 172.21.15.5:0/3347355014 wait complete. 2023-10-16T13:50:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2023-10-16T13:50:02.972 INFO:tasks.ceph:Scrubbing osd.2 2023-10-16T13:50:02.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:03.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.099+0000 7f5808af8700 1 Processor -- start 2023-10-16T13:50:03.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.099+0000 7f5808af8700 1 -- start start 2023-10-16T13:50:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5808af8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58040727e0 0x7f58040b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5808af8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5808af8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58040b2e40 con 0x7f5804151680 2023-10-16T13:50:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5808af8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580406e420 con 0x7f58040727e0 2023-10-16T13:50:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5808af8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580415e7c0 con 0x7f580406da30 2023-10-16T13:50:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5802d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5801d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58040727e0 0x7f58040b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f580259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5804151680 0x7f580415ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:52270/0 (socket says 172.21.15.5:52270) 2023-10-16T13:50:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5802d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580406dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49198/0 (socket says 172.21.15.5:49198) 2023-10-16T13:50:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f580259c700 1 -- 172.21.15.5:0/2987401800 learned_addr learned my addr 172.21.15.5:0/2987401800 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5802d9d700 1 -- 172.21.15.5:0/2987401800 >> v2:172.21.15.112:3300/0 conn(0x7f58040727e0 msgr2=0x7f58040b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5802d9d700 1 --2- 172.21.15.5:0/2987401800 >> v2:172.21.15.112:3300/0 conn(0x7f58040727e0 0x7f58040b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5802d9d700 1 -- 172.21.15.5:0/2987401800 >> v1:172.21.15.112:6789/0 conn(0x7f5804151680 legacy=0x7f580415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5802d9d700 1 -- 172.21.15.5:0/2987401800 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040b2880 con 0x7f580406da30 2023-10-16T13:50:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.100+0000 7f5801d9b700 1 --2- 172.21.15.5:0/2987401800 >> v2:172.21.15.112:3300/0 conn(0x7f58040727e0 0x7f58040b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5802d9d700 1 --2- 172.21.15.5:0/2987401800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580406dee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009d90 tx=0x7f57fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d5cee550ad40b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f580159a700 1 -- 172.21.15.5:0/2987401800 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00e070 con 0x7f580406da30 2023-10-16T13:50:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f580159a700 1 -- 172.21.15.5:0/2987401800 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00bb20 con 0x7f580406da30 2023-10-16T13:50:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f580159a700 1 -- 172.21.15.5:0/2987401800 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc012430 con 0x7f580406da30 2023-10-16T13:50:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 -- 172.21.15.5:0/2987401800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 msgr2=0x7f580406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 --2- 172.21.15.5:0/2987401800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580406dee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009d90 tx=0x7f57fc00b330 comp rx=0 tx=0).stop 2023-10-16T13:50:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 -- 172.21.15.5:0/2987401800 shutdown_connections 2023-10-16T13:50:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 --2- 172.21.15.5:0/2987401800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580406dee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 --2- 172.21.15.5:0/2987401800 >> v2:172.21.15.112:3300/0 conn(0x7f58040727e0 0x7f58040b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 -- 172.21.15.5:0/2987401800 >> 172.21.15.5:0/2987401800 conn(0x7f580406bd70 msgr2=0x7f580406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 -- 172.21.15.5:0/2987401800 shutdown_connections 2023-10-16T13:50:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.101+0000 7f5808af8700 1 -- 172.21.15.5:0/2987401800 wait complete. 2023-10-16T13:50:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 Processor -- start 2023-10-16T13:50:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 -- start start 2023-10-16T13:50:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58040727e0 0x7f58040c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5804151680 0x7f58040cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040c74d0 con 0x7f5804151680 2023-10-16T13:50:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040c77b0 con 0x7f58040727e0 2023-10-16T13:50:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.103+0000 7f5808af8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040c7a90 con 0x7f580406da30 2023-10-16T13:50:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5804151680 0x7f58040cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5804151680 0x7f58040cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51300/0 (socket says 172.21.15.5:51300) 2023-10-16T13:50:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 -- 172.21.15.5:0/2798952181 learned_addr learned my addr 172.21.15.5:0/2798952181 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f580259c700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5801d9b700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58040727e0 0x7f58040c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 -- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 msgr2=0x7f580414e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f580406da30 0x7f580414e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 -- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58040727e0 msgr2=0x7f58040c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58040727e0 0x7f58040c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 -- 172.21.15.5:0/2798952181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80094a0 con 0x7f5804151680 2023-10-16T13:50:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5802d9d700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5804151680 0x7f58040cba10 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f57fc014040 tx=0x7f57fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc012430 con 0x7f5804151680 2023-10-16T13:50:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc020070 con 0x7f5804151680 2023-10-16T13:50:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc004280 con 0x7f5804151680 2023-10-16T13:50:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc009a70 con 0x7f5804151680 2023-10-16T13:50:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.104+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58040c8050 con 0x7f5804151680 2023-10-16T13:50:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.105+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f580415e450 con 0x7f5804151680 2023-10-16T13:50:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.106+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f57fc0043e0 con 0x7f5804151680 2023-10-16T13:50:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.106+0000 7f57f2ffd700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57e406b2f0 0x7f57e406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.106+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57fc022070 con 0x7f5804151680 2023-10-16T13:50:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f57f2ffd700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7f57e4071150 0x7f57e4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 --> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57e4073c40 con 0x7f57e4071150 2023-10-16T13:50:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57fc08bea0 con 0x7f5804151680 2023-10-16T13:50:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f580259c700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57e406b2f0 0x7f57e406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f5801d9b700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7f57e4071150 0x7f57e4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f5801d9b700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7f57e4071150 0x7f57e4073570 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.107+0000 7f580259c700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57e406b2f0 0x7f57e406d7b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f57f4000f60 tx=0x7f57f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.108+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== osd.2 v2:172.21.15.5:6816/1041667004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f57e4073c40 con 0x7f57e4071150 2023-10-16T13:50:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.122+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 --> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58040b2b60 con 0x7f57e4071150 2023-10-16T13:50:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f57f2ffd700 1 -- 172.21.15.5:0/2798952181 <== osd.2 v2:172.21.15.5:6816/1041667004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57f8009950 con 0x7f57e4071150 2023-10-16T13:50:03.126 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:03.127 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:03.127 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:03.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7f57e4071150 msgr2=0x7f57e4073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:6816/1041667004,v1:172.21.15.5:6817/1041667004] conn(0x7f57e4071150 0x7f57e4073570 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57e406b2f0 msgr2=0x7f57e406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f57e406b2f0 0x7f57e406d7b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f57f4000f60 tx=0x7f57f4009040 comp rx=0 tx=0).stop 2023-10-16T13:50:03.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5804151680 msgr2=0x7f58040cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 --2- 172.21.15.5:0/2798952181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5804151680 0x7f58040cba10 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f57fc014040 tx=0x7f57fc004ad0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5802d9d700 1 -- 172.21.15.5:0/2798952181 reap_dead start 2023-10-16T13:50:03.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 shutdown_connections 2023-10-16T13:50:03.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 >> 172.21.15.5:0/2798952181 conn(0x7f580406bd70 msgr2=0x7f58040d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 shutdown_connections 2023-10-16T13:50:03.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.123+0000 7f5808af8700 1 -- 172.21.15.5:0/2798952181 wait complete. 2023-10-16T13:50:03.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-16T13:50:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.261+0000 7f1a69ce8700 1 Processor -- start 2023-10-16T13:50:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.261+0000 7f1a69ce8700 1 -- start start 2023-10-16T13:50:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a69ce8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a6406d390 0x7f1a640cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a69ce8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a640ce460 0x7f1a6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a69ce8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a640ca570 con 0x7f1a6406d770 2023-10-16T13:50:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a69ce8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640cb0d0 con 0x7f1a640ce460 2023-10-16T13:50:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a69ce8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6415f1d0 con 0x7f1a6406d390 2023-10-16T13:50:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a6406d390 0x7f1a640cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a63fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a640ce460 0x7f1a6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a62ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1a6406d770 0x7f1a640cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:52286/0 (socket says 172.21.15.5:52286) 2023-10-16T13:50:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a62ffd700 1 -- 172.21.15.5:0/1562618527 learned_addr learned my addr 172.21.15.5:0/1562618527 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a6406d390 0x7f1a640cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49210/0 (socket says 172.21.15.5:49210) 2023-10-16T13:50:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a63fff700 1 -- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a6406d390 msgr2=0x7f1a640cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a63fff700 1 --2- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a6406d390 0x7f1a640cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a63fff700 1 -- 172.21.15.5:0/1562618527 >> v1:172.21.15.112:6789/0 conn(0x7f1a6406d770 legacy=0x7f1a640cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a63fff700 1 -- 172.21.15.5:0/1562618527 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640ca7a0 con 0x7f1a640ce460 2023-10-16T13:50:03.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.262+0000 7f1a627fc700 1 -- 172.21.15.5:0/1562618527 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510430049 0 0) 0x7f1a640ca570 con 0x7f1a6406d770 2023-10-16T13:50:03.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a63fff700 1 --2- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a640ce460 0x7f1a6406a840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009d90 tx=0x7f1a5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f8cb6bbe0578a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a627fc700 1 -- 172.21.15.5:0/1562618527 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400e070 con 0x7f1a640ce460 2023-10-16T13:50:03.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a627fc700 1 -- 172.21.15.5:0/1562618527 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5400bb20 con 0x7f1a640ce460 2023-10-16T13:50:03.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a627fc700 1 -- 172.21.15.5:0/1562618527 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54012430 con 0x7f1a640ce460 2023-10-16T13:50:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 -- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a640ce460 msgr2=0x7f1a6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a640ce460 0x7f1a6406a840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009d90 tx=0x7f1a5400b330 comp rx=0 tx=0).stop 2023-10-16T13:50:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 -- 172.21.15.5:0/1562618527 shutdown_connections 2023-10-16T13:50:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a640ce460 0x7f1a6406a840 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/1562618527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a6406d390 0x7f1a640cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 -- 172.21.15.5:0/1562618527 >> 172.21.15.5:0/1562618527 conn(0x7f1a640cfc40 msgr2=0x7f1a640d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.263+0000 7f1a69ce8700 1 -- 172.21.15.5:0/1562618527 shutdown_connections 2023-10-16T13:50:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.264+0000 7f1a69ce8700 1 -- 172.21.15.5:0/1562618527 wait complete. 2023-10-16T13:50:03.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.265+0000 7f1a69ce8700 1 Processor -- start 2023-10-16T13:50:03.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.265+0000 7f1a69ce8700 1 -- start start 2023-10-16T13:50:03.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6406d390 0x7f1a640c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 0x7f1a640b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a640ce460 0x7f1a640b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640b28c0 con 0x7f1a6406d770 2023-10-16T13:50:03.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640c90c0 con 0x7f1a6406d390 2023-10-16T13:50:03.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640c93a0 con 0x7f1a640ce460 2023-10-16T13:50:03.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 0x7f1a640b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 0x7f1a640b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51312/0 (socket says 172.21.15.5:51312) 2023-10-16T13:50:03.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6406d390 0x7f1a640c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 -- 172.21.15.5:0/108560861 learned_addr learned my addr 172.21.15.5:0/108560861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:03.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a63fff700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a640ce460 0x7f1a640b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 -- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a640ce460 msgr2=0x7f1a640b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a640ce460 0x7f1a640b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 -- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6406d390 msgr2=0x7f1a640c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6406d390 0x7f1a640c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 -- 172.21.15.5:0/108560861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009a70 con 0x7f1a6406d770 2023-10-16T13:50:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a62ffd700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 0x7f1a640b0750 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800c550 tx=0x7f1a5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58004c80 con 0x7f1a6406d770 2023-10-16T13:50:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a58004e00 con 0x7f1a6406d770 2023-10-16T13:50:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a640c9680 con 0x7f1a6406d770 2023-10-16T13:50:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.266+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58007310 con 0x7f1a6406d770 2023-10-16T13:50:03.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.267+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a640c8c80 con 0x7f1a6406d770 2023-10-16T13:50:03.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.268+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a64067d20 con 0x7f1a6406d770 2023-10-16T13:50:03.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.268+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f1a58007470 con 0x7f1a6406d770 2023-10-16T13:50:03.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.268+0000 7f1a4bfff700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a5006b2f0 0x7f1a5006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.269+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a58089410 con 0x7f1a6406d770 2023-10-16T13:50:03.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.269+0000 7f1a637fe700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a5006b2f0 0x7f1a5006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.269+0000 7f1a637fe700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a5006b2f0 0x7f1a5006d7b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009b40 tx=0x7f1a5c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.273+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a58054400 con 0x7f1a6406d770 2023-10-16T13:50:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.473+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a640cad60 con 0x7f1a5006b2f0 2023-10-16T13:50:03.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.474+0000 7f1a4bfff700 1 -- 172.21.15.5:0/108560861 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a5c004020 con 0x7f1a5006b2f0 2023-10-16T13:50:03.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a5006b2f0 msgr2=0x7f1a5006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a5006b2f0 0x7f1a5006d7b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009b40 tx=0x7f1a5c009210 comp rx=0 tx=0).stop 2023-10-16T13:50:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 msgr2=0x7f1a640b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 0x7f1a640b0750 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800c550 tx=0x7f1a5800c860 comp rx=0 tx=0).stop 2023-10-16T13:50:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 shutdown_connections 2023-10-16T13:50:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1a5006b2f0 0x7f1a5006d7b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a640ce460 0x7f1a640b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6406d390 0x7f1a640c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 --2- 172.21.15.5:0/108560861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a6406d770 0x7f1a640b0750 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 >> 172.21.15.5:0/108560861 conn(0x7f1a640cfc40 msgr2=0x7f1a6406ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 shutdown_connections 2023-10-16T13:50:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.476+0000 7f1a69ce8700 1 -- 172.21.15.5:0/108560861 wait complete. 2023-10-16T13:50:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2023-10-16T13:50:03.491 INFO:tasks.ceph:Scrubbing osd.3 2023-10-16T13:50:03.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:03.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.618+0000 7fc2a3680700 1 Processor -- start 2023-10-16T13:50:03.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.618+0000 7fc2a3680700 1 -- start start 2023-10-16T13:50:03.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a3680700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c162070 0x7fc29c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a3680700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc29c0cd870 0x7fc29c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a3680700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0cee20 con 0x7fc29c15d840 2023-10-16T13:50:03.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a3680700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0cdd20 con 0x7fc29c0cd870 2023-10-16T13:50:03.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a3680700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b2ce0 con 0x7fc29c162070 2023-10-16T13:50:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a141c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc29c15d840 0x7fc29c0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33090/0 (socket says 172.21.15.5:33090) 2023-10-16T13:50:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a141c700 1 -- 172.21.15.5:0/1476362507 learned_addr learned my addr 172.21.15.5:0/1476362507 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/1476362507 >> v2:172.21.15.112:3300/0 conn(0x7fc29c0cd870 0x7fc29c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.619+0000 7fc2a0c1b700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c162070 0x7fc29c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433968113 0 0) 0x7fc29c0cee20 con 0x7fc29c15d840 2023-10-16T13:50:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2880035b0 con 0x7fc29c15d840 2023-10-16T13:50:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1154647384 0 0) 0x7fc2880035b0 con 0x7fc29c15d840 2023-10-16T13:50:03.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c162070 msgr2=0x7fc29c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c162070 0x7fc29c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 >> v2:172.21.15.112:3300/0 conn(0x7fc29c0cd870 msgr2=0x7fc29c0caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 --2- 172.21.15.5:0/1476362507 >> v2:172.21.15.112:3300/0 conn(0x7fc29c0cd870 0x7fc29c0caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0ceb40 con 0x7fc29c15d840 2023-10-16T13:50:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fc28c001670 con 0x7fc29c15d840 2023-10-16T13:50:03.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 >> v1:172.21.15.5:6789/0 conn(0x7fc29c15d840 legacy=0x7fc29c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc288003a00 0x7fc288003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2880043f0 0x7fc2880048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc288004f40 0x7fc28800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0cdd20 con 0x7fc288004f40 2023-10-16T13:50:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b2ce0 con 0x7fc2880043f0 2023-10-16T13:50:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28800bf50 con 0x7fc288003a00 2023-10-16T13:50:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/1476362507 >> v2:172.21.15.112:3300/0 conn(0x7fc29c0cd870 0x7fc29c0caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:03.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a0c1b700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c162070 0x7fc29c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:03.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc288004f40 0x7fc28800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a141c700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc288003a00 0x7fc288003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a0c1b700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2880043f0 0x7fc2880048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc288003a00 msgr2=0x7fc288003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc288003a00 0x7fc288003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2880043f0 msgr2=0x7fc2880048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2880043f0 0x7fc2880048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.620+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/1476362507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880035b0 con 0x7fc288004f40 2023-10-16T13:50:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc288004f40 0x7fc28800ba10 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc29400e350 tx=0x7fc288005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11900fd9cbc176af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400ee10 con 0x7fc288004f40 2023-10-16T13:50:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400f040 con 0x7fc288004f40 2023-10-16T13:50:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc293fff700 1 -- 172.21.15.5:0/1476362507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294003c40 con 0x7fc288004f40 2023-10-16T13:50:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a3680700 1 -- 172.21.15.5:0/1476362507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc288004f40 msgr2=0x7fc28800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a3680700 1 --2- 172.21.15.5:0/1476362507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc288004f40 0x7fc28800ba10 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc29400e350 tx=0x7fc288005880 comp rx=0 tx=0).stop 2023-10-16T13:50:03.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/1476362507 reap_dead start 2023-10-16T13:50:03.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a3680700 1 -- 172.21.15.5:0/1476362507 shutdown_connections 2023-10-16T13:50:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a3680700 1 -- 172.21.15.5:0/1476362507 >> 172.21.15.5:0/1476362507 conn(0x7fc29c06bd70 msgr2=0x7fc29c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a3680700 1 -- 172.21.15.5:0/1476362507 shutdown_connections 2023-10-16T13:50:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.621+0000 7fc2a3680700 1 -- 172.21.15.5:0/1476362507 wait complete. 2023-10-16T13:50:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 Processor -- start 2023-10-16T13:50:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 -- start start 2023-10-16T13:50:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29c156540 0x7fc29c160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c0af370 0x7fc29c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc29c0b37e0 0x7fc29c0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0ae0a0 con 0x7fc29c0b37e0 2023-10-16T13:50:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b60d0 con 0x7fc29c156540 2023-10-16T13:50:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a3680700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0aeee0 con 0x7fc29c0af370 2023-10-16T13:50:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a1c1d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc29c0b37e0 0x7fc29c0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a1c1d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc29c0b37e0 0x7fc29c0b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51332/0 (socket says 172.21.15.5:51332) 2023-10-16T13:50:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/48955491 learned_addr learned my addr 172.21.15.5:0/48955491 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.623+0000 7fc2a141c700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29c156540 0x7fc29c160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a0c1b700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c0af370 0x7fc29c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c0af370 msgr2=0x7fc29c0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29c0af370 0x7fc29c0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29c156540 msgr2=0x7fc29c160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29c156540 0x7fc29c160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/48955491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0b41b0 con 0x7fc29c0b37e0 2023-10-16T13:50:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a1c1d700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc29c0b37e0 0x7fc29c0b3c70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc288005730 tx=0x7fc294009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294004440 con 0x7fc29c0b37e0 2023-10-16T13:50:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2940045c0 con 0x7fc29c0b37e0 2023-10-16T13:50:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c0ae2d0 con 0x7fc29c0b37e0 2023-10-16T13:50:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294004970 con 0x7fc29c0b37e0 2023-10-16T13:50:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.624+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0ae890 con 0x7fc29c0b37e0 2023-10-16T13:50:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.625+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc29c161870 con 0x7fc29c0b37e0 2023-10-16T13:50:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fc294024070 con 0x7fc29c0b37e0 2023-10-16T13:50:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc291ffb700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc28006b2f0 0x7fc28006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc29408bb20 con 0x7fc29c0b37e0 2023-10-16T13:50:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc291ffb700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7fc280071150 0x7fc280073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 --> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc280073c40 con 0x7fc280071150 2023-10-16T13:50:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc29400e030 con 0x7fc29c0b37e0 2023-10-16T13:50:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.626+0000 7fc2a141c700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc28006b2f0 0x7fc28006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.627+0000 7fc2a0c1b700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7fc280071150 0x7fc280073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.627+0000 7fc2a0c1b700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7fc280071150 0x7fc280073570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.627+0000 7fc2a141c700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc28006b2f0 0x7fc28006d7b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc28c000c00 tx=0x7fc28c007980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.627+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== osd.3 v2:172.21.15.5:6824/81511064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc280073c40 con 0x7fc280071150 2023-10-16T13:50:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.642+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 --> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc29c161590 con 0x7fc280071150 2023-10-16T13:50:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.642+0000 7fc291ffb700 1 -- 172.21.15.5:0/48955491 <== osd.3 v2:172.21.15.5:6824/81511064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc298009df0 con 0x7fc280071150 2023-10-16T13:50:03.653 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:03.653 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:03.654 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.642+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7fc280071150 msgr2=0x7fc280073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:6824/81511064,v1:172.21.15.5:6825/81511064] conn(0x7fc280071150 0x7fc280073570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc28006b2f0 msgr2=0x7fc28006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fc28006b2f0 0x7fc28006d7b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc28c000c00 tx=0x7fc28c007980 comp rx=0 tx=0).stop 2023-10-16T13:50:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc29c0b37e0 msgr2=0x7fc29c0b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 --2- 172.21.15.5:0/48955491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc29c0b37e0 0x7fc29c0b3c70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc288005730 tx=0x7fc294009750 comp rx=0 tx=0).stop 2023-10-16T13:50:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a1c1d700 1 -- 172.21.15.5:0/48955491 reap_dead start 2023-10-16T13:50:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 shutdown_connections 2023-10-16T13:50:03.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 >> 172.21.15.5:0/48955491 conn(0x7fc29c06bd70 msgr2=0x7fc29c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 shutdown_connections 2023-10-16T13:50:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.643+0000 7fc2a3680700 1 -- 172.21.15.5:0/48955491 wait complete. 2023-10-16T13:50:03.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-16T13:50:03.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.783+0000 7f698b047700 1 Processor -- start 2023-10-16T13:50:03.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.783+0000 7f698b047700 1 -- start start 2023-10-16T13:50:03.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f698b047700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f698406daa0 0x7f69840cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f698b047700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69840ce5f0 0x7f69840cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f698b047700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840cef40 con 0x7f698415a280 2023-10-16T13:50:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f698b047700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6984072200 con 0x7f698406daa0 2023-10-16T13:50:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f698b047700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840cf1d0 con 0x7f69840ce5f0 2023-10-16T13:50:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f698406daa0 0x7f69840cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f698406daa0 0x7f69840cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51340/0 (socket says 172.21.15.5:51340) 2023-10-16T13:50:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 -- 172.21.15.5:0/2587078730 learned_addr learned my addr 172.21.15.5:0/2587078730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f69895e4700 1 --2- 172.21.15.5:0/2587078730 >> v2:172.21.15.112:3300/0 conn(0x7f69840ce5f0 0x7f69840cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 -- 172.21.15.5:0/2587078730 >> v2:172.21.15.112:3300/0 conn(0x7f69840ce5f0 msgr2=0x7f69840cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 --2- 172.21.15.5:0/2587078730 >> v2:172.21.15.112:3300/0 conn(0x7f69840ce5f0 0x7f69840cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 -- 172.21.15.5:0/2587078730 >> v1:172.21.15.112:6789/0 conn(0x7f698415a280 legacy=0x7f698406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 -- 172.21.15.5:0/2587078730 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840cafb0 con 0x7f698406daa0 2023-10-16T13:50:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f69895e4700 1 --2- 172.21.15.5:0/2587078730 >> v2:172.21.15.112:3300/0 conn(0x7f69840ce5f0 0x7f69840cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f6983fff700 1 --2- 172.21.15.5:0/2587078730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840cbd70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f698415dc00 tx=0x7f6970009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ec102ab884bfac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f69837fe700 1 -- 172.21.15.5:0/2587078730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970004230 con 0x7f698406daa0 2023-10-16T13:50:03.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f69837fe700 1 -- 172.21.15.5:0/2587078730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970004390 con 0x7f698406daa0 2023-10-16T13:50:03.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.784+0000 7f69837fe700 1 -- 172.21.15.5:0/2587078730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700036a0 con 0x7f698406daa0 2023-10-16T13:50:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 -- 172.21.15.5:0/2587078730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 msgr2=0x7f69840cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 --2- 172.21.15.5:0/2587078730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840cbd70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f698415dc00 tx=0x7f6970009bd0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 -- 172.21.15.5:0/2587078730 shutdown_connections 2023-10-16T13:50:03.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 --2- 172.21.15.5:0/2587078730 >> v2:172.21.15.112:3300/0 conn(0x7f69840ce5f0 0x7f69840cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 --2- 172.21.15.5:0/2587078730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840cbd70 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 -- 172.21.15.5:0/2587078730 >> 172.21.15.5:0/2587078730 conn(0x7f69840cfc40 msgr2=0x7f69840d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:03.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 -- 172.21.15.5:0/2587078730 shutdown_connections 2023-10-16T13:50:03.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.785+0000 7f698b047700 1 -- 172.21.15.5:0/2587078730 wait complete. 2023-10-16T13:50:03.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.786+0000 7f698b047700 1 Processor -- start 2023-10-16T13:50:03.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.786+0000 7f698b047700 1 -- start start 2023-10-16T13:50:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f698b047700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f698b047700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69840ce5f0 0x7f6984151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f698b047700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f698415a280 0x7f69841571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f698b047700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698415b5c0 con 0x7f698406daa0 2023-10-16T13:50:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f698b047700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984151c80 con 0x7f698415a280 2023-10-16T13:50:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f698b047700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698415a9b0 con 0x7f69840ce5f0 2023-10-16T13:50:03.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f6988de3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f6988de3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51346/0 (socket says 172.21.15.5:51346) 2023-10-16T13:50:03.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f6988de3700 1 -- 172.21.15.5:0/1336187655 learned_addr learned my addr 172.21.15.5:0/1336187655 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:03.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f69895e4700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f698415a280 0x7f69841571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.787+0000 7f6983fff700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69840ce5f0 0x7f6984151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6988de3700 1 -- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69840ce5f0 msgr2=0x7f6984151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6988de3700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69840ce5f0 0x7f6984151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6988de3700 1 -- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f698415a280 msgr2=0x7f69841571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6988de3700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f698415a280 0x7f69841571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6988de3700 1 -- 172.21.15.5:0/1336187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009550 con 0x7f698406daa0 2023-10-16T13:50:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6983fff700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69840ce5f0 0x7f6984151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:50:03.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f6988de3700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840c6d10 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f697800c500 tx=0x7f697800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978011790 con 0x7f698406daa0 2023-10-16T13:50:03.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69780118f0 con 0x7f698406daa0 2023-10-16T13:50:03.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698415ac90 con 0x7f698406daa0 2023-10-16T13:50:03.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978011ca0 con 0x7f698406daa0 2023-10-16T13:50:03.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.788+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698415b250 con 0x7f698406daa0 2023-10-16T13:50:03.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.789+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6984067d20 con 0x7f698406daa0 2023-10-16T13:50:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.790+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f697801c460 con 0x7f698406daa0 2023-10-16T13:50:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.790+0000 7f69817fa700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f696806b320 0x7f696806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.790+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6978089760 con 0x7f698406daa0 2023-10-16T13:50:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.790+0000 7f6983fff700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f696806b320 0x7f696806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.791+0000 7f6983fff700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f696806b320 0x7f696806d7e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f698415dc00 tx=0x7f6970008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.795+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f69780545c0 con 0x7f698406daa0 2023-10-16T13:50:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.996+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f69840cb570 con 0x7f696806b320 2023-10-16T13:50:03.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.996+0000 7f69817fa700 1 -- 172.21.15.5:0/1336187655 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6970020070 con 0x7f696806b320 2023-10-16T13:50:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f696806b320 msgr2=0x7f696806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f696806b320 0x7f696806d7e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f698415dc00 tx=0x7f6970008030 comp rx=0 tx=0).stop 2023-10-16T13:50:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 msgr2=0x7f69840c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840c6d10 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f697800c500 tx=0x7f697800c810 comp rx=0 tx=0).stop 2023-10-16T13:50:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 shutdown_connections 2023-10-16T13:50:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f698415a280 0x7f69841571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698406daa0 0x7f69840c6d10 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f696806b320 0x7f696806d7e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 --2- 172.21.15.5:0/1336187655 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69840ce5f0 0x7f6984151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 >> 172.21.15.5:0/1336187655 conn(0x7f69840cfc40 msgr2=0x7f69840665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.998+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 shutdown_connections 2023-10-16T13:50:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:03.999+0000 7f698b047700 1 -- 172.21.15.5:0/1336187655 wait complete. 2023-10-16T13:50:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2023-10-16T13:50:04.013 INFO:tasks.ceph:Scrubbing osd.4 2023-10-16T13:50:04.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.140+0000 7fdc506a5700 1 Processor -- start 2023-10-16T13:50:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.140+0000 7fdc506a5700 1 -- start start 2023-10-16T13:50:04.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc506a5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc4815d840 0x7fdc48162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc506a5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc480cdfd0 0x7fdc480ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc506a5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cd330 0x7fdc480cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc506a5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480cdce0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc506a5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480cee20 con 0x7fdc4815d840 2023-10-16T13:50:04.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc506a5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480b2ce0 con 0x7fdc480cd330 2023-10-16T13:50:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc480cdfd0 0x7fdc480ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc480cdfd0 0x7fdc480ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51354/0 (socket says 172.21.15.5:51354) 2023-10-16T13:50:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 -- 172.21.15.5:0/1066255110 learned_addr learned my addr 172.21.15.5:0/1066255110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4ec42700 1 --2- 172.21.15.5:0/1066255110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cd330 0x7fdc480cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4e441700 1 --2- 172.21.15.5:0/1066255110 >> v2:172.21.15.112:3300/0 conn(0x7fdc4815d840 0x7fdc48162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 -- 172.21.15.5:0/1066255110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cd330 msgr2=0x7fdc480cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 --2- 172.21.15.5:0/1066255110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cd330 0x7fdc480cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 -- 172.21.15.5:0/1066255110 >> v2:172.21.15.112:3300/0 conn(0x7fdc4815d840 msgr2=0x7fdc48162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 --2- 172.21.15.5:0/1066255110 >> v2:172.21.15.112:3300/0 conn(0x7fdc4815d840 0x7fdc48162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.141+0000 7fdc4dc40700 1 -- 172.21.15.5:0/1066255110 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480ceb40 con 0x7fdc480cdfd0 2023-10-16T13:50:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc4dc40700 1 --2- 172.21.15.5:0/1066255110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc480ce450 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fdc4806b8a0 tx=0x7fdc44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cbe7f2cea47968 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc4d43f700 1 -- 172.21.15.5:0/1066255110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400b870 con 0x7fdc480cdfd0 2023-10-16T13:50:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc4d43f700 1 -- 172.21.15.5:0/1066255110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400b9d0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc4d43f700 1 -- 172.21.15.5:0/1066255110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400bd60 con 0x7fdc480cdfd0 2023-10-16T13:50:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 -- 172.21.15.5:0/1066255110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 msgr2=0x7fdc480ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 --2- 172.21.15.5:0/1066255110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc480ce450 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fdc4806b8a0 tx=0x7fdc44009bd0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 -- 172.21.15.5:0/1066255110 shutdown_connections 2023-10-16T13:50:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 --2- 172.21.15.5:0/1066255110 >> v2:172.21.15.112:3300/0 conn(0x7fdc4815d840 0x7fdc48162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 --2- 172.21.15.5:0/1066255110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cd330 0x7fdc480cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 --2- 172.21.15.5:0/1066255110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc480ce450 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 -- 172.21.15.5:0/1066255110 >> 172.21.15.5:0/1066255110 conn(0x7fdc4806bd70 msgr2=0x7fdc4806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 -- 172.21.15.5:0/1066255110 shutdown_connections 2023-10-16T13:50:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.142+0000 7fdc506a5700 1 -- 172.21.15.5:0/1066255110 wait complete. 2023-10-16T13:50:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 Processor -- start 2023-10-16T13:50:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 -- start start 2023-10-16T13:50:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cd330 0x7fdc4815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc481556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc4815d840 0x7fdc48155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48156230 con 0x7fdc480cdfd0 2023-10-16T13:50:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48156510 con 0x7fdc480cd330 2023-10-16T13:50:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.144+0000 7fdc506a5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481567f0 con 0x7fdc4815d840 2023-10-16T13:50:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc481556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc481556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51362/0 (socket says 172.21.15.5:51362) 2023-10-16T13:50:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 -- 172.21.15.5:0/810884194 learned_addr learned my addr 172.21.15.5:0/810884194 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4e441700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cd330 0x7fdc4815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4ec42700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc4815d840 0x7fdc48155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 -- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc4815d840 msgr2=0x7fdc48155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc4815d840 0x7fdc48155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 -- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cd330 msgr2=0x7fdc4815fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cd330 0x7fdc4815fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 -- 172.21.15.5:0/810884194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44009550 con 0x7fdc480cdfd0 2023-10-16T13:50:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc4dc40700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc481556b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fdc44000c00 tx=0x7fdc44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44004480 con 0x7fdc480cdfd0 2023-10-16T13:50:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc440045e0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc506a5700 1 -- 172.21.15.5:0/810884194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc48156ad0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440038e0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.145+0000 7fdc506a5700 1 -- 172.21.15.5:0/810884194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc48160220 con 0x7fdc480cdfd0 2023-10-16T13:50:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.146+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc24000fc0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fdc44021070 con 0x7fdc480cdfd0 2023-10-16T13:50:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc3effd700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdc2c06b2f0 0x7fdc2c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdc4408af60 con 0x7fdc480cdfd0 2023-10-16T13:50:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc3effd700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fdc2c071150 0x7fdc2c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 --> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc2c073c40 con 0x7fdc2c071150 2023-10-16T13:50:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc4e441700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdc2c06b2f0 0x7fdc2c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.147+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc4408d4f0 con 0x7fdc480cdfd0 2023-10-16T13:50:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.148+0000 7fdc4ec42700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fdc2c071150 0x7fdc2c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.148+0000 7fdc4e441700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdc2c06b2f0 0x7fdc2c06d7b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdc38006b20 tx=0x7fdc38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.148+0000 7fdc4ec42700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fdc2c071150 0x7fdc2c073570 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.149+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== osd.4 v2:172.21.15.112:6816/3896016116 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdc2c073c40 con 0x7fdc2c071150 2023-10-16T13:50:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 --> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdc24002ce0 con 0x7fdc2c071150 2023-10-16T13:50:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3effd700 1 -- 172.21.15.5:0/810884194 <== osd.4 v2:172.21.15.112:6816/3896016116 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdc24002ce0 con 0x7fdc2c071150 2023-10-16T13:50:04.168 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:04.168 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:04.169 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fdc2c071150 msgr2=0x7fdc2c073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6816/3896016116,v1:172.21.15.112:6817/3896016116] conn(0x7fdc2c071150 0x7fdc2c073570 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdc2c06b2f0 msgr2=0x7fdc2c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdc2c06b2f0 0x7fdc2c06d7b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdc38006b20 tx=0x7fdc38008040 comp rx=0 tx=0).stop 2023-10-16T13:50:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 msgr2=0x7fdc481556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 --2- 172.21.15.5:0/810884194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc480cdfd0 0x7fdc481556b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fdc44000c00 tx=0x7fdc44004750 comp rx=0 tx=0).stop 2023-10-16T13:50:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc4ec42700 1 -- 172.21.15.5:0/810884194 reap_dead start 2023-10-16T13:50:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 shutdown_connections 2023-10-16T13:50:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.164+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 >> 172.21.15.5:0/810884194 conn(0x7fdc4806bd70 msgr2=0x7fdc4806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.165+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 shutdown_connections 2023-10-16T13:50:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.165+0000 7fdc3cff9700 1 -- 172.21.15.5:0/810884194 wait complete. 2023-10-16T13:50:04.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-16T13:50:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.302+0000 7f387d460700 1 Processor -- start 2023-10-16T13:50:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.302+0000 7f387d460700 1 -- start start 2023-10-16T13:50:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f387d460700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f387815dbc0 0x7f387815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f387d460700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f38780d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f387d460700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387815e4e0 con 0x7f38780b7050 2023-10-16T13:50:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f387d460700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780b7560 con 0x7f387815dbc0 2023-10-16T13:50:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f387d460700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780b7840 con 0x7f38780d3fc0 2023-10-16T13:50:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f38767fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f38780d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f3876ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f387815dbc0 0x7f387815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f38767fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f38780d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49276/0 (socket says 172.21.15.5:49276) 2023-10-16T13:50:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.303+0000 7f38767fc700 1 -- 172.21.15.5:0/1140029392 learned_addr learned my addr 172.21.15.5:0/1140029392 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f38767fc700 1 -- 172.21.15.5:0/1140029392 >> v2:172.21.15.112:3300/0 conn(0x7f387815dbc0 msgr2=0x7f387815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f38767fc700 1 --2- 172.21.15.5:0/1140029392 >> v2:172.21.15.112:3300/0 conn(0x7f387815dbc0 0x7f387815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f38767fc700 1 -- 172.21.15.5:0/1140029392 >> v1:172.21.15.112:6789/0 conn(0x7f38780b7050 legacy=0x7f38780d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f38767fc700 1 -- 172.21.15.5:0/1140029392 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38780b7b20 con 0x7f38780d3fc0 2023-10-16T13:50:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f38767fc700 1 --2- 172.21.15.5:0/1140029392 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f38780d1ac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f386c0098f0 tx=0x7f386c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afa0d20e1016484 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f3875ffb700 1 -- 172.21.15.5:0/1140029392 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c011830 con 0x7f38780d3fc0 2023-10-16T13:50:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f3875ffb700 1 -- 172.21.15.5:0/1140029392 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c011990 con 0x7f38780d3fc0 2023-10-16T13:50:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.304+0000 7f3875ffb700 1 -- 172.21.15.5:0/1140029392 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c011d20 con 0x7f38780d3fc0 2023-10-16T13:50:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 -- 172.21.15.5:0/1140029392 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 msgr2=0x7f38780d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 --2- 172.21.15.5:0/1140029392 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f38780d1ac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f386c0098f0 tx=0x7f386c009c00 comp rx=0 tx=0).stop 2023-10-16T13:50:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 -- 172.21.15.5:0/1140029392 shutdown_connections 2023-10-16T13:50:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 --2- 172.21.15.5:0/1140029392 >> v2:172.21.15.112:3300/0 conn(0x7f387815dbc0 0x7f387815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 --2- 172.21.15.5:0/1140029392 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f38780d1ac0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 -- 172.21.15.5:0/1140029392 >> 172.21.15.5:0/1140029392 conn(0x7f387809cb40 msgr2=0x7f38780d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 -- 172.21.15.5:0/1140029392 shutdown_connections 2023-10-16T13:50:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.305+0000 7f387d460700 1 -- 172.21.15.5:0/1140029392 wait complete. 2023-10-16T13:50:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.306+0000 7f387d460700 1 Processor -- start 2023-10-16T13:50:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.306+0000 7f387d460700 1 -- start start 2023-10-16T13:50:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f387d460700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38780b7050 0x7f387809f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f387d460700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f387815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f387d460700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 0x7f38780cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f387d460700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387815b570 con 0x7f387815dbc0 2023-10-16T13:50:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f387d460700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780cdcd0 con 0x7f38780b7050 2023-10-16T13:50:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f387d460700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387809fa90 con 0x7f38780d3fc0 2023-10-16T13:50:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 0x7f38780cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 0x7f38780cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51380/0 (socket says 172.21.15.5:51380) 2023-10-16T13:50:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 -- 172.21.15.5:0/2761177807 learned_addr learned my addr 172.21.15.5:0/2761177807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38767fc700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f387815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f3876ffd700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38780b7050 0x7f387809f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 -- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 msgr2=0x7f387815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f387815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 -- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38780b7050 msgr2=0x7f387809f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38780b7050 0x7f387809f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 -- 172.21.15.5:0/2761177807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c009550 con 0x7f387815dbc0 2023-10-16T13:50:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.307+0000 7f38777fe700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 0x7f38780cd790 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f387000cbc0 tx=0x7f387000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.308+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870003c00 con 0x7f387815dbc0 2023-10-16T13:50:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.308+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3870003d60 con 0x7f387815dbc0 2023-10-16T13:50:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.308+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387809fd70 con 0x7f387815dbc0 2023-10-16T13:50:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.308+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000aae0 con 0x7f387815dbc0 2023-10-16T13:50:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.308+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780cab40 con 0x7f387815dbc0 2023-10-16T13:50:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.309+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387804ebb0 con 0x7f387815dbc0 2023-10-16T13:50:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.309+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f387000ac40 con 0x7f387815dbc0 2023-10-16T13:50:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.309+0000 7f385f7fe700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f386406b2f0 0x7f386406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.310+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3870089950 con 0x7f387815dbc0 2023-10-16T13:50:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.310+0000 7f3876ffd700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f386406b2f0 0x7f386406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.310+0000 7f3876ffd700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f386406b2f0 0x7f386406d7b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f38780c7260 tx=0x7f38680091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.314+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38700547b0 con 0x7f387815dbc0 2023-10-16T13:50:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.518+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f38780b80e0 con 0x7f386406b2f0 2023-10-16T13:50:04.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.518+0000 7f385f7fe700 1 -- 172.21.15.5:0/2761177807 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3868005ad0 con 0x7f386406b2f0 2023-10-16T13:50:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f386406b2f0 msgr2=0x7f386406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f386406b2f0 0x7f386406d7b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f38780c7260 tx=0x7f38680091c0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 msgr2=0x7f38780cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 0x7f38780cd790 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f387000cbc0 tx=0x7f387000ced0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 shutdown_connections 2023-10-16T13:50:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387815dbc0 0x7f38780cd790 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38780b7050 0x7f387809f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f386406b2f0 0x7f386406d7b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 --2- 172.21.15.5:0/2761177807 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38780d3fc0 0x7f387815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 >> 172.21.15.5:0/2761177807 conn(0x7f387809cb40 msgr2=0x7f387806d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 shutdown_connections 2023-10-16T13:50:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.520+0000 7f387d460700 1 -- 172.21.15.5:0/2761177807 wait complete. 2023-10-16T13:50:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2023-10-16T13:50:04.535 INFO:tasks.ceph:Scrubbing osd.5 2023-10-16T13:50:04.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:04.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.662+0000 7f0b64422700 1 Processor -- start 2023-10-16T13:50:04.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.662+0000 7f0b64422700 1 -- start start 2023-10-16T13:50:04.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b64422700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c151680 0x7f0b5c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b64422700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0b5c06da30 0x7f0b5c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b64422700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0b2e40 con 0x7f0b5c0727e0 2023-10-16T13:50:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b64422700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c06e400 con 0x7f0b5c06da30 2023-10-16T13:50:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b64422700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15e7c0 con 0x7f0b5c151680 2023-10-16T13:50:04.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b621be700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c151680 0x7f0b5c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b619bd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0b5c0727e0 0x7f0b5c0b1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:52368/0 (socket says 172.21.15.5:52368) 2023-10-16T13:50:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b619bd700 1 -- 172.21.15.5:0/1225758525 learned_addr learned my addr 172.21.15.5:0/1225758525 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:04.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b629bf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0b5c06da30 0x7f0b5c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b621be700 1 -- 172.21.15.5:0/1225758525 >> v2:172.21.15.112:3300/0 conn(0x7f0b5c06da30 msgr2=0x7f0b5c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b621be700 1 --2- 172.21.15.5:0/1225758525 >> v2:172.21.15.112:3300/0 conn(0x7f0b5c06da30 0x7f0b5c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b611bc700 1 -- 172.21.15.5:0/1225758525 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402968571 0 0) 0x7f0b58001110 con 0x7f0b5c0727e0 2023-10-16T13:50:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b621be700 1 -- 172.21.15.5:0/1225758525 >> v1:172.21.15.112:6789/0 conn(0x7f0b5c0727e0 legacy=0x7f0b5c0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.663+0000 7f0b621be700 1 -- 172.21.15.5:0/1225758525 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0b2620 con 0x7f0b5c151680 2023-10-16T13:50:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b621be700 1 --2- 172.21.15.5:0/1225758525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c151680 0x7f0b5c15ec50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009840 tx=0x7f0b4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6828afeb6dca0fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b611bc700 1 -- 172.21.15.5:0/1225758525 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011830 con 0x7f0b5c151680 2023-10-16T13:50:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b611bc700 1 -- 172.21.15.5:0/1225758525 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c011990 con 0x7f0b5c151680 2023-10-16T13:50:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b611bc700 1 -- 172.21.15.5:0/1225758525 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011d20 con 0x7f0b5c151680 2023-10-16T13:50:04.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 -- 172.21.15.5:0/1225758525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c151680 msgr2=0x7f0b5c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 --2- 172.21.15.5:0/1225758525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c151680 0x7f0b5c15ec50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009840 tx=0x7f0b4c009b50 comp rx=0 tx=0).stop 2023-10-16T13:50:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 -- 172.21.15.5:0/1225758525 shutdown_connections 2023-10-16T13:50:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 --2- 172.21.15.5:0/1225758525 >> v2:172.21.15.112:3300/0 conn(0x7f0b5c06da30 0x7f0b5c06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 --2- 172.21.15.5:0/1225758525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c151680 0x7f0b5c15ec50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 -- 172.21.15.5:0/1225758525 >> 172.21.15.5:0/1225758525 conn(0x7f0b5c06bd70 msgr2=0x7f0b5c06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 -- 172.21.15.5:0/1225758525 shutdown_connections 2023-10-16T13:50:04.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.664+0000 7f0b64422700 1 -- 172.21.15.5:0/1225758525 wait complete. 2023-10-16T13:50:04.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 Processor -- start 2023-10-16T13:50:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 -- start start 2023-10-16T13:50:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c06da30 0x7f0b5c14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c0727e0 0x7f0b5c0b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b5c151680 0x7f0b5c149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c14ad40 con 0x7f0b5c0727e0 2023-10-16T13:50:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0b5790 con 0x7f0b5c151680 2023-10-16T13:50:04.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b64422700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0b4b80 con 0x7f0b5c06da30 2023-10-16T13:50:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b619bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c0727e0 0x7f0b5c0b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b619bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c0727e0 0x7f0b5c0b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51392/0 (socket says 172.21.15.5:51392) 2023-10-16T13:50:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.666+0000 7f0b619bd700 1 -- 172.21.15.5:0/3136031294 learned_addr learned my addr 172.21.15.5:0/3136031294 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b621be700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c06da30 0x7f0b5c14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b629bf700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b5c151680 0x7f0b5c149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b619bd700 1 -- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c06da30 msgr2=0x7f0b5c14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b619bd700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b5c06da30 0x7f0b5c14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b619bd700 1 -- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b5c151680 msgr2=0x7f0b5c149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b619bd700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b5c151680 0x7f0b5c149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b619bd700 1 -- 172.21.15.5:0/3136031294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0094a0 con 0x7f0b5c0727e0 2023-10-16T13:50:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b619bd700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c0727e0 0x7f0b5c0b4330 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c730 tx=0x7f0b5800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58004c80 con 0x7f0b5c0727e0 2023-10-16T13:50:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58004e00 con 0x7f0b5c0727e0 2023-10-16T13:50:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0b4e60 con 0x7f0b5c0727e0 2023-10-16T13:50:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58007310 con 0x7f0b5c0727e0 2023-10-16T13:50:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.667+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0b5420 con 0x7f0b5c0727e0 2023-10-16T13:50:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.668+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b5c0b2b60 con 0x7f0b5c0727e0 2023-10-16T13:50:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f0b58007470 con 0x7f0b5c0727e0 2023-10-16T13:50:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b52ffd700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0b4006b2f0 0x7f0b4006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0b58089520 con 0x7f0b5c0727e0 2023-10-16T13:50:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b52ffd700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f0b40071150 0x7f0b40073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 --> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b40073c40 con 0x7f0b40071150 2023-10-16T13:50:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b5808bb00 con 0x7f0b5c0727e0 2023-10-16T13:50:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b621be700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0b4006b2f0 0x7f0b4006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.669+0000 7f0b629bf700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f0b40071150 0x7f0b40073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.670+0000 7f0b621be700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0b4006b2f0 0x7f0b4006d7b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0090b0 tx=0x7f0b4c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.670+0000 7f0b629bf700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f0b40071150 0x7f0b40073570 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.670+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== osd.5 v2:172.21.15.112:6808/3215612020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0b40073c40 con 0x7f0b40071150 2023-10-16T13:50:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.685+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 --> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0b5c0b2880 con 0x7f0b40071150 2023-10-16T13:50:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b52ffd700 1 -- 172.21.15.5:0/3136031294 <== osd.5 v2:172.21.15.112:6808/3215612020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0b5400f040 con 0x7f0b40071150 2023-10-16T13:50:04.690 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:04.690 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:04.691 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f0b40071150 msgr2=0x7f0b40073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6808/3215612020,v1:172.21.15.112:6809/3215612020] conn(0x7f0b40071150 0x7f0b40073570 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0b4006b2f0 msgr2=0x7f0b4006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f0b4006b2f0 0x7f0b4006d7b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0090b0 tx=0x7f0b4c01c040 comp rx=0 tx=0).stop 2023-10-16T13:50:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c0727e0 msgr2=0x7f0b5c0b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 --2- 172.21.15.5:0/3136031294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c0727e0 0x7f0b5c0b4330 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c730 tx=0x7f0b5800caf0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b629bf700 1 -- 172.21.15.5:0/3136031294 reap_dead start 2023-10-16T13:50:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 shutdown_connections 2023-10-16T13:50:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 >> 172.21.15.5:0/3136031294 conn(0x7f0b5c06bd70 msgr2=0x7f0b5c0cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 shutdown_connections 2023-10-16T13:50:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.686+0000 7f0b64422700 1 -- 172.21.15.5:0/3136031294 wait complete. 2023-10-16T13:50:04.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-16T13:50:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.823+0000 7fdce61e4700 1 Processor -- start 2023-10-16T13:50:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.823+0000 7fdce61e4700 1 -- start start 2023-10-16T13:50:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdce61e4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce00cc3f0 0x7fdce00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdce61e4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdce006af50 0x7fdce0071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdce61e4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce0071ab0 con 0x7fdce0161670 2023-10-16T13:50:04.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdce61e4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce0161bc0 con 0x7fdce006af50 2023-10-16T13:50:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdce61e4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0161ea0 con 0x7fdce00cc3f0 2023-10-16T13:50:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdcdeffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdce0161670 0x7fdce006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33174/0 (socket says 172.21.15.5:33174) 2023-10-16T13:50:04.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.824+0000 7fdcdeffd700 1 -- 172.21.15.5:0/735997646 learned_addr learned my addr 172.21.15.5:0/735997646 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdf7fe700 1 --2- 172.21.15.5:0/735997646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce00cc3f0 0x7fdce00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdffff700 1 --2- 172.21.15.5:0/735997646 >> v2:172.21.15.112:3300/0 conn(0x7fdce006af50 0x7fdce0071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcde7fc700 1 -- 172.21.15.5:0/735997646 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052945418 0 0) 0x7fdce0071ab0 con 0x7fdce0161670 2023-10-16T13:50:04.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcde7fc700 1 -- 172.21.15.5:0/735997646 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc0035b0 con 0x7fdce0161670 2023-10-16T13:50:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdf7fe700 1 -- 172.21.15.5:0/735997646 >> v2:172.21.15.112:3300/0 conn(0x7fdce006af50 msgr2=0x7fdce0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdf7fe700 1 --2- 172.21.15.5:0/735997646 >> v2:172.21.15.112:3300/0 conn(0x7fdce006af50 0x7fdce0071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdf7fe700 1 -- 172.21.15.5:0/735997646 >> v1:172.21.15.5:6789/0 conn(0x7fdce0161670 legacy=0x7fdce006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdf7fe700 1 -- 172.21.15.5:0/735997646 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0162180 con 0x7fdce00cc3f0 2023-10-16T13:50:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdffff700 1 --2- 172.21.15.5:0/735997646 >> v2:172.21.15.112:3300/0 conn(0x7fdce006af50 0x7fdce0071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcdf7fe700 1 --2- 172.21.15.5:0/735997646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce00cc3f0 0x7fdce00cc7d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009840 tx=0x7fdcc8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cce10fb8e41d991f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcde7fc700 1 -- 172.21.15.5:0/735997646 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8011830 con 0x7fdce00cc3f0 2023-10-16T13:50:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcde7fc700 1 -- 172.21.15.5:0/735997646 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8011990 con 0x7fdce00cc3f0 2023-10-16T13:50:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.825+0000 7fdcde7fc700 1 -- 172.21.15.5:0/735997646 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8011d00 con 0x7fdce00cc3f0 2023-10-16T13:50:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 -- 172.21.15.5:0/735997646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce00cc3f0 msgr2=0x7fdce00cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 --2- 172.21.15.5:0/735997646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce00cc3f0 0x7fdce00cc7d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009840 tx=0x7fdcc8009b50 comp rx=0 tx=0).stop 2023-10-16T13:50:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 -- 172.21.15.5:0/735997646 shutdown_connections 2023-10-16T13:50:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 --2- 172.21.15.5:0/735997646 >> v2:172.21.15.112:3300/0 conn(0x7fdce006af50 0x7fdce0071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 --2- 172.21.15.5:0/735997646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce00cc3f0 0x7fdce00cc7d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 -- 172.21.15.5:0/735997646 >> 172.21.15.5:0/735997646 conn(0x7fdce006dac0 msgr2=0x7fdce006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 -- 172.21.15.5:0/735997646 shutdown_connections 2023-10-16T13:50:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.826+0000 7fdce61e4700 1 -- 172.21.15.5:0/735997646 wait complete. 2023-10-16T13:50:04.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.828+0000 7fdce61e4700 1 Processor -- start 2023-10-16T13:50:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.828+0000 7fdce61e4700 1 -- start start 2023-10-16T13:50:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdce61e4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce006af50 0x7fdce00b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdce61e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 0x7fdce006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdce61e4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce0161670 0x7fdce006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdce61e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01f4070 con 0x7fdce00cc3f0 2023-10-16T13:50:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdce61e4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00b3f70 con 0x7fdce0161670 2023-10-16T13:50:04.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdce61e4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01f33f0 con 0x7fdce006af50 2023-10-16T13:50:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 0x7fdce006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 0x7fdce006dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51408/0 (socket says 172.21.15.5:51408) 2023-10-16T13:50:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 -- 172.21.15.5:0/3474084842 learned_addr learned my addr 172.21.15.5:0/3474084842 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:04.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdf7fe700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce006af50 0x7fdce00b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdffff700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce0161670 0x7fdce006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 -- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce006af50 msgr2=0x7fdce00b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce006af50 0x7fdce00b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 -- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce0161670 msgr2=0x7fdce006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:04.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce0161670 0x7fdce006e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:04.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 -- 172.21.15.5:0/3474084842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009a70 con 0x7fdce00cc3f0 2023-10-16T13:50:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcdeffd700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 0x7fdce006dea0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0001eb0 tx=0x7fdcd000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.829+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000cea0 con 0x7fdce00cc3f0 2023-10-16T13:50:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.830+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0005d90 con 0x7fdce00cc3f0 2023-10-16T13:50:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.830+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc80094a0 con 0x7fdce00cc3f0 2023-10-16T13:50:04.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.830+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0007310 con 0x7fdce00cc3f0 2023-10-16T13:50:04.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.830+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce01f39b0 con 0x7fdce00cc3f0 2023-10-16T13:50:04.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.830+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce0067d20 con 0x7fdce00cc3f0 2023-10-16T13:50:04.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.831+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fdcd0007470 con 0x7fdce00cc3f0 2023-10-16T13:50:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.831+0000 7fdcd7fff700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc006b2f0 0x7fdcc006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.831+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcd0088df0 con 0x7fdce00cc3f0 2023-10-16T13:50:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.832+0000 7fdcdf7fe700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc006b2f0 0x7fdcc006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.832+0000 7fdcdf7fe700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc006b2f0 0x7fdcc006d7b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000c00 tx=0x7fdcc8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:04.836+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcd0053c80 con 0x7fdce00cc3f0 2023-10-16T13:50:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.034+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fdce0162460 con 0x7fdcc006b2f0 2023-10-16T13:50:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.035+0000 7fdcd7fff700 1 -- 172.21.15.5:0/3474084842 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdcc8011630 con 0x7fdcc006b2f0 2023-10-16T13:50:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc006b2f0 msgr2=0x7fdcc006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc006b2f0 0x7fdcc006d7b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000c00 tx=0x7fdcc8008030 comp rx=0 tx=0).stop 2023-10-16T13:50:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 msgr2=0x7fdce006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 0x7fdce006dea0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0001eb0 tx=0x7fdcd000c7b0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 shutdown_connections 2023-10-16T13:50:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdce0161670 0x7fdce006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fdcc006b2f0 0x7fdcc006d7b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdce006af50 0x7fdce00b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 --2- 172.21.15.5:0/3474084842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce00cc3f0 0x7fdce006dea0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.037+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 >> 172.21.15.5:0/3474084842 conn(0x7fdce006dac0 msgr2=0x7fdce015ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.038+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 shutdown_connections 2023-10-16T13:50:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.038+0000 7fdce61e4700 1 -- 172.21.15.5:0/3474084842 wait complete. 2023-10-16T13:50:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2023-10-16T13:50:05.052 INFO:tasks.ceph:Scrubbing osd.6 2023-10-16T13:50:05.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:05.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.179+0000 7fbf6bca8700 1 Processor -- start 2023-10-16T13:50:05.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.179+0000 7fbf6bca8700 1 -- start start 2023-10-16T13:50:05.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf6bca8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf64071920 0x7fbf640ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf6bca8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 0x7fbf6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf6bca8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6415aad0 con 0x7fbf6415a6f0 2023-10-16T13:50:05.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf6bca8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640cf680 con 0x7fbf64071920 2023-10-16T13:50:05.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf6bca8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cb200 con 0x7fbf640cef00 2023-10-16T13:50:05.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf69a44700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf6415a6f0 0x7fbf64071210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33186/0 (socket says 172.21.15.5:33186) 2023-10-16T13:50:05.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.180+0000 7fbf69a44700 1 -- 172.21.15.5:0/2274195367 learned_addr learned my addr 172.21.15.5:0/2274195367 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:05.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf6a245700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 0x7fbf6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301532342 0 0) 0x7fbf6415aad0 con 0x7fbf6415a6f0 2023-10-16T13:50:05.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf500035b0 con 0x7fbf6415a6f0 2023-10-16T13:50:05.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf69243700 1 --2- 172.21.15.5:0/2274195367 >> v2:172.21.15.112:3300/0 conn(0x7fbf64071920 0x7fbf640ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622504411 0 0) 0x7fbf500035b0 con 0x7fbf6415a6f0 2023-10-16T13:50:05.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 msgr2=0x7fbf6406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 0x7fbf6406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 >> v2:172.21.15.112:3300/0 conn(0x7fbf64071920 msgr2=0x7fbf640ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 --2- 172.21.15.5:0/2274195367 >> v2:172.21.15.112:3300/0 conn(0x7fbf64071920 0x7fbf640ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640ce2b0 con 0x7fbf6415a6f0 2023-10-16T13:50:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fbf54001670 con 0x7fbf6415a6f0 2023-10-16T13:50:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 >> v1:172.21.15.5:6789/0 conn(0x7fbf6415a6f0 legacy=0x7fbf64071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf50003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf50004850 0x7fbf50004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 0x7fbf50005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cf680 con 0x7fbf50003a00 2023-10-16T13:50:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cb200 con 0x7fbf50004850 2023-10-16T13:50:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5000ba10 con 0x7fbf640cef00 2023-10-16T13:50:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf69a44700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf50003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf69243700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf50004850 0x7fbf50004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.181+0000 7fbf6a245700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 0x7fbf50005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf69a44700 1 -- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 msgr2=0x7fbf50005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf69a44700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf640cef00 0x7fbf50005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf69a44700 1 -- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf50004850 msgr2=0x7fbf50004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf69a44700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf50004850 0x7fbf50004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf69a44700 1 -- 172.21.15.5:0/2274195367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500035b0 con 0x7fbf50003a00 2023-10-16T13:50:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf69a44700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf50003e20 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fbf54007d80 tx=0x7fbf50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907ad75e9ff57b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400ce80 con 0x7fbf50003a00 2023-10-16T13:50:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54005960 con 0x7fbf50003a00 2023-10-16T13:50:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf68a42700 1 -- 172.21.15.5:0/2274195367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54005cf0 con 0x7fbf50003a00 2023-10-16T13:50:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf6bca8700 1 -- 172.21.15.5:0/2274195367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 msgr2=0x7fbf50003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf6bca8700 1 --2- 172.21.15.5:0/2274195367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf50003e20 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fbf54007d80 tx=0x7fbf50005880 comp rx=0 tx=0).stop 2023-10-16T13:50:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf6a245700 1 -- 172.21.15.5:0/2274195367 reap_dead start 2023-10-16T13:50:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf6bca8700 1 -- 172.21.15.5:0/2274195367 shutdown_connections 2023-10-16T13:50:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.182+0000 7fbf6bca8700 1 -- 172.21.15.5:0/2274195367 >> 172.21.15.5:0/2274195367 conn(0x7fbf640cfc10 msgr2=0x7fbf640d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.183+0000 7fbf6bca8700 1 -- 172.21.15.5:0/2274195367 shutdown_connections 2023-10-16T13:50:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.183+0000 7fbf6bca8700 1 -- 172.21.15.5:0/2274195367 wait complete. 2023-10-16T13:50:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.184+0000 7fbf6bca8700 1 Processor -- start 2023-10-16T13:50:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.184+0000 7fbf6bca8700 1 -- start start 2023-10-16T13:50:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.184+0000 7fbf6bca8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf641484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.184+0000 7fbf6bca8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf64148c30 0x7fbf641490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.184+0000 7fbf6bca8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf640cb340 0x7fbf640cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6bca8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6414a420 con 0x7fbf50003a00 2023-10-16T13:50:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6bca8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cbd00 con 0x7fbf640cb340 2023-10-16T13:50:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6bca8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640acb50 con 0x7fbf64148c30 2023-10-16T13:50:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf641484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf641484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51426/0 (socket says 172.21.15.5:51426) 2023-10-16T13:50:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 -- 172.21.15.5:0/4180312798 learned_addr learned my addr 172.21.15.5:0/4180312798 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69243700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf64148c30 0x7fbf641490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6a245700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf640cb340 0x7fbf640cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 -- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf64148c30 msgr2=0x7fbf641490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf64148c30 0x7fbf641490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 -- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf640cb340 msgr2=0x7fbf640cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf640cb340 0x7fbf640cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 -- 172.21.15.5:0/4180312798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf641497a0 con 0x7fbf50003a00 2023-10-16T13:50:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6a245700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf640cb340 0x7fbf640cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:50:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf69a44700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf641484f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fbf54000c00 tx=0x7fbf54000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54001660 con 0x7fbf50003a00 2023-10-16T13:50:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54004a80 con 0x7fbf50003a00 2023-10-16T13:50:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf64149a80 con 0x7fbf50003a00 2023-10-16T13:50:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54004e30 con 0x7fbf50003a00 2023-10-16T13:50:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.185+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6414a040 con 0x7fbf50003a00 2023-10-16T13:50:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.186+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf640cd980 con 0x7fbf50003a00 2023-10-16T13:50:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fbf54021020 con 0x7fbf50003a00 2023-10-16T13:50:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf5a7fc700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf4806b2f0 0x7fbf4806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf5408a8c0 con 0x7fbf50003a00 2023-10-16T13:50:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf69243700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf4806b2f0 0x7fbf4806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf5a7fc700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7fbf48071150 0x7fbf48073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 --> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf48073c40 con 0x7fbf48071150 2023-10-16T13:50:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.187+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf5408f2a0 con 0x7fbf50003a00 2023-10-16T13:50:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.188+0000 7fbf6a245700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7fbf48071150 0x7fbf48073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.188+0000 7fbf69243700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf4806b2f0 0x7fbf4806d7b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbf640cc0c0 tx=0x7fbf60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.188+0000 7fbf6a245700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7fbf48071150 0x7fbf48073570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.189+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== osd.6 v2:172.21.15.112:6800/1905123765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbf48073c40 con 0x7fbf48071150 2023-10-16T13:50:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.204+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 --> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf640ce740 con 0x7fbf48071150 2023-10-16T13:50:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.204+0000 7fbf5a7fc700 1 -- 172.21.15.5:0/4180312798 <== osd.6 v2:172.21.15.112:6800/1905123765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbf5c00f040 con 0x7fbf48071150 2023-10-16T13:50:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:05.215 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:05.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7fbf48071150 msgr2=0x7fbf48073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6800/1905123765,v1:172.21.15.112:6801/1905123765] conn(0x7fbf48071150 0x7fbf48073570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf4806b2f0 msgr2=0x7fbf4806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fbf4806b2f0 0x7fbf4806d7b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbf640cc0c0 tx=0x7fbf60008040 comp rx=0 tx=0).stop 2023-10-16T13:50:05.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 msgr2=0x7fbf641484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 --2- 172.21.15.5:0/4180312798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf50003a00 0x7fbf641484f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fbf54000c00 tx=0x7fbf54000fe0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6a245700 1 -- 172.21.15.5:0/4180312798 reap_dead start 2023-10-16T13:50:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 shutdown_connections 2023-10-16T13:50:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 >> 172.21.15.5:0/4180312798 conn(0x7fbf640cfc10 msgr2=0x7fbf640711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 shutdown_connections 2023-10-16T13:50:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.205+0000 7fbf6bca8700 1 -- 172.21.15.5:0/4180312798 wait complete. 2023-10-16T13:50:05.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-16T13:50:05.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.343+0000 7f1ef5e5b700 1 Processor -- start 2023-10-16T13:50:05.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.343+0000 7f1ef5e5b700 1 -- start start 2023-10-16T13:50:05.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.344+0000 7f1ef5e5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 0x7f1ef015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.344+0000 7f1ef5e5b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 0x7f1ef00d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.344+0000 7f1ef5e5b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef00ce350 con 0x7f1ef00d1fc0 2023-10-16T13:50:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.344+0000 7f1ef5e5b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00b5140 con 0x7f1ef0161f10 2023-10-16T13:50:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.344+0000 7f1ef5e5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0162630 con 0x7f1ef015d9e0 2023-10-16T13:50:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 0x7f1ef015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eeffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 0x7f1ef00d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eeeffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1ef00d1fc0 0x7f1ef0161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:52416/0 (socket says 172.21.15.5:52416) 2023-10-16T13:50:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eeffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 0x7f1ef00d2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:47336/0 (socket says 172.21.15.5:47336) 2023-10-16T13:50:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 0x7f1ef015ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49340/0 (socket says 172.21.15.5:49340) 2023-10-16T13:50:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eeeffd700 1 -- 172.21.15.5:0/220817494 learned_addr learned my addr 172.21.15.5:0/220817494 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 -- 172.21.15.5:0/220817494 >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 msgr2=0x7f1ef00d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 --2- 172.21.15.5:0/220817494 >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 0x7f1ef00d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 -- 172.21.15.5:0/220817494 >> v1:172.21.15.112:6789/0 conn(0x7f1ef00d1fc0 legacy=0x7f1ef0161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 -- 172.21.15.5:0/220817494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00ce5f0 con 0x7f1ef015d9e0 2023-10-16T13:50:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eeffff700 1 --2- 172.21.15.5:0/220817494 >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 0x7f1ef00d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eef7fe700 1 --2- 172.21.15.5:0/220817494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 0x7f1ef015ddc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009840 tx=0x7f1ee0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac57e69d4c6dbe5a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eee7fc700 1 -- 172.21.15.5:0/220817494 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011830 con 0x7f1ef015d9e0 2023-10-16T13:50:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eee7fc700 1 -- 172.21.15.5:0/220817494 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0011990 con 0x7f1ef015d9e0 2023-10-16T13:50:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.345+0000 7f1eee7fc700 1 -- 172.21.15.5:0/220817494 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011d20 con 0x7f1ef015d9e0 2023-10-16T13:50:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/220817494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 msgr2=0x7f1ef015ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/220817494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 0x7f1ef015ddc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009840 tx=0x7f1ee0009b50 comp rx=0 tx=0).stop 2023-10-16T13:50:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/220817494 shutdown_connections 2023-10-16T13:50:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/220817494 >> v2:172.21.15.112:3300/0 conn(0x7f1ef0161f10 0x7f1ef00d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/220817494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef015d9e0 0x7f1ef015ddc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/220817494 >> 172.21.15.5:0/220817494 conn(0x7f1ef009cb40 msgr2=0x7f1ef00d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/220817494 shutdown_connections 2023-10-16T13:50:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.346+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/220817494 wait complete. 2023-10-16T13:50:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.348+0000 7f1ef5e5b700 1 Processor -- start 2023-10-16T13:50:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.348+0000 7f1ef5e5b700 1 -- start start 2023-10-16T13:50:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1ef5e5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ef00d1fc0 0x7f1ef015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1ef5e5b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 0x7f1ef0158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1ef5e5b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef0161f10 0x7f1ef00b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1ef5e5b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015e060 con 0x7f1ef015d9e0 2023-10-16T13:50:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1ef5e5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015e920 con 0x7f1ef00d1fc0 2023-10-16T13:50:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1ef5e5b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015ec00 con 0x7f1ef0161f10 2023-10-16T13:50:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 0x7f1ef0158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 0x7f1ef0158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51444/0 (socket says 172.21.15.5:51444) 2023-10-16T13:50:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 -- 172.21.15.5:0/1793735220 learned_addr learned my addr 172.21.15.5:0/1793735220 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eef7fe700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ef00d1fc0 0x7f1ef015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeffff700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef0161f10 0x7f1ef00b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 -- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef0161f10 msgr2=0x7f1ef00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef0161f10 0x7f1ef00b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 -- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ef00d1fc0 msgr2=0x7f1ef015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ef00d1fc0 0x7f1ef015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.349+0000 7f1eeeffd700 1 -- 172.21.15.5:0/1793735220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009a70 con 0x7f1ef015d9e0 2023-10-16T13:50:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.350+0000 7f1eeeffd700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 0x7f1ef0158060 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800c520 tx=0x7f1ed800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.350+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8005d70 con 0x7f1ef015d9e0 2023-10-16T13:50:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.350+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed80070d0 con 0x7f1ef015d9e0 2023-10-16T13:50:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.350+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee00094a0 con 0x7f1ef015d9e0 2023-10-16T13:50:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.350+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8007440 con 0x7f1ef015d9e0 2023-10-16T13:50:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.350+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef015f1c0 con 0x7f1ef015d9e0 2023-10-16T13:50:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.351+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef00cbf00 con 0x7f1ef015d9e0 2023-10-16T13:50:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.351+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f1ed80075a0 con 0x7f1ef015d9e0 2023-10-16T13:50:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.352+0000 7f1ee7fff700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ed006b2f0 0x7f1ed006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.352+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1ed8088c80 con 0x7f1ef015d9e0 2023-10-16T13:50:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.352+0000 7f1eef7fe700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ed006b2f0 0x7f1ed006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.352+0000 7f1eef7fe700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ed006b2f0 0x7f1ed006d7b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0000c00 tx=0x7f1ee0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.356+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ef00cbf00 con 0x7f1ef015d9e0 2023-10-16T13:50:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.560+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ef00cebb0 con 0x7f1ed006b2f0 2023-10-16T13:50:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.561+0000 7f1ee7fff700 1 -- 172.21.15.5:0/1793735220 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ee0011c00 con 0x7f1ed006b2f0 2023-10-16T13:50:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ed006b2f0 msgr2=0x7f1ed006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ed006b2f0 0x7f1ed006d7b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0000c00 tx=0x7f1ee0008030 comp rx=0 tx=0).stop 2023-10-16T13:50:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 msgr2=0x7f1ef0158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 0x7f1ef0158060 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800c520 tx=0x7f1ed800c830 comp rx=0 tx=0).stop 2023-10-16T13:50:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 shutdown_connections 2023-10-16T13:50:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ed006b2f0 0x7f1ed006d7b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ef0161f10 0x7f1ef00b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ef00d1fc0 0x7f1ef015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 --2- 172.21.15.5:0/1793735220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015d9e0 0x7f1ef0158060 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 >> 172.21.15.5:0/1793735220 conn(0x7f1ef009cb40 msgr2=0x7f1ef006b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 shutdown_connections 2023-10-16T13:50:05.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.563+0000 7f1ef5e5b700 1 -- 172.21.15.5:0/1793735220 wait complete. 2023-10-16T13:50:05.570 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2023-10-16T13:50:05.578 INFO:tasks.ceph:Scrubbing osd.7 2023-10-16T13:50:05.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-16T13:50:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.704+0000 7f863e4ef700 1 Processor -- start 2023-10-16T13:50:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.704+0000 7f863e4ef700 1 -- start start 2023-10-16T13:50:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.705+0000 7f863e4ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 0x7f86380b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.705+0000 7f863e4ef700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380d05e0 con 0x7f86380cdf40 2023-10-16T13:50:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.705+0000 7f863e4ef700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380b08d0 con 0x7f86380cf430 2023-10-16T13:50:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.705+0000 7f863e4ef700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86380cfcb0 con 0x7f86380d2050 2023-10-16T13:50:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.705+0000 7f8637fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86380cdf40 0x7f86380ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33222/0 (socket says 172.21.15.5:33222) 2023-10-16T13:50:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.705+0000 7f8637fff700 1 -- 172.21.15.5:0/2657584460 learned_addr learned my addr 172.21.15.5:0/2657584460 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794115551 0 0) 0x7f86380d05e0 con 0x7f86380cdf40 2023-10-16T13:50:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f863ca8c700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 0x7f86380b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86240035b0 con 0x7f86380cdf40 2023-10-16T13:50:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3891805369 0 0) 0x7f86240035b0 con 0x7f86380cdf40 2023-10-16T13:50:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 msgr2=0x7f86380b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 0x7f86380b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 >> v1:172.21.15.112:6789/0 conn(0x7f86380cf430 legacy=0x7f86380b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380cff90 con 0x7f86380cdf40 2023-10-16T13:50:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f86280017f0 con 0x7f86380cdf40 2023-10-16T13:50:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 >> v1:172.21.15.5:6789/0 conn(0x7f86380cdf40 legacy=0x7f86380ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8624003a30 0x7f8624003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 0x7f8624004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8624004d90 0x7f8624005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86380cfcb0 con 0x7f8624003a30 2023-10-16T13:50:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862400baf0 con 0x7f8624004d90 2023-10-16T13:50:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862400bcb0 con 0x7f86380d2050 2023-10-16T13:50:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8637fff700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8624003a30 0x7f8624003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f86377fe700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 0x7f8624004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f863ca8c700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8624004d90 0x7f8624005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8637fff700 1 -- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 msgr2=0x7f8624004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8637fff700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86380d2050 0x7f8624004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8637fff700 1 -- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8624004d90 msgr2=0x7f8624005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8637fff700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8624004d90 0x7f8624005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.706+0000 7f8637fff700 1 -- 172.21.15.5:0/2657584460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240035b0 con 0x7f8624003a30 2023-10-16T13:50:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f8637fff700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8624003a30 0x7f8624003e50 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f862800c210 tx=0x7f8624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b906629ac0509cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800cdb0 con 0x7f8624003a30 2023-10-16T13:50:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8628007b80 con 0x7f8624003a30 2023-10-16T13:50:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f8636ffd700 1 -- 172.21.15.5:0/2657584460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280072f0 con 0x7f8624003a30 2023-10-16T13:50:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863e4ef700 1 -- 172.21.15.5:0/2657584460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8624003a30 msgr2=0x7f8624003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863e4ef700 1 --2- 172.21.15.5:0/2657584460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8624003a30 0x7f8624003e50 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f862800c210 tx=0x7f8624005880 comp rx=0 tx=0).stop 2023-10-16T13:50:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863ca8c700 1 -- 172.21.15.5:0/2657584460 reap_dead start 2023-10-16T13:50:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863e4ef700 1 -- 172.21.15.5:0/2657584460 shutdown_connections 2023-10-16T13:50:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863e4ef700 1 -- 172.21.15.5:0/2657584460 >> 172.21.15.5:0/2657584460 conn(0x7f86380d1530 msgr2=0x7f86380d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863e4ef700 1 -- 172.21.15.5:0/2657584460 shutdown_connections 2023-10-16T13:50:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.707+0000 7f863e4ef700 1 -- 172.21.15.5:0/2657584460 wait complete. 2023-10-16T13:50:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.708+0000 7f863e4ef700 1 Processor -- start 2023-10-16T13:50:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 -- start start 2023-10-16T13:50:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8638157090 0x7f86380c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638157470 0x7f8638158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86381588c0 0x7f86381f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86380c73e0 con 0x7f8638157090 2023-10-16T13:50:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8638158d70 con 0x7f8638157470 2023-10-16T13:50:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.709+0000 7f863e4ef700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863815ab00 con 0x7f86381588c0 2023-10-16T13:50:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8638157090 0x7f86380c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8638157090 0x7f86380c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51462/0 (socket says 172.21.15.5:51462) 2023-10-16T13:50:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 -- 172.21.15.5:0/3393751923 learned_addr learned my addr 172.21.15.5:0/3393751923 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f86377fe700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638157470 0x7f8638158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f863ca8c700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86381588c0 0x7f86381f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 -- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86381588c0 msgr2=0x7f86381f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86381588c0 0x7f86381f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 -- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638157470 msgr2=0x7f8638158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638157470 0x7f8638158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 -- 172.21.15.5:0/3393751923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380c6e20 con 0x7f8638157090 2023-10-16T13:50:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f863ca8c700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86381588c0 0x7f86381f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8637fff700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8638157090 0x7f86380c77f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f862400bac0 tx=0x7f8628001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628005830 con 0x7f8638157090 2023-10-16T13:50:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8628005990 con 0x7f8638157090 2023-10-16T13:50:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628005d40 con 0x7f8638157090 2023-10-16T13:50:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86380c7100 con 0x7f8638157090 2023-10-16T13:50:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.710+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863806bd60 con 0x7f8638157090 2023-10-16T13:50:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.711+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86380d0270 con 0x7f8638157090 2023-10-16T13:50:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f862801d420 con 0x7f8638157090 2023-10-16T13:50:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f8634ff9700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f861806b2f0 0x7f861806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f862808a600 con 0x7f8638157090 2023-10-16T13:50:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f8634ff9700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7f8618071150 0x7f8618073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 --> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8618073c40 con 0x7f8618071150 2023-10-16T13:50:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=138) v2 ==== 24+0+0 (secure 0 0 0) 0x7f862808cbe0 con 0x7f8638157090 2023-10-16T13:50:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f86377fe700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f861806b2f0 0x7f861806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.712+0000 7f863ca8c700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7f8618071150 0x7f8618073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.713+0000 7f86377fe700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f861806b2f0 0x7f861806d7b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8638157f70 tx=0x7f8620009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.713+0000 7f863ca8c700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7f8618071150 0x7f8618073570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.714+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== osd.7 v2:172.21.15.112:6824/678489070 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8618073c40 con 0x7f8618071150 2023-10-16T13:50:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.728+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 --> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f863806c0d0 con 0x7f8618071150 2023-10-16T13:50:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f8634ff9700 1 -- 172.21.15.5:0/3393751923 <== osd.7 v2:172.21.15.112:6824/678489070 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f863806c0d0 con 0x7f8618071150 2023-10-16T13:50:05.737 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-16T13:50:05.737 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T13:50:05.737 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-16T13:50:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7f8618071150 msgr2=0x7f8618073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6824/678489070,v1:172.21.15.112:6825/678489070] conn(0x7f8618071150 0x7f8618073570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f861806b2f0 msgr2=0x7f861806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f861806b2f0 0x7f861806d7b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8638157f70 tx=0x7f8620009040 comp rx=0 tx=0).stop 2023-10-16T13:50:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8638157090 msgr2=0x7f86380c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 --2- 172.21.15.5:0/3393751923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8638157090 0x7f86380c77f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f862400bac0 tx=0x7f8628001b80 comp rx=0 tx=0).stop 2023-10-16T13:50:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863ca8c700 1 -- 172.21.15.5:0/3393751923 reap_dead start 2023-10-16T13:50:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 shutdown_connections 2023-10-16T13:50:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 >> 172.21.15.5:0/3393751923 conn(0x7f86380d1530 msgr2=0x7f86380b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 shutdown_connections 2023-10-16T13:50:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.729+0000 7f863e4ef700 1 -- 172.21.15.5:0/3393751923 wait complete. 2023-10-16T13:50:05.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-16T13:50:05.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.868+0000 7f73e1b57700 1 Processor -- start 2023-10-16T13:50:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.868+0000 7f73e1b57700 1 -- start start 2023-10-16T13:50:05.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.868+0000 7f73e1b57700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73dc0ce3b0 0x7f73dc0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.868+0000 7f73e1b57700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc072a10 con 0x7f73dc15b8b0 2023-10-16T13:50:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.868+0000 7f73e1b57700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc0b2230 con 0x7f73dc0b3630 2023-10-16T13:50:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.868+0000 7f73e1b57700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0ceda0 con 0x7f73dc0ce3b0 2023-10-16T13:50:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73db7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73dc15b8b0 0x7f73dc0b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33244/0 (socket says 172.21.15.5:33244) 2023-10-16T13:50:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73db7fe700 1 -- 172.21.15.5:0/1402568024 learned_addr learned my addr 172.21.15.5:0/1402568024 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73daffd700 1 --2- 172.21.15.5:0/1402568024 >> v2:172.21.15.112:3300/0 conn(0x7f73dc0ce3b0 0x7f73dc0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206826374 0 0) 0x7f73dc072a10 con 0x7f73dc15b8b0 2023-10-16T13:50:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c80035b0 con 0x7f73dc15b8b0 2023-10-16T13:50:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916431983 0 0) 0x7f73c80035b0 con 0x7f73dc15b8b0 2023-10-16T13:50:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 >> v2:172.21.15.112:3300/0 conn(0x7f73dc0ce3b0 msgr2=0x7f73dc0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 --2- 172.21.15.5:0/1402568024 >> v2:172.21.15.112:3300/0 conn(0x7f73dc0ce3b0 0x7f73dc0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 >> v1:172.21.15.112:6789/0 conn(0x7f73dc0b3630 legacy=0x7f73dc0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc071e90 con 0x7f73dc15b8b0 2023-10-16T13:50:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7f73cc001670 con 0x7f73dc15b8b0 2023-10-16T13:50:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 >> v1:172.21.15.5:6789/0 conn(0x7f73dc15b8b0 legacy=0x7f73dc0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8003a00 0x7f73c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8004850 0x7f73c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c8005210 0x7f73c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0ceda0 con 0x7f73c8003a00 2023-10-16T13:50:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c800c0b0 con 0x7f73c8005210 2023-10-16T13:50:05.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c800c270 con 0x7f73c8004850 2023-10-16T13:50:05.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73daffd700 1 --2- 172.21.15.5:0/1402568024 >> v2:172.21.15.112:3300/0 conn(0x7f73dc0ce3b0 0x7f73dc0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:05.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73db7fe700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8003a00 0x7f73c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.869+0000 7f73dbfff700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c8005210 0x7f73c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73daffd700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8004850 0x7f73c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73db7fe700 1 -- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8004850 msgr2=0x7f73c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73db7fe700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8004850 0x7f73c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73db7fe700 1 -- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c8005210 msgr2=0x7f73c800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73db7fe700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c8005210 0x7f73c800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73dbfff700 1 -- 172.21.15.5:0/1402568024 reap_dead start 2023-10-16T13:50:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73db7fe700 1 -- 172.21.15.5:0/1402568024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80035b0 con 0x7f73c8003a00 2023-10-16T13:50:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73daffd700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8004850 0x7f73c8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73db7fe700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8003a00 0x7f73c8003e20 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c240 tx=0x7f73c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67b3c55ef82cef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc007c10 con 0x7f73c8003a00 2023-10-16T13:50:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc00ce00 con 0x7f73c8003a00 2023-10-16T13:50:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73da7fc700 1 -- 172.21.15.5:0/1402568024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc005ba0 con 0x7f73c8003a00 2023-10-16T13:50:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73e1b57700 1 -- 172.21.15.5:0/1402568024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8003a00 msgr2=0x7f73c8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.870+0000 7f73e1b57700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8003a00 0x7f73c8003e20 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c240 tx=0x7f73c8005880 comp rx=0 tx=0).stop 2023-10-16T13:50:05.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.871+0000 7f73e1b57700 1 -- 172.21.15.5:0/1402568024 shutdown_connections 2023-10-16T13:50:05.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.871+0000 7f73e1b57700 1 --2- 172.21.15.5:0/1402568024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8003a00 0x7f73c8003e20 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.871+0000 7f73e1b57700 1 -- 172.21.15.5:0/1402568024 >> 172.21.15.5:0/1402568024 conn(0x7f73dc06dac0 msgr2=0x7f73dc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:05.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.871+0000 7f73e1b57700 1 -- 172.21.15.5:0/1402568024 shutdown_connections 2023-10-16T13:50:05.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.871+0000 7f73e1b57700 1 -- 172.21.15.5:0/1402568024 wait complete. 2023-10-16T13:50:05.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.872+0000 7f73e1b57700 1 Processor -- start 2023-10-16T13:50:05.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.872+0000 7f73e1b57700 1 -- start start 2023-10-16T13:50:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8003a00 0x7f73dc1f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc0c3a90 0x7f73dc15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 0x7f73dc150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc153970 con 0x7f73dc15e900 2023-10-16T13:50:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc152d40 con 0x7f73dc0c3a90 2023-10-16T13:50:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc152fd0 con 0x7f73c8003a00 2023-10-16T13:50:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 0x7f73dc150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 0x7f73dc150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51488/0 (socket says 172.21.15.5:51488) 2023-10-16T13:50:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 -- 172.21.15.5:0/2499156546 learned_addr learned my addr 172.21.15.5:0/2499156546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:05.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73db7fe700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8003a00 0x7f73dc1f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73daffd700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc0c3a90 0x7f73dc15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 -- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8003a00 msgr2=0x7f73dc1f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8003a00 0x7f73dc1f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 -- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc0c3a90 msgr2=0x7f73dc15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:05.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc0c3a90 0x7f73dc15e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:05.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 -- 172.21.15.5:0/2499156546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc1532b0 con 0x7f73dc15e900 2023-10-16T13:50:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73dbfff700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 0x7f73dc150490 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06d410 tx=0x7f73d400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400ee40 con 0x7f73dc15e900 2023-10-16T13:50:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4003c10 con 0x7f73dc15e900 2023-10-16T13:50:05.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc153590 con 0x7f73dc15e900 2023-10-16T13:50:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40050d0 con 0x7f73dc15e900 2023-10-16T13:50:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.873+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc1f7470 con 0x7f73dc15e900 2023-10-16T13:50:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.874+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc153ab0 con 0x7f73dc15e900 2023-10-16T13:50:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.875+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f73d4005230 con 0x7f73dc15e900 2023-10-16T13:50:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.875+0000 7f73d3fff700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f73bc06b2f0 0x7f73bc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.875+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f73d4089640 con 0x7f73dc15e900 2023-10-16T13:50:05.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.876+0000 7f73db7fe700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f73bc06b2f0 0x7f73bc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.876+0000 7f73db7fe700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f73bc06b2f0 0x7f73bc06d7b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000c00 tx=0x7f73cc007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:05.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:05.880+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73dc153ab0 con 0x7f73dc15e900 2023-10-16T13:50:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.080+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f73dc072450 con 0x7f73bc06b2f0 2023-10-16T13:50:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.080+0000 7f73d3fff700 1 -- 172.21.15.5:0/2499156546 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f73cc007b30 con 0x7f73bc06b2f0 2023-10-16T13:50:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f73bc06b2f0 msgr2=0x7f73bc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f73bc06b2f0 0x7f73bc06d7b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000c00 tx=0x7f73cc007000 comp rx=0 tx=0).stop 2023-10-16T13:50:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 msgr2=0x7f73dc150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 0x7f73dc150490 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06d410 tx=0x7f73d400edd0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 shutdown_connections 2023-10-16T13:50:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc15e900 0x7f73dc150490 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f73bc06b2f0 0x7f73bc06d7b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73c8003a00 0x7f73dc1f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 --2- 172.21.15.5:0/2499156546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc0c3a90 0x7f73dc15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.082+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 >> 172.21.15.5:0/2499156546 conn(0x7f73dc06dac0 msgr2=0x7f73dc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.083+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 shutdown_connections 2023-10-16T13:50:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.083+0000 7f73e1b57700 1 -- 172.21.15.5:0/2499156546 wait complete. 2023-10-16T13:50:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2023-10-16T13:50:06.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:50:06.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.220+0000 7f6428caa700 1 Processor -- start 2023-10-16T13:50:06.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.220+0000 7f6428caa700 1 -- start start 2023-10-16T13:50:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6428caa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f642415b740 0x7f64240d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6428caa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f64240cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6428caa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64240cf190 con 0x7f64240d0c70 2023-10-16T13:50:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6428caa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642415bb20 con 0x7f642415b740 2023-10-16T13:50:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6428caa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240cbd40 con 0x7f64240ce6e0 2023-10-16T13:50:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6422d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f64240cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6421d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f64240d0c70 0x7f64240cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:52472/0 (socket says 172.21.15.5:52472) 2023-10-16T13:50:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.221+0000 7f6421d9b700 1 -- 172.21.15.5:0/2913627603 learned_addr learned my addr 172.21.15.5:0/2913627603 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f642259c700 1 --2- 172.21.15.5:0/2913627603 >> v2:172.21.15.112:3300/0 conn(0x7f642415b740 0x7f64240d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f6422d9d700 1 -- 172.21.15.5:0/2913627603 >> v2:172.21.15.112:3300/0 conn(0x7f642415b740 msgr2=0x7f64240d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f6422d9d700 1 --2- 172.21.15.5:0/2913627603 >> v2:172.21.15.112:3300/0 conn(0x7f642415b740 0x7f64240d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f6422d9d700 1 -- 172.21.15.5:0/2913627603 >> v1:172.21.15.112:6789/0 conn(0x7f64240d0c70 legacy=0x7f64240cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f642159a700 1 -- 172.21.15.5:0/2913627603 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358359771 0 0) 0x7f64240cf190 con 0x7f64240d0c70 2023-10-16T13:50:06.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f6422d9d700 1 -- 172.21.15.5:0/2913627603 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240cc020 con 0x7f64240ce6e0 2023-10-16T13:50:06.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f6422d9d700 1 --2- 172.21.15.5:0/2913627603 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f64240cf690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f642415bc60 tx=0x7f641c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6dd129dfcb09e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:06.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f642159a700 1 -- 172.21.15.5:0/2913627603 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c016070 con 0x7f64240ce6e0 2023-10-16T13:50:06.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f642159a700 1 -- 172.21.15.5:0/2913627603 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00bb20 con 0x7f64240ce6e0 2023-10-16T13:50:06.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.222+0000 7f642159a700 1 -- 172.21.15.5:0/2913627603 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00e070 con 0x7f64240ce6e0 2023-10-16T13:50:06.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 -- 172.21.15.5:0/2913627603 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 msgr2=0x7f64240cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 --2- 172.21.15.5:0/2913627603 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f64240cf690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f642415bc60 tx=0x7f641c00b330 comp rx=0 tx=0).stop 2023-10-16T13:50:06.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 -- 172.21.15.5:0/2913627603 shutdown_connections 2023-10-16T13:50:06.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 --2- 172.21.15.5:0/2913627603 >> v2:172.21.15.112:3300/0 conn(0x7f642415b740 0x7f64240d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 --2- 172.21.15.5:0/2913627603 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f64240cf690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 -- 172.21.15.5:0/2913627603 >> 172.21.15.5:0/2913627603 conn(0x7f64240665a0 msgr2=0x7f6424066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 -- 172.21.15.5:0/2913627603 shutdown_connections 2023-10-16T13:50:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.223+0000 7f6428caa700 1 -- 172.21.15.5:0/2913627603 wait complete. 2023-10-16T13:50:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.224+0000 7f6428caa700 1 Processor -- start 2023-10-16T13:50:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.224+0000 7f6428caa700 1 -- start start 2023-10-16T13:50:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6428caa700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f642406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6428caa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64240d0c70 0x7f642415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6428caa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 0x7f642415d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6428caa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64241f7190 con 0x7f642415b740 2023-10-16T13:50:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6428caa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64241f6550 con 0x7f64240d0c70 2023-10-16T13:50:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6428caa700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64241f67f0 con 0x7f64240ce6e0 2023-10-16T13:50:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 0x7f642415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 0x7f642415d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51500/0 (socket says 172.21.15.5:51500) 2023-10-16T13:50:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 -- 172.21.15.5:0/643920438 learned_addr learned my addr 172.21.15.5:0/643920438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6421d9b700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64240d0c70 0x7f642415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:06.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f642259c700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f642406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:06.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 -- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 msgr2=0x7f642406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f642406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 -- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64240d0c70 msgr2=0x7f642415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64240d0c70 0x7f642415ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.225+0000 7f6422d9d700 1 -- 172.21.15.5:0/643920438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c009a70 con 0x7f642415b740 2023-10-16T13:50:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.226+0000 7f6422d9d700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 0x7f642415d390 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f641c014040 tx=0x7f641c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:06.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.226+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c016040 con 0x7f642415b740 2023-10-16T13:50:06.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.226+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c0098f0 con 0x7f642415b740 2023-10-16T13:50:06.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.226+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64241f6ad0 con 0x7f642415b740 2023-10-16T13:50:06.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.226+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c01b680 con 0x7f642415b740 2023-10-16T13:50:06.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.226+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642406d7f0 con 0x7f642415b740 2023-10-16T13:50:06.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.227+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642406d980 con 0x7f642415b740 2023-10-16T13:50:06.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.227+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f641c01b7e0 con 0x7f642415b740 2023-10-16T13:50:06.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.228+0000 7f6412ffd700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f640406b2f0 0x7f640406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:06.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.228+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f641c08b1e0 con 0x7f642415b740 2023-10-16T13:50:06.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.228+0000 7f642259c700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f640406b2f0 0x7f640406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:06.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.229+0000 7f642259c700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f640406b2f0 0x7f640406d7b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6414009ad0 tx=0x7f6414008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:06.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.233+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f642406d980 con 0x7f642415b740 2023-10-16T13:50:06.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.428+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64240cc5e0 con 0x7f640406b2f0 2023-10-16T13:50:06.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.431+0000 7f6412ffd700 1 -- 172.21.15.5:0/643920438 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50510 (secure 0 0 0) 0x7f6414011750 con 0x7f640406b2f0 2023-10-16T13:50:06.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:50:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f640406b2f0 msgr2=0x7f640406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f640406b2f0 0x7f640406d7b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6414009ad0 tx=0x7f6414008040 comp rx=0 tx=0).stop 2023-10-16T13:50:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 msgr2=0x7f642415d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:06.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 0x7f642415d390 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f641c014040 tx=0x7f641c004ad0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 shutdown_connections 2023-10-16T13:50:06.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f642415b740 0x7f642415d390 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f640406b2f0 0x7f640406d7b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64240ce6e0 0x7f642406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 --2- 172.21.15.5:0/643920438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64240d0c70 0x7f642415ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:06.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 >> 172.21.15.5:0/643920438 conn(0x7f64240665a0 msgr2=0x7f64240c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:06.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 shutdown_connections 2023-10-16T13:50:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:06.433+0000 7f6428caa700 1 -- 172.21.15.5:0/643920438 wait complete. 2023-10-16T13:50:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:50:06.448 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2023-10-16T13:50:05.635162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280944,"kb_used_data":14848,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754693776,"statfs":{"total":773094113280,"available":772806426624,"internally_reserved":0,"allocated":15204352,"data_stored":7466210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":272354872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.310728"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":269,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-16T13:49:57.391534+0000","last_change":"2023-10-16T13:38:14.895360+0000","last_active":"2023-10-16T13:49:57.391534+0000","last_peered":"2023-10-16T13:49:57.391534+0000","last_clean":"2023-10-16T13:49:57.391534+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:49:57.391534+0000","last_undegraded":"2023-10-16T13:49:57.391534+0000","last_fullsized":"2023-10-16T13:49:57.391534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:38:13.879011+0000","last_clean_scrub_stamp":"2023-10-16T13:38:13.879011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:35:42.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2347008,"data_stored":1376307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.58699999999999997,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.93100000000000005},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.56999999999999995,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":0.496},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.47799999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.309},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.42999999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.90600000000000003},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.51000000000000001,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.495}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.627}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.40400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.26500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.622,"5min":0.622,"15min":1.1619999999999999},"last":0.315},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.752},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":0.88},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.34899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":1.905},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.879},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0549999999999999},"last":0.621}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.925},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.085},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37632,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334208,"statfs":{"total":96636764160,"available":96598228992,"internally_reserved":0,"allocated":2342912,"data_stored":1375288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.434}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.499},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.623}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37048,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1748992,"data_stored":784920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34399999999999997,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.51700000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.38700000000000001},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.57299999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.48899999999999999,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.20599999999999999},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48899999999999999,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":8.1129999999999995,"5min":8.1129999999999995,"15min":8.1129999999999995},"last":0.626}]},{"osd":4,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.872}]},{"osd":5,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.367,"5min":5.367,"15min":5.367},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.379},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.98999999999999999}]},{"osd":7,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61399999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":2.141,"5min":2.141,"15min":4.0609999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.2690000000000001,"5min":5.2690000000000001,"15min":6.0499999999999998},"last":0.88700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.629,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65000000000000002,"5min":0.73599999999999999,"15min":2.181},"last":0.45200000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.5,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.497},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"max":{"1min":0.67100000000000004,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.379}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.621}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.71199999999999997},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.66000000000000003},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.60499999999999998}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":1.264,"15min":2.4039999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":1.298,"15min":2.4430000000000001},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.68300000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.42399999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.47199999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65900000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.443},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:50:06.451 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-16T13:38:13.879011+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=13, tm_min=38, tm_sec=13, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=13, tm_min=50, tm_sec=0, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T13:50:06.452 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T13:50:26.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:50:26.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.590+0000 7fe517242700 1 Processor -- start 2023-10-16T13:50:26.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.590+0000 7fe517242700 1 -- start start 2023-10-16T13:50:26.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe517242700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 0x7fe51015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe517242700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100cf260 con 0x7fe51006a840 2023-10-16T13:50:26.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe517242700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100b2d60 con 0x7fe5100cede0 2023-10-16T13:50:26.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe517242700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101619a0 con 0x7fe5100cd950 2023-10-16T13:50:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe5157df700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe51006a840 0x7fe510161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33276/0 (socket says 172.21.15.5:33276) 2023-10-16T13:50:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe5157df700 1 -- 172.21.15.5:0/1256202451 learned_addr learned my addr 172.21.15.5:0/1256202451 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe514fde700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 0x7fe51015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454065114 0 0) 0x7fe5100cf260 con 0x7fe51006a840 2023-10-16T13:50:26.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.591+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5000035b0 con 0x7fe51006a840 2023-10-16T13:50:26.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375572707 0 0) 0x7fe5100b2d60 con 0x7fe5100cede0 2023-10-16T13:50:26.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5100cf260 con 0x7fe5100cede0 2023-10-16T13:50:26.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2004632399 0 0) 0x7fe5000035b0 con 0x7fe51006a840 2023-10-16T13:50:26.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 msgr2=0x7fe51015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:26.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 0x7fe51015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 >> v1:172.21.15.112:6789/0 conn(0x7fe5100cede0 legacy=0x7fe51015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100cdd30 con 0x7fe51006a840 2023-10-16T13:50:26.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fe5080019f0 con 0x7fe51006a840 2023-10-16T13:50:26.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 >> v1:172.21.15.5:6789/0 conn(0x7fe51006a840 legacy=0x7fe510161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe500003bc0 0x7fe500003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 0x7fe500004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe500005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101619a0 con 0x7fe500004d90 2023-10-16T13:50:26.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000142d0 con 0x7fe500003bc0 2023-10-16T13:50:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe500014440 con 0x7fe5100cd950 2023-10-16T13:50:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe5157df700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe500005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe514fde700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe500003bc0 0x7fe500003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe50ffff700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 0x7fe500004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe5157df700 1 -- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 msgr2=0x7fe500004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:26.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe5157df700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100cd950 0x7fe500004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe5157df700 1 -- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe500003bc0 msgr2=0x7fe500003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:26.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe5157df700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe500003bc0 0x7fe500003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe5157df700 1 -- 172.21.15.5:0/1256202451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5000035b0 con 0x7fe500004d90 2023-10-16T13:50:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.592+0000 7fe514fde700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe500003bc0 0x7fe500003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe5157df700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe500005210 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe50800a7b0 tx=0x7fe500005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f971de1d639757 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508012600 con 0x7fe500004d90 2023-10-16T13:50:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5080127a0 con 0x7fe500004d90 2023-10-16T13:50:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe50f7fe700 1 -- 172.21.15.5:0/1256202451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508012b50 con 0x7fe500004d90 2023-10-16T13:50:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe517242700 1 -- 172.21.15.5:0/1256202451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 msgr2=0x7fe500005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe517242700 1 --2- 172.21.15.5:0/1256202451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe500005210 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe50800a7b0 tx=0x7fe500005880 comp rx=0 tx=0).stop 2023-10-16T13:50:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe5157df700 1 -- 172.21.15.5:0/1256202451 reap_dead start 2023-10-16T13:50:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe517242700 1 -- 172.21.15.5:0/1256202451 shutdown_connections 2023-10-16T13:50:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe517242700 1 -- 172.21.15.5:0/1256202451 >> 172.21.15.5:0/1256202451 conn(0x7fe51006dae0 msgr2=0x7fe51006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe517242700 1 -- 172.21.15.5:0/1256202451 shutdown_connections 2023-10-16T13:50:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.593+0000 7fe517242700 1 -- 172.21.15.5:0/1256202451 wait complete. 2023-10-16T13:50:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.595+0000 7fe517242700 1 Processor -- start 2023-10-16T13:50:26.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.595+0000 7fe517242700 1 -- start start 2023-10-16T13:50:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe510155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100c6370 0x7fe5100c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe510159810 0x7fe510159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe510156c00 con 0x7fe500004d90 2023-10-16T13:50:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101562a0 con 0x7fe510159810 2023-10-16T13:50:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe510156540 con 0x7fe5100c6370 2023-10-16T13:50:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe510155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe510155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51514/0 (socket says 172.21.15.5:51514) 2023-10-16T13:50:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 -- 172.21.15.5:0/2521129093 learned_addr learned my addr 172.21.15.5:0/2521129093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe50ffff700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100c6370 0x7fe5100c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe5157df700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe510159810 0x7fe510159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 -- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100c6370 msgr2=0x7fe5100c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100c6370 0x7fe5100c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 -- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe510159810 msgr2=0x7fe510159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe510159810 0x7fe510159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 -- 172.21.15.5:0/2521129093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510156820 con 0x7fe500004d90 2023-10-16T13:50:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe5157df700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe510159810 0x7fe510159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:50:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe514fde700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe510155320 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe504011ca0 tx=0x7fe50400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400fb30 con 0x7fe500004d90 2023-10-16T13:50:26.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400fc90 con 0x7fe500004d90 2023-10-16T13:50:26.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe510155860 con 0x7fe500004d90 2023-10-16T13:50:26.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504004020 con 0x7fe500004d90 2023-10-16T13:50:26.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.596+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51015a5b0 con 0x7fe500004d90 2023-10-16T13:50:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.597+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100b2630 con 0x7fe500004d90 2023-10-16T13:50:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.598+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fe504004180 con 0x7fe500004d90 2023-10-16T13:50:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.598+0000 7fe50d7fa700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe4f406b320 0x7fe4f406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.598+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe504089fc0 con 0x7fe500004d90 2023-10-16T13:50:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.599+0000 7fe50ffff700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe4f406b320 0x7fe4f406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.599+0000 7fe50ffff700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe4f406b320 0x7fe4f406d7e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe51015b840 tx=0x7fe4fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.603+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe504054d90 con 0x7fe500004d90 2023-10-16T13:50:26.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.800+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 --> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe51015ec00 con 0x7fe4f406b320 2023-10-16T13:50:26.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.803+0000 7fe50d7fa700 1 -- 172.21.15.5:0/2521129093 <== mgr.4102 v2:172.21.15.112:6832/3065671710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50578 (secure 0 0 0) 0x7fe4fc001740 con 0x7fe4f406b320 2023-10-16T13:50:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:50:26.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe4f406b320 msgr2=0x7fe4f406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe4f406b320 0x7fe4f406d7e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe51015b840 tx=0x7fe4fc009040 comp rx=0 tx=0).stop 2023-10-16T13:50:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 msgr2=0x7fe510155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe510155320 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe504011ca0 tx=0x7fe50400f520 comp rx=0 tx=0).stop 2023-10-16T13:50:26.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 shutdown_connections 2023-10-16T13:50:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe510159810 0x7fe510159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe500004d90 0x7fe510155320 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fe4f406b320 0x7fe4f406d7e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 --2- 172.21.15.5:0/2521129093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5100c6370 0x7fe5100c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 >> 172.21.15.5:0/2521129093 conn(0x7fe51006dae0 msgr2=0x7fe51015bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.805+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 shutdown_connections 2023-10-16T13:50:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.806+0000 7fe517242700 1 -- 172.21.15.5:0/2521129093 wait complete. 2023-10-16T13:50:26.812 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-16T13:50:26.821 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2023-10-16T13:50:25.639579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280936,"kb_used_data":14848,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754693784,"statfs":{"total":773094113280,"available":772806434816,"internally_reserved":0,"allocated":15204352,"data_stored":7466210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":272354872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002572"},"pg_stats":[{"pgid":"1.0","version":"138'119","reported_seq":281,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-16T13:50:06.489321+0000","last_change":"2023-10-16T13:50:06.489321+0000","last_active":"2023-10-16T13:50:06.489321+0000","last_peered":"2023-10-16T13:50:06.489321+0000","last_clean":"2023-10-16T13:50:06.489321+0000","last_became_active":"2023-10-16T13:38:14.894418+0000","last_became_peered":"2023-10-16T13:38:14.894418+0000","last_unstale":"2023-10-16T13:50:06.489321+0000","last_undegraded":"2023-10-16T13:50:06.489321+0000","last_fullsized":"2023-10-16T13:50:06.489321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'119","last_scrub_stamp":"2023-10-16T13:50:06.489114+0000","last_deep_scrub":"138'119","last_deep_scrub_stamp":"2023-10-16T13:50:06.489114+0000","last_clean_scrub_stamp":"2023-10-16T13:50:06.489114+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:02:14.117063+0000","scrub_duration":0.0048883809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2347008,"data_stored":1376307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.499},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.80200000000000005,"15min":0.82699999999999996},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.58699999999999997,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.93100000000000005},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.56999999999999995,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.47799999999999998,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"last":0.441},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.309},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.51000000000000001}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.432,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.90600000000000003},"last":0.48699999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.98299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.51000000000000001,"5min":0.36399999999999999,"15min":0.35699999999999998},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.57799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32700000000000001},"max":{"1min":0.73499999999999999,"5min":0.83199999999999996,"15min":0.84299999999999997},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.27600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.86099999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.48199999999999998,"5min":0.35699999999999998,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":1.3129999999999999,"15min":2.8100000000000001},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.47199999999999998,"5min":0.33600000000000002,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":1.768,"15min":1.768},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.157},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.77600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":10.964},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.95599999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":0.74299999999999999,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.40799999999999997}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":1.343,"15min":1.343},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74399999999999999,"5min":0.83399999999999996,"15min":1.036},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.38300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.26500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.622,"5min":0.622,"15min":1.1619999999999999},"last":0.623},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.752},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":0.88},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.34899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.59899999999999998,"5min":0.64200000000000002,"15min":1.4390000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":1.905},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.879},"last":0.93700000000000006}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0549999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":1.8340000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.925},"last":0.96499999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.93100000000000005,"15min":0.96899999999999997},"last":1},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.085},"last":0.83199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2342912,"data_stored":1375288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34300000000000003,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.67700000000000005,"15min":3.8260000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.214},"max":{"1min":0.57599999999999996,"5min":0.73399999999999999,"15min":4.0499999999999998},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":3.9169999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":3.8849999999999998},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":3.9359999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.438,"15min":0.441},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28899999999999998},"max":{"1min":0.68999999999999995,"5min":0.77300000000000002,"15min":3.9940000000000002},"last":0.81899999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.39000000000000001,"15min":0.30499999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":4.0190000000000001},"last":0.749},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":4.0650000000000004},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.496,"5min":0.41799999999999998,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.0369999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":4.1859999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.282,"5min":1.282,"15min":4.3049999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.39000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":4.2359999999999998},"last":0.91900000000000004}]},{"osd":7,"last update":"Mon Oct 16 13:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":4.2119999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":4.2649999999999997},"last":0.80500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37048,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1748992,"data_stored":784920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34399999999999997,"15min":0.33900000000000002},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.186},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.38700000000000001},"min":{"1min":0.24399999999999999,"5min":0.22,"15min":0.22},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.53600000000000003}]},{"osd":3,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.48899999999999999,"15min":0.436},"min":{"1min":0.32200000000000001,"5min":0.255,"15min":0.20599999999999999},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.48899999999999999,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":8.1129999999999995,"5min":8.1129999999999995,"15min":8.1129999999999995},"last":0.44900000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.622},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.746}]},{"osd":6,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.367,"5min":5.367,"15min":5.367},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.379},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 16 13:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.61399999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":2.141,"5min":2.141,"15min":4.0609999999999999},"last":0.755},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.2690000000000001,"5min":5.2690000000000001,"15min":6.0499999999999998},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.629,"5min":0.95699999999999996,"15min":5.8890000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65000000000000002,"5min":0.73599999999999999,"15min":2.181},"last":0.27900000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.5,"5min":0.66500000000000004,"15min":0.89100000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.33100000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":2.3519999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23599999999999999},"max":{"1min":0.61599999999999999,"5min":0.66600000000000004,"15min":0.94199999999999995},"last":0.311},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"max":{"1min":0.67100000000000004,"5min":1.2829999999999999,"15min":2.4820000000000002},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":5.7560000000000002},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.71199999999999997},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":1.0309999999999999,"15min":5.8559999999999999},"last":0.504},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.66000000000000003},"min":{"1min":0.53600000000000003,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.2410000000000001,"15min":2.2999999999999998},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.66600000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":1.264,"15min":2.4039999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":2.2799999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 16 13:49:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.8959999999999999,"15min":5.8179999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":1.298,"15min":2.4430000000000001},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.95099999999999996},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.77800000000000002,"15min":0.81799999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.88},"last":0.74299999999999999}]},{"osd":5,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":1.0589999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.308},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.499}]},{"osd":6,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.94199999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.34699999999999998},"max":{"1min":0.85099999999999998,"5min":0.872,"15min":1.0209999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Oct 16 13:49:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.35899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.64800000000000002},"min":{"1min":0.371,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.91600000000000004},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":785939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":0.68700000000000006,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63500000000000001}]},{"osd":1,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.81499999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79900000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.34999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.623}]},{"osd":3,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57499999999999996,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.69799999999999995}]},{"osd":4,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.53300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":1.141},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":1.3700000000000001},"last":0.44700000000000001}]},{"osd":6,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.79600000000000004,"15min":0.879},"last":0.497}]},{"osd":7,"last update":"Mon Oct 16 13:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60199999999999998},"min":{"1min":0.35699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.90700000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60699999999999998,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":0.87,"15min":0.87},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:50:26.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-16T13:50:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.944+0000 7f1f0d10e700 1 Processor -- start 2023-10-16T13:50:26.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.944+0000 7f1f0d10e700 1 -- start start 2023-10-16T13:50:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0d10e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f0806af50 0x7f1f080cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0d10e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f080b28b0 0x7f1f080b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0d10e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080b3530 con 0x7f1f0815f130 2023-10-16T13:50:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0d10e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080cde00 con 0x7f1f0806af50 2023-10-16T13:50:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0d10e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080cd180 con 0x7f1f080b28b0 2023-10-16T13:50:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f06d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f0815f130 0x7f1f0806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33294/0 (socket says 172.21.15.5:33294) 2023-10-16T13:50:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f06d9d700 1 -- 172.21.15.5:0/1146188018 learned_addr learned my addr 172.21.15.5:0/1146188018 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0659c700 1 --2- 172.21.15.5:0/1146188018 >> v2:172.21.15.112:3300/0 conn(0x7f1f0806af50 0x7f1f080cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f0759e700 1 --2- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f080b28b0 0x7f1f080b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.945+0000 7f1f05d9b700 1 -- 172.21.15.5:0/1146188018 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618147725 0 0) 0x7f1f080b3530 con 0x7f1f0815f130 2023-10-16T13:50:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f05d9b700 1 -- 172.21.15.5:0/1146188018 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef00035b0 con 0x7f1f0815f130 2023-10-16T13:50:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f0659c700 1 -- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f080b28b0 msgr2=0x7f1f080b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:26.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f0659c700 1 --2- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f080b28b0 0x7f1f080b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f0659c700 1 -- 172.21.15.5:0/1146188018 >> v1:172.21.15.5:6789/0 conn(0x7f1f0815f130 legacy=0x7f1f0806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f0659c700 1 -- 172.21.15.5:0/1146188018 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080cd460 con 0x7f1f0806af50 2023-10-16T13:50:26.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f0659c700 1 --2- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f0806af50 0x7f1f080cede0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009820 tx=0x7f1efc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd183f9eb193e22e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:26.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f05d9b700 1 -- 172.21.15.5:0/1146188018 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc005e30 con 0x7f1f0806af50 2023-10-16T13:50:26.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f05d9b700 1 -- 172.21.15.5:0/1146188018 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc006030 con 0x7f1f0806af50 2023-10-16T13:50:26.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.946+0000 7f1f05d9b700 1 -- 172.21.15.5:0/1146188018 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0063c0 con 0x7f1f0806af50 2023-10-16T13:50:26.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f0806af50 msgr2=0x7f1f080cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f0806af50 0x7f1f080cede0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009820 tx=0x7f1efc009b30 comp rx=0 tx=0).stop 2023-10-16T13:50:26.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1146188018 shutdown_connections 2023-10-16T13:50:26.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f080b28b0 0x7f1f080b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1146188018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f0806af50 0x7f1f080cede0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1146188018 >> 172.21.15.5:0/1146188018 conn(0x7f1f0806dae0 msgr2=0x7f1f0806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1146188018 shutdown_connections 2023-10-16T13:50:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.947+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1146188018 wait complete. 2023-10-16T13:50:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.948+0000 7f1f0d10e700 1 Processor -- start 2023-10-16T13:50:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.948+0000 7f1f0d10e700 1 -- start start 2023-10-16T13:50:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0d10e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f0806af50 0x7f1f0815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0d10e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f080b28b0 0x7f1f080c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0d10e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 0x7f1f080c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0d10e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080ca140 con 0x7f1f0815f130 2023-10-16T13:50:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0d10e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080c6380 con 0x7f1f080b28b0 2023-10-16T13:50:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0d10e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08150490 con 0x7f1f0806af50 2023-10-16T13:50:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 0x7f1f080c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 0x7f1f080c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51532/0 (socket says 172.21.15.5:51532) 2023-10-16T13:50:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 -- 172.21.15.5:0/1239350008 learned_addr learned my addr 172.21.15.5:0/1239350008 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0659c700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f080b28b0 0x7f1f080c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f06d9d700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f0806af50 0x7f1f0815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 -- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f0806af50 msgr2=0x7f1f0815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f0806af50 0x7f1f0815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 -- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f080b28b0 msgr2=0x7f1f080c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f080b28b0 0x7f1f080c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f0759e700 1 -- 172.21.15.5:0/1239350008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc009430 con 0x7f1f0815f130 2023-10-16T13:50:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.949+0000 7f1f06d9d700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f0806af50 0x7f1f0815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.950+0000 7f1f0759e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 0x7f1f080c9ac0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800e950 tx=0x7f1ef800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.950+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8009730 con 0x7f1f0815f130 2023-10-16T13:50:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.950+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800c850 con 0x7f1f0815f130 2023-10-16T13:50:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.950+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f080c7740 con 0x7f1f0815f130 2023-10-16T13:50:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.950+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800cbe0 con 0x7f1f0815f130 2023-10-16T13:50:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.950+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f080c7d00 con 0x7f1f0815f130 2023-10-16T13:50:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.951+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f08067d20 con 0x7f1f0815f130 2023-10-16T13:50:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.951+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7f1ef800cd40 con 0x7f1f0815f130 2023-10-16T13:50:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.952+0000 7f1eef7fe700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ef406b2f0 0x7f1ef406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.952+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1ef8089e20 con 0x7f1f0815f130 2023-10-16T13:50:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.952+0000 7f1f06d9d700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ef406b2f0 0x7f1ef406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:26.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.953+0000 7f1f06d9d700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ef406b2f0 0x7f1ef406d7b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1f00001560 tx=0x7f1f00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:26.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:26.957+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ef8054c80 con 0x7f1f0815f130 2023-10-16T13:50:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.155+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1f080ceb30 con 0x7f1f0815f130 2023-10-16T13:50:27.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.159+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1ef80170c0 con 0x7f1f0815f130 2023-10-16T13:50:27.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.160+0000 7f1eef7fe700 1 -- 172.21.15.5:0/1239350008 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1ef8054c80 con 0x7f1f0815f130 2023-10-16T13:50:27.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ef406b2f0 msgr2=0x7f1ef406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ef406b2f0 0x7f1ef406d7b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1f00001560 tx=0x7f1f00009040 comp rx=0 tx=0).stop 2023-10-16T13:50:27.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 msgr2=0x7f1f080c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 0x7f1f080c9ac0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800e950 tx=0x7f1ef800ed10 comp rx=0 tx=0).stop 2023-10-16T13:50:27.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 shutdown_connections 2023-10-16T13:50:27.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815f130 0x7f1f080c9ac0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7f1ef406b2f0 0x7f1ef406d7b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f0806af50 0x7f1f0815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 --2- 172.21.15.5:0/1239350008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f080b28b0 0x7f1f080c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 >> 172.21.15.5:0/1239350008 conn(0x7f1f0806dae0 msgr2=0x7f1f080b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 shutdown_connections 2023-10-16T13:50:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.162+0000 7f1f0d10e700 1 -- 172.21.15.5:0/1239350008 wait complete. 2023-10-16T13:50:27.177 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T13:50:27.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:50:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.299+0000 7fa926365700 1 Processor -- start 2023-10-16T13:50:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.300+0000 7fa926365700 1 -- start start 2023-10-16T13:50:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.300+0000 7fa926365700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa9200cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.300+0000 7fa926365700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9200cfc60 0x7fa9200cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.300+0000 7fa926365700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92015e7a0 con 0x7fa92015ab10 2023-10-16T13:50:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.300+0000 7fa926365700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200d00d0 con 0x7fa9200cfc60 2023-10-16T13:50:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.300+0000 7fa926365700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b29a0 con 0x7fa92015f1f0 2023-10-16T13:50:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa92015ab10 0x7fa9200b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33308/0 (socket says 172.21.15.5:33308) 2023-10-16T13:50:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91ffff700 1 -- 172.21.15.5:0/726462280 learned_addr learned my addr 172.21.15.5:0/726462280 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-10-16T13:50:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91f7fe700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa9200cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290415471 0 0) 0x7fa92015e7a0 con 0x7fa92015ab10 2023-10-16T13:50:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa90c0035b0 con 0x7fa92015ab10 2023-10-16T13:50:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa924902700 1 --2- 172.21.15.5:0/726462280 >> v2:172.21.15.112:3300/0 conn(0x7fa9200cfc60 0x7fa9200cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136055291 0 0) 0x7fa90c0035b0 con 0x7fa92015ab10 2023-10-16T13:50:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 msgr2=0x7fa9200cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa9200cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 >> v2:172.21.15.112:3300/0 conn(0x7fa9200cfc60 msgr2=0x7fa9200cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 --2- 172.21.15.5:0/726462280 >> v2:172.21.15.112:3300/0 conn(0x7fa9200cfc60 0x7fa9200cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200b2c80 con 0x7fa92015ab10 2023-10-16T13:50:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 628881303 0 0) 0x7fa910001670 con 0x7fa92015ab10 2023-10-16T13:50:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 >> v1:172.21.15.5:6789/0 conn(0x7fa92015ab10 legacy=0x7fa9200b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa90c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c003f80 0x7fa90c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa90c004d90 0x7fa90c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200d00d0 con 0x7fa90c004d90 2023-10-16T13:50:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b29a0 con 0x7fa90c003f80 2023-10-16T13:50:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c00ba60 con 0x7fa92015f1f0 2023-10-16T13:50:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91ffff700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa90c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa924902700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa90c004d90 0x7fa90c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.301+0000 7fa91f7fe700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c003f80 0x7fa90c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91ffff700 1 -- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c003f80 msgr2=0x7fa90c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91ffff700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c003f80 0x7fa90c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91ffff700 1 -- 172.21.15.5:0/726462280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa90c004d90 msgr2=0x7fa90c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:50:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91ffff700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa90c004d90 0x7fa90c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91ffff700 1 -- 172.21.15.5:0/726462280 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0035b0 con 0x7fa92015f1f0 2023-10-16T13:50:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa924902700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa90c004d90 0x7fa90c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:50:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91ffff700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa90c003a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa91000c370 tx=0x7fa90c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1137a2c0f25e221a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910007c60 con 0x7fa92015f1f0 2023-10-16T13:50:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa910005960 con 0x7fa92015f1f0 2023-10-16T13:50:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.302+0000 7fa91effd700 1 -- 172.21.15.5:0/726462280 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910005d30 con 0x7fa92015f1f0 2023-10-16T13:50:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa926365700 1 -- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 msgr2=0x7fa90c003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa926365700 1 --2- 172.21.15.5:0/726462280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015f1f0 0x7fa90c003a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa91000c370 tx=0x7fa90c005880 comp rx=0 tx=0).stop 2023-10-16T13:50:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa924902700 1 -- 172.21.15.5:0/726462280 reap_dead start 2023-10-16T13:50:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa926365700 1 -- 172.21.15.5:0/726462280 shutdown_connections 2023-10-16T13:50:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa926365700 1 -- 172.21.15.5:0/726462280 >> 172.21.15.5:0/726462280 conn(0x7fa92006dae0 msgr2=0x7fa92006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa926365700 1 -- 172.21.15.5:0/726462280 shutdown_connections 2023-10-16T13:50:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.303+0000 7fa926365700 1 -- 172.21.15.5:0/726462280 wait complete. 2023-10-16T13:50:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.304+0000 7fa926365700 1 Processor -- start 2023-10-16T13:50:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.304+0000 7fa926365700 1 -- start start 2023-10-16T13:50:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa926365700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92015f1f0 0x7fa9201f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa926365700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 0x7fa92006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa926365700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015ce70 0x7fa92015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa926365700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92006e8b0 con 0x7fa92006def0 2023-10-16T13:50:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa926365700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200ac950 con 0x7fa92015f1f0 2023-10-16T13:50:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa926365700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9201f3480 con 0x7fa92015ce70 2023-10-16T13:50:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 0x7fa92006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 0x7fa92006e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51550/0 (socket says 172.21.15.5:51550) 2023-10-16T13:50:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 -- 172.21.15.5:0/3501961283 learned_addr learned my addr 172.21.15.5:0/3501961283 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-16T13:50:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa924902700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015ce70 0x7fa92015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91ffff700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92015f1f0 0x7fa9201f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 -- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015ce70 msgr2=0x7fa92015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015ce70 0x7fa92015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 -- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92015f1f0 msgr2=0x7fa9201f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92015f1f0 0x7fa9201f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 -- 172.21.15.5:0/3501961283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200acbf0 con 0x7fa92006def0 2023-10-16T13:50:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91ffff700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92015f1f0 0x7fa9201f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa924902700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015ce70 0x7fa92015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:50:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.305+0000 7fa91f7fe700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 0x7fa92006e370 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fa9080119c0 tx=0x7fa908011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.306+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908005cf0 con 0x7fa92006def0 2023-10-16T13:50:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.306+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa908005e50 con 0x7fa92006def0 2023-10-16T13:50:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.306+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9200aced0 con 0x7fa92006def0 2023-10-16T13:50:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.306+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800f990 con 0x7fa92006def0 2023-10-16T13:50:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.306+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9200ad490 con 0x7fa92006def0 2023-10-16T13:50:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.306+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9200afc10 con 0x7fa92006def0 2023-10-16T13:50:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.307+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 89586+0+0 (secure 0 0 0) 0x7fa90800faf0 con 0x7fa92006def0 2023-10-16T13:50:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.307+0000 7fa91cff9700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa90006b2f0 0x7fa90006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:50:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.308+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa90808a1d0 con 0x7fa92006def0 2023-10-16T13:50:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.308+0000 7fa91ffff700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa90006b2f0 0x7fa90006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:50:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.308+0000 7fa91ffff700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa90006b2f0 0x7fa90006d7b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa910015040 tx=0x7fa91000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:50:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.313+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa908054f10 con 0x7fa92006def0 2023-10-16T13:50:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.557+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa920158f70 con 0x7fa92006def0 2023-10-16T13:50:27.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.558+0000 7fa91cff9700 1 -- 172.21.15.5:0/3501961283 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+3701 (secure 0 0 0) 0x7fa908021090 con 0x7fa92006def0 2023-10-16T13:50:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-16T13:50:27.562 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":101,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4124656837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4124656837},{"type":"v1","addr":"172.21.15.5:6835","nonce":4124656837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1541074189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1541074189},{"type":"v1","addr":"172.21.15.112:6836","nonce":1541074189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1846105319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1846105319},{"type":"v1","addr":"172.21.15.112:6837","nonce":1846105319}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101},{"gid":8217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1951189121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1951189121},{"type":"v1","addr":"172.21.15.5:6834","nonce":1951189121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92}],"filesystems":[]} 2023-10-16T13:50:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa90006b2f0 msgr2=0x7fa90006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa90006b2f0 0x7fa90006d7b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa910015040 tx=0x7fa91000a000 comp rx=0 tx=0).stop 2023-10-16T13:50:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 msgr2=0x7fa92006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:50:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 0x7fa92006e370 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fa9080119c0 tx=0x7fa908011d80 comp rx=0 tx=0).stop 2023-10-16T13:50:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 shutdown_connections 2023-10-16T13:50:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:6832/3065671710,v1:172.21.15.112:6833/3065671710] conn(0x7fa90006b2f0 0x7fa90006d7b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa92015ce70 0x7fa92015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92015f1f0 0x7fa9201f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 --2- 172.21.15.5:0/3501961283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa92006def0 0x7fa92006e370 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:50:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 >> 172.21.15.5:0/3501961283 conn(0x7fa92006dae0 msgr2=0x7fa9200cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:50:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 shutdown_connections 2023-10-16T13:50:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-16T13:50:27.560+0000 7fa926365700 1 -- 172.21.15.5:0/3501961283 wait complete. 2023-10-16T13:50:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 101 2023-10-16T13:50:27.575 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-16T13:50:27.576 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T13:50:27.576 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T13:50:27.577 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.584 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T13:50:27.585 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T13:50:27.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.633 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T13:50:27.633 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T13:50:27.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.645 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T13:50:27.645 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T13:50:27.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.697 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T13:50:27.697 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T13:50:27.698 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T13:50:27.698 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.729 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T13:50:27.729 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T13:50:27.730 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.798 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T13:50:27.799 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T13:50:27.799 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.877 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T13:50:27.877 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T13:50:27.878 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.949 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T13:50:27.950 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T13:50:27.950 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:27.998 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T13:50:27.999 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T13:50:27.999 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.029 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T13:50:28.030 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T13:50:28.030 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.114 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T13:50:28.115 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T13:50:28.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.144 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T13:50:28.145 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T13:50:28.145 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T13:50:28.145 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.169 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T13:50:28.169 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T13:50:28.170 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.212 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T13:50:28.212 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T13:50:28.212 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T13:50:28.213 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.224 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T13:50:28.224 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T13:50:28.224 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.263 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T13:50:28.264 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T13:50:28.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T13:50:28.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-16T13:50:28.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-16T13:50:28.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-16T13:50:28.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-16T13:50:28.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-16T13:50:28.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-16T13:50:28.316 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T13:50:28.317 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T13:50:28.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-16T13:50:28.353 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:50:28.353 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T13:50:28.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:50:28.620 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-16T13:50:28.707 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:50:28.707 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-16T13:50:28.818 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:50:28.819 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-16T13:50:28.890 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:50:28.891 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-16T13:50:29.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:50:29.035 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-16T13:50:29.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:50:29.169 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-16T13:50:29.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:50:29.248 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-16T13:50:29.322 INFO:tasks.ceph:Archiving mon data... 2023-10-16T13:50:29.325 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/data/mon.a.tgz 2023-10-16T13:50:29.325 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2023-10-16T13:50:29.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:50:29.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:50:29.344 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.bZV2kZmcuC 2023-10-16T13:50:29.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bZV2kZmcuC 2023-10-16T13:50:29.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.bZV2kZmcuC 2023-10-16T13:50:29.650 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.bZV2kZmcuC is 608KB 2023-10-16T13:50:29.722 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.bZV2kZmcuC 2023-10-16T13:50:29.739 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/data/mon.b.tgz 2023-10-16T13:50:29.739 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-10-16T13:50:29.756 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.5E8ibgNAyO 2023-10-16T13:50:29.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5E8ibgNAyO 2023-10-16T13:50:29.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.5E8ibgNAyO 2023-10-16T13:50:30.019 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.5E8ibgNAyO is 610KB 2023-10-16T13:50:30.118 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.5E8ibgNAyO 2023-10-16T13:50:30.134 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/data/mon.c.tgz 2023-10-16T13:50:30.134 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-10-16T13:50:30.190 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.FFywqSxrfN 2023-10-16T13:50:30.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FFywqSxrfN 2023-10-16T13:50:30.355 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.FFywqSxrfN 2023-10-16T13:50:30.440 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.FFywqSxrfN is 610KB 2023-10-16T13:50:30.539 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.FFywqSxrfN 2023-10-16T13:50:30.556 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-16T13:50:30.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T13:50:30.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T13:50:30.622 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-16T13:50:30.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T13:50:30.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T13:50:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T13:50:30.697 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T13:50:30.703 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T13:50:30.705 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/remote/smithi005/crash 2023-10-16T13:50:30.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T13:50:30.736 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/remote/smithi112/crash 2023-10-16T13:50:30.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T13:50:30.768 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T13:50:30.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:50:30.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:50:30.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T13:50:30.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T13:50:30.922 INFO:tasks.ceph:Compressing logs... 2023-10-16T13:50:30.923 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T13:50:30.938 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T13:50:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119723.log 2023-10-16T13:50:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114863.log 2023-10-16T13:50:31.009 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104009.log 2023-10-16T13:50:31.009 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104192.log 2023-10-16T13:50:31.009 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-16T13:50:31.010 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104009.log.gz 2023-10-16T13:50:31.010 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111695.log 2023-10-16T13:50:31.010 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104192.log.gz 2023-10-16T13:50:31.011 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104284.log 2023-10-16T13:50:31.011 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.3.111695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.113723.log 2023-10-16T13:50:31.011 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111695.log.gz 2023-10-16T13:50:31.012 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.113112.log 2023-10-16T13:50:31.012 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.113723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.113723.log.gz 2023-10-16T13:50:31.012 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.117188.log 2023-10-16T13:50:31.012 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104284.log.gz 2023-10-16T13:50:31.013 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.113112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104055.log 2023-10-16T13:50:31.013 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.113112.log.gz 2023-10-16T13:50:31.013 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.117188.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T13:50:31.013 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.117188.log.gz 2023-10-16T13:50:31.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.114696.log 2023-10-16T13:50:31.014 INFO:teuthology.orchestra.run.smithi112.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104055.log.gz 2023-10-16T13:50:31.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.117192.log 2023-10-16T13:50:31.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.114696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111080.log 2023-10-16T13:50:31.015 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.114696.log.gz 2023-10-16T13:50:31.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.117192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.116529.log 2023-10-16T13:50:31.015 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.117192.log.gz 2023-10-16T13:50:31.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.111080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111080.log.gz 2023-10-16T13:50:31.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104147.log 2023-10-16T13:50:31.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.116529.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-16T13:50:31.016 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.116529.log.gz 2023-10-16T13:50:31.017 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111699.log 2023-10-16T13:50:31.017 INFO:teuthology.orchestra.run.smithi112.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104147.log.gz 2023-10-16T13:50:31.017 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.116525.log 2023-10-16T13:50:31.017 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.3.111699.log: -- /var/log/ceph/ceph-mds.d.log 2023-10-16T13:50:31.018 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111699.log.gz 2023-10-16T13:50:31.018 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.116525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.113116.log 2023-10-16T13:50:31.018 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.116525.log.gz 2023-10-16T13:50:31.019 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.115904.log 2023-10-16T13:50:31.019 INFO:teuthology.orchestra.run.smithi112.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T13:50:31.019 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.113116.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T13:50:31.019 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.113116.log.gz 2023-10-16T13:50:31.020 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-16T13:50:31.020 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.115904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.115904.log.gz 2023-10-16T13:50:31.020 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.113727.log 2023-10-16T13:50:31.020 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.114700.log 2023-10-16T13:50:31.021 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.113727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.113727.log.gz 2023-10-16T13:50:31.021 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.114700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.114700.log.gz 2023-10-16T13:50:31.021 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-16T13:50:31.022 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.115297.log 2023-10-16T13:50:31.022 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.1.115297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.115297.log.gz 2023-10-16T13:50:31.022 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-16T13:50:31.022 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T13:50:31.023 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.115908.log 2023-10-16T13:50:31.023 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.115908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.115908.log.gz 2023-10-16T13:50:31.023 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104335.log 2023-10-16T13:50:31.024 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104335.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104335.log.gz 2023-10-16T13:50:31.024 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-16T13:50:31.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104238.log 2023-10-16T13:50:31.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104238.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104238.log.gz 2023-10-16T13:50:31.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104101.log 2023-10-16T13:50:31.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.104101.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104101.log.gz 2023-10-16T13:50:31.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111088.log 2023-10-16T13:50:31.027 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.111088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111088.log.gz 2023-10-16T13:50:31.027 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-16T13:50:31.031 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-16T13:50:31.039 INFO:teuthology.orchestra.run.smithi112.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-16T13:50:31.058 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.115301.log 2023-10-16T13:50:31.064 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.115301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.115301.log.gz 2023-10-16T13:50:31.064 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112484.log 2023-10-16T13:50:31.075 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.112484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112484.log.gz 2023-10-16T13:50:31.076 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112488.log 2023-10-16T13:50:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250915.log 2023-10-16T13:50:31.077 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5%/var/log/ceph/ceph-client.admin.114863.log: -- replaced with /var/log/ceph/ceph-client.admin.119723.log.gz 2023-10-16T13:50:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115001.log 2023-10-16T13:50:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258036.log 2023-10-16T13:50:31.077 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114863.log.gz 2023-10-16T13:50:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115001.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.250915.log.gz 2023-10-16T13:50:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254522.log 2023-10-16T13:50:31.078 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115001.log.gz 2023-10-16T13:50:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125654.log 2023-10-16T13:50:31.079 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.258036.log.gz 2023-10-16T13:50:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120247.log 2023-10-16T13:50:31.079 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.254522.log.gz 2023-10-16T13:50:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.125654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112457.log 2023-10-16T13:50:31.080 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.125654.log.gz 2023-10-16T13:50:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114671.log 2023-10-16T13:50:31.081 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120247.log.gz 2023-10-16T13:50:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257170.log 2023-10-16T13:50:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250685.log 2023-10-16T13:50:31.082 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2%/var/log/ceph/ceph-client.admin.257170.log: -- replaced with /var/log/ceph/ceph-client.admin.112457.log.gz 2023-10-16T13:50:31.082 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114671.log.gz 2023-10-16T13:50:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124565.log 2023-10-16T13:50:31.082 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.257170.log.gz 2023-10-16T13:50:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249299.log 2023-10-16T13:50:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250685.log: /var/log/ceph/ceph-client.admin.124565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252428.log 2023-10-16T13:50:31.083 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.250685.log.gz 2023-10-16T13:50:31.084 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124565.log.gz 2023-10-16T13:50:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117306.log 2023-10-16T13:50:31.084 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.249299.log.gz 2023-10-16T13:50:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248867.log 2023-10-16T13:50:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117306.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.252428.log.gz 2023-10-16T13:50:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245838.log 2023-10-16T13:50:31.086 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117306.log.gz 2023-10-16T13:50:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251860.log 2023-10-16T13:50:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245838.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.248867.log.gz 2023-10-16T13:50:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109618.log 2023-10-16T13:50:31.087 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.245838.log.gz 2023-10-16T13:50:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116624.log 2023-10-16T13:50:31.087 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.251860.log.gz 2023-10-16T13:50:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123275.log 2023-10-16T13:50:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109618.log: /var/log/ceph/ceph-client.admin.116624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243664.log 2023-10-16T13:50:31.088 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109618.log.gz 2023-10-16T13:50:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249850.log 2023-10-16T13:50:31.089 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116624.log.gz 2023-10-16T13:50:31.089 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123275.log.gz 2023-10-16T13:50:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254043.log 2023-10-16T13:50:31.090 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.243664.log.gz 2023-10-16T13:50:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:gzip /var/log/ceph/ceph-client.admin.249850.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.256506.log 2023-10-16T13:50:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111178.log 2023-10-16T13:50:31.091 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.249850.log.gz 2023-10-16T13:50:31.091 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.254043.log.gz 2023-10-16T13:50:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123775.log 2023-10-16T13:50:31.092 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6%/var/log/ceph/ceph-client.admin.111178.log: -- replaced with /var/log/ceph/ceph-client.admin.256506.log.gz 2023-10-16T13:50:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253230.log 2023-10-16T13:50:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123775.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111178.log.gz 2023-10-16T13:50:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111997.log 2023-10-16T13:50:31.093 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123775.log.gz 2023-10-16T13:50:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257327.log 2023-10-16T13:50:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111997.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.253230.log.gz 2023-10-16T13:50:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246114.log 2023-10-16T13:50:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257327.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111997.log.gz 2023-10-16T13:50:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257373.log 2023-10-16T13:50:31.095 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.257327.log.gz 2023-10-16T13:50:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118215.log 2023-10-16T13:50:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246114.log: /var/log/ceph/ceph-client.admin.257373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247777.log 2023-10-16T13:50:31.096 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.257373.log.gz 2023-10-16T13:50:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119815.log 2023-10-16T13:50:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125956.log 2023-10-16T13:50:31.097 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118215.log.gz 2023-10-16T13:50:31.097 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.246114.log.gz 2023-10-16T13:50:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123118.log 2023-10-16T13:50:31.098 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.247777.log.gz 2023-10-16T13:50:31.098 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119815.log.gz 2023-10-16T13:50:31.098 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124891.log 2023-10-16T13:50:31.099 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125956.log.gz 2023-10-16T13:50:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113101.log 2023-10-16T13:50:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123118.log: /var/log/ceph/ceph-client.admin.124891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243890.log 2023-10-16T13:50:31.100 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123118.log.gz 2023-10-16T13:50:31.100 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124891.log.gz 2023-10-16T13:50:31.100 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121115.log 2023-10-16T13:50:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.113101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113101.log.gz 2023-10-16T13:50:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 /var/log/ceph/ceph-client.admin.243890.log: --verbose -- /var/log/ceph/ceph-client.admin.258349.log 2023-10-16T13:50:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121115.log: gzip -5 --verbose 88.7%-- /var/log/ceph/ceph-client.admin.123229.log -- replaced with /var/log/ceph/ceph-client.admin.243890.log.gz 2023-10-16T13:50:31.101 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-16T13:50:31.102 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121115.log.gz 2023-10-16T13:50:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117120.log 2023-10-16T13:50:31.102 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.258349.log.gz 2023-10-16T13:50:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253997.log 2023-10-16T13:50:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123229.log: /var/log/ceph/ceph-client.admin.117120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.256144.log 2023-10-16T13:50:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253997.log: gzip 89.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.123229.log.gz 2023-10-16T13:50:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:-- /var/log/ceph/ceph-client.admin.119474.log 2023-10-16T13:50:31.104 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117120.log.gz 2023-10-16T13:50:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.256144.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.253997.log.gz 2023-10-16T13:50:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244574.log 2023-10-16T13:50:31.105 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.256144.log.gz 2023-10-16T13:50:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243756.log 2023-10-16T13:50:31.105 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119474.log.gz 2023-10-16T13:50:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248072.log 2023-10-16T13:50:31.106 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.244574.log.gz 2023-10-16T13:50:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111186.log 2023-10-16T13:50:31.107 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248072.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.243756.log.gz 2023-10-16T13:50:31.107 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255911.log 2023-10-16T13:50:31.107 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.248072.log.gz 2023-10-16T13:50:31.107 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120045.log 2023-10-16T13:50:31.108 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111186.log.gz 2023-10-16T13:50:31.108 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123728.log 2023-10-16T13:50:31.108 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120045.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.255911.log.gz 2023-10-16T13:50:31.109 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250302.log 2023-10-16T13:50:31.109 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120045.log.gz 2023-10-16T13:50:31.109 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251053.log 2023-10-16T13:50:31.109 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123728.log.gz 2023-10-16T13:50:31.110 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121773.log 2023-10-16T13:50:31.110 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251053.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.250302.log.gz 2023-10-16T13:50:31.110 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-16T13:50:31.111 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6%/var/log/ceph/ceph-client.admin.121773.log: -- replaced with /var/log/ceph/ceph-client.admin.251053.log.gz 2023-10-16T13:50:31.111 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114817.log 2023-10-16T13:50:31.111 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121773.log.gz 2023-10-16T13:50:31.111 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114395.log 2023-10-16T13:50:31.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.114817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260085.log 2023-10-16T13:50:31.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114817.log.gz 2023-10-16T13:50:31.112 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243802.log 2023-10-16T13:50:31.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114395.log.gz 2023-10-16T13:50:31.113 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253859.log 2023-10-16T13:50:31.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243802.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.260085.log.gz 2023-10-16T13:50:31.113 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249804.log 2023-10-16T13:50:31.114 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.243802.log.gz 2023-10-16T13:50:31.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111813.log 2023-10-16T13:50:31.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249804.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.253859.log.gz 2023-10-16T13:50:31.114 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111553.log 2023-10-16T13:50:31.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111813.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.249804.log.gz 2023-10-16T13:50:31.115 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114579.log 2023-10-16T13:50:31.115 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111813.log.gz 2023-10-16T13:50:31.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248819.log 2023-10-16T13:50:31.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114579.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111553.log.gz 2023-10-16T13:50:31.116 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110824.log 2023-10-16T13:50:31.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248819.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114579.log.gz 2023-10-16T13:50:31.117 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116486.log 2023-10-16T13:50:31.117 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.248819.log.gz 2023-10-16T13:50:31.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253656.log 2023-10-16T13:50:31.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116486.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110824.log.gz 2023-10-16T13:50:31.118 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110813.log 2023-10-16T13:50:31.118 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116486.log.gz 2023-10-16T13:50:31.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110814.log 2023-10-16T13:50:31.119 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.253656.log.gz 2023-10-16T13:50:31.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247933.log 2023-10-16T13:50:31.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110814.log: gzip -5 --verbose 88.3%-- /var/log/ceph/ceph-client.admin.110823.log 2023-10-16T13:50:31.120 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110813.log.gz 2023-10-16T13:50:31.120 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110814.log.gz 2023-10-16T13:50:31.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258616.log 2023-10-16T13:50:31.121 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.247933.log.gz 2023-10-16T13:50:31.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262550.log 2023-10-16T13:50:31.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258616.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110823.log.gz 2023-10-16T13:50:31.122 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262506.log 2023-10-16T13:50:31.122 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.258616.log.gz 2023-10-16T13:50:31.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243710.log 2023-10-16T13:50:31.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262506.log: gzip 88.1%-5 --verbose -- /var/log/ceph/ceph-client.admin.246979.log -- replaced with /var/log/ceph/ceph-client.admin.262550.log.gz 2023-10-16T13:50:31.123 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-16T13:50:31.124 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116716.log 2023-10-16T13:50:31.124 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.262506.log.gz 2023-10-16T13:50:31.124 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.243710.log.gz 2023-10-16T13:50:31.124 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245364.log 2023-10-16T13:50:31.125 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.246979.log.gz 2023-10-16T13:50:31.125 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116716.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T13:50:31.126 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111191.log 2023-10-16T13:50:31.126 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116716.log.gz 2023-10-16T13:50:31.126 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.245364.log.gz 2023-10-16T13:50:31.127 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260311.log 2023-10-16T13:50:31.127 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117074.log 2023-10-16T13:50:31.127 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111191.log: /var/log/ceph/ceph-client.admin.260311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116210.log 2023-10-16T13:50:31.128 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111191.log.gz 2023-10-16T13:50:31.128 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122980.log 2023-10-16T13:50:31.128 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.260311.log.gz 2023-10-16T13:50:31.129 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117074.log.gz 2023-10-16T13:50:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259863.log 2023-10-16T13:50:31.129 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116210.log.gz 2023-10-16T13:50:31.130 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121163.log 2023-10-16T13:50:31.130 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122980.log: /var/log/ceph/ceph-client.admin.259863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252336.log 2023-10-16T13:50:31.131 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122980.log.gz 2023-10-16T13:50:31.131 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.259863.log.gz 2023-10-16T13:50:31.131 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253384.log 2023-10-16T13:50:31.132 INFO:teuthology.orchestra.run.smithi005.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T13:50:31.132 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109718.log /var/log/ceph/ceph-client.admin.252336.log: 2023-10-16T13:50:31.132 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121163.log.gz 2023-10-16T13:50:31.133 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247823.log 2023-10-16T13:50:31.133 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.252336.log.gz 2023-10-16T13:50:31.133 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109718.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.253384.log.gz--verbose 2023-10-16T13:50:31.133 INFO:teuthology.orchestra.run.smithi005.stderr:-- /var/log/ceph/ceph-client.admin.258570.log 2023-10-16T13:50:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247823.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109718.log.gz 2023-10-16T13:50:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256652.log 2023-10-16T13:50:31.134 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.247823.log.gz 2023-10-16T13:50:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110320.log 2023-10-16T13:50:31.135 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.258570.log.gz 2023-10-16T13:50:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251302.log 2023-10-16T13:50:31.136 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110320.log: gzip 87.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.256652.log.gz-- 2023-10-16T13:50:31.136 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114118.log 2023-10-16T13:50:31.136 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251302.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110320.log.gz 2023-10-16T13:50:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117826.log 2023-10-16T13:50:31.137 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.251302.log.gz 2023-10-16T13:50:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119612.log 2023-10-16T13:50:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117826.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114118.log.gz 2023-10-16T13:50:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121022.log 2023-10-16T13:50:31.138 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117826.log.gz 2023-10-16T13:50:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121865.log 2023-10-16T13:50:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121022.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119612.log.gz 2023-10-16T13:50:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251099.log 2023-10-16T13:50:31.139 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121022.log.gz 2023-10-16T13:50:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257990.log 2023-10-16T13:50:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244252.log 2023-10-16T13:50:31.140 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121865.log.gz 2023-10-16T13:50:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257990.log: gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.119000.log 2023-10-16T13:50:31.141 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.251099.log.gz 2023-10-16T13:50:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244252.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.257990.log.gz 2023-10-16T13:50:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251394.log 2023-10-16T13:50:31.142 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.244252.log.gz 2023-10-16T13:50:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244298.log 2023-10-16T13:50:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251394.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.119000.log.gz-5 2023-10-16T13:50:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:--verbose -- /var/log/ceph/ceph-client.admin.117398.log 2023-10-16T13:50:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244298.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.251394.log.gz 2023-10-16T13:50:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118954.log 2023-10-16T13:50:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117398.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.244298.log.gz 2023-10-16T13:50:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119092.log 2023-10-16T13:50:31.144 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117398.log.gz 2023-10-16T13:50:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260219.log 2023-10-16T13:50:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119092.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118954.log.gz 2023-10-16T13:50:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247025.log 2023-10-16T13:50:31.145 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119092.log.gz 2023-10-16T13:50:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247343.log 2023-10-16T13:50:31.146 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5%/var/log/ceph/ceph-client.admin.247025.log: -- replaced with /var/log/ceph/ceph-client.admin.260219.log.gz 2023-10-16T13:50:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116118.log 2023-10-16T13:50:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247343.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.247025.log.gz 2023-10-16T13:50:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122214.log 2023-10-16T13:50:31.147 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.247343.log.gz 2023-10-16T13:50:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116302.log 2023-10-16T13:50:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.122214.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116118.log.gz 2023-10-16T13:50:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254273.log 2023-10-16T13:50:31.148 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122214.log.gz 2023-10-16T13:50:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245930.log 2023-10-16T13:50:31.149 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116302.log.gz 2023-10-16T13:50:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253476.log 2023-10-16T13:50:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254273.log: /var/log/ceph/ceph-client.admin.245930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115605.log 2023-10-16T13:50:31.150 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.254273.log.gz 2023-10-16T13:50:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253476.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.245930.log.gz 2023-10-16T13:50:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122754.log 2023-10-16T13:50:31.151 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.253476.log.gz 2023-10-16T13:50:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 /var/log/ceph/ceph-client.admin.115605.log: --verbose -- /var/log/ceph/ceph-client.admin.117260.log 2023-10-16T13:50:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122754.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115605.log.gz 2023-10-16T13:50:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122846.log 2023-10-16T13:50:31.152 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122754.log.gz 2023-10-16T13:50:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261769.log 2023-10-16T13:50:31.152 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117260.log.gz 2023-10-16T13:50:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117490.log 2023-10-16T13:50:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261769.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.122846.log.gz 2023-10-16T13:50:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.123643.log 2023-10-16T13:50:31.153 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.261769.log.gz 2023-10-16T13:50:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112089.log 2023-10-16T13:50:31.154 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8%/var/log/ceph/ceph-client.admin.123643.log: -- replaced with /var/log/ceph/ceph-client.admin.117490.log.gz 2023-10-16T13:50:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254951.log 2023-10-16T13:50:31.155 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123643.log.gz 2023-10-16T13:50:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248256.log 2023-10-16T13:50:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254951.log: 87.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.112089.log.gz--verbose 2023-10-16T13:50:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:-- /var/log/ceph/ceph-osd.0.log 2023-10-16T13:50:31.156 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.254951.log.gz 2023-10-16T13:50:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246933.log 2023-10-16T13:50:31.156 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.248256.log.gz 2023-10-16T13:50:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260825.log 2023-10-16T13:50:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244942.log 2023-10-16T13:50:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260825.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.246933.log.gz 2023-10-16T13:50:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111859.log 2023-10-16T13:50:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244942.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.260825.log.gz 2023-10-16T13:50:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253522.log 2023-10-16T13:50:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111859.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.244942.log.gz 2023-10-16T13:50:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257465.log 2023-10-16T13:50:31.159 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111859.log.gz 2023-10-16T13:50:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246666.log 2023-10-16T13:50:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262367.log 2023-10-16T13:50:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257465.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.253522.log.gz 2023-10-16T13:50:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244620.log 2023-10-16T13:50:31.161 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.257465.log.gz 2023-10-16T13:50:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116808.log 2023-10-16T13:50:31.162 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.246666.log.gz 2023-10-16T13:50:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244620.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.262367.log.gz--verbose 2023-10-16T13:50:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:-- /var/log/ceph/ceph-client.admin.247684.log 2023-10-16T13:50:31.163 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.244620.log.gz 2023-10-16T13:50:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244988.log 2023-10-16T13:50:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119907.log 2023-10-16T13:50:31.164 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116808.log.gz 2023-10-16T13:50:31.164 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.247684.log.gz 2023-10-16T13:50:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125764.log 2023-10-16T13:50:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111951.log 2023-10-16T13:50:31.165 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.244988.log.gz 2023-10-16T13:50:31.165 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119907.log.gz 2023-10-16T13:50:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252242.log 2023-10-16T13:50:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120440.log 2023-10-16T13:50:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111951.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125764.log.gz 2023-10-16T13:50:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252242.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111951.log.gz 2023-10-16T13:50:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110479.log 2023-10-16T13:50:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248302.log 2023-10-16T13:50:31.167 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.252242.log.gz 2023-10-16T13:50:31.168 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120440.log.gz 2023-10-16T13:50:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256944.log 2023-10-16T13:50:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118169.log 2023-10-16T13:50:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248302.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110479.log.gz 2023-10-16T13:50:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.248302.log.gz 2023-10-16T13:50:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256460.log 2023-10-16T13:50:31.169 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.256944.log.gz 2023-10-16T13:50:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.118169.log: -- /var/log/ceph/ceph-client.admin.116670.log 2023-10-16T13:50:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247500.log 2023-10-16T13:50:31.170 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118169.log.gz 2023-10-16T13:50:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116670.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.256460.log.gz 2023-10-16T13:50:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115754.log 2023-10-16T13:50:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247500.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116670.log.gz 2023-10-16T13:50:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248210.log 2023-10-16T13:50:31.172 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.247500.log.gz 2023-10-16T13:50:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244804.log 2023-10-16T13:50:31.172 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115754.log.gz 2023-10-16T13:50:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261953.log 2023-10-16T13:50:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252520.log 2023-10-16T13:50:31.173 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6%/var/log/ceph/ceph-client.admin.244804.log: -- replaced with /var/log/ceph/ceph-client.admin.248210.log.gz 2023-10-16T13:50:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261953.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-16T13:50:31.174 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.244804.log.gz 2023-10-16T13:50:31.174 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.261953.log.gz 2023-10-16T13:50:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250390.log 2023-10-16T13:50:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256806.log 2023-10-16T13:50:31.175 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.252520.log.gz 2023-10-16T13:50:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243388.log 2023-10-16T13:50:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256806.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.250390.log.gz 2023-10-16T13:50:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243388.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.256806.log.gz 2023-10-16T13:50:31.176 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.243388.log.gz 2023-10-16T13:50:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249253.log 2023-10-16T13:50:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246022.log 2023-10-16T13:50:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109452.log 2023-10-16T13:50:31.177 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.249253.log.gz 2023-10-16T13:50:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246022.log: /var/log/ceph/ceph-client.admin.109452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.246022.log.gz 2023-10-16T13:50:31.178 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109452.log.gz 2023-10-16T13:50:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116026.log 2023-10-16T13:50:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112411.log 2023-10-16T13:50:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259771.log 2023-10-16T13:50:31.179 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116026.log.gz 2023-10-16T13:50:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112411.log: /var/log/ceph/ceph-client.admin.259771.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112411.log.gz 2023-10-16T13:50:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118010.log 2023-10-16T13:50:31.180 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.259771.log.gz 2023-10-16T13:50:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255463.log 2023-10-16T13:50:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111557.log 2023-10-16T13:50:31.181 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118010.log.gz 2023-10-16T13:50:31.181 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255463.log: /var/log/ceph/ceph-client.admin.111557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.255463.log.gz 2023-10-16T13:50:31.181 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111557.log.gz 2023-10-16T13:50:31.181 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.246421.log 2023-10-16T13:50:31.182 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257898.log 2023-10-16T13:50:31.182 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.246421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124380.log 2023-10-16T13:50:31.182 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.246421.log.gz 2023-10-16T13:50:31.182 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250777.log 2023-10-16T13:50:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124380.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.257898.log.gz 2023-10-16T13:50:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255565.log 2023-10-16T13:50:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250777.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124380.log.gz 2023-10-16T13:50:31.183 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123867.log 2023-10-16T13:50:31.184 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.250777.log.gz 2023-10-16T13:50:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120928.log 2023-10-16T13:50:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120976.log 2023-10-16T13:50:31.184 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.255565.log.gz 2023-10-16T13:50:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120928.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123867.log.gz 2023-10-16T13:50:31.185 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120928.log.gz 2023-10-16T13:50:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120976.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120976.log.gz 2023-10-16T13:50:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250482.log 2023-10-16T13:50:31.186 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260871.log 2023-10-16T13:50:31.186 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117352.log 2023-10-16T13:50:31.186 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261677.log 2023-10-16T13:50:31.187 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.250482.log.gz 2023-10-16T13:50:31.187 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119246.log 2023-10-16T13:50:31.187 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.260871.log.gz 2023-10-16T13:50:31.187 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118610.log 2023-10-16T13:50:31.188 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117352.log.gz 2023-10-16T13:50:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119246.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.261677.log.gz 2023-10-16T13:50:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248411.log 2023-10-16T13:50:31.189 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.118610.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119246.log.gz 2023-10-16T13:50:31.189 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118610.log.gz 2023-10-16T13:50:31.189 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248411.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.248411.log.gz 2023-10-16T13:50:31.189 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118858.log 2023-10-16T13:50:31.190 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249153.log 2023-10-16T13:50:31.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254383.log 2023-10-16T13:50:31.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249153.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118858.log.gz 2023-10-16T13:50:31.190 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.249153.log.gz 2023-10-16T13:50:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254383.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.254383.log.gz 2023-10-16T13:50:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121911.log 2023-10-16T13:50:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243618.log 2023-10-16T13:50:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259382.log 2023-10-16T13:50:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262275.log /var/log/ceph/ceph-client.admin.243618.log: 2023-10-16T13:50:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259382.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.243618.log.gz 2023-10-16T13:50:31.192 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.121911.log.gz 2023-10-16T13:50:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262275.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.259382.log.gz 2023-10-16T13:50:31.193 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.262275.log.gz 2023-10-16T13:50:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125213.log 2023-10-16T13:50:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251532.log 2023-10-16T13:50:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116854.log 2023-10-16T13:50:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251532.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125213.log.gz 2023-10-16T13:50:31.194 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.251532.log.gz 2023-10-16T13:50:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116854.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116854.log.gz 2023-10-16T13:50:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126002.log 2023-10-16T13:50:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123367.log 2023-10-16T13:50:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.126002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262045.log 2023-10-16T13:50:31.196 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126002.log.gz 2023-10-16T13:50:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123367.log: /var/log/ceph/ceph-client.admin.262045.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123367.log.gz 2023-10-16T13:50:31.196 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.262045.log.gz 2023-10-16T13:50:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257419.log 2023-10-16T13:50:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109906.log 2023-10-16T13:50:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254181.log 2023-10-16T13:50:31.197 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.257419.log.gz 2023-10-16T13:50:31.198 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260488.log 2023-10-16T13:50:31.198 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110366.log 2023-10-16T13:50:31.198 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254181.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109906.log.gz 2023-10-16T13:50:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260488.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.254181.log.gz 2023-10-16T13:50:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110366.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.260488.log.gz 2023-10-16T13:50:31.199 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110366.log.gz 2023-10-16T13:50:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-16T13:50:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117918.log 2023-10-16T13:50:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244003.log 2023-10-16T13:50:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115559.log 2023-10-16T13:50:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244003.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117918.log.gz 2023-10-16T13:50:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115559.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.244003.log.gz 2023-10-16T13:50:31.201 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115559.log.gz 2023-10-16T13:50:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253430.log 2023-10-16T13:50:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113093.log 2023-10-16T13:50:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124937.log 2023-10-16T13:50:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.113093.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.253430.log.gz 2023-10-16T13:50:31.203 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113093.log.gz 2023-10-16T13:50:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113758.log 2023-10-16T13:50:31.203 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124937.log.gz 2023-10-16T13:50:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121265.log 2023-10-16T13:50:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.113758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113758.log.gz 2023-10-16T13:50:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121265.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121265.log.gz 2023-10-16T13:50:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254706.log 2023-10-16T13:50:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252150.log 2023-10-16T13:50:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254706.log: /var/log/ceph/ceph-client.admin.252150.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.254706.log.gz 2023-10-16T13:50:31.205 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.252150.log.gz 2023-10-16T13:50:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249207.log 2023-10-16T13:50:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121589.log 2023-10-16T13:50:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249207.log: /var/log/ceph/ceph-client.admin.121589.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.249207.log.gz 2023-10-16T13:50:31.206 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121589.log.gz 2023-10-16T13:50:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114625.log 2023-10-16T13:50:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111192.log 2023-10-16T13:50:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110090.log 2023-10-16T13:50:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114625.log.gz 2023-10-16T13:50:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110090.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111192.log.gz 2023-10-16T13:50:31.208 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110090.log.gz 2023-10-16T13:50:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.252915.log 2023-10-16T13:50:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251256.log 2023-10-16T13:50:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.252915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252196.log 2023-10-16T13:50:31.209 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.252915.log.gz 2023-10-16T13:50:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251256.log: /var/log/ceph/ceph-client.admin.252196.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.251256.log.gz 2023-10-16T13:50:31.210 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.252196.log.gz 2023-10-16T13:50:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124613.log 2023-10-16T13:50:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117168.log 2023-10-16T13:50:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114026.log 2023-10-16T13:50:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117168.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124613.log.gz 2023-10-16T13:50:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114026.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117168.log.gz 2023-10-16T13:50:31.212 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114026.log.gz 2023-10-16T13:50:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110810.log 2023-10-16T13:50:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248585.log 2023-10-16T13:50:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110810.log: /var/log/ceph/ceph-client.admin.248585.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110810.log.gz 2023-10-16T13:50:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122370.log 2023-10-16T13:50:31.213 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.248585.log.gz 2023-10-16T13:50:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110816.log 2023-10-16T13:50:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122370.log: /var/log/ceph/ceph-client.admin.110816.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122370.log.gz 2023-10-16T13:50:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244758.log 2023-10-16T13:50:31.214 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110816.log.gz 2023-10-16T13:50:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122554.log 2023-10-16T13:50:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244758.log: /var/log/ceph/ceph-client.admin.122554.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.244758.log.gz 2023-10-16T13:50:31.215 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122554.log.gz 2023-10-16T13:50:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245142.log 2023-10-16T13:50:31.216 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109952.log 2023-10-16T13:50:31.216 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121451.log 2023-10-16T13:50:31.216 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109952.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.245142.log.gz 2023-10-16T13:50:31.216 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109952.log.gz 2023-10-16T13:50:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121451.log.gz 2023-10-16T13:50:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120183.log 2023-10-16T13:50:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245502.log 2023-10-16T13:50:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120183.log: /var/log/ceph/ceph-client.admin.245502.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120183.log.gz 2023-10-16T13:50:31.218 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.245502.log.gz 2023-10-16T13:50:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256606.log 2023-10-16T13:50:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117586.log 2023-10-16T13:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250256.log 2023-10-16T13:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.256606.log.gz 2023-10-16T13:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250256.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117586.log.gz 2023-10-16T13:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.250256.log.gz 2023-10-16T13:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124799.log 2023-10-16T13:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111180.log 2023-10-16T13:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124799.log: /var/log/ceph/ceph-client.admin.111180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260917.log 2023-10-16T13:50:31.221 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124799.log.gz 2023-10-16T13:50:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121211.log 2023-10-16T13:50:31.221 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111180.log.gz 2023-10-16T13:50:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253138.log 2023-10-16T13:50:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121211.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.260917.log.gz 2023-10-16T13:50:31.222 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121211.log.gz 2023-10-16T13:50:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256414.log 2023-10-16T13:50:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253138.log: /var/log/ceph/ceph-client.admin.256414.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.253138.log.gz 2023-10-16T13:50:31.223 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.256414.log.gz 2023-10-16T13:50:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259947.log 2023-10-16T13:50:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125810.log 2023-10-16T13:50:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123551.log 2023-10-16T13:50:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125810.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.259947.log.gz 2023-10-16T13:50:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123551.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125810.log.gz 2023-10-16T13:50:31.225 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123551.log.gz 2023-10-16T13:50:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247454.log 2023-10-16T13:50:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251640.log 2023-10-16T13:50:31.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119046.log 2023-10-16T13:50:31.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251640.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.247454.log.gz 2023-10-16T13:50:31.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119046.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.251640.log.gz 2023-10-16T13:50:31.226 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119046.log.gz 2023-10-16T13:50:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249345.log 2023-10-16T13:50:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262321.log 2023-10-16T13:50:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249345.log: /var/log/ceph/ceph-client.admin.262321.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.249345.log.gz 2023-10-16T13:50:31.227 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.262321.log.gz 2023-10-16T13:50:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116164.log 2023-10-16T13:50:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122218.log 2023-10-16T13:50:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116164.log: /var/log/ceph/ceph-client.0.122218.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116164.log.gz 2023-10-16T13:50:31.229 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122218.log.gz 2023-10-16T13:50:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258663.log 2023-10-16T13:50:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118766.log 2023-10-16T13:50:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258663.log: /var/log/ceph/ceph-client.admin.118766.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.258663.log.gz 2023-10-16T13:50:31.230 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118766.log.gz 2023-10-16T13:50:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115938.log 2023-10-16T13:50:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122800.log 2023-10-16T13:50:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115938.log: /var/log/ceph/ceph-client.admin.122800.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115938.log.gz 2023-10-16T13:50:31.231 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122800.log.gz 2023-10-16T13:50:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124472.log 2023-10-16T13:50:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248118.log 2023-10-16T13:50:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255317.log 2023-10-16T13:50:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248118.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124472.log.gz 2023-10-16T13:50:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255317.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.248118.log.gz 2023-10-16T13:50:31.233 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.255317.log.gz 2023-10-16T13:50:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248164.log 2023-10-16T13:50:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257603.log 2023-10-16T13:50:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114072.log 2023-10-16T13:50:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257603.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.248164.log.gz 2023-10-16T13:50:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114072.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.257603.log.gz 2023-10-16T13:50:31.234 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114072.log.gz 2023-10-16T13:50:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250118.log 2023-10-16T13:50:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123959.log 2023-10-16T13:50:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250118.log: /var/log/ceph/ceph-client.admin.123959.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.250118.log.gz 2023-10-16T13:50:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-16T13:50:31.236 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123959.log.gz 2023-10-16T13:50:31.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125864.log 2023-10-16T13:50:31.236 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246574.log 2023-10-16T13:50:31.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125864.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125864.log.gz 2023-10-16T13:50:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.112488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112488.log.gz 2023-10-16T13:50:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110617.log 2023-10-16T13:50:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246574.log: /var/log/ceph/ceph-client.admin.110617.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.246574.log.gz 2023-10-16T13:50:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245550.log 2023-10-16T13:50:31.323 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110617.log.gz 2023-10-16T13:50:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262459.log 2023-10-16T13:50:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245550.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.245550.log.gz 2023-10-16T13:50:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124519.log 2023-10-16T13:50:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262459.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.262459.log.gz 2023-10-16T13:50:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258805.log 2023-10-16T13:50:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124519.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124519.log.gz 2023-10-16T13:50:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258805.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.258805.log.gz 2023-10-16T13:50:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245232.log 2023-10-16T13:50:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259725.log 2023-10-16T13:50:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245232.log: /var/log/ceph/ceph-client.admin.259725.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.245232.log.gz 2023-10-16T13:50:31.325 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.259725.log.gz 2023-10-16T13:50:31.326 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123459.log 2023-10-16T13:50:31.326 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244850.log 2023-10-16T13:50:31.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123459.log: 89.4%/var/log/ceph/ceph-client.admin.244850.log: -- replaced with /var/log/ceph/ceph-client.admin.123459.log.gz 2023-10-16T13:50:31.326 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246620.log 2023-10-16T13:50:31.327 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.244850.log.gz 2023-10-16T13:50:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247546.log 2023-10-16T13:50:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246620.log: /var/log/ceph/ceph-client.admin.247546.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.246620.log.gz 2023-10-16T13:50:31.328 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.247546.log.gz 2023-10-16T13:50:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123505.log 2023-10-16T13:50:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258944.log 2023-10-16T13:50:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123505.log: /var/log/ceph/ceph-client.admin.258944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123505.log.gz 2023-10-16T13:50:31.329 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.258944.log.gz 2023-10-16T13:50:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114348.log 2023-10-16T13:50:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125351.log 2023-10-16T13:50:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114348.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114348.log.gz 2023-10-16T13:50:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125351.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125351.log.gz 2023-10-16T13:50:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116394.log 2023-10-16T13:50:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119200.log 2023-10-16T13:50:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116394.log: /var/log/ceph/ceph-client.admin.119200.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116394.log.gz 2023-10-16T13:50:31.331 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119200.log.gz 2023-10-16T13:50:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117028.log 2023-10-16T13:50:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262229.log 2023-10-16T13:50:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117028.log: /var/log/ceph/ceph-client.admin.262229.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117028.log.gz 2023-10-16T13:50:31.332 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.262229.log.gz 2023-10-16T13:50:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248501.log 2023-10-16T13:50:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247408.log 2023-10-16T13:50:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248501.log: /var/log/ceph/ceph-client.admin.247408.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.248501.log.gz 2023-10-16T13:50:31.333 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.247408.log.gz 2023-10-16T13:50:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121405.log 2023-10-16T13:50:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254227.log 2023-10-16T13:50:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121405.log: /var/log/ceph/ceph-client.admin.254227.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121405.log.gz 2023-10-16T13:50:31.334 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.254227.log.gz 2023-10-16T13:50:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258524.log 2023-10-16T13:50:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250574.log 2023-10-16T13:50:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258524.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.258524.log.gz/var/log/ceph/ceph-client.admin.250574.log: 2023-10-16T13:50:31.335 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.250574.log.gz 2023-10-16T13:50:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120532.log 2023-10-16T13:50:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121819.log 2023-10-16T13:50:31.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120532.log: /var/log/ceph/ceph-client.admin.121819.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120532.log.gz 2023-10-16T13:50:31.336 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121819.log.gz 2023-10-16T13:50:31.336 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109858.log 2023-10-16T13:50:31.336 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257557.log 2023-10-16T13:50:31.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109858.log: /var/log/ceph/ceph-client.admin.257557.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109858.log.gz 2023-10-16T13:50:31.337 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.257557.log.gz 2023-10-16T13:50:31.337 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125121.log 2023-10-16T13:50:31.337 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245698.log 2023-10-16T13:50:31.338 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125121.log: /var/log/ceph/ceph-client.admin.245698.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125121.log.gz 2023-10-16T13:50:31.338 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.245698.log.gz 2023-10-16T13:50:31.338 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246712.log 2023-10-16T13:50:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116532.log 2023-10-16T13:50:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246712.log: /var/log/ceph/ceph-client.admin.116532.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.246712.log.gz 2023-10-16T13:50:31.339 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116532.log.gz 2023-10-16T13:50:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111559.log 2023-10-16T13:50:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116944.log 2023-10-16T13:50:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111559.log: /var/log/ceph/ceph-client.admin.116944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111559.log.gz 2023-10-16T13:50:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252096.log 2023-10-16T13:50:31.340 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116944.log.gz 2023-10-16T13:50:31.341 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246887.log 2023-10-16T13:50:31.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252096.log: /var/log/ceph/ceph-client.admin.246887.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.252096.log.gz 2023-10-16T13:50:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.246887.log.gz 2023-10-16T13:50:31.341 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121635.log 2023-10-16T13:50:31.342 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247297.log 2023-10-16T13:50:31.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121635.log: /var/log/ceph/ceph-client.admin.247297.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121635.log.gz 2023-10-16T13:50:31.342 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.247297.log.gz 2023-10-16T13:50:31.342 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245410.log 2023-10-16T13:50:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248631.log 2023-10-16T13:50:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245410.log: 88.8%/var/log/ceph/ceph-client.admin.248631.log: -- replaced with /var/log/ceph/ceph-client.admin.245410.log.gz 2023-10-16T13:50:31.343 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.248631.log.gz 2023-10-16T13:50:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255417.log 2023-10-16T13:50:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251163.log 2023-10-16T13:50:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255417.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.255417.log.gz 2023-10-16T13:50:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251163.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.251163.log.gz 2023-10-16T13:50:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121543.log 2023-10-16T13:50:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120645.log 2023-10-16T13:50:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121543.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-16T13:50:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120645.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121543.log.gz 2023-10-16T13:50:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120645.log.gz 2023-10-16T13:50:31.346 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120348.log 2023-10-16T13:50:31.346 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255841.log 2023-10-16T13:50:31.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123597.log 2023-10-16T13:50:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255841.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120348.log.gz 2023-10-16T13:50:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123597.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123597.log.gz 2023-10-16T13:50:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.255841.log.gz 2023-10-16T13:50:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123321.log 2023-10-16T13:50:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258709.log 2023-10-16T13:50:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123321.log: /var/log/ceph/ceph-client.admin.258709.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123321.log.gz 2023-10-16T13:50:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.258709.log.gz 2023-10-16T13:50:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124205.log 2023-10-16T13:50:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259220.log 2023-10-16T13:50:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110412.log 2023-10-16T13:50:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259220.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124205.log.gz 2023-10-16T13:50:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110412.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.259220.log.gz 2023-10-16T13:50:31.350 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110412.log.gz 2023-10-16T13:50:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118377.log 2023-10-16T13:50:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122416.log 2023-10-16T13:50:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118377.log: /var/log/ceph/ceph-client.admin.122416.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118377.log.gz 2023-10-16T13:50:31.351 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122416.log.gz 2023-10-16T13:50:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246184.log 2023-10-16T13:50:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115287.log 2023-10-16T13:50:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114164.log 2023-10-16T13:50:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115287.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.246184.log.gz 2023-10-16T13:50:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114164.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115287.log.gz 2023-10-16T13:50:31.352 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114164.log.gz 2023-10-16T13:50:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111181.log 2023-10-16T13:50:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258082.log 2023-10-16T13:50:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111181.log: /var/log/ceph/ceph-client.admin.258082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111181.log.gz 2023-10-16T13:50:31.353 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.258082.log.gz 2023-10-16T13:50:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T13:50:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114210.log 2023-10-16T13:50:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.114210.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114210.log.gz 2023-10-16T13:50:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123183.log 2023-10-16T13:50:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114533.log 2023-10-16T13:50:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123183.log: /var/log/ceph/ceph-client.admin.114533.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123183.log.gz 2023-10-16T13:50:31.355 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114533.log.gz 2023-10-16T13:50:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120486.log 2023-10-16T13:50:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122662.log 2023-10-16T13:50:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120486.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120486.log.gz 2023-10-16T13:50:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122662.log: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T13:50:31.356 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122662.log.gz 2023-10-16T13:50:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255175.log 2023-10-16T13:50:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244666.log 2023-10-16T13:50:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255175.log: /var/log/ceph/ceph-client.admin.244666.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.255175.log.gz 2023-10-16T13:50:31.357 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.244666.log.gz 2023-10-16T13:50:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122934.log 2023-10-16T13:50:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114487.log 2023-10-16T13:50:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115651.log 2023-10-16T13:50:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115241.log 2023-10-16T13:50:31.359 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122934.log.gz 2023-10-16T13:50:31.359 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114487.log.gz 2023-10-16T13:50:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115651.log: /var/log/ceph/ceph-client.admin.115241.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115241.log.gz 2023-10-16T13:50:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117780.log 2023-10-16T13:50:31.360 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115651.log.gz 2023-10-16T13:50:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260265.log 2023-10-16T13:50:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117780.log: /var/log/ceph/ceph-client.admin.260265.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117780.log.gz 2023-10-16T13:50:31.361 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.260265.log.gz 2023-10-16T13:50:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120091.log 2023-10-16T13:50:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120578.log 2023-10-16T13:50:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245456.log 2023-10-16T13:50:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120578.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120091.log.gz 2023-10-16T13:50:31.362 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120578.log.gz 2023-10-16T13:50:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245456.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.245456.log.gz 2023-10-16T13:50:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112611.log 2023-10-16T13:50:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244390.log 2023-10-16T13:50:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260779.log 2023-10-16T13:50:31.363 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5%/var/log/ceph/ceph-client.admin.244390.log: -- replaced with /var/log/ceph/ceph-client.admin.112611.log.gz 2023-10-16T13:50:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260779.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.244390.log.gz 2023-10-16T13:50:31.364 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.260779.log.gz 2023-10-16T13:50:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246068.log 2023-10-16T13:50:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254089.log 2023-10-16T13:50:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246068.log: /var/log/ceph/ceph-client.admin.254089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.246068.log.gz 2023-10-16T13:50:31.365 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.254089.log.gz 2023-10-16T13:50:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112273.log 2023-10-16T13:50:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114771.log 2023-10-16T13:50:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117214.log 2023-10-16T13:50:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114771.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112273.log.gz 2023-10-16T13:50:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117214.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114771.log.gz 2023-10-16T13:50:31.367 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124051.log 2023-10-16T13:50:31.367 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117214.log.gz 2023-10-16T13:50:31.367 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259082.log 2023-10-16T13:50:31.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124051.log: /var/log/ceph/ceph-client.admin.259082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124051.log.gz 2023-10-16T13:50:31.368 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.259082.log.gz 2023-10-16T13:50:31.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250210.log 2023-10-16T13:50:31.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253951.log 2023-10-16T13:50:31.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261861.log 2023-10-16T13:50:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253951.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.250210.log.gz 2023-10-16T13:50:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261861.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.253951.log.gz 2023-10-16T13:50:31.369 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.261861.log.gz 2023-10-16T13:50:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.259619.log 2023-10-16T13:50:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111560.log 2023-10-16T13:50:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.259619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.259619.log.gz 2023-10-16T13:50:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111560.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111560.log.gz 2023-10-16T13:50:31.371 INFO:teuthology.orchestra.run.smithi005.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gzgzip 2023-10-16T13:50:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.255795.log 2023-10-16T13:50:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111554.log 2023-10-16T13:50:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124707.log 2023-10-16T13:50:31.372 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.255795.log.gz/var/log/ceph/ceph-client.admin.111554.log: 2023-10-16T13:50:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118812.log 2023-10-16T13:50:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111554.log.gz 2023-10-16T13:50:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258757.log 2023-10-16T13:50:31.373 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124707.log.gz 2023-10-16T13:50:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.246417.log 2023-10-16T13:50:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116348.log 2023-10-16T13:50:31.374 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118812.log.gz 2023-10-16T13:50:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.246417.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.258757.log.gz 2023-10-16T13:50:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253905.log 2023-10-16T13:50:31.375 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.246417.log.gz 2023-10-16T13:50:31.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116578.log 2023-10-16T13:50:31.375 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116348.log.gz 2023-10-16T13:50:31.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253905.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.253905.log.gz 2023-10-16T13:50:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116578.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116578.log.gz 2023-10-16T13:50:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119566.log 2023-10-16T13:50:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120753.log 2023-10-16T13:50:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251348.log 2023-10-16T13:50:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120753.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119566.log.gz 2023-10-16T13:50:31.377 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120753.log.gz 2023-10-16T13:50:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251348.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.251348.log.gz 2023-10-16T13:50:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118056.log 2023-10-16T13:50:31.378 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253071.log 2023-10-16T13:50:31.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256698.log 2023-10-16T13:50:31.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256255.log 2023-10-16T13:50:31.378 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118056.log.gz 2023-10-16T13:50:31.379 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.253071.log.gz 2023-10-16T13:50:31.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251906.log 2023-10-16T13:50:31.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113754.log 2023-10-16T13:50:31.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256255.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.256698.log.gz 2023-10-16T13:50:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252474.log 2023-10-16T13:50:31.380 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.256255.log.gz 2023-10-16T13:50:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.113754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252612.log 2023-10-16T13:50:31.380 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113754.log.gz 2023-10-16T13:50:31.381 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.251906.log.gz 2023-10-16T13:50:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258174.log 2023-10-16T13:50:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119386.log 2023-10-16T13:50:31.382 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.252474.log.gz 2023-10-16T13:50:31.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258174.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.252612.log.gz 2023-10-16T13:50:31.382 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.258174.log.gz 2023-10-16T13:50:31.382 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250731.log 2023-10-16T13:50:31.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247159.log 2023-10-16T13:50:31.383 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119386.log.gz 2023-10-16T13:50:31.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250731.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.250731.log.gz 2023-10-16T13:50:31.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247159.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.247159.log.gz 2023-10-16T13:50:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261155.log 2023-10-16T13:50:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125910.log 2023-10-16T13:50:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120843.log 2023-10-16T13:50:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125910.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.261155.log.gz 2023-10-16T13:50:31.385 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125910.log.gz 2023-10-16T13:50:31.385 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125075.log 2023-10-16T13:50:31.385 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120843.log.gz 2023-10-16T13:50:31.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124753.log 2023-10-16T13:50:31.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244206.log 2023-10-16T13:50:31.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250436.log 2023-10-16T13:50:31.386 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125075.log.gz 2023-10-16T13:50:31.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115047.log 2023-10-16T13:50:31.387 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124753.log.gz 2023-10-16T13:50:31.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250436.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.121069.log 2023-10-16T13:50:31.387 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.244206.log.gz 2023-10-16T13:50:31.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115047.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.250436.log.gz 2023-10-16T13:50:31.388 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115047.log.gz 2023-10-16T13:50:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121069.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121069.log.gz 2023-10-16T13:50:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115892.log 2023-10-16T13:50:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248771.log 2023-10-16T13:50:31.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118614.log 2023-10-16T13:50:31.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248771.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115892.log.gz 2023-10-16T13:50:31.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246528.log 2023-10-16T13:50:31.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.118614.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.248771.log.gz 2023-10-16T13:50:31.390 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118614.log.gz 2023-10-16T13:50:31.390 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111905.log 2023-10-16T13:50:31.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112181.log 2023-10-16T13:50:31.390 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.246528.log.gz 2023-10-16T13:50:31.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251730.log 2023-10-16T13:50:31.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260039.log 2023-10-16T13:50:31.391 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111905.log.gz 2023-10-16T13:50:31.391 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112181.log.gz 2023-10-16T13:50:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249061.log 2023-10-16T13:50:31.392 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.251730.log.gz 2023-10-16T13:50:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257944.log 2023-10-16T13:50:31.392 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.260039.log.gz 2023-10-16T13:50:31.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244528.log 2023-10-16T13:50:31.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119953.log 2023-10-16T13:50:31.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257944.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.249061.log.gz 2023-10-16T13:50:31.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123821.log 2023-10-16T13:50:31.394 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.257944.log.gz 2023-10-16T13:50:31.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125305.log 2023-10-16T13:50:31.394 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.244528.log.gz 2023-10-16T13:50:31.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123821.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119953.log.gz 2023-10-16T13:50:31.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125305.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123821.log.gz 2023-10-16T13:50:31.395 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125305.log.gz 2023-10-16T13:50:31.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.256148.log 2023-10-16T13:50:31.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251486.log 2023-10-16T13:50:31.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.256148.log: gzip -5 0.0%--verbose -- /var/log/ceph/ceph-client.admin.111767.log -- replaced with /var/log/ceph/ceph-client.0.256148.log.gz 2023-10-16T13:50:31.396 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-16T13:50:31.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109998.log 2023-10-16T13:50:31.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111767.log: gzip -5 88.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.251486.log.gz/var/log/ceph/ceph-client.admin.104272.log 2023-10-16T13:50:31.396 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-16T13:50:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109998.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111767.log.gz 2023-10-16T13:50:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115800.log 2023-10-16T13:50:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.104272.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109998.log.gz 2023-10-16T13:50:31.398 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122508.log 2023-10-16T13:50:31.398 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104272.log.gz 2023-10-16T13:50:31.398 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260963.log 2023-10-16T13:50:31.398 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115800.log.gz 2023-10-16T13:50:31.399 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244482.log 2023-10-16T13:50:31.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122508.log: /var/log/ceph/ceph-client.admin.260963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119340.log 2023-10-16T13:50:31.399 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122508.log.gz 2023-10-16T13:50:31.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244482.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.260963.log.gz 2023-10-16T13:50:31.400 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.244482.log.gz 2023-10-16T13:50:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119340.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119340.log.gz 2023-10-16T13:50:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245318.log 2023-10-16T13:50:31.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254476.log 2023-10-16T13:50:31.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245034.log 2023-10-16T13:50:31.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114955.log 2023-10-16T13:50:31.401 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.245318.log.gz 2023-10-16T13:50:31.402 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.254476.log.gz 2023-10-16T13:50:31.402 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245034.log: /var/log/ceph/ceph-client.admin.114955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.245034.log.gz 2023-10-16T13:50:31.402 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114955.log.gz 2023-10-16T13:50:31.402 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256898.log 2023-10-16T13:50:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248967.log 2023-10-16T13:50:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118720.log 2023-10-16T13:50:31.403 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.256898.log.gz 2023-10-16T13:50:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248967.log: /var/log/ceph/ceph-client.admin.118720.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.248967.log.gz 2023-10-16T13:50:31.404 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118720.log.gz 2023-10-16T13:50:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262091.log 2023-10-16T13:50:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121727.log 2023-10-16T13:50:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119769.log 2023-10-16T13:50:31.405 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.262091.log.gz 2023-10-16T13:50:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121727.log: /var/log/ceph/ceph-client.admin.119769.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121727.log.gz 2023-10-16T13:50:31.405 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119769.log.gz 2023-10-16T13:50:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247980.log 2023-10-16T13:50:31.406 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249461.log 2023-10-16T13:50:31.406 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244095.log 2023-10-16T13:50:31.406 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253794.log 2023-10-16T13:50:31.407 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.247980.log.gz 2023-10-16T13:50:31.407 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.249461.log.gz 2023-10-16T13:50:31.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244095.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-16T13:50:31.407 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259174.log 2023-10-16T13:50:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253794.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.244095.log.gz 2023-10-16T13:50:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.253794.log.gz 2023-10-16T13:50:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259174.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.259174.log.gz 2023-10-16T13:50:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115379.log 2023-10-16T13:50:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110274.log 2023-10-16T13:50:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124005.log 2023-10-16T13:50:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110274.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115379.log.gz 2023-10-16T13:50:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124005.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110274.log.gz 2023-10-16T13:50:31.410 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124005.log.gz 2023-10-16T13:50:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259993.log 2023-10-16T13:50:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110525.log 2023-10-16T13:50:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245976.log 2023-10-16T13:50:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110525.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.259993.log.gz 2023-10-16T13:50:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245976.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110525.log.gz 2023-10-16T13:50:31.412 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.245976.log.gz 2023-10-16T13:50:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111399.log 2023-10-16T13:50:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261017.log 2023-10-16T13:50:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250961.log 2023-10-16T13:50:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261017.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111399.log.gz 2023-10-16T13:50:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250961.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.261017.log.gz 2023-10-16T13:50:31.413 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.250961.log.gz 2023-10-16T13:50:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255037.log 2023-10-16T13:50:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124983.log 2023-10-16T13:50:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255037.log: /var/log/ceph/ceph-client.admin.124983.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.255037.log.gz 2023-10-16T13:50:31.414 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124983.log.gz 2023-10-16T13:50:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.259615.log 2023-10-16T13:50:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255519.log 2023-10-16T13:50:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.259615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123913.log 2023-10-16T13:50:31.416 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.259615.log.gz 2023-10-16T13:50:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260357.log 2023-10-16T13:50:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123913.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.255519.log.gz 2023-10-16T13:50:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260357.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123913.log.gz 2023-10-16T13:50:31.417 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.260357.log.gz 2023-10-16T13:50:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125029.log 2023-10-16T13:50:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249963.log 2023-10-16T13:50:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125029.log: /var/log/ceph/ceph-client.admin.249963.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125029.log.gz 2023-10-16T13:50:31.418 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.249963.log.gz 2023-10-16T13:50:31.418 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259312.log 2023-10-16T13:50:31.418 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259128.log 2023-10-16T13:50:31.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259312.log: /var/log/ceph/ceph-client.admin.259128.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.259128.log.gz 2023-10-16T13:50:31.419 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.259312.log.gz 2023-10-16T13:50:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257078.log 2023-10-16T13:50:31.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253702.log 2023-10-16T13:50:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248026.log 2023-10-16T13:50:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.257078.log.gz 2023-10-16T13:50:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120394.log 2023-10-16T13:50:31.420 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.253702.log.gz 2023-10-16T13:50:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248026.log: /var/log/ceph/ceph-client.admin.120394.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.248026.log.gz 2023-10-16T13:50:31.421 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120394.log.gz 2023-10-16T13:50:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115846.log 2023-10-16T13:50:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255371.log 2023-10-16T13:50:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114256.log 2023-10-16T13:50:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255371.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115846.log.gz 2023-10-16T13:50:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114256.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.255371.log.gz 2023-10-16T13:50:31.423 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114256.log.gz 2023-10-16T13:50:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256368.log 2023-10-16T13:50:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243342.log 2023-10-16T13:50:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245598.log 2023-10-16T13:50:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243342.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.256368.log.gz 2023-10-16T13:50:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 87.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.243342.log.gz--verbose 2023-10-16T13:50:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:-- /var/log/ceph/ceph-client.admin.249107.log 2023-10-16T13:50:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122708.log 2023-10-16T13:50:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249107.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.245598.log.gz 2023-10-16T13:50:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122708.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.249107.log.gz 2023-10-16T13:50:31.425 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122708.log.gz 2023-10-16T13:50:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261815.log 2023-10-16T13:50:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245652.log 2023-10-16T13:50:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.249698.log 2023-10-16T13:50:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245652.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.261815.log.gz 2023-10-16T13:50:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.249698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.245652.log.gz 2023-10-16T13:50:31.427 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.249698.log.gz 2023-10-16T13:50:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112227.log 2023-10-16T13:50:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113980.log 2023-10-16T13:50:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112227.log: /var/log/ceph/ceph-client.admin.113980.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112227.log.gz 2023-10-16T13:50:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253184.log 2023-10-16T13:50:31.428 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113980.log.gz 2023-10-16T13:50:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262413.log 2023-10-16T13:50:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119861.log 2023-10-16T13:50:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262413.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.253184.log.gz 2023-10-16T13:50:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119861.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.262413.log.gz 2023-10-16T13:50:31.430 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119861.log.gz 2023-10-16T13:50:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253748.log 2023-10-16T13:50:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249013.log 2023-10-16T13:50:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117872.log 2023-10-16T13:50:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249013.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.253748.log.gz 2023-10-16T13:50:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117872.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.249013.log.gz 2023-10-16T13:50:31.431 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117872.log.gz 2023-10-16T13:50:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117964.log 2023-10-16T13:50:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125421.log 2023-10-16T13:50:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110228.log 2023-10-16T13:50:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125421.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117964.log.gz 2023-10-16T13:50:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110228.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125421.log.gz 2023-10-16T13:50:31.433 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110228.log.gz 2023-10-16T13:50:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254861.log 2023-10-16T13:50:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124097.log 2023-10-16T13:50:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.249694.log 2023-10-16T13:50:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124097.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.254861.log.gz 2023-10-16T13:50:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.249694.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124097.log.gz 2023-10-16T13:50:31.434 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.249694.log.gz 2023-10-16T13:50:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247205.log 2023-10-16T13:50:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244049.log 2023-10-16T13:50:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247205.log: /var/log/ceph/ceph-client.admin.244049.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.247205.log.gz 2023-10-16T13:50:31.435 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.244049.log.gz 2023-10-16T13:50:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119658.log 2023-10-16T13:50:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252290.log 2023-10-16T13:50:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254430.log 2023-10-16T13:50:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252290.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119658.log.gz 2023-10-16T13:50:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254430.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.252290.log.gz 2023-10-16T13:50:31.437 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.254430.log.gz 2023-10-16T13:50:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250869.log 2023-10-16T13:50:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123072.log 2023-10-16T13:50:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250869.log: /var/log/ceph/ceph-client.admin.123072.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.250869.log.gz 2023-10-16T13:50:31.438 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123072.log.gz 2023-10-16T13:50:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260403.log 2023-10-16T13:50:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261907.log 2023-10-16T13:50:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112365.log 2023-10-16T13:50:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261907.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.260403.log.gz 2023-10-16T13:50:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112365.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.261907.log.gz 2023-10-16T13:50:31.440 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112365.log.gz 2023-10-16T13:50:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111558.log 2023-10-16T13:50:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254660.log 2023-10-16T13:50:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111558.log: /var/log/ceph/ceph-client.admin.254660.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111558.log.gz 2023-10-16T13:50:31.441 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.254660.log.gz 2023-10-16T13:50:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260733.log 2023-10-16T13:50:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254752.log 2023-10-16T13:50:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248921.log 2023-10-16T13:50:31.442 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254752.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.260733.log.gz 2023-10-16T13:50:31.442 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.254752.log.gz 2023-10-16T13:50:31.442 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248921.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.248921.log.gz 2023-10-16T13:50:31.443 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115333.log 2023-10-16T13:50:31.443 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255129.log 2023-10-16T13:50:31.443 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115333.log: /var/log/ceph/ceph-client.admin.255129.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115333.log.gz 2023-10-16T13:50:31.443 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.255129.log.gz 2023-10-16T13:50:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258128.log 2023-10-16T13:50:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251814.log 2023-10-16T13:50:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109537.log 2023-10-16T13:50:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251814.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.258128.log.gz 2023-10-16T13:50:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109537.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.251814.log.gz 2023-10-16T13:50:31.445 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109537.log.gz 2023-10-16T13:50:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118307.log 2023-10-16T13:50:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247592.log 2023-10-16T13:50:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118307.log: /var/log/ceph/ceph-client.admin.247592.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.247592.log.gz 2023-10-16T13:50:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114909.log 2023-10-16T13:50:31.446 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.118307.log.gz 2023-10-16T13:50:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248677.log 2023-10-16T13:50:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114909.log: /var/log/ceph/ceph-client.admin.248677.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114909.log.gz 2023-10-16T13:50:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117686.log 2023-10-16T13:50:31.447 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.248677.log.gz 2023-10-16T13:50:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245884.log 2023-10-16T13:50:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117686.log: /var/log/ceph/ceph-client.admin.245884.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117686.log.gz 2023-10-16T13:50:31.448 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.245884.log.gz 2023-10-16T13:50:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251007.log 2023-10-16T13:50:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254614.log 2023-10-16T13:50:31.449 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256556.log 2023-10-16T13:50:31.449 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254614.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.251007.log.gz 2023-10-16T13:50:31.449 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256556.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.254614.log.gz 2023-10-16T13:50:31.449 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.256556.log.gz 2023-10-16T13:50:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253025.log 2023-10-16T13:50:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253338.log 2023-10-16T13:50:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.253025.log: /var/log/ceph/ceph-client.admin.253338.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.253025.log.gz 2023-10-16T13:50:31.450 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.253338.log.gz 2023-10-16T13:50:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252000.log 2023-10-16T13:50:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124661.log 2023-10-16T13:50:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259036.log 2023-10-16T13:50:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124661.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.252000.log.gz 2023-10-16T13:50:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259036.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124661.log.gz 2023-10-16T13:50:31.452 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.259036.log.gz 2023-10-16T13:50:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113323.log 2023-10-16T13:50:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247071.log 2023-10-16T13:50:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.113323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244712.log 2023-10-16T13:50:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247071.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113323.log.gz 2023-10-16T13:50:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244712.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.247071.log.gz 2023-10-16T13:50:31.453 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.244712.log.gz 2023-10-16T13:50:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112135.log 2023-10-16T13:50:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250639.log 2023-10-16T13:50:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243957.log 2023-10-16T13:50:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250639.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112135.log.gz 2023-10-16T13:50:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.243957.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.250639.log.gz 2023-10-16T13:50:31.457 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.243957.log.gz 2023-10-16T13:50:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255703.log 2023-10-16T13:50:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253610.log 2023-10-16T13:50:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255703.log: /var/log/ceph/ceph-client.admin.253610.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.255703.log.gz 2023-10-16T13:50:31.458 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.253610.log.gz 2023-10-16T13:50:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247251.log 2023-10-16T13:50:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255657.log 2023-10-16T13:50:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251954.log 2023-10-16T13:50:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255657.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.247251.log.gz 2023-10-16T13:50:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251954.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.255657.log.gz 2023-10-16T13:50:31.460 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.251954.log.gz 2023-10-16T13:50:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258851.log 2023-10-16T13:50:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245744.log 2023-10-16T13:50:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258851.log: /var/log/ceph/ceph-client.admin.245744.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.258851.log.gz 2023-10-16T13:50:31.461 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.245744.log.gz 2023-10-16T13:50:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109343.log 2023-10-16T13:50:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116440.log 2023-10-16T13:50:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110818.log 2023-10-16T13:50:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116440.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109343.log.gz 2023-10-16T13:50:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110818.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116440.log.gz 2023-10-16T13:50:31.462 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110818.log.gz 2023-10-16T13:50:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116256.log 2023-10-16T13:50:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114717.log 2023-10-16T13:50:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255269.log 2023-10-16T13:50:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114717.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116256.log.gz 2023-10-16T13:50:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255269.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114717.log.gz 2023-10-16T13:50:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 89.0%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.255269.log.gz/var/log/ceph/ceph-client.0.125658.log 2023-10-16T13:50:31.464 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-16T13:50:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256990.log 2023-10-16T13:50:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.125658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.125658.log.gz 2023-10-16T13:50:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256990.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.256990.log.gz 2023-10-16T13:50:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109764.log 2023-10-16T13:50:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260641.log 2023-10-16T13:50:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244436.log 2023-10-16T13:50:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260641.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109764.log.gz 2023-10-16T13:50:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244436.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.260641.log.gz 2023-10-16T13:50:31.466 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.244436.log.gz 2023-10-16T13:50:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110044.log 2023-10-16T13:50:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120294.log 2023-10-16T13:50:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110044.log: /var/log/ceph/ceph-client.admin.120294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110044.log.gz 2023-10-16T13:50:31.467 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120294.log.gz 2023-10-16T13:50:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261583.log 2023-10-16T13:50:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115467.log 2023-10-16T13:50:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117734.log 2023-10-16T13:50:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115467.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.261583.log.gz 2023-10-16T13:50:31.468 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115467.log.gz 2023-10-16T13:50:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117734.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117734.log.gz 2023-10-16T13:50:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118261.log 2023-10-16T13:50:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112319.log 2023-10-16T13:50:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260687.log 2023-10-16T13:50:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112319.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118261.log.gz 2023-10-16T13:50:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.260687.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112319.log.gz 2023-10-16T13:50:31.470 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.260687.log.gz 2023-10-16T13:50:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256852.log 2023-10-16T13:50:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244344.log 2023-10-16T13:50:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261723.log 2023-10-16T13:50:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244344.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.256852.log.gz 2023-10-16T13:50:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261723.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.244344.log.gz 2023-10-16T13:50:31.472 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.261723.log.gz 2023-10-16T13:50:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257695.log 2023-10-16T13:50:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259266.log 2023-10-16T13:50:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116072.log 2023-10-16T13:50:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259266.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.257695.log.gz 2023-10-16T13:50:31.474 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.259266.log.gz 2023-10-16T13:50:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.116072.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116072.log.gz 2023-10-16T13:50:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112043.log 2023-10-16T13:50:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255749.log 2023-10-16T13:50:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.112043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258241.log 2023-10-16T13:50:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255749.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112043.log.gz 2023-10-16T13:50:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258241.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.255749.log.gz 2023-10-16T13:50:31.476 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.258241.log.gz 2023-10-16T13:50:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254319.log 2023-10-16T13:50:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117640.log 2023-10-16T13:50:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254319.log: /var/log/ceph/ceph-client.admin.117640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.254319.log.gz 2023-10-16T13:50:31.477 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117640.log.gz 2023-10-16T13:50:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248725.log 2023-10-16T13:50:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257851.log 2023-10-16T13:50:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.248725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115195.log 2023-10-16T13:50:31.478 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257851.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.248725.log.gz 2023-10-16T13:50:31.478 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.257851.log.gz 2023-10-16T13:50:31.478 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261999.log 2023-10-16T13:50:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122462.log 2023-10-16T13:50:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261999.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115195.log.gz 2023-10-16T13:50:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.122462.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.261999.log.gz 2023-10-16T13:50:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121311.log 2023-10-16T13:50:31.480 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.122462.log.gz 2023-10-16T13:50:31.480 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252566.log 2023-10-16T13:50:31.480 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257741.log 2023-10-16T13:50:31.481 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252566.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121311.log.gz 2023-10-16T13:50:31.481 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.252566.log.gz 2023-10-16T13:50:31.481 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257741.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.257741.log.gz 2023-10-16T13:50:31.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121497.log 2023-10-16T13:50:31.482 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109672.log 2023-10-16T13:50:31.482 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121497.log: /var/log/ceph/ceph-client.admin.109672.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121497.log.gz 2023-10-16T13:50:31.482 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97542.log 2023-10-16T13:50:31.483 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109672.log.gz 2023-10-16T13:50:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.97542.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97542.log.gz 2023-10-16T13:50:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119999.log 2023-10-16T13:50:31.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261247.log 2023-10-16T13:50:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119999.log: /var/log/ceph/ceph-client.admin.261247.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119999.log.gz 2023-10-16T13:50:31.484 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.261247.log.gz 2023-10-16T13:50:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257216.log 2023-10-16T13:50:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255611.log 2023-10-16T13:50:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119520.log 2023-10-16T13:50:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255611.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.257216.log.gz 2023-10-16T13:50:31.485 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.255611.log.gz 2023-10-16T13:50:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119520.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119520.log.gz 2023-10-16T13:50:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258990.log 2023-10-16T13:50:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125259.log 2023-10-16T13:50:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119293.log 2023-10-16T13:50:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125259.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.258990.log.gz 2023-10-16T13:50:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.119293.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125259.log.gz 2023-10-16T13:50:31.487 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119293.log.gz 2023-10-16T13:50:31.488 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252682.log 2023-10-16T13:50:31.488 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125167.log 2023-10-16T13:50:31.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250528.log 2023-10-16T13:50:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.252682.log.gz 2023-10-16T13:50:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250528.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125167.log.gz 2023-10-16T13:50:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250009.log 2023-10-16T13:50:31.489 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.250528.log.gz 2023-10-16T13:50:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122324.log 2023-10-16T13:50:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250009.log: /var/log/ceph/ceph-client.admin.122324.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.250009.log.gz 2023-10-16T13:50:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124845.log 2023-10-16T13:50:31.491 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122324.log.gz 2023-10-16T13:50:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124845.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124845.log.gz 2023-10-16T13:50:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249391.log 2023-10-16T13:50:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254568.log 2023-10-16T13:50:31.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.249391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111189.log 2023-10-16T13:50:31.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.254568.log: /var/log/ceph/ceph-client.admin.111189.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.254568.log.gz 2023-10-16T13:50:31.492 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.249391.log.gz 2023-10-16T13:50:31.493 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111189.log.gz 2023-10-16T13:50:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257124.log 2023-10-16T13:50:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251440.log 2023-10-16T13:50:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109810.log 2023-10-16T13:50:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.251440.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.257124.log.gz 2023-10-16T13:50:31.494 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.251440.log.gz 2023-10-16T13:50:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.109810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110812.log 2023-10-16T13:50:31.495 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109810.log.gz 2023-10-16T13:50:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247731.log 2023-10-16T13:50:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110571.log 2023-10-16T13:50:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247731.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110812.log.gz 2023-10-16T13:50:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.247731.log.gz 2023-10-16T13:50:31.496 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110571.log.gz 2023-10-16T13:50:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252382.log 2023-10-16T13:50:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104141.log 2023-10-16T13:50:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252382.log: /var/log/ceph/ceph-client.admin.104141.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.252382.log.gz 2023-10-16T13:50:31.497 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104141.log.gz 2023-10-16T13:50:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245792.log 2023-10-16T13:50:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124426.log 2023-10-16T13:50:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.245792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258439.log 2023-10-16T13:50:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124426.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.245792.log.gz 2023-10-16T13:50:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258439.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124426.log.gz 2023-10-16T13:50:31.499 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.258439.log.gz 2023-10-16T13:50:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123026.log 2023-10-16T13:50:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257511.log 2023-10-16T13:50:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123026.log: /var/log/ceph/ceph-client.admin.257511.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123026.log.gz 2023-10-16T13:50:31.500 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.257511.log.gz 2023-10-16T13:50:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252048.log 2023-10-16T13:50:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256322.log 2023-10-16T13:50:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.252048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114302.log 2023-10-16T13:50:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.256322.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.252048.log.gz 2023-10-16T13:50:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.114302.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.256322.log.gz 2023-10-16T13:50:31.501 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114302.log.gz 2023-10-16T13:50:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262137.log 2023-10-16T13:50:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124295.log 2023-10-16T13:50:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.262137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246779.log 2023-10-16T13:50:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.124295.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.262137.log.gz 2023-10-16T13:50:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.246779.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124295.log.gz 2023-10-16T13:50:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110136.log 2023-10-16T13:50:31.503 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.246779.log.gz 2023-10-16T13:50:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262183.log 2023-10-16T13:50:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110136.log: /var/log/ceph/ceph-client.admin.262183.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110136.log.gz 2023-10-16T13:50:31.504 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.262183.log.gz 2023-10-16T13:50:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.252919.log 2023-10-16T13:50:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247869.log 2023-10-16T13:50:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.252919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121981.log 2023-10-16T13:50:31.505 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.252919.log.gz 2023-10-16T13:50:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.247869.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-16T13:50:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121981.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.247869.log.gz 2023-10-16T13:50:31.506 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121981.log.gz 2023-10-16T13:50:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117444.log 2023-10-16T13:50:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260595.log 2023-10-16T13:50:31.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117444.log: /var/log/ceph/ceph-client.admin.260595.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117444.log.gz 2023-10-16T13:50:31.507 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.260595.log.gz 2023-10-16T13:50:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261537.log 2023-10-16T13:50:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247638.log 2023-10-16T13:50:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261537.log: /var/log/ceph/ceph-client.admin.247638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.261537.log.gz 2023-10-16T13:50:31.508 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.247638.log.gz 2023-10-16T13:50:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117538.log 2023-10-16T13:50:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249896.log 2023-10-16T13:50:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.117538.log: /var/log/ceph/ceph-client.admin.249896.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117538.log.gz 2023-10-16T13:50:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110182.log 2023-10-16T13:50:31.510 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.249896.log.gz 2023-10-16T13:50:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251210.log 2023-10-16T13:50:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.110182.log: /var/log/ceph/ceph-client.admin.251210.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110182.log.gz 2023-10-16T13:50:31.511 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.251210.log.gz 2023-10-16T13:50:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250823.log 2023-10-16T13:50:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254135.log 2023-10-16T13:50:31.512 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250823.log: /var/log/ceph/ceph-client.admin.254135.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.250823.log.gz 2023-10-16T13:50:31.512 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.254135.log.gz 2023-10-16T13:50:31.512 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121357.log 2023-10-16T13:50:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261063.log 2023-10-16T13:50:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121357.log: /var/log/ceph/ceph-client.admin.261063.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121357.log.gz 2023-10-16T13:50:31.513 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.261063.log.gz 2023-10-16T13:50:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255221.log 2023-10-16T13:50:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257787.log 2023-10-16T13:50:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255221.log: /var/log/ceph/ceph-client.admin.257787.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.255221.log.gz 2023-10-16T13:50:31.514 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.257787.log.gz 2023-10-16T13:50:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115513.log 2023-10-16T13:50:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262596.log 2023-10-16T13:50:31.515 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115513.log: /var/log/ceph/ceph-client.admin.262596.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115513.log.gz 2023-10-16T13:50:31.515 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.262596.log.gz 2023-10-16T13:50:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250164.log 2023-10-16T13:50:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260131.log 2023-10-16T13:50:31.516 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.250164.log: /var/log/ceph/ceph-client.admin.260131.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.250164.log.gz 2023-10-16T13:50:31.516 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.260131.log.gz 2023-10-16T13:50:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118102.log 2023-10-16T13:50:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116762.log 2023-10-16T13:50:31.517 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118102.log: /var/log/ceph/ceph-client.admin.116762.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118102.log.gz 2023-10-16T13:50:31.517 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116762.log.gz 2023-10-16T13:50:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261201.log 2023-10-16T13:50:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257649.log 2023-10-16T13:50:31.518 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261201.log: /var/log/ceph/ceph-client.admin.257649.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.261201.log.gz 2023-10-16T13:50:31.518 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.257649.log.gz 2023-10-16T13:50:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103833.log 2023-10-16T13:50:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244896.log 2023-10-16T13:50:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.103833.log: /var/log/ceph/ceph-client.admin.244896.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.103833.log.gz 2023-10-16T13:50:31.520 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.244896.log.gz 2023-10-16T13:50:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261109.log 2023-10-16T13:50:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114441.log 2023-10-16T13:50:31.520 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261109.log: /var/log/ceph/ceph-client.admin.114441.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.261109.log.gz 2023-10-16T13:50:31.521 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114441.log.gz 2023-10-16T13:50:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121681.log 2023-10-16T13:50:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-16T13:50:31.521 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.121681.log: /var/log/ceph/ceph-mgr.y.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121681.log.gz 2023-10-16T13:50:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111188.log 2023-10-16T13:50:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.111188.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111188.log.gz 2023-10-16T13:50:31.522 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257262.log 2023-10-16T13:50:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.257262.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.257262.log.gz 2023-10-16T13:50:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261293.log 2023-10-16T13:50:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.261293.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.261293.log.gz 2023-10-16T13:50:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258898.log 2023-10-16T13:50:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.258898.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.258898.log.gz 2023-10-16T13:50:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259817.log 2023-10-16T13:50:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.259817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.259817.log.gz 2023-10-16T13:50:31.524 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244160.log 2023-10-16T13:50:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.244160.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-16T13:50:31.525 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.244160.log.gz 2023-10-16T13:50:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118904.log 2023-10-16T13:50:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111552.log 2023-10-16T13:50:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.118904.log: /var/log/ceph/ceph-client.admin.111552.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118904.log.gz 2023-10-16T13:50:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123413.log 2023-10-16T13:50:31.526 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111552.log.gz 2023-10-16T13:50:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261631.log 2023-10-16T13:50:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.123413.log: /var/log/ceph/ceph-client.admin.261631.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123413.log.gz 2023-10-16T13:50:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255083.log 2023-10-16T13:50:31.527 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.261631.log.gz 2023-10-16T13:50:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120137.log 2023-10-16T13:50:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.255083.log: /var/log/ceph/ceph-client.admin.120137.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.255083.log.gz 2023-10-16T13:50:31.528 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120137.log.gz 2023-10-16T13:50:31.529 INFO:teuthology.orchestra.run.smithi112.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-16T13:50:31.529 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-16T13:50:31.653 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-16T13:50:31.665 INFO:teuthology.orchestra.run.smithi005.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-16T13:50:31.724 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-16T13:50:31.741 INFO:teuthology.orchestra.run.smithi112.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-16T13:50:31.750 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-16T13:50:31.836 INFO:teuthology.orchestra.run.smithi112.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-16T13:50:31.917 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-16T13:50:31.936 INFO:teuthology.orchestra.run.smithi112.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-16T13:50:32.063 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-16T13:50:32.065 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-16T13:50:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m1.112s 2023-10-16T13:50:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m3.928s 2023-10-16T13:50:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.479s 2023-10-16T13:50:32.428 INFO:teuthology.orchestra.run.smithi112.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-16T13:50:33.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-16T13:50:33.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-16T13:50:33.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-16T13:50:33.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-16T13:50:33.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-16T13:50:33.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-16T13:50:38.457 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-16T13:50:38.459 INFO:teuthology.orchestra.run.smithi112.stderr: 2023-10-16T13:50:38.459 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m7.480s 2023-10-16T13:50:38.459 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m12.551s 2023-10-16T13:50:38.460 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.425s 2023-10-16T13:50:38.460 INFO:tasks.ceph:Archiving logs... 2023-10-16T13:50:38.460 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/remote/smithi005/log 2023-10-16T13:50:38.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T13:50:39.473 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/remote/smithi112/log 2023-10-16T13:50:39.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T13:50:41.099 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T13:50:41.109 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T13:50:41.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T13:50:41.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T13:50:41.192 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T13:50:41.201 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T13:50:41.201 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:50:41.204 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T13:50:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-10-16T13:50:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-10-16T13:50:41.226 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:50:41.226 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-10-16T13:50:41.226 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +228us[ +228us] +/- 80ms 2023-10-16T13:50:41.227 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 +780us[ +773us] +/- 71ms 2023-10-16T13:50:41.227 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -1131us[-1131us] +/- 86ms 2023-10-16T13:50:41.227 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:50:41.228 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T13:50:41.229 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-10-16T13:50:41.229 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +211us[ +211us] +/- 80ms 2023-10-16T13:50:41.229 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 +776us[ +776us] +/- 71ms 2023-10-16T13:50:41.230 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 -1122us[-1122us] +/- 86ms 2023-10-16T13:50:41.230 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T13:50:41.230 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T13:50:41.251 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T13:50:41.251 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T13:50:41.260 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T13:50:41.339 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T13:50:41.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:50:41.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:50:41.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T13:50:41.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:50:41.505 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T13:50:41.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T13:50:41.530 INFO:teuthology.task.internal:Duration was 1482.298258 seconds 2023-10-16T13:50:41.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T13:50:41.540 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T13:50:41.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T13:50:41.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T13:50:41.592 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:50:41.593 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T13:50:41.788 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T13:50:41.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2023-10-16T13:50:41.789 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T13:50:41.813 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2023-10-16T13:50:41.813 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T13:50:41.834 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T13:50:41.835 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T13:50:41.855 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T13:50:41.915 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T13:50:41.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T13:50:41.918 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T13:50:42.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T13:50:42.045 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T13:50:42.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T13:50:42.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T13:50:42.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T13:50:42.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:50:42.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:50:42.139 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2023-10-16T13:50:42.165 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2023-10-16T13:50:42.178 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:50:42.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:50:42.210 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T13:50:42.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T13:50:42.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T13:50:42.246 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T13:50:42.246 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/remote/smithi005 2023-10-16T13:50:42.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T13:50:42.287 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020/remote/smithi112 2023-10-16T13:50:42.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T13:50:42.325 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T13:50:42.326 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T13:50:42.329 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T13:50:42.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T13:50:42.388 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T13:50:42.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T13:50:42.397 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T13:50:42.398 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T13:50:42.400 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T13:50:42.414 INFO:teuthology.orchestra.run.smithi005.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 13:50 /home/ubuntu/cephtest 2023-10-16T13:50:42.432 INFO:teuthology.orchestra.run.smithi112.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 13:50 /home/ubuntu/cephtest 2023-10-16T13:50:42.434 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T13:50:42.443 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T13:50:42.462 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T13:50:42.488 DEBUG:teuthology.nuke:shortname: smithi005 2023-10-16T13:50:42.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:50:42.513 DEBUG:teuthology.nuke:shortname: smithi112 2023-10-16T13:50:42.513 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:50:42.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 13:20:41.857962', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:50:42.541 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 13:20:41.855780', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T13:50:42.568 INFO:teuthology.orchestra.console.smithi005:Power off 2023-10-16T13:50:42.568 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:50:42.594 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-10-16T13:50:42.594 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:42.610 INFO:teuthology.orchestra.console.smithi112:Power off 2023-10-16T13:50:42.610 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:50:42.620 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-16T13:50:42.633 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-10-16T13:50:42.633 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:42.654 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-16T13:50:46.622 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:46.655 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:46.733 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-16T13:50:46.765 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-16T13:50:50.734 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:50.766 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:50.844 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-10-16T13:50:50.877 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-16T13:50:50.946 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-10-16T13:50:54.878 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:50:54.988 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-10-16T13:50:55.089 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-10-16T13:50:55.194 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1482.2982575893402 failure_reason: 'Test failure: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4fa5429785f541f3bab189fba4654494 status: fail success: false 2023-10-16T13:50:55.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T13:50:55.269 INFO:teuthology.run:FAIL